A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS).

Science.gov (United States)

McDermott, Orii; Orgeta, Vasiliki; Ridder, Hanne Mette; Orrell, Martin

2014-06-01

Music in Dementia Assessment Scales (MiDAS), an observational outcome measure for music therapy with people with moderate to severe dementia, was developed from qualitative data of focus groups and interviews. Expert and peer consultations were conducted at each stage of the scale development to maximize its content validity. This study aimed to evaluate the psychometric properties of MiDAS. Care home residents with dementia attended weekly group music therapy for up to ten sessions. Music therapists and care home staff were requested to complete weekly MiDAS ratings. The Quality of Life Scale (QoL-AD) was completed at three time-points. A total of 629 (staff = 306, therapist = 323) MiDAS forms were completed. The statistical analysis revealed that MiDAS has high therapist inter-rater reliability, low staff inter-rater reliability, adequate staff test-retest reliability, adequate concurrent validity, and good construct validity. High factor loadings between the five MiDAS Visual Analogue Scale (VAS) items, levels of Interest, Response, Initiation, Involvement, and Enjoyment, were found. This study indicates that MiDAS has good psychometric properties despite the small sample size. Future research with a larger sample size could provide a more in-depth psychometric evaluation, including further exploration of the underlying factors. MiDAS provides a measure of engagement with musical experience and offers insight into who is likely to benefit on other outcomes such as quality of life or reduction in psychiatric symptoms.

Psychometric evaluation of self-report outcome measures for prosthetic applications.

Science.gov (United States)

Hafner, Brian J; Morgan, Sara J; Askew, Robert L; Salem, Rana

2016-01-01

Documentation of clinical outcomes is increasingly expected in delivery of prosthetic services and devices. However, many outcome measures suitable for use in clinical care and research have not been psychometrically tested with prosthesis users. The aim of this study was to determine test-retest reliability, mode-of-administration (MoA) equivalence, standard error of measurement (SEM), and minimal detectable change (MDC) of standardized, self-report instruments that assess constructs of importance to people with lower limb loss. Prosthesis users (n = 201) were randomly assigned to groups based on MoA (i.e., paper, electronic, or mixed-mode). Participants completed two surveys 2 to 3 d apart. Instruments included the Prosthetic Limb Users Survey of Mobility, Prosthesis Evaluation Questionnaire-Mobility Subscale, Activities-Specific Balance Confidence Scale, Quality of Life in Neurological Conditions-Applied Cognition/General Concerns, Patient-Reported Outcomes Measurement Information System Profile, and Socket Comfort Score. Intraclass correlation coefficients indicated all instruments are appropriate for group-level comparisons and select instruments are suitable for individual-level applications. Several instruments showed evidence of possible floor and ceiling effects. All were equivalent across MoAs. SEM and MDC were quantified to facilitate interpretation of outcomes and change scores. These results can enhance clinicians' and researchers' ability to select, apply, and interpret scores from instruments administered to prosthesis users.

Psychometric study of the Required Care Levels for People with Severe Mental Disorder Assessment Scale (ENAR-TMG).

Science.gov (United States)

Lascorz, David; López, Victoria; Pinedo, Carmen; Trujols, Joan; Vegué, Joan; Pérez, Víctor

2016-03-08

People with severe mental disorder have significant difficulties in everyday life that involve the need for continued support. These needs are not easily measurable with the currently available tools. Therefore, a multidimensional scale that assesses the different levels of need for care is proposed, including a study of its psychometric properties. One-hundred and thirty-nine patients (58% men) with a severe mental disorder were assessed using the Required Care Levels for People with Severe Mental Disorder Assessment Scale (ENAR-TMG), the Camberwell Assessment of Need scale, and the Health of the Nation Outcome Scales. ENAR-TMG's psychometric features were examined by: a) evaluating 2 sources of validity evidence (evidence based on internal structure and evidence based on relations to other variables), and b) estimating the internal consistency, temporal stability, inter-rater reliability, and sensitivity to change of scores of the ENAR-TMG's subscales. Exploratory factor analyses revealed a one-factor structure for each of the theoretical dimensions of the scale, in which all but one showed a significant and positive correlation with the Camberwell Assessment of Need (range of r: 0.143-0.557) and Health of the Nation Outcome Scales (range of r: 0.241-0.474) scales. ENAR-TMG subscale scores showed acceptable internal consistency (range of ordinal α coefficients: 0.682-0.804), excellent test-retest (range of intraclass correlation coefficients: 0.889-0.999) and inter-rater reliabilities (range of intraclass correlation coefficients: 0.926-0.972), and satisfactory sensitivity to treatment-related changes (range of η 2 : 0.003-0.103). The satisfactory psychometric behaviour of the ENAR-TMG makes the scale a promising tool to assess global functioning in people with a severe mental disorder. Copyright © 2016 SEP y SEPB. Published by Elsevier España. All rights reserved.

A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS)

DEFF Research Database (Denmark)

McDermott, Orii; Orgeta, Vasiliki; Ridder, Hanne Mette Ochsner

2014-01-01

despite the small sample size. Future research with a larger sample size could provide a more in-depth psychometric evaluation, including further exploration of the underlying factors. MiDAS provides a measure of engagement with musical experience and offers insight into who is likely to benefit on other......Background: Music in Dementia Assessment Scales (MiDAS), an observational outcome measure for music therapy with people with moderate to severe dementia, was developed from qualitative data of focus groups and interviews. Expert and peer consultations were conducted at each stage of the scale...

Psychometric properties of the Cumulated Ambulation Score

DEFF Research Database (Denmark)

Ferriero, Giorgio; Kristensen, Morten T; Invernizzi, Marco

2018-01-01

INTRODUCTION: In the geriatric population, independent mobility is a key factor in determining readiness for discharge following acute hospitalization. The Cumulated Ambulation Score (CAS) is a potentially valuable score that allows day-to-day measurements of basic mobility. The CAS was developed...... and validated in older patients with hip fracture as an early postoperative predictor of short-term outcome, but it is also used to assess geriatric in-patients with acute medical illness. Despite the fast- accumulating literature on the CAS, to date no systematic review synthesizing its psychometric properties....... Of 49 studies identified, 17 examined the psychometric properties of the CAS. EVIDENCE SYNTHESIS: Most papers dealt with patients after hip fracture surgery, and only 4 studies assessed the CAS psychometric characteristics also in geriatric in-patients with acute medical illness. Two versions of CAS...

Psychometric Evaluation of the Diabetes Symptom Checklist-Revised (DSC-R)-A Measure of Symptom Distress

NARCIS (Netherlands)

Arbuckle, R.A.; Humphrey, L.; Vardeva, K.; Arondekar, B.; Scott, J.A.; Snoek, F.J.

2009-01-01

Objective: To assess the psychometric validity, reliability, responsiveness, and minimal important differences of the Diabetes Symptoms Checklist-Revised (DSC-R), a widely used patient-reported outcome measure of diabetes symptom distress. Research Design and Methods: Psychometric validity of the

Psychometric testing of the Chinese version of the medical outcomes study social support survey (MOS-SSS-C).

Science.gov (United States)

Yu, Doris S F; Lee, Diana T F; Woo, Jean

2004-04-01

The purpose of this study was to assess the psychometric properties of the Chinese version of the Medical Outcomes Study Social Support Survey (MOS-SSS-C) in a sample of 110 patients. Criterion-related and construct validities of the MOS-SSS-C were evaluated by correlations with the Chinese version of the Multidimensional Perceived Social Support Survey (r =.82) and the Hospital Anxiety and Depression Scale (r = -.58). Confirmatory factor analysis affirmed the four-factor structure of the MOS-SSS-C in measuring the functional aspects of perceived social support. Cronbach's alphas for the subscales ranged from.93 to.96, whereas the alpha for the overall scale was.98. The 2-week test-retest reliability of the MOS-SSS-C as measured by the intraclass correlation coefficient was.84. The MOS-SSS-C is a psychometrically sound multidimensional measure for the evaluation of functional aspects of perceived social support by Chinese patients with chronic disease. Copyright 2004 Wiley Periodicals, Inc.

Development and psychometric evaluation of a cardiovascular risk and disease management knowledge assessment tool.

Science.gov (United States)

Rosneck, James S; Hughes, Joel; Gunstad, John; Josephson, Richard; Noe, Donald A; Waechter, Donna

2014-01-01

This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.

Psychometric properties of the Late-Life Function and Disability Instrument

DEFF Research Database (Denmark)

Beauchamp, Marla K; Schmidt, Catherine T; Pedersen, Mette M

2014-01-01

The choice of measure for use as a primary outcome in geriatric research is contingent upon the construct of interest and evidence for its psychometric properties. The Late-Life Function and Disability Instrument (LLFDI) has been widely used to assess functional limitations and disability...... in studies with older adults. The primary aim of this systematic review was to evaluate the current available evidence for the psychometric properties of the LLFDI....

Assessment of Minimal HE (with emphasis on computerized psychometric tests)

Science.gov (United States)

Kappus, Matthew R; Bajaj, Jasmohan S

2012-01-01

Synopsis Minimal hepatic encephalopathy (MHE) is associated with a high risk of development of overt hepatic encephalopathy, impaired quality of life and driving accidents. The detection of MHE requires specialized testing since it cannot by definition, be diagnosed on standard clinical examination. Psychometric (paper-pencil or computerized or a combination) and neuro-physiological techniques are often used to test for MHE. Paper-pencil psychometric batteries like the Psychometric Hepatic Encephalopathy Score (PHES) have been validated in several countries but do not have US normative values. Computerized tests such as the inhibitory control test (ICT), cognitive drug research system and Scan test have proven useful to diagnose MHE and predict outcomes. The specificity and sensitivity of these tests are similar to the recommended gold standards. Neuro-physiological tests such as the EEG and its interpretations, evoked potentials and Critical Flicker Frequency (CFF) also provide useful information. The diagnosis of MHE is an important issue for clinicians and patients alike and the testing strategies depend on the normative data available, patient comfort and local expertise. PMID:22321464

Assessment of minimal hepatic encephalopathy (with emphasis on computerized psychometric tests).

Science.gov (United States)

Kappus, Matthew R; Bajaj, Jasmohan S

2012-02-01

Minimal hepatic encephalopathy (MHE) is associated with a high risk of development of overt hepatic encephalopathy, impaired quality of life, and driving accidents. The detection of MHE requires specialized testing because it cannot, by definition, be diagnosed on standard clinical examination. Psychometric and neurophysiologic techniques are often used to test for MHE. Paper-pencil psychometric batteries and computerized tests have proved useful in diagnosing MHE and predicting its outcomes. Neurophysiologic tests also provide useful information. The diagnosis of MHE is an important issue for clinicians and patients alike. Testing strategies depend on the normative data available, patient comfort, and local expertise. Copyright © 2012 Elsevier Inc. All rights reserved.

Item-Level Psychometrics of the Glasgow Outcome Scale: Extended Structured Interviews.

Science.gov (United States)

Hong, Ickpyo; Li, Chih-Ying; Velozo, Craig A

2016-04-01

The Glasgow Outcome Scale-Extended (GOSE) structured interview captures critical components of activities and participation, including home, shopping, work, leisure, and family/friend relationships. Eighty-nine community dwelling adults with mild-moderate traumatic brain injury (TBI) were recruited (average = 2.7 year post injury). Nine items of the 19 items were used for the psychometrics analysis purpose. Factor analysis and item-level psychometrics were investigated using the Rasch partial-credit model. Although the principal components analysis of residuals suggests that a single measurement factor dominates the measure, the instrument did not meet the factor analysis criteria. Five items met the rating scale criteria. Eight items fit the Rasch model. The instrument demonstrated low person reliability (0.63), low person strata (2.07), and a slight ceiling effect. The GOSE demonstrated limitations in precisely measuring activities/participation for individuals after TBI. Future studies should examine the impact of the low precision of the GOSE on effect size. © The Author(s) 2016.

Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal

Directory of Open Access Journals (Sweden)

Schwartz Carolyn E

2004-03-01

Full Text Available Abstract The increasing evidence for response shift phenomena in quality of life (QOL assessment points to the necessity to reconsider both the measurement model and the application of psychometric analyses. The proposed psychometric model posits that the QOL true score is always contingent upon parameters of the appraisal process. This new model calls into question existing methods for establishing the reliability and validity of QOL assessment tools and suggests several new approaches for describing the psychometric properties of these scales. Recommendations for integrating the assessment of appraisal into QOL research and clinical practice are discussed.

Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal

Science.gov (United States)

Schwartz, Carolyn E; Rapkin, Bruce D

2004-01-01

The increasing evidence for response shift phenomena in quality of life (QOL) assessment points to the necessity to reconsider both the measurement model and the application of psychometric analyses. The proposed psychometric model posits that the QOL true score is always contingent upon parameters of the appraisal process. This new model calls into question existing methods for establishing the reliability and validity of QOL assessment tools and suggests several new approaches for describing the psychometric properties of these scales. Recommendations for integrating the assessment of appraisal into QOL research and clinical practice are discussed. PMID:15038830

Screening Avoidant/Restrictive Food Intake Disorder (ARFID) in children: Outcomes from utilitarian versus specialist psychometrics.

Science.gov (United States)

Dovey, Terence M; Aldridge, Victoria K; Martin, Clarissa I; Wilken, Markus; Meyer, Caroline

2016-12-01

This study assessed the specificity and sensitivity of two commonly used psychometric methods to assess ARFID in children. To achieve this, a sample of 329 mothers and one father completed the Behavioral Pediatrics Feeding Assessment Scale (BPFAS) and the Child Food Neophobia Scale (CFNS). A Receiver Operating Characteristic (ROC) analysis indicated that both measures were able to successfully differentiate a known clinical sample from those of typically developing population. Although the BPFAS was more accurate at differentiating ARFID from the general population, the CFNS was acceptable and on some metrics better than its longer counterpart. The ability of a food neophobia scale to differentiate clinical and population samples, and detect gradation of food avoidance within the population sample, suggests that the multitude of psychometric measures available may be measuring similar constructs. Therefore, confidence can be expected in cross-site comparisons despite each using different psychometric measures of food avoidance in children. Copyright © 2016 Elsevier Ltd. All rights reserved.

A systematic review of generic multidimensional patient-reported outcome measures for children, part II: evaluation of psychometric performance of English-language versions in a general population.

Science.gov (United States)

Janssens, Astrid; Rogers, Morwenna; Thompson Coon, Jo; Allen, Karen; Green, Colin; Jenkinson, Crispin; Tennant, Alan; Logan, Stuart; Morris, Christopher

2015-03-01

The objectives of this systematic review were 1) to identify studies that assess the psychometric performance of the English-language version of 35 generic multidimensional patient-reported outcome measures (PROMs) for children and young people in general populations and evaluate their quality and 2) to summarize the psychometric properties of each PROM. MEDLINE, EMBASE, and PsycINFO were searched. The methodological quality of the articles was assessed using the COnsensus-based Standards for selection of health Measurement INstruments checklist. For each PROM, extracted evidence of content validity, construct validity, internal consistency, test-retest reliability, proxy reliability, responsiveness, and precision was judged against standardized reference criteria. We found no evidence for 14 PROMs. For the remaining 21 PROMs, 90 studies were identified. The methodological quality of most studies was fair. Quality was generally rated higher in more recent studies. Not reporting how missing data were handled was the most common reason for downgrading the quality. None of the 21 PROMs has had all psychometric properties evaluated; data on construct validity and internal consistency were most frequently reported. Overall, consistent positive findings for at least five psychometric properties were found for Child Health and Illness Profile, Healthy Pathways, KIDSCREEN, and Multi-dimensional Student Life Satisfaction Scale. None of the PROMs had been evaluated for responsiveness to detect change in general populations. Further well-designed studies with transparent reporting of methods and results are required. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Clinical Application and Psychometric Properties of a Norwegian Questionnaire for the Self-Assessment of Communication in Quiet and Adverse Conditions Using Two Revised APHAB Subscales.

Science.gov (United States)

Heggdal, Peder O Laugen; Nordvik, Øyvind; Brännström, Jonas; Vassbotn, Flemming; Aarstad, Anne Kari; Aarstad, Hans Jørgen

2018-01-01

Difficulty in following and understanding conversation in different daily life situations is a common complaint among persons with hearing loss. To the best of our knowledge, there is currently no published validated Norwegian questionnaire available that allows for a self-assessment of unaided communication ability in a population with hearing loss. The aims of the present study were to investigate a questionnaire for the self-assessment of communication ability, examine the psychometric properties of this questionnaire, and explore how demographic variables such as degree of hearing loss, age, and sex influence response patterns. A questionnaire based on the subscales of the Norwegian translation of the Abbreviated Profile of Hearing Aid Benefit was applied to a group of hearing aid users and normal-hearing controls. A total of 108 patients with bilateral hearing loss, and 101 controls with self-reported normal hearing. The psychometric properties were evaluated. Associations and differences between outcome scores and descriptive variables were examined. A regression analysis was performed to investigate whether descriptive variables could predict outcome. The measures of reliability suggest that the questionnaire has satisfactory psychometric properties, with the outcome of the questionnaire correlating to hearing loss severity, thus indicating that the concurrent validity of the questionnaire is good. The findings indicate that the proposed questionnaire is a valid measure of self-assessed communication ability in both quiet and adverse listening conditions in participants with and without hearing loss. American Academy of Audiology

Psychometric Assessment of Stereoscopic Head-Mounted Displays

Science.gov (United States)

2016-06-29

Journal Article 3. DATES COVERED (From – To) Jan 2015 - Dec 2015 4. TITLE AND SUBTITLE PSYCHOMETRIC ASSESSMENT OF STEREOSCOPIC HEAD- MOUNTED DISPLAYS...to render an immersive three-dimensional constructive environment. The purpose of this effort was to quantify the impact of aircrew vision on an...simulated tasks requiring precise depth discrimination. This work will provide an example validation method for future stereoscopic virtual immersive

Enhancing rigour in the validation of patient reported outcome measures (PROMs: bridging linguistic and psychometric testing

Directory of Open Access Journals (Sweden)

Roberts Gwerfyl

2012-06-01

Full Text Available Abstract Background A strong consensus exists for a systematic approach to linguistic validation of patient reported outcome measures (PROMs and discrete methods for assessing their psychometric properties. Despite the need for robust evidence of the appropriateness of measures, transition from linguistic to psychometric validation is poorly documented or evidenced. This paper demonstrates the importance of linking linguistic and psychometric testing through a purposeful stage which bridges the gap between translation and large-scale validation. Findings Evidence is drawn from a study to develop a Welsh language version of the Beck Depression Inventory-II (BDI-II and investigate its psychometric properties. The BDI-II was translated into Welsh then administered to Welsh-speaking university students (n = 115 and patients with depression (n = 37 concurrent with the English BDI-II, and alongside other established depression and quality of life measures. A Welsh version of the BDI-II was produced that, on administration, showed conceptual equivalence with the original measure; high internal consistency reliability (Cronbach’s alpha = 0.90; 0.96; item homogeneity; adequate correlation with the English BDI-II (r = 0.96; 0.94 and additional measures; and a two-factor structure with one overriding dimension. Nevertheless, in the student sample, the Welsh version showed a significantly lower overall mean than the English (p = 0.002; and significant differences in six mean item scores. This prompted a review and refinement of the translated measure. Conclusions Exploring potential sources of bias in translated measures represents a critical step in the translation-validation process, which until now has been largely underutilised. This paper offers important findings that inform advanced methods of cross-cultural validation of PROMs.

[Psychometric properties of Q-DIO, an instrument to measure the quality of documented nursing diagnoses, interventions and outcomes].

NARCIS (Netherlands)

Muller-Staub, M.; Lunney, M.; Lavin, M.A.; Needham, I.; Odenbreit, M.; Achterberg, T. van

2010-01-01

The instrument Q-DIO was developed in the years 2005 till 2006 to measure the quality of documented nursing diagnoses, interventions, and nursing sensitive patient outcomes. Testing psychometric properties of the Q-DIO (Quality of nursing Diagnoses, Interventions and Outcomes.) was the study aim.

Ancillary outcome measures for assessment of individuals with cervical spondylotic myelopathy.

Science.gov (United States)

Kalsi-Ryan, Sukhvinder; Singh, Anoushka; Massicotte, Eric M; Arnold, Paul M; Brodke, Darrel S; Norvell, Daniel C; Hermsmeyer, Jeffrey T; Fehlings, Michael G

2013-10-15

Narrative review. To identify suitable outcome measures that can be used to quantify neurological and functional impairment in the management of cervical spondylotic myelopathy (CSM). CSM is the leading cause of acquired spinal cord disability, causing varying degrees of neurological impairment which impact on independence and quality of life. Because this impairment can have a heterogeneous presentation, a single outcome measure cannot define the broad range of deficits seen in this population. Therefore, it is necessary to define outcome measures that characterize the deficits with greater validity and sensitivity. This review was conducted in 3 stages. Stage I: To evaluate the current use of outcome measures in CSM, PubMed was searched using the name of the outcome measure and the common abbreviation combined with "CSM" or "myelopathy." Stage II: Having identified a lack of appropriate outcome measures, we constructed criteria by which measures appropriate for assessing the various aspects of CSM could be identified. Stage III: A second literature search was then conducted looking at specified outcomes that met these criteria. All literature was reviewed to determine specificity and psychometric properties of outcomes for CSM. Nurick grade, modified Japanese Orthopaedic Association Scale, visual analogue scale (VAS) for pain, Short Form (36) Health Survey (SF-36), and Neck Disability Index were the most commonly cited measures. The Short-Form 36 Health Survey and Myelopathy Disability Index have been validated in the CSM population with multiple studies, whereas the modified Japanese Orthopaedic Association Scale score, Nurick grade, and European Myelopathy Scale each had only one study assessing psychometric characteristics. No validity, reliability, or responsiveness studies were found for the VAS or Neck Disability Index in the CSM population. We recommend that the modified Japanese Orthopaedic Association Scale, Nurick grade, Myelopathy Disability Index

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

Science.gov (United States)

Cordier, Reinie; Speyer, Renée; Chen, Yu-Wei; Wilkes-Gillan, Sarah; Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

Science.gov (United States)

Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Introduction Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. Objective To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. Methods A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. Conclusions The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments. PMID:26151362

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

Directory of Open Access Journals (Sweden)

Reinie Cordier

Full Text Available Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning.To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults.A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria.Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity.The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Psychometric Properties of Questionnaires on Functional Health Status in Oropharyngeal Dysphagia: A Systematic Literature Review

Science.gov (United States)

Speyer, Renée; Cordier, Reinie; Kertscher, Berit; Heijnen, Bas J

2014-01-01

Introduction. Questionnaires on Functional Health Status (FHS) are part of the assessment of oropharyngeal dysphagia. Objective. To conduct a systematic review of the literature on the psychometric properties of English-language FHS questionnaires in adults with oropharyngeal dysphagia. Methods. A systematic search was performed using the electronic databases Pubmed and Embase. The psychometric properties of the questionnaires were determined based on the COSMIN taxonomy of measurement properties and definitions for health-related patient-reported outcomes and the COSMIN checklist using preset psychometric criteria. Results. Three questionnaires were included: the Eating Assessment Tool (EAT-10), the Swallowing Outcome after Laryngectomy (SOAL), and the Self-report Symptom Inventory. The Sydney Swallow Questionnaire (SSQ) proved to be identical to the Modified Self-report Symptom Inventory. All FHS questionnaires obtained poor overall methodological quality scores for most measurement properties. Conclusions. The retrieved FHS questionnaires need psychometric reevaluation; if the overall methodological quality shows satisfactory improvement on most measurement properties, the use of the questionnaires in daily clinic and research can be justified. However, in case of insufficient validity and/or reliability scores, new FHS questionnaires need to be developed using and reporting on preestablished psychometric criteria as recommended in literature. PMID:24877095

Psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Nicotine Dependence Item Bank for use with electronic cigarettes.

Science.gov (United States)

Morean, Meghan; Krishnan-Sarin, Suchitra; Sussman, Steve; Foulds, Jonathan; Fishbein, Howard; Grana, Rachel; O'Malley, Stephanie S

2018-01-02

Psychometrically sound measures of e-cigarette dependence are lacking. We modified the PROMIS Nicotine Dependence Item Banks for use with e-cigarettes and evaluated the psychometrics of the 22-, 8- and 4-item adapted versions. 1009 adults who reported using e-cigarettes at least weekly completed an anonymous survey in Summer 2016 (50.2% male, 77.1% White, mean age 35.81 [10.71], 66.4% daily e-cigarette users, 72.6% current cigarette smokers). Psychometric analyses included confirmatory factor analysis, internal consistency, measurement invariance, examination of mean-level differences, convergent validity, and test-criterion relationships with e-cigarette use outcomes. All PROMIS-E versions had confirmable, internally consistent latent structures that were scalar invariant by sex, race, e-cigarette use (non-daily/daily), e-liquid nicotine content (no/yes), and current cigarette smoking status (no/yes). Daily e-cigarette users, nicotine e-liquid users, and cigarette smokers reported being more dependent on e-cigarettes than their counterparts. All PROMIS-E versions correlated strongly with one another, evidenced convergent validity with the Penn State E-cigarette Dependence Index and time to first e-cigarette use in the morning, and evidenced test-criterion relationships with vaping frequency, e-liquid nicotine concentration, and e-cigarette quit attempts. Similar results were observed when analyses were conducted within subsamples of exclusive e-cigarette users and duals-users of cigarettes and e-cigarettes. Each PROMIS-E version evidenced strong psychometric properties for assessing e-cigarette dependence in adults who either use e-cigarette exclusively or who are dual-users of cigarettes and e-cigarettes. However, results indicated little benefit of the longer versions over the 4-item PROMIS-E, which provides an efficient assessment of e-cigarette dependence. The availability of the novel, psychometrically sound PROMIS-E can further research on a wide range of

Modern psychometrics for assessing achievement goal orientation: a Rasch analysis.

Science.gov (United States)

Muis, Krista R; Winne, Philip H; Edwards, Ordene V

2009-09-01

A program of research is needed that assesses the psychometric properties of instruments designed to quantify students' achievement goal orientations to clarify inconsistencies across previous studies and to provide a stronger basis for future research. We conducted traditional psychometric and modern Rasch-model analyses of the Achievement Goals Questionnaire (AGQ, Elliot & McGregor, 2001) and the Patterns of Adaptive Learning Scale (PALS, Midgley et al., 2000) to provide an in-depth analysis of the two most popular instruments in educational psychology. For Study 1, 217 undergraduate students enrolled in educational psychology courses participated. Thirty-four were male and 181 were female (two did not respond). Participants completed the AGQ in the context of their educational psychology class. For Study 2, 126 undergraduate students enrolled in educational psychology courses participated. Thirty were male and 95 were female (one did not respond). Participants completed the PALS in the context of their educational psychology class. Traditional psychometric assessments of the AGQ and PALS replicated previous studies. For both, reliability estimates ranged from good to very good for raw subscale scores and fit for the models of goal orientations were good. Based on traditional psychometrics, the AGQ and PALS are valid and reliable indicators of achievement goals. Rasch analyses revealed that estimates of reliability for items were very good but respondent ability estimates varied from poor to good for both the AGQ and PALS. These findings indicate that items validly and reliably reflect a group's aggregate goal orientation, but using either instrument to characterize an individual's goal orientation is hazardous.

Questionnaire-based assessment of executive functioning: Psychometrics.

Science.gov (United States)

Castellanos, Irina; Kronenberger, William G; Pisoni, David B

2018-01-01

The psychometric properties of the Learning, Executive, and Attention Functioning (LEAF) scale were investigated in an outpatient clinical pediatric sample. As a part of clinical testing, the LEAF scale, which broadly measures neuropsychological abilities related to executive functioning and learning, was administered to parents of 118 children and adolescents referred for psychological testing at a pediatric psychology clinic; 85 teachers also completed LEAF scales to assess reliability across different raters and settings. Scores on neuropsychological tests of executive functioning and academic achievement were abstracted from charts. Psychometric analyses of the LEAF scale demonstrated satisfactory internal consistency, parent-teacher inter-rater reliability in the small to large effect size range, and test-retest reliability in the large effect size range, similar to values for other executive functioning checklists. Correlations between corresponding subscales on the LEAF and other behavior checklists were large, while most correlations with neuropsychological tests of executive functioning and achievement were significant but in the small to medium range. Results support the utility of the LEAF as a reliable and valid questionnaire-based assessment of delays and disturbances in executive functioning and learning. Applications and advantages of the LEAF and other questionnaire measures of executive functioning in clinical neuropsychology settings are discussed.

The Mayo-Portland Participation Index: A brief and psychometrically sound measure of brain injury outcome.

Science.gov (United States)

Malec, James F

2004-12-01

To evaluate the internal consistency, interrater agreement, concurrent validity, and floor and ceiling effects of the 8-item Participation Index (M2PI) of the Mayo-Portland Adaptability Inventory (MPAI). M2PI data derived from MPAIs completed independently by the people with acquired brain injury undergoing evaluation, their significant others, and rehabilitation staff were submitted to Rasch Facets analysis to determine the internal consistency of each independent rater group and of composite measures that combined rater groups. Correlations with the full-scale MPAI were examined to assess concurrent validity, as was interrater agreement. Outpatient rehabilitation in academic physical medicine and rehabilitation department. People with acquired brain injury (N=134) consecutively seen for evaluation, significant others, and evaluating staff. Not applicable. The MPAI and M2PI. The M2PI showed satisfactory internal consistency, concurrent validity, interrater agreement, and minimal floor and ceiling effects, although evidence of rater bias was also apparent. Composite indices showed more desirable psychometric properties than ratings by individual rater groups. The M2PI, particularly in composite indices and with attention to rater biases, provides an outcome measure with satisfactory psychometric qualities and the potential to represent the varying perspectives of people with acquired brain injury, significant others, and rehabilitation staff.

[The methodological assessment and qualitative evaluation of psychometric performance tests based on the example of modern tests that assess reading and spelling skills].

Science.gov (United States)

Galuschka, Katharina; Rothe, Josefine; Schulte-Körne, Gerd

2015-09-01

This article looks at a means of objectively evaluating the quality of psychometric tests. This approach enables users to evaluate psychometric tests based on their methodological characteristics, in order to decide which instrument should be used. Reading and spelling assessment tools serve as examples. The paper also provides a review of German psychometric tests for the assessment of reading and spelling skills. This method facilitates the identification of psychometric tests.of high methodological quality which can be used for the assessment of reading and spelling skills. Reading performance should ideally be assessed with the following instruments: ELFE 1-6, LGVT 6-12, LESEN 6-7, LESEN 8-9, or WLLP-R. The tests to be used for the evaluation of spelling skills are DERET 1-2+, DERET 3-4+, WRT 1+, WRT 2+, WRT 3+, WRT 4+ or HSP 1-10.

Assessing leadership decision-making styles: psychometric properties of the Leadership Judgement Indicator

Directory of Open Access Journals (Sweden)

Faraci P

2013-10-01

Full Text Available Palmira Faraci,1 Michael Lock,2 Robert Wheeler2 1Faculty of Human and Social Sciences, University of Enna “Kore”, Enna, Italy; 2Formula 4 Leadership Limited, Nottingham, UK Abstract: This study aimed to validate the Italian version of the Leadership Judgement Indicator, an unconventional instrument devoted to measurement of leaders' judgments and preferred styles, ie, directive, consultative, consensual, or delegative, when dealing with a range of decision-making scenarios. After forward-translation and back-translation, its psychometric properties were estimated for 299 managers at various levels, who were asked to put themselves in the position of leader and to rate the appropriateness of certain ways of responding to challenge. Differences between several groups of managers, ranked in order of seniority, provided evidence for discriminant validity. Internal consistency was adequate. The findings show that the Italian adaptation of the Leadership Judgement Indicator has promising psychometric qualities, suggesting its suitability for use to improve outcomes in both organizational and selection settings. Keywords: Leadership Judgement Indicator, decision-making, situational test, scenarios, psychometric properties

CRISP-Psychometric Assessment of Postdivorce Stress/Adjustment in Children.

Science.gov (United States)

Aronson, David M.; Baum, Steven K.

A new psychometric instrument for measuring the impact of divorce on elementary school age children was developed: the Child's Report of the Impact of Separation by Parents (CRISP). This structured projective test was specifically designed to assess children's postdivorce stress/adjustment. An initial version of the CRISP was administered to 99…

Psychometric model for safety culture assessment in nuclear research facilities

Energy Technology Data Exchange (ETDEWEB)

Nascimento, C.S. do, E-mail: claudio.souza@ctmsp.mar.mil.br [Centro Tecnológico da Marinha em São Paulo (CTMSP), Av. Professor Lineu Prestes 2468, 05508-000 São Paulo, SP (Brazil); Andrade, D.A., E-mail: delvonei@ipen.br [Instituto de Pesquisas Energéticas e Nucleares (IPEN/CNEN – SP), Av. Professor Lineu Prestes 2242, 05508-000 São Paulo, SP (Brazil); Mesquita, R.N. de, E-mail: rnavarro@ipen.br [Instituto de Pesquisas Energéticas e Nucleares (IPEN/CNEN – SP), Av. Professor Lineu Prestes 2242, 05508-000 São Paulo, SP (Brazil)

2017-04-01

Highlights: • A psychometric model to evaluate ‘safety climate’ at nuclear research facilities. • The model presented evidences of good psychometric qualities. • The model was applied to nuclear research facilities in Brazil. • Some ‘safety culture’ weaknesses were detected in the assessed organization. • A potential tool to develop safety management programs in nuclear facilities. - Abstract: A safe and reliable operation of nuclear power plants depends not only on technical performance, but also on the people and on the organization. Organizational factors have been recognized as the main causal mechanisms of accidents by research organizations through USA, Europe and Japan. Deficiencies related with these factors reveal weaknesses in the organization’s safety culture. A significant number of instruments to assess the safety culture based on psychometric models that evaluate safety climate through questionnaires, and which are based on reliability and validity evidences, have been published in health and ‘safety at work’ areas. However, there are few safety culture assessment instruments with these characteristics (reliability and validity) available on nuclear literature. Therefore, this work proposes an instrument to evaluate, with valid and reliable measures, the safety climate of nuclear research facilities. The instrument was developed based on methodological principles applied to research modeling and its psychometric properties were evaluated by a reliability analysis and validation of content, face and construct. The instrument was applied to an important nuclear research organization in Brazil. This organization comprises 4 research reactors and many nuclear laboratories. The survey results made possible a demographic characterization and the identification of some possible safety culture weaknesses and pointing out potential areas to be improved in the assessed organization. Good evidence of reliability with Cronbach's alpha

Psychometric model for safety culture assessment in nuclear research facilities

International Nuclear Information System (INIS)

Nascimento, C.S. do; Andrade, D.A.; Mesquita, R.N. de

2017-01-01

Highlights: • A psychometric model to evaluate ‘safety climate’ at nuclear research facilities. • The model presented evidences of good psychometric qualities. • The model was applied to nuclear research facilities in Brazil. • Some ‘safety culture’ weaknesses were detected in the assessed organization. • A potential tool to develop safety management programs in nuclear facilities. - Abstract: A safe and reliable operation of nuclear power plants depends not only on technical performance, but also on the people and on the organization. Organizational factors have been recognized as the main causal mechanisms of accidents by research organizations through USA, Europe and Japan. Deficiencies related with these factors reveal weaknesses in the organization’s safety culture. A significant number of instruments to assess the safety culture based on psychometric models that evaluate safety climate through questionnaires, and which are based on reliability and validity evidences, have been published in health and ‘safety at work’ areas. However, there are few safety culture assessment instruments with these characteristics (reliability and validity) available on nuclear literature. Therefore, this work proposes an instrument to evaluate, with valid and reliable measures, the safety climate of nuclear research facilities. The instrument was developed based on methodological principles applied to research modeling and its psychometric properties were evaluated by a reliability analysis and validation of content, face and construct. The instrument was applied to an important nuclear research organization in Brazil. This organization comprises 4 research reactors and many nuclear laboratories. The survey results made possible a demographic characterization and the identification of some possible safety culture weaknesses and pointing out potential areas to be improved in the assessed organization. Good evidence of reliability with Cronbach's alpha

Psychometrics of the neonatal oral motor assessment scale.

Science.gov (United States)

Zarem, Cori; Kidokoro, Hiroyuki; Neil, Jeffrey; Wallendorf, Michael; Inder, Terrie; Pineda, Roberta

2013-12-01

To establish the psychometrics of the Neonatal Oral Motor Assessment Scale (NOMAS). In this prospective cohort study of 75 preterm infants (39 females, 36 males) born at or before 30 weeks gestation (mean gestational age 26.56 wks, SD 1.90, range 23-30 wks; mean birthweight 967.33 g, SD 288.54, range 480-2240), oral feeding was videotaped before discharge from the neonatal intensive care unit (NICU). The NOMAS was used to classify feeding as normal, disorganized, or dysfunctional. Neurobehavior was assessed at term equivalent, and infants underwent magnetic resonance imaging. Children returned for developmental testing at 2 years corrected age. Associations between NOMAS scores and (1) neurobehavior; (2) cerebral injury and metrics; and (3) developmental outcome were investigated using χ(2) -analyses, t-tests, and linear regression. For reliability, six certified NOMAS evaluators rated five randomly selected NOMAS recordings and re-scored them 2 weeks later in a second randomized order. Reliability was calculated with Cohen's kappa statistics. Dysfunctional NOMAS scores were associated with lower Dubowitz scores [t=-2.14; mean difference -2.32 (95% confidence interval [CI] -0.157 to -4.49); p=0.036], higher stress on the NICU Network Neurobehavioral Scale (t=2.61; mean difference 0.073 [95% CI 0.017-0.129]; p=0.0110), and decreased transcerebellar diameter (t=-2.22; mean difference -2.04 [CI=-3.89 to -0.203]; p=0.03). No significant associations were found between NOMAS scores and 2-year outcome. Some concurrent validity was established with associations between NOMAS scores and measures of infant behavior and cerebral structure. The NOMAS did not show predictive validity in this study of preterm infants at high risk of developmental delay. Reliability was variable and suboptimal. © 2013 Mac Keith Press.

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

Science.gov (United States)

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

The Cervical Dystonia Impact Profile (CDIP-58: Can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

Directory of Open Access Journals (Sweden)

Bhatia Kailash P

2008-08-01

Full Text Available Abstract Background The United States Food and Drug Administration (FDA are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58, a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1 provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2 enable researchers and clinicians to compare it with existing dystonia PROMs; and 3 help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. Methods We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. Results A total of 391 people returned completed questionnaires (corrected response rate 87%. Analyses showed: 1 data quality was high (low missing data ≤ 4%, subscale scores could be computed for > 96% of the sample; 2 item groupings passed tests for scaling assumptions; 3 good targeting (except for the Sleep subscale, ceiling effect = 27%; 4 good reliability (Cronbach's alpha ≥ 0.92, test-retest intraclass correlations ≥ 0.83; and 5 validity was supported. Conclusion This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis.

Psychometric properties and clinical usefulness of the Oswestry Disability Index.

Science.gov (United States)

Vianin, Michael

2008-12-01

Outcome measures with good reliability, validity, responsiveness, and low burden of administration are clinically useful. The Oswestry Disability Index (ODI) is one of the most commonly used outcome measures for individuals with low back pain. Psychometric properties of the ODI will determine the questionnaire's suitability as a useful clinical tool. A literature search of relevant databases on psychometric evaluation of the ODI was performed. The search was done using the key words disability evaluation, and low back pain, and questionnaires, and reproducibility of results, and the term Oswestry. Inclusion criterion was direct reference regarding psychometric property, interpretability, and burden being included in the abstract. Eight articles met the inclusion criterion. The ODI shows good construct validity; internal consistency is rated as acceptable; test-retest reliability and responsiveness have been shown to be high; and burden of administration is low. The ODI is a valid, reliable, and responsive condition-specific assessment tool that is suited for use in clinical practice. It is easy to administer and score, objectifies clients' complaints, and monitors effects of therapy.

Cross-cultural psychometric assessment of the VAGUS insight into psychosis scale - Spanish version.

Science.gov (United States)

de León, Patricia Ponce; Gerretsen, Philip; Shah, Parita; Saracco-Alvarez, Ricardo; Graff-Guerrero, Ariel; Fresán, Ana

2018-01-01

Impaired insight into illness, a core feature of schizophrenia with negative clinical implications, is a multidimensional phenomenon existing on a continuum. However, the degree to which illness perception in distinct cultures influences the appraisal of insight into illness in schizophrenia remains unclear. As such, we aimed to determine if the psychometric properties of the VAGUS insight into psychosis scale (www.vagusonline.com), which was originally assessed in English speaking Canadians, were similar in a sample of Latino Mexican Spanish speaking patients with schizophrenia. To accomplish this, the VAGUS - Self-Report (SR) version was translated from English to Spanish and psychometrically evaluated in 95 participants. The Spanish version of the VAGUS-SR was internally consistent (ᾳ = 0.713), and demonstrated good convergent and discriminant validity with the subscales of the Positive and Negative Syndrome Scale. Factor analysis identified two components of insight, congruent with two of the components of the English version of the VAGUS-SR. In conclusion, the VAGUS-SR is a brief, novel, and valid measure of insight into illness in schizophrenia, which demonstrated similar psychometric properties in two culturally and linguistically distinct samples with schizophrenia. Future studies should assess whether the VAGUS demonstrates similar psychometric properties in non-Western cultures. Copyright © 2017 Elsevier B.V. All rights reserved.

A psychometric assessment of the LPME scale for the South African skills development context

Directory of Open Access Journals (Sweden)

Maelekanyo Christopher Tshilongamulenzhe

2015-09-01

Full Text Available A thorough examination of psychometric properties of measurement scales is necessary to ensure that these scales comply with the existing scientific conventions. This article assesses the psychometric properties of the Learning Programme Management and Evaluation (LPME scale. A quantitative, non-experimental cross-sectional survey design was used. Data were collected from a sample of 652 respondents comprising skills development practitioners and learners/apprentices. Data were analyzed using Winsteps, SPSS and AMOS computer software. The findings show that the LPME scale meets the psychometric expectations and complies with the established scientific conventions in terms of validity, reliability, fit and unidimensionality.

Development and psychometric evaluation of the self-assessment of psoriasis symptoms (SAPS) - clinical trial and the SAPS - real world patient-reported outcomes.

Science.gov (United States)

Armstrong, April W; Banderas, Benjamin; Foley, Catherine; Stokes, Jonathan; Sundaram, Murali; Shields, Alan L

2017-09-01

The Self-Assessment of Psoriasis Symptoms - Clinical Trials (SAPS-CT) and SAPS - Real World (SAPS-RW) were simultaneously created to assess the experience of plaque psoriasis in two unique contexts. Qualitative and quantitative research was conducted in four phases namely concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Following concept elicitation, 18 concepts were selected to inform questionnaire construction of the SAPS-CT and SAPS-RW. To accommodate each context of use, the SAPS-CT asks respondents to rate the target symptom 'at its worst' in the 24 h prior to assessment, while the SAPS-RW asks respondents to rate the target symptom "on average" in the 7 days prior to assessment. Cognitive debriefing confirmed that patients could comprehend and provide meaningful responses to both versions and, after minor modifications, resulted in 11-item questionnaires administered in an observational study (N = 200). Results from the observational study informed further item reduction (SAPS-RW to six items and SAPS-CT to nine items) and demonstrated that scores from each were reliable (Cronbach's α > 0.90, test-retest intraclass correlation coefficient >0.70), construct valid and able to differentiate among clinically distinct groups. The SAPS-CT and SAPS-RW are content-valid PRO questionnaires capable of producing psychometrically sound scores when administered chronic to plaque psoriasis patients.

Assessing outcomes of tinnitus intervention.

Science.gov (United States)

Newman, Craig W; Sandridge, Sharon A; Jacobson, Gary P

2014-01-01

It has been estimated that as many as 50 million Americans do experience or have experienced tinnitus. For approximately 12 million of these individuals, tinnitus makes it impossible for them to carry out normal everyday activities without limitation. These are the patients that present to audiology clinics for assessment and management. The tinnitus evaluation includes the measurement of acoustical characteristics of tinnitus and the impact that this impairment has on health-related quality of life (HRQoL). Tinnitus is a disorder that often occurs as a result of auditory system impairment. The impairment for some can impart an activity limitation and a participation restriction (i.e., tinnitus-related disability or handicap, respectively). The goal of tinnitus management is to reduce, or eliminate, activity limitations and participation restrictions by reducing or eliminating a patient's perception of tinnitus or their reaction to tinnitus. Implicit in this statement is the assumption that there exist standardized measures for quantifying the patient's tinnitus perception and their reaction to it. If there existed stable and responsive standardized tinnitus measures, then it would be possible to compare a patient's tinnitus experience at different time points (e.g., before and after treatment) to assess, for example, treatment efficacy. The purposes of the current review are to (1) describe psychometric standards used to select outcome measurement tools; (2) discuss available measurement techniques and their application to tinnitus evaluation and treatment-related assessment within the domains established by the World Health Organization's International Classification of Functioning, Disability and Health; (3) list and briefly describe self-report tinnitus questionnaires; (4) describe how valuation of tinnitus treatment can be assessed using economic models of treatment effectiveness; and (5) provide future directions including the development of a tinnitus

The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure.

Science.gov (United States)

Horn, Katyana Kowalchuk; Jennings, Sophie; Richardson, Gillian; Vliet, Ditte Van; Hefford, Cheryl; Abbott, J Haxby

2012-01-01

Systematic review of the literature. To summarize peer-reviewed literature on the reliability, validity, and responsiveness of the Patient-Specific Functional Scale (PSFS), and to identify its use as an outcome measure. Searches were performed of several electronic databases from 1995 to May 2010. Studies included were published articles containing (1) primary research investigating the psychometric and clinimetrics of the PSFS or (2) the implementation of the PSFS as an outcome measure. We assessed the methodological quality of studies included in the first category. Two hundred forty-two articles published from 1994 to May 2010 were identified. Of these, 66 met the inclusion criteria for this review, with 13 reporting the measurement properties of the PSFS, 55 implementing the PSFS as an outcome measure, and 2 doing both of the above. The PSFS was reported to be valid, reliable, and responsive in populations with knee dysfunction, cervical radiculopathy, acute low back pain, mechanical low back pain, and neck dysfunction. The PSFS was found to be reliable and responsive in populations with chronic low back pain. The PSFS was also reported to be valid, reliable, or responsive in individuals with a limited number of acute, subacute, and chronic conditions. This review found that the PSFS is also being used as an outcome measure in many other conditions, despite a lack of published evidence supporting its validity in these conditions. Although the use of the PSFS as an outcome measure is increasing in physiotherapy practice, there are gaps in the research literature regarding its validity, reliability, and responsiveness in many health conditions.

[Development of patient-reported outcome scale for myasthenia gravis: a psychometric test].

Science.gov (United States)

Chen, Xin-lin; Liu, Feng-bin; Guo, Li; Liu, Xiao-bin

2010-02-01

To investigate the scientificity of patient-reported outcome (PRO) scale for myasthenia gravis (MG), which was used to evaluate the clinical effects of traditional Chinese and Western medicine treatment on MG patients. Psychometric performance of the MG-PRO scale was also expected to be evaluated in this study. A total of 100 MG patients and 100 healthy people were face-to-face interviewed by well-trained investigators, and the data of MG-PRO scale were collected. The classical theory test (CTT) and item response theory (IRT) methods were used to analyze the psychometric performance such as validity, reliability, person separation index (PSI) and differential item functioning (DIF) in the MG-PRO scale. The results of CTT analysis showed that the split-half reliabilities of the MG-PRO scale and each dimension were greater than 0.7. In the analysis of internal consistency of each dimension, the Cronbach's alpha was greater than 0.8. Each facet had greater correlation with its dimension than the other dimensions. Four principal components were extracted by exploratory factor analysis, which represented all dimensions of the scale, and the cumulative variance was 55.54%. The scores of each of the 8 facets between MG patients and healthy people were different (Pdefinition and connotation of quality of life and contains special issues of MG patients as well, and shows good reliability (split-half reliability, Cronbach's alpha), validity (content validity, construct validity, discriminate validity) from the results of CTT, and good psychometric performance from the results of IRT.

Assessing leadership decision-making styles: psychometric properties of the Leadership Judgement Indicator.

Science.gov (United States)

Faraci, Palmira; Lock, Michael; Wheeler, Robert

2013-01-01

This study aimed to validate the Italian version of the Leadership Judgement Indicator, an unconventional instrument devoted to measurement of leaders' judgments and preferred styles, ie, directive, consultative, consensual, or delegative, when dealing with a range of decision-making scenarios. After forward-translation and back-translation, its psychometric properties were estimated for 299 managers at various levels, who were asked to put themselves in the position of leader and to rate the appropriateness of certain ways of responding to challenge. Differences between several groups of managers, ranked in order of seniority, provided evidence for discriminant validity. Internal consistency was adequate. The findings show that the Italian adaptation of the Leadership Judgement Indicator has promising psychometric qualities, suggesting its suitability for use to improve outcomes in both organizational and selection settings.

Assessing leadership decision-making styles: psychometric properties of the Leadership Judgement Indicator

Science.gov (United States)

Faraci, Palmira; Lock, Michael; Wheeler, Robert

2013-01-01

This study aimed to validate the Italian version of the Leadership Judgement Indicator, an unconventional instrument devoted to measurement of leaders’ judgments and preferred styles, ie, directive, consultative, consensual, or delegative, when dealing with a range of decision-making scenarios. After forward-translation and back-translation, its psychometric properties were estimated for 299 managers at various levels, who were asked to put themselves in the position of leader and to rate the appropriateness of certain ways of responding to challenge. Differences between several groups of managers, ranked in order of seniority, provided evidence for discriminant validity. Internal consistency was adequate. The findings show that the Italian adaptation of the Leadership Judgement Indicator has promising psychometric qualities, suggesting its suitability for use to improve outcomes in both organizational and selection settings. PMID:24204179

Translation, cross-cultural adaptation, and psychometric properties of the German version of the hip disability and osteoarthritis outcome score.

Science.gov (United States)

Blasimann, Angela; Dauphinee, Sharon Wood; Staal, J Bart

2014-12-01

Clinical measurement. To translate and cross-culturally adapt the Hip disability and Osteoarthritis Outcome Score (HOOS) from English into German, and to study its psychometric properties in patients after hip surgery. There is no specific hip questionnaire in German that not only measures symptoms and function but also contains items about hip-related quality of life. The translation and cross-cultural adaptation involved forward translation, harmonization, cognitive debriefing, back translation, and comparison to the original HOOS following international guidelines. The German version was tested in 51 Swiss inpatients 8 weeks after different types of hip surgery, mainly total hip replacement. The mean age of the participants was 62.5 years, and the age range was from 27 to 87 years. Thirty (58.8%) of the participants were women. Internal consistency and test-retest reliability were estimated using Cronbach alpha and intraclass correlation coefficients for agreement. For construct validity, total scores of the German HOOS were correlated with those of the Western Ontario and McMaster Universities Osteoarthritis Index. The HOOS was also compared to the Medical Outcomes Study 36-Item Short-Form Health Survey. Cronbach alpha values for all German HOOS subscales were between .87 and .93. For test-retest reliability, the intraclass correlation coefficient for agreement was 0.85 for the total scores of the German HOOS. The Spearman rho for the Medical Outcomes Study 36-Item Short-Form Health Survey physical functioning subscale compared to the sum of all HOOS subscales was 0.71, and that for the Medical Outcomes Study 36-Item Short-Form Health Survey physical component summary was 0.97. The German HOOS has demonstrated adequate reliability and validity. Use of the German HOOS is recommended for assessment of patients after hip surgery, with the proviso that additional psychometric testing should be done in future research.

Psychometric Characteristics of a Patient Reported Outcome Measure on Ego-Integrity and Despair among Cancer Patients.

Directory of Open Access Journals (Sweden)

Gitta Kleijn

Full Text Available To evaluate psychometric characteristics of a questionnaire (the Northwestern Ego-integrity Scale (NEIS on ego-integrity (the experience of wholeness and meaning in life, even in spite of negative experiences and despair (the experience of regret about the life one has led, and feelings of sadness, failure and hopelessness among cancer patients.Cancer patients (n = 164 completed patient reported outcome measures on ego-integrity and despair (NEIS, psychological distress, anxiety and depression (Hospital Anxiety and Depression Scale (HADS, and quality of life (EORTC QLQ-C30 (cancer survivors, n = 57 or EORTC QLQ-C15-PAL (advanced cancer patients, n = 107. Confirmatory Factor Analysis was used to assess construct validity. Cronbach's alpha was used to assess internal consistency. Convergent validity was tested based on a priori defined hypotheses: a higher level of ego-integrity was expected to be related to a higher level of quality of life, and lower levels of distress, depression and anxiety; a higher level of despair was expected to be related to a lower level of quality of life, and higher levels of distress, depression and anxiety.The majority of all items (94.5% of the NEIS were completed by patients and single item missing rate was below 2%. The two subscales, labeled as Ego-integrity (5 items and Despair (4 items had acceptable internal consistency (Cronbach's alpha .72 and .61, respectively. The Ego-integrity subscale was not significantly associated with quality of life, distress, anxiety, or depression. The Despair subscale correlated significantly (p <.001 with quality of life (r = -.29, distress (r = .44, anxiety (r = .47 and depression (r = .32.The NEIS has good psychometric characteristics to assess ego-integrity and despair among cancer patients.

Psychometric Assessment and Reporting Practices: Incongruence between Theory and Practice

Science.gov (United States)

Slaney, Kathleen L.; Tkatchouk, Masha; Gabriel, Stephanie M.; Maraun, Michael D.

2009-01-01

The aim of the current study is twofold: (a) to investigate the rates at which researchers assess and report on the psychometric properties of the measures they use in their research and (b) to examine whether or not researchers appear to be generally employing sound/unsound rationales when it comes to how they conduct test evaluations. Based on a…

Are existing outcome instruments suitable for assessment of spinal trauma patients?

Science.gov (United States)

Stadhouder, Agnita; Buckens, Constantinus F M; Holtslag, Herman R; Oner, F Cumhur

2010-11-01

Valid outcome assessment tools specific for spinal trauma patients are necessary to establish the efficacy of different treatment options. So far, no validated specific outcome measures are available for this patient population. The purpose of this study was to assess the current state of outcome measurement in spinal trauma patients and to address the question of whether this group is adequately served by current disease-specific and generic health-related quality-of-life instruments. A number of widely used outcome measures deemed most appropriate were reviewed, and their applicability to spinal trauma outcome discussed. An overview of recent movements in the theoretical foundations of outcome assessment, as it pertains to spinal trauma patients has been attempted, along with a discussion of domains important for spinal trauma. Commonly used outcome measures that are recommended for use in trauma patients were reviewed from the perspective of spinal trauma. The authors further sought to select a number of spine trauma-relevant domains from the WHO's comprehensive International Classification of Functioning, Disability and Health (ICF) as a benchmark for assessing the content coverage of the commonly used outcome measurements reviewed. The study showed that there are no psychometrically validated outcome measurements for the spinal trauma population and there are no commonly used outcome measures that provide adequate content coverage for spinal trauma domains. Spinal trauma patients are currently followed either as a subset of the polytrauma population in the acute and early postacute setting or as a subset of neurological injury in the long-term revalidation medicine setting.

Factor Structure and Basic Psychometric Properties of the "Transition Assessment and Goal Generator"

Science.gov (United States)

Hennessey, Maeghan N.; Terry, Robert; Martin, James E.; McConnell, Amber E.; Willis, Donna M.

2018-01-01

We examined the theoretical factor structure fit and psychometric properties of the "Transition Assessment and Goal Generator" (TAGG). In the first study, 349 transition-aged students with disabilities, their special educators, and family members completed TAGG assessments, and using exploratory factor analysis (EFA)/confirmatory factor…

Adapting the helpful responses questionnaire to assess communication skills involved in delivering contingency management: preliminary psychometrics.

Science.gov (United States)

Hartzler, Bryan

2015-08-01

A paper/pencil instrument, adapted from Miller and colleagues' (1991) Helpful Responses Questionnaire (HRQ), was developed to assess clinician skill with core communicative aspects involved in delivering contingency management (CM). The instrument presents a single vignette consisting of six points of client dialogue to which respondents write 'what they would say next.' In the context of an implementation/effectiveness hybrid trial, 19 staff clinicians at an opiate treatment program completed serial training outcome assessments before, following, and three months after CM training. Assessments included this adaptation of the HRQ, a multiple-choice CM knowledge test, and a recorded standardized patient encounter scored for CM skillfulness. Study results reveal promising psychometric properties for the instrument, including strong scoring reliability, internal consistency, concurrent and predictive validity, test-retest reliability and sensitivity to training effects. These preliminary findings suggest the instrument is a viable, practical method to assess clinician skill in communicative aspects of CM delivery. Copyright © 2015 Elsevier Inc. All rights reserved.

Assessment of psychometric properties of a modified PHEEM questionnaire.

Science.gov (United States)

Gooneratne, I K; Munasinghe, S R; Siriwardena, C; Olupeliyawa, A M; Karunathilake, I

2008-12-01

An effective tool in analysing the learning environment, customised to the Sri Lankan setting, is vital for the assessment and delivery of quality healthcare training of preregistration house officers. Such a tool should be reliable and valid. We assessed psychometric properties such as internal reliability and construct validity of a modified version of the Postgraduate Hospital Educational Environment Measure (PHEEM). A modified PHEEM questionnaire customised to the Sri Lankan context was developed in accordance to the Sri Lanka Medical Council guidelines. The questionnaire was distributed to all interns at the National Hospital of Sri Lanka, Colombo North Teaching Hospital and Wathupitiwala Base Hospital during a calendar year (n = 100, response rate = 86%). Internal reliability and construct validity of the inventory were assessed by using Cronbach's alpha and exploratory factor analysis respectively as statistical methods. PHEEM consists of 3 subscales: perceptions of autonomy, social support and teaching, which are factors perceived to be influencing the educational environment. This administration demonstrated high internal reliability as reflected by a Cronbach's alpha value of 0.84. Exploratory factor analysis identified 12 factors with eigenvalue >1. However, the first factor had an eigenvalue of 6.7 (accounting for 19.7% of variance), while the rest had eigenvalues internal reliability in assessing the educational environment of intern doctors in Sri Lanka. It is possible that the clinical educational environment is collectively represented as a single dimension. This may be due to the complex interplay between individual items in the questionnaire. Therefore the psychometric properties do not justify the interpretation of the educational environment through specified subscales.

Translation, Cross-cultural Adaptation, and Psychometric Properties of the German Version of the Hip Disability and Osteoarthritis Outcome Score

NARCIS (Netherlands)

Blasimann, A.; Dauphinee, S.W.; Staal, J.B.

2014-01-01

Study Design Clinical measurement. Objectives To translate and cross-culturally adapt the Hip disability and Osteoarthritis Outcome Score (HOOS) from English into German, and to study its psychometric properties in patients after hip surgery. Background There is no specific hip questionnaire in

The use of computer adaptive tests in outcome assessments following upper limb trauma.

Science.gov (United States)

Jayakumar, P; Overbeek, C; Vranceanu, A-M; Williams, M; Lamb, S; Ring, D; Gwilym, S

2018-06-01

Aims Outcome measures quantifying aspects of health in a precise, efficient, and user-friendly manner are in demand. Computer adaptive tests (CATs) may overcome the limitations of established fixed scales and be more adept at measuring outcomes in trauma. The primary objective of this review was to gain a comprehensive understanding of the psychometric properties of CATs compared with fixed-length scales in the assessment of outcome in patients who have suffered trauma of the upper limb. Study designs, outcome measures and methodological quality are defined, along with trends in investigation. Materials and Methods A search of multiple electronic databases was undertaken on 1 January 2017 with terms related to "CATs", "orthopaedics", "trauma", and "anatomical regions". Studies involving adults suffering trauma to the upper limb, and undergoing any intervention, were eligible. Those involving the measurement of outcome with any CATs were included. Identification, screening, and eligibility were undertaken, followed by the extraction of data and quality assessment using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) criteria. The review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria and reg istered (PROSPERO: CRD42016053886). Results A total of 31 studies reported trauma conditions alone, or in combination with non-traumatic conditions using CATs. Most were cross-sectional with varying level of evidence, number of patients, type of study, range of conditions and methodological quality. CATs correlated well with fixed scales and had minimal or no floor-ceiling effects. They required significantly fewer questions and/or less time for completion. Patient-Reported Outcomes Measurement Information System (PROMIS) CATs were the most frequently used, and the use of CATs is increasing. Conclusion Early studies show valid and reliable outcome measurement with CATs

Psychometric and Clinimetric Properties of the Melbourne Assessment 2 in Children With Cerebral Palsy.

Science.gov (United States)

Wang, Tien-Ni; Liang, Kai-Jie; Liu, Yi-Chia; Shieh, Jeng-Yi; Chen, Hao-Ling

2017-09-01

To examine the psychometric and clinimetric properties of the Melbourne Assessment 2 (MA2), an outcome measurement that is increasingly used in clinical studies. Psychometric and clinimetric study. Community. Seventeen children with cerebral palsy (CP) from 5 to 12 years were recruited for the estimation of the test-retest reliability and minimal detectable change (MDC). Thirty-five children with CP were recruited to receive an 8-week intensive neurorehabilitation intervention to estimate the validity, responsiveness, and minimal clinically important difference (MCID). Thirty-five children with CP received upper limb neurorehabilitation programs for 8 weeks. The MA2 and the criterion measures, including the Bruininks-Oseretsky Test of Motor Proficiency, 2nd edition (BOT-2), the Box and Blocks Test (BBT), and the Pediatric Motor Activity Log-Revised (PMAL-R), were evaluated at pretreatment and posttreatment. The MA2 has 4 subscales: range of motion, fluency, accuracy, and dexterity. The test-retest reliability of the MA2 is high (intraclass correlation coefficient, .92-.98). The significant relationships between the MA2 and BBT, BOT-2, and PMAL-R support its validity. The significance of paired t test results (PMA2. The MDC values of the 4 subscales of the MA2 are 2.85, 1.63, 1.97, and 1.84, respectively, and the suggested MCID values of these 4 subscales are 2.35, 3.20, 2.09, and 2.22, respectively, indicating the minimum scores of improvement to be interpreted as both statistically significant and clinically important. The study findings indicate that the MA2 has sound psychometric and clinimetric properties and is thus an adequate measurement for research and clinical applications. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development and psychometric properties of the Carer - Head Injury Neurobehavioral Assessment Scale (C-HINAS) and the Carer - Head Injury Participation Scale (C-HIPS): patient and family determined outcome scales.

Science.gov (United States)

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-06-01

Develop and assess the psychometric properties of the Carer - Head Injury Participation Scale (C-HIPS) and its biggest factor the Carer - Head Injury Neurobehavioral Assessment Scale (C-HINAS). Furthermore, the aim was to examine the inter-informant reliability by comparing the self reports of individuals with traumatic brain injury (TBI) with the carer reports on the C-HIPS and the C-HINAS. Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analysed and key themes and concepts were used to construct a 49-item and 58-item patient (Patient - Head Injury Participation Scale [P-HIPS]) and carer outcome measure (C-HIPS) respectively, of which 49 were parallel items and nine additional items were used to assess carer burden. Postal versions of the P-HIPS, C-HIPS, Mayo Portland Adaptability Inventory-3 (MPAI-3), and the Glasgow Outcome Scale-Extended (GOSE) were completed by a cohort of 113 TBI individuals and 80 carers. Data from a sub-group of 66 patient/carer pairs were used to compare inter-informant reliability between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS respectively. All individual 49 items of the C-HIPS and their total score showed good test-retest reliability (0.95) and internal consistency (0.95). Comparisons with the MPAI-3 and GOSE found a good correlation with the MPAI-3 (0.7) and a moderate negative correlation with the GOSE (-0.6). Factor analysis of these items extracted a 4-factor structure which represented the domains 'Emotion/Behavior' (C-HINAS), 'Independence/Community Living', 'Cognition', and 'Physical'. The C-HINAS showed good internal consistency (0.92), test-retest reliability (0.93), and concurrent validity with one MPAI subscale (0.7). Assessment of inter-informant reliability revealed good correspondence between the reports of the patients and the carers for both the C-HIPS (0.83) and the C-HINAS (0.82). Both the C

An evaluation of the HM prison service "thinking skills programme" using psychometric assessments.

Science.gov (United States)

Gobbett, Matthew J; Sellen, Joselyn L

2014-04-01

The most widely implemented offending behaviour programme in the United Kingdom was Enhanced Thinking Skills (ETS), a cognitive-behavioural group intervention that aimed to develop participant's general cognitive skills. A new offending behaviour programme has been developed to replace ETS: the Thinking Skills Programme (TSP). This study reports an evaluation of the effectiveness of TSP using psychometric assessments. Phasing of the two programmes created an opportunity to compare the two programmes consecutively. Forty participants, 20 from each programme, completed a range of psychometric measures to examine cognition, attitudes, and thinking styles. Analysis of pre- and post-programme psychometric results indicated that participants of TSP demonstrated improvements on 14 of the 15 scales, 9 of which were statistically significant. Effect sizes between pre-post results were generally greater for TSP than ETS, demonstrating that TSP had a more positive impact on the thinking styles and attitudes of participants than the ETS programme.

Screening Avoidant/Restrictive Food Intake Disorder (ARFID) in children: Outcomes from utilitarian versus specialist psychometrics

OpenAIRE

Dovey, T. M.; Aldridge, V. K.; Martin, C. I.; Wilken, M.; Meyer, C.

2016-01-01

This study assessed the specificity and sensitivity of two commonly used psychometric methods to assess ARFID in children. To achieve this, a sample of 329 mothers and one father completed the Behavioral Pediatrics Feeding Assessment Scale (BPFAS) and the Child Food Neophobia Scale (CFNS). A Receiver Operating Characteristic (ROC) analysis indicated that both measures were able to successfully differentiate a known clinical sample from those of typically developing population. Although the BP...

Development and psychometric properties of the client's assessment of treatment scale for supported accommodation (CAT-SA).

Science.gov (United States)

Sandhu, Sima; Killaspy, Helen; Krotofil, Joanna; McPherson, Peter; Harrison, Isobel; Dowling, Sarah; Arbuthnott, Maurice; Curtis, Sarah; King, Michael; Leavey, Gerard; Shepherd, Geoff; Priebe, Stefan

2016-02-25

Patient-Reported Outcome Measures (PROMs) are important for evaluating mental health services. Yet, no specific PROM exists for the large and diverse mental health supported accommodation sector. We aimed to produce and validate a PROM specifically for supported accommodation services, by adapting the Client's Assessment of Treatment Scale (CAT) and assessing its psychometric properties in a large sample. Focus groups with service users in the three main types of mental health supported accommodation services in the United Kingdom (residential care, supported housing and floating outreach) were conducted to adapt the contents of the original CAT items and assess the acceptability of the modified scale (CAT-SA). The CAT-SA was then administered in a survey to service users across England. Internal consistency was assessed using Cronbach's alpha. Convergent validity was tested through correlations with subjective quality of life and satisfaction with accommodation, as measured by the Manchester Short Assessment of Quality of Life (MANSA). All seven original items of the CAT were regarded as relevant to appraisals of mental health supported accommodation services, with only slight modifications to the wording required. In the survey, data were obtained from 618 clients. The internal consistency of the CAT-SA items was 0.89. Mean CAT-SA scores were correlated with the specific accommodation item on the MANSA (r s  = 0.37, p ˂ .001). The content of the CAT-SA has relevance to service users living in mental health supported accommodation. The findings from our large survey show that the CAT-SA is acceptable across different types of supported accommodation and suggest good psychometric properties. The CAT-SA appears a valid and easy to use PROM for service users in mental health supported accommodation services.

Assessing organizational climate: psychometric properties of the CLIOR Scale.

Science.gov (United States)

Peña-Suárez, Elsa; Muñiz, José; Campillo-Álvarez, Angela; Fonseca-Pedrero, Eduardo; García-Cueto, Eduardo

2013-02-01

Organizational climate is the set of perceptions shared by workers who occupy the same workplace. The main goal of this study is to develop a new organizational climate scale and to determine its psychometric properties. The sample consisted of 3,163 Health Service workers. A total of 88.7% of participants worked in hospitals, and 11.3% in primary care; 80% were women and 20% men, with a mean age of 51.9 years (SD= 6.28). The proposed scale consists of 50 Likert-type items, with an alpha coefficient of 0.97, and an essentially one-dimensional structure. The discrimination indexes of the items are greater than 0.40, and the items show no differential item functioning in relation to participants' sex. A short version of the scale was developed, made up of 15 items, with discrimination indexes higher than 0.40, an alpha coefficient of 0.94, and its structure was clearly one-dimensional. These results indicate that the new scale has adequate psychometric properties, allowing a reliable and valid assessment of organizational climate.

Sensitivity and validity of psychometric tests for assessing driving impairment: effects of sleep deprivation.

Science.gov (United States)

Jongen, Stefan; Perrier, Joy; Vuurman, Eric F; Ramaekers, Johannes G; Vermeeren, Annemiek

2015-01-01

To assess drug induced driving impairment, initial screening is needed. However, no consensus has been reached about which initial screening tools have to be used. The present study aims to determine the ability of a battery of psychometric tests to detect performance impairing effects of clinically relevant levels of drowsiness as induced by one night of sleep deprivation. Twenty four healthy volunteers participated in a 2-period crossover study in which the highway driving test was conducted twice: once after normal sleep and once after one night of sleep deprivation. The psychometric tests were conducted on 4 occasions: once after normal sleep (at 11 am) and three times during a single night of sleep deprivation (at 1 am, 5 am, and 11 am). On-the-road driving performance was significantly impaired after sleep deprivation, as measured by an increase in Standard Deviation of Lateral Position (SDLP) of 3.1 cm compared to performance after a normal night of sleep. At 5 am, performance in most psychometric tests showed significant impairment. As expected, largest effect sizes were found on performance in the Psychomotor Vigilance Test (PVT). Large effects sizes were also found in the Divided Attention Test (DAT), the Attention Network Test (ANT), and the test for Useful Field of View (UFOV) at 5 and 11 am during sleep deprivation. Effects of sleep deprivation on SDLP correlated significantly with performance changes in the PVT and the DAT, but not with performance changes in the UFOV. From the psychometric tests used in this study, the PVT and DAT seem most promising for initial evaluation of drug impairment based on sensitivity and correlations with driving impairment. Further studies are needed to assess the sensitivity and validity of these psychometric tests after benchmark sedative drug use.

Sensitivity and validity of psychometric tests for assessing driving impairment: effects of sleep deprivation.

Directory of Open Access Journals (Sweden)

Stefan Jongen

Full Text Available To assess drug induced driving impairment, initial screening is needed. However, no consensus has been reached about which initial screening tools have to be used. The present study aims to determine the ability of a battery of psychometric tests to detect performance impairing effects of clinically relevant levels of drowsiness as induced by one night of sleep deprivation.Twenty four healthy volunteers participated in a 2-period crossover study in which the highway driving test was conducted twice: once after normal sleep and once after one night of sleep deprivation. The psychometric tests were conducted on 4 occasions: once after normal sleep (at 11 am and three times during a single night of sleep deprivation (at 1 am, 5 am, and 11 am.On-the-road driving performance was significantly impaired after sleep deprivation, as measured by an increase in Standard Deviation of Lateral Position (SDLP of 3.1 cm compared to performance after a normal night of sleep. At 5 am, performance in most psychometric tests showed significant impairment. As expected, largest effect sizes were found on performance in the Psychomotor Vigilance Test (PVT. Large effects sizes were also found in the Divided Attention Test (DAT, the Attention Network Test (ANT, and the test for Useful Field of View (UFOV at 5 and 11 am during sleep deprivation. Effects of sleep deprivation on SDLP correlated significantly with performance changes in the PVT and the DAT, but not with performance changes in the UFOV.From the psychometric tests used in this study, the PVT and DAT seem most promising for initial evaluation of drug impairment based on sensitivity and correlations with driving impairment. Further studies are needed to assess the sensitivity and validity of these psychometric tests after benchmark sedative drug use.

Screening avoidant/ restrictive food intake disorder (ARFID) in children : outcomes in utilitarian versus specialist psychometrics

OpenAIRE

Dovey, T. M.; Aldridge, V. K; Martin, C. I.; Wilken, M.; Meyer, Caroline

2016-01-01

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link. This study assessed the specificity and sensitivity of two commonly used psychometric methods to assess ARFID in children. To achieve this, a sample of 329 mothers and one father completed the Behavioral Pediatrics Feeding Assessment Scale (BPFAS) and the Child Food Neophobia Scale (CFNS). A Receiver Operating Characteristic (ROC) analysis indi...

Measuring Gratitude in Youth: Assessing the Psychometric Properties of Adult Gratitude Scales in Children and Adolescents

Science.gov (United States)

Froh, Jeffrey J.; Fan, Jinyan; Emmons, Robert A.; Bono, Giacomo; Huebner, E. Scott; Watkins, Philip

2011-01-01

Before the developmental trajectory, outcomes, and related interventions of gratitude can be accurately and confidently studied among the youth, researchers must ensure that they have psychometrically sound measures of gratitude that are suitable for this population. Thus, considering that no known scales were specifically designed to measure…

Methodologically Sound: Evaluating the Psychometric Approach to the Assessment of Human Life History [Reply to Copping, Campbell, and Muncer, 2014

Science.gov (United States)

Cabeza de Baca, Tomás; Black, Candace Jasmine; García, Rafael Antonio; Fernandes, Heitor Barcellos Ferreira; Wolf, Pedro Sofio Abril; Woodley of Menie, Michael Anthony

2016-01-01

Copping, Campbell, and Muncer (2014) have recently published an article critical of the psychometric approach to the assessment of life history (LH) strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS). As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1) A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2) our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3) our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4) our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledgintheir limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods. PMID:25844774

Methodologically Sound: Evaluating the Psychometric Approach to the Assessment of Human Life History [Reply to Copping, Campbell, and Muncer, 2014

Directory of Open Access Journals (Sweden)

Aurelio José Figueredo

2015-04-01

Full Text Available Copping, Campbell, and Muncer (2014 have recently published an article critical of the psychometric approach to the assessment of life history (LH strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS. As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1 A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2 our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3 our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4 our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledging their limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods.

Psychometric properties of the Knee injury and Osteoarthritis Outcome Score for Children (KOOS-Child) in children with knee disorders

DEFF Research Database (Denmark)

Ortqvist, Maria; Iversen, Maura D; Janarv, Per-Mats

2014-01-01

-Child was developed. This study aims to evaluate psychometric properties of the final KOOS-Child when used in children with knee disorders. METHODS: 115 children (boys/girls 51/64, 7-16 years) with knee disorders were recruited. All children (n=115) completed the KOOS-Child, the Child-Health Assessment Questionnaire...... better. CONCLUSIONS: The final KOOS-Child demonstrates good psychometric properties and supports the use of the KOOS-Child when evaluating children with knee disorders....

The Behavioural Assessment of Self-Structuring (BASS): psychometric properties in a post-acute brain injury rehabilitation programme.

Science.gov (United States)

Jackson, Howard F; Tunstall, Victoria; Hague, Gemma; Daniels, Leanne; Crompton, Stacey; Taplin, Kimberly

2014-01-01

Jackson et al. (this edition) argue that structure is an important component in reducing the handicaps caused by cognitive impairments following acquired brain injury and that post-acute neuropsychological brain injury rehabilitation programmes should not only endeavour to provide structure but also aim to develop self-structuring. However, at present there is no standardized device for assessing self-structuring. To provide preliminary analysis of the psychometric properties of the Behavioural Assessment of Self-Structuring (BASS) staff rating scale (a 26 item informant five point rating scale based on the degree of support client requires to achieve self-structuring item). BASS data was utilised for clients attending residential rehabilitation. Reliability (inter-rarer and intra-rater), validity (construct, concurrent and discriminate) and sensitivity to change were investigated. Initial results indicate that the BASS has reasonably good reliability, good construct validity (via principal components analysis), good discriminant validity, and good concurrent validity correlating well with a number of other outcome measures (HoNOS; NPDS, Supervision Rating Scale, MPAI, FIM and FAM). The BASS did not correlate well with the NPCNA. Finally, the BASS was shown to demonstrate sensitivity to change. Although some caution is required in drawing firm conclusions at the present time and further exploration of the psychometric properties of the BASS is required, initial results are encouraging for the use of the BASS in assessing rehabilitation progress. These findings are discussed in terms of the value of the concept of self-structuring to the rehabilitation process for individuals with neuropsychological impairments consequent on acquired brain injury.

Development and psychometric properties of the Patient-Head Injury Participation Scale (P-HIPS) and the Patient-Head Injury Neurobehavioral Assessment Scale (P-HINAS): patient and family determined outcomes scales.

Science.gov (United States)

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-06-01

To develop a measure to assess post-acute outcome following from traumatic brain injury (TBI) with particular emphasis on the emotional and the behavioral outcome. The second objective was to assess the test-retest reliability, internal consistency, and factor structure of the newly developed patient version of the Head Injury Participation Scale (P-HIPS) and Patient-Head Injury Neurobehavioral Scale (P-HINAS). Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analyzed and key themes and concepts were used to construct the 49-item P-HIPS. A postal survey was then conducted on a cohort of 113 TBI patients to 'field test' the P-HIPS and the P-HINAS. All individual 49 items of the P-HIPS and their total score showed good test-retest reliability (0.93) and internal consistency (0.95). The P-HIPS showed a very good correlations with the Mayo Portland Adaptability Inventory-3 (MPAI-3) (0.87) and a moderate negative correlation with the Glasgow Outcome Scale-Extended (GOSE) (-0.51). Factor analysis extracted the following domains: 'Emotion/Behavior,' 'Independence/Community Living,' 'Cognition' and 'Physical'. The 'Emotion/Behavior' factor constituted the P-HINAS, which showed good internal consistency (0.93), test-retest reliability (0.91) and concurrent validity with MPAI subscale (0.82). Both the P-HIPS and the P-HINAS show strong psychometric properties. The qualitative methodology employed in the construction stage of the questionnaires provided good evidence of face and content validity.

Investigating Key Psychometric Properties of the French Version of the Early Years Evaluation-Teacher Assessment

Science.gov (United States)

Laurie, Robert; Sloat, Elizabeth

2016-01-01

This research investigates key psychometric properties of the French Early Years Evaluation-Teacher Assessment measure designed to systematically assess kindergarten children across five social and academic developmental domains: awareness of self and environment, social skills and behaviour, cognitive abilities, language and communication, and…

Psychometric qualities of questionnaires for the assessment of otitis media impact.

Science.gov (United States)

Timmerman, A A; Meesters, C M G; Speyer, R; Anteunis, L J C

2007-12-01

The assessment of impact and evaluation of treatment effects in chronic otitis media (OM) calls for a much broader approach than just examining the presence of middle ear effusion or hearing loss. It is increasingly recognised that this condition may result in a comprised quality of life. Several studies have used proxy completed questionnaires to objectify the illness experience associated with chronic OM. To review questionnaires which have been developed to describe the effects of chronic OM on the daily functioning of children. Psychometric properties have been evaluated, in addition to discriminative and evaluative qualities. A systematic review of publications pertaining to developed questionnaires related with chronic OM. Systematic literature searches of PubMed (1966-January 2007) and EMBASE (1989-January 2007) were conducted, supplemented by using free text words to identify publications after January 2005. The included 15 questionnaires were developed for children with recurrent or persistent OM, describing functional health status (FHS), while two questionnaires also evaluate the effect of tympanostomy tubes insertion. The questionnaires generally cover six impact areas (physical symptoms, child development, educational performance, emotional/practical burden and general health status) with physical symptoms being the most prominant. The OM8-30, OMO-22 and OM-6 adequately reflect the multidimensional aspects of FHS in chronic OM. The OMO-22 and OM8-30 show the best psychometric properties for the discrimination of impact severity between children, while the OM-6 was found to have the best qualities for the evaluation of clinical change. Clinical applicability is crucial for the assessment of FHS in chronic OM, but requires a trade-off with necessary psychometric properties.

Psychometric Evaluation of the Brachial Assessment Tool Part 1: Reproducibility.

Science.gov (United States)

Hill, Bridget; Williams, Gavin; Olver, John; Ferris, Scott; Bialocerkowski, Andrea

2018-04-01

To evaluate reproducibility (reliability and agreement) of the Brachial Assessment Tool (BrAT), a new patient-reported outcome measure for adults with traumatic brachial plexus injury (BPI). Prospective repeated-measure design. Outpatient clinics. Adults with confirmed traumatic BPI (N=43; age range, 19-82y). People with BPI completed the 31-item 4-response BrAT twice, 2 weeks apart. Results for the 3 subscales and summed score were compared at time 1 and time 2 to determine reliability, including systematic differences using paired t tests, test retest using intraclass correlation coefficient model 1,1 (ICC 1,1 ), and internal consistency using Cronbach α. Agreement parameters included standard error of measurement, minimal detectable change, and limits of agreement. BrAT. Test-retest reliability was excellent (ICC 1,1 =.90-.97). Internal consistency was high (Cronbach α=.90-.98). Measurement error was relatively low (standard error of measurement range, 3.1-8.8). A change of >4 for subscale 1, >6 for subscale 2, >4 for subscale 3, and >10 for the summed score is indicative of change over and above measurement error. Limits of agreement ranged from ±4.4 (subscale 3) to 11.61 (summed score). These findings support the use of the BrAT as a reproducible patient-reported outcome measure for adults with traumatic BPI with evidence of appropriate reliability and agreement for both individual and group comparisons. Further psychometric testing is required to establish the construct validity and responsiveness of the BrAT. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Assessment of time management skills: psychometric properties of the Swedish version.

Science.gov (United States)

Janeslätt, Gunnel Kristina; Holmqvist, Kajsa Lidström; White, Suzanne; Holmefur, Marie

2018-05-01

Persons with impaired time management skills are often in need of occupational therapy. Valid and reliable instruments to assess time management and organizational skills are needed for the evaluation of intervention. The purpose of this study was to evaluate the psychometric properties of a Swedish version of the Assessment of Time Management Skills (ATMS-S) for persons with and without impaired time management skills. A total of 238 persons participated in the study, of whom 94 had self-reported impaired time management skills due to mental disorders such as schizophrenic spectrum or neurodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and mild intellectual disabilities, and 144 persons had no reported impaired time management skills. Rasch analysis was used to analyze data. Three subscales were detected: the time management subscale with 11 items, the organization & planning subscale with 11 items, and the subscale of regulation of emotions with 5 items, with excellent to acceptable psychometric properties. The conclusions were that: ATMS-S is a valid instrument for self-rating of time management, organization & planning and for the regulation of emotions. ATMS-S can be useful for persons with mental disorders including mild neurodevelopmental disorders.

Assessing decentering: validation, psychometric properties, and clinical usefulness of the Experiences Questionnaire in a Spanish sample.

Science.gov (United States)

Soler, Joaquim; Franquesa, Alba; Feliu-Soler, Albert; Cebolla, Ausias; García-Campayo, Javier; Tejedor, Rosa; Demarzo, Marcelo; Baños, Rosa; Pascual, Juan Carlos; Portella, Maria J

2014-11-01

Decentering is defined as the ability to observe one's thoughts and feelings in a detached manner. The Experiences Questionnaire (EQ) is a self-report instrument that originally assessed decentering and rumination. The purpose of this study was to evaluate the psychometric properties of the Spanish version of EQ-Decentering and to explore its clinical usefulness. The 11-item EQ-Decentering subscale was translated into Spanish and psychometric properties were examined in a sample of 921 adult individuals, 231 with psychiatric disorders and 690 without. The subsample of nonpsychiatric participants was also split according to their previous meditative experience (meditative participants, n=341; and nonmeditative participants, n=349). Additionally, differences among these three subgroups were explored to determine clinical validity of the scale. Finally, EQ-Decentering was administered twice in a group of borderline personality disorder, before and after a 10-week mindfulness intervention. Confirmatory factor analysis indicated acceptable model fit, sbχ(2)=243.8836 (p.46; and divergent validity: r<-.35). The scale detected changes in decentering after a 10-session intervention in mindfulness (t=-4.692, p<.00001). Differences among groups were significant (F=134.8, p<.000001), where psychiatric participants showed the lowest scores compared to nonpsychiatric meditative and nonmeditative participants. The Spanish version of the EQ-Decentering is a valid and reliable instrument to assess decentering either in clinical and nonclinical samples. In addition, the findings show that EQ-Decentering seems an adequate outcome instrument to detect changes after mindfulness-based interventions. Copyright © 2014. Published by Elsevier Ltd.

Psychometric Properties of “Community Assessment of Psychic Experiences”: Review and Meta-analyses

Science.gov (United States)

Mark, Winifred; Toulopoulou, Timothea

2016-01-01

The Community Assessment of Psychic Experiences (CAPE) has been used extensively as a measurement for psychosis proneness in clinical and research settings. However, no prior review and meta-analysis have comprehensively examined psychometric properties (reliability and validity) of CAPE scores across different studies. To study CAPE’s internal reliability—ie, how well scale items correlate with one another—111 studies were reviewed. Of these, 18 reported unique internal reliability coefficients using data at hand, which were aggregated in a meta-analysis. Furthermore, to confirm the number and nature of factors tapped by CAPE, 17 factor analytic studies were reviewed and subjected to meta-analysis in cases of discrepancy. Results suggested that CAPE scores were psychometrically reliable—ie, scores obtained could be attributed to true score variance. Our review of factor analytic studies supported a 3-factor model for CAPE consisting of “Positive”, “Negative”, and “Depressive” subscales; and a tripartite structure for the Negative dimension consisting of “Social withdrawal”, “Affective flattening”, and “Avolition” subdimensions. Meta-analysis of factor analytic studies of the Positive dimension revealed a tridimensional structure consisting of “Bizarre experiences”, “Delusional ideations”, and “Perceptual anomalies”. Information on reliability and validity of CAPE scores is important for ensuring accurate measurement of the psychosis proneness phenotype, which in turn facilitates early detection and intervention for psychotic disorders. Apart from enhancing the understanding of psychometric properties of CAPE scores, our review revealed questionable reporting practices possibly reflecting insufficient understanding regarding the significance of psychometric properties. We recommend increased focus on psychometrics in psychology programmes and clinical journals. PMID:26150674

Measuring patient engagement: development and psychometric properties of the Patient Health Engagement (PHE) Scale.

Science.gov (United States)

Graffigna, Guendalina; Barello, Serena; Bonanomi, Andrea; Lozza, Edoardo

2015-01-01

Beyond the rhetorical call for increasing patients' engagement, policy makers recognize the urgency to have an evidence-based measure of patients' engagement and capture its effect when planning and implementing initiatives aimed at sustaining the engagement of consumers in their health. In this paper, authors describe the Patient Health Engagement Scale (PHE-scale), a measure of patient engagement that is grounded in rigorous conceptualization and appropriate psychometric methods. The scale was developed based on our previous conceptualization of patient engagement (the PHE-model). In particular, the items of the PHE-scale were developed based on the findings from the literature review and from interviews with chronic patients. Initial psychometric analysis was performed to pilot test a preliminary version of the items. The items were then refined and administered to a national sample of chronic patients (N = 382) to assess the measure's psychometric performance. A final phase of test-retest reliability was performed. The analysis showed that the PHE Scale has good psychometric properties with good correlation with concurrent measures and solid reliability. Having a valid and reliable measure to assess patient engagement is the first step in understanding patient engagement and its role in health care quality, outcomes, and cost containment. The PHE Scale shows a promising clinical relevance, indicating that it can be used to tailor intervention and assess changes after patient engagement interventions.

Psychometrics in action, science as practice.

Science.gov (United States)

Pearce, Jacob

2017-07-27

Practitioners in health sciences education and assessment regularly use a range of psychometric techniques to analyse data, evaluate models, and make crucial progression decisions regarding student learning. However, a recent editorial entitled "Is Psychometrics Science?" highlighted some core epistemological and practical problems in psychometrics, and brought its legitimacy into question. This paper attempts to address these issues by applying some key ideas from history and philosophy of science (HPS) discourse. I present some of the conceptual developments in HPS that have bearing on the psychometrics debate. Next, by shifting the focus onto what constitutes the practice of science, I discuss psychometrics in action. Some incorrectly conceptualize science as an assemblage of truths, rather than an assemblage of tools and goals. Psychometrics, however, seems to be an assemblage of methods and techniques. Psychometrics in action represents a range of practices using specific tools in specific contexts. This does not render the practice of psychometrics meaningless or futile. Engaging in debates about whether or not we should regard psychometrics as 'scientific' is, however, a fruitless enterprise. The key question and focus should be whether, on what grounds, and in what contexts, the existing methods and techniques used by psychometricians can be justified or criticized.

Internet Administration of Paper-and-Pencil Questionnaires Used in Couple Research: Assessing Psychometric Equivalence

Science.gov (United States)

Brock, Rebecca L.; Barry, Robin A.; Lawrence, Erika; Dey, Jodi; Rolffs, Jaci

2012-01-01

This study examined the psychometric equivalence of paper-and-pencil and Internet formats of key questionnaires used in couple research. Self-report questionnaires assessing interpersonal constructs (relationship satisfaction, communication/conflict management, partner support, emotional intimacy) and intrapersonal constructs (individual traits,…

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score.

Science.gov (United States)

Hung, Man; Hon, Shirley D; Cheng, Christine; Franklin, Jeremy D; Aoki, Stephen K; Anderson, Mike B; Kapron, Ashley L; Peters, Christopher L; Pelt, Christopher E

2014-12-01

The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Cohort study (diagnosis); Level of evidence, 2. Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future

[Psychometric properties of Q-DIO, an instrument to measure the quality of documented nursing diagnoses, interventions and outcomes].

Science.gov (United States)

Müller-Staub, Maria; Lunney, Margaret; Lavin, Mary Ann; Needham, Ian; Odenbreit, Matthias; van Achterberg, Theo

2010-04-01

The instrument Q-DIO was developed in the years 2005 till 2006 to measure the quality of documented nursing diagnoses, interventions, and nursing sensitive patient outcomes. Testing psychometric properties of the Q-DIO (Quality of nursing Diagnoses, Interventions and Outcomes.) was the study aim. Instrument testing included internal consistency, test-retest reliability, interrater reliability, item analyses, and an assessment of the objectivity. To render variation in scores, a random strata sample of 60 nursing documentations was drawn. The strata represented 30 nursing documentations with and 30 without application of theory based, standardised nursing language. Internal consistency of the subscale nursing diagnoses as process showed Cronbach's Alpha 0.83 [0.78, 0.88]; nursing diagnoses as product 0.98 [0.94, 0.99]; nursing interventions 0.90 [0.85, 0.94]; and nursing-sensitive patient outcomes 0.99 [0.95, 0.99]. With Cohen's Kappa of 0.95, the intrarater reliability was good. The interrater reliability showed a Kappa of 0.94 [0.90, 0.96]. Item analyses confirmed the fulfilment of criteria for degree of difficulty and discriminative validity of the items. In this study, Q-DIO has shown to be a reliable instrument. It allows measuring the documented quality of nursing diagnoses, interventions and outcomes with and without implementation of theory based, standardised nursing languages. Studies for further testing of Q-DIO in other settings are recommended. The results implicitly support the use of nursing classifications such as NANDA, NIC and NOC.

Cultural adaptation, psychometric properties, and outcomes of the Native American Spirituality Scale.

Science.gov (United States)

Greenfield, Brenna L; Hallgren, Kevin A; Venner, Kamilla L; Hagler, Kylee J; Simmons, Jeremiah D; Sheche, Judith N; Homer, Everett; Lupee, Donna

2015-05-01

Spirituality is central to many Native Americans (NAs) and has been associated with recovery from substance use disorders (SUDs). However, no published questionnaire uniquely taps tribal-specific spiritual beliefs and practices. This hinders efforts to integrate traditional NA spirituality into SUD treatment and track spiritual outcomes. As part of a randomized controlled trial examining SUD treatment for NAs, we adapted the Daily Spiritual Experience Scale (DSES) in collaboration with members of a Southwest tribe to create the Native American Spirituality Scale (NASS) and measured changes in the NASS over the course of treatment. The 83 participants (70% male) were from a single Southwest tribe and seeking SUD treatment. They completed the NASS at baseline, 4, 8, and 12 months. Exploratory factor analysis of the NASS was conducted and its temporal invariance, construct validity, and longitudinal changes in the factor and item scores were examined. The NASS yielded a 2-factor structure that was largely invariant across time. Factor 1 reflected behavioral practices, while Factor 2 reflected more global beliefs. Both factors significantly increased across 12 months, albeit at different assessment points. At baseline, Factor 1 was negatively related to substance use and positively associated with measures of tribal identification while Factor 2 was unrelated to these measures. Given the importance of tribal spirituality to many NAs, the development of this psychometrically sound measure is a key precursor and complement to the incorporation of tribal spirituality into treatment, as well as research on mechanisms of change for SUD treatment among NAs and assessment of NA spirituality in relation to other aspects of health. (c) 2015 APA, all rights reserved).

Psychometric Properties of the Problems Assessment for Substance Using Psychiatric Patients

OpenAIRE

Sayed Hadi Sayed Alitabar; Maryam Falahatpisheh; Mojtaba Habibi Asgarabad; Musa Arvin; Ali Sarvestani

2016-01-01

Background and Objective: Today, substance use problem is an important and critical problem in the world. This study investigates the psychometric properties of the Problems Assessment for Substance Using Psychiatric Patients (PASUPP).Materials and Methods: Research was descriptive and correlational. The study population consisted of all psychiatry patients with drug addiction in Tehran. The sample consisted of 381 patients (143 women and 238 men) were selected with a multi-stage cluster samp...

Psychometric Analysis of the Work/Life Balance Self-Assessment Scale.

Science.gov (United States)

Smeltzer, Suzanne C; Cantrell, Mary Ann; Sharts-Hopko, Nancy C; Heverly, Mary Ann; Jenkinson, Amanda; Nthenge, Serah

2016-01-01

This study investigated the psychometric properties of the Work/Life Balance Self-Assessment scale among nurse faculty involved in doctoral education. A national random sample of 554 respondents completed the Work/Life Balance Self-Assessment scale, which addresses 3 factors: work interference with personal life (WIPL), personal life interference with work (PLIW), and work/personal life enhancement (WPLE). A principal components analysis with varimax rotation revealed 3 internally consistent aspects of work-life balance, explaining 40.5% of the variance. The Cronbach's alpha coefficients for reliability of the scale were .88 for the total scale and for the subscales, .93 (WIPL), .85 (PLIW), and .69 (WPLE). The Work/Life Balance Self-Assessment scale appears to be a reliable and valid instrument to examine work-life balance among nurse faculty.

[Psychometric properties of an instrument for assessing cyber-sex addiction].

Science.gov (United States)

Ballester Arnal, Rafael; Gil Llario, Ma Dolores; Gómez Martínez, Sandra; Gil Juliá, Beatriz

2010-11-01

Psychometric properties of an instrument for assessing cyber-sex addiction. Cyber-sex addiction is a «new pathology» whose prevalence has grown rapidly in recent years. Therefore, it is important to have validated assessment instruments. The aim of this study was the adaptation and validation of the Internet Sex Screening Test (ISST) for its use in a Spanish population. The instrument was administered to 1239 Spanish college students. The results yielded five components that account for 47.5% of the variance. Internal consistency was .88 and temporal stability was .84. Moreover, the instrument had adequate convergent and discriminant validity and was related to other behaviors such as the use of pornography, internet addiction, number of hours online and sexual frequency. Therefore, this tool is proposed as an appropriate measure to assess cyber-sex addiction.

Questionnaires for Measuring Refractive Surgery Outcomes.

Science.gov (United States)

Kandel, Himal; Khadka, Jyoti; Lundström, Mats; Goggin, Michael; Pesudovs, Konrad

2017-06-01

To identify the questionnaires used to assess refractive surgery outcomes, assess the available questionnaires in regard to their psychometric properties, validity, and reliability, and evaluate the performance of the available questionnaires in measuring refractive surgery outcomes. An extensive literature search was done on PubMed, MEDLINE, Scopus, CINAHL, Cochrane, and Web of Science databases to identify articles that described or used at least one questionnaire to assess refractive surgery outcomes. The information on content quality, validity, reliability, responsiveness, and psychometric properties was extracted and analyzed based on an extensive set of quality criteria. Eighty-one articles describing 27 questionnaires (12 refractive error-specific, including 4 refractive surgery-specific, 7 vision-but-non-refractive, and 8 generic) were included in the review. Most articles (56, 69.1%) described refractive error-specific questionnaires. The Quality of Life Impact of Refractive Correction (QIRC), the Quality of Vision (QoV), and the Near Activity Visual Questionnaire (NAVQ) were originally constructed using Rasch analysis; others were developed using the Classical Test Theory. The National Eye Institute Refractive Quality of Life questionnaire was the most frequently used questionnaire, but it does not provide a valid measurement. The QoV, QIRC, and NAVQ are the three best existing questionnaires to assess visual symptoms, quality of life, and activity limitations, respectively. This review identified three superior quality questionnaires for measuring different aspects of quality of life in refractive surgery. Clinicians and researchers should choose a questionnaire based on the concept being measured with superior psychometric properties. [J Refract Surg. 2017;33(6):416-424.]. Copyright 2017, SLACK Incorporated.

Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties: a systematic review protocol.

Science.gov (United States)

Khadjesari, Zarnie; Vitoratou, Silia; Sevdalis, Nick; Hull, Louise

2017-10-08

Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the

Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties: a systematic review protocol

Science.gov (United States)

Vitoratou, Silia; Sevdalis, Nick; Hull, Louise

2017-01-01

Introduction Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. Methods and analysis The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethics and dissemination Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for

Development and psychometric properties of the Carer – Head Injury Neurobehavioral Assessment Scale (C-HINAS) and the Carer – Head Injury Participation Scale (C-HIPS): patient and family determined outcome scales

Science.gov (United States)

Deb, Shoumitro; Bryant, Eleanor; Morris, Paul G; Prior, Lindsay; Lewis, Glyn; Haque, Sayeed

2007-01-01

Objective Develop and assess the psychometric properties of the Carer – Head Injury Participation Scale (C-HIPS) and its biggest factor the Carer – Head Injury Neurobehavioral Assessment Scale (C-HINAS). Furthermore, the aim was to examine the inter-informant reliability by comparing the self reports of individuals with traumatic brain injury (TBI) with the carer reports on the C-HIPS and the C-HINAS. Method Thirty-two TBI individuals and 27 carers took part in in-depth qualitative interviews exploring the consequences of the TBI. Interview transcripts were analysed and key themes and concepts were used to construct a 49-item and 58-item patient (Patient – Head Injury Participation Scale [P-HIPS]) and carer outcome measure (C-HIPS) respectively, of which 49 were parallel items and nine additional items were used to assess carer burden. Postal versions of the P-HIPS, C-HIPS, Mayo Portland Adaptability Inventory-3 (MPAI-3), and the Glasgow Outcome Scale-Extended (GOSE) were completed by a cohort of 113 TBI individuals and 80 carers. Data from a sub-group of 66 patient/carer pairs were used to compare inter-informant reliability between the P-HIPS and the C-HIPS, and the P-HINAS and the C-HINAS respectively. Results All individual 49 items of the C-HIPS and their total score showed good test-retest reliability (0.95) and internal consistency (0.95). Comparisons with the MPAI-3 and GOSE found a good correlation with the MPAI-3 (0.7) and a moderate negative correlation with the GOSE (−0.6). Factor analysis of these items extracted a 4-factor structure which represented the domains ‘Emotion/Behavior’ (C-HINAS), ‘Independence/Community Living’, ‘Cognition’, and ‘Physical’. The C-HINAS showed good internal consistency (0.92), test-retest reliability (0.93), and concurrent validity with one MPAI subscale (0.7). Assessment of inter-informant reliability revealed good correspondence between the reports of the patients and the carers for both the C

Bayesian psychometric scaling

NARCIS (Netherlands)

Fox, Gerardus J.A.; van den Berg, Stéphanie Martine; Veldkamp, Bernard P.; Irwing, P.; Booth, T.; Hughes, D.

2015-01-01

In educational and psychological studies, psychometric methods are involved in the measurement of constructs, and in constructing and validating measurement instruments. Assessment results are typically used to measure student proficiency levels and test characteristics. Recently, Bayesian item

Psychometric properties of the Movement Assessment Battery for Children-Checklist as a screening instrument for children with a developmental co-ordination disorder

NARCIS (Netherlands)

Schoemaker, MM; Smits-Engelsman, BCM; Jongmans, MJ

Background. The Checklist of the Movement Assessment Battery for Children (M-ABC) was developed to screen children for movement difficulties in the school situation. However, the psychometric properties of the Checklist have not been investigated in detail. Aim. The psychometric properties of the

Assessment of psychosocial outcomes in adolescents and young adults with cancer: a systematic review of available instruments

Directory of Open Access Journals (Sweden)

Wakefield CE

2013-02-01

Full Text Available Claire E Wakefield,1,2 Pandora Patterson,3 Fiona E J McDonald,3 Helen L Wilson,1,2 Esther Davis,3 Ursula M Sansom-Daly2,41School of Women's and Children's Health, UNSW Medicine, University of New South Wales, Sydney, NSW, Australia; 2Centre for Children's Cancer and Blood Disorders, Sydney Children's Hospital, Sydney, NSW, Australia; 3CanTeen, Sydney, NSW, Australia; 4School of Psychology, University of New South Wales, Sydney, NSW, AustraliaPurpose: Given the burgeoning body of research relating to the psychosocial needs of adolescents and young adults (AYAs with cancer, this review aimed to evaluate the psychometric properties and appropriateness of the instruments available for use in this unique population. Specifically, we reviewed published instruments developed to assess psychological distress (depression, anxiety, stress, and fear of recurrence, psychological growth (resilience, posttraumatic growth, and benefit finding, unmet needs, coping, quality of life, identity, and mindfulness-based practices and skills in AYAs with cancer. Given the dearth of validated instruments targeting AYAs with cancer, this review also provides a summary of promising measures yet to be formally validated in this population.Methods: Five electronic databases were searched by a team of six researchers, and studies involving AYAs (who have or have had cancer aged 15–30 years, and published between 1982 and 2012 were reviewed. Of 410 abstracts, 7 instruments were identified as validated in this population, with a further 19 identified as promising.Results: While there are numerous scales to assess psychosocial outcomes in cancer, few have been specifically validated for AYAs affected by cancer, particularly in the domains of psychological distress, psychological growth, coping, unmet needs, and identity. There are relatively more instruments validated, or promising, for assessment of quality of life than scales for other domains.Conclusion: In the AYA context

Psychometric evaluation of a visual analog scale for the assessment of anxiety

Directory of Open Access Journals (Sweden)

Morlock Robert J

2010-06-01

Full Text Available Abstract Background Fast-acting medications for the management of anxiety are important to patients and society. Measuring early onset, however, requires a sensitive and clinically responsive tool. This study evaluates the psychometric properties of a patient-reported Global Anxiety - Visual Analog Scale (GA-VAS. Methods Data from a double-blind, randomized, placebo-controlled study of lorazepam and paroxetine in patients with Generalized Anxiety Disorder were analyzed to assess the reliability, validity, responsiveness, and utility of the GA-VAS. The GA-VAS was completed at clinic visits and at home during the first week of treatment. Targeted psychometric analyses—test-retest reliabilities, validity correlations, responsiveness statistics, and minimum important differences—were conducted. Results The GA-VAS correlates well with other anxiety measures, at Week 4, r = 0.60 (p r = 0.74 (p p p p Conclusions The GA-VAS is capable of validly and effectively capturing a reduction in anxiety as quickly as 24 hours post-dose.

Assessing the Psychometric Properties of a Scenario-Based Measure of Achievement Guilt and Shame

Science.gov (United States)

Thompson, Ted; Sharp, Jessica; Alexander, James

2008-01-01

In this study, the psychometric properties of the scenario-based Achievement Guilt and Shame Scale (AGSS) were established. The AGSS and scales assessing interpersonal guilt and shame, high standards, overgeneralization, self-criticism, self-esteem, academic self-concept, fear of failure, and tendency to respond in a socially desirable manner were…

The properties of self-report research measures: beyond psychometrics.

Science.gov (United States)

Blount, Claire; Evans, Chris; Birch, Sarah; Warren, Fiona; Norton, Kingsley

2002-06-01

Self-report measures pertinent for personality disorder are widely used and many are available. Their relative merits are usually assessed on nomothetic psychometrics and acceptability to users is neglected. We report reactions of lay, patient and professional groups to the Personality Diagnostic Questionnaire (PDQ-IV); Millon Clinical Multiaxial Inventory (MCMI-III); the Borderline Syndrome Index (BSI); Rosenberg's Self-Esteem Scale (RSE) and the Social Functioning Questionnaire (SFQ). These were sent to 148 professionals, ex-patients and lay people for comment. Thirty-six per cent were returned. Pattern-coding by three raters revealed problematic themes across all measures, including inappropriate length, vague items and language, cultural assumptions and slang, state-bias and response-set. Measures can be depressing and upsetting for some participants (both patients and non-patients), hence administration of measures should be sensitive. Treatment may make people more self-aware, which may compromise validity for outcome research. This evaluation raises issues and concerns, which are missed in traditional psychometric evaluation.

Assessment of Patient-Reported Outcome Instruments to Assess Chronic Low Back Pain.

Science.gov (United States)

Ramasamy, Abhilasha; Martin, Mona L; Blum, Steven I; Liedgens, Hiltrud; Argoff, Charles; Freynhagen, Rainer; Wallace, Mark; McCarrier, Kelly P; Bushnell, Donald M; Hatley, Noël V; Patrick, Donald L

2017-06-01

 To identify patient-reported outcome (PRO) instruments that assess chronic low back pain (cLBP) symptoms (specifically pain qualities) and/or impacts for potential use in cLBP clinical trials to demonstrate treatment benefit and support labeling claims.  Literature review of existing PRO measures.  Publications detailing existing PRO measures for cLBP were identified, reviewed, and summarized. As recommended by the US Food & Drug Administration (FDA) PRO development guidance, standard measurement characteristics were reviewed, including development history, psychometric properties (validity and reliability), ability to detect change, and interpretation of observed changes.  Thirteen instruments were selected and reviewed: Low Back Pain Bothersomeness Scale, Neuropathic Pain Symptom Inventory, PainDETECT, Pain Quality Assessment Scale Revised, Revised Short Form McGill Pain Questionnaire, Low Back Pain Impact Questionnaire, Oswestry Disability Index, Pain Disability Index, Roland-Morris Disability Questionnaire, Brief Pain Inventory and Brief Pain Inventory Short Form, Musculoskeletal Outcomes Data Evaluation and Management System Spine Module, Orebro Musculoskeletal Pain Questionnaire, and the West Haven-Yale Multidimensional Pain Inventory Interference Scale. The instruments varied in the aspects of pain and/or impacts that they assessed, and none of the instruments fulfilled all criteria for use in clinical trials to support labeling claims based on recommendations outlined in the FDA PRO guidance.  There is an unmet need for a validated PRO instrument to evaluate cLBP-related symptoms and impacts for use in clinical trials. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Working alliance inventory applied to virtual and augmented reality (WAI-VAR): psychometrics and therapeutic outcomes.

Science.gov (United States)

Miragall, Marta; Baños, Rosa M; Cebolla, Ausiàs; Botella, Cristina

2015-01-01

This study examines the psychometric properties of the Working Alliance Inventory-Short (WAI-S) adaptation to Virtual Reality (VR) and Augmented Reality (AR) therapies (WAI-VAR). The relationship between the therapeutic alliance (TA) with VR and AR and clinically significant change (CSC) is also explored. Seventy-five patients took part in this study (74.7% women, M age = 34.41). Fear of flying and adjustment disorder patients received VR therapy, and cockroach phobia patients received AR therapy. Psychometric properties, CSC, one-way ANOVA, Spearman's Correlations and Multiple Regression were calculated. The WAI-VAR showed a unidimensional structure, high internal consistency and adequate convergent validity. "Not changed" patients scored lower on the WAI-VAR than "improved" and "recovered" patients. Correlation between the WAI-VAR and CSC was moderate. The best fitting model for predicting CSC was a linear combination of the TA with therapist (WAI-S) and the TA with VR and AR (WAI-VAR), due to the latter variable slightly increased the percentage of variability accounted for in CSC. The WAI-VAR is the first validated instrument to measure the TA with VR and AR in research and clinical practice. This study reveals the importance of the quality of the TA with technologies in achieving positive outcomes in the therapy.

Psychometric Properties of the Psychosocial Assessment Tool-Chronic Pain Version in Families of Children With Headache.

Science.gov (United States)

Woods, Kristine; Ostrowski-Delahanty, Sarah

2017-07-01

Children with headache disorders are at increased psychosocial risk, and no validated screening measures exist to succinctly assess for risk. This study examined the psychometric properties of the Psychosocial Assessment Tool-Chronic Pain, a previously adapted screening measure of risk, in a retrospective sample of families of children diagnosed with headaches. Participants included 127 children and caregivers presenting for behavioral health evaluation of headache. Children and their primary caregivers completed several psychosocial assessment measures. Internal consistency for the Psychosocial Assessment Tool-Chronic Pain total score was high (α = 0.80), and all subscale scores had moderate to high internal consistency (α = 0.597-0.88), with the exception of the caregiver beliefs subscale (α = 0.443). The total score and the majority of subscale scores on the Psychosocial Assessment Tool-Chronic Pain were correlated with caregiver- and child-reported scores on study measures. The results demonstrate that the Psychosocial Assessment Tool-Chronic Pain has adequate psychometric properties, and because of the brief administration time, ease of scoring, and accessibility of the measure, it is a promising measure of screening for psychosocial risk in this population.

Evaluation of the Psychometric Properties of NOC Outcomes "Anxiety Level" and "Anxiety Self-Control" in a Portuguese Outpatient Sample.

Science.gov (United States)

Sampaio, Francisco Miguel Correia; Araújo, Odete Sofia Silva Lomba; Sequeira, Carlos Alberto da Cruz; Lluch Canut, María Teresa; Martins, Teresa

2017-01-25

To adopt the language and to evaluate the psychometric properties of "Anxiety level" and "Anxiety self-control" NOC outcomes in Portuguese adult patients. Methodological design. The final European Portuguese version of the NOC outcome "Anxiety level," composed by 16 indicators, proved excellent internal consistency. Exploratory factor analysis (EFA) was forced to three factors. The NOC outcome "Anxiety self-control," composed of nine indicators, demonstrated a questionable internal consistency. EFA was forced to two factors. European Portuguese versions of the studied NOC outcomes proved to be tools with acceptable psychometric properties for evaluating anxiety in Portuguese patients. This study contributed to the development of NOC language and to the enrichment of nursing's body of knowledge. Adaptar a linguagem e avaliar as propriedades psicométricas dos resultados NOC "Nível de ansiedade" e "Autocontrolo da ansiedade" em utentes portugueses adultos. MÉTODOS: Estudo metodológico. A versão portuguesa do resultado NOC "Nível de ansiedade", composta por 16 indicadores, apresentou uma excelente consistência interna. A análise fatorial exploratória (AFE) foi forçada a três dimensões. O resultado NOC "Autocontrolo da ansiedade", composto por nove indicadores, apresentou uma consistência interna questionável. A AFE foi forçada a duas dimensões. CONCLUSÕES: As versões portuguesas dos resultados NOC estudados são instrumentos com propriedades psicométricas aceitáveis para avaliar a ansiedade em utentes portugueses. IMPLICAÇÕES PARA A PRÁTICA DE ENFERMAGEM: Este estudo contribuiu para o desenvolvimento da linguagem NOC e para enriquecer o corpo de conhecimento de Enfermagem. © 2017 NANDA International, Inc.

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

Science.gov (United States)

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients

Psychometrics of social cognitive measures for psychosis treatment research.

Science.gov (United States)

Davidson, Charlie A; Lesser, Rebecca; Parente, Lori T; Fiszdon, Joanna M

2018-03-01

Social cognition represents an important treatment target, closely linked to everyday social function. While a number of social cognitive interventions have recently been developed, measures used to evaluate these treatments are only beginning to receive psychometric scrutiny. Study goals were to replicate recently-published psychometrics for several social cognitive measures, and to provide information for additional social cognitive measures not included in recent reports. Forty-eight outpatients with psychotic-spectrum disorders completed measures of emotion perception, theory of mind, and attributional bias on two occasions, one month apart. Measures were tested for distributional characteristics, test-retest reliability, utility as a repeated measure, and relationship to symptoms and functioning. For a subgroup of participants, information about sensitivity to social cognitive treatment was also available. We replicated aspects of prior work, including largely favorable psychometric characteristics for the Bell-Lysaker Emotion Recognition Task, and promising but weaker characteristics for The Awareness of Social Inferences Test subscales and Reading the Mind in the Eyes Task. The Hinting Task had adequate test-retest statistics but a more pronounced ceiling effect. Ambiguous Intentions and Hostility Questionnaire data showed evidence of validity but were limited by inconsistency over time. Our results strongly support the Davos Assessment of Cognitive Biases Scale for future evaluation as a social cognitive treatment outcome measure. Its scores were adequately distributed, consistent over time, related to symptoms and functioning, and sensitive to treatment effects. Other relatively novel assessments of attributional bias and theory of mind showed some promise, although more work is needed. Published by Elsevier B.V.

Psychometrical Assessment and Item Analysis of the General Health Questionnaire in Victims of Terrorism

Science.gov (United States)

Delgado-Gomez, David; Lopez-Castroman, Jorge; de Leon-Martinez, Victoria; Baca-Garcia, Enrique; Cabanas-Arrate, Maria Luisa; Sanchez-Gonzalez, Antonio; Aguado, David

2013-01-01

There is a need to assess the psychiatric morbidity that appears as a consequence of terrorist attacks. The General Health Questionnaire (GHQ) has been used to this end, but its psychometric properties have never been evaluated in a population affected by terrorism. A sample of 891 participants included 162 direct victims of terrorist attacks and…

Turkish adaptation and psychometric characteristics of the Nursing Authority and Autonomy Scale.

Science.gov (United States)

Basaran Acil, Seher; Dinç, Leyla

2018-04-14

To adapt the Nursing Authority and Autonomy Scale (NAAS) into Turkish the Nursing Authority and Autonomy Scale (NAAS) to Turkish and assess its psychometric properties for Turkish nurses and nurse managers. The NAAS is a tool that specifically measures nursing authority and autonomy from the perspectives of nurses and nurse managers. The study sample consisted of 160 nurse managers and 266 staff nurses. Content validity was assessed using expert approval. Construct validity was assessed using confirmatory factor analysis. Internal consistency was assessed using Cronbach's α, and the test-retest reliability was assessed using Pearson's correlation coefficients. The model achieved a good fit. The internal reliability of the NAAS' authority and autonomy in nursing practice and importance of nursing practice subscales were .84. The Cronbach's α of the instrument was .88. The test-retest scores within an interval of 3 weeks were statistically not significant. The Turkish version of the NAAS has good psychometric properties and this scale can be employed to measure nurses' authority and autonomy. Nurse managers and educators should use an appropriate scale such as NAAS in order to assess nurses' clinical authority and autonomy to improve patient outcomes and develop nurses. © 2018 John Wiley & Sons Ltd.

Clinical and Psychometric Evaluations of the Cerebral Vision Screening Questionnaire in 461 Nonaphasic Individuals Poststroke.

Science.gov (United States)

Neumann, Guenter; Schaadt, Anna-Katharina; Reinhart, Stefan; Kerkhoff, Georg

2016-03-01

Cerebral vision disorders (CVDs) are frequent after brain damage and impair the patient's outcome. Yet clinically and psychometrically validated procedures for the anamnesis of CVD are lacking. To evaluate the clinical validity and psychometric qualities of the Cerebral Vision Screening Questionnaire (CVSQ) for the anamnesis of CVD in individuals poststroke. Analysis of the patients' subjective visual complaints in the 10-item CVSQ in relation to objective visual perimetry, tests of reading, visual scanning, visual acuity, spatial contrast sensitivity, light/dark adaptation, and visual depth judgments. Psychometric analyses of concurrent validity, specificity, sensitivity, positive/negative predictive value, and interrater reliability were also done. Four hundred sixty-one patients with unilateral (39.5% left, 47.5% right) or bilateral stroke (13.0%) were included. Most patients were assessed in the chronic stage, on average 36.7 (range = 1-620) weeks poststroke. The majority of all patients (96.4%) recognized their visual symptoms within 1 week poststroke when asked for specifically. Mean concurrent validity of the CVSQ with objective tests was 0.64 (0.54-0.79, P reliability was 0.76 for a 1-week interval between both assessments (all P guides the clinician in the selection of necessary assessments and appropriate neurovisual therapies for the patient. © The Author(s) 2015.

Validity, Reliability, and the Questionable Role of Psychometrics in Plastic Surgery

Science.gov (United States)

2014-01-01

Summary: This report examines the meaning of validity and reliability and the role of psychometrics in plastic surgery. Study titles increasingly include the word “valid” to support the authors’ claims. Studies by other investigators may be labeled “not validated.” Validity simply refers to the ability of a device to measure what it intends to measure. Validity is not an intrinsic test property. It is a relative term most credibly assigned by the independent user. Similarly, the word “reliable” is subject to interpretation. In psychometrics, its meaning is synonymous with “reproducible.” The definitions of valid and reliable are analogous to accuracy and precision. Reliability (both the reliability of the data and the consistency of measurements) is a prerequisite for validity. Outcome measures in plastic surgery are intended to be surveys, not tests. The role of psychometric modeling in plastic surgery is unclear, and this discipline introduces difficult jargon that can discourage investigators. Standard statistical tests suffice. The unambiguous term “reproducible” is preferred when discussing data consistency. Study design and methodology are essential considerations when assessing a study’s validity. PMID:25289354

Validity, Reliability, and the Questionable Role of Psychometrics in Plastic Surgery

Directory of Open Access Journals (Sweden)

Eric Swanson, MD

2014-06-01

Full Text Available Summary: This report examines the meaning of validity and reliability and the role of psychometrics in plastic surgery. Study titles increasingly include the word “valid” to support the authors’ claims. Studies by other investigators may be labeled “not validated.” Validity simply refers to the ability of a device to measure what it intends to measure. Validity is not an intrinsic test property. It is a relative term most credibly assigned by the independent user. Similarly, the word “reliable” is subject to interpretation. In psychometrics, its meaning is synonymous with “reproducible.” The definitions of valid and reliable are analogous to accuracy and precision. Reliability (both the reliability of the data and the consistency of measurements is a prerequisite for validity. Outcome measures in plastic surgery are intended to be surveys, not tests. The role of psychometric modeling in plastic surgery is unclear, and this discipline introduces difficult jargon that can discourage investigators. Standard statistical tests suffice. The unambiguous term “reproducible” is preferred when discussing data consistency. Study design and methodology are essential considerations when assessing a study’s validity.

Psychometric Evaluation of the Hospital Culture of Transitions Survey.

Science.gov (United States)

McClelland, Mark; Bena, James; Albert, Nancy M; Pines, Jesse M

2017-10-01

Ineffective or inefficient transitions threaten patient safety, hinder communication, and worsen patient outcomes. The Hospital Culture of Transitions (H-CulT) survey was designed to assess a hospital's organizational culture related to within-hospital transitions in care involving patient movement. In this article, psychometric properties of the H-CulT survey were examined to assess and refine the hospital culture of transitions. A cross-sectional, multicenter, multidisciplinary correlational design and survey methods were used to examine the psychometric properties of the H-CulT survey. Exploratory factor analysis was used to quantify the accuracy of the previously identified structure. Specifically, the analysis involved the principal axis factor method with an oblique rotation, based on a polychoric correlation matrix. A sample of 492 respondents from 13 diverse hospitals participated. Cronbach's alpha for the instrument was 0.88, indicating strong internal consistency. Seven subscales emerged and were labeled: Hospital Leadership, Unit Leadership, My Unit's Culture, Other Units' Culture, Busy Workload, Priority of Patient Care, and Use of Data. Correlations between subscales ranged from 0.07 to 0.52, providing evidence that the subscales did not measure the same construct. Subscale correlations with the total score were near or above 0.50 (p <0.001). Use of a factor-loading cutoff of 0.40 resulted in the elimination of 12 items because of weak associations with the topic. The H-CulT is a psychometrically sound and practical survey for assessing hospital culture related to patient flow during transitions in care. Survey results may prompt quality improvement interventions that enhance in-hospital transitions and improve staff satisfaction and patient satisfaction with care. Copyright © 2017 The Joint Commission. Published by Elsevier Inc. All rights reserved.

Psychometric evaluation of ADAS-Cog and NTB for measuring drug response.

Science.gov (United States)

Karin, A; Hannesdottir, K; Jaeger, J; Annas, P; Segerdahl, M; Karlsson, P; Sjögren, N; von Rosen, T; Miller, F

2014-02-01

To conduct a psychometric analysis to determine the adequacy of instruments that measure cognition in Alzheimer's disease trials. Both the Alzheimer's Disease Assessment Scale - Cognition (ADAS-Cog) and the Neuropsychological Test Battery (NTB) are validated outcome measures for clinical trials in Alzheimer's disease and are approved also for regulatory purposes. However, it is not clear how comparable they are in measuring cognitive function. In fact, many recent trials in Alzheimer's disease patients have failed and it has been questioned if ADAS-Cog still is a sensitive measure. The present paper examines the psychometric properties of ADAS-Cog and NTB, based on a post hoc analysis of data from a clinical trial (NCT01024660), which was conducted by AstraZeneca, in mild-to-moderate Alzheimer's disease (AD) patients, with a Mini Mental State Examination (MMSE) Total score 16-24. Acceptability, reliability, different types of validity and ability to detect change were assessed using relevant statistical methods. Total scores of both tests, as well as separate domains of both tests, including the Wechsler Memory Scale (WMS), Rey Auditory Verbal Learning Test (RAVLT) and Delis-Kaplan Executive Function System (D-KEFS) Verbal Fluency Condition, were analyzed. Overall, NTB performed well, with acceptable reliability and ability to detect change, while ADAS-Cog had insufficient psychometric properties, including ceiling effects in 8 out of a total of 11 ADAS-Cog items in mild AD patients, as well as low test-retest reliability in some of the items. Based on a direct comparison on the same patient sample, we see advantages of the NTB compared with the ADAS-Cog for the evaluation of cognitive function in the population of mild-to-moderate AD patients. The results suggest that not all of ADAS-Cog items are relevant for both mild and moderate AD population. This validation study demonstrates satisfactory psychometric properties of the NTB, while ADAS-Cog was found to be

Tailoring a psychophysical discrimination experiment upon assessment of the psychometric function: Predictions and results

Science.gov (United States)

Vilardi, Andrea; Tabarelli, Davide; Ricci, Leonardo

2015-02-01

Decision making is a widespread research topic and plays a crucial role in neuroscience as well as in other research and application fields of, for example, biology, medicine and economics. The most basic implementation of decision making, namely binary discrimination, is successfully interpreted by means of signal detection theory (SDT), a statistical model that is deeply linked to physics. An additional, widespread tool to investigate discrimination ability is the psychometric function, which measures the probability of a given response as a function of the magnitude of a physical quantity underlying the stimulus. However, the link between psychometric functions and binary discrimination experiments is often neglected or misinterpreted. Aim of the present paper is to provide a detailed description of an experimental investigation on a prototypical discrimination task and to discuss the results in terms of SDT. To this purpose, we provide an outline of the theory and describe the implementation of two behavioural experiments in the visual modality: upon the assessment of the so-called psychometric function, we show how to tailor a binary discrimination experiment on performance and decisional bias, and to measure these quantities on a statistical base. Attention is devoted to the evaluation of uncertainties, an aspect which is also often overlooked in the scientific literature.

Oswestry Disability Index: a psychometric analysis with 1,610 patients.

Science.gov (United States)

Brodke, Darrel S; Goz, Vadim; Lawrence, Brandon D; Spiker, W Ryan; Neese, Ashley; Hung, Man

2017-03-01

One-fourth of the adult US population has or will experience back pain and has undergone one of a myriad of treatments. Understanding the outcomes of these many treatments from pharmacologic to surgical, from manipulation to modality, allows for a better understanding and value-driven decision making. Patient-reported outcome measures are the current standard and include general and disease-specific measures. The Oswestry Disability Index (ODI) is the most commonly used disease-specific patient-reported outcome tool to measure functional disability related to back pain. Few studies have evaluated its psychometric properties in a large patient sample using a modern tool such as the Rasch analysis model. This study aims to identify the benefits and deficiencies of the ODI as an outcome tool for assessing patients with back pain. This study aimed to investigate the psychometric properties, performance, and applicability of the ODI in patients with back pain who visited a university-based outpatient clinic. This study used a secondary analysis-assessment of diagnostic tool on consecutive patients. The sample comprised 1,610 patients visiting an academic spine center. The ODI was the outcome measure. Detailed Rasch analysis of the ODI was performed. Standard descriptive statistics were also assessed. The ODI performed well overall. It demonstrated suboptimal unidimensionality (ie, unexplained variance after accounting for the first dimension) of 8.3%. Person reliability was good, at 0.85, and item reliability was excellent, at 1.00. The overall item fit for the ODI was good with an outfit mean square of 1.02. The ODI had a floor effect of 29.9% and ceiling effect of 3.9%. The raw score to measure correlation of the ODI was excellent, at 0.944. The ODI performed relatively well overall, with some problematic findings. It had good person and item reliability, although it did not demonstrate strong evidence of unidimensionality. The ODI has moderately poor coverage, with a

The use of the EQ-5D-Y health related quality of life outcome measure in children in the Western Cape, South Africa: psychometric properties, feasibility and usefulness - a longitudinal, analytical study.

Science.gov (United States)

Scott, Des; Ferguson, Gillian D; Jelsma, Jennifer

2017-01-19

The EQ-5D-Y, an outcome measure of Health Related Quality of Life (HRQoL) in children, was developed by an international task team in 2010. The multinational feasibility, reliability and validity study which followed was undertaken with mainly healthy children. The aim of this study was to investigate the psychometric properties of the EQ-5D-Y when used to assess the HRQoL of children with different health states. A sample of 224 children between eight and twelve years were grouped according to their health state. The groups included 52 acutely ill children, 67 children with either a chronic health condition or disability and 105 mostly healthy, mainstream school children as a comparator. They were assessed at baseline, at three months and at six months. An analysis of the psychometric properties was performed to assess the reliability, validity and responsiveness of the EQ-5D-Y in the different groups of children. Cohen's kappa, the intraclass correlation coefficient, Pearson Chi-square, Kruskal-Wallis ANOVA and effect size of Wilcoxon Signed-rank test were used to determine the reliability, validity and responsiveness of the instrument. The EQ-5D-Y dimensions were found to be reliable on test-retest (kappa varying from 0.365 to 0.653), except for the Usual Activities dimension (kappa 0.199). The Visual Analogue Scale (VAS) was also reliable (ICC = 0.77). Post-hoc analysis indicated that dimensions were able to discriminate between acutely ill and healthy children (all differences p Wilcoxon Signed-rank test for VAS was 0.43). Six of the nine therapists who took part in the study, found the measure quick and easy to apply, used the information in the management of the child and would continue to use it in future. The EQ-5D-Y could be used with confidence as an outcome measure for acutely-ill children, but demonstrated poorer psychometric properties in children with no health condition or chronic conditions. It appears to be feasible and useful to include the

[Standardization of the Test Your Memory and evaluation of their concordance with the outcome of the psychometric examination].

Science.gov (United States)

Ferrero-Arias, J; Turrión-Rojo, M A

2016-05-01

To explore the relationship between scores on the Test Your Memory (TYM) battery and findings from a more exhaustive neurocognitive assessment. The TYM and fourteen psychometric tests were administered to 84 subjects aged 50 or older who attended an outpatient neurology clinic due to cognitive symptoms. Each patient's cognitive state was determined independently from his/her score on the TYM (CDR 0, n=25; CDR 0.5, n=45; CDR 1, n=14). We analysed concurrent validity of TYM scores and results from the psychometric tests, as well as the degree of concordance between the two types of measurement, by contrasting normalised data from each instrument. Although the intraclass correlation coefficient was 0.67 (confidence interval 95%, 0.53-0.77), analysis of the Bland-Altman plot and the curve on the survival-agreement plot (Luiz et al. method) demonstrates that the individual distances between the two methods exhibit excessive dispersion from a clinical viewpoint. TYM-based predictions of the mean z-score on psychometric tests differed substantially from real results in 30% of the subjects. Concordance of 95% can only be achieved by accepting absolute inter-instrument differences of up to 0.87 as identical values. Furthermore, the TYM underestimates cognitive performance for low values and overestimates it for high values. The TYM is a cognitive screening test which should not be used to predict results on psychometric tests or to detect cognitive changes in clinical trials. Copyright © 2014 Sociedad Española de Neurología. Published by Elsevier España, S.L.U. All rights reserved.

Manifesto: towards a clinically-oriented psychometrics.

Science.gov (United States)

Vickers, Andrew J; Chen, Ling Y

2017-04-26

New technologies to collect patient - reported outcomes have substantially solved the challenge of integrating a questionnaire in a busy clinical practice. At Memorial Sloan Kettering, we have been collecting patient reported outcomes electronically for many years. Our experience confirms the predicted benefits of obtaining patient reported outcomes but has also raised serious concerns about whether instruments developed for the research setting are appropriate for routine clinical use. We summarize four principles for a clinically - relevant psychometrics. First, minimize patient burden: the use of a large number of items for a single domain may be of interest for research but additional items have little clinical utility. Secondly, use simplified language: patients who do not have good language skills are typically excluded from research studies but will nonetheless present in clinical practice. Third, avoid dumb questions: many questionnaire items are inappropriate when applied to a more general population. Fourth, what works for the group may not work for the individual: group level statistics used to validate survey instruments can obscure problems when applied to a subgroup of patients. There is a need for a clinically-oriented psychometrics to help design, test, and evaluate questionnaires that would be used in routine practice. Developing statistical methods to optimize questionnaires will be highly challenging but needed to bring the potential of patient reported outcomes into widespread clinical use.

Psychometric properties of the Revised Chen Internet Addiction Scale (CIAS-R) in Chinese adolescents.

Science.gov (United States)

Mak, Kwok-Kei; Lai, Ching-Man; Ko, Chih-Hung; Chou, Chien; Kim, Dong-Il; Watanabe, Hiroko; Ho, Roger C M

2014-10-01

The Revised Chen Internet Addiction Scale (CIAS-R) was developed to assess Internet addiction in Chinese populations, but its psychometric properties in adolescents have not been examined. This study aimed to evaluate the factor structure and psychometric properties of CIAS-R in Hong Kong Chinese adolescents. 860 Grade 7 to 13 students (38 % boys) completed the CIAS-R, the Young's Internet Addiction Test (IAT), and the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) in a survey. The prevalence of Internet addiction as assessed by CIAS-R was 18 %. High internal consistency and inter-item correlations were reported for the CIAS-R. Results from the confirmatory factor analysis suggested a four-factor structure of Compulsive Use and Withdrawal, Tolerance, Interpersonal and Health-related Problems, and Time Management Problems. Moreover, results of hierarchical multiple regression supported the incremental validity of the CIAS-R to predict mental health outcomes beyond the effects of demographic differences and self-reported time spent online. The CIAS is a reliable and valid measure of internet addiction problems in Hong Kong adolescents. Future study is warranted to validate the cutoffs of the CIAS-R for identification of adolescents with Internet use problems who may have mental health needs.

Psychometric Properties of the Lifetime Assessment of Violent Acts.

Science.gov (United States)

King, Alan R; Russell, Tiffany D; Bailly, Matthew D

2017-12-01

The Lifetime Assessment of Violent Acts (LAVA) inventory provides estimates of the frequency, triggers, and consequences (including injuries to others) of historic acts of aggression. The LAVA also identifies the situational contexts in which prior violence was triggered and allows classifications based on past reactive, intimate partner, alcoholrelated, and/or weapon-related violence. Normative and psychometric data were provided from a college (N = 1,133) and general population (N = 545) sample. Around 15% of the general population sample recalled inflicting 5 or more injuries on others at some time in the past. LAVA scores were significantly higher for women than men (d = .45), and respondents from the general population were more aggressive than those in the college sample (d = .41). The potential benefits, applications, and limitations of this retrospective self-report inventory are discussed.

Positive psychology outcome measures for family caregivers of people living with dementia: a systematic review.

Science.gov (United States)

Stansfeld, Jacki; Stoner, Charlotte R; Wenborn, Jennifer; Vernooij-Dassen, Myrra; Moniz-Cook, Esme; Orrell, Martin

2017-08-01

Family caregivers of people living with dementia can have both positive and negative experiences of caregiving. Despite this, existing outcome measures predominately focus on negative aspects of caregiving such as burden and depression. This review aimed to evaluate the development and psychometric properties of existing positive psychology measures for family caregivers of people living with dementia to determine their potential utility in research and practice. A systematic review of positive psychology outcome measures for family caregivers of people with dementia was conducted. The databases searched were as follows: PsychINFO, CINAHL, MEDLINE, EMBASE, and PubMed. Scale development papers were subject to a quality assessment to appraise psychometric properties. Twelve positive outcome measures and six validation papers of these scales were identified. The emerging constructs of self-efficacy, spirituality, resilience, rewards, gain, and meaning are in line with positive psychology theory. There are some robust positive measures in existence for family caregivers of people living with dementia. However, lack of reporting of the psychometric properties hindered the quality assessment of some outcome measures identified in this review. Future research should aim to include positive outcome measures in interventional research to facilitate a greater understanding of the positive aspects of caregiving and how these contribute to well-being.

Psychometric performance and responsiveness of the functional outcomes of sleep questionnaire and sleep apnea quality of life instrument in a randomized trial: the HomePAP study.

Science.gov (United States)

Billings, Martha E; Rosen, Carol L; Auckley, Dennis; Benca, Ruth; Foldvary-Schaefer, Nancy; Iber, Conrad; Zee, Phyllis C; Redline, Susan; Kapur, Vishesh K

2014-12-01

Measures of health-related quality of life (HRQL) specific for sleep disorders have had limited psychometric evaluation in the context of randomized controlled trials (RCTs). We investigated the psychometric properties of the Functional Outcomes of Sleep Questionnaire (FOSQ) and Sleep Apnea Quality of Life Instrument (SAQLI). We evaluated the FOSQ and SAQLI construct and criterion validity, determined a minimally important difference, and assessed for associations of responsiveness to baseline subject characteristics and continuous positive airway pressure (CPAP) adherence in a RCT population. Secondary analysis of data collected in a multisite RCT of home versus laboratory-based diagnosis and treatment of obstructive sleep apnea (HomePAP trial). Individuals enrolled in the HomePAP trial (n = 335). N/A. The FOSQ and SAQLI subscores demonstrated high reliability and criterion validity, correlating with Medical Outcomes Study 36-Item Short Form Survey domains. Correlations were weaker with the Epworth Sleepiness Scale (ESS). Both the FOSQ and SAQLI scores improved after 3 mo with CPAP therapy. Averaging 4 h or more of CPAP use was associated with an increase in the FOSQ beyond the minimally important difference. Baseline depressive symptoms and sleepiness predicted FOSQ and SAQLI responsiveness; demographic, objective obstructive sleep apnea (OSA) severity and sleep habits were not predictive in linear regression. The FOSQ and SAQLI are responsive to CPAP intervention, with the FOSQ being more sensitive to differences in CPAP adherence than the SAQLI. These instruments provide unique information about health outcomes beyond that provided by changes in physiological measures of OSA severity (apnea-hypopnea index). Portable Monitoring for Diagnosis and Management of Sleep Apnea (HomePAP) URL: http://clinicaltrials.gov/show/NCT00642486. NIH clinical trials registry number: NCT00642486. © 2014 Associated Professional Sleep Societies, LLC.

Developing and validating a psychometric scale for image quality assessment

International Nuclear Information System (INIS)

Mraity, H.; England, A.; Hogg, P.

2014-01-01

Purpose: Using AP pelvis as a catalyst, this paper explains how a psychometric scale for image quality assessment can be created using Bandura's theory for self-efficacy. Background: Establishing an accurate diagnosis is highly dependent upon the quality of the radiographic image. Image quality, as a construct (i.e. set of attributes that makes up the image quality), continues to play an essential role in the field of diagnostic radiography. The process of assessing image quality can be facilitated by using criteria, such as the European Commission (EC) guidelines for quality criteria as published in 1996. However, with the advent of new technology (Computed Radiography and Digital Radiography), some of the EC criteria may no longer be suitable for assessing the visual quality of a digital radiographic image. Moreover, a lack of validated visual image quality scales in the literature can also lead to significant variations in image quality evaluation. Creating and validating visual image quality scales, using a robust methodology, could reduce variability and improve the validity and reliability of perceptual image quality evaluations

Assessment of Scientific Communication Self-Efficacy, Interest, and Outcome Expectations for Career Development in Academic Medicine

Science.gov (United States)

Anderson, Cheryl B.; Lee, Hwa Young; Byars-Winston, Angela; Baldwin, Constance D.; Cameron, Carrie; Chang, Shine

2015-01-01

Competency in forms of scientific communication, both written and spoken, is essential for success in academic science. This study examined the psychometric properties of three new measures, based on social cognitive career theory, that are relevant to assessment of skill and perseverance in scientific communication. Pre- and postdoctoral trainees in biomedical science (N = 411) completed online questionnaires assessing self-efficacy in scientific communication, career outcome expectations, and interest in performing tasks in scientific writing, oral presentation, and impromptu scientific discourse. Structural equation modeling was used to evaluate factor structures and model relations. Confirmatory factor analysis supported a 22-item, 3-factor measure of self-efficacy, an 11-item, 2-factor measure of outcome expectations, and a 12-item, 3-factor measure of interest in scientific communication activities. Construct validity was further demonstrated by theory-consistent inter-factor relations and relations with typical communications performance behaviors (e.g., writing manuscripts, abstracts, presenting at national meetings). PMID:26924920

A Psychometric Comparison of the Clinical Assessment Interview for Negative Symptoms and the Brief Negative Symptom Scale.

Science.gov (United States)

Strauss, Gregory P; Gold, James M

2016-11-01

In 2005, the National Institute of Mental Health held a consensus development conference on negative symptoms of schizophrenia. Among the important conclusions of this meeting were that there are at least 5 commonly accepted domains of negative symptoms (blunted affect, alogia, avolition, anhedonia, asociality) and that new rating scales were needed to adequately assess these constructs. Two next-generation negative symptom scales resulted from this meeting: the Brief Negative Symptom Scale (BNSS) and Clinical Assessment Interview for Negative Symptoms (CAINS). Both measures are becoming widely used and studies have demonstrated good psychometric properties for each scale. The current study provides the first direct psychometric comparison of these scales. Participants included 65 outpatients diagnosed with schizophrenia or schizoaffective disorder who completed clinical interviews, questionnaires, and neuropsychological testing. Separate raters completed the BNSS and CAINS within the same week. Results indicated that both measures had good internal consistency, convergent validity, and discriminant validity. High correspondence was observed between CAINS and BNSS blunted affect and alogia items. Moderate convergence occurred for avolition and asociality items, and low convergence was seen among anhedonia items. Findings suggest that both scales have good psychometric properties, but that there are important distinctions among the items related to motivation and pleasure. © The Author 2016. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Development and initial psychometric evaluation of patient-reported outcome questionnaires to evaluate the symptoms and impact of hidradenitis suppurativa.

Science.gov (United States)

Kimball, Alexa B; Sundaram, Murali; Banderas, Benjamin; Foley, Catherine; Shields, Alan L

2018-03-01

Two patient-reported outcome (PRO) questionnaires, the Hidradenitis Suppurativa Symptom Assessment (HSSA) and Hidradenitis Suppurativa Impact Assessment (HSIA), were developed to measure signs, symptoms and impacts of HS in treatment efficacy studies. In accordance with FDA guidelines and published best practices, four stages of research were conducted to create the questionnaires: concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Subjects (N = 20) who participated in the concept elicitation stage reported 15 unique HS-related signs and symptoms and 51 impacts. Following this, eight sign and symptom concepts and 21 impacts were selected for construction of the HSSA and HSIA, respectively. During content evaluation, cognitive debriefing interviews with HS subjects (N = 20) confirmed subjects could read, comprehend and meaningfully respond to both questionnaires. Modifications made after this stage of work resulted in a nine-item HSSA and a 17-item HSIA. The HSSA and HSIA were subsequently entered into a US-based observational study (N = 40), and the scores produced by each were found to be reliable, construct valid, and able to distinguish among clinically distinct groups. The HSSA and HSIA are content-valid, HS-specific, PRO questionnaires with demonstrated ability to generate reliable, valid scores when administered to patients with HS in a research setting.

Development and psychometric validation of a scale to assess information needs in cardiac rehabilitation: the INCR Tool.

Science.gov (United States)

Ghisi, Gabriela Lima de Melo; Grace, Sherry L; Thomas, Scott; Evans, Michael F; Oh, Paul

2013-06-01

To develop and psychometrically validate a tool to assess information needs in cardiac rehabilitation (CR) patients. After a literature search, 60 information items divided into 11 areas of needs were identified. To establish content validity, they were reviewed by an expert panel (N=10). Refined items were pilot-tested in 34 patients on a 5-point Likert-scale from 1 "really not helpful" to 5 "very important". A final version was generated and psychometrically tested in 203 CR patients. Test-retest reliability was assessed via the intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and criterion validity was assessed with regard to patient's education and duration in CR. Five items were excluded after ICC analysis as well as one area of needs. All 10 areas were considered internally consistent (Cronbach's alpha>0.7). Criterion validity was supported by significant differences in mean scores by educational level (pinformation need. The INCR Tool was demonstrated to have good reliability and validity. This is an appropriate tool for application in clinical and research settings, assessing patients' needs during CR and as part of education programming. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Psychometric analysis of subjective sedation scales used for critically ill paediatric patients.

Science.gov (United States)

Ge, Xiaohua; Zhang, Tingting; Zhou, Lingling

2018-01-01

This study evaluated the psychometric properties of subjective sedation scales using one psychometric scoring system to identify the appropriate scale that is most suitable for clinical care practice. A number of published sedation assessment scales for paediatric patients are currently used to attempt to achieve a moderate depth of sedation to avoid the undesirable effects caused by over- or undersedation. However, there has been no systematic review of these scales. We searched the Cochrane Library, PubMed, EMBASE, the Cumulative Index to Nursing and Allied Health Literature, etc., to obtain relevant articles. The quality of the selected studies was evaluated according to the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. Articles that had been published or were in press and discussed the psychometric properties of sedation scales were included. The population comprised critically ill infants and non-verbal children ranging in age from 0 to 18 years who underwent sedation in an intensive care unit. Data were independently extracted by two investigators using a standard data extraction checklist: 43 articles were included in this review, and 13 sedation scales were examined. The quality of the psychometric evidence for the Comfort Scale and Comfort Behaviour Scale was 'very good', with the Comfort Scale having a higher quality (total weighted scores, Comfort Scale = 17·3 and Comfort Behaviour Scale = 15·5). We suggest that the scales be systematically and comprehensively tested in terms of development method, reliability, validation, feasibility and correlation with clinical outcome. The Comfort Scale and Comfort Behaviour Scale are useful tools for measuring sedation in paediatric patients. Nursing staff should choose one subjective sedation scale that is suitable for assessing paediatric patients' depth of sedation. We recommend the Comfort Scale and Comfort Behaviour Scale as optimal choices if the clinical

Can genetics help psychometrics? Improving dimensionality assessment through genetic factor modeling.

Science.gov (United States)

Franić, Sanja; Dolan, Conor V; Borsboom, Denny; Hudziak, James J; van Beijsterveldt, Catherina E M; Boomsma, Dorret I

2013-09-01

In the present article, we discuss the role that quantitative genetic methodology may play in assessing and understanding the dimensionality of psychological (psychometric) instruments. Specifically, we study the relationship between the observed covariance structures, on the one hand, and the underlying genetic and environmental influences giving rise to such structures, on the other. We note that this relationship may be such that it hampers obtaining a clear estimate of dimensionality using standard tools for dimensionality assessment alone. One situation in which dimensionality assessment may be impeded is that in which genetic and environmental influences, of which the observed covariance structure is a function, differ from each other in structure and dimensionality. We demonstrate that in such situations settling dimensionality issues may be problematic, and propose using quantitative genetic modeling to uncover the (possibly different) dimensionalities of the underlying genetic and environmental structures. We illustrate using simulations and an empirical example on childhood internalizing problems.

Measuring both negative and positive reactions to giving care to cancer patients : psychometric qualities of the Caregiver Reaction Assessment (CRA)

NARCIS (Netherlands)

Nijboer, C; Triemstra, M; Sanderman, R.; van den Bos, G.A M

The Caregiver Reaction Assessment Scale (CRA) is an instrument designed to assess specific aspects of the caregiving situation, including both negative and positive dimensions of caregiving reactions. This paper addresses the psychometric qualities of the CRA in a multicenter study among partners of

Measuring both negative and positive reactions to giving care to cancer patients: psychometric qualities of the Caregiver Reaction Assessment (CRA)

NARCIS (Netherlands)

Nijboer, C.; Triemstra, M.; Tempelaar, R.; Sanderman, R.; van den Bos, G. A.

1999-01-01

The Caregiver Reaction Assessment Scale (CRA) is an instrument designed to assess specific aspects of the caregiving situation, including both negative and positive dimensions of caregiving reactions. This paper addresses the psychometric qualities of the CRA in a multicenter study among partners of

Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure

Science.gov (United States)

McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.

2013-01-01

Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342

The Counseling Center Assessment of Psychological Symptoms (CCAPS-62): Acceptance, feasibility, and initial psychometric properties in a UK student population.

Science.gov (United States)

Broglia, Emma; Millings, Abigail; Barkham, Michael

2017-09-01

The burden and severity of student mental health continue to increase in parallel with increasing financial pressures on students and services alike. There is a need for a student-specific measure of distress that acknowledges their unique context. This study examined the feasibility, acceptance, and initial psychometric properties of a US measure, the Counseling Center Assessment of Psychological Symptoms (CCAPS), in a UK student sample. A sample of 294 UK help-seeking students from two universities completed the CCAPS-62 and Clinical Outcomes in Routine Evaluation (CORE-10) as a comparator. The factor solution and reliability of the CCAPS-62 were examined. Correlations and clinical boundaries were determined between the CCAPS-62 subscales and CORE-10, and comparisons were made with US published norms. The CCAPS-62 demonstrated a strong factor solution that matched the intended subscales. All subscales had good reliability and correlated significantly with the CORE-10. The agreement on caseness between the two measures was 92.8% with 86.3% reaching clinical threshold on both the CCAPS-62 and CORE-10. Severity was most noticeable for academic distress, depression, anxiety, and social anxiety. Compared to US data, UK students showed higher clinical severity for all psychological symptoms. The CCAPS-62 is a reliable and psychometrically valid assessment measure to use with UK students without revision. The overall distress indicated is similar to that of the CORE-10, but the individual subscales are more informative of specific student concerns including academic distress, social anxiety, and substance abuse. Potential benefits of administering a student-focused assessment measure in student counselling services are discussed. University students attending counselling in the UK demonstrate clinical severity for academic distress, depression, anxiety, and social anxiety. Compared to university students in the US, UK students present with higher clinical severity on

Psychometric Properties of Virtual Reality Vignette Performance Measures: A Novel Approach for Assessing Adolescents' Social Competency Skills

Science.gov (United States)

Paschall, Mallie J.; Fishbein, Diana H.; Hubal, Robert C.; Eldreth, Diana

2005-01-01

This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on…

Patients' perception of postoperative pain management: validation of the International Pain Outcomes (IPO) questionnaire.

Science.gov (United States)

Rothaug, Judith; Zaslansky, Ruth; Schwenkglenks, Matthias; Komann, Marcus; Allvin, Renée; Backström, Ragnar; Brill, Silviu; Buchholz, Ingo; Engel, Christoph; Fletcher, Dominique; Fodor, Lucian; Funk, Peter; Gerbershagen, Hans J; Gordon, Debra B; Konrad, Christoph; Kopf, Andreas; Leykin, Yigal; Pogatzki-Zahn, Esther; Puig, Margarita; Rawal, Narinder; Taylor, Rod S; Ullrich, Kristin; Volk, Thomas; Yahiaoui-Doktor, Maryam; Meissner, Winfried

2013-11-01

PAIN OUT is a European Commission-funded project aiming at improving postoperative pain management. It combines a registry that can be useful for quality improvement and research using treatment and patient-reported outcome measures. The core of the project is a patient questionnaire-the International Pain Outcomes questionnaire-that comprises key patient-level outcomes of postoperative pain management, including pain intensity, physical and emotional functional interference, side effects, and perceptions of care. Its psychometric quality after translation and adaptation to European patients is the subject of this validation study. The questionnaire was administered to 9,727 patients in 10 languages in 8 European countries and Israel. Construct validity was assessed using factor analysis. Discriminant validity assessment used Mann-Whitney U tests to detect mean group differences between 2 surgical disciplines. Internal consistency reliability was calculated as Cronbach's alpha. Factor analysis resulted in a 3-factor structure explaining 53.6% of variance. Cronbach's alpha at overall scale level was high (.86), and for the 3 subscales was low, moderate, or high (range, .53-.89). Significant mean group differences between general and orthopedic surgery patients confirmed discriminant validity. The psychometric quality of the International Pain Outcomes questionnaire can be regarded as satisfactory. The International Pain Outcomes questionnaire provides an instrument for postoperative pain assessment and improvement of quality of care, which demonstrated good psychometric quality when translated into a variety of languages in a large European and Israeli patient population. This measure provides the basis for the first comprehensive postoperative pain registry in Europe and other countries. Copyright © 2013. Published by Elsevier Inc.

Psychometric Properties of the Persian Version of the Relationship Assessment Scale among Couples

Directory of Open Access Journals (Sweden)

غلامرضا دهشیری

2016-06-01

Full Text Available This research administrated to evaluate the psychometric properties of the Persian version of Relationship Assessment scale. Therefore, 315 married individuals (199 women and 116 men from Tehran city were volunteered to respond to four scales: the Relationship Assessment, the Kansas Marital Satisfaction, the Oxford Happiness and the Life Satisfaction. Results from exploratory & confirmatory factor analysis showed that factor structure of Relationship Assessment scale was unidimensional. The internal consistency of the scale in the total sample was 0.88. Significant correlations between scores of the Relationship Assessment scale with the scores of the Kansas Marital Satisfaction Scale, the Life Satisfaction Scale and the Oxford Happiness Questionnaire demonstrated good convergent validity of the scale. Also, the results showed that there was no significant gender difference between the mean scores of relationship satisfaction. In conclusion, the Relationship Assessment scale is a valid and reliable tool to measure marital satisfaction in Iran.

A Psychometric Review of Norm-Referenced Tests Used to Assess Phonological Error Patterns

Science.gov (United States)

Kirk, Celia; Vigeland, Laura

2014-01-01

Purpose: The authors provide a review of the psychometric properties of 6 norm-referenced tests designed to measure children's phonological error patterns. Three aspects of the tests' psychometric adequacy were evaluated: the normative sample, reliability, and validity. Method: The specific criteria used for determining the psychometric…

Organizational readiness for implementing change: a psychometric assessment of a new measure.

Science.gov (United States)

Shea, Christopher M; Jacobs, Sara R; Esserman, Denise A; Bruce, Kerry; Weiner, Bryan J

2014-01-10

Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change. We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. This article provides evidence in

Motor assessment instruments and psychometric procedures: A systematic review

Directory of Open Access Journals (Sweden)

Pâmella de Medeiros

2017-03-01

Full Text Available It was our objective to identify the psychometric elements to an epistemological reflection through a systematic review of cross-cultural validation procedures of TGMD-2 batteries, MABC-2 and KTK. Searches were carried out by two evaluators independently without year and language restrictions in six databases: Web of Science, Science Direct, Lilacs, Scopus, Pubmed and The ScientificElectronic Library Online - SciELO. The key words used were: "MABC", "TGMD" and "KTK" all of them combined with the word "validity". There was a total of 734 articles, of which, after the exclusion criteria, remained only 11 studies. It was found that there are differences between the authors in relation to the psychometric factors taken into account in cross-cultural validation. So that there was a lack of unanimity of the validation criteria of all studies in this field.

Psychometric Consequences of Subpopulation Item Parameter Drift

Science.gov (United States)

Huggins-Manley, Anne Corinne

2017-01-01

This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study.

Science.gov (United States)

Rahmani, Azam; Merghati-Khoei, Effat; Moghadam-Banaem, Lida; Hajizadeh, Ebrahim; Hamdieh, Mostafa; Montazeri, Ali

2014-06-13

Premarital sexual behaviors are important issue for women's health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach's alpha coefficient for the instrument was found to be 0.87. This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women's sexual abstinence.

Psychometric properties of the Blood-borne Virus Transmission Risk Assessment Questionnaire (BBV-TRAQ).

Science.gov (United States)

Fry, Craig L; Lintzeris, Nick

2003-02-01

To develop a standard measure of blood-borne virus transmission risk behaviour, and examine the underlying psychometric properties. The Blood-borne Virus Transmission Risk Assessment Questionnaire (BBV-TRAQ) was developed over three consecutive phases of the original BBV-TRAQ study in adherence to classical scale development procedures, culminating in the recruitment of a development sample of current injecting drug users via convenience and snowball sampling. Needle and syringe programmes (NSPs), medical clinics, alcohol/drug agencies, peer-based and outreach organizations across inner and outer metropolitan Melbourne. Two hundred and nine current injecting drug users. The mean age was 27 years, 68% were male, 65% unemployed, 36% with prison history and 25% in methadone maintenance. BBV-TRAQ items cover specific injecting, sexual and skin penetration risk practices. BBV-TRAQ characteristics were assessed via measures of internal and test-retest reliability; collateral validation; and principal components analyses. The BBV-TRAQ has satisfactory psychometric properties. Internal (a=0.87), test-retest (r=0.84) and inter-observer reliability results were high, suggesting that the instrument provides a reliable measure of BBV risk behaviour and is reliable over time and across interviewers. A principal components analysis with varimax rotation produced a parsimonious factor solution despite modest communality, and indicated that three factors (injecting, sex and skin penetration/hygiene risks) are required to describe BBV risk behaviour. The BBV-TRAQ is reliable and represents the first risk assessment tool to incorporate sufficient coverage of injecting, sex and other skin penetration risk practices to be considered truly content valid. The questionnaire is indicated for use in addictions research, clinical, peer education and BBV risk behaviour surveillance settings.

A Psychometric Review of Measures Assessing Discrimination Against Sexual Minorities.

Science.gov (United States)

Morrison, Todd G; Bishop, C J; Morrison, Melanie A; Parker-Taneo, Kandice

2016-08-01

Discrimination against sexual minorities is widespread and has deleterious consequences on victims' psychological and physical wellbeing. However, a review of the psychometric properties of instruments measuring lesbian, gay, and bisexual (LGB) discrimination has not been conducted. The results of this review, which involved evaluating 162 articles, reveal that most have suboptimal psychometric properties. Specifically, myriad scales possess questionable content validity as (1) items are not created in collaboration with sexual minorities; (2) measures possess a small number of items and, thus, may not sufficiently represent the domain of interest; and (3) scales are "adapted" from measures designed to examine race- and gender-based discrimination. Additional limitations include (1) summed scores are computed, often in the absence of scale score reliability metrics; (2) summed scores operate from the questionable assumption that diverse forms of discrimination are necessarily interrelated; (3) the dimensionality of instruments presumed to consist of subscales is seldom tested; (4) tests of criterion-related validity are routinely omitted; and (5) formal tests of measures' construct validity are seldom provided, necessitating that one infer validity based on the results obtained. The absence of "gold standard" measures, the attendant difficulty in formulating a coherent picture of this body of research, and suggestions for psychometric improvements are noted.

Item reduction and psychometric validation of the Oily Skin Self Assessment Scale (OSSAS) and the Oily Skin Impact Scale (OSIS).

Science.gov (United States)

Arbuckle, Robert; Clark, Marci; Harness, Jane; Bonner, Nicola; Scott, Jane; Draelos, Zoe; Rizer, Ronald; Yeh, Yating; Copley-Merriman, Kati

2009-01-01

Developed using focus groups, the Oily Skin Self Assessment Scale (OSSAS) and Oily Skin Impact Scale (OSIS) are patient-reported outcome measures of oily facial skin. The aim of this study was to finalize the item-scale structure of the instruments and perform psychometric validation in adults with self-reported oily facial skin. The OSSAS and OSIS were administered to 202 adult subjects with oily facial skin in the United States. A subgroup of 152 subjects returned, 4 to 10 days later, for test–retest reliability evaluation. Of the 202 participants, 72.8% were female; 64.4% had self-reported nonsevere acne. Item reduction resulted in a 14-item OSSAS with Sensation (five items), Tactile (four items) and Visual (four items) domains, a single blotting item, and an overall oiliness item. The OSIS was reduced to two three-item domains assessing Annoyance and Self-Image. Confirmatory factor analysis supported the construct validity of the final item-scale structures. The OSSAS and OSIS scales had acceptable item convergent validity (item-scale correlations >0.40) and floor and ceiling effects (skin severity (P skin (P skin), as assessments of self-reported oily facial skin severity and its emotional impact, respectively.

Psychometric validation of the dysmenorrhea daily diary (DysDD): a patient-reported outcome for dysmenorrhea.

Science.gov (United States)

Nguyen, Allison M; Arbuckle, Rob; Korver, Tjeerd; Chen, Fang; Taylor, Beverley; Turnbull, Alice; Norquist, Josephine M

2017-08-01

The objective of this study was to evaluate the psychometric properties of the Dysmenorrhea Daily Diary (DysDD), an electronic patient-reported outcome, in a sample of 355 women with primary dysmenorrhea enrolled in a phase IIb, multicenter, randomized, partially blinded, placebo-controlled trial for treatment of dysmenorrhea. Subjects completed the DysDD over three menstrual cycles, one pre-treatment baseline cycle and two treatment cycles. The DysDD was administered alongside the Menstrual Distress Questionnaire (MDQ), the Short-Form 36 Version 2.0 (SF-36v2), and a Global Assessment of Change (GAC). Item response distributions, test-retest reliability, concurrent and known groups validity, responsiveness, and minimally important difference (MID) were evaluated for the DysDD. As expected, item response distributions varied throughout the menstrual period for all items, with the response scales fully utilized. Within-cycle test-retest reliability was adequate (weighted kappa: 0.5-0.7), although between-cycle test-retest was poor (weighted kappa: 0.1-0.5), most likely due to the highly variable nature of dysmenorrhea between cycles rather than limitations of the measure. Correlations with the MDQ and SF-36v2 were low-moderate, but in the predicted direction, supporting concurrent validity. There were significant differences in DysDD scores across severity groups based on pain medication use. The DysDD was responsive to changes in patients' dysmenorrhea with significantly different changes in scores between change groups (p dysmenorrhea.

An inventory to assess empathic concern for disability and accessibility: development and preliminary psychometric investigation

Directory of Open Access Journals (Sweden)

Motohide Miyahara

2017-11-01

Full Text Available Cultivating empathy and prosocial attitude towards disability is a first step for university students to become the leaders of society and professions to create accessible environments and inclusive society. Gauging levels of empathy and prosocial attitude towards disability among the students is important for evaluating the adequacy of disability training and education. We developed and conducted an initial psychometric validation of a novel inventory in Japanese and English languages to assess Empathic Concern for Disability and Accessibility (ECDA in Japan and New Zealand. Preliminary psychometric evaluation indicates strong internal consistency in the Japanese sample (α = .96 and the New Zealand sample (α = .93. Exploratory factor analysis demonstrated a four-factor solution for both samples. The present study has resulted in the development of the ECDA that demonstrated initial support for internal consistency and construct validity. The ECDA may be used for the cross-cultural comparisons of disability training and education.

Psychometric assessment of the Spiritual Climate Scale Arabic version for nurses in Saudi Arabia.

Science.gov (United States)

Cruz, Jonas Preposi; Albaqawi, Hamdan Mohammad; Alharbi, Sami Melbes; Alicante, Jerico G; Vitorino, Luciano M; Abunab, Hamzeh Y

2017-12-07

To assess the psychometric properties of the Spiritual Climate Scale Arabic version for Saudi nurses. Evidence showed that a high level of spiritual climate in the workplace is associated with increased productivity and performance, enhanced emotional intelligence, organisational commitment and job satisfaction among nurses. A convenient sample of 165 Saudi nurses was surveyed in this descriptive, cross-sectional study. Cronbach's α and intraclass correlation coefficient of the 2 week test-retest scores were computed to establish reliability. Exploratory factor analysis was performed to support the validity of the Spiritual Climate Scale Arabic version. The Spiritual Climate Scale Arabic version manifested excellent content validity. Exploratory factor analysis supported a single factor with an explained variance of 73.2%. The Cronbach's α values of the scale ranged from .79 to .88, while the intraclass correlation coefficient value was .90. The perceived spiritual climate was associated with the respondents' hospital, gender, age and years of experience. Findings of this study support the sound psychometric properties of the Spiritual Climate Scale Arabic version. The Spiritual Climate Scale Arabic version can be used by nurse managers to assess the nurses' perception of the spiritual climate in any clinical area. This process can lead to spiritually centred interventions, thereby ensuring a clinical climate that accepts and respects different spiritual beliefs and practices. © 2017 John Wiley & Sons Ltd.

Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures.

Science.gov (United States)

Deighton, Jessica; Croudace, Tim; Fonagy, Peter; Brown, Jeb; Patalay, Praveetha; Wolpert, Miranda

2014-01-01

There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures' psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against

[Psychometric properties of the Escala de Autoeficacia para el Afrontamiento del Estrés (EAEAE)].

Science.gov (United States)

Godoy Izquierdo, Débora; Godoy García, Juan F; López-Chicheri García, Isabel; Martínez Delgado, Antonio; Gutiérrez Jiménez, Susana; Vázquez Vázquez, Luisa

2008-02-01

This paper presents the theoretical construct of and an instrument for its assessment, the Escala de Autoeficacia para el Afrontamiento del Estrés (EAEAE; in English, Coping with Stress Self-Efficacy Scale), as well as the results obtained concerning its psychometric properties from an adult population. 812 individuals, aged 18 to 64 years old ( M = 26.46, SD = 9.93, 62.6% females and 37.4% males), recruited from various contexts, participated in this study. Participants completed the EAEAE along with other measures of constructs theoretically related to this specific self-efficacy. The EAEAE shows appropriate reliability in its complete form as well as in its two subscales of Efficacy Expectations and Outcome Expectations, and adequate factorial construct validity (which reveals the bi-dimensionality of the instrument), and convergent validity with the remaining measures. The characteristics of brevity and ease of application of the scale, in addition to its adequate psychometric properties, indicate that the EAEAE is an appropriate tool to assess and investigate coping with stress self-efficacy in research as well as clinical settings.

Using R and WinBUGS to fit a generalized partial credit model for developing and evaluating patient-reported outcomes assessments.

Science.gov (United States)

Li, Yuelin; Baser, Ray

2012-08-15

The US Food and Drug Administration recently announced the final guidelines on the development and validation of patient-reported outcomes (PROs) assessments in drug labeling and clinical trials. This guidance paper may boost the demand for new PRO survey questionnaires. Henceforth, biostatisticians may encounter psychometric methods more frequently, particularly item response theory (IRT) models to guide the shortening of a PRO assessment instrument. This article aims to provide an introduction on the theory and practical analytic skills in fitting a generalized partial credit model (GPCM) in IRT. GPCM theory is explained first, with special attention to a clearer exposition of the formal mathematics than what is typically available in the psychometric literature. Then, a worked example is presented, using self-reported responses taken from the international personality item pool. The worked example contains step-by-step guides on using the statistical languages r and WinBUGS in fitting the GPCM. Finally, the Fisher information function of the GPCM model is derived and used to evaluate, as an illustrative example, the usefulness of assessment items by their information contents. This article aims to encourage biostatisticians to apply IRT models in the re-analysis of existing data and in future research. Copyright © 2012 John Wiley & Sons, Ltd.

Development and Initial Psychometric Assessment of the Plant Attitude Questionnaire

Science.gov (United States)

Fančovičová, Jana; Prokop, Pavol

2010-10-01

Plants are integral parts of ecosystems which determine life on Earth. People's attitudes toward them are however, largely overlooked. Here we present initial psychometric assessment of self-constructed Plant Attitude Scale (PAS) that was administered to a sample of 310 Slovakian students living in rural areas aged 10-15 years. The final version of PAS consists from 29 Likert-scale items that were loaded to four distinct dimensions (Interest, Importance, Urban trees and Utilization). Mean scores revealed that Slovakian students lack positive attitudes toward plants and that gender had no effect on their mean attitude scores. Living in a family with a garden was associated with a more positive attitude toward plants. Further correlative research on diverse samples containing urban children and experimental research examining the impact of gardening in schools on student attitudes toward plants is required.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

Science.gov (United States)

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error

Psychometric validation of the functional assessment of cancer therapy--brain (FACT-Br) for assessing quality of life in patients with brain metastases.

Science.gov (United States)

Thavarajah, Nemica; Bedard, Gillian; Zhang, Liying; Cella, David; Beaumont, Jennifer L; Tsao, May; Barnes, Elizabeth; Danjoux, Cyril; Sahgal, Arjun; Soliman, Hany; Chow, Edward

2014-04-01

This study aimed to test the reliability, psychometric, and clinical validity of the use of the Functional Assessment of Cancer Therapy--Brain (FACT-Br) in patients with brain metastases. Patients with brain metastases were interviewed using the FACT-Br (including the FACT-general) 1 week prior to treatment. All patients completed a follow-up assessment 1 month post-treatment. Patients with a good performance status and receiving stereotactic radiosurgery completed an additional 1 week follow-up assessment after the initial baseline interview to assess test-retest reliability. Forty patients had complete 1 month follow-up data. Ten of these patients also completed the 1 week follow-up assessment from baseline. The median Karnofsky performance status of patients was 80 and the median age was 64 years. All subscales of the FACT-Br were found to be conceptually related (except for two correlations) using the following subscales: physical well-being (PWB), social/family well-being (SWB), emotional well-being (EWB), functional well-being (FWB), FACT-G total score, brain cancer subscale (BrC), and the FACT-Br total score. All FACT-Br scores demonstrated excellent reliability, except for the SWB scale which revealed good reliability. The FACT-Br scores showed no significant change in the quality of life (QoL) of patients from baseline to 1 month follow-up. The use of the combined FACT-G and FACT-Br Subscale to assess QoL specifically in patients with brain metastases has successfully undergone psychometric validation. Future clinical trials should use the FACT-G and FACT-Br Subscale to assess QoL in this patient population.

The SF-8 Spanish Version for Health-Related Quality of Life Assessment: Psychometric Study with IRT and CFA Models.

Science.gov (United States)

Tomás, José M; Galiana, Laura; Fernández, Irene

2018-03-22

The aim of current research is to analyze the psychometric properties of the Spanish version of the SF-8, overcoming previous shortcomings. A double line of analyses was used: competitive structural equations models to establish factorial validity, and Item Response theory to analyze item psychometric characteristics and information. 593 people aged 60 years or older, attending long life learning programs at the University were surveyed. Their age ranged from 60 to 92 years old. 67.6% were women. The survey included scales on personality dimensions, attitudes, perceptions, and behaviors related to aging. Competitive confirmatory models pointed out two-factors (physical and mental health) as the best representation of the data: χ2(13) = 72.37 (p < .01); CFI = .99; TLI = .98; RMSEA = .08 (.06, .10). Item 5 was removed because of unreliability and cross-loading. Graded response models showed appropriate fit for two-parameter logistic model both the physical and the mental dimensions. Item Information Curves and Test Information Functions pointed out that the SF-8 was more informative for low levels of health. The Spanish SF-8 has adequate psychometric properties, being better represented by two dimensions, once Item 5 is removed. Gathering evidence on patient-reported outcome measures is of crucial importance, as this type of measurement instruments are increasingly used in clinical arena.

The Social Provisions Scale: psychometric properties of the SPS-10 among participants in nature-based services.

Science.gov (United States)

Steigen, Anne Mari; Bergh, Daniel

2018-02-05

This article analyses the psychometric properties of the Social Provisions Scale 10-items version. The Social Provisions Scale was analysed by means of the polytomous Rasch model, applied to data on 93 young adults (16-30 years) out of school or work, participating in different nature-based services, due to mental or drug-related problems. The psychometric analysis concludes that the original scale has difficulties related to targeting and construct validity. In order to improve the psychometric properties, the scale was modified to include eight items measuring functional support. The modification was based on theoretical and statistical considerations. After modifications the scale showed not only satisfying psychometric properties, but it also clarified uncertainties regarding construct validity of the measure. However, further analysis on larger samples are required. Implications for Rehabilitation Social support is important for a variety of rehabilitation outcomes and for different patient groups in the rehabilitation context, including people with mental health or drug-related problems. Social Provisions Scale may be used as a screening tool to assess social support of participants in rehabilitation, and the scale may also be an important instrument in rehabilitation research. There might be issues measuring structural support using a 10-items version of the Social Provisions Scale but it seemed to work well as an 8-item scale measuring functional support.

Initial evaluation of psychometric properties of a structured work task application for the Assessment of Work Performance in a constructed environment.

Science.gov (United States)

Karlsson, Elin A; Liedberg, Gunilla M; Sandqvist, Jan L

2017-06-22

The Swedish Social Insurance Administration has developed a new assessment tool for sickness insurance. This study is a part of the initial evaluation of the application, called the Assessment of Work Performance, Structured Activities, and focuses on evaluation of the psychometric properties of social validity, content validity, and utility. This was a qualitative study using semi-structured telephone interviews with occupational therapists. A convenience sample was used and participants who fulfilled inclusion criteria (n = 15) were interviewed. Data were analyzed using content analysis with a directed approach. The results indicate that the application provides valuable information and that it is socially valid. Assessors found work tasks suitable for a diverse group of clients and reported that clients accepted the assessments. Improvements were suggested, for example, expanding the application with more work tasks. The instrument has benefits; however, further development is desired. The use of a constructed environment in assessments may be a necessary option to supplement a real environment. But depending on organizational factors such as time and other resources, the participants had different opportunities to do so. Further evaluations regarding ecological validity are essential to ensure that assessments are fair and realistic when using constructed environments. Implications for rehabilitation This study indicates that assessment in a constructed environment can provide a secure and protected context for clients being assessed. Psychometric evaluations are a never-ending process and this assessment instrument needs further development. However, this initial evaluation provides guidance in development of the instrument but also what studies to give priority to. It is important to evaluate social validity in order to ensure that clients and assessors perceive assessment methods fair and meaningful. In this study, participants found the work tasks

Validation of online psychometric instruments for common mental health disorders: a systematic review.

Science.gov (United States)

van Ballegooijen, Wouter; Riper, Heleen; Cuijpers, Pim; van Oppen, Patricia; Smit, Johannes H

2016-02-25

Online questionnaires for measuring common mental health disorders such as depression and anxiety disorders are increasingly used. The psychometrics of several pen-and-paper questionnaires have been re-examined for online use and new online instruments have been developed and tested for validity as well. This study aims to review and synthesise the literature on this subject and provide a framework for future research. We searched Medline and PsycINFO for psychometric studies on online instruments for common mental health disorders and extracted the psychometric data. Studies were coded and assessed for quality by independent raters. We included 56 studies on 62 online instruments. For common instruments such as the CES-D, MADRS-S and HADS there is mounting evidence for adequate psychometric properties. Further results are scattered over different instruments and different psychometric characteristics. Few studies included patient populations. We found at least one online measure for each of the included mental health disorders and symptoms. A small number of online questionnaires have been studied thoroughly. This study provides an overview of online instruments to refer to when choosing an instrument for assessing common mental health disorders online, and can structure future psychometric research.

Psychometric evaluation of the Danish version of Satisfaction with Daily Occupations (SDO)

DEFF Research Database (Denmark)

Eklund, Mona; Morville, Anne-Le

2014-01-01

AIMS: The Satisfaction with Daily Occupations (SDO) scale assesses satisfaction within the domains of work, leisure, domestic tasks, and self-care. The aim was to investigate the psychometric properties of the Danish version of the SDO when used with asylum seekers. METHODS: The participants were...... and criterion and concurrent validity. The findings regarding discriminant validity were somewhat inconclusive. The Danish SDO may be regarded as psychometrically sound but further psychometric testing is needed....

Psychometric properties of the Calgary Cambridge guides to assess communication skills of undergraduate medical students.

OpenAIRE

Simmenroth-Nayda, Anne; Heinemann, Stephanie; Nolte, Catharina; Fischer, Thomas; Himmel, Wolfgang

2014-01-01

OBJECTIVE: The aim of this study was to analyse the psychometric properties of the short version of the Calgary Cambridge Guides and to decide whether it can be recommended for use in the assessment of communications skills in young undergraduate medical students. METHODS: Using a translated version of the Guide, 30 members from the Department of General Practice rated 5 videotaped encounters between students and simulated patients twice. Item analysis should detect possible floor and/or...

The psychometric properties of a shortened corporate entrepreneurship assessment instrument

Directory of Open Access Journals (Sweden)

Renier Steyn

2017-08-01

Aim: The aim of this research was to evaluate the psychometric properties of a measure of entrepreneurial climate. Entrepreneurial climate was measured using a shortened version of the Hornsby, Kuratko and Zahra (2002 instrument, called the Corporate Entrepreneurship Assessment Instrument (CEAI. Making information on the psychometric properties of the instrument available directly relates to its utility. Setting: The setting was medium to large South African companies. A random sample of employees was drawn from 53 selected companies across South Africa, with 60 respondents per company (N = 3 180. Methods: A cross-sectional survey design was used. Several instruments were administered, including the shortened version of the CEAI. Cronbach’s alpha was used to test for reliability and several methods were used to test for validity. Correlation analysis was used to test for concurrent validity, convergent validity and divergent validity. Principle component factor analysis was used to test for factorial validity and a t-test to test for known-group validity. Results: The results showed that the reliability for the total score of the shortened version of the CEAI was acceptable at 0.758. The results also showed some evidence of concurrent validity, as well as homogeneity among the items. With regard to factorial validity, all items loaded in accordance with the subscales of the instrument. The measure was able to distinguish, as expected, between government organisations and private business entities, suggesting known-group validity. Convergent validity and divergent validity were also assessed. Interesting to note was that entrepreneurship climate correlates more with general employee attitude (e.g. employee engagement; R= 0.420, p < 0.001 and organisational commitment, R = 0.331, p < 0.001 than with self-reported innovation (R = 0.277, p < 0.001 and R = 0.267, p < 0.001. Contribution: This paper not only provided information on the reliability

The breastfeeding self-efficacy scale: psychometric assessment of the short form.

Science.gov (United States)

Dennis, Cindy-Lee

2003-01-01

The purpose of this study was to reduce the number of items on the original Breastfeeding Self-Efficacy Scale (BSES) and psychometrically assess the revised BSES-Short Form (BSES-SF). As part of a longitudinal study, participants completed mailed questionnaires at 1, 4, and 8 weeks postpartum. Health region in British Columbia. A population-based sample of 491 breastfeeding mothers. BSES, Edinburgh Postnatal Depression Scale, Rosenberg Self-Esteem Scale, and Perceived Stress Scale. Internal consistency statistics with the original BSES suggested item redundancy. As such, 18 items were deleted, using explicit reduction criteria. Based on the encouraging reliability analysis of the new 14-item BSES-SF, construct validity was assessed using principal components factor analysis, comparison of contrasted groups, and correlations with measures of similar constructs. Support for predictive validity was demonstrated through significant mean differences between breastfeeding and bottle feeding mothers at 4 (p self-efficacy and considered ready for clinical use to (a) identify breastfeeding mothers at high risk, (b) assess breastfeeding behaviors and cognitions to individualize confidence-building strategies, and (c) evaluate the effectiveness of various interventions and guide program development.

Assessing therapy-relevant cognitive capacities in young people: development and psychometric evaluation of the self-reflection and insight scale for youth.

Science.gov (United States)

Sauter, Floor M; Heyne, David; Blöte, Anke W; van Widenfelt, Brigit M; Westenberg, P Michiel

2010-05-01

The effectiveness of cognitive-behaviour therapy with young people may be influenced by a young person's capacity for self-reflection and insight. Clinicians who assess clients' proficiencies in these cognitive capacities can better tailor cognitive and behavioural techniques to the client, facilitating engagement and enhancing treatment outcome. It is therefore important that sound instruments for assessing self-reflection and insight in young people are available. The aim of the current study was to translate and adapt the Self-Reflection and Insight Scale (SRIS) for use with a child and adolescent population (Study 1), and to evaluate the psychometric properties of the resulting measure, the Self-Reflection and Insight Scale for Youth (SRIS-Y; Study 2). In Study 1 (n=145), the comprehensibility of the SRIS-Y was assessed in a community sample of children and adolescents. Study 2 (n=215) then explored the reliability and structural, convergent, and divergent validity of the SRIS-Y. The SRIS-Y was found to be comprehensible to young people, and had good reliability and structural validity. It appears that the SRIS-Y is a sound instrument for assessing therapy-relevant cognitive capacities in young people, of potential benefit in both research and clinical contexts. Future research foci include the predictive validity of the instrument.

Racial and ethnic disparities in stroke outcomes: a scoping review of post-stroke disability assessment tools.

Science.gov (United States)

Burns, Suzanne Perea; White, Brandi M; Magwood, Gayenell; Ellis, Charles; Logan, Ayaba; Jones Buie, Joy N; Adams, Robert J

2018-03-23

To identify how post-stroke disability outcomes are assessed in studies that examine racial/ethnic disparities and to map the identified assessment content to the International Classification of Functioning, Disability, and Health (ICF) across the time course of stroke recovery. We conducted a scoping review of the literature. Articles published between January 2001 and July 2017 were identified through Scopus, PubMed, CINAHL, and PsycINFO according to predefined inclusion and exclusion criteria. We identified 1791 articles through database and hand-searching strategies. Of the articles, 194 met inclusion criteria for full-text review, and 41 met inclusion criteria for study inclusion. The included studies used a variety of outcome measures encompassing domains within the ICF: body functions, activities, participation, and contextual factors across the time course of stroke recovery. We discovered disproportionate representation among racial/ethnic groups in the post-stroke disability disparities literature. A wide variety of assessments are used to examine disparities in post-stroke disability across the time course of stroke recovery. Several studies have identified disparities through a variety of assessments; however, substantial problems abound from the assessments used including inconsistent use of assessments, lacking evidence on the validity of assessments among racial/ethnic groups, and inadequate representation among all racial/ethnic populations comprising the US. Implications for Rehabilitation An enhanced understanding of racial/ethnic disparities in post-stroke disability outcomes is inherently important among rehabilitation practitioners who frequently engage with racial/ethnic minority populations across the time course of stroke recovery. Clinicians should carefully consider the psychometric properties of assessment tools to counter potential racial bias. Clinicians should be aware that many assessments used in stroke rehabilitation lack cultural

Psychometric properties of three measures assessing advanced theory of mind: Evidence from people with schizophrenia.

Science.gov (United States)

Chen, Kuan-Wei; Lee, Shih-Chieh; Chiang, Hsin-Yu; Syu, Ya-Cing; Yu, Xiao-Xuan; Hsieh, Ching-Lin

2017-11-01

Patients with schizophrenia tend to have deficits in advanced Theory of Mind (ToM). The "Reading the mind in the eyes" test (RMET), the Faux Pas Task, and the Strange Stories are commonly used for assessing advanced ToM. However, most of the psychometric properties of these 3 measures in patients with schizophrenia are unknown. The aims of this study were to validate the psychometric properties of the 3 advanced ToM measures in patients with schizophrenia, including: (1) test-retest reliability; (2) random measurement error; (3) practice effect; (4) concurrent validity; and (5) ecological validity. We recruited 53 patients with schizophrenia, who completed the 3 measures twice, 4 weeks apart. The Revised Social Functioning Scale-Taiwan short version (R-SFST) was completed within 3 days of first session of assessments. We found that the intraclass correlation coefficients of the RMET, Strange Stories, and Faux Pas Task were 0.24, 0.5, and 0.76. All 3 advanced ToM measures had large random measurement error, trivial to small practice effects, poor concurrent validity, and low ecological validity. We recommend that the scores of the 3 advanced ToM measures be interpreted with caution because these measures may not provide reliable and valid results on patients' advanced ToM abilities. Copyright © 2017 Elsevier B.V. All rights reserved.

Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities.

Science.gov (United States)

Hong, Ickpyo; Velozo, Craig A; Li, Chih-Ying; Romero, Sergio; Gruber-Baldini, Ann L; Shulman, Lisa M

2016-09-01

The aim of this study is to investigate the psychometrics of the Patient-Reported Outcomes Measurement Information System self-efficacy for managing daily activities item bank. The item pool was field tested on a sample of 1087 participants via internet (n = 250) and in-clinic (n = 837) surveys. All participants reported having at least one chronic health condition. The 35 item pool was investigated for dimensionality (confirmatory factor analyses, CFA and exploratory factor analysis, EFA), item-total correlations, local independence, precision, and differential item functioning (DIF) across gender, race, ethnicity, age groups, data collection modes, and neurological chronic conditions (McFadden Pseudo R (2) less than 10 %). The item pool met two of the four CFA fit criteria (CFI = 0.952 and SRMR = 0.07). EFA analysis found a dominant first factor (eigenvalue = 24.34) and the ratio of first to second eigenvalue was 12.4. The item pool demonstrated good item-total correlations (0.59-0.85) and acceptable internal consistency (Cronbach's alpha = 0.97). The item pool maintained its precision (reliability over 0.90) across a wide range of theta (3.70), and there was no significant DIF. The findings indicated the item pool has sound psychometric properties and the test items are eligible for development of computerized adaptive testing and short forms.

Systematic literature review of patient-reported outcome measures used in assessment and measurement of sleep disorders in chronic obstructive pulmonary disease.

Science.gov (United States)

Garrow, Adam P; Yorke, Janelle; Khan, Naimat; Vestbo, Jørgen; Singh, Dave; Tyson, Sarah

2015-01-01

Sleep problems are common in patients with chronic obstructive pulmonary disease (COPD), but the validity of patient-reported outcome measures (PROMs) that measure sleep dysfunction has not been evaluated. We have reviewed the literature to identify disease-specific and non-disease-specific sleep PROMs that have been validated for use in COPD patients. The review also examined the psychometric properties of identified sleep outcome measures and extracted point and variability estimates of sleep instruments used in COPD studies. The online EMBASE, MEDLINE, PsycINFO, and SCOPUS databases for all years to May 2014 were used to source articles for the review. The review was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Criteria from the Medical Outcomes Trust Scientific Advisory Committee guidelines were used to evaluate the psychometric properties of all sleep PROMs identified. One COPD-specific and six non-COPD-specific sleep outcome measures were identified and 44 papers met the review selection criteria. We only identified one instrument, the COPD and Asthma Sleep Impact Scale, which was developed specifically for use in COPD populations. Ninety percent of the identified studies used one of two non-disease-specific sleep scales, ie, the Pittsburgh Sleep Quality Index and/or the Epworth Sleep Scale, although neither has been tested for reliability or validity in people with COPD. The results highlight a need for existing non-disease-specific instruments to be validated in COPD populations and also a need for new disease-specific measures to assess the impact of sleep problems in COPD.

Psychometric evaluation of the Danish version of Satisfaction with Daily Occupations (SDO)

DEFF Research Database (Denmark)

Eklund, Mona; Morville, Anne-Le

2013-01-01

Aims: The Satisfaction with Daily Occupations (SDO) scale assesses satisfaction within the domains of work, leisure, domestic tasks, and self-care. The aim was to investigate the psychometric properties of the Danish version of the SDO when used with asylum seekers. Methods: The participants were...... and criterion and concurrent validity. The findings regarding discriminant validity were somewhat inconclusive. The Danish SDO may be regarded as psychometrically sound but further psychometric testing is needed. Key words: validity, reliability, health, Activity...

Psychometric Properties of Quality of Life Assessment Tools in Morbid Obesity: A Review of Literature

Directory of Open Access Journals (Sweden)

Negar Yazdani

2018-01-01

Full Text Available Background: Since studies have demonstrated that morbid obesity can exponentially impair quality of life, the measurement of quality of life is paramount to monitoring the effects of treatment and influences the development of clinical pathways, service provision, healthcare expenditures, and public health policy. Accordingly, clinicians, researchers, and policy makers must rely on valid instruments. Aim: This study aimed to review and critique the psychometric properties of some specific tools by COSMIN checklist and their application among morbidly obese individuals. Method: We searched PubMed, Web of Science, PsycINFO, Ovid, Elsevier, and ScienceDirect by using the keywords related to the Quality of Life Questionnaire, namely “morbid obesity”, “tool”, and “scale”, to retrieve articles published during 1989-2017. Then, the psychometric properties of the selected tools were assessed using the COSMIN checklist. Results: Most of the tools had not reported complete and desirable psychometrics properties. Demonstration of responsiveness from independent randomized controlled trials was not available in two of the eight questionnaires. These tools also did not report proper definition of interpretability. However, the data obtained by COSMIN checklist showed that Laval questionnaire is a proper scale for measuring quality of life in obese individuals, which can be recommended to researchers. Implications for Practice: Although Laval questionnaire was found a proper tool for measuring the quality of life among morbid obese patients, developing an instrument suitable for different societies with varied cultural and social characteristics is suggested because socio-cultural factors can influence the quality of life.

Psychometric properties including reliability, validity and responsiveness of the Majeed pelvic score in patients with chronic sacroiliac joint pain.

Science.gov (United States)

Bajada, Stefan; Mohanty, Khitish

2016-06-01

The Majeed scoring system is a disease-specific outcome measure that was originally designed to assess pelvic injuries. The aim of this study was to determine the psychometric properties of the Majeed scoring system for chronic sacroiliac joint pain. Internal consistency, content validity, criterion validity, construct validity and responsiveness to change was assessed prospectively for the Majeed scoring system in a cohort of 60 patients diagnosed with sacroiliac joint pain. This diagnosis was confirmed with CT-guided sacroiliac joint anaesthetic block. The overall Majeed score showed acceptable internal consistency (Cronbach alpha = 0.63). Similarly, it showed acceptable floor (0 %) and ceiling (0 %) effects. On the other hand, the domains of pain, work, sitting and sexual intercourse had high (>30 %) floor effects. Significant correlation with the physical component of the Short Form-36 (p = 0.005) and Oswestry disability index (p ≤ 0.001) was found indicating acceptable criterion validity. The overall Majeed score showed acceptable construct validity with all five developed hypotheses showing significance (p ≤ 0.05). The overall Majeed score showed acceptable responsiveness to change with a large (≥0.80) effect size and standardized response mean. Overall the Majeed scoring system demonstrated acceptable psychometric properties for outcome assessment in chronic sacroiliac joint pain. Thus, its use in this condition is adequate. However, some domains demonstrated suboptimal performance indicating that improvement might be achieved with the development of an outcome measure specific for sacroiliac joint dysfunction and degeneration.

Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

Directory of Open Access Journals (Sweden)

Bárbara Backes

2014-07-01

Full Text Available Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.

Combining choice experiments with psychometric scales to assess the social acceptability of wind energy projects: A latent class approach

International Nuclear Information System (INIS)

Strazzera, Elisabetta; Mura, Marina; Contu, Davide

2012-01-01

A choice experiment exercise is combined with psychometric scales in order: (1) to identify factors that explain support/opposition toward a wind energy development project; and (2) to assess (monetary) trade-offs between attributes of the project. A Latent Class estimator is fitted to the data, and different utility parameters are estimated, conditional on class allocation. It is found that the probability of class membership depends on specific psychometric variables. Visual impacts on valued sites are an important factor of opposition toward a project, and this effect is magnified when identity values are attached to the specific site, so much that no trade-off would be acceptable for a class of individuals characterized by strong place attachment. Conversely, other classes of individuals are willing to accept compensations, in form of private and/or public benefits. The distribution of benefits in the territory, and preservation of the option value related to the possible development of an archeological site, are important for a class of individuals concerned with the sustainability of the local economy. - Highlights: ► A Choice Experiment approach is used to assess acceptability of a wind farm project. ► Psychometric variables are used to model heterogeneity in a Latent Class model. ► No trade-off would be acceptable for a class of individuals. ► Another class of individuals is interested in private benefits. ► Other classes are interested in public benefits and sustainability of the development.

R in Psychometrics and Psychometrics in R

OpenAIRE

Leeuw, Jan de

2006-01-01

In psychometrics, and in the closely related fields of quantititative methods for the social and educational sciences, R is not yet used very often. Traditional mainframe packages such as SAS and SPSS are still dominant at the user-level, Stata has made inroads at the teaching level, and Matlab is quite prominent at the research level. In this paper we define the most visible techniques in the psychometrics area, we give an overview of what is available in R, and we discuss what is m...

Evaluation of psychometric properties of Tinetti performance-oriented mobility assessment scale in subjects with knee osteoarthritis

OpenAIRE

Parveen, Huma; Noohu, Majumi M.

2017-01-01

Objective: The objective of this study was to determine the psychometric properties of the Tinetti Performance-Oriented Mobility Assessment (POMA) scale to measure balance and gait impairments in individuals with knee osteoarthritis (OA). Methods: A convenient sample of 25 individuals with bilateral OA knee were recruited. The convergent validity was determined by correlation analysis between scores of Berg Balance Scale (BBS) with balance subscale (POMA-B) and the Timed Up and Go Test (TU...

Psychometric properties and convergent and predictive validity of an executive function test battery for two-year-olds

Directory of Open Access Journals (Sweden)

Hanna eMulder

2014-07-01

Full Text Available Executive function (EF is an important predictor of numerous developmental outcomes, such as academic achievement and behavioral adjustment. Although a plethora of measurement instruments exists to assess executive function in children, only few of these are suitable for toddlers, and even fewer have undergone psychometric evaluation. The present study evaluates the psychometric properties and validity of an assessment battery for measuring EF in two-year-olds. A sample of 2437 children were administered the assessment battery at a mean age of 2;4 years (SD = 0;3 years in a large-scale field study. Measures of both hot EF (snack and gift delay tasks and cool EF (six boxes, memory for location, and visual search task were included. Confirmatory Factor Analyses showed that a two-factor hot and cool EF model fitted the data better than a one-factor model. Measurement invariance was supported across groups differing in age, gender, socioeconomic status (SES, home language, and test setting. Criterion and convergent validity were evaluated by examining relationships between EF and age, gender, SES, home language, and parent and teacher reports of children’s attention and inhibitory control. Predictive validity of the test battery was investigated by regressing children’s pre-academic skills and behavioral problems at age three on the latent hot and cool EF factors at age two years. The test battery showed satisfactory psychometric quality and criterion, convergent, and predictive validity. Whereas cool EF predicted both pre-academic skills and behavior problems one year later, hot EF predicted behavior problems only. These results show that EF can be assessed with psychometrically sound instruments in children as young as two years, and that EF tasks can be reliably applied in large scale field research. The current instruments offer new opportunities for investigating EF in early childhood, and for evaluating interventions targeted at improving

Initial psychometric evaluation of the Moral Injury Questionnaire--Military version.

Science.gov (United States)

Currier, Joseph M; Holland, Jason M; Drescher, Kent; Foy, David

2015-01-01

Moral injury is an emerging construct related to negative consequences associated with war-zone stressors that transgress military veterans' deeply held values/beliefs. Given the newness of the construct, there is a need for instrumentation that might assess morally injurious experiences (MIEs) in this population. Drawing on a community sample of 131 Iraq and/or Afghanistan Veterans and clinical sample of 82 returning Veterans, we conducted an initial psychometric evaluation of the newly developed Moral Injury Questionnaire-Military version (MIQ-M)-a 20-item self-report measure for assessing MIEs. Possibly due to low rates of reporting, an item assessing sexual trauma did not yield favourable psychometric properties and was excluded from analyses. Veterans in the clinical sample endorsed significantly higher scores across MIQ-M items. Factor analytic results for the final 19 items supported a unidimensional structure, and convergent validity analyses revealed that higher scores (indicative of more MIEs) were correlated with greater general combat exposure, impairments in work/social functioning, posttraumatic stress and depression in the community sample. In addition, when controlling for demographics, deployment-related factors and exposure to life threat stressors associated with combat, tests of incremental validity indicated that MIQ-M scores were also uniquely linked with suicide risk and other mental health outcomes. These findings provide preliminary evidence for the validity of the MIQ-M and support the applicability of this measure for further research and clinical work with Veterans. Military service can confront service members with experiences that undermine their core sense of humanity and violate global values and beliefs. These types of experiences increase the risk for posttraumatic maladjustment in this population, even when accounting for rates of exposure to life threat traumas. Moral injury is an emerging construct to more fully capture the many

Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

Science.gov (United States)

Sijtsma, Klaas

2012-01-01

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

My Vocational Situation (MVS): Case Example and Psychometric Review.

Science.gov (United States)

Nitsch, Kristian P; Pedersen, Jessica; Miliotto, Alexandra; Petersen, Brett; Robbins, Samantha; Garcia, Ana; Hoisington, Molly Ansel; The, Kimberly J; Smiley, Jill; Janikowski, Timothy

This case report provides an overview of the psychometric properties and clinical utility of the My Vocational Situation (MVS) instrument. The accompanying hypothetical case description illustrates how clinicians could use the MVS to evaluate vocational preferences and outcomes and how the MVS can be used to inform treatment planning and rehabilitation decision making. The information contained in this report is intended to familiarize clinicians with the administration and scoring of the MVS, the psychometric information necessary to interpret results obtained from the MVS, and how the results could be used to provide comprehensive, patient-centered care. It is important to note that the information provided represents only a sample of the available research literature on the MVS. Copyright © 2017 by the American Occupational Therapy Association, Inc.

Initial Psychometric Properties of a Brief Parent-Report Instrument for Assessing Tic Severity in Children with Chronic Tic Disorders

Science.gov (United States)

Chang, Susanna; Himle, Michael B.; Tucker, Benjamin T. P.; Woods, Douglas W.; Piacentini, John

2009-01-01

This article describes the development and initial psychometric properties of the Parent Tic Questionnaire (PTQ)--a new measure assessing the number, frequency, and intensity of motor and vocal tics in children and adolescents with Chronic Tic Disorder (CTD). Parents of 40 children with a CTD completed the PTQ as part of a larger assessment…

Psychometric analysis in support of shortening the Scale for the Assessment of Negative Symptoms.

Science.gov (United States)

Levine, Stephen Z; Leucht, Stefan

2013-09-01

Despite recent emphasis on the measurement and treatment of negative symptoms, studies of the Scale for the Assessment of Negative Symptoms (SANS) identify different symptom clusters, offer mixed support for its psychometric properties and suggest that it is shortened. The current study objective is to examine the psychometric properties of the SANS and the feasibility of a short research version of the SANS. Data were re-analyzed from three clinical trials that compared placebo and amisulpride to 60 days. Participants had chronic schizophrenia and predominantly negative symptoms (n=487). Baseline data were examined with exploratory factor analysis and Item Response Theory (IRT) to identify a short SANS. The short and original SANS were compared: with confirmatory factor analysis at endpoint; and on symptom response with mixed modeling to compare. Results showed that at baseline the SANS consisted of three factors labeled Affective-flattening, Asociality and Alogia-inattentiveness. IRT suggested a short SANS with 11 items and 3 response options. Comparisons of the original and short SANS showed: the short version was a better fit to the data based on confirmatory factor analysis at endpoint; similar significant (pnegative symptoms in chronic schizophrenia in research settings. Copyright © 2012 Elsevier B.V. and ECNP. All rights reserved.

Cultural Adaptation and Psychometric Evaluation of the Spanish Version of the Nursing Outcome "Pain Control" in Primary Care Patients with Chronic Pain.

Science.gov (United States)

Bellido-Vallejo, José Carlos; Pancorbo-Hidalgo, Pedro Luis

2017-10-01

The control of chronic pain is a major challenge for patients and health care professionals. To culturally adapt the Nursing Outcomes Classification outcome "Pain control" (PC) to the Spanish health care setting and to analyze its psychometric properties and sensitivity to change. A study of three stages was designed: (1) Translation and cultural adaptation by translation-back-translation method, (2) content validation by a group of experts, and (3) observational-longitudinal study in patients with chronic pain. Patient sampling was nonprobabilistic, and participants completed forms and questionnaires and responded to a question on pain. Statistical analysis included descriptive analysis, content validity index (for global PC and each indicator), principal component analysis, Spearman's test, Cronbach's α, Cohen's κ coefficient, and Wilcoxon range test. The new Spanish version of "Pain control" was semantically equivalent to the original, with a mean content validity index of 0.96. The clinical study included 88 patients with long-term pain, and the mean (standard deviation) interval between assessments (baseline and final) was 29.33 (8.05) days. Thirteen indicators were organized into two components. There was divergent but not convergent validity with the Change Pain Scale and Brief Pain Inventory. Between-observer agreement was κ = 0.48 and internal consistency was α = 0.85. No differences were found between mean baseline and final scores. The Spanish version of "Pain control," culturally adapted and structured in two components (13 indicators), is useful to assess and monitor pain control in patients with chronic pain. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

A systematic review evaluating the psychometric properties of measures of social inclusion.

Science.gov (United States)

Cordier, Reinie; Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching

Development and Validity Testing of the Worksite Health Index: An Assessment Tool to Help and Improve Korean Employees' Health-Related Outcome.

Science.gov (United States)

Yun, Young Ho; Sim, Jin Ah; Lim, Ye Jin; Lim, Cheol Il; Kang, Sung-Choon; Kang, Joon-Ho; Park, Jun Dong; Noh, Dong Young

2016-06-01

The objective of this study was to develop the Worksite Health Index (WHI) and validate its psychometric properties. The development of the WHI questionnaire included item generation, item construction, and field testing. To assess the instrument's reliability and validity, we recruited 30 different Korean worksites. We developed the WHI questionnaire of 136 items categorized into five domains, namely Governance and Infrastructure, Need Assessment and Planning, Health Prevention and Promotion Program, Occupational Safety, and Monitoring and Feedback. All WHI domains demonstrated a high reliability with good internal consistency. The total WHI scores differentiated worksite groups effectively according to firm size. Each domain was associated significantly with employees' health status, absence, and financial outcome. The WHI can assess comprehensive worksite health programs. This tool is publicly available for addressing the growing need for worksite health programs.

An Instrument to Assess Self-Statements During Public Speaking: Scale Development and Preliminary Psychometric Properties

Science.gov (United States)

Hofmann, Stefan G.; DiBartolo, Patricia Marten

2006-01-01

Public speaking is the most commonly reported fearful social situation. Although a number of contemporary theories emphasize the importance of cognitive processes in social anxiety, there is no instrument available to assess fearful thoughts experienced during public speaking. The Self-Statements During Public Speaking (SSPS) scale is a 10-item questionnaire consisting of two 5-item subscales, the “Positive Self-Statements” (SSPS-P) and the “Negative Self-Statements” subscale (SSPS-N). Four studies report on the development and the preliminary psychometric properties of this instrument. PMID:16763666

Psychometric assessment of the Brazilian version of the Male Body Dissatisfaction Scale

Directory of Open Access Journals (Sweden)

Pedro Henrique Berbert de Carvalho

2015-08-01

Full Text Available Background The study of male body image has increased substantially, but there are few assessment tools available for this population. The Male Body Dissatisfaction Scale (MBDS has been widely used among students to research body image disturbances and eating disorders. However, the psychometric properties of this instrument have not been tested in the Brazilian context.Objectives To explore the psychometric properties (convergent validity, internal consistency, test-retest reliability and factor structure of the Brazilian version of the MBDS.Methods Two-hundred sixty-four undergraduate students were evaluated. Pearson’s correlation was used to test the convergent validity of the MBDS and the Drive for Muscularity Scale, the Swansea Muscularity Attitudes Questionnaire, the Rosenberg Self-Esteem Scale, the Beck Depression Inventory, the Eating Attitudes Test-26, and the Commitment to Exercise Scale. Test-retest reliability was evaluated using t-tests for repeated measures and by calculating the coefficient of intraclass correlation. Exploratory factor analysis was conducted, and Cronbach’s α coefficients were determined. A significance level of 5% was adopted.Results The MBDS had an adequate factor structure, with two factors explaining 52.67% of the total variance. It showed excellent internal consistency (Cronbach’s α between 0.90 and 0.92, a high intraclass correlation coefficient (0.81, and convergent validity with the drive for muscularity, the psychological commitment to exercise, low self-esteem, and eating disorder risk behaviour measures.Discussion The MBDS appears to be a valid and reliable tool for evaluating Brazilian male body image dissatisfaction.

Preliminary psychometric properties of the Acceptance and Action Questionnaire-II: a revised measure of psychological inflexibility and experiential avoidance.

Science.gov (United States)

Bond, Frank W; Hayes, Steven C; Baer, Ruth A; Carpenter, Kenneth M; Guenole, Nigel; Orcutt, Holly K; Waltz, Tom; Zettle, Robert D

2011-12-01

The present research describes the development and psychometric evaluation of a second version of the Acceptance and Action Questionnaire (AAQ-II), which assesses the construct referred to as, variously, acceptance, experiential avoidance, and psychological inflexibility. Results from 2,816 participants across six samples indicate the satisfactory structure, reliability, and validity of this measure. For example, the mean alpha coefficient is .84 (.78-.88), and the 3- and 12-month test-retest reliability is .81 and .79, respectively. Results indicate that AAQ-II scores concurrently, longitudinally, and incrementally predict a range of outcomes, from mental health to work absence rates, that are consistent with its underlying theory. The AAQ-II also demonstrates appropriate discriminant validity. The AAQ-II appears to measure the same concept as the AAQ-I (r=.97) but with better psychometric consistency. Copyright © 2011. Published by Elsevier Ltd.

Clinical Outcome Assessments: Conceptual Foundation-Report of the ISPOR Clinical Outcomes Assessment - Emerging Good Practices for Outcomes Research Task Force.

Science.gov (United States)

Walton, Marc K; Powers, John H; Hobart, Jeremy; Patrick, Donald; Marquis, Patrick; Vamvakas, Spiros; Isaac, Maria; Molsen, Elizabeth; Cano, Stefan; Burke, Laurie B

2015-09-01

An outcome assessment, the patient assessment used in an endpoint, is the measuring instrument that provides a rating or score (categorical or continuous) that is intended to represent some aspect of the patient's health status. Outcome assessments are used to define efficacy endpoints when developing a therapy for a disease or condition. Most efficacy endpoints are based on specified clinical assessments of patients. When clinical assessments are used as clinical trial outcomes, they are called clinical outcome assessments (COAs). COAs include any assessment that may be influenced by human choices, judgment, or motivation. COAs must be well-defined and possess adequate measurement properties to demonstrate (directly or indirectly) the benefits of a treatment. In contrast, a biomarker assessment is one that is subject to little, if any, patient motivational or rater judgmental influence. This is the first of two reports by the ISPOR Clinical Outcomes Assessment - Emerging Good Practices for Outcomes Research Task Force. This report provides foundational definitions important for an understanding of COA measurement principles. The foundation provided in this report includes what it means to demonstrate a beneficial effect, how assessments of patients relate to the objective of showing a treatment's benefit, and how these assessments are used in clinical trial endpoints. In addition, this report describes intrinsic attributes of patient assessments and clinical trial factors that can affect the properties of the measurements. These factors should be considered when developing or refining assessments. These considerations will aid investigators designing trials in their choice of using an existing assessment or developing a new outcome assessment. Although the focus of this report is on the development of a new COA to define endpoints in a clinical trial, these principles may be applied more generally. A critical element in appraising or developing a COA is to

Nonparametric tests for equality of psychometric functions.

Science.gov (United States)

García-Pérez, Miguel A; Núñez-Antón, Vicente

2017-12-07

Many empirical studies measure psychometric functions (curves describing how observers' performance varies with stimulus magnitude) because these functions capture the effects of experimental conditions. To assess these effects, parametric curves are often fitted to the data and comparisons are carried out by testing for equality of mean parameter estimates across conditions. This approach is parametric and, thus, vulnerable to violations of the implied assumptions. Furthermore, testing for equality of means of parameters may be misleading: Psychometric functions may vary meaningfully across conditions on an observer-by-observer basis with no effect on the mean values of the estimated parameters. Alternative approaches to assess equality of psychometric functions per se are thus needed. This paper compares three nonparametric tests that are applicable in all situations of interest: The existing generalized Mantel-Haenszel test, a generalization of the Berry-Mielke test that was developed here, and a split variant of the generalized Mantel-Haenszel test also developed here. Their statistical properties (accuracy and power) are studied via simulation and the results show that all tests are indistinguishable as to accuracy but they differ non-uniformly as to power. Empirical use of the tests is illustrated via analyses of published data sets and practical recommendations are given. The computer code in MATLAB and R to conduct these tests is available as Electronic Supplemental Material.

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance.

Science.gov (United States)

Holloway, Laura; Humphrey, Louise; Heron, Louise; Pilling, Claire; Kitchen, Helen; Højbjerre, Lise; Strandberg-Larsen, Martin; Hansen, Brian Bekker

2014-07-22

Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and Activity Impairment Questionnaire: Lupus (WPAI

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance

Science.gov (United States)

2014-01-01

Background Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. Methods A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. Results The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and

Psychometric evaluation of the Sheehan Disability Scale in adult patients with attention-deficit/hyperactivity disorder

Directory of Open Access Journals (Sweden)

Coles T

2014-05-01

Full Text Available Theresa Coles,1 Cheryl Coon,1 Carla DeMuro,1 Lori McLeod,1 Ari Gnanasakthy21Patient-Reported Outcomes, RTI Health Solutions, Research Triangle Park, NC, 2Novartis Pharmaceuticals, East Hanover, NJ, USAAbstract: Inattention and impulsivity symptoms are common among adults with attention-deficit/hyperactivity disorder (ADHD, which can lead to difficulty concentrating, restlessness, difficulty completing tasks, disorganization, impatience, and impulsiveness. Many adults with ADHD find it difficult to focus and prioritize. Resulting outcomes, such as missed deadlines and forgotten engagements, may ultimately impact the ability to function at work, school, home, or in a social environment. The European Medicines Agency guidelines for evaluating medicinal products for ADHD recommend inclusion of both functional outcomes, such as school, social, or work functioning, and outcomes related to symptoms of ADHD in clinical studies of novel medication primary efficacy endpoints. Due to its performance in other disease areas and the relevance of its items as evidenced by content validity analyses, the Sheehan Disability Scale (SDS was chosen to assess functional impairment in ADHD. The aim of this study was to investigate the psychometric properties of the SDS, used as a brief measure of functional impairment in a number of psychiatric disorders, in adult patients with ADHD. To the authors' knowledge, this is the first study to evaluate the reliability of the SDS (based on Cronbach's coefficient alpha and test-retest reliability, its validity (construct and known-groups validity, and its ability to detect change in this patient population. This study also established a preliminary responder definition for the SDS in this study population to determine when change can be considered clinically beneficial in a clinical trial setting. The psychometric results support the use of the SDS subscales (items 1–3 and total score (sum of items 1–3 in an ADHD

A psychometric evaluation of the digital logic concept inventory

Science.gov (United States)

Herman, Geoffrey L.; Zilles, Craig; Loui, Michael C.

2014-10-01

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric evaluation). Classical Test Theory and Item Response Theory provide two psychometric frameworks for evaluating the quality of assessment tools. We discuss how these theories can be applied to assessment tools generally and then apply them to the Digital Logic Concept Inventory (DLCI). We demonstrate that the DLCI is sufficiently reliable for research purposes when used in its entirety and as a post-course assessment of students' conceptual understanding of digital logic. The DLCI can also discriminate between students across a wide range of ability levels, providing the most information about weaker students' ability levels.

Psychometric Properties of the Problems Assessment for Substance Using Psychiatric Patients

Directory of Open Access Journals (Sweden)

Sayed Hadi Sayed Alitabar

2016-05-01

Full Text Available Background and Objective: Today, substance use problem is an important and critical problem in the world. This study investigates the psychometric properties of the Problems Assessment for Substance Using Psychiatric Patients (PASUPP.Materials and Methods: Research was descriptive and correlational. The study population consisted of all psychiatry patients with drug addiction in Tehran. The sample consisted of 381 patients (143 women and 238 men were selected with a multi-stage cluster sampling of areas from drug rehabilitation centers in Tehran. The PASUPP, Drug Abuse Screening Test (DAST and Relapse Prediction Scale (RPS were used as instrument. In order to assess the first order confirmatory factor, the weighted lowest squares (WLS and to assess the adequacy of the model to the data, the parameters of RMR, RMSEA, CFI, AGFI, GFI, c2، c2/ df & Dc2 were used.Results: The PASUPP was confirmed after the first time factor structure of using confirmatory factor analysis. The PASUPP had a good internal consistency (Cranach’s alpha, and the reliability of the test within a week, 88/0, 76/0. Also this scale had a positive correlation with Drug Abuse Screening Test and Relapse Prediction Scale which indicates its convergent validity.Conclusion: The overall results showed that the Problems Assessment for Substance Using Psychiatric Patients in Iranian society is valid. It can be said that self-report scale tool is useful for research purposes and addiction.  

Symptoms and impact of COPD assessed by an electronic diary in patients with moderate-to-severe COPD: psychometric results from the SHINE study

Directory of Open Access Journals (Sweden)

Kulich K

2015-01-01

�� and the ratings of “bother” and “difficulty with activities” confirmed the relevance of this symptom in patients with COPD. Future studies will be required to explore further psychometric properties and their ability to differentiate between COPD treatments.Keywords: QVA149, psychometric assessment, dyspnea, health status, patient-reported outcomes

Linguistic Adaptation and Psychometric Properties of Tamil Version ...

African Journals Online (AJOL)

Background: Oral health has an impact on quality of life hence for research purpose validation of a Tamil version of General Oral Health Assessment Index would enable it to be used as a valuable tool among Tamil speaking population. Aim: In this study, we aimed to assess the psychometric properties of translated Tamil ...

Revisiting the psychometric properties of a revised Danish version of the McGill ingestive skills assessment

DEFF Research Database (Denmark)

Hansen, Tina; Kristiansen, Dorte Melgaard

2017-01-01

Background: During a longstanding validation process of the Danish version of the McGill Ingestive Skills Assessment (MISA2-DK) for measuring mealtime performance in dysphagic clients, extensive revisions have been undertaken. Therefore, this study aimed to determine the psychometric properties...... of this revised version. Methods: In a cross-sectional study, 328 adults referred to occupational therapy for swallowing evaluation were included. MISA2-DK with 36 items distributed into four subscales (positioning for meals, self-feeding skills, liquid ingestion, and solid ingestion) was administered...

Psychometric properties of the Global Operative Assessment of Laparoscopic Skills (GOALS) using item response theory.

Science.gov (United States)

Watanabe, Yusuke; Madani, Amin; Ito, Yoichi M; Bilgic, Elif; McKendy, Katherine M; Feldman, Liane S; Fried, Gerald M; Vassiliou, Melina C

2017-02-01

The extent to which each item assessed using the Global Operative Assessment of Laparoscopic Skills (GOALS) contributes to the total score remains unknown. The purpose of this study was to evaluate the level of difficulty and discriminative ability of each of the 5 GOALS items using item response theory (IRT). A total of 396 GOALS assessments for a variety of laparoscopic procedures over a 12-year time period were included. Threshold parameters of item difficulty and discrimination power were estimated for each item using IRT. The higher slope parameters seen with "bimanual dexterity" and "efficiency" are indicative of greater discriminative ability than "depth perception", "tissue handling", and "autonomy". IRT psychometric analysis indicates that the 5 GOALS items do not demonstrate uniform difficulty and discriminative power, suggesting that they should not be scored equally. "Bimanual dexterity" and "efficiency" seem to have stronger discrimination. Weighted scores based on these findings could improve the accuracy of assessing individual laparoscopic skills. Copyright © 2016 Elsevier Inc. All rights reserved.

Psycho-oncology assessment in Chinese populations: a systematic review of quality of life and psychosocial measures.

Science.gov (United States)

Hyde, M K; Chambers, S K; Shum, D; Ip, D; Dunn, J

2016-09-01

This systematic review describes psychosocial and quality of life (QOL) measures used in psycho-oncology research with cancer patients and caregivers in China. Medline and PsycINFO databases were searched (1980-2014). Studies reviewed met the following criteria: English language; peer-reviewed; sampled Chinese cancer patients/caregivers; developed, validated or assessed psychometric properties of psychosocial or QOL outcome measures; and reported validation data. The review examined characteristics of measures and participants, translation and cultural adaptation processes and psychometric properties of the measures. Ninety five studies met review criteria. Common characteristics of studies reviewed were they: assessed primarily QOL measures, sampled patients with breast, colorectal, or head and neck cancer, and validated existing measures (>80%) originating in North America or Europe. Few studies reported difficulties translating measures. Regarding psychometric properties of the measures >50% of studies reported subscale reliabilities adaptation and psychometric testing of psychosocial measures is needed. Developing support structures for translating and validating psychosocial measures would enable this and ensure Chinese psycho-oncology clinical practice and research keeps pace with international focus on patient reported outcome measures and data management. © 2015 John Wiley & Sons Ltd.

Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

Science.gov (United States)

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

Graphic Creativity Assessment: Psychometric Properties in College Students From Buenos Aires

Directory of Open Access Journals (Sweden)

Agustín Freiberg Hoffmann

2017-04-01

Full Text Available Research on creativity has acquired major development due to its relevance concerning teaching in college. Its assessment is generally conducted by means of verbal and graphic measures. A short scale to measure verbal creativity (CREA in college students from Buenos Aires is currently available. However, right now there are no similar scales designed to assess graphic creativity. In view of that, this study will analyse psychometric features of the ECG scale locally known as Evaluación de la Creatividad Gráfica – Graphic Creativity Assessment, to be employed in the academic milieu in order to provide a complementary measure of verbal creativity. Face and construct validity evidences (converging validity analysis and confirmatory factor analysis were examined as well as reliability, taking into account internal consistency aspects, inter-rater and test-retest stability. The resulting scale showed adequate technical features. The original version, supported by De la Torre’s model, was composed by 12 indicators. This study’s findings maintained 9 of them but, considering new analyses, only 4 of the original ones were retained. This 4-indicator model obtained a better fit to empirical data and good indexes of correlation with a verbal creativity measure, as well as good reliability indicators (internal consistency, inter-rater and test-retest. Findings are discussed taking into account theoretical basis.

The Drug Effects Questionnaire: Psychometric Support across Three Drug Types

Science.gov (United States)

Morean, Meghan E.; de Wit, Harriet; King, Andrea C.; Sofuoglu, Mehmet; Rueger, Sandra Y.; O’Malley, Stephanie S.

2013-01-01

Rationale The Drug Effects Questionnaire (DEQ) is widely used in studies of acute subjective response (SR) to a variety of substances, but the format of the DEQ varies widely across studies, and details of its psychometric properties are lacking. Thus, the field would benefit from demonstrating the reliability and validity of the DEQ for use across multiple substances. Objective The current study evaluated the psychometric properties of several variations of DEQ items, which assessed the extent to which participants (1) feel any substance effect(s), (2) feel high, (3) like the effects, (4) dislike the effects, and (5) want more of the substance using 100mm Visual Analog Scales. Methods DEQ data from three placebo-controlled studies were analyzed to examine SR to amphetamine, nicotine, and alcohol. We evaluated the internal structure of the DEQ for use with each substance as well as relationships between scale items, measures of similar constructs, and substance-related behaviors. Results Results provided preliminary psychometric support for items assessing each DEQ construct (FEEL, HIGH, DISLIKE, LIKE, and MORE). Conclusions Based on the study results, we identify several common limitations of extant variants of the DEQ and recommend an improved version of the measure. The simplicity and brevity of the DEQ combined with its promising psychometric properties support its use in future SR research across a variety of substances. PMID:23271193

Development and psychometric pilot-testing of a questionnaire for the evaluation of satisfaction with continuing education in infection control nurses.

Science.gov (United States)

Meng, Michael; Peter, Daniel; Mattner, Frauke; Igel, Christoph; Kugler, Christiane

2018-05-16

Satisfaction with continuing education can be defined as positive attitudes towards educational programs, which has potential to strengthen learning outcomes. A multi-dimensional construct may enhance continuing education program evaluation processes. The objective is to describe the development and psychometric testing of the 'affective - behavioral - cognitive - satisfaction questionnaire' (ABC-SAT) for assessing participants' satisfaction with a continuing education program for nurses in infection control. The multi-staged development of a satisfaction questionnaire comprised of three subscales. The pilot tool was administered to a nationwide sample of 126 infection control nurses to assess satisfaction after participating in a continuing education program. Satisfaction scores were calculated and psychometric testing was performed to determine reliability, using Cronbach's alpha, face validity, objectivity, and economy. A principle component analysis using varimax rotation and Kaiser normalization was performed. The analysis led to a three-factor solution of the questionnaire with 11 items, explaining 61.4% of the variance. Internal consistency of three scales using Cronbach's alpha was 0.83, 0.60, and 0.66, respectively. Selectivity coefficients varied between 0.39 and 0.70. Participants needed approximately three minutes to complete the questionnaire. Initial findings refer to a satisfying scale structure and internal consistency of the 3-dimensional ABC-SAT questionnaire. Further research is required to confirm the questionnaires' psychometric properties. Copyright © 2018 Elsevier Ltd. All rights reserved.

Patient-assessed measures of health outcome in asthma: a comparison of four approaches.

Science.gov (United States)

Garratt, A M; Hutchinson, A; Russell, I

2000-06-01

The study compares the psychometric properties of four different approaches to patient-assessed health outcomes in asthma, including the Asthma Quality of Life Questionnaire (AQLQ), Newcastle Asthma Symptoms Questionnaire (NASQ), SF-12 and EuroQol. The instruments were administered by means of a self-completed postal questionnaire to 394 patients recruited from general practices in the North East of England. Patients completed a follow-up questionnaire at 6 months. The levels of missing data were assessed and instrument scores compared using correlational analysis. Scores were related to self-reports of smoking behaviour, socioeconomic status and health transition. Responsiveness was assessed using standardized response means. Two hundred and thirty-five patients took part in the study giving a response rate of 59.6%. There was a relatively large amount of missing data for the individualized section of the AQLQ. Correlational analysis provided evidence of convergent validity between the specific instruments; the largest correlation was found between NASQ scores and the asthma symptoms scale of the AQLQ (r = 0.84). The NASQ was found to be the most powerful at discriminating between smokers and non-smokers. All four instruments were linearly related to self-reported asthma transition (Pscope for application in economic evaluation.

The Nurses Self-Concept Instrument (NSCI): assessment of psychometric properties for Australian domestic and international student nurses.

Science.gov (United States)

Angel, Elizabeth; Craven, Rhonda; Denson, Nida

2012-07-01

Professional self-concept is a critical driver of job satisfaction. In Australia, as international nursing enrolments rise, nursing is increasingly characterised by a professional body of international nurses who may differ from domestic Australian nurses in their nursing self-concept. At present, no psychometrically sound instrument for assessing nursing self-concept for Australian domestic and international nursing students is available. The purpose of this study was to: (1) develop an instrument (the Nurses' Self-Concept Instrument (NSCI)) to measure the professional self-concept of domestic and international nursing students in Australia, and (2) test the psychometric properties of this newly developed instrument. A literature review was conducted to generate the initial dimension and item pools to measure nurses' professional self-concept (NSCI). Two stakeholders examined the content and face validity of dimensions and items. Analysis was performed on data collected from 253 undergraduate nursing students in a large public university in Sydney, Australia, and consisted of domestic (n=218) and international (n=35) nursing students. Internal reliability was assessed using Cronbach's Alpha. Confirmatory factor analysis (CFA) was used to assess the construct validity of the NSCI. The resulting NSCI consisted of 14 items across four self-concept domains: care, leadership, staff relations, and knowledge. The CFA supported the hypothesised factor structure of the self-concept model. All reliabilities were acceptable for both domestic and international students (ranging from r=.78 to .93). The NSCI was shown to be a valid and reliable tool for assessing Australian domestic and international student nurses' professional self-concept. This instrument may also enable those responsible for recruitment of students into nursing courses to assess students' professional self-concept and implement appropriate strategies to foster the growth of lifelong career development

Clinimetrics and clinical psychometrics: macro- and micro-analysis.

Science.gov (United States)

Tomba, Elena; Bech, Per

2012-01-01

Clinimetrics was introduced three decades ago to specify the domain of clinical markers in clinical medicine (indexes or rating scales). In this perspective, clinical validity is the platform for selecting the various indexes or rating scales (macro-analysis). Psychometric validation of these indexes or rating scales is the measuring aspect (micro-analysis). Clinical judgment analysis by experienced psychiatrists is included in the macro-analysis and the item response theory models are especially preferred in the micro-analysis when using the total score as a sufficient statistic. Clinical assessment tools covering severity of illness scales, prognostic measures, issues of co-morbidity, longitudinal assessments, recovery, stressors, lifestyle, psychological well-being, and illness behavior have been identified. The constructive dialogue in clinimetrics between clinical judgment and psychometric validation procedures is outlined for generating developments of clinical practice in psychiatry. Copyright © 2012 S. Karger AG, Basel.

Psychometric Properties of the Danish Strength and Difficulties Questionnaire: The SDQ Assessed for More than 70,000 Raters in Four Different Cohorts

DEFF Research Database (Denmark)

Niclasen, Janni; Teasdale, Thomas William; Andersen, Anne-Marie Nybo

2012-01-01

The Strength and Difficulties Questionnaire (SDQ) is a brief behavioural five factor instrument developed to assess emotional and behavioural problems in children and adolescents. The aim of the current study was to evaluate the psychometric properties for parent and teacher ratings in the Danish...

Psychometric properties of a pictorial scale measuring correct condom use.

Science.gov (United States)

Li, Qing; Li, Xiaoming; Stanton, Bonita; Wang, Bo

2011-02-01

This study was designed to assess the psychometric properties of a pictorial scale of correct condom use (PSCCU) using data from female sex workers (FSWs) in China. The psychometric properties assessed in this study include construct validity by correlations and known-group validation. The study sample included 396 FSWs in Guangxi, China. The results demonstrate adequate validity of the PSCCU among the study population. FSWs with a higher level of education scored significantly higher on the PSCCU than those with a lower level of education. FSWs who self-reported appropriate condom use with stable partners scored significantly higher on PSCCU than their counterparts. The PSCCU should provide HIV/STI prevention researchers and practitioners with a valid alternative assessment tool among high-risk populations, especially in resource-limited settings.

The Perfectionistic Self-Presentation Scale--Junior Form: Psychometric Properties and Association with Social Anxiety in Early Adolescents

Science.gov (United States)

Flett, Gordon L.; Coulter, Lisa-Marie; Hewitt, Paul L.

2012-01-01

This study assessed the psychometric characteristics and correlates of the Perfectionistic Self-Presentation Scale--Junior Form (PSPS-JR). The PSPS-JR was designed for use with children and adolescents, but its psychometric properties and applications among early adolescents have not been investigated. The PSPS-JR has three subscales assessing the…

Metric qualities of the cognitive behavioral assessment for outcome evaluation to estimate psychological treatment effects.

Science.gov (United States)

Bertolotti, Giorgio; Michielin, Paolo; Vidotto, Giulio; Sanavio, Ezio; Bottesi, Gioia; Bettinardi, Ornella; Zotti, Anna Maria

2015-01-01

Cognitive behavioral assessment for outcome evaluation was developed to evaluate psychological treatment interventions, especially for counseling and psychotherapy. It is made up of 80 items and five scales: anxiety, well-being, perception of positive change, depression, and psychological distress. The aim of the study was to present the metric qualities and to show validity and reliability of the five constructs of the questionnaire both in nonclinical and clinical subjects. Four steps were completed to assess reliability and factor structure: criterion-related and concurrent validity, responsiveness, and convergent-divergent validity. A nonclinical group of 269 subjects was enrolled, as was a clinical group comprising 168 adults undergoing psychotherapy and psychological counseling provided by the Italian public health service. Cronbach's alphas were between 0.80 and 0.91 for the clinical sample and between 0.74 and 0.91 in the nonclinical one. We observed an excellent structural validity for the five interrelated dimensions. The clinical group showed higher scores in the anxiety, depression, and psychological distress scales, as well as lower scores in well-being and perception of positive change scales than those observed in the nonclinical group. Responsiveness was large for the anxiety, well-being, and depression scales; the psychological distress and perception of positive change scales showed a moderate effect. The questionnaire showed excellent psychometric properties, thus demonstrating that the questionnaire is a good evaluative instrument, with which to assess pre- and post-treatment outcomes.

A systematic review evaluating the psychometric properties of measures of social inclusion

Science.gov (United States)

Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Introduction Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. Objective To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. Methods A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. Conclusions The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working

A tool for assessing continuity of care across care levels: an extended psychometric validation of the CCAENA questionnaire

Directory of Open Access Journals (Sweden)

Marta Beatriz Aller

2013-12-01

Full Text Available Background: The CCAENA questionnaire was developed to assess care continuity across levels from the patients’ perspective. The aim is to provide additional evidence on the psychometric properties of the scales of this questionnaire. Methods: Cross-sectional study by means of a survey of a random sample of 1500 patients attended in primary and secondary care in three healthcare areas of the Catalan healthcare system. Data were collected in 2010 using the CCAENA questionnaire. To assess psychometric properties, an exploratory factor analysis was performed (construct validity and the item-rest correlations and Cronbach’s alpha were calculated (internal consistency. Spearman correlation coefficients were calculated (multidimensionality and the ability to discriminate between groups was tested. Results: The factor analysis resulted in 21 items grouped into three factors: patient-primary care provider relationship, patient-secondary care provider relationship and continuity across care levels. Cronbach’s alpha indicated good internal consistency (0.97, 0.93, 0.80 and the correlation coefficients indicated that dimensions can be interpreted as separated scales. Scales discriminated patients according to healthcare area, age and educational level. Conclusion: The CCAENA questionnaire has proved to be a valid and reliable tool for measuring patients’ perceptions of continuity. Providers and researchers could apply the questionnaire to identify areas for healthcare improvement.

Psychometric Properties of Patient-Facing eHealth Evaluation Measures: Systematic Review and Analysis.

Science.gov (United States)

Wakefield, Bonnie J; Turvey, Carolyn L; Nazi, Kim M; Holman, John E; Hogan, Timothy P; Shimada, Stephanie L; Kennedy, Diana R

2017-10-11

Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A standardized set of metrics used across health systems and research will enable aggregation of data to inform improved implementation, clinical practice, and ultimately health outcomes associated with use of patient-facing eHealth technologies. The objective of this project was to conduct a systematic review to (1) identify existing instruments for eHealth research and implementation evaluation from the patient's point of view, (2) characterize measurement components, and (3) assess psychometrics. Concepts from existing models and published studies of technology use and adoption were identified and used to inform a search strategy. Search terms were broadly categorized as platforms (eg, email), measurement (eg, survey), function/information use (eg, self-management), health care occupations (eg, nurse), and eHealth/telemedicine (eg, mHealth). A computerized database search was conducted through June 2014. Included articles (1) described development of an instrument, or (2) used an instrument that could be traced back to its original publication, or (3) modified an instrument, and (4) with full text in English language, and (5) focused on the patient perspective on technology, including patient preferences and satisfaction, engagement with technology, usability, competency and fluency with technology, computer literacy, and trust in and acceptance of technology. The review was limited to instruments that reported at least one psychometric property. Excluded were investigator-developed measures, disease-specific assessments delivered via technology or telephone (eg, a cancer-coping measure delivered via computer survey), and measures focused primarily on clinician use (eg, the electronic health record). The search strategy yielded 47,320 articles. Following elimination of duplicates and non

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

Science.gov (United States)

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

Science.gov (United States)

Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the

Psychometric Support for the Ownership in Exercise and Empowerment in Exercise Scales

Science.gov (United States)

Moore, E. Whitney G.; Fry, Mary D.

2014-01-01

This study's purpose was to examine the psychometric properties of two new scales developed to quantitatively measure participants' ownership in exercise classes and empowerment, with respect to exercise. These two outcome measures will compliment Achievement Goal Perspective Theory (AGPT) grounded research to better understand participants'…

A Psychometric Approach to Theory-Based Behavior Change Intervention Development: Example From the Colorado Meaning-Activity Project.

Science.gov (United States)

Masters, Kevin S; Ross, Kaile M; Hooker, Stephanie A; Wooldridge, Jennalee L

2018-05-18

There has been a notable disconnect between theories of behavior change and behavior change interventions. Because few interventions are both explicitly and adequately theory-based, investigators cannot assess the impact of theory on intervention effectiveness. Theory-based interventions, designed to deliberately engage the theory's proposed mechanisms of change, are needed to adequately test theories. Thus, systematic approaches to theory-based intervention development are needed. This article will introduce and discuss the psychometric method of developing theory-based interventions. The psychometric approach to intervention development utilizes basic psychometric principles at each step of the intervention development process in order to build a theoretically driven intervention to, subsequently, be tested in process (mechanism) and outcome studies. Five stages of intervention development are presented as follows: (i) Choice of theory; (ii) Identification and characterization of key concepts and expected relations; (iii) Intervention construction; (iv) Initial testing and revision; and (v) Empirical testing of the intervention. Examples of this approach from the Colorado Meaning-Activity Project (COMAP) are presented. Based on self-determination theory integrated with meaning or purpose, and utilizing a motivational interviewing approach, the COMAP intervention is individually based with an initial interview followed by smart phone-delivered interventions for increasing daily activity. The psychometric approach to intervention development is one method to ensure careful consideration of theory in all steps of intervention development. This structured approach supports developing a research culture that endorses deliberate and systematic operationalization of theory into behavior change intervention from the outset of intervention development.

A systematic review of patient reported outcome measures (PROMs) used in child and adolescent burn research.

Science.gov (United States)

Griffiths, C; Armstrong-James, L; White, P; Rumsey, N; Pleat, J; Harcourt, D

2015-03-01

Patient reported outcome measures (PROMs) can identify important information about patient needs and therapeutic progress. The aim of this review was to identify the PROMs that are being used in child and adolescent burn care and to determine the quality of such scales. Computerised and manual bibliographic searches of Medline, Social Sciences Index, Cinahl, Psychinfo, Psycharticles, AMED, and HAPI, were used to identify English-language articles using English-language PROMs from January 2001 to March 2013. The psychometric quality of the PROMs was assessed. 23 studies met the entry criteria and identified 32 different PROMs (31 generic, 1 burns-specific). Overall, the psychometric quality of the PROMs was low; only two generic scales (the Perceived Stigmatisation Questionnaire and the Social Comfort Scale) and only one burns-specific scale (the Children Burn Outcomes Questionnaire for children aged 5-18) had psychometric evidence relevant to this population. The majority of PROMs did not have psychometric evidence for their use with child or adolescent burn patients. To appropriately identify the needs and treatment progress of child and adolescent burn patients, new burns-specific PROMs need to be developed and validated to reflect issues that are of importance to this population. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

Psychometric evaluation of the HIV symptom distress scale

Science.gov (United States)

Marc, Linda G.; Wang, Ming-Mei; Testa, Marcia A.

2012-01-01

The objective of this paper is to psychometrically validate the HIV Symptom Distress Scale (SDS), an instrument that can be used to measure overall HIV symptom distress or clinically relevant groups of HIV symptoms. A secondary data analysis was conducted using the Collaborations in HIV Outcomes Research U.S. Cohort (CHORUS). Inclusion criteria required study participants (N=5,521) to have a valid baseline measure of the AIDS Clinical Trial Group Symptom Distress Module, with an SF-12 or SF-36 completed on the same day. Psychometric testing assessed unidimensionality, internal consistency and factor structure using exploratory and confirmatory factor analysis, and structural equation modeling (SEM). Construct validity examined whether the new measure discriminates across clinical significance (CD4 and HIV viral load). Findings show that the SDS has high reliability (α=0.92), and SEM supports a correlated second-order factor model (physical and mental distress) with acceptable fit (GFI=0.88, AGFI=0.85, NFI=0.99, NNFI=0.99; RMSEA=0.06, [90% CI 0.06 – 0.06]; Satorra Bentler Scaled, C2 =3274.20; p=0.0). Construct validity shows significant differences across categories for HIV-1 viral load (p< 0.001) and CD4 (p< 0.001). Differences in mean SDS scores exist across gender (p< 0.001), race/ethnicity (p< 0.05) and educational attainment (p < 0.001). Hence, the HIV Symptom Distress Scale is a reliable and valid instrument, which measures overall HIV symptoms or clinically relevant groups of symptoms. PMID:22409246

Got spirit? The spiritual climate scale, psychometric properties, benchmarking data and future directions.

Science.gov (United States)

Doram, Keith; Chadwick, Whitney; Bokovoy, Joni; Profit, Jochen; Sexton, Janel D; Sexton, J Bryan

2017-02-11

Organizations that encourage the respectful expression of diverse spiritual views have higher productivity and performance, and support employees with greater organizational commitment and job satisfaction. Within healthcare, there is a paucity of studies which define or intervene on the spiritual needs of healthcare workers, or examine the effects of a pro-spirituality environment on teamwork and patient safety. Our objective was to describe a novel survey scale for evaluating spiritual climate in healthcare workers, evaluate its psychometric properties, provide benchmarking data from a large faith-based healthcare system, and investigate relationships between spiritual climate and other predictors of patient safety and job satisfaction. Cross-sectional survey study of US healthcare workers within a large, faith-based health system. Seven thousand nine hundred twenty three of 9199 eligible healthcare workers across 325 clinical areas within 16 hospitals completed our survey in 2009 (86% response rate). The spiritual climate scale exhibited good psychometric properties (internal consistency: Cronbach α = .863). On average 68% (SD 17.7) of respondents of a given clinical area expressed good spiritual climate, although assessments varied widely (14 to 100%). Spiritual climate correlated positively with teamwork climate (r = .434, p spiritual climate were less likely to have intentions to leave, to be burned out, or to experience disruptive behaviors in their unit and more likely to have participated in executive rounding (p spiritual climate scale exhibits good psychometric properties, elicits results that vary widely by clinical area, and aligns well with other culture constructs that have been found to correlate with clinical and organizational outcomes.

The Spanish-Version of the Subjective Vitality Scale: Psychometric Properties and Evidence of Validity.

Science.gov (United States)

Castillo, Isabel; Tomás, Inés; Balaguer, Isabel

2017-06-05

The Subjective Vitality Scale (SVS) assess the subjective experience of being full of energy and alive, a clinically relevant outcome measure of positive psychological well-being. The purpose of this paper was to translate the 7-item SVS into Spanish and examine its psychometric properties. In Study 1 (n = 790 adolescents) and Study 2 (n = 130 athletes) reliability and exploratory factor analysis (EFA) were carried out. In Study 1 and Study 3 (n = 197 dancers) evidence of validity of inferences based on SVS scores estimating relationships with other variables (life satisfaction, global self-esteem and emotional and physical exhaustion) was obtained. In Study 2 invariance across time was tested. Finally in Study 3, the factorial structure was cross-validated using confirmatory factor analysis (CFA). Results of EFA showed a one-factor solution. CFA also supported a unidimensional factor structure for the Spanish 6-item SVS (RMSEA = .050 (90% CI = .00, .080); NNFI = .993; CFI = .996). Reliability analysis indicated a strong internal consistency in all study samples (α ranged from .82 to .89). Further, results from multi-sample analysis supported the replicability of SVS factor structure across time. Finally, the SVS scores showed the expected correlations patterns (all them significant, p < .01) with the measured outcomes. In conclusion, the Spanish version of the SVS demonstrated adequate psychometric properties, indicating that the scale can be confidently used to measure the experience of possessing energy and aliveness; furthermore, differences across time can be meaningfully carried out.

Psychometric properties of the PROMIS Physical Function item bank in patients receiving physical therapy.

Directory of Open Access Journals (Sweden)

Martine H P Crins

Full Text Available The Patient-Reported Outcomes Measurement Information System (PROMIS is a universally applicable set of instruments, including item banks, short forms and computer adaptive tests (CATs, measuring patient-reported health across different patient populations. PROMIS CATs are highly efficient and the use in practice is considered feasible with little administration time, offering standardized and routine patient monitoring. Before an item bank can be used as CAT, the psychometric properties of the item bank have to be examined. Therefore, the objective was to assess the psychometric properties of the Dutch-Flemish PROMIS Physical Function item bank (DF-PROMIS-PF in Dutch patients receiving physical therapy.Cross-sectional study.805 patients >18 years, who received any kind of physical therapy in primary care in the past year, completed the full DF-PROMIS-PF (121 items.Unidimensionality was examined by Confirmatory Factor Analysis and local dependence and monotonicity were evaluated. A Graded Response Model was fitted. Construct validity was examined with correlations between DF-PROMIS-PF T-scores and scores on two legacy instruments (SF-36 Health Survey Physical Functioning scale [SF36-PF10] and the Health Assessment Questionnaire Disability-Index [HAQ-DI]. Reliability (standard errors of theta was assessed.The results for unidimensionality were mixed (scaled CFI = 0.924, TLI = 0.923, RMSEA = 0.045, 1th factor explained 61.5% of variance. Some local dependence was found (8.2% of item pairs. The item bank showed a broad coverage of the physical function construct (threshold-parameters range: -4.28-2.33 and good construct validity (correlation with SF36-PF10 = 0.84 and HAQ-DI = -0.85. Furthermore, the DF-PROMIS-PF showed greater reliability over a broader score-range than the SF36-PF10 and HAQ-DI.The psychometric properties of the DF-PROMIS-PF item bank are sufficient. The DF-PROMIS-PF can now be used as short forms or CAT to measure the level of

Internet addiction assessment tools: dimensional structure and methodological status.

Science.gov (United States)

Lortie, Catherine L; Guitton, Matthieu J

2013-07-01

Excessive internet use is becoming a concern, and some have proposed that it may involve addiction. We evaluated the dimensions assessed by, and psychometric properties of, a range of questionnaires purporting to assess internet addiction. Fourteen questionnaires were identified purporting to assess internet addiction among adolescents and adults published between January 1993 and October 2011. Their reported dimensional structure, construct, discriminant and convergent validity and reliability were assessed, as well as the methods used to derive these. Methods used to evaluate internet addiction questionnaires varied considerably. Three dimensions of addiction predominated: compulsive use (79%), negative outcomes (86%) and salience (71%). Less common were escapism (21%), withdrawal symptoms (36%) and other dimensions. Measures of validity and reliability were found to be within normally acceptable limits. There is a broad convergence of questionnaires purporting to assess internet addiction suggesting that compulsive use, negative outcome and salience should be covered and the questionnaires show adequate psychometric properties. However, the methods used to evaluate the questionnaires vary widely and possible factors contributing to excessive use such as social motivation do not appear to be covered. © 2013 Society for the Study of Addiction.

A psychometric approach to supervisory competency assessment

Directory of Open Access Journals (Sweden)

A. Vorster

2003-10-01

Full Text Available The primary purpose of this study was to evaluate the possibility of using a psychometric approach for assessing supervisory competencies relevant to the mining and refining environment. The competency questionnaire was developed using supervisory roles and registered supervisory unit standards from the United Kingdom (UK, as no registered unit standards exist in South Africa. Twenty-four supervisors from three departments (Production, Engineering and Laboratory were evaluated by 125 raters; besides by themselves, also by their managers, peers, customers and their sub-ordinates. Based on difference scores derived from the Importance and Performance scales, a single factor was extracted with an internal reliability of 0,965. No statistical significant differences were obtained (ANOVA’s, t-test and F-statistics between groups based on biographical variables or between rater groups. The findings and their implications are further discussed. Opsomming Die primêre doel van die studie was om die moontlikheid vir die gebruik van ’n psigometriese benadering tot toesighouerbevoegdheidsbeoordeling, te evalueer. Die bevoegdheidsvraelys is ontwikkel deur gebruik te maak van toesighouersrolle en geregistreerde toesighouerseenheidstandaarde van die Verenigde Koningkryk, as gevolg van ‘n gebrek aan bestaande eenheidstandaarde in Suid-Afrika. Vier-en-twintig toesighouers van drie departemente (Produksie, Ingenieurswese en Laboratorium is deur 125 beoordelaars geëvalueer; buiten deur hulself, ook deur hul bestuurders, kollegas, kliënte en hul ondergeskiktes. ’n Enkele faktor, met ’n betroubaarheid van 0,965, gebaseer op die verskiltellings van die Prestasie- en Belangrikheidskaal, is onttrek. Geen beduidende verskille (ANOVA’s, t-toetse en F-statistiek kon tussen groepe gebaseer op biografiese veranderlikes en die onderskeie beoordelaarsgroepe gevind word nie. Hierdie bevindinge en die implikasies daarvan word verder bespreek.

Assessing the psychometric properties and the perceived usefulness of the BasisRaadsOnderzoek (BARO as a first-line screening instrument for juvenile offenders

Directory of Open Access Journals (Sweden)

van Loosbroek Erik

2011-06-01

Full Text Available Abstract Background The aim of this study is to investigate the psychometric properties and the perceived usefulness of the BARO (Dutch: BAsisRaadsOnderzoek; Protection Board Preliminary Examination of Juvenile Suspects. The BARO is a first-line screening instrument for the identification of psychiatric disorders, adverse environmental factors, and levels of (dysfunction in adolescent offenders (age 12 to 18, to be used by social workers of the Child Protection Board (CPB following a police arrest. Method CPB workers administered the BARO to 295 juvenile offenders (91% boys, 9% girls. A subgroup of 66 offenders (89% boys, 11% girls underwent an elaborate diagnostic assessment by forensic psychologists and psychiatrists. Using these assessments the most relevant psychometric properties of the BARO were studied. The perceived usefulness was studied using questionnaires to be filled in by the CPB social workers. Results The internal consistency of the instrument was sufficient to good, the concurrent validity of the CPB social workers applying the BARO and the forensic experts carrying out the comprehensive diagnostic assessment was strong, the discriminatory value of the instrument was moderate to strong, and the perceived usefulness of the instrument was evaluated as good to very good by the majority of the CPB workers. Discussion The BARO has sufficient to good psychometric properties including moderate to strong discriminatory value and is considered a good screening instrument by the CPB social workers. In conclusion, the BARO seems to be a very promising first-line screening instrument to identify psychiatric and psychosocial problems in young offenders.

How possible is the development of an operational psychometric method to assess the presence of the 5-HTTLPR s allele? Equivocal preliminary findings

Directory of Open Access Journals (Sweden)

Laszik Andras

2010-05-01

Full Text Available Abstract Objective The s allele of the 5-hydroxytryptamine transporter-linked promoter region (5-HTTLPR polymorphism of the serotonin transporter gene has been found to be associated with neuroticism-related traits, affective temperaments and response to selective serotonin reuptake inhibitor (SSRI treatment. The aim of the current study was to develop a psychometric tool that could at least partially substitute for laboratory testing and could predict the presence of the s allele. Methods The study included 138 women of Caucasian origin, mean 32.20 ± 1.02 years old. All subjects completed the Hungarian standardised version of the Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego Autoquestionnaire (TEMPS-A instrument and were genotyped for 5-HTTLPR using PCR. The statistical analysis included the calculation of the Index of Discrimination (D, Discriminant Function Analysis, creation of scales on the basis of the above and then item analysis and calculation of sensitivity and specificity. Results Four indices were eventually developed, but their psychometric properties were relatively poor and their joint application did not improve the outcome. Conclusions We could not create a scale that predicts the 5-HTTLPR genotype with sufficient sensitivity and specificity, therefore we could not substitute a psychometric scale for laboratory genetic testing in predicting genotype, and also possibly affective disorder characterisation and treatment.

Original article The Symbiotic Bond Questionnaire – theoretical background and psychometric qualities

OpenAIRE

Aleksandra Lewandowska-Walter; Magdalena Błażek; Maria Kaźmierczak

2015-01-01

Background The article describes the Symbiotic Bond Questionnaire (SBQ) – the theoretical background as well as its psychometric characteristics and psychological correlates. The items were created on the basis of the definition of symbiotic personality (Johnson, 1994a). Participants and procedure For these initial survey development and cross-validation studies, the factor structure and psychometric properties of the SBQ were examined. To assess the SBQ’s reliability, the...

Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review

Directory of Open Access Journals (Sweden)

Johnston Marie

2007-03-01

Full Text Available Abstract Subjective measures involving clinician ratings or patient self-assessments have become recognised as an important tool for the assessment of health outcome. The value of a health outcome measure is usually assessed by a psychometric evaluation of its reliability, validity and responsiveness. However, psychometric testing involves an accumulation of evidence and has recognised limitations. It has been suggested that an evaluation of how well a measure has been developed would be a useful additional criteria in assessing the value of a measure. This paper explored the theoretical background and methodological development of subjective health status measures commonly used in osteoarthritis research. Fourteen subjective health outcome measures commonly used in osteoarthritis research were examined. Each measure was explored on the basis of their i theoretical framework (was there a definition of what was being assessed and was it part of a theoretical model? and ii methodological development (what was the scaling strategy, how were the items generated and reduced, what was the response format and what was the scoring method?. Only the AIMS, SF-36 and WHOQOL defined what they were assessing (i.e. the construct of interest and no measure assessed was part of a theoretical model. None of the clinician report measures appeared to have implemented a scaling procedure or described the rationale for the items selected or scoring system. Of the patient self-report measures, the AIMS, MPQ, OXFORD, SF-36, WHOQOL and WOMAC appeared to follow a standard psychometric scaling method. The DRP and EuroQol used alternative scaling methods. The review highlighted the general lack of theoretical framework for both clinician report and patient self-report measures. This review also drew attention to the wide variation in the methodological development of commonly used measures in OA. While, in general the patient self-report measures had good methodological

The Perceived Personal Control (PPC) questionnaire as an outcome of genetic counseling: reliability and validity of the instrument.

NARCIS (Netherlands)

Smets, E.M.A.; Pieterse, A.H.; Aalfs, C.M.; Ausems, M.G.E.M.; Dulmen, A.M. van

2006-01-01

The perceived personal control (PPC) questionnaire was developed by Berkenstadt and colleagues as an outcome measure for the evaluation of the process of genetic counseling. The present study aimed to further assess the psychometric properties of a Dutch version of the instrument. Data were used

The Psychometric Toolbox: An Excel Package for Use in Measurement and Psychometrics Courses

Science.gov (United States)

Ferrando, Pere J.; Masip-Cabrera, Antoni; Navarro-González, David; Lorenzo-Seva, Urbano

2017-01-01

The Psychometric Toolbox (PT) is a user-friendly, non-commercial package mainly intended to be used for instructional purposes in introductory courses of educational and psychological measurement, psychometrics and statistics. The PT package is organized in six separate modules or sub-programs: Data preprocessor (descriptive analyses and data…

Decay of Iconic Memory Traces Is Related to Psychometric Intelligence: A Fixed-Links Modeling Approach

Science.gov (United States)

Miller, Robert; Rammsayer, Thomas H.; Schweizer, Karl; Troche, Stefan J.

2010-01-01

Several memory processes have been examined regarding their relation to psychometric intelligence with the exception of sensory memory. This study examined the relation between decay of iconic memory traces, measured with a partial-report task, and psychometric intelligence, assessed with the Berlin Intelligence Structure test, in 111…

Psychometric Features of the General Aptitude Test-Verbal Part (GAT-V): A Large-Scale Assessment of High School Graduates in Saudi Arabia

Science.gov (United States)

Dimitrov, Dimiter M.; Shamrani, Abdul Rahman

2015-01-01

This study examines the psychometric features of a General Aptitude Test-Verbal Part, which is used with assessments of high school graduates in Saudi Arabia. The data supported a bifactor model, with one general factor and three content domains (Analogy, Sentence Completion, and Reading Comprehension) as latent aspects of verbal aptitude.

Measuring pain phenomena after spinal cord injury: Development and psychometric properties of the SCI-QOL Pain Interference and Pain Behavior assessment tools.

Science.gov (United States)

Cohen, Matthew L; Kisala, Pamela A; Dyson-Hudson, Trevor A; Tulsky, David S

2018-05-01

To develop modern patient-reported outcome measures that assess pain interference and pain behavior after spinal cord injury (SCI). Grounded-theory based qualitative item development; large-scale item calibration field-testing; confirmatory factor analyses; graded response model item response theory analyses; statistical linking techniques to transform scores to the Patient Reported Outcome Measurement Information System (PROMIS) metric. Five SCI Model Systems centers and one Department of Veterans Affairs medical center in the United States. Adults with traumatic SCI. N/A. Spinal Cord Injury - Quality of Life (SCI-QOL) Pain Interference item bank, SCI-QOL Pain Interference short form, and SCI-QOL Pain Behavior scale. Seven hundred fifty-seven individuals with traumatic SCI completed 58 items addressing various aspects of pain. Items were then separated by whether they assessed pain interference or pain behavior, and poorly functioning items were removed. Confirmatory factor analyses confirmed that each set of items was unidimensional, and item response theory analyses were used to estimate slopes and thresholds for the items. Ultimately, 7 items (4 from PROMIS) comprised the Pain Behavior scale and 25 items (18 from PROMIS) comprised the Pain Interference item bank. Ten of these 25 items were selected to form the Pain Interference short form. The SCI-QOL Pain Interference item bank and the SCI-QOL Pain Behavior scale demonstrated robust psychometric properties. The Pain Interference item bank is available as a computer adaptive test or short form for research and clinical applications, and scores are transformed to the PROMIS metric.

Psychometric properties of the OARSI/OMERACT osteoarthritis pain and functional impairment scales: ICOAP, KOOS-PS and HOOS-PS.

Science.gov (United States)

Ruyssen-Witrand, A; Fernandez-Lopez, C J; Gossec, L; Anract, P; Courpied, J P; Dougados, M

2011-01-01

To evaluate the psychometric properties of the OARSI-OMERACT questionnaires in comparison to the existing validated scales. Consecutive hip or knee osteoarthritis patients consulting in an orthopedic department were enrolled in the study. Data collected were pain using the Intermittent and Constant Osteoarthritis Pain (ICOAP), a Numeric Rating Scale (NRS), the Western Ontario McMaster Universities' Osteoarthritis Index (WOMAC) pain subscale, the Lequesne pain subscale; functional impairment using the Knee disability and Osteoarthritis Outcome Score-Physical Function Shortform (KOOS-PS), the Hip disability and Osteoarthritis Outcome Score-Physical Function Shortform (HOOS-PS), a NRS, the WOMAC function sub-scale, the Lequesne function subscale. Validity was assessed by calculating the Spearman's correlation coefficient between all the scales. Reliability was assessed in out-patients with stable disease comparing the data collected within 2 weeks using the intra-class correlation coefficient (ICC). Responsiveness was assessed on the data from hospitalised patients prior to and 12 weeks after a total joint replacement (TJR) using the standardised response mean. Three hundred patients (mean age=68 years, females=62%, hip OA=57%) were included. There was a moderate to good correlation between ICOAP, KOOS-PS, HOOS-PS and the WOMAC, NRS and Lequesne scales. Reliability of the ICOAP hip OA HOOS-PS and KOOS-PS was good (ICC range 0.80-0.81) whereas it was moderate for knee ICOAP (ICC=0.65). Responsiveness of the ICOAP, KOOS-PS and HOOS-PS 12 weeks after TJR was comparable to responsiveness of other scales (SRM range: 0.54-1.82). The psychometric properties of the ICOAP, KOOS-PS and HOOS-PS were comparable to those of the WOMAC, Lequesne and NRS.

Development and Psychometric Assessment of the Measure of Globalization Influence on Health Risk (MGIHR) Among Mexican Women with Breast Cancer.

Science.gov (United States)

Nodora, Jesse N; Carvajal, Scott C; Robles-Garcia, Rebeca; Agraz, Francisco Páez; Daneri-Navarro, Adrian; Meza-Montenegro, Maria Mercedes; Gutierrez-Millan, Luis Enrique; Martinez, Maria Elena

2015-08-01

Lacking in the literature are data addressing the extent to which changes in reproductive and lifestyle factors predispose women in developing nations to higher breast cancer rates, and the degree to which these are due to globalization influences. This article describes the development and psychometric assessment of an instrument intended to measure global, predominantly U.S., influences on breast cancer risk profile among women residing in Mexico. Using investigator consensus and a focus group methodology, the Measure of Globalization Influence on Health Risk (MGIHR) was developed and completed by 341 women. Psychometric analysis support the use of an 11-item Consumerism and Modernity scale and 7-item Reproductive Control and Gender Role scale. The MGIHR is a valid and reliable instrument for understanding changing lifestyle and reproductive factors for breast cancer risk and may provide a more complete understanding of breast cancer development and needed interventions.

Developing and psychometric of an instrument for reproductive ...

African Journals Online (AJOL)

Background: Due to the socio-cultural characteristics of Iranian adult men and lack of standardized questionnaires to assess their reproductive health associated with sexually transmitted diseases and HIV / AIDS, this study is done with the goal of development and psychometrics of a valid relevant instrument. Method: A ...

The psychometric properties of the cervical nonorganic signs in patients with neck pain: an assessment of pain expression.

Science.gov (United States)

Lue, Yi-Jing; Chang, Jyh-Jong; Wu, Yuh-Yih; Lin, Rong-Fong; Lu, Yen-Mou

2018-04-01

Neck pain is a common cause of disability. This study investigated the psychometric properties of the cervical nonorganic signs (CNOS), a tool for assessing abnormal illness behaviors in patients with neck pain. The CNOS was administered on patients with neck pain. Reliability and validity analyses were used to evaluate the psychometric properties. Exploratory factor analysis was used to investigate the dimensionality. Correlations with the Short Form-36 were used to investigate the convergent validity. The results supported the reliability (inter-rater reliability intra-class correlation: 0.920), validity (correlated with body pain (|ρ|=0.31) and vitality (|ρ| =0.30), and two-factor dimensionality (χ 2 =   5.904, p= 0.66; χ 2 /df = 0.738; RMSEApain (severe pain) and vitality (poor vitality) expressed by the patients. The CNOS is a reliable and valid instrument for assessing pain and vitality problems. It helps patients to express severe pain and lack of vitality. The rehabilitation discipline could use the scale to understand pain expression and to design proper rehabilitation programs. Implications for Rehabilitation The cervical nonorganic signs has two domains (pain and vitality). The scale is reliable and valid for patients with neck pain. Patients with high scores on the pain domain have severe body pain that may interfere with normal social activities. Clinicians should understand their suffering and try to help them to alleviate the pain.

Patient-reported outcomes in borderline personality disorder

Science.gov (United States)

Hasler, Gregor; Hopwood, Christopher J.; Jacob, Gitta A.; Brändle, Laura S.; Schulte-Vels, Thomas

2014-01-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes. PMID:25152662

Psychometric properties of parent and child reported sleep assessment tools in children with cerebral palsy: a systematic review.

Science.gov (United States)

Bautista, Manuel; Whittingham, Koa; Edwards, Priya; Boyd, Roslyn N

2018-02-01

To determine whether any parent and child report sleep measure tools have been validated in children aged 0-18 years with cerebral palsy (CP). A systematic search of five databases was performed up to June 2017. Studies were included if a sleep measure tool was used to evaluate sleep in children 0-18 years with CP based on international classifications of sleep. Sleep measures were assessed for psychometric data in children with CP. Only one paper which used the Schlaffragebogen für Kinder mit Neurologischen und Anderen Komplexen Erkrankungen (SNAKE) questionnaire met the study criteria. The four other measures frequently used in children with CP had no psychometric data available for their use in children with CP. The SNAKE questionnaire has been validated only in children with CP in Gross Motor Function Classification System level V. The Sleep Disturbance Scale for Children and the Pediatric Sleep Questionnaire had the strongest psychometric properties in typically developing children, but has not yet been validated in children with CP. Current sleep measures being administered in typically developing children are also often used in children with CP, but have not been well validated in this group of children. There are no condition specific measures of sleep in children with cerebral palsy (CP). The Schlaffragebogen für Kinder mit Neurologischen und Anderen Komplexen Erkrankungen (SNAKE) questionnaire is validated for children with CP in Gross Motor Function Classification System level V. A framework to design a CP specific sleep questionnaire is provided. © 2017 Mac Keith Press.

Psychometrics

NARCIS (Netherlands)

Borsboom, D.; Molenaar, D.; Wright, J.D.

2015-01-01

Psychometrics is a scientific discipline concerned with the construction of measurement models for psychological data. In these models, a theoretical construct (e.g., intelligence) is systematically coordinated with observables (e.g., IQ scores). This is often done through latent variable models,

Assessment of Psychopathological Problems in the School Context: The Psychometric Properties of a Portuguese Version of the Adolescent Psychopathology Scale--Short Form

Science.gov (United States)

Lemos, Ida Timoteo; Faisca, Luis Madeira; Valadas, Sandra Teodosio

2011-01-01

The psychometric properties of a Portuguese version of the Adolescent Psychopathology Scale-Short Form (APS-SF) were studied in a sample of 656 Portuguese adolescents, aged 12 to 19 years, assessed in school context. Also, the aim of the study was to gather data concerning age- and gender-related differences in the expression of psychopathological…

The measurement of social disablement and assessment of psychometric properties of the Social Behaviour Schedule (SBS-BR) in 881 Brazilian long-stay psychiatric patients.

Science.gov (United States)

Lima, Lúcia Abelha; Gonçalves, Sylvia; Pereira, Basílio Bragança; Lovisi, Giovanni Marcos

2006-03-01

Data on the prevalence of social disablement in long-stay psychiatric patients, and the assessment of the psychometric properties of the instruments that evaluate social behaviour in this population are scarce in Brazil. Therefore, this cross-sectional study aimed to estimate the prevalence rates of social disablement in a population of long-stay psychiatric patients from the Rio de Janeiro metropolitan area, and assessed the psychometric properties of the Social Behaviour Schedule (SBS). Data were collected from a population of 881 psychiatric patients housed in the Municipal Mental Health Institute using the 21-item SBS. Most of the patients were women (59%), the mean age was 65.8 years (SD = 11) and the mean length of stay was 37.3 years (SD = 11.5). Of the population, 50.6% were scored as having poor self-care, 46% with little spontaneous communication, 41.1% with poor attention span, and 37.1% with underactivity. Comparing our data with international studies that used the same instrument, we found that our population was more disabled than the others, especially on the social withdrawal factor. Regarding psychometric properties, the inter-rater kappa was 0.709, the inter-informant kappa was 0.500, and the Cronbach's alpha coefficient was 0.766. The groups of patients in the six settings of the institute presented significant statistical differences in the total score (F = 11.447, p < 0.001). This study demonstrates the high rates of social disablement in this population. The precarious conditions of the institution where the patients have been living for decades and unmet individual care may have exacerbated their social disablement. Furthermore, the SBS-BR had satisfactory psychometric properties, particularly reliability, showing it to be an adequate instrument for measuring social disablement in Brazil.

Evaluation of the Psychometric Properties of the Mental Vulnerability Questionnaire in Undergraduate Students.

Science.gov (United States)

Sequeira, Carlos Alberto da Cruz; Barbosa, Elsa Natalina Mendes; Nogueira, Maria José Carvalho; Sampaio, Francisco Miguel Correia

2017-10-01

Translate, adapt the language, and assess the psychometric properties of the Mental Vulnerability Questionnaire (MVQ) in a Portuguese population sample of young adults. A psychometric validation study was performed. The sample comprised 166 undergraduate students. Factor analysis was applied to extract three indicators. The MVQ showed divergent validity with the Positive Mental Health Questionnaire (p Mental Health Inventory including five items (p mental vulnerability. © 2016 Wiley Periodicals, Inc.

Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

Science.gov (United States)

Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

2016-01-01

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Patient-reported outcome (PRO) questionnaires for men who have radical surgery for prostate cancer: a conceptual review of existing instruments.

Science.gov (United States)

Protopapa, Evangelia; van der Meulen, Jan; Moore, Caroline M; Smith, Sarah C

2017-10-01

To critically review conceptual frameworks for available patient-reported outcome (PRO) questionnaires in men having radical prostatectomy (RP), psychometrically evaluate each questionnaire, and identify whether each is appropriate for use at the level of the individual patient. We searched PubMed, the Reports and Publications database of the University of Oxford Patient-Reported Outcomes Measurement Group and the website of the International Consortium for Health Outcomes Measurement (ICHOM) for psychometric reviews of prostate cancer-specific PRO questionnaires. From these we identified relevant questionnaires and critically appraised the conceptual content, guided by the Wilson and Cleary framework and psychometric properties, using well established criteria. The searches found four reviews and one recommendation paper. We identified seven prostate cancer-specific PROs: the Expanded Prostate Cancer Index Composite-26 (EPIC-26), Expanded Prostate Cancer Index Composite-50 (EPIC-50), University of California-Los Angeles Prostate Cancer Index (UCLA-PCI), Functional Assessment of Cancer Therapy - Prostate Cancer Subscale (FACT-P PCS), European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire - prostate specific 25-item (EORTC QLQ-PR25), Prostate Cancer - Quality of Life (PC-QoL), and Symptom Tracking and Reporting (STAR). Six out of seven measures purported to measure health-related quality of life (HRQL), but items focused strongly on urinary and sexual symptoms/functioning. The remaining questionnaire (STAR) claimed to assess functional recovery after RP. The psychometric evidence for these questionnaires was incomplete and variable in quality; none had evidence that they were appropriate for use with individual patients. Several questionnaires provide the basis of measures of urinary and/or sexual symptoms/functioning. Further work should explore other aspects of HRQL that are important for men having RP. Further psychometric work

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

Science.gov (United States)

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational

Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches

Directory of Open Access Journals (Sweden)

Kelly D. Bradley

2016-07-01

Full Text Available This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA and Rasch modeling, the authors investigate the (a an overall assessment of dimensionality using EFA, (b a secondary assessment of dimensionality using a principal components analysis (PCA of the residuals when the items are fit to the Rasch model, and (c an assessment of item-level properties using item-level statistics provided when the items are fit to the Rasch model. The results support the usage of the scale as a supplement to high-stakes decision making such as tenure. However, the lack of precise targeting of item difficulty to person ability combined with the low person separation index renders rank-ordering professors according to minuscule differences in overall subscale scores a highly questionable practice.

Psychometric validation of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool for older Chinese inpatients.

Science.gov (United States)

Zhang, Junhong; Wang, Min; Liu, Yu

2016-10-01

To culturally adapt and evaluate the reliability and validity of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool among older inpatients in the mainland of China. Patient falls are an important safety consideration within hospitals among older inpatients. Nurses need specific risk assessment tools for older inpatients to reliably identify at-risk populations and guide interventions that highlight fixable risk factors for falls and consequent injuries. In China, a few tools have been developed to measure fall risk. However, they lack the solid psychometric development necessary to establish their validity and reliability, and they are not widely used for elderly inpatients. A cross-sectional study. A convenient sampling was used to recruit 201 older inpatients from two tertiary-level hospitals in Beijing and Xiamen, China. The Johns Hopkins Fall Risk Assessment Tool was translated using forward and backward translation procedures and was administered to these 201 older inpatients. Reliability of the tool was calculated by inter-rater reliability and Cronbach's alpha. Validity was analysed through content validity index and construct validity. The Inter-rater reliability of Chinese version of Johns Hopkins Fall Risk Assessment Tool was 97·14% agreement with Cohen's Kappa of 0·903. Cronbach's α was 0·703. Content of Validity Index was 0·833. Two factors represented intrinsic and extrinsic risk factors were explored that together explained 58·89% of the variance. This study provided evidence that Johns Hopkins Fall Risk Assessment Tool is an acceptable, valid and reliable tool to identify older inpatients at risk of falls and falls with injury. Further psychometric testing on criterion validity and evaluation of its advanced utility in geriatric clinical settings are warranted. The Chinese version of Johns Hopkins Fall Risk Assessment Tool may be useful for health care personnel to identify older Chinese inpatients at risk of falls and falls

An instrument assessing satisfaction with iron chelation therapy: Psychometric testing from an open-label clinical trial.

Science.gov (United States)

Rofail, Diana; Viala, Muriel; Gater, Adam; Abetz-Webb, Linda; Baladi, Jean-Francois; Cappellini, Maria Domenica

2010-08-01

The Satisfaction with Iron Chelation Therapy (SICT) instrument was developed based on a literature review, in-depth patient and clinician interviews, and cognitive debriefing interviews. An, open-label, single arm, multicenter trial evaluating the efficacy and safety of deferasirox in patients diagnosed with transfusion-dependent iron overload, provided an opportunity to assess the psychometric measurement properties of the instrument. Psychometric analyses were performed using data at baseline from 273 patients with a range of transfusion-dependent iron overload conditions who were participating in a multinational study. Responsiveness was further evaluated for all patients who also had subsequent satisfaction domain scores collected at week 4. Baseline SICT domain scores had acceptable floor and ceiling effects and internal consistency reliability (Cronbach's alpha: 0.75-0.85). Item discriminant and item convergent validity were both excellent although one item in each analysis did not meet the specified criterion. Small to moderate correlations were observed between SICT and Short Form 36 Health Survey (SF-36) domain scores. Patients with the highest levels of serum ferritin at baseline (>3100 ng/mL) were the least satisfied about the Perceived Effectiveness of ICT and vice versa. Satisfaction improved in all patients, although there were no clear differences observed between groups of patients defined according to changes in serum ferritin levels from baseline to week 4 (stable, improved, or worsened). The SICT domains are reliable and valid. Further testing using a more specific criterion (such as assessing patient global ratings of change in satisfaction domains that correspond to the SICT domains) could help to establish with greater confidence the responsiveness of the instrument.

Measurement of factors that negatively influence the outcome of quitting smoking among patients with COPD: psychometric analyses of the Try To Quit Smoking instrument.

Science.gov (United States)

Lundh, Lena; Alinaghizadeh, Hassan; Törnkvist, Lena; Gilljam, Hans; Galanti, Maria Rosaria

2014-12-01

To test internal consistency and factor structure of a brief instrument called Trying to Quit smoking. The most effective treatment for patients with chronic obstructive pulmonary disease is to quit smoking. Constant thoughts about quitting and repeated quit attempts can generate destructive feelings and make it more difficult to quit. Development and psychometric testing of the Trying to Quit smoking scale. The Trying to Quit smoking, an instrument designed to assess pressure-filled states of mind and corresponding pressure-relief strategies, was tested among 63 Swedish patients with chronic obstructive pulmonary disease. Among these, the psychometric properties of the instrument were analysed by Exploratory Factor Analyses. Fourteen items were included in the factor analyses, loading on three factors labelled: (1) development of pressure-filled mental states; (2) use of destructive pressure-relief strategies; and (3) ambivalent thoughts when trying to quit smoking. These three factors accounted for more than 80% of the variance, performed well on the Kaiser-Meyer-Olkin (KMO) test and had high internal consistency.

Psychometric Characteristics of a Vocational Preference Inventory Short Form.

Science.gov (United States)

Lowman, Rodney L.; Schurman, Susan J.

1982-01-01

The psychometric properties of a revised version of Holland's Vocational Preference Inventory were assessed using federal government employees. Factor analyses, interscale correlations, measures of internal consistency, and criterion group profiles are presented. Evidence was supportive of the validity of the revised form. (Author/BW)

Psychometric Principles in Measurement for Geoscience Education Research: A Climate Change Example

Science.gov (United States)

Libarkin, J. C.; Gold, A. U.; Harris, S. E.; McNeal, K.; Bowles, R.

2015-12-01

Understanding learning in geoscience classrooms requires that we use valid and reliable instruments aligned with intended learning outcomes. Nearly one hundred instruments assessing conceptual understanding in undergraduate science and engineering classrooms (often called concept inventories) have been published and are actively being used to investigate learning. The techniques used to develop these instruments vary widely, often with little attention to psychometric principles of measurement. This paper will discuss the importance of using psychometric principles to design, evaluate, and revise research instruments, with particular attention to the validity and reliability steps that must be undertaken to ensure that research instruments are providing meaningful measurement. An example from a climate change inventory developed by the authors will be used to exemplify the importance of validity and reliability, including the value of item response theory for instrument development. A 24-item instrument was developed based on published items, conceptions research, and instructor experience. Rasch analysis of over 1000 responses provided evidence for the removal of 5 items for misfit and one item for potential bias as measured via differential item functioning. The resulting 18-item instrument can be considered a valid and reliable measure based on pre- and post-implementation metrics. Consideration of the relationship between respondent demographics and concept inventory scores provides unique insight into the relationship between gender, religiosity, values and climate change understanding.

The Body Appreciation Scale-2: item refinement and psychometric evaluation.

Science.gov (United States)

Tylka, Tracy L; Wood-Barcalow, Nichole L

2015-01-01

Considered a positive body image measure, the 13-item Body Appreciation Scale (BAS; Avalos, Tylka, & Wood-Barcalow, 2005) assesses individuals' acceptance of, favorable opinions toward, and respect for their bodies. While the BAS has accrued psychometric support, we improved it by rewording certain BAS items (to eliminate sex-specific versions and body dissatisfaction-based language) and developing additional items based on positive body image research. In three studies, we examined the reworded, newly developed, and retained items to determine their psychometric properties among college and online community (Amazon Mechanical Turk) samples of 820 women and 767 men. After exploratory factor analysis, we retained 10 items (five original BAS items). Confirmatory factor analysis upheld the BAS-2's unidimensionality and invariance across sex and sample type. Its internal consistency, test-retest reliability, and construct (convergent, incremental, and discriminant) validity were supported. The BAS-2 is a psychometrically sound positive body image measure applicable for research and clinical settings. Copyright © 2014 Elsevier Ltd. All rights reserved.

Results from a psychometric assessment of a new tool for measuring evidence-based decision making in public health organizations.

Science.gov (United States)

Stamatakis, Katherine A; Ferreira Hino, Adriano Akira; Allen, Peg; McQueen, Amy; Jacob, Rebekah R; Baker, Elizabeth A; Brownson, Ross C

2017-02-01

In order to better understand how to improve evidence-based decision making (EBDM) in state health departments, measurement tools are needed to evaluate changes in EBDM. The purpose of this study was to test the psychometric properties of a new measurement tool to assess EBDM in public health practice settings. A questionnaire was developed, pilot-tested and refined in an iterative process with the input of public health practitioners with the aim of identifying a set of specific measures representing different components of EBDM. Data were collected in a national survey of state health department chronic disease practitioners. The final dataset (n=879) for psychometric testing was comprised of 19 EBDM items that were first examined using exploratory factor analysis, and then confirmatory factor analysis. The final model from confirmatory factor analysis includes five latent factors representing components of EBDM: capacity for evaluation, expectations and incentives for EBDM, access to evidence and resources for EBDM, participatory decision making, and leadership support and commitment. This study addresses the need for empirically tested and theory-aligned measures that may be used to assess the extent to which EBDM is currently implemented, and further, to gauge the success of strategies to improve EBDM, in public health settings. This EBDM measurement tool may help identify needed supports for enhanced capacity and implementation of effective strategies. Copyright © 2016. Published by Elsevier Ltd.

The suicide assessment scale: psychometric properties of a Norwegian language version.

Science.gov (United States)

Koldsland, Bjørn Odd; Mehlum, Lars; Mellesdal, Liv Solrunn; Walby, Fredrik A; Diep, Lien M

2012-08-07

Rating scales are valuable tools in suicide research and can also be useful supplements to the clinical interview in suicide risk assessments. This study describes the psychometric properties of a Norwegian language version of the Suicide Assessment Scale Self-report version (SUAS-S). Participants were fifty-two patients (mean age = 39.3 years, SD = 10.7) with major depression (53.8%), bipolar disorder (25.0%) and/or a personality disorder (63.5%) referred to a psychiatric outpatient clinic. The SUAS-S, the screening section of the Beck Scale for Suicidal Ideation (BSS-5), the Beck Depression Inventory (BDI), Beck's Hopelessness Scale (BHS), the Symptom Check-List-90 R (SCL-90R) and the Clinical Global Impression for Severity of Suicidality (CGI-SS) were administered. One week later, the patients completed the SUAS-S a second time. Cronbach's alpha for SUAS-S was 0.88 and the test-retest reliability was 0.95 (95% CI: 0.93- 0.97). SUAS-S was positively correlated with the BSS-5 (r = 0.66; 95% CI: 0.47-0.85) for the study sample as a whole and for the suicidal (r = 0.52) and non-suicidal groups (r = 0.50) respectively. There was no difference between the SUAS-S and the BSS-5 in the ability to identify suicidality. This ability was more pronounced when the suicide risk was high. There was a substantial intercorrelation between the score on the SUAS-S and the BDI (0.81) and the BHS (0.76). The sensitivity and specificity of the SUAS-S was explored and an appropriate clinical cut-off value was assessed. The study revealed good internal consistency, test-retest reliability and concurrent validity for the Suicide Assessment Scale Self-report version. The discriminatory ability for suicidality was comparable to that of the BSS-5.

Development and psychometric properties of a measure of catheter burden with bladder drainage after pelvic reconstructive surgery.

Science.gov (United States)

Carpenter, Janet S; Heit, Michael; Rand, Kevin L

2017-04-01

Catheter burden after pelvic reconstructive surgery is an important patient-reported quality of life outcome in research and clinical practice. However, existing tools focus on long-term catheter users rather than short-term postoperative patients. The study aim was to evaluate the psychometric properties of a modified version of the intermittent self-catheterization questionnaire (ISC-Q) in postoperative pelvic reconstructive patients. After experts convened to discuss and modify the ISC-Q items based on their knowledge of women's experiences and clinical practices, 178 women (108 with transurethral and 70 with suprapubic catheters) completed the modified scale and other measures as part of a larger parent study designed to assess health-related quality of life (HRQoL) following pelvic reconstructive surgery requiring bladder drainage. During psychometric testing, the modified ISC-Q was reduced to six items encompassing two factors: a three-item difficulty of use factor and a 3-item embarrassment factor. The new scale was named the short-term catheter burden questionnaire (STCBQ). The two-factor model was robust in both subsamples. Only scores within and not between subsamples can be meaningfully compared due to a lack of scalar invariance. Correlations among STCBQ total scores, subscores, and a single satisfaction item indicated good construct validity. Correlations with patient demographics provided further information about the scale. The STCBQ is a short, efficient assessment of short-term catheter burden following pelvic reconstructive surgery. The scale can be used as an important patient reported outcome measure in clinical practice and research. Neurourol. Urodynam. 36:1140-1146, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Assessment of Affect Lability: Psychometric Properties of the ALS-18.

Science.gov (United States)

Contardi, Anna; Imperatori, Claudio; Amati, Italia; Balsamo, Michela; Innamorati, Marco

2018-01-01

Affect lability, an important aspect of emotion dysregulation, characterizes several psychiatric conditions. The short Affective Lability Scales (ALS-18) measures three aspects of changeability between euthymia and affect states (Anxiety/Depression, AD; Depression/Elation, DE; and Anger, Ang). The aim of our study was to investigate the psychometric characteristics of an Italian version of the ALS-18 in a sample of adults recruited from the general population. The sample was composed of 494 adults (343 women and 151 men) aged 18 and higher (mean age = 31.73 years, SD = 12.6). All participants were administered a checklist assessing socio-demographic variables, the ALS-18 and measures of depression and difficulties in emotion regulation. Confirmatory factor analyses indicated adequate fit of the three-factor model (RMSEA = 0.061, 95% CI = 0.054/0.069; CFI = 0.99; SRMR = 0.055), and the presence of a higher-order general factor. Internal consistency was satisfactory for all the lower-order dimensions and the general factor (ordinal α > 0.70). The ALS-18 was significantly associated with concurrent measures of depression and difficulties in emotion regulation. These findings indicate that the ALS-18 is a valid and reliable instrument for measuring affect lability, although discriminant validity of subdimensions scores could be problematic.

Psychometric properties of a Swedish translation of the VISA-P outcome score for patellar tendinopathy

OpenAIRE

Frohm, Anna; Saartok, Tönu; Edman, Gunnar; Renström, Per

2004-01-01

Abstract Background Self-administrated patient outcome scores are increasingly recommended for evaluation of primary outcome in clinical studies. The VISA-P score, developed at the Victorian Institute of Sport Assessment in Melbourne, Australia, is a questionnaire developed for patients with patellar tendinopathy and the patients assess severity of symptoms, function and ability to participate in sport. The aim of this study was to translate the questionnaire into Swedish and to study the rel...

Linguistic Adaptation and Psychometric Properties of Tamil Version ...

African Journals Online (AJOL)

of a Tamil version of General Oral Health Assessment Index would enable it to be used as a valuable ... psychometric properties, so that it can be used as an efficient tool in identifying the impact of oral ... affects a person physically and psychologically thereby .... questions 3, 5, and 7 were negatively rephrased and choices.

A Systematic Review of Measurement Properties of Patient-Reported Outcome Measures Used in Patients Undergoing Total Knee Arthroplasty.

Science.gov (United States)

Gagnier, Joel J; Mullins, Megan; Huang, Hsiaomin; Marinac-Dabic, Danica; Ghambaryan, Anna; Eloff, Benjamin; Mirza, Faisal; Bayona, Manuel

2017-05-01

While clinical research on total knee arthroplasty (TKA) outcomes is prevalent in the literature, studies often have poor methodological and reporting quality. A high-quality patient-reported outcome instrument is reliable, valid, and responsive. Many studies evaluate these properties, but none have done so with a systematic and accepted method. The objectives of this study were to identify patient-reported outcome measures (PROMs) for TKA, and to critically appraise, compare, and summarize their psychometric properties using accepted methods. MEDLINE, EMBASE, SCOPUS, Web of Science, PsycINFO, and SPORTDiscus were systematically searched for articles with the following inclusion criteria: publication before December 2014, English language, non-generic PRO, and evaluation in the TKA population. Methodological quality and evidence of psychometric properties were assessed with the COnsensus-based standards for the selection of health Status Measurement INstruments (COSMIN) checklist and criteria for psychometric evidence proposed by the COSMIN group and Terwee et al. One-hundred fifteen studies on 32 PROMs were included in this review. Only the Work, Osteoarthritis or joint-Replacement Questionnaire, the Oxford Knee Score, and the Western Ontario and McMaster Universities Arthritis Index had 4 or more properties with positive evidence. Most TKA PROMs have limited evidence for their psychometric properties. Although not all the properties were studied, the Work, Osteoarthritis or joint-Replacement Questionnaire, with the highest overall ratings, could be a useful PROM for evaluating patients undergoing TKA. The methods and reporting of this literature can improve by following accepted guidelines. Published by Elsevier Inc.

The Dutch-Flemish PROMIS Physical Function item bank exhibited strong psychometric properties in patients with chronic pain.

Science.gov (United States)

Crins, Martine H P; Terwee, Caroline B; Klausch, Thomas; Smits, Niels; de Vet, Henrica C W; Westhovens, Rene; Cella, David; Cook, Karon F; Revicki, Dennis A; van Leeuwen, Jaap; Boers, Maarten; Dekker, Joost; Roorda, Leo D

2017-07-01

The objective of this study was to assess the psychometric properties of the Dutch-Flemish Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank in Dutch patients with chronic pain. A bank of 121 items was administered to 1,247 Dutch patients with chronic pain. Unidimensionality was assessed by fitting a one-factor confirmatory factor analysis and evaluating resulting fit statistics. Items were calibrated with the graded response model and its fit was evaluated. Cross-cultural validity was assessed by testing items for differential item functioning (DIF) based on language (Dutch vs. English). Construct validity was evaluated by calculation correlations between scores on the Dutch-Flemish PROMIS Physical Function measure and scores on generic and disease-specific measures. Results supported the Dutch-Flemish PROMIS Physical Function item bank's unidimensionality (Comparative Fit Index = 0.976, Tucker Lewis Index = 0.976) and model fit. Item thresholds targeted a wide range of physical function construct (threshold-parameters range: -4.2 to 5.6). Cross-cultural validity was good as four items only showed DIF for language and their impact on item scores was minimal. Physical Function scores were strongly associated with scores on all other measures (all correlations ≤ -0.60 as expected). The Dutch-Flemish PROMIS Physical Function item bank exhibited good psychometric properties. Development of a computer adaptive test based on the large bank is warranted. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and psychometric evaluation of the Professional Practice Environment (PPE) scale.

Science.gov (United States)

Erickson, Jeanette Ives; Duffy, Mary E; Gibbons, M Patricia; Fitzmaurice, Joan; Ditomassi, Marianne; Jones, Dorothy

2004-01-01

To describe the Professional Practice Environment (PPE) scale, its conceptual development and psychometric evaluation, and its uses in measuring eight characteristics of the professional practice environment in an acute care setting. The 38-item PPE Scale was validated on a sample of 849 professional practice staff at the Massachusetts General Hospital in Boston. Psychometric analysis included: item analysis, principal components analysis (PCA) with varimax rotation and Kaiser normalization, and internal consistency reliability using Cronbach's alpha coefficient. Eight components were shown, confirming the original conceptually derived model's structure and accounting for 61% of explained variance. Cronbach's alpha coefficients for the eight PPE subscales ranged from .78 to .88. Findings showed the 38-item PPE Scale was reliable and valid for use in health outcomes research to examine the professional practice environment of staff working in acute care settings.

Modeling the Development of Vocational Competence: A Psychometric Model for Economic Domains

Science.gov (United States)

Klotz, Viola Katharina; Winther, Esther; Festner, Dagmar

2015-01-01

This article discusses the development of vocational competence through economic vocational educational training (VET) from a theoretical and psychometric perspective. Most assessment and competence models tend to adopt a state perspective toward assessments of competence and carve out different structures of competence for diverse vocational…

The Free and Cued Selective Reminding Test: evidence of psychometric adequacy

Directory of Open Access Journals (Sweden)

KATJA OCEPEK-WELIKSON

2009-09-01

Full Text Available These analyses examine the psychometric properties of the Free and Cued Selective Reminding Test with Immediate Recall (FCSRT-IR. FCSRT-IR is a measure of memory under conditions that control attention and cognitive processing in order to obtain an assessment of memory unconfounded by normal agerelated changes in cognition. FCSRT-IR performance has been associated with preclinical and early dementia in several longitudinal epidemiological studies. Factor and item response theory analyses were applied to FCSRT-IR data from patients at a geriatric primary care center who had independently established clinical diagnoses. The results provide supporting evidence for the psychometric adequacy of the FCSR-IR in terms of reliability, essential (sufficient unidimensionality, information across the continuum of memory disability/ability, and classification accuracy. The psychometric adequacy of the FCSRT-IR adds further validity to its use as a case finding strategy for dementia.

Children and Young People-Mental Health Safety Assessment Tool (CYP-MH SAT) study: Protocol for the development and psychometric evaluation of an assessment tool to identify immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings

Science.gov (United States)

Walker, Gemma M; Carter, Tim; Aubeeluck, Aimee; Witchell, Miranda; Coad, Jane

2018-01-01

Introduction Currently, no standardised, evidence-based assessment tool for assessing immediate self-harm and suicide in acute paediatric inpatient settings exists. Aim The aim of this study is to develop and test the psychometric properties of an assessment tool that identifies immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings. Methods and analysis Development phase: This phase involved a scoping review of the literature to identify and extract items from previously published suicide and self-harm risk assessment scales. Using a modified electronic Delphi approach, these items will then be rated according to their relevance for assessment of immediate suicide or self-harm risk by expert professionals. Inclusion of items will be determined by 65%–70% consensus between raters. Subsequently, a panel of expert members will convene to determine the face validity, appropriate phrasing, item order and response format for the finalised items. Psychometric testing phase: The finalised items will be tested for validity and reliability through a multicentre, psychometric evaluation. Psychometric testing will be undertaken to determine the following: internal consistency, inter-rater reliability, convergent, divergent validity and concurrent validity. Ethics and dissemination Ethical approval was provided by the National Health Service East Midlands—Derby Research Ethics Committee (17/EM/0347) and full governance clearance received by the Health Research Authority and local participating sites. Findings from this study will be disseminated to professionals and the public via peer-reviewed journal publications, popular social media and conference presentations. PMID:29654046

A psychometric comparison of three scales and a single-item measure to assess sexual satisfaction.

Science.gov (United States)

Mark, Kristen P; Herbenick, Debby; Fortenberry, J Dennis; Sanders, Stephanie; Reece, Michael

2014-01-01

This study was designed to systematically compare and contrast the psychometric properties of three scales developed to measure sexual satisfaction and a single-item measure of sexual satisfaction. The Index of Sexual Satisfaction (ISS), Global Measure of Sexual Satisfaction (GMSEX), and the New Sexual Satisfaction Scale-Short (NSSS-S) were compared to one another and to a single-item measure of sexual satisfaction. Conceptualization of the constructs, distribution of scores, internal consistency, convergent validity, test-retest reliability, and factor structure were compared between the measures. A total of 211 men and 214 women completed the scales and a measure of relationship satisfaction, with 33% (n = 139) of the sample reassessed two months later. All scales demonstrated appropriate distribution of scores and adequate internal consistency. The GMSEX, NSSS-S, and the single-item measure demonstrated convergent validity. Test-retest reliability was demonstrated by the ISS, GMSEX, and NSSS-S, but not the single-item measure. Taken together, the GMSEX received the strongest psychometric support in this sample for a unidimensional measure of sexual satisfaction and the NSSS-S received the strongest psychometric support in this sample for a bidimensional measure of sexual satisfaction.

Psychometric Validation of the BODY-Q in Danish Patients Undergoing Weight Loss and Body Contouring Surgery

DEFF Research Database (Denmark)

Poulsen, Lotte; Klassen, Anne; Rose, Michael

2017-01-01

study aims to psychometrically validate the BODY-Q for use in Danish patients. Methods: The process consisted of 3 stages: translation and linguistic validation, field-test, and data analysis. The translation was performed in accordance with the International Society for Pharmacoeconomics and Outcomes...... assessments with an overall response rate at 76%. Cronbach α values were ≥ 0.90, and person separation index values were in general high. The Rasch Measurement Theory analysis provided broad support for the reliability and validity of the Danish version of the BODY-Q scales. Item fit was outside the criteria...... for 34 of 138 items, and of these, 21 had a significant chi-square P value after Bonferroni adjustment. Most items (128 of 138) had ordered thresholds, indicating that response options worked as intended. Conclusion: The Danish version of the BODY-Q is a reliable and valid patient-reported outcome...

Anticipated Benefits of Care (ABC): psychometrics and predictive value in psychiatric disorders.

Science.gov (United States)

Warden, D; Trivedi, M H; Carmody, T J; Gollan, J K; Kashner, T M; Lind, L; Crismon, M L; Rush, A J

2010-06-01

Attitudes and expectations about treatment have been associated with symptomatic outcomes, adherence and utilization in patients with psychiatric disorders. No measure of patients' anticipated benefits of treatment on domains of everyday functioning has previously been available. The Anticipated Benefits of Care (ABC) is a new, 10-item questionnaire used to measure patient expectations about the impact of treatment on domains of everyday functioning. The ABC was collected at baseline in adult out-patients with major depressive disorder (MDD) (n=528), bipolar disorder (n=395) and schizophrenia (n=447) in the Texas Medication Algorithm Project (TMAP). Psychometric properties of the ABC were assessed, and the association of ABC scores with treatment response at 3 months was evaluated. Evaluation of the ABC's internal consistency yielded Cronbach's alpha of 0.90-0.92 for patients across disorders. Factor analysis showed that the ABC was unidimensional for all patients and for patients with each disorder. For patients with MDD, lower anticipated benefits of treatment was associated with less symptom improvement and lower odds of treatment response [odds ratio (OR) 0.72, 95% confidence interval (CI) 0.57-0.87, p=0.0011]. There was no association between ABC and symptom improvement or treatment response for patients with bipolar disorder or schizophrenia, possibly because these patients had modest benefits with treatment. The ABC is the first self-report that measures patient expectations about the benefits of treatment on everyday functioning, filling an important gap in available assessments of attitudes and expectations about treatment. The ABC is simple, easy to use, and has acceptable psychometric properties for use in research or clinical settings.

Psychometric Properties of the Theory of Mind Assessment Scale in a Sample of Adolescents and Adults.

Science.gov (United States)

Bosco, Francesca M; Gabbatore, Ilaria; Tirassa, Maurizio; Testa, Silvia

2016-01-01

This research aimed at the evaluation of the psychometric properties of the Theory of Mind Assessment Scale (Th.o.m.a.s.). Th.o.m.a.s. is a semi-structured interview meant to evaluate a person's Theory of Mind (ToM). It is composed of several questions organized in four scales, each focusing on one of the areas of knowledge in which such faculty may manifest itself: Scale A (I-Me) investigates first-order first-person ToM; Scale B (Other-Self) investigates third-person ToM from an allocentric perspective; Scale C (I-Other) again investigates third-person ToM, but from an egocentric perspective; and Scale D (Other-Me) investigates second-order ToM. The psychometric proprieties of Th.o.m.a.s. were evaluated in a sample of 156 healthy persons: 80 preadolescent and adolescent (aged 11-17 years, 42 females) and 76 adults (aged from 20 to 67 years, 35 females). Th.o.m.a.s. scores show good inter-rater agreement and internal consistency; the scores increase with age. Evidence of criterion validity was found as Scale B scores were correlated with those of an independent instrument for the evaluation of ToM, the Strange Stories task. Confirmatory factor analysis (CFA) showed good fit of the four-factors theoretical model to the data, although the four factors were highly correlated. For each of the four scales, Rasch analyses showed that, with few exceptions, items fitted the Partial credit model and their functioning was invariant for gender and age. The results of this study, along with those of previous researches with clinical samples, show that Th.o.m.a.s. is a promising instrument to assess ToM in different populations.

Demographic, behavioral, and psychometric characteristics of persons denied unescorted access on the basis of psychological assessment

International Nuclear Information System (INIS)

Berghausen, P.E.

1988-01-01

This paper examines the demographic, behavioral, and psychometric characteristics of persons who were denied unescorted access authorization for protected areas and vital islands of nuclear power plants, in accordance with the relevant proposed rule of the United States Nuclear Regulatory Commission. Demographic characteristics examined include age, sex, occupation, education, marital status, and number of children. Behavioral characteristics examined include substance use/abuse/treatment and instances of antisocial behavior. Psychometric characteristics examined include elevations on basic MMPI clinical scales, elevations on special indices of psychosis and substance abuse, and endorsement of so-called critical items

Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia.

Science.gov (United States)

Timmerman, Angelique A; Speyer, Renée; Heijnen, Bas J; Klijn-Zwijnenberg, Iris R

2014-04-01

Dysphagia can have severe consequences for the patient's health, influencing health-related quality of life (HRQoL). Sound psychometric properties of HRQoL questionnaires are a precondition for assessing the impact of dysphagia, the focus of this study, resulting in recommendations for the appropriate use of these questionnaires in both clinical practice and research contexts. We performed a systematic review starting with a search for and retrieval of all full-text articles on the development of HRQoL questionnaires related to oropharyngeal dysphagia and/or their psychometric validation from the electronic databases PubMed and Embase published up to June 2011. Psychometric properties were judged according to quality criteria proposed for health status questionnaires. Eight questionnaires were included in this study. Four are aimed solely at HRQoL in oropharyngeal dysphagia: the deglutition handicap index (DHI), dysphagia handicap index (DHI'), M.D. Anderson Dysphagia Inventory (MDADI), and SWAL-QOL, while the EDGQ, EORTC QLQ-STO 22, EORTC QLQ-OG 25 and EORTC QLQ-H&N35 focus on other primary diseases resulting in dysphagia. The psychometric properties of the DHI, DHI', MDADI, and SWAL-QOL were evaluated. For appropriate applicability of HRQoL questionnaires, strong scores on the psychometric criteria face validity, criterion validity, and interpretability are prerequisites. The SWAL-QOL has the strongest ratings for these criteria, while the DHI' is the most easy to apply given its 25 items and the use of a uniform scoring format. For optimal use of HRQoL questionnaires in diverse settings, it is necessary to combine psychometric and utility approaches.

Four theorems on the psychometric function.

Science.gov (United States)

May, Keith A; Solomon, Joshua A

2013-01-01

In a 2-alternative forced-choice (2AFC) discrimination task, observers choose which of two stimuli has the higher value. The psychometric function for this task gives the probability of a correct response for a given stimulus difference, Δx. This paper proves four theorems about the psychometric function. Assuming the observer applies a transducer and adds noise, Theorem 1 derives a convenient general expression for the psychometric function. Discrimination data are often fitted with a Weibull function. Theorem 2 proves that the Weibull "slope" parameter, β, can be approximated by β(Noise) x β(Transducer), where β(Noise) is the β of the Weibull function that fits best to the cumulative noise distribution, and β(Transducer) depends on the transducer. We derive general expressions for β(Noise) and β(Transducer), from which we derive expressions for specific cases. One case that follows naturally from our general analysis is Pelli's finding that, when d' ∝ (Δx)(b), β ≈ β(Noise) x b. We also consider two limiting cases. Theorem 3 proves that, as sensitivity improves, 2AFC performance will usually approach that for a linear transducer, whatever the actual transducer; we show that this does not apply at signal levels where the transducer gradient is zero, which explains why it does not apply to contrast detection. Theorem 4 proves that, when the exponent of a power-function transducer approaches zero, 2AFC performance approaches that of a logarithmic transducer. We show that the power-function exponents of 0.4-0.5 fitted to suprathreshold contrast discrimination data are close enough to zero for the fitted psychometric function to be practically indistinguishable from that of a log transducer. Finally, Weibull β reflects the shape of the noise distribution, and we used our results to assess the recent claim that internal noise has higher kurtosis than a Gaussian. Our analysis of β for contrast discrimination suggests that, if internal noise is stimulus

Four theorems on the psychometric function.

Directory of Open Access Journals (Sweden)

Keith A May

Full Text Available In a 2-alternative forced-choice (2AFC discrimination task, observers choose which of two stimuli has the higher value. The psychometric function for this task gives the probability of a correct response for a given stimulus difference, Δx. This paper proves four theorems about the psychometric function. Assuming the observer applies a transducer and adds noise, Theorem 1 derives a convenient general expression for the psychometric function. Discrimination data are often fitted with a Weibull function. Theorem 2 proves that the Weibull "slope" parameter, β, can be approximated by β(Noise x β(Transducer, where β(Noise is the β of the Weibull function that fits best to the cumulative noise distribution, and β(Transducer depends on the transducer. We derive general expressions for β(Noise and β(Transducer, from which we derive expressions for specific cases. One case that follows naturally from our general analysis is Pelli's finding that, when d' ∝ (Δx(b, β ≈ β(Noise x b. We also consider two limiting cases. Theorem 3 proves that, as sensitivity improves, 2AFC performance will usually approach that for a linear transducer, whatever the actual transducer; we show that this does not apply at signal levels where the transducer gradient is zero, which explains why it does not apply to contrast detection. Theorem 4 proves that, when the exponent of a power-function transducer approaches zero, 2AFC performance approaches that of a logarithmic transducer. We show that the power-function exponents of 0.4-0.5 fitted to suprathreshold contrast discrimination data are close enough to zero for the fitted psychometric function to be practically indistinguishable from that of a log transducer. Finally, Weibull β reflects the shape of the noise distribution, and we used our results to assess the recent claim that internal noise has higher kurtosis than a Gaussian. Our analysis of β for contrast discrimination suggests that, if internal noise is

Validation of the Organizational Culture Assessment Instrument

Science.gov (United States)

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

Validation of the organizational culture assessment instrument.

Directory of Open Access Journals (Sweden)

Brody Heritage

Full Text Available Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102 Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

Short scales to assess cannabis-related problems: a review of psychometric properties

Directory of Open Access Journals (Sweden)

Klempova Danica

2008-12-01

Full Text Available Abstract Aims The purpose of this paper is to summarize the psychometric properties of four short screening scales to assess problematic forms of cannabis use: Severity of Dependence Scale (SDS, Cannabis Use Disorders Identification Test (CUDIT, Cannabis Abuse Screening Test (CAST and Problematic Use of Marijuana (PUM. Methods A systematic computer-based literature search was conducted within the databases of PubMed, PsychINFO and Addiction Abstracts. A total of 12 publications reporting measures of reliability or validity were identified: 8 concerning SDS, 2 concerning CUDIT and one concerning CAST and PUM. Studies spanned adult and adolescent samples from general and specific user populations in a number of countries worldwide. Results All screening scales tended to have moderate to high internal consistency (Cronbach's α ranging from .72 to .92. Test-retest reliability and item total correlation have been reported for SDS with acceptable results. Results of validation studies varied depending on study population and standards used for validity assessment, but generally sensitivity, specificity and predictive power are satisfactory. Standard diagnostic cut-off points that can be generalized to different populations do not exist for any scale. Conclusion Short screening scales to assess dependence and other problems related to the use of cannabis seem to be a time and cost saving opportunity to estimate overall prevalences of cannabis-related negative consequences and to identify at-risk persons prior to using more extensive diagnostic instruments. Nevertheless, further research is needed to assess the performance of the tests in different populations and in comparison to broader criteria of cannabis-related problems other than dependence.

Validation of a psychometric instrument to assess motivation in veterinary bachelor students.

Science.gov (United States)

Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc

2014-01-01

There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).

Psychometric properties of a single-item scale to assess sleep quality among individuals with fibromyalgia

Directory of Open Access Journals (Sweden)

Sadosky Alesia B

2009-06-01

Full Text Available Abstract Background Sleep disturbances are a common and bothersome symptom of fibromyalgia (FM. This study reports psychometric properties of a single-item scale to assess sleep quality among individuals with FM. Methods Analyses were based on data from two randomized, double-blind, placebo-controlled trials of pregabalin (studies 1056 and 1077. In a daily diary, patients reported the quality of their sleep on a numeric rating scale ranging from 0 ("best possible sleep" to 10 ("worst possible sleep". Test re-test reliability of the Sleep Quality Scale was evaluated by computing intraclass correlation coefficients. Pearson correlation coefficients were computed between baseline Sleep Quality scores and baseline pain diary and Medical Outcomes Study (MOS Sleep scores. Responsiveness to treatment was evaluated by standardized effect sizes computed as the difference between least squares mean changes in Sleep Quality scores in the pregabalin and placebo groups divided by the standard deviation of Sleep Quality scores across all patients at baseline. Results Studies 1056 and 1077 included 748 and 745 patients, respectively. Most patients were female (study 1056: 94.4%; study 1077: 94.5% and white (study 1056: 90.2%; study 1077: 91.0%. Mean ages were 48.8 years (study 1056 and 50.1 years (study 1077. Test re-test reliability coefficients of the Sleep Quality Scale were 0.91 and 0.90 in the 1056 and 1077 studies, respectively. Pearson correlation coefficients between baseline Sleep Quality scores and baseline pain diary scores were 0.64 (p Conclusion These results provide evidence of the reproducibility, convergent validity, and responsiveness to treatment of the Sleep Quality Scale and provide a foundation for its further use and evaluation in FM patients.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

Science.gov (United States)

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

Disruptive behavior scale for adolescents (DISBA): development and psychometric properties.

Science.gov (United States)

Karimy, Mahmood; Fakhri, Ahmad; Vali, Esmaeel; Vali, Farzaneh; Veiga, Feliciano H; Stein, L A R; Araban, Marzieh

2018-01-01

Growing evidence indicates that if disruptive behavior is left unidentified and untreated, a significant proportion of these problems will persist and may develop into problems linked with delinquency, substance abuse, and violence. Research is needed to develop valid and reliable measures of disruptive behavior to assist recognition and impact of treatments on disruptive behavior. The aim of this study was to develop and evaluate the psychometric properties of a scale for disruptive behavior in adolescents. Six hundred high school students (50% girls), ages ranged 15-18 years old, selected through multi stage random sampling. Psychometrics of the disruptive behavior scale for adolescents (DISBA) (Persian version) was assessed through content validity, explanatory factor analysis (EFA) using Varimax rotation and confirmatory factor analysis (CFA). The reliability of this scale was assessed via internal consistency and test-retest reliability. EFA revealed four factors accounting for 59% of observed variance. The final 29-item scale contained four factors: (1) aggressive school behavior, (2) classroom defiant behavior, (3) unimportance of school, and (4) defiance to school authorities. Furthermore, CFA produced a sufficient Goodness of Fit Index > 0.90. Test-retest and internal consistency reliabilities were acceptable at 0.85 and 0.89, respectively. The findings from this study suggest that the Iranian version of DISBA questionnaire has content validity. Further studies are needed to evaluate stronger psychometric properties for DISBA.

Assessment of identity development and identity diffusion in adolescence - Theoretical basis and psychometric properties of the self-report questionnaire AIDA.

Science.gov (United States)

Goth, Kirstin; Foelsch, Pamela; Schlüter-Müller, Susanne; Birkhölzer, Marc; Jung, Emanuel; Pick, Oliver; Schmeck, Klaus

2012-07-19

In the continuing revision of Diagnostic and Statistical Manual (DSM-V) "identity" is integrated as a central diagnostic criterion for personality disorders (self-related personality functioning). According to Kernberg, identity diffusion is one of the core elements of borderline personality organization. As there is no elaborated self-rating inventory to assess identity development in healthy and disturbed adolescents, we developed the AIDA (Assessment of Identity Development in Adolescence) questionnaire to assess this complex dimension, varying from "Identity Integration" to "Identity Diffusion", in a broad and substructured way and evaluated its psychometric properties in a mixed school and clinical sample. Test construction was deductive, referring to psychodynamic as well as social-cognitive theories, and led to a special item pool, with consideration for clarity and ease of comprehension. Participants were 305 students aged 12-18 attending a public school and 52 adolescent psychiatric inpatients and outpatients with diagnoses of personality disorders (N = 20) or other mental disorders (N = 32). Convergent validity was evaluated by covariations with personality development (JTCI 12-18 R scales), criterion validity by differences in identity development (AIDA scales) between patients and controls. AIDA showed excellent total score (Diffusion: α = .94), scale (Discontinuity: α = .86; Incoherence: α = .92) and subscale (α = .73-.86) reliabilities. High levels of Discontinuity and Incoherence were associated with low levels in Self Directedness, an indicator of maladaptive personality functioning. Both AIDA scales were significantly different between PD-patients and controls with remarkable effect sizes (d) of 2.17 and 1.94 standard deviations. AIDA is a reliable and valid instrument to assess normal and disturbed identity in adolescents. Studies for further validation and for obtaining population norms are in progress and may provide

Psychometric properties of the Exercise Benefits/Barriers Scale in Mexican elderly women

Directory of Open Access Journals (Sweden)

María Cristina Enríquez-Reyna

Full Text Available ABSTRACT Objective: analyze and assess the psychometric properties of the subscales in the Spanish version of the Exercise Benefits/Barriers Scale in an elderly population in the Northeast of Mexico. Method: methodological study. The sample consisted of 329 elderly associated with one of the five public centers for senior citizens in the metropolitan area of Northeast Mexico. The psychometric properties included the assessment of the Cronbach's alpha coefficient, the Kaiser Meyer Olkin coefficient, the inter-item correlation, exploratory and confirmatory factor analysis. Results: in the principal components analysis, two components were identified based on the 43 items in the scale. The item-total correlation coefficient of the exercise benefits subscale was good. Nevertheless, the coefficient for the exercise barriers subscale revealed inconsistencies. The reliability and validity were acceptable. The confirmatory factor analysis revealed that the elimination of items improved the goodness of fit of the baseline scale, without affecting its validity or reliability. Conclusion: the Exercise Benefits/Barriers subscale presented satisfactory psychometric properties for the Mexican context. A 15-item short version is presented with factorial structure, validity and reliability similar to the complete scale.

The Short Form Vaping Consequences Questionnaire: Psychometric Properties of a Measure of Vaping Expectancies for Use With Adult E-cigarette Users.

Science.gov (United States)

Morean, Meghan E; L'Insalata, Alexa

2017-02-01

E-cigarettes are popular in the United States, but psychometrically sound measures of vaping beliefs and behaviors are lacking. We evaluated the psychometrics of the Short Form Vaping Consequences Questionnaire (S-VCQ), a modified version of the Short Form Smoking Consequences Questionnaire that assesses expectancies for negative consequences, positive reinforcement, negative reinforcement, and appetite/weight control associated with vaping. Adult, past-month e-cigarette users completed an anonymous survey in Fall 2015 (N = 522, 50.4% female; 71.5% white; 34.10 [SD = 9.66] years). Psychometric analyses included confirmatory factor analysis, internal consistency, measurement invariance, t tests, correlations, and test-criterion relationships with vaping outcomes. The S-VCQ evidenced a four-factor latent structure (Bentler's Comparative Fit Index = .95, Root Mean Square Error of Approximation = .05, Standardized Root Mean Square Residual = .06), and subscales evidenced internal consistency (mean α = 0.89). S-VCQ scores were scalar invariant for sex and smoking status; women reported stronger appetite/weight control than men and dual cigarette/e-cigarette users (n = 309) reported stronger negative vaping consequences and negative reinforcement than nonsmokers. Among dual users, vaping and smoking expectancies also were scalar invariant; dual users reported stronger positive reinforcement associated with vaping than smoking but stronger negative consequences, negative reinforcement, and appetite/weight control associated with smoking than vaping. Correlations indicated that vaping and smoking expectancies were related, yet distinct constructs. Univariate general linear models indicated that vaping frequency and dependence were associated with positive reinforcement (ηp2 = .02/.02), negative reinforcement (ηp2 = .02/.08), and appetite/weight control (ηp2 = .02/.02) from vaping. The S-VCQ evidences solid psychometrics as a measure of adult e-cigarette users' vaping

A call for policy guidance on psychometric testing in doping control in sport.

Science.gov (United States)

Petróczi, Andrea; Backhouse, Susan H; Barkoukis, Vassilis; Brand, Ralf; Elbe, Anne-Marie; Lazuras, Lambros; Lucidi, Fabio

2015-11-01

One of the fundamental challenges in anti-doping is identifying athletes who use, or are at risk of using, prohibited performance enhancing substances. The growing trend to employ a forensic approach to doping control aims to integrate information from social sciences (e.g., psychology of doping) into organised intelligence to protect clean sport. Beyond the foreseeable consequences of a positive identification as a doping user, this task is further complicated by the discrepancy between what constitutes a doping offence in the World Anti-Doping Code and operationalized in doping research. Whilst psychology plays an important role in developing our understanding of doping behaviour in order to inform intervention and prevention, its contribution to the array of doping diagnostic tools is still in its infancy. In both research and forensic settings, we must acknowledge that (1) socially desirable responding confounds self-reported psychometric test results and (2) that the cognitive complexity surrounding test performance means that the response-time based measures and the lie detector tests for revealing concealed life-events (e.g., doping use) are prone to produce false or non-interpretable outcomes in field settings. Differences in social-cognitive characteristics of doping behaviour that are tested at group level (doping users vs. non-users) cannot be extrapolated to individuals; nor these psychometric measures used for individual diagnostics. In this paper, we present a position statement calling for policy guidance on appropriate use of psychometric assessments in the pursuit of clean sport. We argue that, to date, both self-reported and response-time based psychometric tests for doping have been designed, tested and validated to explore how athletes feel and think about doping in order to develop a better understanding of doping behaviour, not to establish evidence for doping. A false 'positive' psychological profile for doping affects not only the individual

School bonding in early adolescents: Psychometrics of the brief survey of school bonding

Science.gov (United States)

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. Of over 30 tools reviewed, this study examined the psychometric properties of three that together assessed the four constructs identified by Hirschi as key elements. With some...

Key issues affecting quality of life and patient-reported outcomes in prostate cancer: an analysis conducted in 2128 patients with initial psychometric assessment of the prostate cancer symptom scale (PCSS).

Science.gov (United States)

Msaouel, Pavlos; Gralla, Richard J; Jones, Randy A; Hollen, Patricia J

2017-09-01

Evidence-based quality of life (QL) questionnaires require the identification of issues of importance to patients. The primary aim of this study was to inform providers on patient-expressed issues while enhancing the content validity of instruments assessing QL and patient-reported outcomes (PROs) in prostate cancer. The study provided additional psychometric properties for the new PRO and QL instrument, the Prostate Cancer Symptom Scale (PCSS). An anonymous web-based survey of 2128 patients with prostate cancer was conducted with patients rating 18 QL items on a five-point scale. Most respondents (74%) were aged 55-74 years, had early stage disease at diagnosis (81%) and were diagnosed within 2 years of the survey (81%). The top five-rated issues were: overall QL, ability to perform normal activities, maintaining independence, ability to sleep and not being a burden. These items were ranked as either 'very important' or 'important' by at least 88% of patients. None of the most highly ranked issues were symptoms. Instead, the highest ranked items were global issues reflecting the impact of symptoms on patients. In addition to the enhanced content validity findings, good reliability results and initial support for construct validity are reported for the PCSS. This is the largest survey providing patient-expressed background for content validity for QL and PRO measures. The findings of this study should aid development of newer practical questionnaires, such as the PCSS, which can be adapted to electronic platforms enhancing rapid and accurate PRO and QL evaluation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Screening for depression in advanced disease: psychometric properties, sensitivity, and specificity of two items of the Palliative Care Outcome Scale (POS).

Science.gov (United States)

Antunes, Bárbara; Murtagh, Fliss; Bausewein, Claudia; Harding, Richard; Higginson, Irene J

2015-02-01

Depression is common among patients with advanced disease but often difficult to detect. To assess the Palliative care Outcome Scale (POS) (10 items) against the Geriatric Depression Scale (GDS)-10 total score and the Hospital Anxiety and Depression Scale (HADS)-Depression subscale total score and determine if the POS has appropriate items to screen for depression among people with advanced disease. This was a secondary analysis performed on five studies. Four psychometric properties were assessed: data quality, scaling assumptions, acceptability, and internal consistency (reliability). Receiver operating characteristic (ROC) curves were used to determine the area under the curve. Sensitivity, specificity, positive and negative predictive values, false positive and negative rates, and positive and negative likelihood ratios were computed. The overall sample had 416 patients from Germany and England: 144 had cancer and 267 had nonmalignant conditions. Prevalence of depression across the sample was 17.5%. Floor and ceiling effects were rare. Cronbach's alpha coefficients for POS items 7 and 8 summed, GDS-10 and HADS-Depression items varied: 0.61 (heart failure) and 0.80 (cancer). Two items combined (Item 7-feeling depressed and Item 8-feeling good about yourself) consistently presented the highest area under the ROC curve, ranging from 0.76 (95% CI 0.60, 0.93) (Germany, lung cancer) to 0.97 (95% CI 0.91, 1.0) (heart failure), highest negative predictive value, and lowest false negative rate. For the overall sample, the cutoff 2/3 presented a negative predictive value of 89.4% (95% CI 84.7, 92.8) and false negative rate of 10.6 (95% CI 7.2, 15.3). POS items 7 and 8 summed are potentially useful to screen for depression in advanced disease populations. Copyright © 2015 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Assessing reserve-building pursuits and person characteristics: psychometric validation of the Reserve-Building Measure

NARCIS (Netherlands)

Schwartz, Carolyn E.; Michael, Wesley; Zhang, Jie; Rapkin, Bruce D.; Sprangers, Mirjam A. G.

2018-01-01

A growing body of research suggests that regularly engaging in stimulating activities across multiple domains-physical, cultural, intellectual, communal, and spiritual-builds resilience. This project investigated the psychometric characteristics of the DeltaQuest Reserve-Building Measure for use in

The suicide assessment scale: Psychometric properties of a Norwegian language version

Directory of Open Access Journals (Sweden)

Koldsland Bjørn

2012-08-01

Full Text Available Abstract Background Rating scales are valuable tools in suicide research and can also be useful supplements to the clinical interview in suicide risk assessments. This study describes the psychometric properties of a Norwegian language version of the Suicide Assessment Scale Self-report version (SUAS-S. Methods Participants were fifty-two patients (mean age = 39.3 years, SD = 10.7 with major depression (53.8%, bipolar disorder (25.0% and/or a personality disorder (63.5% referred to a psychiatric outpatient clinic. The SUAS-S, the screening section of the Beck Scale for Suicidal Ideation (BSS-5, the Beck Depression Inventory (BDI, Beck’s Hopelessness Scale (BHS, the Symptom Check-List-90 R (SCL-90R and the Clinical Global Impression for Severity of Suicidality (CGI-SS were administered. One week later, the patients completed the SUAS-S a second time. Results Cronbach’s alpha for SUAS-S was 0.88 and the test–retest reliability was 0.95 (95% CI: 0.93– 0.97. SUAS-S was positively correlated with the BSS-5 (r = 0.66; 95% CI: 0.47–0.85 for the study sample as a whole and for the suicidal (r = 0.52 and non-suicidal groups (r = 0.50 respectively. There was no difference between the SUAS-S and the BSS-5 in the ability to identify suicidality. This ability was more pronounced when the suicide risk was high. There was a substantial intercorrelation between the score on the SUAS-S and the BDI (0.81 and the BHS (0.76. The sensitivity and specificity of the SUAS-S was explored and an appropriate clinical cut-off value was assessed. Conclusions The study revealed good internal consistency, test–retest reliability and concurrent validity for the Suicide Assessment Scale Self-report version. The discriminatory ability for suicidality was comparable to that of the BSS-5.

Psychometric Properties of a Suicide Screen for Adjudicated Youth in Residential Care

Science.gov (United States)

Langhinrichsen-Rohling, Jennifer; Hudson, Kenneth; Lamis, Dorian A.; Carr, Nicole

2012-01-01

There is a need to efficiently and effectively screen adjudicated youth residing within the juvenile justice system for suicide proneness. Accordingly, in the current study, the psychometric properties of the Life Attitude Schedule: Short Form (LAS:S), a 24-item risk assessment for suicide proneness, were assessed using data from adjudicated youth…

Psychometric properties and validation of the Italian version of the Family Assessment Measure Third Edition – Short Version – in a nonclinical sample

Directory of Open Access Journals (Sweden)

Pellerone M

2017-02-01

Full Text Available Monica Pellerone,1 Tiziana Ramaci,1 Santa Parrello,2 Paola Guariglia,1 Flavio Giaimo1 1Faculty of Human and Social Sciences, “Kore” University of Enna, Enna, 2Department of Humanities Studies, “Federico II” University of Naples, Napoli, Italy Background: Family functioning plays an important role in developing and maintaining dysfunctional behaviors, especially during adolescence. The lack of indicators of family functioning, as determinants of personal and interpersonal problems, represents an obstacle to the activities aimed at developing preventive and intervention strategies. The Process Model of Family Functioning provides a conceptual framework organizing and integrating various concepts into a comprehensive family assessment; this model underlines that through the process of task accomplishment, each family meets objectives central to its life as a group. The Family Assessment Measure Third Edition (FAM III, based on the Process Model of Family Functioning, is among the most frequently used self-report instruments to measure family functioning. Materials and methods: The present study aimed to evaluate the psychometric properties of the Italian version of the Family Assessment Measure Third Edition – Short Version (Brief FAM-III. It consists of three modules: General Scale, which evaluates the family as a system; Dyadic Relationships Scale, which examines how each family member perceives his/her relationship with another member; and Self-Rating Scale, which indicates how each family member is perceived within the nucleus. The developed Brief FAM-III together with the Family Assessment Device were administered to 484 subjects, members of 162 Italian families, formed of 162 fathers aged between 35 and 73 years; 162 mothers aged between 34 and 69 years; and 160 children aged between 12 and 35 years. Correlation, paired-sample t-test, and reliability analyses were carried out. Results: General item analysis shows good indices of

Generalized Network Psychometrics : Combining Network and Latent Variable Models

NARCIS (Netherlands)

Epskamp, S.; Rhemtulla, M.; Borsboom, D.

2017-01-01

We introduce the network model as a formal psychometric model, conceptualizing the covariance between psychometric indicators as resulting from pairwise interactions between observable variables in a network structure. This contrasts with standard psychometric models, in which the covariance between

Psychometric evaluation of the Social Interaction Phobia Scale.

Science.gov (United States)

Reilly, Alison R; Carleton, R Nicholas; Weeks, Justin W

2012-01-01

The present study evaluated the psychometric properties of a novel measure of social anxiety symptoms, the Social Interaction Phobia Scale (SIPS), as a stand-alone item set, using an undergraduate sample (N=512). The 14-item SIPS has three subscales assessing Social Interaction Anxiety, Fear of Overt Evaluation, and Fear of Attracting Attention. Confirmatory factor analyses replicated the three-factor structure for the SIPS originally reported by Carleton et al. All SIPS scores demonstrated good internal consistency. The convergent validity of the SIPS was supported by strong and positive correlations between all SIPS scores and measures of social anxiety and fear of evaluation; the finding that the relationships between all SIPS scores and a social anxiety measure were stronger than relationships between all SIPS scores and measures of other constructs supported the discriminant validity of the SIPS. Results suggest that the SIPS possesses excellent psychometric properties.

Preliminary results on a new instrument to assess patient motivation for treatment in cognitive-behaviour therapy

NARCIS (Netherlands)

Keijsers, G.P.J.; Schaap, C.P.D.R.; Hoogduin, C.A.L.; Hoogsteyns, B.; Kemp, E.C.M. de

1999-01-01

The Nijmegen Motivation List 2 (NML2) is a new instrument to assess patient motivation for psychotherapy. A previous version of the instrument was associated with positive treatment outcome in cognitive-behaviour therapy in several studies but its psychometric properties were poor. The present study

Modern psychometric approaches to analysis of scales for health-related quality of life

DEFF Research Database (Denmark)

Bjorner, Jakob Bue; Bech, Per

2016-01-01

In recent years, much effort has been invested in the development of new instruments for assessment of health-related quality of life (HRQOL). For many new instruments, modern psychometric methods, such as item response theory (IRT) models, have been used, either as supplemental to classical....... The models include Rasch models (Rasch 1980; Fischer and Molenaar 1995), other IRT models (Samejima 1969; van der Linden and Hambleton 1997), and factor analytic models for categorical data (Muthén 1984). “Modern” psychometric methods have actually a rather long history within psychiatric research (both...

SNOT-22: psychometric properties and cross-cultural adaptation into the Portuguese language spoken in Brazil.

Science.gov (United States)

Caminha, Guilherme Pilla; Melo Junior, José Tavares de; Hopkins, Claire; Pizzichini, Emilio; Pizzichini, Marcia Margaret Menezes

2012-12-01

Rhinosinusitis is a highly prevalent disease and a major cause of high medical costs. It has been proven to have an impact on the quality of life through generic health-related quality of life assessments. However, generic instruments may not be able to factor in the effects of interventions and treatments. SNOT-22 is a major disease-specific instrument to assess quality of life for patients with rhinosinusitis. Nevertheless, there is still no validated SNOT-22 version in our country. Cross-cultural adaptation of the SNOT-22 into Brazilian Portuguese and assessment of its psychometric properties. The Brazilian version of the SNOT-22 was developed according to international guidelines and was broken down into nine stages: 1) Preparation 2) Translation 3) Reconciliation 4) Back-translation 5) Comparison 6) Evaluation by the author of the SNOT-22 7) Revision by committee of experts 8) Cognitive debriefing 9) Final version. Second phase: prospective study consisting of a verification of the psychometric properties, by analyzing internal consistency and test-retest reliability. Cultural adaptation showed adequate understanding, acceptability and psychometric properties. We followed the recommended steps for the cultural adaptation of the SNOT-22 into Portuguese language, producing a tool for the assessment of patients with sinonasal disorders of clinical importance and for scientific studies.

Psychometric properties of the School Fears Survey Scale for preadolescents (SFSS-II).

Science.gov (United States)

García-Fernández, José Manuel; Espada Sánchez, José Pedro; Orgilés Amorós, Mireia; Méndez Carrillo, Xavier

2010-08-01

This paper describes the psychometric properties of a new children's self-report measure. The School Fears Survey Scale, Form II (SFSS-II) assesses school fears in children from ages 8 to 11. The factor solution with a Spanish sample of 3,665 children isolated four factors: Fear of academic failure and punishment, fear of physical discomfort, fear of social and school assessment and anticipatory and separation anxiety. The questionnaire was tested by confirmatory factor analysis, which accounted for 55.80% of the total variance. Results indicated that the SFSS-II has a high internal consistency (alpha= .89). The results revealed high test-retest reliability and appropriate relationship with other scales. The age by gender interaction was significant. Two-way analysis of variance found that older children and girls had higher anxiety. The instrument shows adequate psychometric guarantees and can be used for the multidimensional assessment of anxiety in clinical and educational settings.

PROMIS Sleep Disturbance and Sleep-Related Impairment in Adolescents: Examining Psychometrics Using Self-Report and Actigraphy.

Science.gov (United States)

Hanish, Alyson E; Lin-Dyken, Deborah C; Han, Joan C

The National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) has self-reported health measures available for both pediatric and adult populations, but no pediatric measures are available currently in the sleep domains. The purpose of this observational study was to perform preliminary validation studies on age-appropriate, self-reported sleep measures in healthy adolescents. This study examined 25 healthy adolescents' self-reported daytime sleepiness, sleep disturbance, sleep-related impairment, and sleep patterns. Healthy adolescents completed a physical exam at the National Institutes of Health Clinical Center (Bethesda, MD), had no chronic medical conditions, and were not taking any chronic medications. The Cleveland Adolescent Sleepiness Questionnaire (CASQ), PROMIS Sleep Disturbance (v. 1.0; 8a), and PROMIS Sleep-Related Impairment (v. 1.0; 8b) questionnaires were completed, and sleep patterns were assessed using actigraphy. Total scores on the three sleep questionnaires were correlated (all Spearman's r > .70, p psychometrically sound sleep questionnaires. Findings suggest the potential research and clinical utility of adult versions of PROMIS sleep measures in adolescents. Future studies should include larger, more diverse samples and explore additional psychometric properties of PROMIS sleep measures to provide age-appropriate, validated, and reliable measures of sleep in adolescents.

Psychometric testing and Human Resource Management

Directory of Open Access Journals (Sweden)

R. P. van der Merwe

2002-09-01

Full Text Available This is a cumulative report on the findings of various exploratory research that were done with regard to the practice of psychometric testing in the Eastern Cape. Recent and ongoing developments in the South African labour legislation, and especially the implications of the Employment Equity Act, highlight once again the importance of the validation of all instruments to be used for human assessment and selection purposes. Information was gathered to establish which psychometric tests are used, and for what purposes, in industry today. Biographical information on each organisation is supplied, including the number of employees. The role of psychometric testing in the selection procedure is discussed. The different tests used, as well as the test users, are also indicated. The findings of other, related research, as well as comments, recommendations and shortcomings, are discussed. Opsomming Hierdie is ‘n kumulatiewe verslag wat die resultate verstrek van verskeie verkennende ondersoeke wat gedoen is na die aanwending van psigometriese toetsing in die Oos-Kaap. Onlangse en voortdurende ontwikkelinge in die Suid-Afrikaanse arbeidswetgewing, en veral die implikasies van die Wet op Gelyke Indiensneming, beklemtoon weer eens die belangrikheid van die validering van enige instrumente wat gebruik word vir evaluerings- en keuringsdoeleindes van individue. Inligting is ingewin om te bepaal watter psigometriese toetse, sowel as vir watter doel, vandag in die bedryf gebruik word. Biografiese inligting oor die onderskeie organisasies, insluitende hul aantal werknemers, word verstrek. Die rol van psigometriese toetsing in die keuringsproses word bespreek. Die verskillende toetse wat deur die organisasies gebruik word, sowel as die toetsge-bruikers, word ook aangedui. Die bevindinge van ander, relevante navorsing, sowel as opmerkings, aanbevelings en tekortkominge word bespreek.

78th Annual Meeting of the Psychometric Society

CERN Document Server

Bolt, Daniel; Ark, L; Wang, Wen-Chung

2015-01-01

The 78th Annual Meeting of the Psychometric Society (IMPS) builds on the Psychometric Society's mission to share quantitative methods relevant to psychology. The chapters of this volume present cutting-edge work in the field. Topics include studies of item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Additional psychometric topics relate to structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis, among others. The papers in this volume will be especially useful for researchers in the social sciences who use quantitative methods. Prior knowledge of statistical methods is recommended. The 78th annual meeting took place in Arnhem, The Netherlands between July 22nd and 26th, 2013. The previous volume to showcase work from the Psychometric Society’s Meeting is New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 201...

Psychometric properties of the Leisure Time Satisfaction Scale in family caregivers.

Science.gov (United States)

Martínez-Rodríguez, Silvia; Iraurgi, Ioseba; Gómez-Marroquin, Ignacio; Carrasco, María; Ortiz-Marqués, Nuria; Stevens, Alan B

2016-05-01

Despite evidence of the numerous benefits of leisure to health and well-being appropriate tools to assess this construct are lacking. The purpose of this work was to analyse the psychometric properties of the Spanish version of the Leisure Time Satisfaction (LTS). The sample was made up of 1048 primary family caregivers of dependent people. Scale structure was subjected to exploratory and confirmatory factor analysis. Concurrent and convergent validity were assessed by correlation with validated questionnaires for measuring burden (Zarit Burden Inventory - ZBI) and health (SF-36 Health Survey). The results show a high level of internal consistency (Cronbach’s alpha = .938) suitable fit of the dimensional model tested via confirmatory factor analysis (GFI = .925, BBNNFI= .996; IFI= .998, RMSEA= .043), and appropriate convergent validity with similar constructs (r = -.44 with ZBI; and r-values between .226 and .440 with SF-36 dimensions). Psychometric results obtained from the LTS are promising and the results enable us to draw the conclusion that it is a suitable tool for assessing caregivers’ leisure time satisfaction.

Psychometric properties of the Calgary Cambridge guides to assess communication skills of undergraduate medical students.

Science.gov (United States)

Simmenroth-Nayda, Anne; Heinemann, Stephanie; Nolte, Catharina; Fischer, Thomas; Himmel, Wolfgang

2014-12-06

The aim of this study was to analyse the psychometric properties of the short version of the Calgary Cambridge Guides and to decide whether it can be recommended for use in the assessment of communications skills in young undergraduate medical students. Using a translated version of the Guide, 30 members from the Department of General Practice rated 5 videotaped encounters between students and simulated patients twice. Item analysis should detect possible floor and/or ceiling effects. The construct validity was investigated using exploratory factor analysis. Intra-rater reliability was measured in an interval of 3 months, inter-rater reliability was assessed by the intraclass correlation coefficient. The score distribution of the items showed no ceiling or floor effects. Four of the five factors extracted from the factor analysis represented important constructs of doctor-patient communication The ratings for the first and second round of assessing the videos correlated at 0.75 (p<0.0001). Intraclass correlation coefficients for each item ranged were moderate and ranged from 0.05 to 0.57. Reasonable score distributions of most items without ceiling or floor effects as well as a good test-retest reliability and construct validity recommend the C-CG as an instrument for assessing communication skills in undergraduate medical students. Some deficiencies in inter-rater reliability are a clear indication that raters need a thorough instruction before using the C-CG.

Psychometrics of the Emotional Intelligence Scale in Elite, Amateur, and Non-Athletes

Science.gov (United States)

Vaughan, Robert; Laborde, Sylvain

2018-01-01

The purpose of this study was to assess the psychometrics properties of the Emotional Intelligence Scale and assess the measurement invariance across elite (n = 367), amateur (n = 629), and non-athletes (n = 550). In total, 1,546 participants from various sports completed the emotional intelligence scale. Several competing models were compared…

Linguistic Adaptation and Psychometric Properties of Tamil Version of General Oral Health Assessment Index-Tml.

Science.gov (United States)

Appukuttan, D P; Vinayagavel, M; Balasundaram, A; Damodaran, L K; Shivaraman, P; Gunasshegaran, K

2015-01-01

Oral health has an impact on quality of life hence for research purpose validation of a Tamil version of General Oral Health Assessment Index would enable it to be used as a valuable tool among Tamil speaking population. In this study, we aimed to assess the psychometric properties of translated Tamil version of General Oral Health Assessment Index (GOHAI-Tml). Linguistic adaptation involved forward and backward blind translation process. Reliability was analyzed using test-retest, Cronbach alpha, and split half reliability. Inter-item and item-total correlation were evaluated using Spearman rank correlation. Convenience sampling was done, and 265 consecutive patients aged 20-70 years attending the outpatient department were recruited. Subjects were requested to fill a self-reporting questionnaire along with Tamil GOHAI version. Clinical examination was done on the same visit. Concurrent validity was measured by assessing the relationship between GOHAI scores and self-perceived oral health and general health status, satisfaction with oral health, need for dental treatment and esthetic satisfaction. Discriminant validity was evaluated by comparing the GOHAI scores with the objectively assessed clinical parameters. Exploratory factor analysis was done to examine the factor structure. Mean GOHAI-Tml was 52.7 (6.8, range 22-60, median 54). The mean number of negative impacts was 2 (2.4, range 0-11, median 1). The Spearman rank correlation for test-retest ranged from 0.8 to 0.9 (P Tamil speaking population.

School Bonding in Early Adolescence: Psychometrics of the Brief Survey of School Bonding

Science.gov (United States)

Whiteside-Mansell, Leanne; Weber, Judith L.; Moore, Page C.; Johnson, Danya; Williams, Ed R.; Ward, Wendy L.; Robbins, James M.; Phillips, B. Allyson

2015-01-01

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. In this study, the psychometric properties of three assessment tools found in the literature were examined individually and then combined to create a shorter survey. With minor modifications, the tools were found to be…

Assessment of Outcome in Hypospadias Surgery - A Review

Directory of Open Access Journals (Sweden)

Alexander eSpringer

2014-01-01

Full Text Available Hypospadias is a challenging field of urogenital reconstructive surgery with different techniques being currently used. Modern surgery claims that it is possible to create a functionally and cosmetically normal penis. Continuous reevaluation and assessment of outcome may have a major impact on future clinical practice. Assessment of outcome includes: complication rate, cosmetic appearance of the penis, functional outcome (micturition, sexuality and psychological factors such as quality of life and psychosexual life. This article briefly reviews current strategies of outcome assessment and outlines that in the future long-term assessment should be designed in web-based prospective studies multicenter studies. Somehow in the future we will be able to give an accurate estimation of the long-term consequences of being born with hypospadias.

The Development and Psychometric Properties of the Selective Mutism Questionnaire

Science.gov (United States)

Bergman, R. Lindsey; Keller, Melody L.; Piacentini, John; Bergman, Andrea J.

2008-01-01

Research on selective mutism (SM) has been limited by the absence of standardized, psychometrically sound assessment measures. The purpose of our investigation was to present two studies that examined the factor structure and initial reliability and validity of the Selective Mutism Questionnaire (SMQ), a 17-item parent report measure of failure to…

A Psychometric Analysis of the Ottawa Self-Injury Inventory-F

Science.gov (United States)

Brown, Joshua Travis; Volk, Fred; Gearhart, Gabrielle L.

2018-01-01

Objective: This study seeks to evaluate the psychometric properties of the Ottawa Self-Injury Inventory-Functions (OSI-F) for assessing nonsuicidal self-injury (NSSI), a condition for further study in the DSM-5. Participants: Participants included 345 students who indicated a history of self-injury in a university counseling center over six…

Cross-cultural adaptation and psychometric testing of the Quality of Dying and Death Questionnaire for the Spanish population.

Science.gov (United States)

Gutiérrez Sánchez, Daniel; Cuesta-Vargas, Antonio I

2018-04-01

Many measurements have been developed to assess the quality of death (QoD). Among these, the Quality of Dying and Death Questionnaire (QODD) is the most widely studied and best validated. Informal carers and health professionals who care for the patient during their last days of life can complete this assessment tool. The aim of the study is to carry out a cross-cultural adaptation and a psychometric analysis of the QODD for the Spanish population. The translation was performed using a double forward and backward method. An expert panel evaluated the content validity. The questionnaire was tested in a sample of 72 Spanish-speaking adult carers of deceased cancer patients. A psychometric analysis was performed to evaluate internal consistency, divergent criterion-related validity with the Mini-Suffering State Examination (MSSE) and concurrent criterion-related validity with the Palliative Outcome Scale (POS). Some items were deleted and modified to create the Spanish version of the QODD (QODD-ESP-26). The instrument was readable and acceptable. The content validity index was 0.96, suggesting that all items are relevant for the measure of the QoD. This questionnaire showed high internal consistency (Cronbach's α coefficient = 0.88). Divergent validity with MSSE (r = -0.64) and convergent validity with POS (r = -0.61) were also demonstrated. The QODD-ESP-26 is a valid and reliable instrument for the assessment of the QoD of deceased cancer patients that can be used in a clinical and research setting. Copyright © 2018 Elsevier Ltd. All rights reserved.

Psychometric properties of the Doloplus-2 observational pain assessment scale and comparison to self-assessment in hospitalized elderly.

Science.gov (United States)

Pautex, Sophie; Herrmann, François R; Michon, Agnès; Giannakopoulos, Panteleimon; Gold, Gabriel

2007-01-01

Self-report is the "gold standard" for pain assessment, however, observational pain scales, such as Doloplus-2 must be used for patients who cannot communicate. In this follow-up study, we report the psychometric properties of the observational Doloplus-2 scale using the visual analog scale (VAS) pain score as a gold standard and evaluate its performance. Prospective clinical study of 180 hospitalized older patients who demonstrated good comprehension and reliable use of the VAS: 131 participants with dementia and 49 without. All participants assessed their chronic pain using the VAS. Doloplus-2 was independently completed by the nursing team. Mean age of patients (133 women, 47 men) was 83.7+/-6.5. Median mini-mental state examination of patients with diagnosis of dementia was 18.0+/-7.7. Nearly half of the patients (49%) reported that they experienced pain in response to a direct question. The administration of Doloplus-2 was possible in all 180 patients. Doloplus-2 correlated moderately with self-assessment (Spearman coefficient: 0.46). In a multiple regression model, Doloplus-2 predicted 41% of the variability in pain intensity measured by VAS. The somatic dimension alone explained 36% of the variance, the psychosocial bloc 5% with no better contribution of the psychomotor bloc. To shorten Doloplus-2, we constructed a version with only the 5 items that were significantly associated with the VAS score in the multiple regression models. The observational Doloplus-2 scale correlates moderately with self-assessment pain score and has adequate internal consistency. Our data also suggest that Doloplus-2 could be substantially shortened as the brief version performed similarly to the complete Doloplus-2.

Clinician-Reported Outcome Assessments of Treatment Benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force.

Science.gov (United States)

Powers, John H; Patrick, Donald L; Walton, Marc K; Marquis, Patrick; Cano, Stefan; Hobart, Jeremy; Isaac, Maria; Vamvakas, Spiros; Slagle, Ashley; Molsen, Elizabeth; Burke, Laurie B

2017-01-01

A clinician-reported outcome (ClinRO) assessment is a type of clinical outcome assessment (COA). ClinRO assessments, like all COAs (patient-reported, observer-reported, or performance outcome assessments), are used to 1) measure patients' health status and 2) define end points that can be interpreted as treatment benefits of medical interventions on how patients feel, function, or survive in clinical trials. Like other COAs, ClinRO assessments can be influenced by human choices, judgment, or motivation. A ClinRO assessment is conducted and reported by a trained health care professional and requires specialized professional training to evaluate the patient's health status. This is the second of two reports by the ISPOR Clinical Outcomes Assessment-Emerging Good Practices for Outcomes Research Task Force. The first report provided an overview of COAs including definitions important for an understanding of COA measurement practices. This report focuses specifically on issues related to ClinRO assessments. In this report, we define three types of ClinRO assessments (readings, ratings, and clinician global assessments) and describe emerging good measurement practices in their development and evaluation. The good measurement practices include 1) defining the context of use; 2) identifying the concept of interest measured; 3) defining the intended treatment benefit on how patients feel, function, or survive reflected by the ClinRO assessment and evaluating the relationship between that intended treatment benefit and the concept of interest; 4) documenting content validity; 5) evaluating other measurement properties once content validity is established (including intra- and inter-rater reliability); 6) defining study objectives and end point(s) objectives, and defining study end points and placing study end points within the hierarchy of end points; 7) establishing interpretability in trial results; and 8) evaluating operational considerations for the implementation of

Development and validation of the impact of dry eye on everyday life (IDEEL) questionnaire, a patient-reported outcomes (PRO) measure for the assessment of the burden of dry eye on patients.

Science.gov (United States)

Abetz, Linda; Rajagopalan, Krithika; Mertzanis, Polyxane; Begley, Carolyn; Barnes, Rod; Chalmers, Robin

2011-12-08

To develop and validate a comprehensive patient-reported outcomes instrument focusing on the impact of dry eye on everyday life (IDEEL). Development and validation of the IDEEL occurred in four phases: 1) focus groups with 45 dry eye patients to develop a draft instrument, 2) item generation, 3) pilot study to assess content validity in 16 patients and 4) psychometric validation in 210 subjects: 130 with non-Sjögren's keratoconjunctivitis sicca, 32 with Sjögren's syndrome and 48 controls, and subsequent item reduction. Focus groups identified symptoms and the associated bother, the impact of dry eye on daily life and the patients' satisfaction with their treatment as the central concepts in patients' experience of dry eye. Qualitative analysis indicated that saturation was achieved for these concepts and yielded an initial 112-item draft instrument. Patients understood the questionnaire and found the items to be relevant indicating content validity. Patient input, item descriptive statistics and factor analysis identified 55 items that could be deleted. The final 57-item IDEEL assesses dry eye impact constituting 3 modules: dry eye symptom-bother, dry eye impact on daily life comprising impact on daily activities, emotional impact, impact on work, and dry eye treatment satisfaction comprising satisfaction with treatment effectiveness and treatment-related bother/inconvenience. The psychometric analysis results indicated that the IDEEL met the criteria for item discriminant validity, internal consistency reliability, test-retest reliability and floor/ceiling effects. As expected, the correlations between IDEEL and the Dry Eye Questionnaire (a habitual symptom questionnaire) were higher than between IDEEL and Short-Form-36 and EuroQoL-5D, indicating concurrent validity. The IDEEL is a reliable, valid and comprehensive questionnaire relevant to issues that are specific to dry eye patients, and meets current FDA patient-reported outcomes guidelines. The use of this

Psychometric properties of the Drive for Muscularity Scale in Malay men.

Science.gov (United States)

Swami, Viren; Barron, David; Lau, Poh Li; Jaafar, Jas Laile

2016-06-01

The Drive for Muscularity Scale (DMS) is a widely used measure in studies of men's body image, but few studies have examined its psychometric properties outside English-speaking samples. Here, we assessed the factor structure of a Malay translation of the DMS. A community sample of 159 Malay men from Kuala Lumpur, Malaysia, completed the DMS, along with measures of self-esteem, body appreciation, and muscle discrepancy. Exploratory factor analysis led to the extraction of two factors, differentiating attitudes from behaviours, which mirrors the parent scale. Both factors also loaded on to a higher-order drive for muscularity factor. The subscales of the Malay DMS had adequate internal consistencies and good convergent validity, insofar as significant relationships were reported with self-esteem, body appreciation, muscle discrepancy, and body mass index. These results indicate that the Malay DMS has acceptable psychometric properties and can be used to assess body image concerns in Malay men. Copyright © 2016 Elsevier Ltd. All rights reserved.

Psychometric properties of the Depression Anxiety and Stress Scale-21 in older primary care patients.

Science.gov (United States)

Gloster, Andrew T; Rhoades, Howard M; Novy, Diane; Klotsche, Jens; Senior, Ashley; Kunik, Mark; Wilson, Nancy; Stanley, Melinda A

2008-10-01

The Depression Anxiety Stress Scale (DASS) was designed to efficiently measure the core symptoms of anxiety and depression and has demonstrated positive psychometric properties in adult samples of anxiety and depression patients and student samples. Despite these findings, the psychometric properties of the DASS remain untested in older adults, for whom the identification of efficient measures of these constructs is especially important. To determine the psychometric properties of the DASS 21-item version in older adults, we analyzed data from 222 medical patients seeking treatment to manage worry. Consistent with younger samples, a three-factor structure best fit the data. Results also indicated good internal consistency, excellent convergent validity, and good discriminative validity, especially for the Depression scale. Receiver operating curve analyses indicated that the DASS-21 predicted the diagnostic presence of generalized anxiety disorder and depression as well as other commonly used measures. These data suggest that the DASS may be used with older adults in lieu of multiple scales designed to measure similar constructs, thereby reducing participant burden and facilitating assessment in settings with limited assessment resources.

Asthma Outcomes: Quality of Life

Science.gov (United States)

Wilson, Sandra R.; Rand, Cynthia S.; Cabana, Michael D.; Foggs, Michael B.; Halterman, Jill S.; Olson, Lynn; Vollmer, William M.; Wright, Rosalind J.; Taggart, Virginia

2014-01-01

Background “Asthma-related quality of life” refers to the perceived impact that asthma has on the patient’s quality of life. Objective National Institutes of Health (NIH) institutes and other federal agencies convened an expert group to recommend standardized measures of the impact of asthma on quality of life for use in future asthma clinical research. Methods We reviewed published documentation regarding the development and psychometric evaluation; clinical research use since 2000; and extent to which the content of each existing quality of life instrument provides a unique, reliable, and valid assessment of the intended construct. We classified instruments as core (required in future studies), supplemental (used according to the study’s aims and standardized), or emerging (requiring validation and standardization). This work was discussed at an NIH-organized workshop convened in March 2010 and finalized in September 2011. Results Eleven instruments for adults and 6 for children were identified for review. None qualified as core instruments because they predominantly measured indicators of asthma control (symptoms and/or functional status); failed to provide a distinct, reliable score measuring all key dimensions of the intended construct; and/or lacked adequate psychometric data. Conclusions In the absence of existing instruments that meet the stated criteria, currently available instruments are classified as either supplemental or emerging. Research is strongly recommended to develop and evaluate instruments that provide a distinct, reliable measure of the patient’s perception of the impact of asthma on all of the key dimensions of quality of life, an important outcome that is not captured in other outcome measures. PMID:22386511

Analysis of the Psychometric Properties of a Parental Alienation Scale

Directory of Open Access Journals (Sweden)

Paula Inez Cunha Gomide

Full Text Available Abstract The development of forensic evaluation scales is fundamental. This study's purpose was to explore the psychometric properties of a parental alienation scale. Forensic technicians completed 193 scales concerning parents involved in a lawsuit: 48 families with at least one parent indicated as the alienator (group A and 48 families with no parental alienation claim (group B. The scale consisted of five categories and 69 items: denying access to the child; derogatory comparisons; emotional manipulation; behavior of parent and child during assessment. The results show Cronbach's alpha = .965 and split-half = .745; KMO = .884 and Bartlett's sphericity test ( p < .001. Concurrent criterion validity applied to data showed that the scale is able to distinguish between the alienator and target parent. The results showed significant and consistent standards in the instrument's psychometric characteristics.

Psychometric properties of the revised Malay version Medical Outcome Study Social Support Survey using confirmatory factor analysis among postpartum mothers.

Science.gov (United States)

Norhayati, Mohd Noor; Aniza, Abd Aziz; Nik Hazlina, Nik Hussain; Azman, Mohd Yacob

2015-12-01

Social support is an essential component for the physical and emotional well-being of postpartum mothers. The objective of this study is to determine the psychometric properties of the revised Malay version Medical Outcome Study (MOS) Social Support Survey using a confirmatory validity approach. A cross-sectional study was conducted involving 144 postpartum mothers attending Obstetric and Gynecology Clinic, Universiti Sains Malaysia Hospital. Construct validity and internal consistency assessment was performed after the translation, content validity and face validity process. The data were analyzed using SPSS 20.0 (SPSS Inc., Chicago, IL, USA) and AMOS 20.0 (SPSS Inc., Chicago, IL, USA). The original questionnaire consists of four domains (emotional/informational support, tangible support, affectionate support and positive social interaction) and 19 items. Affectionate support domain with three items only was treated as a separate construct and was not included in the factor analysis. The final confirmatory model with three constructs and 13 items demonstrated acceptable factor loadings, domain to domain correlation and best fit; (χ2[df]=1.665 [61]; P-value=0.001; Tucker-Lewis Index=0.944; comparative fit index=0.956; root mean square error of approximation=0.068). Composite reliability, average variance extracted and Cronbach's α of the domains ranged from 0.649 to 0.903; 0.390 to 0.699; 0.616 to 0.902, respectively. The study suggested that the four-factor model with 16 items (including one separate factor of affectionate) of the revised Malay version MOS Social Support Survey was acceptable to be used to measure social support after childbirth because it is valid, reliable and simple. © 2015 Wiley Publishing Asia Pty Ltd.

Development and psychometric evaluation of the breast size satisfaction scale.

Science.gov (United States)

Pahlevan Sharif, Saeed

2017-10-09

Purpose The purpose of this paper is to develop and evaluate psychometrically an instrument named the Breast Size Satisfaction Scale (BSSS) to assess breast size satisfaction. Design/methodology/approach The present scale was developed using a set of 16 computer-generated 3D images of breasts to overcome some of the limitations of existing instruments. The images were presented to participants and they were asked to select the figure that most accurately depicted their actual breast size and the figure that most closely represented their ideal breast size. Breast size satisfaction was computed by subtracting the absolute value of the difference between ideal and actual perceived size from 16, such that higher values indicate greater breast size satisfaction. Findings Study 1 ( n=65 female undergraduate students) showed good test-retest reliability and study 2 ( n=1,000 Iranian women, aged 18 years and above) provided support for convergent validity using a nomological network approach. Originality/value The BSSS demonstrated good psychometric properties and thus can be used in future studies to assess breast size satisfaction among women.

Psychometric characterization of the obstetric communication assessment tool for medical education: a pilot study.

Science.gov (United States)

Rodriguez, A Noel; DeWitt, Peter; Fisher, Jennifer; Broadfoot, Kirsten; Hurt, K Joseph

2016-06-11

To characterize the psychometric properties of a novel Obstetric Communication Assessment Tool (OCAT) in a pilot study of standardized difficult OB communication scenarios appropriate for undergraduate medical evaluation. We developed and piloted four challenging OB Standardized Patient (SP) scenarios in a sample of twenty-one third year OB/GYN clerkship students: Religious Beliefs (RB), Angry Father (AF), Maternal Smoking (MS), and Intimate Partner Violence (IPV). Five trained Standardized Patient Reviewers (SPRs) independently scored twenty-four randomized video-recorded encounters using the OCAT. Cronbach's alpha and Intraclass Correlation Coefficient-2 (ICC-2) were used to estimate internal consistency (IC) and inter-rater reliability (IRR), respectively. Systematic variation in reviewer scoring was assessed using the Stuart-Maxwell test. IC was acceptable to excellent with Cronbach's alpha values (and 95% Confidence Intervals [CI]): RB 0.91 (0.86, 0.95), AF 0.76 (0.62, 0.87), MS 0.91 (0.86, 0.95), and IPV 0.94 (0.91, 0.97). IRR was unacceptable to poor with ICC-2 values: RB 0.46 (0.40, 0.53), AF 0.48 (0.41, 0.54), MS 0.52 (0.45, 0.58), and IPV 0.67 (0.61, 0.72). Stuart-Maxwell analysis indicated systematic differences in reviewer stringency. Our initial characterization of the OCAT demonstrates important issues in communications assessment. We identify scoring inconsistencies due to differences in SPR rigor that require enhanced training to improve assessment reliability. We outline a rational process for initial communication tool validation that may be useful in undergraduate curriculum development, and acknowledge that rigorous validation of OCAT training and implementation is needed to create a valuable OB communication assessment tool.

Outcome Measures for Clinical Trials in Down Syndrome.

Science.gov (United States)

Esbensen, Anna J; Hooper, Stephen R; Fidler, Deborah; Hartley, Sigan L; Edgin, Jamie; d'Ardhuy, Xavier Liogier; Capone, George; Conners, Frances A; Mervis, Carolyn B; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J; Urv, Tiina

2017-05-01

Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the National Institutes of Health (NIH) assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This article focuses on measures in the areas of cognition and behavior.

Psychometric properties of HeartQoL, a core heart disease-specific health-related quality of life questionnaire, in Danish implantable cardioverter defibrillator recipients

DEFF Research Database (Denmark)

Zangger, Graziella; Zwisler, Ann-Dorthe; Kikkenborg Berg, Selina

2017-01-01

Background Patient-reported health-related quality of life is increasingly used as an outcome measure in clinical trials and as a performance measure to evaluate quality of care. The objective of this study was to assess the psychometric properties of the Danish HeartQoL questionnaire, a core heart...... disease-specific health-related quality of life questionnaire, in implantable cardioverter defibrillator recipients. Design This study involved cross-sectional and test-retest study designs. Method Implantable cardioverter defibrillator recipients in the cross-sectional study completed the Heart......QoL, the Short-Form 36 Health Survey, and the Hospital Anxiety and Depression Scale. The HeartQoL structure, construct-related validity (convergent and discriminative) and reliability (internal consistency) were assessed. HeartQoL reproducibility (test-retest) was assessed in an independent sample of implantable...

Assessment methods in surgical training in the United Kingdom

Directory of Open Access Journals (Sweden)

Evgenios Evgeniou

2013-02-01

Full Text Available A career in surgery in the United Kingdom demands a commitment to a long journey of assessment. The assessment methods used must ensure that the appropriate candidates are selected into a programme of study or a job and must guarantee public safety by regulating the progression of surgical trainees and the certification of trained surgeons. This review attempts to analyse the psychometric properties of various assessment methods used in the selection of candidates to medical school, job selection, progression in training, and certification. Validity is an indicator of how well an assessment measures what it is designed to measure. Reliability informs us whether a test is consistent in its outcome by measuring the reproducibility and discriminating ability of the test. In the long journey of assessment in surgical training, the same assessment formats are frequently being used for selection into a programme of study, job selection, progression, and certification. Although similar assessment methods are being used for different purposes in surgical training, the psychometric properties of these assessment methods have not been examined separately for each purpose. Because of the significance of these assessments for trainees and patients, their reliability and validity should be examined thoroughly in every context where the assessment method is being used.

The MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey): cross-cultural evaluation of the French version and additional psychometric assessment.

Science.gov (United States)

Jalenques, Isabelle; Guiguet-Auclair, Candy; Derost, Philippe; Joubert, Pauline; Foures, Louis; Hartmann, Andreas; Muellner, Julia; Rondepierre, Fabien

2018-03-01

The Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey (MOVES) is a self-report scale suggested as a severity scale for tics and related sensory phenomena observed in Gilles de la Tourette syndrome (GTS) and recommended as a screening instrument by the Committee on Rating Scale Development of the International Parkinson's Disease and Movement Disorder Society. To cross-culturally adapt a French version of the MOVES and to evaluate its psychometric properties. After the cross-cultural adaptation of the MOVES, we assessed its psychometric properties in 53 patients aged 12-16 years and in 54 patients aged 16 years and above: reliability and construct validity (relationships between items and scales), internal consistency and concurrent validity with the Yale Global Tic Severity Scale (YGTSS) and the Children's Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) or the auto-Yale-Brown scale. The results showed very good acceptability with response rates greater than 92%, good internal consistency (Cronbach's alpha ranging from 0.62 and 0.89) and good test-retest reliability (ICCs ranging from 0.59 to 0.91). Concurrent validity with the YGTSS, CY-BOCS and auto-Yale-Brown scales showed strong expected correlations. The cut-off points tested for diagnostic performance gave satisfactory values of sensitivity, specificity, and positive and negative predictive values. Our study provides evidence of the good psychometric properties of the French version of the MOVES. The cross-cultural adaptation of this specific instrument will allow investigators to include French-speaking persons with GTS aged 12 years and over in national and international collaboration research projects.

Outcomes Assessment in Dental Hygiene Programs.

Science.gov (United States)

Grimes, Ellen B.

1999-01-01

A survey of 22 dental-hygiene-program directors found that programs routinely and effectively assess student outcomes and use the information for program improvements and to demonstrate accountability. Both policy and faculty/administrative support were deemed important to implementation. Time constraints were a major barrier. Outcomes-assessment…

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties.

Science.gov (United States)

Cadorin, Lucia; Bressan, Valentina; Palese, Alvisa

2017-11-25

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments. A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses. On the basis of the findings

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties

Directory of Open Access Journals (Sweden)

Lucia Cadorin

2017-11-01

Full Text Available Abstract Background Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1 identify the instruments for assessment of SDL abilities among nursing students and nurses; 2 critically evaluate the methodological studies quality; and 3 compare the psychometric properties of the available instruments. Methods A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Results Eleven studies were included and four tools based on Knowles’s theory have emerged: 1 the Self-Directed Learning Readiness Scale; 2 the Self-Directed Learning Readiness Scale for Nursing Education; 3 the Self-Rating Scale of Self-Directed Learning, and 4 the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument. The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative

The paced auditory serial addition test for working memory assessment: Psychometric properties

Science.gov (United States)

Nikravesh, Maryam; Jafari, Zahra; Mehrpour, Masoud; Kazemi, Roozbeh; Amiri Shavaki, Younes; Hossienifar, Shamim; Azizi, Mohamad Parsa

2017-01-01

Background: The paced auditory serial addition test (PASAT) was primarily developed to assess the effects of traumatic brain injury on cognitive functioning. Working memory (WM) is one of the most important aspects of cognitive function, and WM impairment is one of the clinically remarkable signs of aphasia. To develop the Persian version of PASAT, an initial version was used in individuals with aphasia (IWA). Methods: In this study, 25 individuals with aphasia (29-60 years) and 85 controls (18-60 years) were included. PASAT was presented in the form of recorded 61 single-digit numbers (1 to 9). The participants repeatedly added the 2 recent digits. The psychometric properties of PASAT including convergent validity (using the digit memory span tasks), divergent validity (using results in the control group and IWA group), and face validity were investigated. Test-retest reliability was considered as well. Results: The relationship between the PASAT and digit memory span tests was moderate to strong in the control group (forward digit memory span test: r= 0.52, p< 0.0001; backward digit memory span test: r = 0.48, p< 0.0001). A strong relationship was found in IWA (forward digit memory span test: r= 0.72, p< 0.0001; backward digit memory span test: r= 0.53, p= 0.006). Also, strong testretest reliability (intraclass correlation= 0.95, p< 0.0001) was observed. Conclusion: According to our results, the PASAT is a valid and reliable test to assess working memory, particularly in IWA. It could be used as a feasible tool for clinical and research applications. PMID:29445690

Development and psychometric testing of a new geriatric spiritual well-being scale.

Science.gov (United States)

Dunn, Karen S

2008-09-01

Aims and objectives.  Assess the psychometric properties of a new geriatric spiritual well-being scale (GSWS), specifically designed for older adults. Background.  Religiosity and spiritual wellness must be measured as two distinct concepts to prevent confounding them as synonymous among atheist and agnostic population. Design.  A test-retest survey design was used to estimate the psychometric properties. Methods.  A convenience sample of 138 community-dwelling older adults was drawn from the inner city of Detroit. Data were collected using telephone survey interviews. Data analyses included descriptive statistics, structural equation modelling, reliability analyses, and point-biserial correlations. Results.  The factorial validity of the proposed model was not supported by the data. Fit indices were χ(2)  = 185.98, d.f. = 98, P atheists have spiritual needs that do not include religious beliefs or practices. Thus, assessing patients' religious beliefs and practices prior to assessing spiritual well-being is essential to prevent bias. © 2008 The Author. Journal compilation © 2008 Blackwell Publishing Ltd.

Assessment of identity development and identity diffusion in adolescence - Theoretical basis and psychometric properties of the self-report questionnaire AIDA

Directory of Open Access Journals (Sweden)

Goth Kirstin

2012-07-01

Full Text Available Abstract Background In the continuing revision of Diagnostic and Statistical Manual (DSM-V “identity” is integrated as a central diagnostic criterion for personality disorders (self-related personality functioning. According to Kernberg, identity diffusion is one of the core elements of borderline personality organization. As there is no elaborated self-rating inventory to assess identity development in healthy and disturbed adolescents, we developed the AIDA (Assessment of Identity Development in Adolescence questionnaire to assess this complex dimension, varying from “Identity Integration” to “Identity Diffusion”, in a broad and substructured way and evaluated its psychometric properties in a mixed school and clinical sample. Methods Test construction was deductive, referring to psychodynamic as well as social-cognitive theories, and led to a special item pool, with consideration for clarity and ease of comprehension. Participants were 305 students aged 12–18 attending a public school and 52 adolescent psychiatric inpatients and outpatients with diagnoses of personality disorders (N = 20 or other mental disorders (N = 32. Convergent validity was evaluated by covariations with personality development (JTCI 12–18 R scales, criterion validity by differences in identity development (AIDA scales between patients and controls. Results AIDA showed excellent total score (Diffusion: α = .94, scale (Discontinuity: α = .86; Incoherence: α = .92 and subscale (α = .73-.86 reliabilities. High levels of Discontinuity and Incoherence were associated with low levels in Self Directedness, an indicator of maladaptive personality functioning. Both AIDA scales were significantly different between PD-patients and controls with remarkable effect sizes (d of 2.17 and 1.94 standard deviations. Conclusion AIDA is a reliable and valid instrument to assess normal and disturbed identity in adolescents. Studies for further

Perceived Breastfeeding Support Assessment Tool (PBSAT): development and testing of psychometric properties with Pakistani urban working mothers.

Science.gov (United States)

Hirani, Shela Akbar Ali; Karmaliani, Rozina; Christie, Thomas; Parpio, Yasmin; Rafique, Ghazala

2013-06-01

breast feeding is an essential source of nutrition among young babies; however, in Pakistan a gradual decline in prevalence of breast feeding, especially among urban working mothers, has been reported. Previous studies among Pakistani urban working mothers have revealed that ensuring exclusivity and continuation of breast feeding is challenging if social and/or workplace environmental support is minimal or absent. This problem indicated a crucial need to assess availability of breast-feeding support for Pakistani urban working mothers by using a comprehensive, reliable, and validated tool in their national language (Urdu). to develop and test the psychometric properties of the 'Perceived Breastfeeding Support Assessment Tool' (PBSAT) that can gauge Pakistani urban working mothers' perceptions about breast-feeding support. this methodological research was undertaken in five phases. During phase I, a preliminary draft of the PBSAT was developed by using the Socio-ecological model, reviewing literature, and referring to two United States based tools. In Phase II, the instrument was evaluated by seven different experts, and, in Phase III, the instrument was revised, translated, and back translated. In Phase IV, the tool was pilot tested among 20 participants and then modified on the basis of statistical analysis. In Phase V, the refined instrument was tested on 200 breast-feeding working mothers recruited through purposive sampling from the government and private health-care settings in Karachi, Pakistan. Approvals were received from the Ethical Review Committees of the identified settings. the 29-item based PBSAT revealed an acceptable inter-rater reliability of 0.95, and an internal consistency reliability coefficient (Cronbach's alpha) of 0.85. A construct validity assessment through Exploratory Factor Analysis revealed that the PBSAT has two dimensions, 'workplace environmental support' (12 items; α=0.86) and 'social environmental support' (17 items; α=0.77). the

Psychometric properties of the Posttraumatic Cognition Inventory within a Northern Ireland adolescent sample.

Science.gov (United States)

Hyland, Philip; Murphy, Jamie; Shevlin, Mark; Murphy, Siobhan; Egan, Arlene; Boduszek, Daniel

2015-11-01

This study sought to investigate the psychometric properties of the Posttraumatic Cognitions Inventory (PTCI; Foa et al., 1999, Psychol. Assess., 11, 303) among a cohort of older adolescents and to determine the relationship between post-traumatic cognitions and a variety of psychological outcomes including depression, anxiety, stress, and loneliness. The PTCI was investigated among a large sample (N = 785) of Northern Irish adolescents. Confirmatory factor analysis and composite reliability analysis were conducted to assess the psychometric properties of the scale. The familiar three-factor solution of negative cognitions of self, negative cognitions of the world and others, and self-blame was supported; however, it was necessary to remove eight items from the original 33-item scale. The three-factor structure was subsequently demonstrated to be factorially invariant across gender and to possess satisfactory internal reliability. The three PTCI factors were found to correlate with depression, anxiety, stress, and three dimensions of loneliness. These results provide the first piece of evidence that older adolescents cognitively respond to trauma in a similar manner to adults, that the PTCI is factorially invariant between genders, and that trauma cognitions are correlated with feelings of loneliness. The contextual dependent nature of the structure of the PTCI factors is discussed in relation to future research efforts. The PTCI is a valid and reliable measure of trauma-related cognitions among adolescents and works equally well for male adolescents and female adolescents. Trauma cognitions are associated with a range of mental health problems beyond post-traumatic stress disorder including depression, anxiety, stress, and various aspects of loneliness. Reductions in trauma cognitions in survivors of trauma will have wide-scale clinical benefits to patient well-being. The exact structure and make-up of items in the PTCI may well be dependent on culture, context

Psychometric Properties of the Malay Language Version of Knee Injury and Osteoarthritis Outcome Score (KOOS Questionnaire among Knee Osteoarthritis Patients: A Confirmatory Factor Analysis

Directory of Open Access Journals (Sweden)

Zulkifli MM

2017-07-01

Full Text Available INTRODUCTION: This study aimed to cross-culturally adapt a Malay version of Knee Injury and Osteoarthritis Outcome Score (KOOS and to evaluate its psychometric properties in patients with knee osteoarthritis (OA. MATERIALS AND METHODS: The English version KOOS was translated into a Malay version using forward and backward translation process, followed by face validity and content validity. Two hundred and twenty-six knee OA patients attending the Outpatient and Orthopaedic Clinics, Universiti Sains Malaysia Hospital, completed the Malay version KOOS. Construct validity using confirmatory factor analysis and internal reliability assessment were performed. RESULTS: The results showed that the original five-factor model with 42 items failed to achieve acceptable values of the goodness of fit indices, indicating poor model fit. A new five-factor model of 26 items demonstrated acceptable level of goodness of fit (comparative fit index= 0.929, incremental fit index= 0.930, Tucker Lewis fit index= 0.920, root mean square error of approximation= 0.073 and Chisquared/ degree of freedom= 2.183 indices to signify a model fit. The Cronbach’s alpha value for the new model ranged from 0.776 to 0.946. The composite reliability values of each construct ranged between 0.819 and 0.921, indicating satisfactory to high level of convergent validity. CONCLUSION: The five-factor model with 26 items in the Malay version of KOOS questionnaire demonstrated a good degree of goodness of fit and was found to be valid, reliable and simple as an assessment tool for symptoms, pain, activity of daily living, sports and recreational activity and quality of life for Malaysian adults suffering from knee osteoarthritis.

Psychometric properties of the Danish MCMI-I translation

DEFF Research Database (Denmark)

Mortensen, E L; Simonsen, E

1990-01-01

A translation of the MCMI-I has been in use in Denmark for some years. An untested assumption in the interpretation of the pattern of test results is that the psychometric characteristics of the Danish and American versions are similar. The purpose of this study was to evaluate the psychometric...... properties of the questionnaire by using traditional psychometric analysis techniques on the results of a sample consisting of 423 patients and 179 normal controls. Coefficient alpha was calculated for the 20 clinical subscales of the test and the Danish results were strikingly similar to the original...... coefficients reported by Millon. Furthermore, factor analysis of the subscales showed a factor structure very similar to American findings, and it is concluded that the psychometric properties of the Danish MCMI are not significantly different from the original....

[Psychometric assessment of a brief Modern Racism Scale].

Science.gov (United States)

Campo-Arias, Adalberto; Herazo, Edwin; Oviedo, Heidi C

2016-06-01

Objective To find the internal consistency of the Modern Racism Scale (MRS) among medical students in Bucaramanga, Colombia. Methods A total of 352 medical students, mean age=20.0 years (SD=1.9) reported their attitudes towards Afro-Colombians; 59.4 % were women. Students completed the 10-item version of MRS. Cronbach alpha and McDonald omega were calculated. Exploratory factor analyses were done to propose a brief version of the MRS. Results The 10-item version showed a Cronbach alpha of 0.48 and a McDonald omega of 0.15. The short version, the Brief Modern Racism Scale (BMRS) (items 1, 4, 5, 7 and 8) presented a Cronbach alpha of 0.64 and McDonald omega of 0.65. The BMRS showed one salient factor responsible of 41.6 % of the total variance. Conclusions A Spanish-language short version of the MRS shows better psychometric performance than the original version. Further study is needed to corroborate these findings or make adjustments for Colombian cultural regions.

Toward a consensus definition of pathological video-gaming: a systematic review of psychometric assessment tools.

Science.gov (United States)

King, Daniel L; Haagsma, Maria C; Delfabbro, Paul H; Gradisar, Michael; Griffiths, Mark D

2013-04-01

Pathological video-gaming, or its proposed DSM-V classification of "Internet Use Disorder", is of increasing interest to scholars and practitioners in allied health disciplines. This systematic review was designed to evaluate the standards in pathological video-gaming instrumentation, according to Cicchetti (1994) and Groth-Marnat's (2009) criteria and guidelines for sound psychometric assessment. A total of 63 quantitative studies, including eighteen instruments and representing 58,415 participants, were evaluated. Results indicated that reviewed instrumentation may be broadly characterized as inconsistent. Strengths of available measures include: (i) short length and ease of scoring, (ii) excellent internal consistency and convergent validity, and (iii) potentially adequate data for development of standardized norms for adolescent populations. However, key limitations included: (a) inconsistent coverage of core addiction indicators, (b) varying cut-off scores to indicate clinical status, (c) a lack of a temporal dimension, (d) untested or inconsistent dimensionality, and (e) inadequate data on predictive validity and inter-rater reliability. An emerging consensus suggests that pathological video-gaming is commonly defined by (1) withdrawal, (2) loss of control, and (3) conflict. It is concluded that a unified approach to assessment of pathological video-gaming is needed. A synthesis of extant research efforts by meta-analysis may be difficult in the context of several divergent approaches to assessment. Copyright © 2013 Elsevier Ltd. All rights reserved.

Long-term neurodevelopmental outcome after selective feticide in monochorionic pregnancies.

Science.gov (United States)

van Klink, Jmm; Koopman, H M; Middeldorp, J M; Klumper, F J; Rijken, M; Oepkes, D; Lopriore, E

2015-10-01

To assess the incidence of and risk factors for adverse long-term neurodevelopmental outcome in complicated monochorionic pregnancies treated with selective feticide at our centre between 2000 and 2011. Observational cohort study. National referral centre for fetal therapy (Leiden University Medical Centre, the Netherlands). Neurodevelopmental outcome was assessed in 74 long-term survivors. Children, at least 2 years of age, underwent an assessment of neurologic, motor and cognitive development using standardised psychometric tests and the parents completed a behavioural questionnaire. A composite outcome termed neurodevelopmental impairment including cerebral palsy (GMFCS II-V), cognitive and/or motor test score of Neurodevelopmental impairment was detected in 5/74 [6.8%, 95% confidence interval (CI), 1.1-12.5] of survivors. Overall adverse outcome, including perinatal mortality or neurodevelopmental impairment was 48/131 (36.6%). In multivariate analysis, parental educational level was associated with cognitive test scores (regression coefficient B 3.9, 95% CI 1.8-6.0). Behavioural problems were reported in 10/69 (14.5%). Adverse long-term outcome in survivor twins of complicated monochorionic pregnancies treated with selective feticide appears to be more prevalent than in the general population. Cognitive test scores were associated with parental educational level. Neurodevelopmental impairment after selective feticide was detected in 5/74 (6.8%, 95% CI 1.1-12.5) of survivors. © 2015 Royal College of Obstetricians and Gynaecologists.

Development, Testing, and Psychometric Qualities of the Nash Duty to Care Scale for Disaster Response.

Science.gov (United States)

Nash, Tracy Jeanne

2017-08-01

Although nurses struggle with the decision to report for work during disaster events, there are no instruments to measure nurses' duty to care for disaster situations. The purpose of this study was to describe the development, testing, and psychometric qualities of the Nash Duty to Care Scale. A convenience sample of 409 registered nurses were recruited from 3 universities in the United States. Exploratory factor analysis resulted in a 19-item, 4-factor model explaining 67.34% of the variance. Internal consistency reliability was supported by Cronbach's alpha ranging from .81 to .91 for the 4-factor subscales and .92 for the total scale. The psychometrically sound instrument for measuring nurses' perceived duty to care for disasters is applicable to contemporary nursing practice, institutional disaster management plans, and patient health outcomes worldwide.

Assessing reserve-building pursuits and person characteristics: psychometric validation of the Reserve-Building Measure.

Science.gov (United States)

Schwartz, Carolyn E; Michael, Wesley; Zhang, Jie; Rapkin, Bruce D; Sprangers, Mirjam A G

2018-02-01

A growing body of research suggests that regularly engaging in stimulating activities across multiple domains-physical, cultural, intellectual, communal, and spiritual-builds resilience. This project investigated the psychometric characteristics of the DeltaQuest Reserve-Building Measure for use in prospective research. The study included Rare Patient Voice panel participants. The web-based survey included the Reserve-Building Measure with one-week re-test, measures of quality of life (QOL) and well-being (PROMIS General Health; NeuroQOL Cognitive Function and Positive Affect & Well-Being short-forms; Ryff Environmental Mastery subscale); and the Big Five Inventory-10 personality measure. Classical test theory and item response theory (IRT) analyses investigated psychometric characteristics of the Reserve-Building Measure. This North American sample (n = 592) included both patients and caregivers [mean age = 44, SD 19)]. Psychometric analyses revealed distinct subscales measuring current reserve-building activities (Active in the World, Games, Outdoors, Creative, Religious/Spiritual, Exercise, Inner Life, Shopping/Cooking, Passive Media Consumption,), past reserve-building activities (Childhood Activities, Achievement), and reserve-related person-factors (Perseverance, Current and Past Social Support, and Work Value). Test-retest stability (n = 101) was moderately high for 11 of 15 subscales (ICC range 0.78-0.99); four were below 0.59 indicating a need for further refinement. IRT analyses supported the item functioning of all subscales. Correlational analyses suggest the measure's subscales tap distinct constructs (range r = 0.11-0.46) which are not redundant with QOL, well-being, or personality (range r = 0.11-0.48). The Reserve-Building Measure provides a measure of activities and person-factors related to reserve that may potentially be useful in prospective research.

Assessing nicotine dependence in adolescent E-cigarette users: The 4-item Patient-Reported Outcomes Measurement Information System (PROMIS) Nicotine Dependence Item Bank for electronic cigarettes.

Science.gov (United States)

Morean, Meghan E; Krishnan-Sarin, Suchitra; S O'Malley, Stephanie

2018-04-26

Adolescent e-cigarette use (i.e., "vaping") likely confers risk for developing nicotine dependence. However, there have been no studies assessing e-cigarette nicotine dependence in youth. We evaluated the psychometric properties of the 4-item Patient-Reported Outcomes Measurement Information System Nicotine Dependence Item Bank for E-cigarettes (PROMIS-E) for assessing youth e-cigarette nicotine dependence and examined risk factors for experiencing stronger dependence symptoms. In 2017, 520 adolescent past-month e-cigarette users completed the PROMIS-E during a school-based survey (50.5% female, 84.8% White, 16.22[1.19] years old). Adolescents also reported on sex, grade, race, age at e-cigarette use onset, vaping frequency, nicotine e-liquid use, and past-month cigarette smoking. Analyses included conducting confirmatory factor analysis and examining the internal consistency of the PROMIS-E. Bivariate correlations and independent-samples t-tests were used to examine unadjusted relationships between e-cigarette nicotine dependence and the proposed risk factors. Regression models were run in which all potential risk factors were entered as simultaneous predictors of PROMIS-E scores. The single-factor structure of the PROMIS-E was confirmed and evidenced good internal consistency. Across models, larger PROMIS-E scores were associated with being in a higher grade, initiating e-cigarette use at an earlier age, vaping more frequently, using nicotine e-liquid (and higher nicotine concentrations), and smoking cigarettes. Adolescent e-cigarette users reported experiencing nicotine dependence, which was assessed using the psychometrically sound PROMIS-E. Experiencing stronger nicotine dependence symptoms was associated with characteristics that previously have been shown to confer risk for frequent vaping and tobacco cigarette dependence. Copyright © 2018 Elsevier B.V. All rights reserved.

Psychometric properties and validation of the Italian version of the Family Assessment Measure Third Edition - Short Version - in a nonclinical sample.

Science.gov (United States)

Pellerone, Monica; Ramaci, Tiziana; Parrello, Santa; Guariglia, Paola; Giaimo, Flavio

2017-01-01

Family functioning plays an important role in developing and maintaining dysfunctional behaviors, especially during adolescence. The lack of indicators of family functioning, as determinants of personal and interpersonal problems, represents an obstacle to the activities aimed at developing preventive and intervention strategies. The Process Model of Family Functioning provides a conceptual framework organizing and integrating various concepts into a comprehensive family assessment; this model underlines that through the process of task accomplishment, each family meets objectives central to its life as a group. The Family Assessment Measure Third Edition (FAM III), based on the Process Model of Family Functioning, is among the most frequently used self-report instruments to measure family functioning. The present study aimed to evaluate the psychometric properties of the Italian version of the Family Assessment Measure Third Edition - Short Version (Brief FAM-III). It consists of three modules: General Scale, which evaluates the family as a system; Dyadic Relationships Scale, which examines how each family member perceives his/her relationship with another member; and Self-Rating Scale, which indicates how each family member is perceived within the nucleus. The developed Brief FAM-III together with the Family Assessment Device were administered to 484 subjects, members of 162 Italian families, formed of 162 fathers aged between 35 and 73 years; 162 mothers aged between 34 and 69 years; and 160 children aged between 12 and 35 years. Correlation, paired-sample t -test, and reliability analyses were carried out. General item analysis shows good indices of reliability with Cronbach's α coefficients equal to 0.96. The Brief FAM-III has satisfactory internal consistency, with Cronbach's α equal to 0.90 for General Scale, 0.94 for Dyadic Relationships Scale, and 0.88 for the Self-Rating Scale. The Brief FAM-III can be a psychometrically reliable and valid measure for

Finding Pearls: Psychometric Reevaluation of the Simpson-Troost Attitude Questionnaire (STAQ)

Science.gov (United States)

Owen, Steven V.; Toepperwein, Mary Anne; Marshall, Carolyn E.; Lichtenstein, Michael J.; Blalock, Cheryl L.; Liu, Yan; Pruski, Linda A.; Grimes, Kandi

2008-01-01

The Simpson-Troost Attitude Questionnaire (STAQ) was developed as part of a study to assess adolescent commitment to and achievement in science. For this psychometric reappraisal of the 57-item STAQ, data were analyzed from a convenience sample of 1,754 secondary students. Confirmatory and exploratory factor analyses were applied, and results…

The assessment of skin picking in adolescence: psychometric properties of the Skin Picking Scale-Revised (German version).

Science.gov (United States)

Gallinat, Christina; Keuthen, Nancy J; Stefini, Annette; Backenstrass, Matthias

2017-02-01

Skin picking disorder has received growing attention since the release of DSM-5, yet there are no evidence-based assessment instruments for adolescent samples. The present study examines the psychometric properties of the Skin Picking Scale-Revised (SPS-R, German version) in adolescents. A total of 76 adolescents (96% female) completed the SPS-R, the Clinical Psychological Diagnostic System (KPD-38), and a questionnaire assessing demographics and clinical characteristics online. The SPS-R had high internal consistency (α = 0.89) and significant small-to-medium correlations with reduced competence skills, psychological impairment, general life satisfaction, social support, and social problems on the KPD-38. Similar to prior findings for adults, an exploratory factor analysis suggested a two-factor model for the SPS-R in adolescents. Group comparisons failed to show significant differences on SPS-R scores between participants with and without dermatological conditions. The current results suggest that the SPS-R can be useful in adolescent samples as a reliable and valid instrument for the assessment of skin picking severity. Future research investigating scale validity and factor structure in a clinical sample of adolescent skin pickers is warranted.

College Students' Perceptions of Professor/Instructor Bullying: Questionnaire Development and Psychometric Properties

Science.gov (United States)

Marraccini, Marisa E.; Weyandt, Lisa L.; Rossi, Joseph S.

2015-01-01

Objective: This study developed and examined the psychometric properties of a newly formed measure designed to assess professor/instructor bullying, as well as teacher bullying occurring prior to college. Additionally, prevalence of instructor bullying and characteristics related to victims of instructor bullying were examined. Participants:…

Psychometric properties of the Brazilian version of the Tilburg Frailty Indicator (TFI)

NARCIS (Netherlands)

Santiago, L.M.; Luz, L.L.; Mattos, I.M.; Gobbens, R.; van Assen, M.A.L.M.

2013-01-01

This study aims to assess the psychometric properties of the Brazilian version of the TFI, an instrument that identifies frailty in elderly individuals. We interviewed 219 individuals aged 60 or older, living in the community. Individuals were predominantly female (52.5%) and mean age was 70.5

Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients.

Science.gov (United States)

Georgiades, Anastasia; Davis, Vicki G; Atkins, Alexandra S; Khan, Anzalee; Walker, Trina W; Loebel, Antony; Haig, George; Hilt, Dana C; Dunayevich, Eduardo; Umbricht, Daniel; Sand, Michael; Keefe, Richard S E

2017-12-01

The MATRICS Consensus Cognitive Battery (MCCB) was developed to assess cognitive treatment effects in schizophrenia clinical trials, and is considered the FDA gold standard outcome measure for that purpose. The aim of the present study was to establish pre-treatment psychometric characteristics of the MCCB in a large pooled sample. The dataset included 2616 stable schizophrenia patients enrolled in 15 different clinical trials between 2007 and 2016 within the United States (94%) and Canada (6%). The MCCB was administered twice prior to the initiation of treatment in 1908 patients. Test-retest reliability and practice effects of the cognitive composite score, the neurocognitive composite score, which excludes the domain Social Cognition, and the subtests/domains were examined using Intra-Class Correlations (ICC) and Cohen's d. Simulated regression models explored which domains explained the greatest portion of variance in composite scores. Test-retest reliability was high (ICC=0.88) for both composite scores. Practice effects were small for the cognitive (d=0.15) and neurocognitive (d=0.17) composites. Simulated bootstrap regression analyses revealed that 3 of the 7 domains explained 86% of the variance for both composite scores. The domains that entered most frequently in the top 3 positions of the regression models were Speed of Processing, Working Memory, and Visual Learning. Findings provide definitive psychometric characteristics and a benchmark comparison for clinical trials using the MCCB. The test-retest reliability of the MCCB composite scores is considered excellent and the learning effects are small, fulfilling two of the key criteria for outcome measures in cognition clinical trials. Copyright © 2017 Elsevier B.V. All rights reserved.

Faculty Governance and Outcomes Assessment: Compatible or Combustible?

Science.gov (United States)

DeBoy, James L.; Monsilovich, Sally B.; DeBoy, Joanne R.

2013-01-01

This paper identifies the various factors driving the outcomes assessment movement, contrasts the old paradigm with the model now espoused by regional accreditors, discusses the six-step process of student outcomes assessment, emphasizes faculty ownership of the process to prevent administrative usurpation, and proposes specific strategies to…

The UK Functional Assessment Measure (UK FIM+FAM): Psychometric Evaluation in Patients Undergoing Specialist Rehabilitation following a Stroke from the National UK Clinical Dataset.

Science.gov (United States)

Nayar, Meenakshi; Vanderstay, Roxana; Siegert, Richard J; Turner-Stokes, Lynne

2016-01-01

The UK Functional Assessment Measure (UKFIM+FAM) is the principal outcome measure for the UK Rehabilitation Outcomes Collaborative (UKROC) national database for specialist rehabilitation. Previously validated in a mixed neurorehabilitation cohort, this study is the first to explore its psychometric properties in a stroke population, and compare left and right hemispheric strokes (LHS vs RHS). We analysed in-patient episode data from 62 specialist rehabilitation units collated through the UKROC database 2010-2013. Complete data were analysed for 1,539 stroke patients (LHS: 588, RHS: 566 with clear localisation). For factor analysis, admission and discharge data were pooled and randomised into two equivalent samples; the first for exploratory factor analysis (EFA) using principal components analysis, and the second for confirmatory factor analysis (CFA). Responsiveness for each subject (change from admission to discharge) was examined using paired t-tests and differences between LHS and RHS for the entire group were examined using non-paired t-tests. EFA showed a strong general factor accounting for >48% of the total variance. A three-factor solution comprising motor, communication and psychosocial subscales, accounting for >69% total variance, provided acceptable fit statistics on CFA (Root Mean Square Error of Approximation was 0.08 and Comparative Fit Index/ Tucker Lewis Index 0.922/0.907). All three subscales showed significant improvement between admission and discharge (p0.5). Total scores between LHS and RHS were not significantly different. However, LHS showed significantly higher motor scores (Mean 5.7, 95%CI 2.7, 8.6 pLHS had significantly lower cognitive scores, primarily in the communication domain (-6.8 95%CI -7.7, -5.8 pLHS and RHS. This tool extends stroke outcome measurement beyond physical disability to include cognitive, communication and psychosocial function.

Psychometric properties of the Positive and Negative Affect Schedule (PANAS) in a heterogeneous sample of substance users.

Science.gov (United States)

Serafini, Kelly; Malin-Mayor, Bo; Nich, Charla; Hunkele, Karen; Carroll, Kathleen M

2016-03-01

The Positive and Negative Affect Schedule (PANAS) is a widely used measure of affect. A comprehensive psychometric evaluation among substance users, however, has not been published. To examine the psychometric properties of the PANAS in a sample of outpatient treatment substance users. We used pooled data from four randomized clinical trials (N = 416; 34% female, 48% African American). A confirmatory factor analysis indicated adequate support for a two-factor correlated model comprised of Positive Affect and Negative Affect with correlated item errors (Comparative Fit Index = 0.93, Root Mean Square Error of Approximation = 0.07, χ(2) = 478.93, df = 156). Cronbach's α indicated excellent internal consistency for both factors (0.90 and 0.91, respectively). The PANAS factors had good convergence and discriminability (Composite Reliability > 0.7; Maximum Shared Variance Positive Affect = 0.80, Negative Affect = 0.76). Concurrent and discriminant validity were demonstrated with correlations with the Brief Symptom Inventory and Addiction Severity Index. The PANAS scores were also significantly correlated with treatment outcomes (e.g. Positive Affect was associated with the maximum days of consecutive abstinence from primary substance of abuse, r = 0.16, p = 0.001). Our data suggest that the psychometric properties of the PANAS are retained in substance using populations. Although several studies have focused on the role of Negative Affect, our findings suggest that Positive Affect may also be an important factor in substance use treatment outcomes.

79th Annual Meeting of the Psychometric Society

CERN Document Server

Bolt, Daniel; Wang, Wen-Chung; Douglas, Jeffrey; Chow, Sy-Miin

2015-01-01

These research articles from the 79th Annual Meeting of the Psychometric Society (IMPS) cover timely quantitative psychology topics, including new methods in item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Topics within general quantitative methodology include structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis. These methods will appeal, in particular, to researchers in the social sciences. The 79th annual meeting took place in Madison, WI between July 21nd and 25th, 2014. Previous volumes to showcase work from the Psychometric Society’s Meeting are New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 2013) and Quantitative Psychology Research: The 78th Annual Meeting of the Psychometric Society  (Springer, 2015).

80th Annual Meeting of the Psychometric Society

CERN Document Server

Bolt, Daniel; Wang, Wen-Chung; Douglas, Jeffrey; Wiberg, Marie

2016-01-01

The research articles in this volume cover timely quantitative psychology topics, including new methods in item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Topics within general quantitative methodology include structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis. These methods will appeal, in particular, to researchers in the social sciences. The 80th annual meeting took place in Beijing, China, between the 12th and 16th of July, 2014. Previous volumes to showcase work from the Psychometric Society’s Meeting are New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 2013), Quantitative Psychology Research: The 78th Annual Meeting of the Psychometric Society (Springer, 2015), and Quantitative Psychology Research: The 79th Annual Meeting of the Psychometric Society, Wisconsin, USA, 2014 (Springer, 2015).

Psychometric Properties of the Korean Version of the Overactive Bladder Questionnaire (OAB-q in a Korean Population

Directory of Open Access Journals (Sweden)

Seung-June Oh

2012-06-01

Full Text Available Purpose Psychometric properties of the overactive bladder questionnaire (OAB-q were recently examined. However, since the cross-cultural adaptation of a non-English version of the OAB-q has never been demonstrated, we evaluated the psychometric properties of a Korean version of the OAB-q in a Korean population with OAB. Methods A prospective cohort study involving 116 women with 58 OAB and 58 control subjects was performed and convergent validity was assessed. Total and subscale OAB-q scores of the control and OAB groups were compared to their sensitivity to score changes before and after administering anti-cholinergic medication for 12 weeks. Short form 36 and King's health questionnaire (KHQ were also used for comparison or correlation. Results Assessment of face validity showed that the Korean version of the OAB-q was reasonable with OAB-q subscale scores being significantly different between the control and patient groups. Significant correlation (range, -0.29 to -0.81 was found between the OAB-q scores and KHQ results for the OAB patients. Cronbach's alpha coefficients (range, 0.77 to 0.95 indicated excellent internal consistency and test-retest analysis involving 35 OAB patients showed that each questions as well as subscale scores were reproducible. Each score of OAB-q also showed statistically significant sensitivity to changes following anti-muscarinic treatment for OAB (n=27, P<0.001 except for social, P=0.059. Conclusions The Korean version of the OAB-q is a valid and reliable instrument to measure outcomes in Korean patients with OAB.

An integrative review of literature examining psychometric properties of instruments measuring anxiety or fear in hospitalized children.

Science.gov (United States)

Foster, Roxie L; Park, Jeong-hwan

2012-06-01

Anxiety and fear are among the most frequently reported emotional responses to hospitalization and are known to be contributing factors to pain and other negative patient outcomes. The first step in confronting unnecessary anxiety and fear is to identify valid and clinically feasible assessment instruments. The purpose of this paper is to review and evaluate instruments that measure children's fear or anxiety associated with hospitalization or painful procedures. A search was conducted of published English-language literature from 1980 through 2010 with the use of Ovid Health and Psychosocial Instruments, Medline, Nursing/Academic Edition, Cinahl, and Google Scholar. Inclusion criteria specified that the self-report instrument: 1) was developed in English; 2) was developed for and/or widely used with hospitalized children or children undergoing medical procedures or treatment; and 3) had research evidence of psychometric properties from at least five different studies. A comprehensive review of the literature revealed only five fear or anxiety instruments with adequate testing for evaluation of reliability and validity. Although all instruments have beginning psychometric adequacy, no one tool stands out as superior to the others. Therefore, we recommend that researchers and clinicians exercise caution in choosing assessment instruments, balancing potential strengths with reported limitations. Using more than one tool (triangulating) may be one way to achieve more credible results. Knowledge of credible existing instruments alerts us to what is possible today and to the imperative for research that will improve communication with children tomorrow. Copyright © 2012 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Psychometric properties of the Thai Spiritual Well-Being Scale.

Science.gov (United States)

Chaiviboontham, Suchira; Phinitkhajorndech, Noppawan; Hanucharurnkul, Somchit; Noipiang, Thaniya

2016-04-01

The purpose of this study was to investigate the psychometric properties of the modified Thai Spiritual Well-Being Scale in patients with advanced cancer. This cross-sectional study was employed to investigate psychometric properties. Some 196 participants from three tertiary hospitals in Bangkok and suburban Thailand were asked to complete a Personal Information Questionnaire (PIQ), The Memorial Symptom Assessment Scale (MSAS), and the Spiritual Well-Being Scale (SWBS). Validity was determined by known-group, concurrent, and constructs validity. Reliability was estimated using internal consistency by Cronbach's α coefficients. Three factors were extracted: so-called existential well-being, religious well-being, and peacefulness accounted for 71.44% of total variance. The Cronbach's α coefficients for total SWB, EWB, RWB, and peacefulness were 0.96, 0.94, and 0.93, respectively. These findings indicate that the Thai SWBS is a valid and reliable instrument, and it presented one more factor than the original version.

Psychometric validation of the Spanish version of the USS-PROM questionnaire for patients who undergo anterior urethral surgery.

Science.gov (United States)

Puche-Sanz, I; Martín-Way, D; Flores-Martín, J; Expósito-Ruiz, M; Vicente-Prados, J; Nogueras-Ocaña, M; Tinaut-Ranera, J; Cózar-Olmo, J M

2016-06-01

To translate into Spanish and validate the Urethral Stricture Surgery Patient-Reported Outcome Measure (USS-PROM) questionnaire, assessing its psychometric properties and determining its suitability for clinical use in our community. We also assessed the potential changes in ejaculatory function using the Male Sexual Health Questionnaire-Ejaculatory Dysfunction (MSHQ-EjD). A systematic translation of the British version was performed. Patients scheduled for anterior urethral stricture surgery between September 2014 and September 2015 were prospectively included in the study. All patients completed the questionnaire before and after the surgery. We conducted an in-depth psychometric study of the questionnaire. We assessed the responses of a total of 40 patients. The questionnaire showed its validity, presenting an excellent negative correlation between the voiding symptom scores and the maximum flow (r=-0.6, P<.001), and also showed significant improvement in the EQ5D-VAS (visual analogue scale) and the time trade-off. For internal consistency, the Cronbach's alpha was 0.701. For the test-retest reliability, the overall intraclass correlation coefficient (ICC) was 0.974, and the ICC for each item separately ranged from 0.799 to 0.980. We observed significant improvement in all items regarding urinary symptoms and health-related quality of life (P<.001), thereby demonstrating the response capacity to changing the questionnaire. There were no significant changes in the MSHQ-EjD. The Spanish version of the USS-PROM questionnaire is a valid instrument for quantifying changes in voiding symptoms and the health-related quality of life of patients undergoing anterior urethral surgery. Copyright © 2016 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

Clinical outcomes assessment in clinical trials to assess treatment of femoroacetabular impingement

DEFF Research Database (Denmark)

Harris-Hayes, Marcie; McDonough, Christine M; Leunig, Michael

2013-01-01

Patient-reported outcome measures are an important component of outcomes assessment in clinical trials to assess the treatment of femoroacetabular impingement (FAI). This review of disease-specific measures and instruments used to assess the generic quality of life and physical activity levels...... developed recently and have not been established in the literature. Although currently used generic and activity-level measures have limitations, as well, they should be considered, depending on the specific goals of the study. Additional research is needed to assess the properties of these measures fully...

Developing a model of competence in the operating theatre: psychometric validation of the perceived perioperative competence scale-revised.

Science.gov (United States)

Gillespie, Brigid M; Polit, Denise F; Hamlin, Lois; Chaboyer, Wendy

2012-01-01

This paper describes the development and validation of the Revised Perioperative Competence Scale (PPCS-R). There is a lack of a psychometrically tested sound self-assessment tools to measure nurses' perceived competence in the operating room. Content validity was established by a panel of international experts and the original 98-item scale was pilot tested with 345 nurses in Queensland, Australia. Following the removal of several items, a national sample that included all 3209 nurses who were members of the Australian College of Operating Room Nurses was surveyed using the 94-item version. Psychometric testing assessed content validity using exploratory factor analysis, internal consistency using Cronbach's alpha, and construct validity using the "known groups" technique. During item reduction, several preliminary factor analyses were performed on two random halves of the sample (n=550). Usable data for psychometric assessment were obtained from 1122 nurses. The original 94-item scale was reduced to 40 items. The final factor analysis using the entire sample resulted in a 40 item six-factor solution. Cronbach's alpha for the 40-item scale was .96. Construct validation demonstrated significant differences (pperceived competence scores relative to years of operating room experience and receipt of specialty education. On the basis of these results, the psychometric properties of the PPCS-R were considered encouraging. Further testing of the tool in different samples of operating room nurses is necessary to enable cross-cultural comparisons. Copyright © 2011 Elsevier Ltd. All rights reserved.

Adapting tests of sign language assessment for other sign languages--a review of linguistic, cultural, and psychometric problems.

Science.gov (United States)

Haug, Tobias; Mann, Wolfgang

2008-01-01

Given the current lack of appropriate assessment tools for measuring deaf children's sign language skills, many test developers have used existing tests of other sign languages as templates to measure the sign language used by deaf people in their country. This article discusses factors that may influence the adaptation of assessment tests from one natural sign language to another. Two tests which have been adapted for several other sign languages are focused upon: the Test for American Sign Language and the British Sign Language Receptive Skills Test. A brief description is given of each test as well as insights from ongoing adaptations of these tests for other sign languages. The problems reported in these adaptations were found to be grounded in linguistic and cultural differences, which need to be considered for future test adaptations. Other reported shortcomings of test adaptation are related to the question of how well psychometric measures transfer from one instrument to another.

Disgust sensitivity and anxiety disorder symptoms : Psychometric properties of the disgust emotion scale

NARCIS (Netherlands)

Olatunji, Bunmi O.; Sawchuk, Craig N.; de Jong, Peter J.; Lohr, Jeffrey M.

Recent research has implicated disgust sensitivity in the etiology of specific anxiety disorders. The Disgust Emotion Scale (DES) is a newly developed measure that was designed to improve the assessment of disgust sensitivity. The present study examines the psychometric properties of the DES.

[Can Psychometric Tests Predict Success in the Selection Interview for Medical School? A Cross-Sectional Study at One German Medical School].

Science.gov (United States)

Kötter, T; Obst, K U; Brüheim, L; Eisemann, N; Voltmer, E; Katalinic, A

2017-07-01

Background The final exam grade is the main selection criterion for medical school application in Germany. For academic success, it seems to be a reliable predictor. Its use as the only selection criterion is, however, criticised. At some universities, personal interviews are part of the selection process. However, these are very time consuming and are of doubtful validity. The (additional) use of appropriate psychometric instruments could reduce the cost and increase the validity. This study investigates the extent to which psychometric instruments can predict the outcome of a personal selection interview. Methods This is a cross-sectional study on the correlation of the results of psychometric instruments with those of the personal selection interview as part of the application process. As the outcome, the score of the selection interview was used. The NEO - Five Factor Inventory, the Hospital Anxiety and Depression Scale (HADS) and the questionnaire to identify work-related behaviour and experience patterns (AVEM) were used as psychometric interviews. Results There was a statistically significant correlation with the results of the personal selection interview for the sum score of the depression scale from the HADS and the sum score for the dimension of life satisfaction of the AVEM. In addition, those participants who did not previously complete an application training achieved a better result in the selection interview. Conclusion The instruments used measure different aspects than the interviews and cannot replace them. It remains to be seen whether the selected parameters are able to predict academic success. © Georg Thieme Verlag KG Stuttgart · New York.

Outcomes Assessment in Accredited Health Information Management Programs

Science.gov (United States)

Bennett, Dorine

2010-01-01

The purpose of this study was to determine the use and perceived usefulness of outcomes assessment methods in health information management programs. Additional characteristics of the outcomes assessment practices were recognized. The findings were evaluated for significant differences in results based on age of the program, type of institution,…

Patient perspectives on continuity of care: adaption and preliminary psychometric assessment of a Norwegian version of the Nijmegen Continuity Questionnaire (NCQ-N

Directory of Open Access Journals (Sweden)

Øystein Hetlevik

2017-11-01

Full Text Available Abstract Background Continuity of care is regarded as a core quality element in healthcare. Continuity can be related to one or more specific caregivers but also applies to collaboration within a team or across boundaries of healthcare. Measuring continuity is important to identify problems and evaluate quality improvement of interventions. This study aimed to assess the feasibility and psychometric properties of a Norwegian version of the Nijmegen Continuity Questionnaire (NCQ. Methods The NCQ was developed in The Netherlands. It measures patients’ experienced continuity of care across multiple care settings and as a multidimensional concept regardless of morbidity. The NCQ comprises 28 items categorised into three subscales; two personal continuity scales, “care giver knows me” and “shows commitment”, asked regarding the patient’s general practitioner (GP and the most important specialist; and one “team/cross boundary continuity” scale, asked regarding primary care, specialised care and cooperation between GP and specialist, with a total of seven factors. The NCQ was translated and adapted to Norwegian (NCQ-N and distributed among patients referred to somatic rehabilitation (N = 984, response rate 34.5%. Confirmatory factor analyses (CFA, Cronbach’s alpha, intra-class correlation (ICC and Bland–Altman plots were used to assess psychometric properties. Results All patients (N = 375 who had responded to all parts of the NCQ-N were included in CFA. The CFA fit indices (CFI 0.941, RMSEA 0.064 (95% CI 0.059–0.070, SRMR 0.041 support a seven-factor structure in the NCQ-N based on the three subscales of the original NCQ. Cronbach’s alpha showed internal consistency (0.84–0.97, and was highest for the team/cross-boundary subscales. The NCQ-N showed overall high reliability with ICC 0.84–91 for personal continuity factors and 0.67–0.91 for team factors, with the lowest score for team continuity within primary care

Psychometric Assessment and Refinement of the Family Issues Scale of the Human Dimensions of Operations (HDO) Project

National Research Council Canada - National Science Library

Thompson, Megan

2001-01-01

The present report summarizes psychometric analyses and recommendations for item refinement of the Family Issues scale a measure included a predeployment survey of operational stress among Canadian Forces personnel...

The psychometrics of mental workload: multiple measures are sensitive but divergent.

Science.gov (United States)

Matthews, Gerald; Reinerman-Jones, Lauren E; Barber, Daniel J; Abich, Julian

2015-02-01

A study was run to test the sensitivity of multiple workload indices to the differing cognitive demands of four military monitoring task scenarios and to investigate relationships between indices. Various psychophysiological indices of mental workload exhibit sensitivity to task factors. However, the psychometric properties of multiple indices, including the extent to which they intercorrelate, have not been adequately investigated. One hundred fifty participants performed in four task scenarios based on a simulation of unmanned ground vehicle operation. Scenarios required threat detection and/or change detection. Both single- and dual-task scenarios were used. Workload metrics for each scenario were derived from the electroencephalogram (EEG), electrocardiogram, transcranial Doppler sonography, functional near infrared, and eye tracking. Subjective workload was also assessed. Several metrics showed sensitivity to the differing demands of the four scenarios. Eye fixation duration and the Task Load Index metric derived from EEG were diagnostic of single-versus dual-task performance. Several other metrics differentiated the two single tasks but were less effective in differentiating single- from dual-task performance. Psychometric analyses confirmed the reliability of individual metrics but failed to identify any general workload factor. An analysis of difference scores between low- and high-workload conditions suggested an effort factor defined by heart rate variability and frontal cortex oxygenation. General workload is not well defined psychometrically, although various individual metrics may satisfy conventional criteria for workload assessment. Practitioners should exercise caution in using multiple metrics that may not correspond well, especially at the level of the individual operator.

81st Annual Meeting of the Psychometric Society

CERN Document Server

Wiberg, Marie; Culpepper, Steven; Douglas, Jeffrey; Wang, Wen-Chung

2017-01-01

This proceedings volume compiles and expands on selected and peer reviewed presentations given at the 81st Annual Meeting of the Psychometric Society (IMPS), organized by the University of North Carolina at Greensboro, and held in Asheville, North Carolina, July 11th to 17th, 2016. IMPS is one of the largest international meetings focusing on quantitative measurement in psychology, education, and the social sciences, both in terms of participants and number of presentations. The meeting built on the Psychometric Society's mission to share quantitative methods relevant to psychology, addressing a diverse set of psychometric topics including item response theory, factor analysis, structural equation modeling, time series analysis, mediation analysis, cognitive diagnostic models, and multi-level models. Selected presenters were invited to revise and expand their contributions and to have them peer reviewed and published in this proceedings volume. Previous volumes to showcase work from the Psychometric Society�...

Psychometric properties and factor structure of the adapted Self-Regulation Questionnaire assessing autonomous and controlled motivation for healthful eating among youth with type 1 diabetes and their parents.

Science.gov (United States)

Quick, V; Lipsky, L M; Nansel, T R

2018-07-01

The purpose of this cross-sectional study was to examine the psychometric properties of 2 adapted Self-Regulation Questionnaire (SRQ) measures assessing youth with type 1 diabetes motivation internalization for healthful eating and their parents motivation internalization for providing healthy meals for the family. External validity of the adapted SRQ was evaluated with respect to healthy eating attitudes (healthful eating self-efficacy, barriers, and outcome expectations) assessed by questionnaire, diet quality (Healthy Eating Index-2005 [HEI-2005]; Nutrient-Rich Foods Index 9.3 [NRF9.3]; Whole Plant Food Density [WPFD]) assessed by 3-day food records, and body mass index assessed by measured height and weight in youth with type 1 diabetes (N = 136; age 12.3 ± 2.5 years) and their parents. Exploratory factor analysis with varimax rotation yielded a 2-factor structure with the expected autonomous and controlled motivation factors for both youth and parents. Internal consistencies of subscales were acceptable (α = .66-.84). Youth autonomous and controlled motivation were positively correlated overall (r = 0.30, p parent: r = 0.36), positive outcome expectations (youth: r = 0.30, parent: r = 0.35), and fewer barriers to healthful eating (youth: r = -0.36, parent: r = -0.32). Controlled motivation was positively correlated with negative outcome expectations for parents (r = 0.29, p expectations for youth. Autonomous motivation was positively associated (p parents (NRF9.3 r = 0.22; WPFD r = 0.24; HEI-2005 r = 0.22) and youth ≥13 years (NRF9.3 r = 0.26) but not youth parents, but not youth, body mass index was associated negatively with autonomous motivation (r = -.33, p < .001) and positively with controlled motivation (r = .27, p < .01). Findings provide initial support for the SRQ in this population and suggest potential developmental differences in the role of motivation on healthful eating among children, adolescents

Psychometric testing of the properties of the spiritual health scale short form.

Science.gov (United States)

Hsiao, Ya-Chu; Chiang, Yi-Chien; Lee, Hsiang-Chun; Han, Chin-Yen

2013-11-01

To further examine the psychometric properties of the spiritual health scale short form, including its reliability and validity. Spirituality is one of the main factors associated with good health outcomes. A reliable and valid instrument to measure spirituality is essential to identify the spiritual needs of an individual and to evaluate the effect of spiritual care. A cross-sectional study design was used. The study was conducted in six nursing schools in northern, central and southern Taiwan. The inclusion criterion for participants was nursing students with clinical practice experience. Initially, 1141 participants were recruited for the study, but 67 were absent and 48 did not complete the questionnaires. A total of 1026 participants were finally recruited, indicating a response rate of 89·9%. The psychometric testing of the spiritual health scale short form included construct validity with confirmatory factor analysis, known-group validity and internal consistency reliability. The results of the confirmatory factor analysis supported the five-factor model as an acceptable model fit. In the known-group validity, the results indicated that people who are in the category of primary religious affiliation have better spiritual health than people in the category of secondary religious affiliation and atheism. The result also indicated that the 24-item spiritual health scale short form achieved an acceptable internal consistency coefficient. The findings suggest that the spiritual health scale short form is a valid and reliable instrument for the appraisal of individual spiritual health. The spiritual health scale short form could provide useful information to guide clinical practice in assessing and managing people's spiritual health in Taiwan. © 2013 John Wiley & Sons Ltd.

A psychometric appraisal of the DREEM

Directory of Open Access Journals (Sweden)

Hammond Sean M

2012-01-01

Full Text Available Abstract Background The quality of the Educational environment is a key determinant of a student centred curriculum. Evaluation of the educational environment is an important component of programme appraisal. In order to conduct such evaluation use of a comprehensive, valid and reliable instrument is essential. One of most widely used contemporary tools for evaluation of the learning environment is the Dundee Ready Education Environment Measure (DREEM. Apart from the initial psychometric evaluation of the DREEM, few published studies report its psychometric properties in detail. The aim of this study was to examine the psychometric quality of the DREEM measure in the context of medical education in Ireland and to explore the construct validity of the device. Methods 239 final year medical students were asked to complete the DREEM inventory. Anonymised responses were entered into a database. Data analysis was performed using PASW 18 and confirmatory factor analysis performed. Results Whilst the total DREEM score had an acceptable level of internal consistency (alpha 0.89, subscale analysis shows that two subscales had sub-optimal internal consistency. Multiple group confirmatory factor analysis (using Fleming's indices shows an overall fit of 0.76, representing a weak but acceptable level of fit. 17 of the 50 items manifest fit indices less than 0.70. We sought the best fitting oblique solution to the 5-subscale structure, which showed large correlations, suggesting that the independence of the separate scales is open to question. Conclusions There has perhaps been an inadequate focus on establishing and maintaining the psychometric credentials of the DREEM. The present study highlights two concerns. Firstly, the internal consistency of the 5 scales is quite variable and, in our sample, appears rather low. Secondly, the construct validity is not well supported. We suggest that users of the DREEM will provide basic psychometric appraisal of the

A psychometric appraisal of the DREEM

LENUS (Irish Health Repository)

Hammond, Sean M

2012-01-12

Abstract Background The quality of the Educational environment is a key determinant of a student centred curriculum. Evaluation of the educational environment is an important component of programme appraisal. In order to conduct such evaluation use of a comprehensive, valid and reliable instrument is essential. One of most widely used contemporary tools for evaluation of the learning environment is the Dundee Ready Education Environment Measure (DREEM). Apart from the initial psychometric evaluation of the DREEM, few published studies report its psychometric properties in detail. The aim of this study was to examine the psychometric quality of the DREEM measure in the context of medical education in Ireland and to explore the construct validity of the device. Methods 239 final year medical students were asked to complete the DREEM inventory. Anonymised responses were entered into a database. Data analysis was performed using PASW 18 and confirmatory factor analysis performed. Results Whilst the total DREEM score had an acceptable level of internal consistency (alpha 0.89), subscale analysis shows that two subscales had sub-optimal internal consistency. Multiple group confirmatory factor analysis (using Fleming\\'s indices) shows an overall fit of 0.76, representing a weak but acceptable level of fit. 17 of the 50 items manifest fit indices less than 0.70. We sought the best fitting oblique solution to the 5-subscale structure, which showed large correlations, suggesting that the independence of the separate scales is open to question. Conclusions There has perhaps been an inadequate focus on establishing and maintaining the psychometric credentials of the DREEM. The present study highlights two concerns. Firstly, the internal consistency of the 5 scales is quite variable and, in our sample, appears rather low. Secondly, the construct validity is not well supported. We suggest that users of the DREEM will provide basic psychometric appraisal of the device in future

Applied psychometrics in clinical psychiatry: the pharmacopsychometric triangle

DEFF Research Database (Denmark)

Bech, P; Bech, P

2009-01-01

OBJECTIVE: To consider applied psychometrics in psychiatry as a discipline focusing on pharmacopsychology rather than psychopharmacology as illustrated by the pharmacopsychometric triangle. METHOD: The pharmacopsychological dimensions of clinically valid effects of drugs (antianxiety, antidepress......OBJECTIVE: To consider applied psychometrics in psychiatry as a discipline focusing on pharmacopsychology rather than psychopharmacology as illustrated by the pharmacopsychometric triangle. METHOD: The pharmacopsychological dimensions of clinically valid effects of drugs (antianxiety...... psychometrics in psychiatry have been found to cover a pharmacopsychometric triangle illustrating the measurements of wanted and unwanted effects of pharmacotherapeutic drugs as well as health-related quality of life....

Spanish validation of the Negative Symptom Assessment-16 (NSA-16) in patients with schizophrenia.

Science.gov (United States)

Garcia-Alvarez, Leticia; Garcia-Portilla, María Paz; Saiz, Pilar Alejandra; Fonseca-Pedrero, Eduardo; Bobes-Bascaran, María Teresa; Gomar, Jesús; Muñiz, José; Bobes, Julio

2018-04-05

Negative symptoms are prevalent in schizophrenia and associated with a poorer outcome. Validated newer psychometric instruments could contribute to better assessment and improved treatment of negative symptoms. The Negative Symptom Assessment-16 (NSA-16) has been shown to have strong psychometric properties, but there is a need for validation in non-English languages. This study aimed to examine the psychometric properties of a Spanish version of the NSA-16 (Sp-NSA-16). Observational, cross-sectional validation study in a sample of 123 outpatients with schizophrenia. NSA-16, PANSS, HDRS, CGI-SCH and PSP. The results indicate appropriate psychometric properties, high internal consistency (Cronbach's alpha=0.86), convergent validity (PANSS negative scale, PANSS Marder Negative Factor and CGI-negative symptoms r values between 0.81 and 0.94) and divergent validity (PANSS positive scale and the HDRS r values between 0.10 and 0.34). In addition, the NSA-16 also exhibited discriminant validity (ROC curve=0.97, 95% CI=0.94 to 1.00; 94.3% sensitivity and 83.3% specificity). The Sp-NSA-16 is reliable and valid for measuring negative symptoms in patients with schizophrenia. This provides Spanish clinicians with a new tool for clinical practice and research. However, it is necessary to provide further information about its inter-rater reliability. Copyright © 2018 SEP y SEPB. Publicado por Elsevier España, S.L.U. All rights reserved.

The Interpersonal Relationship Inventory: continued psychometric evaluation.

Science.gov (United States)

Tilden, V P; Hirsch, A M; Nelson, C A

1994-01-01

For norm-referenced measures to be useful in social-behavioral research, investigators who develop measures face several psychometric challenges, including: (a) adequate domain specification; (b) adequate initial evidence of reliability and validity; and (c) ongoing evidence of psychometric quality. The Interpersonal Relationship Inventory (IPRI) was developed in response to gaps in measurement of social relationships, and contributed scales for reciprocity and conflict to a measure of social support. For the IPRI, the first two points were addressed during the period of instrument development. The measure now has been in use for 4 years. This article reports evidence addressing the third challenge: ongoing evidence of psychometric quality. Findings from 19 studies using the IPRI provide compelling evidence for internal consistency reliability and construct validity of the scales.

Assessing the psychometric questioner for students rating teachers

Directory of Open Access Journals (Sweden)

Razaghi Reza Sharif

2016-07-01

Full Text Available Educational institutions use different ways to evaluate their teachers. Asking students to rate their teachers is common practice. The purpose of this research was to examine the reliability of the instruments used to evaluate the instructors in a college of medicine. This cross-sectional descriptive research used questioners that evaluated instructors. The questioner was targeting different dimensions of instructors. Item analysis in addition to exploratory factor analysis was performed on 1040questioners answered by the students of the College of Medicine of Kashan University of Medical Sciences. SPSS software was used to perform the analysis. The psychometric properties of questionnaires including Cronbach alpha was determined. The result of exploratory factor analysis and item analysis indicated that three of the subscales of the questioner showed sufficient reliability to evaluate the instructors and two subscales needed further examination. This type of evaluations is necessary to ensure quality of instructors working in an institution as well as providing reliable feedback to the instructors. The result showed that while some subscales of the questioner seems to target the concept of interest; a re-evaluation of the instrument would be valuable to increase its reliability for the administrators in the colleges.

Psychometric validation of a music-based attention assessment: revised for patients with traumatic brain injury.

Science.gov (United States)

Jeong, Eunju

2013-01-01

An estimated 1.5 to 2 million people sustain a traumatic brain injury (TBI) each year in the United States. Impairments in attention following TBI severely limit everyday functioning in a multifaceted manner. A precise assessment is critical in identifying the types of attention impairments and in recommending appropriate tasks to aid in attention rehabilitation. A Music-based Attention Assessment (MAA) was developed to fill this need and revised to reflect variations of attention ability that exist in the general population. The purpose of the study was to investigate the theoretically-based constructs of the Music-based Attention Assessment-Revised (MAA-R) using a factorial approach and to examine item properties and test reliability in relation to the exploratively-derived factor constructs. The MAA-R is a 54-item multiple-choice, melodic contour identification test, designed to assess three different types of auditory attention including sustained, selective, and divided attention. The psychometric validation of the MAA-R was conducted with healthy adults (n = 165) and patients diagnosed with a moderate to severe TBI (n = 22). Exploratory factor analysis identified five factor constructs, including Sustained-Short, Sustained-Med to Long, Selective-Noise, Selective & Divided, and Divided-Long. After item elimination, the final 45-item MAA-R provided evidence of high internal consistency as computed by split-half reliability coefficients (r = .836) and Cronbach's alpha (alpha = .940). The aggregate findings suggest that the MAA-R is a valid and reliable measure that provides assessment information in regards to the different types of auditory attention deficits frequently observed in patients with TBI. Development and revision issues as well as the use of melodic contours in auditory attention assessment are discussed along with suggestions for future research.

Psychometric Properties of the Persian Version of Self-Transcendence Scale: Adolescent Version.

Science.gov (United States)

Farahani, Azam Shirinabadi; Rassouli, Maryam; Yaghmaie, Farideh; Majd, Hamid Alavi; Sajjadi, Moosa

2016-04-01

Given the greater tendency during adolescence toward risk-taking, identifying and measuring the factors affecting the adolescents' health is highly important to ensure the efficacy of health promoting interventions. One of these factors is self-transcendence. The aim of this study was to assess the psychometric features of the Self-Transcendence Scale (adolescents' version) in students in Tehran, the capital city of Iran. This research was conducted in 2015. For this purpose, 1210 high school students were selected through the multistage cluster sampling method. After the backward-forward translation, the psychometric properties of the scale were examined through the assessment of the (face and construct) validity and reliability (internal consistency and stability) of the scale. The construct validity was assessed using two methods, factor analysis, and convergence of the scale with the Hopefulness Scale for Adolescents. The result of face validity was minor modifications in some words. The exploratory factor analysis resulted in the extraction of two dimensions, with explaining 52.79% of the variance collectively. In determining the convergent validity, the correlation between hopefulness score and self-transcendence score was r=0.47 (PSelf-Transcendence Scale showed an acceptable validity and reliability and can be used in the assessment of self-transcendence in Iranian adolescents.

Perceived Effects of Sexually Explicit Media among Men Who Have Sex with Men and Psychometric Properties of the Pornography Consumption Effects Scale (PCES)

DEFF Research Database (Denmark)

Hald, Gert Martin; Smolenski, Derek; Rosser, B R Simon

2013-01-01

a thorough psychometric validation of a reduced and reworked version of the Pornography Consumption Effects Scale (PCES). Main Outcome Measure. A revised version of the PCES by Hald and Malamuth. Methods. Online cross-sectional survey study of 1,333 US adult Men Who Have Sex with Men. Results. This study...... health potential for MSM. Hald GM, Smolenski D, and Rosser BRS. Perceived effects of sexually explicit media among men who have sex with men and psychometric properties of the Pornography Consumption Effects Scale (PCES). J Sex Med 2013;10:757-767....

Work environment impact scale: testing the psychometric properties of the Swedish version.

Science.gov (United States)

Ekbladh, Elin; Fan, Chia-Wei; Sandqvist, Jan; Hemmingsson, Helena; Taylor, Renée

2014-01-01

The Work Environment Impact Scale (WEIS) is an assessment that focuses on the fit between a person and his or her work environment. It is based on Kielhofner's Model of Human Occupation and designed to gather information on how clients experience their work environment. The aim of this study was to examine the psychometric properties of the Swedish version of the WEIS assessment instrument. In total, 95 ratings on the 17-item WEIS were obtained from a sample of clients with experience of sick leave due to different medical conditions. Rasch analysis was used to analyze the data. Overall, the WEIS items together cohered to form a single construct of increasingly challenging work environmental factors. The hierarchical ordering of the items along the continuum followed a logical and expected pattern, and the participants were validly measured by the scale. The three occupational therapists serving as raters validly used the scale, but demonstrated a relatively high rater separation index, indicating differences in rater severity. The findings provide evidence that the Swedish version of the WEIS is a psychometrically sound assessment across diagnoses and occupations, which can provide valuable information about experiences of work environment challenges.

The Child-Adolescent Perfectionism Scale: Development, Psychometric Properties, and Associations With Stress, Distress, and Psychiatric Symptoms

Science.gov (United States)

Flett, Gordon L.; Hewitt, Paul L.; Besser, Avi; Su, Chang; Vaillancourt, Tracy; Boucher, Daniel; Munro, Yvette; Davidson, Lisa A.; Gale, Olga

2016-01-01

There is growing interest in perfectionism among children and adolescents as well as growing interest in the measures designed to assess perfectionism in young people. The current article describes the development and psychometric characteristics of the Child-Adolescent Perfectionism Scale (CAPS), a measure that assesses self-oriented…

Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale.

Science.gov (United States)

Strauss, Gregory P; Keller, William R; Buchanan, Robert W; Gold, James M; Fischer, Bernard A; McMahon, Robert P; Catalano, Lauren T; Culbreth, Adam J; Carpenter, William T; Kirkpatrick, Brian

2012-12-01

The current study examined the psychometric properties of the Brief Negative Symptom Scale (BNSS), a next-generation rating instrument developed in response to the NIMH sponsored consensus development conference on negative symptoms. Participants included 100 individuals with a DSM-IV diagnosis of schizophrenia or schizoaffective disorder who completed a clinical interview designed to assess negative, positive, disorganized, and general psychiatric symptoms, as well as functional outcome. A battery of anhedonia questionnaires and neuropsychological tests were also administered. Results indicated that the BNSS has excellent internal consistency and temporal stability, as well as good convergent and discriminant validity in its relationships with other symptom rating scales, functional outcome, self-reported anhedonia, and neuropsychological test scores. Given its brevity (13-items, 15-minute interview) and good psychometric characteristics, the BNSS can be considered a promising new instrument for use in clinical trials. Copyright © 2012 Elsevier B.V. All rights reserved.

Item-level psychometrics of the ADL instrument of the Korean National Survey on persons with physical disabilities.

Science.gov (United States)

Hong, Ickpyo; Lee, Mi Jung; Kim, Moon Young; Park, Hae Yean

2017-10-01

The aim of this study is to investigate the psychometrics of the 12 items of an instrument assessing activities of daily living (ADL) using an item response theory model. A total of 648 adults with physical disabilities and having difficulties in ADLs were retrieved from the 2014 Korean National Survey on People with Disabilities. The psychometric testing included factor analysis, internal consistency, precision, and differential item functioning (DIF) across categories including sex, older age, marital status, and physical impairment area. The sample had a mean age of 69.7 years old (SD = 13.7). The majority of the sample had lower extremity impairments (62.0%) and had at least 2.1 chronic conditions. The instrument demonstrated unidimensional construct and good internal consistency (Cronbach's alpha = 0.95). The instrument precisely estimated person measures within a wide range of theta values (-2.22 logits  5.0%). Our findings indicate that the dressing item would need to be modified to improve its psychometrics. Overall, the ADL instrument demonstrates good psychometrics, and thus, it may be used as a standardized instrument for measuring disability in rehabilitation contexts. However, the findings are limited to adults with physical disabilities. Future studies should replicate psychometric testing for survey respondents with other disorders and for children.

Psychometric evaluation of dietary habits questionnaire for type 2 diabetes mellitus

Science.gov (United States)

Sami, W.; Ansari, T.; Butt, N. S.; Hamid, M. R. Ab

2017-09-01

This research evaluated the psychometric properties of English version of dietary habits questionnaires developed for type 2 diabetic patients. There is scarcity of literature about availability of standardized questionnaires for assessing dietary habits of type 2 diabetics in Saudi Arabia. As dietary habits vary from country to country, therefore, this was an attempt to develop questionnaires that can serve as a baseline. Through intensive literature review, four questionnaires were developed / modified and subsequently tested for psychometric properties. Prior to pilot study, a pre-test was conducted to evaluate the face validity and content validity. The pilot study was conducted from 23 October - 22 November, 2016 to evaluate the questionnaires’ reliability and validity. Systematic random sampling technique was used to collect the data from 132 patients by direct investigation method. Questionnaires assessing diabetes mellitus knowledge (0.891), dietary knowledge (0.869), dietary attitude (0.841) and dietary practices (0.874) had good internal consistency reliability. Factor analysis conducted on dietary attitude questionnaire showed a valid 5 factor solution. Directions of loadings were positive and free from factorial complexity. Relying on the data obtained from type 2 diabetics, these questionnaires can be considered as reliable and valid for the assessment of dietary habits in Saudi Arabia and neighbouring Gulf countries population.

Conducting Systematic Outcome Assessment in Private Addictions Treatment Settings

Directory of Open Access Journals (Sweden)

Gerard J Connors

2017-07-01

Full Text Available Systematic outcome assessment is central to ascertaining the impact of treatment services and to informing future treatment initiatives. This project was designed to be conducted within the clinical operations of 4 private addictions treatment centers. A structured interview was used to assess patients’ alcohol and other drug use and related variables (on treatment entry and at 1, 3, and 6 months following treatment discharge. The primary outcomes were percentage of days abstinent (PDA from alcohol and drugs, PDA from alcohol, and PDA from other drugs. Collateral reports during follow-up also were gathered. A total of 280 patients (56% men across the 4 programs participated. Percentage of days abstinent for each outcome increased significantly from baseline to the 1-month follow-up assessment, and this change was maintained at the 3- and 6-month follow-up assessments. Collateral reports mirrored the patient follow-up reports. Secondary outcomes of patient ratings of urges/cravings, depression, anxiety, and general life functioning all indicated significant improvement from baseline over the course of the follow-up. The results suggest the feasibility of conducting systematic outcome assessment in freestanding private addictions treatment environments.

Validation of Patient-Reported Outcomes Measurement Information System Computerized Adaptive Tests Against the Foot and Ankle Outcome Score for 6 Common Foot and Ankle Pathologies.

Science.gov (United States)

Koltsov, Jayme C B; Greenfield, Stephen T; Soukup, Dylan; Do, Huong T; Ellis, Scott J

2017-08-01

The field of foot and ankle surgery lacks a widely accepted gold-standard patient-reported outcome instrument. With the changing infrastructure of the medical profession, more efficient patient-reported outcome tools are needed to reduce respondent burden and increase participation while providing consistent and reliable measurement across multiple pathologies and disciplines. The primary purpose of the present study was to validate 3 Patient-Reported Outcomes Measurement Information System computer adaptive tests (CATs) most relevant to the foot and ankle discipline against the Foot and Ankle Outcome Score (FAOS) and the Short Form 12 general health status survey in patients with 6 common foot and ankle pathologies. Patients (n = 240) indicated for operative treatment for 1 of 6 common foot and ankle pathologies completed the CATs, FAOS, and Short Form 12 at their preoperative surgical visits, 1 week subsequently (before surgery), and at 6 months postoperatively. The psychometric properties of the instruments were assessed and compared. The Patient-Reported Outcomes Measurement Information System CATs each took less than 1 minute to complete, whereas the FAOS took 6.5 minutes, and the Short Form 12 took 3 minutes. CAT scores were more normally distributed and had fewer floor and ceiling effects than those on the FAOS, which reached as high as 24%. The CATs were more precise than the FAOS and had similar responsiveness and test-retest reliability. The physical function and mobility CATs correlated strongly with the activities subscale of the FAOS, and the pain interference CAT correlated strongly with the pain subscale of the FAOS. The CATs and FAOS were responsive to changes with operative treatment for 6 common foot and ankle pathologies. The CATs performed as well as or better than the FAOS in all aspects of psychometric validity. The Patient-Reported Outcomes Measurement Information System CATs show tremendous potential for improving the study of patient

Psychometric evaluation of the Dutch version of the Subjective Opiate Withdrawal Scale (SOWS)

NARCIS (Netherlands)

Dijkstra, B.A.G.; Krabbe, P.F.M.; Riezebos, T.G.M.; Staak, C.P.F. van der; Jong, C.A.J. de

2007-01-01

AIM: To evaluate the psychometric properties of the Dutch version of the 16-item Subjective Opiate Withdrawal Scale (SOWS). The SOWS measures withdrawal symptoms at the time of assessment. METHODS: The Dutch SOWS was repeatedly administered to a sample of 272 opioid-dependent inpatients of four

Further Psychometric Properties of the Tourette's Disorder Scale-Parent Rated Version (TODS-PR)

Science.gov (United States)

Storch, Eric A.; Murphy, Tanya K.; Geffken, Gary R.; Soto, Ohel; Sajid, Muhammad; Allen, Pam; Roberti, Jonathan W.; Killiany, Erin M.; Goodman, Wayne K.

2004-01-01

This study evaluated the psychometric properties of the Tourette's Disorder Scale-Parent Rated (TODS-PR), a 15-item parent-rated instrument that assesses a range of common symptoms seen in childhood Tourette's Disorder (TD) patients including tics, obsessions, compulsions, inattention, hyperactivity, aggression, and emotional disturbances.…

Development and Psychometric Testing of the Dogs and WalkinG Survey (DAWGS)

Science.gov (United States)

Richards, Elizabeth A.; McDonough, Meghan H.; Edwards, Nancy E.; Lyle, Roseann M.; Troped, Philip J.

2013-01-01

Purpose: Dog owners represent 40% of the population, a promising audience to increase population levels of physical activity. The purpose of this study was to develop and test the psychometric properties of a new instrument to assess social-cognitive theory constructs related to dog walking. Method: Dog owners ("N" = 431) completed the…

Risk perception and control, an integration of the psychometric research paradigm and social psychology

International Nuclear Information System (INIS)

Haugen, K.

1998-01-01

Full text of publication follows: this paper argues that perceptual control is an essential component in human risk evaluation. Control is seen as an integrative concept between the psychometric research paradigm and various psychological theories. The psychometric approach to the study of risk has mainly dealt with the intuitive judgements people do when they are asked to evaluate risky activities and technologies. It shows that people judge risk in relation to the possible consequences and probabilities related to an outcome; the former more typical for the public and the latter more often used by experts. The psychometric research tradition has concentrated on doing human risk evaluations quantifiable and the reactions predictable. This paper also relates to possible practical implications of this strategy, namely that humans react heterogeneously to different kinds of threats due to perceived control. Theoretical ability to explain and elaborate perceptions of risk, as well as individual reactions, were the main criteria for the literature selection, which includes work on e.g. attribution theory, locus of control, and learned helplessness. Thus, the paper addresses available psychological views for a contribution to a developed theoretical framework for human risk evaluation. It seeks to compare and integrate the psychometric research tradition within social psychological theories. The way in which people find their informational basis for their risk judgements, either from others or from their own perceptions is also discussed. Furthermore, the theories are related to the social and psychological reactions of the Chernobyl accident. The paper concludes that psychological theories can contribute to a more comprehensive framework for the understanding of human risk evaluation, leading to a more coherent and integrative knowledge. (author)

Judging the Neonatal Abstinence Syndrome Assessment Tools to Guide Future Tool Development: The use of Clinimetrics as Opposed to Psychometrics.

Science.gov (United States)

Westgate, Philip M; Gomez-Pomar, Enrique

2017-01-01

In the face of the current Neonatal Abstinence Syndrome (NAS) epidemic, there is considerable variability in the assessment and management of infants with NAS. In this manuscript, we particularly focus on NAS assessment, with special attention given to the popular Finnegan Neonatal Abstinence Score (FNAS). A major instigator of the problem of variable practices is that multiple modified versions of the FNAS exist and continue to be proposed, including shortened versions. Furthermore, the validity of such assessment tools has been questioned, and as a result, the need for better tools has been suggested. The ultimate purpose of this manuscript, therefore, is to increase researchers' and clinicians' understanding on how to judge the usefulness of NAS assessment tools in order to guide future tool development and to reduce variable practices. In short, we suggest that judgment of NAS assessment tools should be made on a clinimetrics viewpoint as opposed to psychometrically. We provide examples, address multiple issues that must be considered, and discuss future tool development. Furthermore, we urge researchers and clinicians to come together, utilizing their knowledge and experience, to assess the utility and practicality of existing assessment tools and to determine if one or more new or modified tools are needed with the goal of increased agreement on the assessment of NAS in practice.

Adjusted linguistic validation and psychometric properties of the Colombian version of KIDSCREEN-52.

Science.gov (United States)

Jaimes-Valencia, Mary Luz; Perpiñá-Galvañ, Juana; Cabañero-Martínez, Maria José; Cabrero-García, Julio; Richart-Martínez, Miguel

2018-01-01

In health and clinical studies, health-related quality of life is often assessed using the well-established KIDSCREEN-52 questionnaires as well as the Vécu et Santé Perçue de l'Adolescent (VSP-A). The purpose of this study was twofold: to perform an adjusted linguistic validation of the Colombian version of the KIDSCREEN-52 and to assess its psychometric properties in children and adolescents. A total of 146 children and adolescents completed the KIDSCREEN-52, adolescents ( n = 48) additionally completed the VSP-A. Psychometric analyses focused on the internal consistency as well as the convergent and discriminant validity of the KIDSCREEN-52 Colombian version. Syntactic and semantic modifications were made to 19 items in the adapted version of the KIDSCREEN-52. Cronbach's α ranged from .74 to .89 for eight dimensions, while α Colombian version of the KIDSCREEN-52 showed acceptable reliability and validity. This study provides a cultural adaptation of the Spanish version of the KIDSCREEN-52 for Colombian children and adolescents.

Assessing patient-caregiver communication in cancer--a psychometric validation of the Cancer Communication Assessment Tool (CCAT-PF) in a German sample.

Science.gov (United States)

Haun, Markus W; Sklenarova, Halina; Winkler, Eva C; Huber, Johannes; Thomas, Michael; Siminoff, Laura A; Woll, Michael; Brechtel, Anette; Herzog, Wolfgang; Hartmann, Mechthild

2014-09-01

The recently introduced Cancer Communication Assessment Tool (CCAT-PF) measures congruence in patient-caregiver communication and was initially validated in lung cancer patients. Contributing to a greater proportion of the variance in the conflict scores, primary caregivers were hypothesized to experience greater stress. For a detailed understanding of conflicting communication patterns of cancer-affected families, our study aimed for psychometric validation of the CCAT-PF in a sample covering heterogeneous tumor entities. Subsequent to a cross-sectional survey of 189 pairs of cancer patients (31 % gastrointestinal, 34 % lung, and 35 % urological) and their caregivers' exploratory factor analysis with principal component condensation and varimax rotation was conducted (response rate, 74.2 %). Reliability and construct validity were assessed calculating Cronbach's α and Pearson correlation coefficients for CCAT-P and CCAT-F scales and related constructs, respectively. Cancer-related communication according to the CCAT-PF can be subdivided into four factors including the scales Disclosure, Limitation of treatment, Family involvement in treatment decisions, and Continuing treatment. Reliability ranged from α = .51-.68. The Disclosure scale, describing poor cancer-related communication of the patient, was correlated with patient's distress (QSC-R10: r = .30, p reliable stand-alone instrument for identifying conflicting communication in patient-caregiver-dyads at risk.

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

Science.gov (United States)

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

Further psychometric evaluation and revision of the Mayo-Portland Adaptability Inventory in a national sample.

Science.gov (United States)

Malec, James F; Kragness, Miriam; Evans, Randall W; Finlay, Karen L; Kent, Ann; Lezak, Muriel D

2003-01-01

To evaluate the internal consistency of the Mayo-Portland Adaptability Inventory (MPAI), further refine the instrument, and provide reference data based on a large, geographically diverse sample of persons with acquired brain injury (ABI). 386 persons, most with moderate to severe ABI. Outpatient, community-based, and residential rehabilitation facilities for persons with ABI located in the United States: West, Midwest, and Southeast. Rasch, item cluster, principal components, and traditional psychometric analyses for internal consistency of MPAI data and subscales. With rescoring of rating scales for 4 items, a 29-item version of the MPAI showed satisfactory internal consistency by Rasch (Person Reliability=.88; Item Reliability=.99) and traditional psychometric indicators (Cronbach's alpha=.89). Three rationally derived subscales for Ability, Activity, and Participation demonstrated psychometric properties that were equivalent to subscales derived empirically through item cluster and factor analyses. For the 3 subscales, Person Reliability ranged from.78 to.79; Item Reliability, from.98 to.99; and Cronbach's alpha, from.76 to.83. Subscales correlated moderately (Pearson r =.49-.65) with each other and strongly with the overall scale (Pearson r=.82-.86). Outcome after ABI is represented by the unitary dimension described by the MPAI. MPAI subscales further define regions of this dimension that may be useful for evaluation of clinical cases and program evaluation.

Measuring the nursing work environment: translation and psychometric evaluation of the Essentials of Magnetism

NARCIS (Netherlands)

Brouwer, B.J.M. de; Kaljouw, M.J.; Kramer, M.; Schmalenberg, C.; Achterberg, T. van

2014-01-01

AIM: Translate the Essentials of Magnetism II(c) (EOMII; Dutch Nurses' Association, Utrecht, The Netherlands) and assess its psychometric properties in a culture different from its origin. BACKGROUND: The EOMII, developed in the USA, measures the extent to which organizations/units provide healthy,

Psychometric Properties and Norms of the German ABC-Community and PAS-ADD Checklist

Science.gov (United States)

Zeilinger, Elisabeth L.; Weber, Germain; Haveman, Meindert J.

2011-01-01

Aim: The aim of the present study was to standardize and generate psychometric evidence of the German language versions of two well-established English language mental health instruments: the "Aberrant Behavior Checklist-Community" (ABC-C) and the "Psychiatric Assessment Schedule for Adults with Developmental Disabilities" (PAS-ADD) Checklist. New…

Examining the Psychometric Properties of the Identify as a Professional Social Worker Subscale

Science.gov (United States)

Farmer, Antoinette Y.

2017-01-01

The purpose of this study was to examine the psychometric properties of the Identify as a Professional Social Worker Subscale, which assessed the Council on Social Work Education--prescribed competency "identify as a professional social worker and conduct oneself accordingly." The results of confirmatory factory analysis indicated that…

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

Science.gov (United States)

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Psychometrics of a new questionnaire to assess glaucoma adherence: the Glaucoma Treatment Compliance Assessment Tool (an American Ophthalmological Society thesis).

Science.gov (United States)

Mansberger, Steven L; Sheppler, Christina R; McClure, Tina M; Vanalstine, Cory L; Swanson, Ingrid L; Stoumbos, Zoey; Lambert, William E

2013-09-01

To report the psychometrics of the Glaucoma Treatment Compliance Assessment Tool (GTCAT), a new questionnaire designed to assess adherence with glaucoma therapy. We developed the questionnaire according to the constructs of the Health Belief Model. We evaluated the questionnaire using data from a cross-sectional study with focus groups (n = 20) and a prospective observational case series (n=58). Principal components analysis provided assessment of construct validity. We repeated the questionnaire after 3 months for test-retest reliability. We evaluated predictive validity using an electronic dosing monitor as an objective measure of adherence. Focus group participants provided 931 statements related to adherence, of which 88.7% (826/931) could be categorized into the constructs of the Health Belief Model. Perceived barriers accounted for 31% (288/931) of statements, cues-to-action 14% (131/931), susceptibility 12% (116/931), benefits 12% (115/931), severity 10% (91/931), and self-efficacy 9% (85/931). The principal components analysis explained 77% of the variance with five components representing Health Belief Model constructs. Reliability analyses showed acceptable Cronbach's alphas (>.70) for four of the seven components (severity, susceptibility, barriers [eye drop administration], and barriers [discomfort]). Predictive validity was high, with several Health Belief Model questions significantly associated (P <.05) with adherence and a correlation coefficient (R (2)) of .40. Test-retest reliability was 90%. The GTCAT shows excellent repeatability, content, construct, and predictive validity for glaucoma adherence. A multisite trial is needed to determine whether the results can be generalized and whether the questionnaire accurately measures the effect of interventions to increase adherence.

Psychometric Properties of the Persian Translation of the Sexual Quality of Life–Male Questionnaire

Science.gov (United States)

Maasoumi, Raziyeh; Mokarami, Hamidreza; Nazifi, Morteza; Stallones, Lorann; Taban, Abrahim; Yazdani Aval, Mohsen; Samimi, Kazem

2016-01-01

Sexual dysfunction has been demonstrated to be related to a poor quality of life. These dysfunctions are especially prevalent among men. This cross-sectional study aimed to investigate the psychometric properties of the Persian translation of the Sexual Quality of Life–Male (SQOL-M), translated and adapted to measure sexual quality of life among Iranian men. Forward–backward procedures were applied in translating the original SQOL-M into Persian, and then the psychometric properties of the Persian translation of the SQOL-M were studied. A total of 181 participants (23-60 years old) were included in the study. Validity was assessed by construct validity using confirmatory factor analysis, convergent validity, and content validity. The international index of erectile function (IIEF) and the work ability index were used to study the convergent validity. Reliability was evaluated through internal consistency and test–retest reliability analyses. The results from confirmatory factor analysis confirmed a one-factor solution for the Persian version of the SQOL-M. Content validity of the translated measure was endorsed by 10 specialists. Pearson correlations indicated that work ability index score, dimensions of the IIEF, and the IIEF total score were positively correlated with the Persian version of the SQOL-M (p Persian version of the SQOL-M has good to excellent psychometric properties and can be used to assess the sexual quality of life among Iranian men. PMID:26856758

Psychometric analyses to improve the Dutch ICF Activity Inventory.

Science.gov (United States)

Bruijning, Janna E; van Rens, Ger; Knol, Dirk; van Nispen, Ruth

2013-08-01

In the past, rehabilitation centers for the visually impaired used unstructured or semistructured methods to assess rehabilitation needs of their patients. Recently, an extensive instrument, the Dutch ICF Activity Inventory (D-AI), was developed to systematically investigate rehabilitation needs of visually impaired adults and to evaluate rehabilitation outcomes. The purpose of this study was to investigate the underlying factor structure and other psychometric properties to shorten and improve the D-AI. The D-AI was administered to 241 visually impaired persons who recently enrolled in a multidisciplinary rehabilitation center. The D-AI uses graded scores to assess the importance and difficulty of 65 rehabilitation goals. For high-priority goals (e.g., daily meal preparation), the difficulty of underlying tasks (e.g., read recipes, cut vegetables) was assessed. To reduce underlying task items (>950), descriptive statistics were investigated and factor analyses were performed for several goals. The internal consistency reliability and test-retest reliability of the D-AI were investigated by calculating Cronbach α and Cohen (weighted) κ. Finally, consensus-based discussions were used to shorten and improve the D-AI. Except for one goal, factor analysis model parameters were at least reasonable. Internal consistency reliability was satisfactory (range, 0.74 to 0.93). In total, 60% of the 65 goal importance items and 84.4% of the goal difficulty items showed moderate to almost perfect κ values (≥0.40). After consensus-based discussions, a new D-AI was produced, containing 48 goals and less than 500 tasks. The analyses were an important step in the validation process of the D-AI and to develop a more feasible assessment tool to investigate rehabilitation needs of visually impaired persons in a systematic way. The D-AI is currently implemented in all Dutch rehabilitation centers serving all visually impaired adults with various rehabilitation needs.

Psychometric assessment of the patient activation measure short form (PAM-13) in rural settings.

Science.gov (United States)

Hung, Man; Carter, Marjorie; Hayden, Candace; Dzierzon, Rhonda; Morales, Jose; Snow, Laverne; Butler, Jorie; Bateman, Kim; Samore, Matthew

2013-04-01

The patient activation measure short form (PAM-13) assesses patients' self-reported health management skills, knowledge, confidence, and motivation. We used item response theory to evaluate the psychometric properties of the PAM-13 utilized in rural settings. A Rasch partial credit model analysis was conducted on the PAM-13 instrument using a sample of 812 rural patients recruited by providers and our research staff. Specially, we examined dimensionality, item fit, and quality of measures, category response curves, and item differential functioning. Convergent and divergent validities were also examined. The PAM-13 instrument has excellent convergent and divergent validities. It is fairly unidimensional, and all items fit the Rasch model well. It has relatively high person and item reliability indices. Majority of the items were free of item differential functioning. There were, however, some issues with ceiling effects. Additionally, there was a lack of responses for category one across all items. Patient activation measure short form (PAM-13) performs well in some areas, but not all. In general, more items need to be added to cover the upper end of the trait. The four response categories of PAM-13 should be collapsed into three.

The extremity function index (EFI), a disability severity measure for neuromuscular diseases : psychometric evaluation

NARCIS (Netherlands)

Bos, Isaac; Wynia, Klaske; Drost, Gea; Almansa, Josué; Kuks, Joannes

2017-01-01

OBJECTIVE: To adapt and to combine the self-report Upper Extremity Functional Index and Lower Extremity Function Scale, for the assessment of disability severity in patients with a neuromuscular disease and to examine its psychometric properties in order to make it suitable for indicating disease

Psychometric evaluation of the ostomy complication severity index.

Science.gov (United States)

Pittman, Joyce; Bakas, Tamilyn; Ellett, Marsha; Sloan, Rebecca; Rawl, Susan M

2014-01-01

reliability and can be used to assess incidence and severity of ostomy complications in the early postoperative period. We found the OCSI to be brief, easy-to-use, and clinically practical. It can be used to (a) identify priority areas for nursing intervention related to the ostomy, (b) determine appropriate interventions to prevent or treat complications, and (c) evaluate the effects of nursing interventions designed to improve outcomes for patients with ostomies.

Why assessment in medical education needs a solid foundation in modern test theory.

Science.gov (United States)

Schauber, Stefan K; Hecht, Martin; Nouns, Zineb M

2018-03-01

Despite the frequent use of state-of-the-art psychometric models in the field of medical education, there is a growing body of literature that questions their usefulness in the assessment of medical competence. Essentially, a number of authors raised doubt about the appropriateness of psychometric models as a guiding framework to secure and refine current approaches to the assessment of medical competence. In addition, an intriguing phenomenon known as case specificity is specific to the controversy on the use of psychometric models for the assessment of medical competence. Broadly speaking, case specificity is the finding of instability of performances across clinical cases, tasks, or problems. As stability of performances is, generally speaking, a central assumption in psychometric models, case specificity may limit their applicability. This has probably fueled critiques of the field of psychometrics with a substantial amount of potential empirical evidence. This article aimed to explain the fundamental ideas employed in psychometric theory, and how they might be problematic in the context of assessing medical competence. We further aimed to show why and how some critiques do not hold for the field of psychometrics as a whole, but rather only for specific psychometric approaches. Hence, we highlight approaches that, from our perspective, seem to offer promising possibilities when applied in the assessment of medical competence. In conclusion, we advocate for a more differentiated view on psychometric models and their usage.

Measuring death-related anxiety in advanced cancer: preliminary psychometrics of the Death and Dying Distress Scale.

Science.gov (United States)

Lo, Christopher; Hales, Sarah; Zimmermann, Camilla; Gagliese, Lucia; Rydall, Anne; Rodin, Gary

2011-10-01

The alleviation of distress associated with death and dying is a central goal of palliative care, despite the lack of routine measurement of this outcome. In this study, we introduce the Death and Dying Distress Scale (DADDS), a new, brief measure we have developed to assess death-related anxiety in advanced cancer and other palliative populations. We describe its preliminary psychometrics based on a sample of 33 patients with advanced or metastatic cancer. The DADDS broadly captures distress about the loss of time and opportunity, the process of death and dying, and its impact on others. The initial version of the scale has a one-factor structure and good internal reliability. Dying and death-related distress was positively associated with depression and negatively associated with spiritual, emotional, physical, and functional well-being, providing early evidence of construct validity. This distress was relatively common, with 45% of the sample scoring in the upper reaches of the scale, suggesting that the DADDS may be a relevant outcome for palliative intervention. We conclude by presenting a revised 15-item version of the scale for further study in advanced cancer and other palliative populations.

A New Clinical Pain Knowledge Test for Nurses: Development and Psychometric Evaluation.

Science.gov (United States)

Bernhofer, Esther I; St Marie, Barbara; Bena, James F

2017-08-01

All nurses care for patients with pain, and pain management knowledge and attitude surveys for nurses have been around since 1987. However, no validated knowledge test exists to measure postlicensure clinicians' knowledge of the core competencies of pain management in current complex patient populations. To develop and test the psychometric properties of an instrument designed to measure pain management knowledge of postlicensure nurses. Psychometric instrument validation. Four large Midwestern U.S. hospitals. Registered nurses employed full time and part time August 2015 to April 2016, aged M = 43.25 years; time as RN, M = 16.13 years. Prospective survey design using e-mail to invite nurses to take an electronic multiple choice pain knowledge test. Content validity of initial 36-item test "very good" (95.1% agreement). Completed tests that met analysis criteria, N = 747. Mean initial test score, 69.4% correct (range 27.8-97.2). After revision/removal of 13 unacceptable questions, mean test score was 50.4% correct (range 8.7-82.6). Initial test item percent difficulty range was 15.2%-98.1%; discrimination values range, 0.03-0.50; final test item percent difficulty range, 17.6%-91.1%, discrimination values range, -0.04 to 1.04. Split-half reliability final test was 0.66. A high decision consistency reliability was identified, with test cut-score of 75%. The final 23-item Clinical Pain Knowledge Test has acceptable discrimination, difficulty, decision consistency, reliability, and validity in the general clinical inpatient nurse population. This instrument will be useful in assessing pain management knowledge of clinical nurses to determine gaps in education, evaluate knowledge after pain management education, and measure research outcomes. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Psychometric Properties of the Psychological Needs Satisfaction Frustration Scale (BPNSFS in Chilean University Students

Directory of Open Access Journals (Sweden)

Milenko Del Valle

2018-01-01

Full Text Available This research work aims to analyze the psychometric properties of the Basic Psychological Needs Satisfaction and Frustration Scale (BPNSFS -autonomy, competence and relatedness- identified by the self-determination theory (Deci & Ryan, 2000b, in a sample of 297 university students from different faculties and programs belonging to a Chilean university. To achieve the objective, through a psychometric study by confirmatory procedures, a confirmatory factor analysis (CFA was performed, analyzing the six-factor proposal developed by Chen et al. (2015, and the internal consistency of the scale was evaluated using the ordinal Alpha. The outcomes obtained from the sample of university students indicate a good internal consistency, Alpha = 0.90 and 0.86 for psychological needs satisfaction and frustration. Besides, the outcomes of the confirmatory factor analysis showed an adequate fit of the model (χ²/gl = 1.75; CFI = 0.92; IFI = 0.92; TLI = 0.90; RMSEA = .05 and SRMR =.05 to the data, showing evidences of the validity of the six-factor structure proposed. According to the foregoing, it is considered that the scale to measure satisfaction and frustration of the three basic psychological needs can be used initially in university students in the higher education of Chile, thus, allowing the relationship with other variables of interest to generate explanatory models that allow going in depth the understanding of aspects that are of institutional interest.

Health-related quality of life of cataract patients: cross-cultural comparisons of utility and psychometric measures.

Science.gov (United States)

Lee, Jae Eun; Fos, Peter J; Zuniga, Miguel A; Kastl, Peter R; Sung, Jung Hye

2003-07-01

This study was conducted to assess the presence and/or absence of cross-cultural differences or similarities between Korean and United States cataract patients. A systematic assessment was performed using utility and psychometric measures in the study population. A cross-sectional study design was used to examine the comparison of preoperative outcomes measures in cataract patients in Korea and the United States. Study subjects were selected using non-probabilistic methods and included 132 patients scheduled for cataract surgery in one eye. Subjects were adult cataract patients at Samsung and Kunyang General Hospital in Seoul, Korea, and Tulane University Hospital and Clinics in New Orleans, Louisiana. Preoperative utility was assessed using the verbal rating scale and standard reference gamble techniques. Current preoperative health status was assessed using the SF-36 and VF-14 surveys. Current preoperative Snellen visual acuity was used as a clinical measure of vision status. Korean patients were more likely to be younger (p = 0.001), less educated (p = 0.001), and to have worse Snellen visual acuity (p = 0.002) than United States patients. Multivariate analysis of variance (MANOVA) revealed that in contrast to Korean patients, United States patients were assessed to have higher scoring in general health, vitality, VF-14, and verbal rating for visual health. This higher scoring trend persisted after controlling for age, gender, education and Snellen visual acuity. The difference in health-related quality of life (HRQOL) between the two countries was quite clear, especially in the older age and highly educated group. Subjects in Korea and the United States were significantly different in quality of life, functional status and clinical outcomes. Subjects in the United States had more favorable health outcomes than those in Korea. These differences may be caused by multiple factors, including country-specific differences in economic status, health care system

The assessment of fatigue: Psychometric qualities and norms for the Checklist individual strength.

Science.gov (United States)

Worm-Smeitink, M; Gielissen, M; Bloot, L; van Laarhoven, H W M; van Engelen, B G M; van Riel, P; Bleijenberg, G; Nikolaus, S; Knoop, H

2017-07-01

The Checklist Individual Strength (CIS) measures four dimensions of fatigue: Fatigue severity, concentration problems, reduced motivation and activity. On the fatigue severity subscale, a cut-off score of 35 is used. This study 1) investigated the psychometric qualities of the CIS; 2) validated the cut-off score for severe fatigue and 3) provided norms. Representatives of the Dutch general population (n=2288) completed the CIS. The factor structure was investigated using an exploratory factor analysis. Internal consistency and test-retest reliability were determined. Concurrent validity was assessed in two additional samples by correlating the CIS with other fatigue scales (Chalder Fatigue Questionnaire, MOS Short form-36 Vitality subscale, EORTC QLQ-C30 fatigue subscale). To validate the fatigue severity cut-off score, a Receiver Operating Characteristics analysis was performed with patients referred to a chronic fatigue treatment centre (n=5243) and a healthy group (n=1906). Norm scores for CIS subscales were calculated for the general population, patients with chronic fatigue syndrome (CFS; n=1407) and eight groups with other medical conditions (n=1411). The original four-factor structure of the CIS was replicated. Internal consistency (α=0.84-0.95) and test-retest reliability (r=0.74-0.86) of the subscales were high. Correlations with other fatigue scales were moderate to high. The 35 points cut-off score for severe fatigue is appropriate, but, given the 17% false positive rate, should be adjusted to 40 for research in CFS. The CIS is a valid and reliable tool for the assessment of fatigue, with a validated cut-off score for severe fatigue that can be used in clinical practice. Copyright © 2017. Published by Elsevier Inc.

Health-related quality of life questionnaire for polycystic ovary syndrome (PCOSQ-50): development and psychometric properties.

Science.gov (United States)

Nasiri-Amiri, Fatemeh; Ramezani Tehrani, Fahimeh; Simbar, Masoumeh; Montazeri, Ali; Mohammadpour, Reza Ali

2016-07-01

The determinants of the health-related quality of life of women with polycystic ovary syndrome are not fully understood. The aim of this study was to develop a comprehensive instrument to assess the health-related quality of life of Iranian women with PCOS and to assess its psychometric properties. We used a mixed-method, sequential, exploratory design including both qualitative [in-depth interview to define the components of health-related quality of life questionnaire (PCOSQ)] and quantitative approaches (to assess the psychometric properties of PCOSQ). A preliminary questionnaire was developed including 147 items which emerged from the qualitative phase of the study. Considering the optimum cutoff points for content validity ratio (CVR), content validity index (CVI), and impact score, items of the preliminary questionnaire were reduced from 147 to 88 items. Finally, by excluding highly correlated items using the exploratory factor analysis, a 50-item questionnaire was obtained. The Kaiser criteria (eigenvalues >1) and Scree plot tests demonstrated that six factors were optimum with an estimated 47.3 % of variance. Assessment of the psychometric properties of the questionnaire demonstrated a mean CVI = 0.92, CVR = 0.91, Cronbach's alpha for whole questionnaire = 0.88 (0.61-0.88 for subscales), Spearman's correlation coefficients of test-retest = 0.75, and the intra-class correlation coefficient for the PCOS questionnaire subscales ranging from 0.57 to 0.88. Eventually the final questionnaire included 50 items in six domains, 'psychosocial and emotional,' 'fertility,' 'sexual function,' 'obesity and menstrual disorders,' 'hirsutism,' and 'coping' and rated on a 5-point Likert scale. The PCOSQ-50 is a valid and reliable instrument for the assessment of quality of life of women with PCOS, capable of assessing some obscure aspects overlooked by previous HRQL questionnaires.

Psychometric testing of inventory of beliefs and attitudes on domestic violence.

Science.gov (United States)

Hutchinson, Marie; Doran, Frances

2017-06-22

Background Domestic violence (DV) is an international public health issue associated with adverse health outcomes for adults and children. There have been widespread calls to increase nurses' capacity to respond to DV and improve undergraduate nursing education in this area. However, there are few valid, reliable and contemporary measures of nursing attitudes towards and beliefs concerning DV that are suited for use in evaluating education programmes. Aim To establish the psychometric properties of a newly developed inventory designed to measure nursing students' beliefs about and attitudes towards DV. Discussion Exploratory factor analysis identified five factors, with a Cronbach's alpha of 0.646. The few factors loading>.80 suggest that the instrument has good discriminate validity. The absence of cross-loadings indicate good convergent validity. Conclusion The inventory provides one of the first validated and reliable measures for examining undergraduate nursing students' attitudes towards and beliefs about DV. Implications for practice The instrument is suited for use by nurse educators in assessing the influence of curriculum design and teaching strategies on student beliefs and attitudes. It would also be useful in studies investigating nurses' clinical practice on domestic violence.

Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review.

Science.gov (United States)

Jelovsek, J Eric; Kow, Nathan; Diwadkar, Gouri B

2013-07-01

The Accreditation Council for Graduate Medical Education (ACGME) Milestone Project mandates programmes to assess the attainment of training outcomes, including the psychomotor (surgical or procedural) skills of medical trainees. The objectives of this study were to determine which tools exist to directly assess psychomotor skills in medical trainees on live patients and to identify the data indicating their psychometric and edumetric properties. An electronic search was conducted for papers published from January 1948 to May 2011 using the PubMed, Education Resource Information Center (ERIC), Cumulative Index to Nursing and Allied Health Literature (CINAHL) and Web of Science electronic databases and the review of references in article bibliographies. A study was included if it described a tool or instrument designed for the direct observation of psychomotor skills in patient care settings by supervisors. Studies were excluded if they referred to tools that assessed only clinical or non-technical skills, involved non-medical health professionals, or assessed skills performed on a simulator. Overall, 4114 citations were screened, 168 (4.1%) articles were reviewed for eligibility and 51 (1.2%) manuscripts were identified as meeting the study inclusion criteria. Three authors abstracted and reviewed studies using a standardised form for the presence of key psychometric and edumetric elements as per ACGME and American Psychological Association (APA) recommendations, and also assigned an overall grade based on the ACGME Committee on Educational Outcome Assessment grading system. A total of 30 tools were identified. Construct validity based on associations between scores and training level was identified in 24 tools, internal consistency in 14, test-retest reliability in five and inter-rater reliability in 20. The modification of attitudes, knowledge or skills was reported using five tools. The seven-item Global Rating Scale and the Procedure-Based Assessment received an

Psychometric Evaluation of the Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF).

Science.gov (United States)

Gelhorn, Heather L; Roberts, Laurie J; Khandelwal, Nikhil; Revicki, Dennis A; DeRogatis, Leonard R; Dobs, Adrian; Hepp, Zsolt; Miller, Michael G

2017-08-01

The Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF) is a patient-reported outcome measurement designed to evaluate the symptoms of hypogonadism. The HIS-Q-SF is an abbreviated version including17 items from the original 28-item HIS-Q. To conduct item analyses and reduction, evaluate the psychometric properties of the HIS-Q-SF, and provide guidance on score interpretation. A 12-week observational longitudinal study of hypogonadal men was conducted as part of the original HIS-Q psychometric evaluation. Participants completed the original HIS-Q every 2 weeks. Blood samples were collected to evaluate testosterone levels. Participants completed the Aging Male's Symptoms Scale, the International Index of Erectile Function, the Short Form-12, and the PROMIS Sexual Activity, Satisfaction with Sex Life, Sleep Disturbance, and Applied Cognition Scales (baseline and weeks 6 and 12). Clinicians completed the Clinical Global Impression of Severity and Change scales and a clinical form. Item performance was evaluated using descriptive statistics and Rasch analyses. Reliability (internal consistency and test-retest), validity (concurrent and know groups), and responsiveness were assessed. One hundred seventy-seven men participated (mean age = 54.1 years, range = 23-83). Similar to the full HIS-Q, the final abbreviated HIS-Q-SF instrument includes five domains (sexual, energy, sleep, cognition, and mood) with two sexual subdomains (libido and sexual function). For key domains, test-retest reliability was very good, and construct validity was good for all domains. Known-groups validity was demonstrated for all domain scores, subdomain scores, and total score based on the Clinical Global Impression-Severity. All domains and subdomains were responsive to change based on patient-rated anchor questions. The HIS-Q-SF could be a useful tool in clinical practice, epidemiologic studies, and other academic research settings. Careful consideration was given to the

Judging the Neonatal Abstinence Syndrome Assessment Tools to Guide Future Tool Development: The use of Clinimetrics as Opposed to Psychometrics

Directory of Open Access Journals (Sweden)

Philip M. Westgate

2017-09-01

Full Text Available In the face of the current Neonatal Abstinence Syndrome (NAS epidemic, there is considerable variability in the assessment and management of infants with NAS. In this manuscript, we particularly focus on NAS assessment, with special attention given to the popular Finnegan Neonatal Abstinence Score (FNAS. A major instigator of the problem of variable practices is that multiple modified versions of the FNAS exist and continue to be proposed, including shortened versions. Furthermore, the validity of such assessment tools has been questioned, and as a result, the need for better tools has been suggested. The ultimate purpose of this manuscript, therefore, is to increase researchers’ and clinicians’ understanding on how to judge the usefulness of NAS assessment tools in order to guide future tool development and to reduce variable practices. In short, we suggest that judgment of NAS assessment tools should be made on a clinimetrics viewpoint as opposed to psychometrically. We provide examples, address multiple issues that must be considered, and discuss future tool development. Furthermore, we urge researchers and clinicians to come together, utilizing their knowledge and experience, to assess the utility and practicality of existing assessment tools and to determine if one or more new or modified tools are needed with the goal of increased agreement on the assessment of NAS in practice.

Review of the Psychometric Evidence of the Perceived Stress Scale

Directory of Open Access Journals (Sweden)

Eun-Hyun Lee, RN, PhD

2012-12-01

Conclusion: Overall, the PSS is an easy-to-use questionnaire with established acceptable psychometric properties. However, future studies should evaluate these psychometric properties in greater depth, and validate the scale using diverse populations.

Psychometric assessment of the Behavior and Attitudes Questionnaire for Healthy Habits: measuring parents' views on food and physical activity.

Science.gov (United States)

Henry, Beverly W; Smith, Thomas J; Ahmad, Saadia

2014-05-01

To assess parents' perspectives of their home environments to establish the validity of scores from the Behavior and Attitudes Questionnaire for Healthy Habits (BAQ-HH). In the present descriptive study, we surveyed a cross-sectional sample of parents of pre-school children. Questionnaire items developed in an iterative process with community-based programming addressed parents' knowledge/awareness, attitudes/concerns and behaviours about healthy foods and physical activity habits with 6-point rating scales. Exploratory and confirmatory factor analyses were used to psychometrically evaluate scores from the scales. English and Spanish versions of the BAQ-HH were administered at parent-teacher conferences for pre-school children at ten Head Start centres across a five-county agency in autumn 2010. From 672 families with pre-school children, 532 parents provided responses to the BAQ-HH (79 % response rate). The majority was female (83 %), Hispanic (66 %) or white (16 %), and ages ranged from 20 to 39 years (85 %). Exploratory and confirmatory analyses revealed a knowledge scale (seven items), an attitude scale (four items) and three behaviour subscales (three items each). Correlations were identified between parents' perceptions of home activities and reports of children's habits. Differences were identified by gender and ethnicity groupings. As a first step in psychometric testing, the dimensionality of each of the three scales (Knowledge, Attitudes and Behaviours) was identified and scale scores were related to other indicators of child behaviours and parents' demographic characteristics. This questionnaire offers a method to measure parents' views to inform planning and monitoring of obesity-prevention education programmes.

Current psychometric and methodological issues in the measurement of overgeneral autobiographical memory.

Science.gov (United States)

Griffith, James W; Sumner, Jennifer A; Raes, Filip; Barnhofer, Thorsten; Debeer, Elise; Hermans, Dirk

2012-12-01

Autobiographical memory is a multifaceted construct that is related to psychopathology and other difficulties in functioning. Across many studies, a variety of methods have been used to study autobiographical memory. The relationship between overgeneral autobiographical memory (OGM) and psychopathology has been of particular interest, and many studies of this cognitive phenomenon rely on the Autobiographical Memory Test (AMT) to assess it. In this paper, we examine several methodological approaches to studying autobiographical memory, and focus primarily on methodological and psychometric considerations in OGM research. We pay particular attention to what is known about the reliability, validity, and methodological variations of the AMT. The AMT has adequate psychometric properties, but there is great variability in methodology across studies that use it. Methodological recommendations and suggestions for future studies are presented. Copyright © 2011 Elsevier Ltd. All rights reserved.

Assessment of patient empowerment--a systematic review of measures.

Directory of Open Access Journals (Sweden)

Paul J Barr

Full Text Available Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified.Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee's 2007 criteria.30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4 or specialty (N=9. Most studies tested measures in English (N=17 or Swedish (N=6. Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures.Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a

Assessing the psychometric and ecometric properties of neighborhood scales using adolescent survey data from urban and rural Scotland.

Science.gov (United States)

Martin, Gina; Inchley, Joanna; Humphris, Gerry; Currie, Candace

2017-03-28

Despite the well-established need for specific measurement instruments to examine the relationship between neighborhood conditions and adolescent well-being outcomes, few studies have developed scales to measure features of the neighborhoods in which adolescents reside. Moreover, measures of neighborhood features may be operationalised differently by adolescents living in different levels of urban/rurality. This has not been addressed in previous studies. The objectives of this study were to: 1) establish instruments to measure adolescent neighborhood features at both the individual and neighborhood level, 2) assess their psychometric and ecometric properties, 3) test for invariance by urban/rurality, and 4) generate neighborhood level scores for use in further analysis. Data were from the Scottish 2010 Health Behaviour in School-aged Children Survey, which included an over-sample of rural adolescents. The survey responses of interest came from questions designed to capture different facets of the local area in which each respondent resided. Intermediate data zones were used as proxies for neighborhoods. Internal consistency was evaluated by Cronbach's alpha. Invariance was examined using confirmatory factor analysis. Multilevel models were used to estimate ecometric properties and generate neighborhood scores. Two constructs labeled neighborhood social cohesion and neighborhood disorder were identified. Adjustment was made to the originally specified model to improve model fit and measures of invariance. At the individual level, reliability was .760 for social cohesion and .765 for disorder, and between .524 and .571 for both constructs at the neighborhood level. Individuals in rural areas experienced greater neighborhood social cohesion and lower levels of neighborhood disorder compared with those in urban areas. The scales are appropriate for measuring neighborhood characteristics experienced by adolescents across urban and rural Scotland, and can be used in

Psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth.

Science.gov (United States)

Goossens, Joline; Verhaeghe, Sofie; Van Hecke, Ann; Barrett, Geraldine; Delbaere, Ilse; Beeckman, Dimitri

2018-01-01

To evaluate the psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth. A two-phase psychometric evaluation design was set-up. Phase I comprised the translation from English into Dutch and pretesting with 6 women using cognitive interviews. In phase II, the reliability and validity of the Dutch version of the LMUP was assessed in 517 women giving birth recently. Reliability (internal consistency) was assessed using Cronbach's alpha, inter-item correlations, and corrected item-total correlations. Construct validity was assessed using principal components analysis and hypothesis testing. Exploratory Mokken scale analysis was carried out. 517 women aged 15-45 completed the Dutch version of the LMUP. Reliability testing showed acceptable internal consistency (alpha = 0.74, positive inter-item correlations between all items, all corrected item-total correlations >0.20). Validity testing confirmed the unidimensional structure of the scale and all hypotheses were confirmed. The overall Loevinger's H coefficient was 0.57, representing a 'strong' scale. The Dutch version of the LMUP is a reliable and valid measure that can be used in the Dutch-speaking population in Belgium to assess pregnancy planning. Future research is necessary to assess the stability of the Dutch version of the LMUP, and to evaluate its psychometric properties in women with abortions.

Caregiving in severe mental illness: the psychometric properties of the Involvement Evaluation Questionnaire in Portugal

NARCIS (Netherlands)

Goncalves-Pereira, Manuel; van Wijngaarden, Bob; Xavier, Miguel; Papoila, Ana L.; Caldas-de-Almeida, Jose M.; Schene, Aart H.

2012-01-01

Background: Despite the achievements of previous research, caregiving assessments in severe mental illness should be crossculturally validated in order to define risk groups or to evaluate family work. This study reports on the psychometric properties of the European version of the Involvement

Outcomes assessment in rotator cuff pathology: what are we measuring?

Science.gov (United States)

Makhni, Eric C; Steinhaus, Michael E; Morrow, Zachary S; Jobin, Charles M; Verma, Nikhil N; Cole, Brian J; Bach, Bernard R

2015-12-01

Assessments used to measure outcomes associated with rotator cuff pathology and after repair are varied. This lack of standardization leads to difficulty drawing comparisons across studies. We hypothesize that this variability in patient-reported outcome measures and objective metrics used in rotator cuff studies persists even in high-impact, peer reviewed journals. All studies assessing rotator cuff tear and repair outcomes in 6 orthopedic journals with a high impact factor from January 2010 to December 2014 were reviewed. Cadaveric and animal studies and those without outcomes were excluded. Outcome measures included range of motion (forward elevation, abduction, external rotation, and internal rotation), strength (in the same 4 planes), tendon integrity imaging, patient satisfaction, and functional assessment scores. Of the 156 included studies, 63% documented range of motion measurements, with 18% reporting range of motion in all 4 planes. Only 38% of studies reported quantitative strength measurements. In 65% of studies, tendon integrity was documented with imaging (38% magnetic resonance imaging/magnetic resonance anrhrogram, 31% ultrasound, and 8% computed tomography arthrogram). Finally, functional score reporting varied significantly, with the 5 most frequently reported scores ranging from 16% to 61% in studies, and 15 of the least reported outcomes were each reported in ≤6% of studies. Significant variability exists in outcomes reporting after rotator cuff tear and repair, making comparisons between clinical studies difficult. Creating a uniformly accepted, validated outcomes tool that assesses pain, function, patient satisfaction, and anatomic integrity would enable consistent outcomes assessment after operative and nonoperative management and allow comparisons across the literature. Copyright © 2015 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

Development and psychometric properties of an informant assessment scale of theory of mind for adults with traumatic brain injury.

Science.gov (United States)

Zhang, Dengke; Pang, Yanxia; Cai, Weixiong; Fazio, Rachel L; Ge, Jianrong; Su, Qiaorong; Xu, Shuiqin; Pan, Yinan; Chen, Sanmei; Zhang, Hongwei

2016-08-01

Impairment of theory of mind (ToM) is a common phenomenon following traumatic brain injury (TBI) that has clear effects on patients' social functioning. A growing body of research has focused on this area, and several methods have been developed to assess ToM deficiency. Although an informant assessment scale would be useful for examining individuals with TBI, very few studies have adopted this approach. The purpose of the present study was to develop an informant assessment scale of ToM for adults with traumatic brain injury (IASToM-aTBI) and to test its reliability and validity with 196 adults with TBI and 80 normal adults. A 44-item scale was developed following a literature review, interviews with patient informants, consultations with experts, item analysis, and exploratory factor analysis (EFA). The following three common factors were extracted: social interaction, understanding of beliefs, and understanding of emotions. The psychometric analyses indicate that the scale has good internal consistency reliability, split-half reliability, test-retest reliability, inter-rater reliability, structural validity, discriminate validity and criterion validity. These results provide preliminary evidence that supports the reliability and validity of the IASToM-aTBI as a ToM assessment tool for adults with TBI.

A Perspective on Student Learning Outcome Assessment at Qatar University

Science.gov (United States)

Al-Thani, Shaikha Jabor; Abdelmoneim, Ali; Daoud, Khaled; Cherif, Adel; Moukarzel, Dalal

2014-01-01

This paper provides a unique perspective on the student learning outcome assessment process as adopted and implemented at Qatar University from 2006 to 2012. The progress of the student learning outcome assessment and continuous improvement efforts at the university and the initiatives taken to establish a culture of assessment and evidence-based…

Development and psychometric evaluation of the arterial puncture self-efficacy scale.

Science.gov (United States)

Hernández-Padilla, José Manuel; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; Fernández-Sola, Cayetano

2016-05-01

Arterial puncture for arterial blood gases (ABG) analysis can be a risky, painful, difficult-to-perform procedure that is often insufficiently practised and generates stress and discomfort amongst patients and healthcare professionals. Self-efficacy is a key component in the acquisition of procedural skills. Therefore, professionals' self-efficacy in arterial puncture should be measured before attempting the procedure on real patients. To develop and psychometrically assess a self-efficacy scale in arterial puncture. An observational cross-sectional design was used in this study. Faculty of Education Sciences, Nursing and Physiotherapy in a higher education institution in the south of Spain. A convenience sample of 342 nursing students entered and completed the study. All participants met the following inclusion criteria: (1) ≥18years old and (2) enrolled in a nursing degree programme during the 2014/2015 academic year. Participants were 74% female (n=254) and their age ranged from 18 to 50, with a mean age of 21.74years (SD=5.14). The Arterial Puncture Self-Efficacy Scale (APSES) was developed and psychometrically tested. Reliability and content validity were studied. Predictive validity and concurrent validity assessed criterion validity. In addition, principal component analysis and known-group analysis evaluated construct validity. Principal component analysis revealed the two-subscale structure of the final 22-item version of the Arterial Puncture Self-Efficacy Scale (APSES). A total Cronbach's alpha coefficient of 0.97 showed its high reliability. The APSES' content validity index was excellent (S-CVI/Ave=0.95). Predictive and concurrent validity analysis demonstrated the good criterion validity of the tool. Supporting the APSES' sensitivity and specificity, known-groups analysis evidenced significant differences (pgood psychometric properties for measuring self-efficacy in arterial puncture for ABG analysis. Copyright © 2016 Elsevier Ltd. All rights

Assessment of the psychometric properties of the Short-Form Prolapse/Urinary Incontinence Sexual Questionnaire (PISQ-12) following surgical placement of Prolift+M: a transvaginal partially absorbable mesh system for the treatment of pelvic organ prolapse.

Science.gov (United States)

Roy, Sanjoy; Mohandas, Anita; Coyne, Karin; Gelhorn, Heather; Gauld, Judi; Sikirica, Vanja; Milani, Alfredo L

2012-04-01

Impairment of sexual function is a significant problem among women suffering from pelvic organ prolapse (POP). Because anatomical measures of POP do not always correspond with patients' subjective reports of their condition, patient-reported outcome measures may provide additional valuable information regarding the experiences of women who have undergone surgery. The Pelvic Organ Prolapse/Urinary Incontinence Sexual Questionnaire (PISQ-12) is a validated, widely used condition-specific questionnaire focused on sexual function among patients with POP or urinary incontinence. This study aims to report sexual function outcomes as measured by PISQ-12 and to evaluate the psychometric characteristics of the questionnaire following surgical mesh implant for the treatment of POP. The PISQ-12 was used to measure sexual function, while a set of other measures, namely, Pelvic Organ Prolapse Quantification, Patient Global Impression of Change, Pelvic Floor Distress Inventory, Pelvic Floor Impact Questionnaire, and Surgical Satisfaction Questionnaire, was used for validation. Data for the study were collected from a prospective multicenter, single-arm study of surgical POP repair via the transvaginal placement of a partially absorbable mesh system. For baseline, month 3, and month 12 following POP surgery, several psychometric properties of the PISQ-12 were evaluated, including internal consistency (Cronbach's alpha), concurrent validity, discriminant validity, and responsiveness. As measured by the PISQ-12 questionnaire, statistically significant improvements were observed in the composite summary score as well as all three subscale scores at 1 year. The PISQ-12 generally demonstrated good psychometric properties including internal consistency reliability, validity, and responsiveness. The PISQ-12 items had good distributional properties at baseline, with substantial ceiling effects at follow-up visits reflecting improvements experienced by the patients. The PISQ-12 is a valid

The new Intragroup Conflict Scale: testing and psychometric properties.

Science.gov (United States)

Cox, Kathleen B

2014-01-01

The importance of healthy work environments has received attention. Health care organizations are plagued with conflict which is detrimental to work environments. Thus, conflict must be studied. The purpose of this article is to describe the testing of a measure of conflict. A survey was used to evaluate the psychometric properties. The sample consisted of 430 nurses at an academic medical center. Using principal component analysis (PCA) with varimax rotation, a six-factor solution (30 items) that explained 74.3% of variance emerged. Coefficient alpha ranged from .95 to .81. Correlations with existing scales supported construct validity (r = -.32(-)-.58). The results are encouraging. Use of the scale may provide insight into the impact of conflict on patient, staff, and organizational outcomes.

Psychometric properties of the Greek Diabetes Treatment Satisfaction Questionnaire

Directory of Open Access Journals (Sweden)

Kontodimopoulos Nick

2012-02-01

Full Text Available Abstract Objectives Measurement of treatment satisfaction in diabetes is important as it has been shown to be associated with positive outcomes, reduced disease cost and better health. The aim of this study was to assess the construct validity and internal consistency reliability of the Greek version of the Diabetes Treatment Satisfaction Questionnaire (DTSQ. Methods A sample of type II diabetes patients (N = 172 completed the DTSQ status version, the SF-36 health survey and also provided data regarding treatment method, clinical and socio-demographic status. Instrument structure, reliability (Cronbach's a and construct validity (convergent, discriminative, concurrent and known-groups were assessed. Results The DTSQ measurement properties were confirmed in the Greek version with confirmatory factor analysis (CFA. Scale reliability was high (Cronbach's a = 0.92. Item-scale internal consistency and discriminant validity were also good, exceeding the designated success criteria. Significant correlations were observed between DTSQ items/overall score and SF-36 scales/component scores, which were hypothesized to measure similar dimensions. Known groups' comparisons yielded consistent support of the construct validity of the instrument. Conclusions The instrument was well-accepted by the patients and its psychometric properties were similar to those reported in validation studies of other language versions. Further research, incorporating a longitudinal study design, is required for examining test-retest reliability and responsiveness of the instrument, which were not addressed in this study. Overall, the present results confirm that the DTSQ status version is a reasonable choice for measuring diabetes treatment satisfaction in Greece.

[Assessment of Work Engagement in Patients with Hematological Malignancies: Psychometric Properties of the German Version of the Utrecht Work Engagement Scale 9 (UWES-9)].

Science.gov (United States)

Sautier, L P; Scherwath, A; Weis, J; Sarkar, S; Bosbach, M; Schendel, M; Ladehoff, N; Koch, U; Mehnert, A

2015-10-01

Our purpose was the psychometric evaluation of the German version of the Utrecht Work Engagement Scale-9 (UWES-9), a self-assessment tool measuring work-related resources consisting of 9 items. Based on a sample of 179 patients with hematological malignancies in in-patient and rehabilitative oncological settings, we tested the dimensional structure by confirmatory and explorative factor analysis. We further evaluated reliability, item characteristics, and construct validity of the UWES-9. The confirmatory factor analysis showed acceptable fit for both a 1-dimensional factor structure and the original 3-factor model. Based on an explorative principal component analysis, we were able to replicate the 1-dimensional factor accounting for 67% of the total variance and showing very high internal consistency (α=0.94) and high factor loads (0.73-0.88). The construct validity was further supported by significant positive correlations between work engagement and meaning of work, corporate feeling, commitment to the workplace, and job satisfaction. The German version of the UWES-9 shows good psychometric qualities in measuring dedication to work in patients with hematological malignancies in in-patient and rehabilitative oncological settings. © Georg Thieme Verlag KG Stuttgart · New York.

The UK Functional Assessment Measure (UK FIM+FAM: Psychometric Evaluation in Patients Undergoing Specialist Rehabilitation following a Stroke from the National UK Clinical Dataset.

Directory of Open Access Journals (Sweden)

Meenakshi Nayar

Full Text Available The UK Functional Assessment Measure (UKFIM+FAM is the principal outcome measure for the UK Rehabilitation Outcomes Collaborative (UKROC national database for specialist rehabilitation. Previously validated in a mixed neurorehabilitation cohort, this study is the first to explore its psychometric properties in a stroke population, and compare left and right hemispheric strokes (LHS vs RHS. We analysed in-patient episode data from 62 specialist rehabilitation units collated through the UKROC database 2010-2013. Complete data were analysed for 1,539 stroke patients (LHS: 588, RHS: 566 with clear localisation. For factor analysis, admission and discharge data were pooled and randomised into two equivalent samples; the first for exploratory factor analysis (EFA using principal components analysis, and the second for confirmatory factor analysis (CFA. Responsiveness for each subject (change from admission to discharge was examined using paired t-tests and differences between LHS and RHS for the entire group were examined using non-paired t-tests. EFA showed a strong general factor accounting for >48% of the total variance. A three-factor solution comprising motor, communication and psychosocial subscales, accounting for >69% total variance, provided acceptable fit statistics on CFA (Root Mean Square Error of Approximation was 0.08 and Comparative Fit Index/ Tucker Lewis Index 0.922/0.907. All three subscales showed significant improvement between admission and discharge (p0.5. Total scores between LHS and RHS were not significantly different. However, LHS showed significantly higher motor scores (Mean 5.7, 95%CI 2.7, 8.6 p<0.001, while LHS had significantly lower cognitive scores, primarily in the communication domain (-6.8 95%CI -7.7, -5.8 p<0.001. To conclude, the UK FIM+FAM has a three-factor structure in stroke, similar to the general neurorehabilitation population. It is responsive to change during in-patient rehabilitation, and distinguishes

Psychometric properties of a culture-adapted Spanish version of AIDA (Assessment of Identity Development in Adolescence) in Mexico.

Science.gov (United States)

Kassin, Moises; De Castro, Filipa; Arango, Ivan; Goth, Kirstin

2013-01-01

The construct "identity" was discussed to be integrated as an important criterion for diagnosing personality disorders in DSM-5. According to Kernberg, identity diffusion is one of the relevant underlying structures in terms of personality organization for developing psychopathology, especially borderline personality disorder. Therefore, it would be important to differentiate healthy from pathological development already in adolescence. With the questionnaire termed AIDA (Assessment of Identity Development in Adolescence), a reliable and valid self-rating inventory was introduced by Goth, Foelsch, Schlueter-Mueller, & Schmeck (2012) to assess pathology-related identity development in healthy and disturbed adolescents. To test the usefulness of the questionnaire in Mexico, we contributed to the development of a culture-specific Spanish translation of AIDA and tested the reliability and aspects of validity of the questionnaire in a juvenile Mexican sample. An adapted Spanish translation of AIDA was developed by an expert panel from Chile, Mexico, and Spain in cooperation with the original authors, focusing on content equivalence and comprehensibility by considering specific idioms, life circumstances, and culture-specific aspects. The psychometric properties of the Spanish version were first tested in Mexico. Participants were 265 students from a state school (N = 110) and private school (N = 155), aged between 12 and 19 years (mean 14.15 years). Of these, 44.9% were boys and 55.1% were girls. Item characteristics were analyzed by several parameters, scale reliability by Cronbach's Alpha, and systematic effects of gender, age, and socioeconomics by an analysis of variance (ANOVA). We evaluated aspects of criterion validity in a juvenile justice system sample (N = 41) of adolescent boys in conflict with the law who displayed various types of behavioral problems by comparing the AIDA scores of a subgroup with signs for borderline pathology (N = 14

Quality of Life Assessment for Physical Activity and Health Promotion: Further Psychometrics and Comparison of Measures

Science.gov (United States)

Gill, Diane L.; Reifsteck, Erin J.; Adams, Melanie M.; Shang, Ya-Ting

2015-01-01

Despite the clear relationship between physical activity and quality of life, few sound, relevant quality of life measures exist. Gill and colleagues developed a 32-item quality of life survey, and provided initial psychometric evidence. This study further examined that quality of life survey in comparison with the widely used short form (SF-36)…

Challenges in assessing depressive symptoms in Fiji: A psychometric evaluation of the CES-D.

Science.gov (United States)

Opoliner, April; Blacker, Deborah; Fitzmaurice, Garrett; Becker, Anne

2014-06-01

The CES-D is a commonly used self-report assessment for depressive symptomatology. However, its psychometric properties have not been evaluated in Fiji. This study aims to evaluate the reliability and validity of English language and Fijian vernacular versions in ethnic Fijian adolescent schoolgirls. As part of the HEALTHY Fiji study, ethnic Fijian female adolescents (N = 523) completed the CES-D. Participants selected to respond in English or the local vernacular. Reliability (internal consistency, item-total score correlation, and test-retest estimates), validity (associations with other proxies for depression) and factor structure were assessed. Evaluations considered differences between language versions. In this sample, the CES-D had a Cronbach's α of 0.81 and item-total score correlation coefficients ranged between 0.2 and 0.63. One week test-retest reliability (ICC(2)) was 0.57. CES-D scores were higher among individuals who endorsed feelings of depression and suicidality compared to those who did not. ROC analyses of the CES-D versus binary depression and suicidality variables produced AUCs around 0.70 and did not support a discrete cut-off for significant disturbance. Findings were similar across the two language groups. The CES-D has acceptable reliability and validity among ethnic Fijian female adolescents in English and in the Fijian vernacular language. Findings support its utility as a dimensional measure for depressive symptomatology in this study population. Further examination of its clinical utility for case finding for depression in Fijian school-based and community populations is warranted. © The Author(s) 2013.

The use of test scores from large-scale assessment surveys: psychometric and statistical considerations

Directory of Open Access Journals (Sweden)

Henry Braun

2017-11-01

Full Text Available Abstract Background Economists are making increasing use of measures of student achievement obtained through large-scale survey assessments such as NAEP, TIMSS, and PISA. The construction of these measures, employing plausible value (PV methodology, is quite different from that of the more familiar test scores associated with assessments such as the SAT or ACT. These differences have important implications both for utilization and interpretation. Although much has been written about PVs, it appears that there are still misconceptions about whether and how to employ them in secondary analyses. Methods We address a range of technical issues, including those raised in a recent article that was written to inform economists using these databases. First, an extensive review of the relevant literature was conducted, with particular attention to key publications that describe the derivation and psychometric characteristics of such achievement measures. Second, a simulation study was carried out to compare the statistical properties of estimates based on the use of PVs with those based on other, commonly used methods. Results It is shown, through both theoretical analysis and simulation, that under fairly general conditions appropriate use of PV yields approximately unbiased estimates of model parameters in regression analyses of large scale survey data. The superiority of the PV methodology is particularly evident when measures of student achievement are employed as explanatory variables. Conclusions The PV methodology used to report student test performance in large scale surveys remains the state-of-the-art for secondary analyses of these databases.

Psychometric properties of the problematic online gaming questionnaire short-form and prevalence of problematic online gaming in a national sample of adolescents.

Science.gov (United States)

Pápay, Orsolya; Urbán, Róbert; Griffiths, Mark D; Nagygyörgy, Katalin; Farkas, Judit; Kökönyei, Gyöngyi; Felvinczi, Katalin; Oláh, Attila; Elekes, Zsuzsanna; Demetrovics, Zsolt

2013-05-01

The rise and growing popularity of online games has led to the appearance of excessive gaming that in some cases can lead to physical and psychological problems. Several measures have been developed to explore the nature and the scale of the phenomenon. However, few measures have been validated psychometrically. The aim of the present study was to test the psychometric properties of the 12-item Problematic Online Gaming Questionnaire Short-Form (POGQ-SF) and to assess the prevalence of problematic online gaming. Data collection was carried out to assess the prevalence of problematic online gaming in a national representative adolescent sample by using an offline (pen and pencil) method. A total of 5,045 secondary school students were assessed (51% male, mean age 16.4 years, SD=0.9 years) of which 2,804 were gamers (65.4% male, mean age 16.4 years, SD=0.9 years). Confirmatory factor analysis was applied to test the measurement model of problematic online gaming, and latent profile analysis was used to identify the proportion of gamers whose online game use can be considered problematic. Results showed that the original six-factor model yielded appropriate fit to the data, and thus the POGQ-SF has appropriate psychometric properties. Latent profile analysis revealed that 4.6% of the adolescents belong to a high risk group and an additional 13.3% to a low risk group. Due to its satisfactory psychometric characteristics, the 12-item POGQ-SF appears to be an adequate tool for the assessment of problematic online gaming.

A critical appraisal of instruments to measure outcomes of interprofessional education.

Science.gov (United States)

Oates, Matthew; Davidson, Megan

2015-04-01

Interprofessional education (IPE) is believed to prepare health professional graduates for successful collaborative practice. A range of instruments have been developed to measure the outcomes of IPE. An understanding of the psychometric properties of these instruments is important if they are to be used to measure the effectiveness of IPE. This review set out to identify instruments available to measure outcomes of IPE and collaborative practice in pre-qualification health professional students and to critically appraise the psychometric properties of validity, responsiveness and reliability against contemporary standards for instrument design. Instruments were selected from a pool of extant instruments and subjected to critical appraisal to determine whether they satisfied inclusion criteria. The qualitative and psychometric attributes of the included instruments were appraised using a checklist developed for this review. Nine instruments were critically appraised, including the widely adopted Readiness for Interprofessional Learning Scale (RIPLS) and the Interdisciplinary Education Perception Scale (IEPS). Validity evidence for instruments was predominantly based on test content and internal structure. Ceiling effects and lack of scale width contribute to the inability of some instruments to detect change in variables of interest. Limited reliability data were reported for two instruments. Scale development and scoring protocols were generally reported by instrument developers, but the inconsistent application of scoring protocols for some instruments was apparent. A number of instruments have been developed to measure outcomes of IPE in pre-qualification health professional students. Based on reported validity evidence and reliability data, the psychometric integrity of these instruments is limited. The theoretical test construction paradigm on which instruments have been developed may be contributing to the failure of some instruments to detect change in

A Systematic Review of the Psychometric Properties of Composite LGBT Prejudice and Discrimination Scales.

Science.gov (United States)

Morrison, Melanie A; Bishop, C J; Morrison, Todd G

2018-01-08

Prejudice and discrimination against LGBT individuals is widespread and has been shown to have negative consequences for sexual and gender minority persons' physical and psychological wellbeing. A recent and problematic trend in the literature is to compositely measure prejudice toward and discrimination against LGBT persons. As such, a review of the psychometric properties of scales assessing, in a combinatory fashion, negative attitudes and/or behaviors toward LGBT persons is warranted. In the current study, 32 scales were identified, and their psychometric properties were evaluated. Most of the scales reviewed did not provide sufficient information regarding item development and refinement, scale dimensionality, scale score reliability, or validity. Properties of the reviewed scales are summarized, and recommendations for better measurement practice are articulated.

Assessing local outcomes in heterogeneous gliomas

International Nuclear Information System (INIS)

Dowson, Nicholas; Bourgeat, Pierrick; Salvado, Olivier; Rose, Stephen; Thomas, Paul; Fay, Michael; Jeffree, Rosalind L; Winter, Craig; Coulthard, Alan; Smith, Jye; Gal, Yaniv; Crozier, Stuart

2014-01-01

Tumours are known to be heterogeneous, yet typical treatment plans consider them as a single unit. This may influence treatment outcomes. However, treatment cannot be customised to intra-tumour variation without a method to establish outcomes at an intra-tumour scale. This work proposes a method to both assess and measure outcomes locally within tumours. Methods: Four patients were scanned at two post-surgery time points using contrast enhanced MRI and 3,4-dihydroxy-6-[18F]-fluoro-L-phenylalanine (18F-DOPA) PET. The shell of active tumour tissue is divided into a set of small subregions at both time points. Local outcome is measured from changes in subregion volume over time. The utility of the proposed approach is evaluated by measuring the correlation between PET uptake and documented growth. Correlation with overall survival time was also examined. Results: Local outcomes were heterogeneous and evidence of a positive correlation between local 18F-DOPA uptake and local progression was observed. Conclusions: Given that intra-tumour outcomes are heterogeneous the consistently positive correlation between FDOPA uptake and progression, local analysis of tumours could prove useful for treatment planning.

Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples.

Science.gov (United States)

Petrillo, Jennifer; Cano, Stefan J; McLeod, Lori D; Coon, Cheryl D

2015-01-01

To provide comparisons and a worked example of item- and scale-level evaluations based on three psychometric methods used in patient-reported outcome development-classical test theory (CTT), item response theory (IRT), and Rasch measurement theory (RMT)-in an analysis of the National Eye Institute Visual Functioning Questionnaire (VFQ-25). Baseline VFQ-25 data from 240 participants with diabetic macular edema from a randomized, double-masked, multicenter clinical trial were used to evaluate the VFQ at the total score level. CTT, RMT, and IRT evaluations were conducted, and results were assessed in a head-to-head comparison. Results were similar across the three methods, with IRT and RMT providing more detailed diagnostic information on how to improve the scale. CTT led to the identification of two problematic items that threaten the validity of the overall scale score, sets of redundant items, and skewed response categories. IRT and RMT additionally identified poor fit for one item, many locally dependent items, poor targeting, and disordering of over half the response categories. Selection of a psychometric approach depends on many factors. Researchers should justify their evaluation method and consider the intended audience. If the instrument is being developed for descriptive purposes and on a restricted budget, a cursory examination of the CTT-based psychometric properties may be all that is possible. In a high-stakes situation, such as the development of a patient-reported outcome instrument for consideration in pharmaceutical labeling, however, a thorough psychometric evaluation including IRT or RMT should be considered, with final item-level decisions made on the basis of both quantitative and qualitative results. Copyright © 2015. Published by Elsevier Inc.

Assessments in outcome evaluation in aphasia therapy

DEFF Research Database (Denmark)

Isaksen, Jytte; Brouwer, Catherine E.

2015-01-01

Abstract Outcomes of aphasia therapy in Denmark are documented in evaluation sessions in which both the person with aphasia and the speech-language therapist take part. The participants negotiate agreements on the results of therapy. By means of conversation analysis, we study how such agreements...... on therapy outcome are reached interactionally. The sequential analysis of 34 video recordings focuses on a recurrent method for reaching agreements in these outcome evaluation sessions. In and through a special sequence of conversational assessment it is claimed that the person with aphasia has certain...

Psychometrics of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults.

Science.gov (United States)