WorldWideScience

Sample records for rasch progredientem dementiellen

  1. Tc-99m-bicisate (ECD)-brain-SPECT in rapidly progressive dementia; Hirn-SPECT mit Tc-99m-Bicisat (ECD) bei rasch progredientem dementiellen Syndrom

    Energy Technology Data Exchange (ETDEWEB)

    Marienhagen, J.; Eilles, C. [Regensburg Univ. (Germany). Abt. fuer Nuklearmedizin; Weingaertner, U.; Blaha, L. [Bezirkskrankenhaus Mainkofen (Germany). Psychiatrische Klinik; Zerr, I.; Poser, S. [Goettingen Univ. (Germany). Klinik und Poliklinik fuer Neurologie

    1999-07-01

    We present a 61-year-old male patient with progressive dementia. A brain SPECT with Tc-99m-bicisate was performed for confirmation of clinically suspected Alzheimer-dementia. At the time of the SPECT-investigation marked apraxia and aphasia besides severe dementia were present. Electrophysiological as well as anatomical neuroimaging findings showed non-diagnostic alterations. SPECT revealed distinct perfusion defects, which made Alzheimer Dementia unlikely. The further course of the patient was determined by rapidly progressive deterioration with development of akinetic mutism. Thereafter, increased levels of neuron-specific enolase as well as 14-3-3 proteins were found in the cerebro-spinal fluid (CSF). The patient finally died with signs of cerebral decortication. Due to the clinical course and the CSF-findings the patient's final diagnosis was Creutzfeld-Jakob-disease, nevertheless no autopsy was performed. The presented case report underscores the clinical utility of perfusion brain SPECT in the differential diagnosis of dementias. (orig.) [German] Wir berichten ueber einen 61jaehrigen Patienten mit progredientem dementiellen Syndrom, der unter der Verdachtsdiagnose einer Demenz vom Alzheimer-Typ (DAT) zur Hirn-SPECT-Untersuchung mit TC-99m-Bicisat (ECD) vorgestellt wurde. Zum Untersuchungszeitpunkt bestanden neben dem Vollbild einer Demenz eine ausgepraegte Apraxie und Aphasie bei unspezifischen Veraenderungen im EEG sowie der neuroradiologischen Bildgebung. In der Hirn-SPECT-Untersuchung fanden sich fuer eine DAT untypische ausgedehnte, vorwiegend rechtshemisphaerische Perfusionsstoerungen. Im weiteren Verlauf rasche Progredienz des Krankheitsbildes mit Entwicklung eines akinetischen Mutismus sowie Nachweis erhoehter Werte der neuronspezifischen Enolase und des 14-3-3-Proteins im Liquor. Der Patient verstarb schliesslich unter dem Bild einer Decortication. Aufgrund des klinischen Verlaufs sowie der Liquorbefunde wurde, da eine autoptische Befundsicherung

  2. Graphical Rasch models

    DEFF Research Database (Denmark)

    Kreiner, Svend; Christensen, Karl Bang

    Rasch models; Partial Credit models; Rating Scale models; Item bias; Differential item functioning; Local independence; Graphical models......Rasch models; Partial Credit models; Rating Scale models; Item bias; Differential item functioning; Local independence; Graphical models...

  3. Loglinear Rasch model tests

    NARCIS (Netherlands)

    Kelderman, Hendrikus

    1984-01-01

    Existing statistical tests for the fit of the Rasch model have been criticized, because they are only sensitive to specific violations of its assumptions. Contingency table methods using loglinear models have been used to test various psychometric models. In this paper, the assumptions of the Rasch

  4. Causal Rasch models.

    Science.gov (United States)

    Stenner, A Jackson; Fisher, William P; Stone, Mark H; Burdick, Donald S

    2013-01-01

    Rasch's unidimensional models for measurement show how to connect object measures (e.g., reader abilities), measurement mechanisms (e.g., machine-generated cloze reading items), and observational outcomes (e.g., counts correct on reading instruments). Substantive theory shows what interventions or manipulations to the measurement mechanism can be traded off against a change to the object measure to hold the observed outcome constant. A Rasch model integrated with a substantive theory dictates the form and substance of permissible interventions. Rasch analysis, absent construct theory and an associated specification equation, is a black box in which understanding may be more illusory than not. Finally, the quantitative hypothesis can be tested by comparing theory-based trade-off relations with observed trade-off relations. Only quantitative variables (as measured) support such trade-offs. Note that to test the quantitative hypothesis requires more than manipulation of the algebraic equivalencies in the Rasch model or descriptively fitting data to the model. A causal Rasch model involves experimental intervention/manipulation on either reader ability or text complexity or a conjoint intervention on both simultaneously to yield a successful prediction of the resultant observed outcome (count correct). We conjecture that when this type of manipulation is introduced for individual reader text encounters and model predictions are consistent with observations, the quantitative hypothesis is sustained.

  5. Causal Rasch models

    Science.gov (United States)

    Stenner, A. Jackson; Fisher, William P.; Stone, Mark H.; Burdick, Donald S.

    2013-01-01

    Rasch's unidimensional models for measurement show how to connect object measures (e.g., reader abilities), measurement mechanisms (e.g., machine-generated cloze reading items), and observational outcomes (e.g., counts correct on reading instruments). Substantive theory shows what interventions or manipulations to the measurement mechanism can be traded off against a change to the object measure to hold the observed outcome constant. A Rasch model integrated with a substantive theory dictates the form and substance of permissible interventions. Rasch analysis, absent construct theory and an associated specification equation, is a black box in which understanding may be more illusory than not. Finally, the quantitative hypothesis can be tested by comparing theory-based trade-off relations with observed trade-off relations. Only quantitative variables (as measured) support such trade-offs. Note that to test the quantitative hypothesis requires more than manipulation of the algebraic equivalencies in the Rasch model or descriptively fitting data to the model. A causal Rasch model involves experimental intervention/manipulation on either reader ability or text complexity or a conjoint intervention on both simultaneously to yield a successful prediction of the resultant observed outcome (count correct). We conjecture that when this type of manipulation is introduced for individual reader text encounters and model predictions are consistent with observations, the quantitative hypothesis is sustained. PMID:23986726

  6. Causal Rasch models

    Directory of Open Access Journals (Sweden)

    A. Jackson Stenner

    2013-08-01

    Full Text Available Rasch’s unidimensional models for measurement show how to connect object measures (e.g., reader abilities, measurement mechanisms (e.g., machine-generated cloze reading items, and observational outcomes (e.g., counts correct on reading instruments. Substantive theory shows what interventions or manipulations to the measurement mechanism can be traded off against a change to the object measure to hold the observed outcome constant. A Rasch model integrated with a substantive theory dictates the form and substance of permissible interventions. Rasch analysis, absent construct theory and an associated specification equation, is a black box in which understanding may be more illusory than not. Finally, the quantitative hypothesis can be tested by comparing theory-based trade-off relations with observed trade-off relations. Only quantitative variables (as measured support such trade-offs. Note that to test the quantitative hypothesis requires more than manipulation of the algebraic equivalencies in the Rasch model or descriptively fitting data to the model. A causal Rasch model involves experimental intervention/manipulation on either reader ability or text complexity or a conjoint intervention on both simultaneously to yield a successful prediction of the resultant observed outcome (count correct. We conjecture that when this type of manipulation is introduced for individual reader text encounters and model predictions are consistent with observations, the quantitative hypothesis is sustained.

  7. Predicting responses from Rasch measures.

    Science.gov (United States)

    Linacre, John M

    2010-01-01

    There is a growing family of Rasch models for polytomous observations. Selecting a suitable model for an existing dataset, estimating its parameters and evaluating its fit is now routine. Problems arise when the model parameters are to be estimated from the current data, but used to predict future data. In particular, ambiguities in the nature of the current data, or overfit of the model to the current dataset, may mean that better fit to the current data may lead to worse fit to future data. The predictive power of several Rasch and Rasch-related models are discussed in the context of the Netflix Prize. Rasch-related models are proposed based on Singular Value Decomposition (SVD) and Boltzmann Machines.

  8. Polytomous Rasch Models in Counseling Assessment

    Science.gov (United States)

    Willse, John T.

    2017-01-01

    This article provides a brief introduction to the Rasch model. Motivation for using Rasch analyses is provided. Important Rasch model concepts and key aspects of result interpretation are introduced, with major points reinforced using a simulation demonstration. Concrete guidelines are provided regarding sample size and the evaluation of items.

  9. Guessing and the Rasch Model

    Science.gov (United States)

    Holster, Trevor A.; Lake, J.

    2016-01-01

    Stewart questioned Beglar's use of Rasch analysis of the Vocabulary Size Test (VST) and advocated the use of 3-parameter logistic item response theory (3PLIRT) on the basis that it models a non-zero lower asymptote for items, often called a "guessing" parameter. In support of this theory, Stewart presented fit statistics derived from…

  10. Reliability in the Rasch Model

    Czech Academy of Sciences Publication Activity Database

    Martinková, Patrícia; Zvára, K.

    2007-01-01

    Roč. 43, č. 3 (2007), s. 315-326 ISSN 0023-5954 R&D Projects: GA MŠk(CZ) 1M06014 Institutional research plan: CEZ:AV0Z10300504 Keywords : Cronbach's alpha * Rasch model * reliability Subject RIV: BB - Applied Statistics, Operational Research Impact factor: 0.552, year: 2007 http://dml.cz/handle/10338.dmlcz/135776

  11. From Rasch scores to regression

    DEFF Research Database (Denmark)

    Christensen, Karl Bang

    2006-01-01

    Rasch models provide a framework for measurement and modelling latent variables. Having measured a latent variable in a population a comparison of groups will often be of interest. For this purpose the use of observed raw scores will often be inadequate because these lack interval scale propertie....... This paper compares two approaches to group comparison: linear regression models using estimated person locations as outcome variables and latent regression models based on the distribution of the score....

  12. Analysis of Local Dependence and Multidimensionality in Graphical Loglinear Rasch Models

    DEFF Research Database (Denmark)

    Kreiner, Svend; Christensen, Karl Bang

    2004-01-01

    Local independence; Multidimensionality; Differential item functioning; Uniform local dependence and DIF; Graphical Rasch models; Loglinear Rasch model......Local independence; Multidimensionality; Differential item functioning; Uniform local dependence and DIF; Graphical Rasch models; Loglinear Rasch model...

  13. Some Improved Diagnostics for Failure of The Rasch Model.

    Science.gov (United States)

    Molenaar, Ivo W.

    1983-01-01

    Goodness of fit tests for the Rasch model are typically large-sample, global measures. This paper offers suggestions for small-sample exploratory techniques for examining the fit of item data to the Rasch model. (Author/JKS)

  14. Sample Size Determination for Rasch Model Tests

    Science.gov (United States)

    Draxler, Clemens

    2010-01-01

    This paper is concerned with supplementing statistical tests for the Rasch model so that additionally to the probability of the error of the first kind (Type I probability) the probability of the error of the second kind (Type II probability) can be controlled at a predetermined level by basing the test on the appropriate number of observations.…

  15. Educational Leadership Effectiveness: A Rasch Analysis

    Science.gov (United States)

    Sinnema, Claire; Ludlow, Larry; Robinson, Viviane

    2016-01-01

    Purpose: The purposes of this paper are, first, to establish the psychometric properties of the ELP tool, and, second, to test, using a Rasch item response theory analysis, the hypothesized progression of challenge presented by the items included in the tool. Design/ Methodology/ Approach: Data were collected at two time points through a survey of…

  16. Examining Teacher Grades Using Rasch Measurement Theory

    Science.gov (United States)

    Randall, Jennifer; Engelhard, George, Jr.

    2009-01-01

    In this study, we present an approach to questionnaire design within educational research based on Guttman's mapping sentences and Many-Facet Rasch Measurement Theory. We designed a 54-item questionnaire using Guttman's mapping sentences to examine the grading practices of teachers. Each item in the questionnaire represented a unique student…

  17. Fitting polytomous Rasch models in SAS

    DEFF Research Database (Denmark)

    Christensen, Karl Bang

    2006-01-01

    The item parameters of a polytomous Rasch model can be estimated using marginal and conditional approaches. This paper describes how this can be done in SAS (V8.2) for three item parameter estimation procedures: marginal maximum likelihood estimation, conditional maximum likelihood estimation, an...

  18. Item Information in the Rasch Model

    NARCIS (Netherlands)

    Engelen, Ron J.H.; van der Linden, Willem J.; Oosterloo, Sebe J.

    1988-01-01

    Fisher's information measure for the item difficulty parameter in the Rasch model and its marginal and conditional formulations are investigated. It is shown that expected item information in the unconditional model equals information in the marginal model, provided the assumption of sampling

  19. FIM measurement properties and Rasch model details.

    Science.gov (United States)

    Wright, B D; Linacre, J M; Smith, R M; Heinemann, A W; Granger, C V

    1997-12-01

    To summarize, we take issue with the criticisms of Dickson & Köhler for two main reasons: 1. Rasch analysis provides a model from which to approach the analysis of the FIM, an ordinal scale, as an interval scale. The existence of examples of items or individuals which do not fit the model does not disprove the overall efficacy of the model; and 2. the principal components analysis of FIM motor items as presented by Dickson & Köhler tends to undermine rather than support their argument. Their own analyses produce a single major factor explaining between 58.5 and 67.1% of the variance, depending upon the sample, with secondary factors explaining much less variance. Finally, analysis of item response, or latent trait, is a powerful method for understanding the meaning of a measure. However, it presumes that item scores are accurate. Another concern is that Dickson & Köhler do not address the issue of reliability of scoring the FIM items on which they report, a critical point in comparing results. The Uniform Data System for Medical Rehabilitation (UDSMRSM) expends extensive effort in the training of clinicians of subscribing facilities to score items accurately. This is followed up with a credentialing process. Phase 1 involves the testing of individual clinicians who are submitting data to determine if they have achieved mastery over the use of the FIM instrument. Phase 2 involves examining the data for outlying values. When Dickson & Köhler investigate more carefully the application of the Rasch model to their FIM data, they will discover that the results presented in their paper support rather than contradict their application of the Rasch model! This paper is typical of supposed refutations of Rasch model applications. Dickson & Köhler will find that idiosyncrasies in their data and misunderstandings of the Rasch model are the only basis for a claim to have disproven the relevance of the model to FIM data. The Rasch model is a mathematical theorem (like

  20. Understanding Rasch Measurement: Partial Credit Model and Pivot Anchoring.

    Science.gov (United States)

    Bode, Rita K.

    2001-01-01

    Describes the Rasch measurement partial credit model, what it is, how it differs from other Rasch models, and when and how to use it. Also describes the calibration of instruments with increasingly complex items. Explains pivot anchoring and illustrates its use and describes the effect of pivot anchoring on step calibrations, item hierarchy, and…

  1. A gentle introduction to Rasch measurement models for metrologists

    International Nuclear Information System (INIS)

    Mari, Luca; Wilson, Mark

    2013-01-01

    The talk introduces the basics of Rasch models by systematically interpreting them in the conceptual and lexical framework of the International Vocabulary of Metrology, third edition (VIM3). An admittedly simple example of physical measurement highlights the analogies between physical transducers and tests, as they can be understood as measuring instruments of Rasch models and psychometrics in general. From the talk natural scientists and engineers might learn something of Rasch models, as a specifically relevant case of social measurement, and social scientists might re-interpret something of their knowledge of measurement in the light of the current physical measurement models

  2. Measurement of change in health status with Rasch models.

    Science.gov (United States)

    Anselmi, Pasquale; Vidotto, Giulio; Bettinardi, Ornella; Bertolotti, Giorgio

    2015-02-07

    The traditional approach to the measurement of change presents important drawbacks (no information at individual level, ordinal scores, variance of the measurement instrument across time points), which Rasch models overcome. The article aims to illustrate the features of the measurement of change with Rasch models. To illustrate the measurement of change using Rasch models, the quantitative data of a longitudinal study of heart-surgery patients (N = 98) were used. The scale "Perception of Positive Change" was used as an example of measurement instrument. All patients underwent cardiac rehabilitation, individual psychological intervention, and educational intervention. Nineteen patients also attended progressive muscle relaxation group trainings. The scale was administered before and after the interventions. Three Rasch approaches were used. Two separate analyses were run on the data from the two time points to test the invariance of the instrument. An analysis was run on the stacked data from both time points to measure change in a common frame of reference. Results of the latter analysis were compared with those of an analysis that removed the influence of local dependency on patient measures. Statistics t, χ(2) and F were used for comparing the patient and item measures estimated in the Rasch analyses (a-priori α = .05). Infit, Outfit, R and item Strata were used for investigating Rasch model fit, reliability, and validity of the instrument. Data of all 98 patients were included in the analyses. The instrument was reliable, valid, and substantively unidimensional (Infit, Outfit instrument occurred across the two time, which prevented the use of the two separate analyses to unambiguously measure change. Local dependency had a negligible effect on patient measures (p ≥ .8674). Thirteen patients improved, whereas 3 worsened. The patients who attended the relaxation group trainings did not report greater improvement than those who did not (p

  3. Rasch analysis on OSCE data : An illustrative example.

    Science.gov (United States)

    Tor, E; Steketee, C

    2011-01-01

    The Objective Structured Clinical Examination (OSCE) is a widely used tool for the assessment of clinical competence in health professional education. The goal of the OSCE is to make reproducible decisions on pass/fail status as well as students' levels of clinical competence according to their demonstrated abilities based on the scores. This paper explores the use of the polytomous Rasch model in evaluating the psychometric properties of OSCE scores through a case study. The authors analysed an OSCE data set (comprised of 11 stations) for 80 fourth year medical students based on the polytomous Rasch model in an effort to answer two research questions: (1) Do the clinical tasks assessed in the 11 OSCE stations map on to a common underlying construct, namely clinical competence? (2) What other insights can Rasch analysis offer in terms of scaling, item analysis and instrument validation over and above the conventional analysis based on classical test theory? The OSCE data set has demonstrated a sufficient degree of fit to the Rasch model (Χ(2) = 17.060, DF=22, p=0.76) indicating that the 11 OSCE station scores have sufficient psychometric properties to form a measure for a common underlying construct, i.e. clinical competence. Individual OSCE station scores with good fit to the Rasch model (p > 0.1 for all Χ(2) statistics) further corroborated the characteristic of unidimensionality of the OSCE scale for clinical competence. A Person Separation Index (PSI) of 0.704 indicates sufficient level of reliability for the OSCE scores. Other useful findings from the Rasch analysis that provide insights, over and above the analysis based on classical test theory, are also exemplified using the data set. The polytomous Rasch model provides a useful and supplementary approach to the calibration and analysis of OSCE examination data.

  4. Rasch analysis on OSCE data : An illustrative example

    Directory of Open Access Journals (Sweden)

    Tor E

    2011-06-01

    Full Text Available BackgroundThe Objective Structured Clinical Examination (OSCE is awidely used tool for the assessment of clinical competencein health professional education. The goal of the OSCE is tomake reproducible decisions on pass/fail status as well asstudents’ levels of clinical competence according to theirdemonstrated abilities based on the scores. This paperexplores the use of the polytomous Rasch model inevaluating the psychometric properties of OSCE scoresthrough a case study.MethodThe authors analysed an OSCE data set (comprised of 11stations for 80 fourth year medical students based on thepolytomous Rasch model in an effort to answer tworesearch questions: (1 Do the clinical tasks assessed in the11 OSCE stations map on to a common underlyingconstruct, namely clinical competence? (2 What otherinsights can Rasch analysis offer in terms of scaling, itemanalysis and instrument validation over and above theconventional analysis based on classical test theory?ResultsThe OSCE data set has demonstrated a sufficient degree offit to the Rasch model (χ2 = 17.060, DF=22, p=0.76indicating that the 11 OSCE station scores have sufficientpsychometric properties to form a measure for a commonunderlying construct, i.e. clinical competence. IndividualOSCE station scores with good fit to the Rasch model (p >0.1 for all χ2 statistics further corroborated thecharacteristic of unidimensionality of the OSCE scale forclinical competence. A Person Separation Index (PSI of0.704 indicates sufficient level of reliability for the OSCEscores. Other useful findings from the Rasch analysis thatprovide insights, over and above the analysis based onclassical test theory, are also exemplified using the data set.ConclusionThe polytomous Rasch model provides a useful andsupplementary approach to the calibration and analysis ofOSCE examination data.

  5. Enhancing measurement in science education research through Rasch analysis: Rationale and properties

    Directory of Open Access Journals (Sweden)

    Jørgen Sjaastad

    2014-10-01

    Full Text Available This article presents the basic rationale of Rasch theory and seven core properties of Rasch modeling; analyses of test targeting, person separation, person fit, item fit, differential item functioning, functioning of response categories and tests of unidimensionality. Illustrative examples are provided consecutively, drawing on Rasch analysis of data from a survey where students in the 9th grade responded to questions regarding their mathematics competence. The relationship between Rasch theory and classical test theory is commented on. Rasch theory provides science and mathematics education researchers with valuable tools to evaluate the psychometric quality of tests and questionnaires and support the development of these.

  6. Rasch analysis of the Multiple Sclerosis Impact Scale (MSIS-29

    Directory of Open Access Journals (Sweden)

    Misajon Rose

    2009-06-01

    Full Text Available Abstract Background Multiple Sclerosis (MS is a degenerative neurological disease that causes impairments, including spasticity, pain, fatigue, and bladder dysfunction, which negatively impact on quality of life. The Multiple Sclerosis Impact Scale (MSIS-29 is a disease-specific health-related quality of life (HRQoL instrument, developed using the patient's perspective on disease impact. It consists of two subscales assessing the physical (MSIS-29-PHYS and psychological (MSIS-29-PSYCH impact of MS. Although previous studies have found support for the psychometric properties of the MSIS-29 using traditional methods of scale evaluation, the scale has not been subjected to a detailed Rasch analysis. Therefore, the objective of this study was to use Rasch analysis to assess the internal validity of the scale, and its response format, item fit, targeting, internal consistency and dimensionality. Methods Ninety-two persons with definite MS residing in the community were recruited from a tertiary hospital database. Patients completed the MSIS-29 as part of a larger study. Rasch analysis was undertaken to assess the psychometric properties of the MSIS-29. Results Rasch analysis showed overall support for the psychometric properties of the two MSIS-29 subscales, however it was necessary to reduce the response format of the MSIS-29-PHYS to a 3-point response scale. Both subscales were unidimensional, had good internal consistency, and were free from item bias for sex and age. Dimensionality testing indicated it was not appropriate to combine the two subscales to form a total MSIS score. Conclusion In this first study to use Rasch analysis to fully assess the psychometric properties of the MSIS-29 support was found for the two subscales but not for the use of the total scale. Further use of Rasch analysis on the MSIS-29 in larger and broader samples is recommended to confirm these findings.

  7. Rasch analysis of the Multiple Sclerosis Impact Scale (MSIS-29)

    Science.gov (United States)

    Ramp, Melina; Khan, Fary; Misajon, Rose Anne; Pallant, Julie F

    2009-01-01

    Background Multiple Sclerosis (MS) is a degenerative neurological disease that causes impairments, including spasticity, pain, fatigue, and bladder dysfunction, which negatively impact on quality of life. The Multiple Sclerosis Impact Scale (MSIS-29) is a disease-specific health-related quality of life (HRQoL) instrument, developed using the patient's perspective on disease impact. It consists of two subscales assessing the physical (MSIS-29-PHYS) and psychological (MSIS-29-PSYCH) impact of MS. Although previous studies have found support for the psychometric properties of the MSIS-29 using traditional methods of scale evaluation, the scale has not been subjected to a detailed Rasch analysis. Therefore, the objective of this study was to use Rasch analysis to assess the internal validity of the scale, and its response format, item fit, targeting, internal consistency and dimensionality. Methods Ninety-two persons with definite MS residing in the community were recruited from a tertiary hospital database. Patients completed the MSIS-29 as part of a larger study. Rasch analysis was undertaken to assess the psychometric properties of the MSIS-29. Results Rasch analysis showed overall support for the psychometric properties of the two MSIS-29 subscales, however it was necessary to reduce the response format of the MSIS-29-PHYS to a 3-point response scale. Both subscales were unidimensional, had good internal consistency, and were free from item bias for sex and age. Dimensionality testing indicated it was not appropriate to combine the two subscales to form a total MSIS score. Conclusion In this first study to use Rasch analysis to fully assess the psychometric properties of the MSIS-29 support was found for the two subscales but not for the use of the total scale. Further use of Rasch analysis on the MSIS-29 in larger and broader samples is recommended to confirm these findings. PMID:19545445

  8. Improving the Individual Work Performance Questionnaire using Rasch analysis.

    OpenAIRE

    Koopmans, L.; Bernaards, C.M.; Hildebrandt, V.H.; Buuren, S. van; Beek, A.J. van der; Vet, H.C.W. de

    2014-01-01

    Recently, the Individual Work Performance Questionnaire (IWPQ) version 0.2 was developed using Rasch analysis. The goal of the current study was to improve targeting of the IWPQ scales by including additional items. The IWPQ 0.2 (original) and 0.3 (including additional items) were examined using Rasch analysis. Additional items that showed misfit or did not improve targeting were removed from the IWPQ 0.3, resulting in a final IWPQ 1.0. Subsequently, the scales showed good model fit and relia...

  9. Rasch Calibration of Perceived Weights of Different Sports Games

    Science.gov (United States)

    Kang, Sang-Jo; Kang, Minsoo

    2006-01-01

    In many countries, an athlete's performance at sporting competitions is often used as part of the selection criteria for entry into college. These criteria could be biased depending upon the procedures utilized by the authorities in a particular country. The purpose of this study was to calibrate, by using the Rasch rating scale model, the…

  10. Rasch Analysis: A Primer for School Psychology Researchers and Practitioners

    Science.gov (United States)

    Boone, William J.; Noltemeyer, Amity

    2017-01-01

    In order to progress as a field, school psychology research must be informed by effective measurement techniques. One approach to address the need for careful measurement is Rasch analysis. This technique can (a) facilitate the development of instruments that provide useful data, (b) provide data that can be used confidently for both descriptive…

  11. Analysis of High School German Textbooks through Rasch Measurement Model

    Science.gov (United States)

    Batdi, Veli; Elaldi, Senel

    2016-01-01

    The purpose of the present study is to analyze German teacher trainers' views on high school German textbooks through the Rasch measurement model. A survey research design was employed and study group consisted of a total of 21 teacher trainers, three from each region and selected randomly from provinces which are located in seven regions and…

  12. Improving the Individual Work Performance Questionnaire using Rasch analysis.

    NARCIS (Netherlands)

    Koopmans, L.; Bernaards, C.M.; Hildebrandt, V.H.; Buuren, S. van; Beek, A.J. van der; Vet, H.C.W. de

    2014-01-01

    Recently, the Individual Work Performance Questionnaire (IWPQ) version 0.2 was developed using Rasch analysis. The goal of the current study was to improve targeting of the IWPQ scales by including additional items. The IWPQ 0.2 (original) and 0.3 (including additional items) were examined using

  13. Rasch Analysis of Professional Behavior in Medical Education

    Science.gov (United States)

    Lange, R.; Verhulst, S. J.; Roberts, N. K.; Dorsey, J. K.

    2015-01-01

    The use of students' "consumer feedback" to assess faculty behavior and improve the process of medical education is a significant challenge. We used quantitative Rasch measurement to analyze pre-categorized student comments listed by 385 graduating medical students. We found that students differed little with respect to the number of…

  14. Validation of VARK learning modalities questionnaire using Rasch analysis

    Science.gov (United States)

    Fitkov-Norris, E. D.; Yeghiazarian, A.

    2015-02-01

    This article discusses the application of Rasch analysis to assess the internal validity of a four sub-scale VARK (Visual, Auditory, Read/Write and Kinaesthetic) learning styles instrument. The results from the analysis show that the Rasch model fits the majority of the VARK questionnaire data and the sample data support the internal validity of the four sub-constructs at 1% level of significance for all but one item. While this suggests that the instrument could potentially be used as a predictor for a person's learning preference orientation, further analysis is necessary to confirm the invariability of the instrument across different user groups across factors such as gender, age, educational and cultural background.

  15. Analysis of letter name knowledge using Rasch measurement.

    Science.gov (United States)

    Bowles, Ryan P; Skibbe, Lori E; Justice, Laura M

    2011-01-01

    Letter name knowledge (LNK) is a key predictor of later reading ability and has been emphasized strongly in recent educational policy. Studies of LNK have implicitly treated it as a unidimensional construct with all letters equally relevant to its measurement. However, some empirical research suggests that contextual factors can affect the measurement of LNK. In this study, we analyze responses from 909 children on measures of LNK using the Rasch model and its extensions, and consider two contextual factors: the format of assessment and the own-name advantage, which states that children are more likely to know letters in their own first names. Results indicate that both contextual factors have important impacts on measurement and that LNK does not meet the requirements of Rasch measurement even when accounting for the contextual factors. These findings introduce philosophical concerns for measurement of constrained skills which have limited content for assessment.

  16. Calibration of a Chemistry Test Using the Rasch Model

    Directory of Open Access Journals (Sweden)

    Nancy Coromoto Martín Guaregua

    2011-11-01

    Full Text Available The Rasch model was used to calibrate a general chemistry test for the purpose of analyzing the advantages and information the model provides. The sample was composed of 219 college freshmen. Of the 12 questions used, good fit was achieved in 10. The evaluation shows that although there are items of variable difficulty, there are gaps on the scale; in order to make the test complete, it will be necessary to design new items to fill in these gaps.

  17. Measuring Mindfulness: A Rasch Analysis of the Freiburg Mindfulness Inventory

    Directory of Open Access Journals (Sweden)

    Siobhan Lynch

    2011-12-01

    Full Text Available The objective of the study was to assess the psychometric properties of the Freiburg Mindfulness Inventory (FMI-14 using a Rasch model approach in a cross-sectional design. The scale was administered to N = 130 British patients with different psychosomatic conditions. The scale failed to show clear one-factoriality and item 13 did not fit the Rasch model. A two-factorial solution without item 13, however, appeared to fit well. The scale seemed to work equally well in different subgroups such as patients with or without mindfulness practice. However, some limitations of the validity of both the one-factorial and the two-factorial version of the scale were observed. Sizeable floor and ceiling effects limit the diagnostical use of the instrument. In summary, the study demonstrates that the two-factorial version of the FMI-13 shows acceptable approximation to Rasch requirements, but is in need of further improvement. The one-factorial solution did not fit well, and cannot be recommended for further use.

  18. Examination of a Social-Networking Site Activities Scale (SNSAS) Using Rasch Analysis

    Science.gov (United States)

    Alhaythami, Hassan; Karpinski, Aryn; Kirschner, Paul; Bolden, Edward

    2017-01-01

    This study examined the psychometric properties of a social-networking site (SNS) activities scale (SNSAS) using Rasch Analysis. Items were also examined with Rasch Principal Components Analysis (PCA) and Differential Item Functioning (DIF) across groups of university students (i.e., males and females from the United States [US] and Europe; N =…

  19. The Rasch Poisson counts model for incomplete data : An application of the EM algorithm

    NARCIS (Netherlands)

    Jansen, G.G.H.

    Rasch's Poisson counts model is a latent trait model for the situation in which K tests are administered to N examinees and the test score is a count [e.g., the repeated occurrence of some event, such as the number of items completed or the number of items answered (in)correctly]. The Rasch Poisson

  20. Detecting Aberrant Response Patterns in the Rasch Model. Rapport 87-3.

    Science.gov (United States)

    Kogut, Jan

    In this paper, the detection of response patterns aberrant from the Rasch model is considered. For this purpose, a new person fit index, recently developed by I. W. Molenaar (1987) and an iterative estimation procedure are used in a simulation study of Rasch model data mixed with aberrant data. Three kinds of aberrant response behavior are…

  1. A psychometric revision of the European American Values Scale for Asian Americans using the Rasch model

    OpenAIRE

    Hong, S; Kim, Bryan S.K.; Wolfe, M M

    2005-01-01

    The 18-item European American Values Scale for Asian Americans (M. M. Wolfe, P H. Yang, E C. Wong, & D. R. Atkinson, 2001) was revised on the basis of results from a psychometric analysis using the Rasch Model (G. Rasch,1960). The results led to the establishment of the 25-item European AmericanValues Scale for Asian Americans-Revised.

  2. Rasch Analysis of the Locus-of-Hope Scale. Brief Report

    Science.gov (United States)

    Gadiana, Leny G.; David, Adonis P.

    2015-01-01

    The Locus-of-Hope Scale (LHS) was developed as a measure of the locus-of-hope dimensions (Bernardo, 2010). The present study adds to the emerging literature on locus-of-hope by assessing the psychometric properties of the LHS using Rasch analysis. The results from the Rasch analyses of the four subscales of LHS provided evidence on the…

  3. A Comparison of Uniform DIF Effect Size Estimators under the MIMIC and Rasch Models

    Science.gov (United States)

    Jin, Ying; Myers, Nicholas D.; Ahn, Soyeon; Penfield, Randall D.

    2013-01-01

    The Rasch model, a member of a larger group of models within item response theory, is widely used in empirical studies. Detection of uniform differential item functioning (DIF) within the Rasch model typically employs null hypothesis testing with a concomitant consideration of effect size (e.g., signed area [SA]). Parametric equivalence between…

  4. Rasch model based analysis of the Force Concept Inventory

    Directory of Open Access Journals (Sweden)

    Maja Planinic

    2010-03-01

    Full Text Available The Force Concept Inventory (FCI is an important diagnostic instrument which is widely used in the field of physics education research. It is therefore very important to evaluate and monitor its functioning using different tools for statistical analysis. One of such tools is the stochastic Rasch model, which enables construction of linear measures for persons and items from raw test scores and which can provide important insight in the structure and functioning of the test (how item difficulties are distributed within the test, how well the items fit the model, and how well the items work together to define the underlying construct. The data for the Rasch analysis come from the large-scale research conducted in 2006-07, which investigated Croatian high school students’ conceptual understanding of mechanics on a representative sample of 1676 students (age 17–18 years. The instrument used in research was the FCI. The average FCI score for the whole sample was found to be (27.7±0.4%, indicating that most of the students were still non-Newtonians at the end of high school, despite the fact that physics is a compulsory subject in Croatian schools. The large set of obtained data was analyzed with the Rasch measurement computer software WINSTEPS 3.66. Since the FCI is routinely used as pretest and post-test on two very different types of population (non-Newtonian and predominantly Newtonian, an additional predominantly Newtonian sample (N=141, average FCI score of 64.5% of first year students enrolled in introductory physics course at University of Zagreb was also analyzed. The Rasch model based analysis suggests that the FCI has succeeded in defining a sufficiently unidimensional construct for each population. The analysis of fit of data to the model found no grossly misfitting items which would degrade measurement. Some items with larger misfit and items with significantly different difficulties in the two samples of students do require further

  5. Rasch Analysis of Lebanese Nurses’ Responses to the EIS Questionnaire

    Directory of Open Access Journals (Sweden)

    Michael Clinton

    2014-08-01

    Full Text Available This study examined the psychometric characteristics of a 32-item modified version of the Ethical Issues Scale (EIS. Data were collected from 59 registered nurses at the American University of Beirut Medical Centre (AUBMC. Data were analyzed using WINSTEPS Rasch analysis software. The four-category EIS rating scale needs modification for future studies in Lebanon. All EIS scale items need rewording prior to translation into Arabic to avoid confusion among Lebanese nurses. Principal component analysis (PCA of residuals indicated the possible presence of additional dimensions. Additional EIS items are needed to improve targeting.

  6. Rasch Analysis of the Fullerton Advanced Balance (FAB) Scale

    Science.gov (United States)

    Fiedler, Roger C.; Rose, Debra J.

    2011-01-01

    ABSTRACT Purpose: This cross-sectional study explores the psychometric properties and dimensionality of the Fullerton Advanced Balance (FAB) Scale, a multi-item balance test for higher-functioning older adults. Methods: Participants (n=480) were community-dwelling adults able to ambulate independently. Data gathering consisted of survey and balance performance assessment. Psychometric properties were assessed using Rasch analysis. Results: Mean age of participants was 76.4 (SD=7.1) years. Mean FAB Scale scores were 24.7/40 (SD=7.5). Analyses for scale dimensionality showed that 9 of the 10 items fit a unidimensional measure of balance. Item 10 (Reactive Postural Control) did not fit the model. The reliability of the scale to separate persons was 0.81 out of 1.00; the reliability of the scale to separate items in terms of their difficulty was 0.99 out of 1.00. Cronbach's alpha for a 10-item model was 0.805. Items of differing difficulties formed a useful ordinal hierarchy for scaling patterns of expected balance ability scoring for a normative population. Conclusion: The FAB Scale appears to be a reliable and valid tool to assess balance function in higher-functioning older adults. The test was found to discriminate among participants of varying balance abilities. Further exploration of concurrent validity of Rasch-generated expected item scoring patterns should be undertaken to determine the test's diagnostic and prescriptive utility. PMID:22210989

  7. Rasch Analysis of the Fullerton Advanced Balance (FAB) Scale.

    Science.gov (United States)

    Klein, Penelope J; Fiedler, Roger C; Rose, Debra J

    2011-01-01

    This cross-sectional study explores the psychometric properties and dimensionality of the Fullerton Advanced Balance (FAB) Scale, a multi-item balance test for higher-functioning older adults. Participants (n=480) were community-dwelling adults able to ambulate independently. Data gathering consisted of survey and balance performance assessment. Psychometric properties were assessed using Rasch analysis. Mean age of participants was 76.4 (SD=7.1) years. Mean FAB Scale scores were 24.7/40 (SD=7.5). Analyses for scale dimensionality showed that 9 of the 10 items fit a unidimensional measure of balance. Item 10 (Reactive Postural Control) did not fit the model. The reliability of the scale to separate persons was 0.81 out of 1.00; the reliability of the scale to separate items in terms of their difficulty was 0.99 out of 1.00. Cronbach's alpha for a 10-item model was 0.805. Items of differing difficulties formed a useful ordinal hierarchy for scaling patterns of expected balance ability scoring for a normative population. The FAB Scale appears to be a reliable and valid tool to assess balance function in higher-functioning older adults. The test was found to discriminate among participants of varying balance abilities. Further exploration of concurrent validity of Rasch-generated expected item scoring patterns should be undertaken to determine the test's diagnostic and prescriptive utility.

  8. Estimating the Multilevel Rasch Model: With the lme4 Package

    Directory of Open Access Journals (Sweden)

    Harold Doran

    2007-02-01

    Full Text Available Traditional Rasch estimation of the item and student parameters via marginal maximum likelihood, joint maximum likelihood or conditional maximum likelihood, assume individuals in clustered settings are uncorrelated and items within a test that share a grouping structure are also uncorrelated. These assumptions are often violated, particularly in educational testing situations, in which students are grouped into classrooms and many test items share a common grouping structure, such as a content strand or a reading passage. Consequently, one possible approach is to explicitly recognize the clustered nature of the data and directly incorporate random effects to account for the various dependencies. This article demonstrates how the multilevel Rasch model can be estimated using the functions in R for mixed-effects models with crossed or partially crossed random effects. We demonstrate how to model the following hierarchical data structures: a individuals clustered in similar settings (e.g., classrooms, schools, b items nested within a particular group (such as a content strand or a reading passage, and c how to estimate a teacher × content strand interaction.

  9. Monte Carlo tests of the Rasch model based on scalability coefficients

    DEFF Research Database (Denmark)

    Christensen, Karl Bang; Kreiner, Svend

    2010-01-01

    that summarizes the number of Guttman errors in the data matrix. These coefficients are shown to yield efficient tests of the Rasch model using p-values computed using Markov chain Monte Carlo methods. The power of the tests of unequal item discrimination, and their ability to distinguish between local dependence......For item responses fitting the Rasch model, the assumptions underlying the Mokken model of double monotonicity are met. This makes non-parametric item response theory a natural starting-point for Rasch item analysis. This paper studies scalability coefficients based on Loevinger's H coefficient...

  10. Sample Size and Statistical Conclusions from Tests of Fit to the Rasch Model According to the Rasch Unidimensional Measurement Model (Rumm) Program in Health Outcome Measurement.

    Science.gov (United States)

    Hagell, Peter; Westergren, Albert

    Sample size is a major factor in statistical null hypothesis testing, which is the basis for many approaches to testing Rasch model fit. Few sample size recommendations for testing fit to the Rasch model concern the Rasch Unidimensional Measurement Models (RUMM) software, which features chi-square and ANOVA/F-ratio based fit statistics, including Bonferroni and algebraic sample size adjustments. This paper explores the occurrence of Type I errors with RUMM fit statistics, and the effects of algebraic sample size adjustments. Data with simulated Rasch model fitting 25-item dichotomous scales and sample sizes ranging from N = 50 to N = 2500 were analysed with and without algebraically adjusted sample sizes. Results suggest the occurrence of Type I errors with N less then or equal to 500, and that Bonferroni correction as well as downward algebraic sample size adjustment are useful to avoid such errors, whereas upward adjustment of smaller samples falsely signal misfit. Our observations suggest that sample sizes around N = 250 to N = 500 may provide a good balance for the statistical interpretation of the RUMM fit statistics studied here with respect to Type I errors and under the assumption of Rasch model fit within the examined frame of reference (i.e., about 25 item parameters well targeted to the sample).

  11. Modern psychometrics for assessing achievement goal orientation: a Rasch analysis.

    Science.gov (United States)

    Muis, Krista R; Winne, Philip H; Edwards, Ordene V

    2009-09-01

    A program of research is needed that assesses the psychometric properties of instruments designed to quantify students' achievement goal orientations to clarify inconsistencies across previous studies and to provide a stronger basis for future research. We conducted traditional psychometric and modern Rasch-model analyses of the Achievement Goals Questionnaire (AGQ, Elliot & McGregor, 2001) and the Patterns of Adaptive Learning Scale (PALS, Midgley et al., 2000) to provide an in-depth analysis of the two most popular instruments in educational psychology. For Study 1, 217 undergraduate students enrolled in educational psychology courses participated. Thirty-four were male and 181 were female (two did not respond). Participants completed the AGQ in the context of their educational psychology class. For Study 2, 126 undergraduate students enrolled in educational psychology courses participated. Thirty were male and 95 were female (one did not respond). Participants completed the PALS in the context of their educational psychology class. Traditional psychometric assessments of the AGQ and PALS replicated previous studies. For both, reliability estimates ranged from good to very good for raw subscale scores and fit for the models of goal orientations were good. Based on traditional psychometrics, the AGQ and PALS are valid and reliable indicators of achievement goals. Rasch analyses revealed that estimates of reliability for items were very good but respondent ability estimates varied from poor to good for both the AGQ and PALS. These findings indicate that items validly and reliably reflect a group's aggregate goal orientation, but using either instrument to characterize an individual's goal orientation is hazardous.

  12. Rasch Measurement of Collaborative Problem Solving in an Online Environment.

    Science.gov (United States)

    Harding, Susan-Marie E; Griffin, Patrick E

    2016-01-01

    This paper describes an approach to the assessment of human to human collaborative problem solving using a set of online interactive tasks completed by student dyads. Within the dyad, roles were nominated as either A or B and students selected their own roles. The question as to whether role selection affected individual student performance measures is addressed. Process stream data was captured from 3402 students in six countries who explored the problem space by clicking, dragging the mouse, moving the cursor and collaborating with their partner through a chat box window. Process stream data were explored to identify behavioural indicators that represented elements of a conceptual framework. These indicative behaviours were coded into a series of dichotomous items. These items represented actions and chats performed by students. The frequency of occurrence was used as a proxy measure of item difficulty. Then given a measure of item difficulty, student ability could be estimated using the difficulty estimates of the range of items demonstrated by the student. The Rasch simple logistic model was used to review the indicators to identify those that were consistent with the assumptions of the model and were invariant across national samples, language, curriculum and age of the student. The data were analysed using a one and two dimension, one parameter model. Rasch separation reliability, fit to the model, distribution of students and items on the underpinning construct, estimates for each country and the effect of role differences are reported. This study provides evidence that collaborative problem solving can be assessed in an online environment involving human to human interaction using behavioural indicators shown to have a consistent relationship between the estimate of student ability, and the probability of demonstrating the behaviour.

  13. Scale construction utilising the Rasch unidimensional measurement model: A measurement of adolescent attitudes towards abortion.

    Science.gov (United States)

    Hendriks, Jacqueline; Fyfe, Sue; Styles, Irene; Skinner, S Rachel; Merriman, Gareth

    2012-01-01

    Measurement scales seeking to quantify latent traits like attitudes, are often developed using traditional psychometric approaches. Application of the Rasch unidimensional measurement model may complement or replace these techniques, as the model can be used to construct scales and check their psychometric properties. If data fit the model, then a scale with invariant measurement properties, including interval-level scores, will have been developed. This paper highlights the unique properties of the Rasch model. Items developed to measure adolescent attitudes towards abortion are used to exemplify the process. Ten attitude and intention items relating to abortion were answered by 406 adolescents aged 12 to 19 years, as part of the "Teen Relationships Study". The sampling framework captured a range of sexual and pregnancy experiences. Items were assessed for fit to the Rasch model including checks for Differential Item Functioning (DIF) by gender, sexual experience or pregnancy experience. Rasch analysis of the original dataset initially demonstrated that some items did not fit the model. Rescoring of one item (B5) and removal of another (L31) resulted in fit, as shown by a non-significant item-trait interaction total chi-square and a mean log residual fit statistic for items of -0.05 (SD=1.43). No DIF existed for the revised scale. However, items did not distinguish as well amongst persons with the most intense attitudes as they did for other persons. A person separation index of 0.82 indicated good reliability. Application of the Rasch model produced a valid and reliable scale measuring adolescent attitudes towards abortion, with stable measurement properties. The Rasch process provided an extensive range of diagnostic information concerning item and person fit, enabling changes to be made to scale items. This example shows the value of the Rasch model in developing scales for both social science and health disciplines.

  14. An Analysis of Cross Racial Identity Scale Scores Using Classical Test Theory and Rasch Item Response Models

    Science.gov (United States)

    Sussman, Joshua; Beaujean, A. Alexander; Worrell, Frank C.; Watson, Stevie

    2013-01-01

    Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…

  15. TESTING THE ASSUMPTIONS AND INTERPRETING THE RESULTS OF THE RASCH MODEL USING LOG-LINEAR PROCEDURES IN SPSS

    NARCIS (Netherlands)

    TENVERGERT, E; GILLESPIE, M; KINGMA, J

    This paper shows how to use the log-linear subroutine of SPSS to fit the Rasch model. It also shows how to fit less restrictive models obtained by relaxing specific assumptions of the Rasch model. Conditional maximum likelihood estimation was achieved by including dummy variables for the total

  16. A Cross-Cultural Validation of Stage Development: A Rasch Re-Analysis of Longitudinal Socio-Moral Reasoning Data

    Science.gov (United States)

    Boom, Jan; Wouters, Hans; Keller, Monika

    2007-01-01

    Kohlberg's characterization of moral development as displaying an invariant hierarchical order of structurally consistent stages is losing ground. However, by applying Rasch analysis, Dawson recently gave new interpretation and support to his characterization of stage development. Using Rasch models, we replicated and strengthened her findings in…

  17. Teachers' Checklist on Reading-Related Behavioral Characteristics of Chinese Primary Students: A Rasch Measurement Model Analysis

    Science.gov (United States)

    Chan, David W.; Ho, Connie Suk-han; Chung, Kevin K. H.; Tsang, Suk-man; Lee, Suk-han

    2010-01-01

    Data of item responses to the Hong Kong Specific Learning Difficulties Behaviour Checklist from 673 Chinese primary grade students were analyzed using the dichotomous Rasch measurement model. Rasch scaling suggested that the data fit the model adequately with a latent dimension of global dyslexic dysfunctioning. Estimates of item attributes and…

  18. Obtaining Content Weights for Test Specifications from Job Analysis Task Surveys: An Application of the Many-Facets Rasch Model

    Science.gov (United States)

    Wang, Ning; Stahl, John

    2012-01-01

    This article discusses the use of the Many-Facets Rasch Model, via the FACETS computer program (Linacre, 2006a), to scale job/practice analysis survey data as well as to combine multiple rating scales into single composite weights representing the tasks' relative importance. Results from the Many-Facets Rasch Model are compared with those…

  19. Acceptance on Mobile Learning via SMS: A Rasch Model Analysis

    Directory of Open Access Journals (Sweden)

    Issham Ismail

    2010-04-01

    Full Text Available This study investigated whether mobile learning via Short Message Service (SMS-learning is accepted by the students enrolled in the distance learning academic programme in the Universiti Sains Malaysia. This study explored the impact of perceived usefulness, perceived ease of use and usability of the system to their acceptability. The survey was constructed using a questionnaire consisting of statements regarding the participants’ demographics, experiences in and perception of using mobile learning via SMS, involving 105 students from management and sciences disciplines. The Rasch Model Analysis was used for measurement correspond to a 5 point Likert. Results indicated that the usability of the system contributed to be effectiveness in assisting the students with their study. Respondents agree that SMS-learning is easy, effective and useful to help them study. However, the results found that there has been a problem in mobile learning that less interaction with lecturers. It implies that the acceptability of students to this mode on communication and interaction is highly endorsed.

  20. Rasch-modeling the Portuguese SOCRATES in a clinical sample.

    Science.gov (United States)

    Lopes, Paulo; Prieto, Gerardo; Delgado, Ana R; Gamito, Pedro; Trigo, Hélder

    2010-06-01

    The Stages of Change Readiness and Treatment Eagerness Scale (SOCRATES) assesses motivation for treatment in the drug-dependent population. The development of adequate measures of motivation is needed in order to properly understand the role of this construct in rehabilitation. This study probed the psychometric properties of the SOCRATES in the Portuguese population by means of the Rasch Rating Scale Model, which allows the conjoint measurement of items and persons. The participants were 166 substance abusers under treatment for their addiction. Results show that the functioning of the five response categories is not optimal; our re-analysis indicates that a three-category system is the most appropriate one. By using this response category system, both model fit and estimation accuracy are improved. The discussion takes into account other factors such as item format and content in order to make suggestions for the development of better motivation-for-treatment scales. (PsycINFO Database Record (c) 2010 APA, all rights reserved).

  1. USING RASCH ANALYSIS TO EXPLORE WHAT STUDENTS LEARN ABOUT PROBABILITY CONCEPTS

    Directory of Open Access Journals (Sweden)

    Zamalia Mahmud

    2015-01-01

    Full Text Available Students’ understanding of probability concepts have been investigated from various different perspectives. This study was set out to investigate perceived understanding of probability concepts of forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW. Rasch measurement which is based on a probabilistic model was used to identify concepts that students find easy, moderate and difficult to understand.  Data were captured from the e-learning Moodle platform where students provided their responses through an on-line quiz. As illustrated in the Rasch map, 96% of the students could understand about sample space, simple events, mutually exclusive events and tree diagram while 67% of the students found concepts of conditional and independent events rather easy to understand.Keywords: Perceived Understanding, Probability Concepts, Rasch Measurement Model DOI: dx.doi.org/10.22342/jme.61.1

  2. Measuring Instrument Constructs of Return Factors for Green Office Building Investments Variables Using Rasch Measurement Model

    Directory of Open Access Journals (Sweden)

    Isa Mona

    2016-01-01

    Full Text Available This paper is a preliminary study on rationalising green office building investments in Malaysia. The aim of this paper is attempt to introduce the application of Rasch measurement model analysis to determine the validity and reliability of each construct in the questionnaire. In achieving this objective, a questionnaire survey was developed consists of 6 sections and a total of 106 responses were received from various investors who own and lease office buildings in Kuala Lumpur. The Rasch Measurement analysis is used to measure the quality control of item constructs in the instrument by measuring the specific objectivity within the same dimension, to reduce ambiguous measures, and a realistic estimation of precision and implicit quality. The Rasch analysis consists of the summary statistics, item unidimensionality and item measures. A result shows the items and respondent (person reliability is at 0.91 and 0.95 respectively.

  3. Rasch scaling paranormal belief and experience: structure and semantics of Thalbourne's Australian Sheep-Goat Scale.

    Science.gov (United States)

    Lange, Rense; Thalbourne, Michael A

    2002-12-01

    Research on the relation between demographic variables and paranormal belief remains controversial given the possible semantic distortions introduced by item and test level biases. We illustrate how Rasch scaling can be used to detect such biases and to quantify their effects, using the Australian Sheep-Goal Scale as a substantive example. Based on data from 1.822 respondents, this test was Rasch scalable, reliable, and unbiased at the test level. Consistent with other research in which unbiased measures of paranormal belief were used, extremely weak age and sex effects were found (partial eta2 = .005 and .012, respectively).

  4. Rasch scaling of the Oswestry Disability Index and the Roland-Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Lauridsen, Henrik Hein; Hartvigsen, Jan

    Questionnaire (RMQ) and the Oswestry Disability Index (ODI), however, only few studies have tested these questionnaires using Rasch analysis. This study used Rasch scaling to test the construct validity of the Danish versions of the RMQ (23-item Patrick version) and the ODI (version 2.1a) in a heterogeneous...... on an ordinal scale into interval scaling in addition to optimising the fit of instrument items to the target population. In low back pain research the two most commonly used and well-validated questionnaires to assess functional status in patients with low back pain are the Roland-Morris Disability...

  5. %lrasch_mml: A SAS Macro for Marginal Maximum Likelihood Estimation in Longitudinal Polytomous Rasch Models

    Directory of Open Access Journals (Sweden)

    Maja Olsbjerg

    2015-10-01

    Full Text Available Item response theory models are often applied when a number items are used to measure a unidimensional latent variable. Originally proposed and used within educational research, they are also used when focus is on physical functioning or psychological wellbeing. Modern applications often need more general models, typically models for multidimensional latent variables or longitudinal models for repeated measurements. This paper describes a SAS macro that fits two-dimensional polytomous Rasch models using a specification of the model that is sufficiently flexible to accommodate longitudinal Rasch models. The macro estimates item parameters using marginal maximum likelihood estimation. A graphical presentation of item characteristic curves is included.

  6. A Rasch Analysis of the Junior Metacognitive Awareness Inventory with Singapore Students

    Science.gov (United States)

    Ning, Hoi Kwan

    2018-01-01

    The psychometric properties of the 2 versions of the Junior Metacognitive Awareness Inventory were examined with Singapore student samples. Other than 2 misfitting items and an underutilized response scale, Rasch analysis demonstrated that the instruments have good measurement precision, and no differential item functioning was detected across…

  7. A psychometric revision of the Asian values scale using the Rasch model

    OpenAIRE

    Kim, Bryan S. K.; Hong, Sehee

    2004-01-01

    The 36-item Asian Values Scale (B. S. K. Kim, D. R. Atkinson, & P H. Yang, 1999) was revised on the basis of G. Rasch (1960) model and data from 618 Asian Americans. The results led to the establishment of a 25-item measure named the Asian Values Scale-Revised.

  8. Using and Developing Measurement Instruments in Science Education: A Rasch Modeling Approach. Science & Engineering Education Sources

    Science.gov (United States)

    Liu, Xiufeng

    2010-01-01

    This book meets a demand in the science education community for a comprehensive and introductory measurement book in science education. It describes measurement instruments reported in refereed science education research journals, and introduces the Rasch modeling approach to developing measurement instruments in common science assessment domains,…

  9. Latent trait standardization of the benzodiazepine dependence self-report questionnaire using the Rasch scaling model.

    NARCIS (Netherlands)

    Kan, C.C.; Ven, A.H.G.S. van der; Breteler, M.H.M.; Zitman, F.G.

    2001-01-01

    The aim of the present study was to obtain standardized scores that correspond with the raw scores on the four Rasch scales of the Benzodiazepine Dependence-Self Report Questionnaire (Bendep-SRQ). The eligible normative group for standardization of the Bendep-SRQ scales consisted of 217 general

  10. Latent Trait Standardization of the Benzodiazepine Dependence Self-Report Questionnaire using the Rasch Scaling Model

    NARCIS (Netherlands)

    Kan, C.C.; Ven, A.H.G.S. van der; Breteler, M.H.M.; Zitman, F.G.

    2001-01-01

    The aim of the present study was to obtain standardized scores that correspond with the raw scores on the four Rasch scales of the Benzodiazepine Dependence-Self Report Questionnaire (Bendep-SRQ). The eligible normative group for standardization of the Bendep-SRQ scales consisted of 217 general

  11. Quantifying Local, Response Dependence between Two Polytomous Items Using the Rasch Model

    Science.gov (United States)

    Andrich, David; Humphry, Stephen M.; Marais, Ida

    2012-01-01

    Models of modern test theory imply statistical independence among responses, generally referred to as "local independence." One violation of local independence occurs when the response to one item governs the response to a subsequent item. Expanding on a formulation of this kind of violation as a process in the dichotomous Rasch model,…

  12. Using the Mixture Rasch Model to Explore Knowledge Resources Students Invoke in Mathematic and Science Assessments

    Science.gov (United States)

    Zhang, Danhui; Orrill, Chandra; Campbell, Todd

    2015-01-01

    The purpose of this study was to investigate whether mixture Rasch models followed by qualitative item-by-item analysis of selected Programme for International Student Assessment (PISA) mathematics and science items offered insight into knowledge students invoke in mathematics and science separately and combined. The researchers administered an…

  13. Historical Views of Invariance: Evidence from the Measurement Theories of Thorndike, Thurstone, and Rasch.

    Science.gov (United States)

    Engelhard, George, Jr.

    1992-01-01

    A historical perspective is provided of the concept of invariance in measurement theory, describing sample-invariant item calibration and item-invariant measurement of individuals. Invariance as a key measurement concept is illustrated through the measurement theories of E. L. Thorndike, L. L. Thurstone, and G. Rasch. (SLD)

  14. Thorndike, Thurstone and Rasch: A Comparison of Their Approaches to Item-Invariant Measurement.

    Science.gov (United States)

    Englehard, George, Jr.

    The methods used by E. L. Thorndike, L. L. Thurstone, and G. Rasch to address issues related to item-invariant measurement and the scoring of individual performance are compared. The analyses highlight the close connection among the three methods, and suggest that progress in measurement theory reflects the movement from essentially ad hoc methods…

  15. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS).

    Science.gov (United States)

    Shea, Tracey L; Tennant, Alan; Pallant, Julie F

    2009-05-09

    There is a growing awareness of the need for easily administered, psychometrically sound screening tools to identify individuals with elevated levels of psychological distress. Although support has been found for the psychometric properties of the Depression, Anxiety and Stress Scales (DASS) using classical test theory approaches it has not been subjected to Rasch analysis. The aim of this study was to use Rasch analysis to assess the psychometric properties of the DASS-21 scales, using two different administration modes. The DASS-21 was administered to 420 participants with half the sample responding to a web-based version and the other half completing a traditional pencil-and-paper version. Conformity of DASS-21 scales to a Rasch partial credit model was assessed using the RUMM2020 software. To achieve adequate model fit it was necessary to remove one item from each of the DASS-21 subscales. The reduced scales showed adequate internal consistency reliability, unidimensionality and freedom from differential item functioning for sex, age and mode of administration. Analysis of all DASS-21 items combined did not support its use as a measure of general psychological distress. A scale combining the anxiety and stress items showed satisfactory fit to the Rasch model after removal of three items. The results provide support for the measurement properties, internal consistency reliability, and unidimensionality of three slightly modified DASS-21 scales, across two different administration methods. The further use of Rasch analysis on the DASS-21 in larger and broader samples is recommended to confirm the findings of the current study.

  16. Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

    Science.gov (United States)

    Vaughan, Brett

    2018-01-01

    Clinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Questionnaire. The current study utilised Rasch analysis to investigate the construct validity of the Osteopathy Clinical Teaching Questionnaire and provide evidence for the validity argument through fit to the Rasch model. Senior osteopathy students at four institutions in Australia, New Zealand and the United Kingdom rated their clinical teachers using the Osteopathy Clinical Teaching Questionnaire. Three hundred and ninety-nine valid responses were received and the data were evaluated for fit to the Rasch model. Reliability estimations (Cronbach's alpha and McDonald's omega) were also evaluated for the final model. The initial analysis demonstrated the data did not fit the Rasch model. Accordingly, modifications to the questionnaire were made including removing items, removing person responses, and rescoring one item. The final model contained 12 items and fit to the Rasch model was adequate. Support for unidimensionality was demonstrated through both the Principal Components Analysis/t-test, and the Cronbach's alpha and McDonald's omega reliability estimates. Analysis of the questionnaire using McDonald's omega hierarchical supported a general factor (quality of clinical teaching in osteopathy). The evidence for unidimensionality and the presence of a general factor support the calculation of a total score for the questionnaire as a sufficient statistic. Further work is now required to investigate the reliability of the 12-item Osteopathy Clinical Teaching Questionnaire to provide evidence

  17. Assessing social isolation in motor neurone disease: a Rasch analysis of the MND Social Withdrawal Scale.

    Science.gov (United States)

    Gibbons, Chris J; Thornton, Everard W; Ealing, John; Shaw, Pamela J; Talbot, Kevin; Tennant, Alan; Young, Carolyn A

    2013-11-15

    Social withdrawal is described as the condition in which an individual experiences a desire to make social contact, but is unable to satisfy that desire. It is an important issue for patients with motor neurone disease who are likely to experience severe physical impairment. This study aims to reassess the psychometric and scaling properties of the MND Social Withdrawal Scale (MND-SWS) domains and examine the feasibility of a summary scale, by applying scale data to the Rasch model. The MND Social Withdrawal Scale was administered to 298 patients with a diagnosis of MND, alongside the Hospital Anxiety and Depression Scale. The factor structure of the MND Social Withdrawal Scale was assessed using confirmatory factor analysis. Model fit, category threshold analysis, differential item functioning (DIF), dimensionality and local dependency were evaluated. Factor analysis confirmed the suitability of the four-factor solution suggested by the original authors. Mokken scale analysis suggested the removal of item five. Rasch analysis removed a further three items; from the Community (one item) and Emotional (two items) withdrawal subscales. Following item reduction, each scale exhibited excellent fit to the Rasch model. A 14-item Summary scale was shown to fit the Rasch model after subtesting the items into three subtests corresponding to the Community, Family and Emotional subscales, indicating that items from these three subscales could be summed together to create a total measure for social withdrawal. Removal of four items from the Social Withdrawal Scale led to a four factor solution with a 14-item hierarchical Summary scale that were all unidimensional, free for DIF and well fitted to the Rasch model. The scale is reliable and allows clinicians and researchers to measure social withdrawal in MND along a unidimensional construct. © 2013. Published by Elsevier B.V. All rights reserved.

  18. Comparison of CTT and Rasch-based approaches for the analysis of longitudinal Patient Reported Outcomes.

    Science.gov (United States)

    Blanchin, Myriam; Hardouin, Jean-Benoit; Le Neel, Tanguy; Kubis, Gildas; Blanchard, Claire; Mirallié, Eric; Sébille, Véronique

    2011-04-15

    Health sciences frequently deal with Patient Reported Outcomes (PRO) data for the evaluation of concepts, in particular health-related quality of life, which cannot be directly measured and are often called latent variables. Two approaches are commonly used for the analysis of such data: Classical Test Theory (CTT) and Item Response Theory (IRT). Longitudinal data are often collected to analyze the evolution of an outcome over time. The most adequate strategy to analyze longitudinal latent variables, which can be either based on CTT or IRT models, remains to be identified. This strategy must take into account the latent characteristic of what PROs are intended to measure as well as the specificity of longitudinal designs. A simple and widely used IRT model is the Rasch model. The purpose of our study was to compare CTT and Rasch-based approaches to analyze longitudinal PRO data regarding type I error, power, and time effect estimation bias. Four methods were compared: the Score and Mixed models (SM) method based on the CTT approach, the Rasch and Mixed models (RM), the Plausible Values (PV), and the Longitudinal Rasch model (LRM) methods all based on the Rasch model. All methods have shown comparable results in terms of type I error, all close to 5 per cent. LRM and SM methods presented comparable power and unbiased time effect estimations, whereas RM and PV methods showed low power and biased time effect estimations. This suggests that RM and PV methods should be avoided to analyze longitudinal latent variables. Copyright © 2010 John Wiley & Sons, Ltd.

  19. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS)

    Science.gov (United States)

    Shea, Tracey L; Tennant, Alan; Pallant, Julie F

    2009-01-01

    Background There is a growing awareness of the need for easily administered, psychometrically sound screening tools to identify individuals with elevated levels of psychological distress. Although support has been found for the psychometric properties of the Depression, Anxiety and Stress Scales (DASS) using classical test theory approaches it has not been subjected to Rasch analysis. The aim of this study was to use Rasch analysis to assess the psychometric properties of the DASS-21 scales, using two different administration modes. Methods The DASS-21 was administered to 420 participants with half the sample responding to a web-based version and the other half completing a traditional pencil-and-paper version. Conformity of DASS-21 scales to a Rasch partial credit model was assessed using the RUMM2020 software. Results To achieve adequate model fit it was necessary to remove one item from each of the DASS-21 subscales. The reduced scales showed adequate internal consistency reliability, unidimensionality and freedom from differential item functioning for sex, age and mode of administration. Analysis of all DASS-21 items combined did not support its use as a measure of general psychological distress. A scale combining the anxiety and stress items showed satisfactory fit to the Rasch model after removal of three items. Conclusion The results provide support for the measurement properties, internal consistency reliability, and unidimensionality of three slightly modified DASS-21 scales, across two different administration methods. The further use of Rasch analysis on the DASS-21 in larger and broader samples is recommended to confirm the findings of the current study. PMID:19426512

  20. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2009-05-01

    Full Text Available Abstract Background There is a growing awareness of the need for easily administered, psychometrically sound screening tools to identify individuals with elevated levels of psychological distress. Although support has been found for the psychometric properties of the Depression, Anxiety and Stress Scales (DASS using classical test theory approaches it has not been subjected to Rasch analysis. The aim of this study was to use Rasch analysis to assess the psychometric properties of the DASS-21 scales, using two different administration modes. Methods The DASS-21 was administered to 420 participants with half the sample responding to a web-based version and the other half completing a traditional pencil-and-paper version. Conformity of DASS-21 scales to a Rasch partial credit model was assessed using the RUMM2020 software. Results To achieve adequate model fit it was necessary to remove one item from each of the DASS-21 subscales. The reduced scales showed adequate internal consistency reliability, unidimensionality and freedom from differential item functioning for sex, age and mode of administration. Analysis of all DASS-21 items combined did not support its use as a measure of general psychological distress. A scale combining the anxiety and stress items showed satisfactory fit to the Rasch model after removal of three items. Conclusion The results provide support for the measurement properties, internal consistency reliability, and unidimensionality of three slightly modified DASS-21 scales, across two different administration methods. The further use of Rasch analysis on the DASS-21 in larger and broader samples is recommended to confirm the findings of the current study.

  1. Teater vajab ellujäämiseks värsket dramaturgiat / Jane Rasch ; vahendanud Eva-Liisa Linder

    Index Scriptorium Estoniae

    Rasch, Jane

    2009-01-01

    Taani teatriteadlane Jane Rasch õpetas 10.-14. augustini 2009 Viljandi Kultuuriakadeemias toimunud draamakirjutuskursusel "Ideedest näidendi stsenaariumini". Ka näitekirjanike koolitamisest Taanis jt. Põhjamaades

  2. Power analysis on the time effect for the longitudinal Rasch model.

    Science.gov (United States)

    Feddag, M L; Blanchin, M; Hardouin, J B; Sebille, V

    2014-01-01

    Statistics literature in the social, behavioral, and biomedical sciences typically stress the importance of power analysis. Patient Reported Outcomes (PRO) such as quality of life and other perceived health measures (pain, fatigue, stress,...) are increasingly used as important health outcomes in clinical trials or in epidemiological studies. They cannot be directly observed nor measured as other clinical or biological data and they are often collected through questionnaires with binary or polytomous items. The Rasch model is the well known model in the item response theory (IRT) for binary data. The article proposes an approach to evaluate the statistical power of the time effect for the longitudinal Rasch model with two time points. The performance of this method is compared to the one obtained by simulation study. Finally, the proposed approach is illustrated on one subscale of the SF-36 questionnaire.

  3. USING RASCH ANALYSIS TO EXPLORE WHAT STUDENTS LEARN ABOUT PROBABILITY CONCEPTS

    Directory of Open Access Journals (Sweden)

    Zamalia Mahmud

    2015-01-01

    Full Text Available Students’ understanding of probability concepts have been investigated from various different perspectives. This study was set out to investigate perceived understanding of probability concepts of forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW. Rasch measurement which is based on a probabilistic model was used to identify concepts that students find easy, moderate and difficult to understand. Data were captured from the e-learning Moodle platform where students provided their responses through an on-line quiz. As illustrated in the Rasch map, 96% of the students could understand about sample space, simple events, mutually exclusive events and tree diagram while 67% of the students found concepts of conditional and independent events rather easy to understand

  4. Using Rasch Analysis To Explore What Students Learn About Probability Concepts

    Directory of Open Access Journals (Sweden)

    Zamalia Mahmud

    2015-01-01

    Full Text Available Students’ understanding of probability concepts have been investigated from various different perspectives. This study was set out to investigate perceived understanding of probability concepts of forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW. Rasch measurement which is based on a probabilistic model was used to identify concepts that students find easy, moderate and difficult to understand. Data were captured from the e-learning Moodle platform where students provided their responses through an on-line quiz. As illustrated in the Rasch map, 96% of the students could understand about sample space, simple events, mutually exclusive events and tree diagram while 67% of the students found concepts of conditional and independent events rather easy to understand.

  5. Accounting for Local Dependence with the Rasch Model: The Paradox of Information Increase.

    Science.gov (United States)

    Andrich, David

    Test theories imply statistical, local independence. Where local independence is violated, models of modern test theory that account for it have been proposed. One violation of local independence occurs when the response to one item governs the response to a subsequent item. Expanding on a formulation of this kind of violation between two items in the dichotomous Rasch model, this paper derives three related implications. First, it formalises how the polytomous Rasch model for an item constituted by summing the scores of the dependent items absorbs the dependence in its threshold structure. Second, it shows that as a consequence the unit when the dependence is accounted for is not the same as if the items had no response dependence. Third, it explains the paradox, known, but not explained in the literature, that the greater the dependence of the constituent items the greater the apparent information in the constituted polytomous item when it should provide less information.

  6. On the Construct Validity of the Academic Motivation Scale: a CFA and Rasch Analysis approach

    DEFF Research Database (Denmark)

    Andersen, Martin Stolpe; Nielsen, Tine

    subscales measuring Extrinsic Motivation (EM) and one scale measuring Amotivation (AM), each with 4 items. The AMS was translated into Danish and data was collected from psychology students (N = 607) at two Danish universities in 6 different study terms. The construct validity of the seven scales was first...... investigated using confirmatory factor analysis with mixed results of some acceptable and some non-acceptable fit indices for the model. Secondly, Rasch analyses were conducted for each of the seven subscales, using the partial credit model (PCM) and graphical loglinear rasch models (GLLRM). This resulted...... in fit to the PCM in the case of IM to Accomplish (retaining three out of four items), and fit to GLLRMs in two cases: 1) IM to know with evidence of local dependence between all four items. 2) AM (retaining three out of four items) with evidence of gender-based differential item functioning, which...

  7. Measuring parental stress in mothers of infants: A Rasch-based construct validity study

    DEFF Research Database (Denmark)

    Nielsen, Tine; Pontoppidan, Maiken; Kristensen, Ingeborg Hedegaard

    of the Danish language version of the PSS in a community sample of 1110 mothers of children aged 0 to 12 months employing the Rasch family of IRT models, and emphasizing the issues of unidimensionality and equal item functioning (no DIF) relative to the age and educational levels of the mothers. No adequate fit......) were found each to fit so-called graphical loglinear Rasch models: The parental stress subscale fit a model adjusted for local response dependence between some item pairs, as well as DIF for one item relative to mothers’ level of education and DIF for another item relative to age and educational level...... of the mothers. The parental satisfaction subscale fit a model adjusted only for local response dependence. The findings are in line with the original interpretation of the PSS. We recommend that the scoring of the PSS is changed to reflect the two subscales and the dichotomization of response categories...

  8. Rasch family models in e-learning: analyzing architectural sketching with a digital pen.

    Science.gov (United States)

    Scalise, Kathleen; Cheng, Nancy Yen-Wen; Oskui, Nargas

    2009-01-01

    Since architecture students studying design drawing are usually assessed qualitatively on the basis of their final products, the challenges and stages of their learning have remained masked. To clarify the challenges in design drawing, we have been using the BEAR Assessment System and Rasch family models to measure levels of understanding for individuals and groups, in order to correct pedagogical assumptions and tune teaching materials. This chapter discusses the analysis of 81 drawings created by architectural students to solve a space layout problem, collected and analyzed with digital pen-and-paper technology. The approach allows us to map developmental performance criteria and perceive achievement overlaps in learning domains assumed separate, and then re-conceptualize a three-part framework to represent learning in architectural drawing. Results and measurement evidence from the assessment and Rasch modeling are discussed.

  9. Sensitivity of Mantel Haenszel Model and Rasch Model as Viewed From Sample Size

    OpenAIRE

    ALWI, IDRUS

    2011-01-01

    The aims of this research is to study the sensitivity comparison of Mantel Haenszel and Rasch Model for detection differential item functioning, observed from the sample size. These two differential item functioning (DIF) methods were compared using simulate binary item respon data sets of varying sample size,  200 and 400 examinees were used in the analyses, a detection method of differential item functioning (DIF) based on gender difference. These test conditions were replication 4 tim...

  10. Rasch-built Overall Disability Scale (R-ODS) for immune-mediated peripheral neuropathies.

    Science.gov (United States)

    van Nes, S I; Vanhoutte, E K; van Doorn, P A; Hermans, M; Bakkers, M; Kuitwaard, K; Faber, C G; Merkies, I S J

    2011-01-25

    To develop a patient-based, linearly weighted scale that captures activity and social participation limitations in patients with Guillain-Barré syndrome (GBS), chronic inflammatory demyelinating polyradiculoneuropathy (CIDP), and gammopathy-related polyneuropathy (MGUSP). A preliminary Rasch-built Overall Disability Scale (R-ODS) containing 146 activity and participation items was constructed, based on the WHO International Classification of Functioning, Disability and Health, literature search, and patient interviews. The preliminary R-ODS was assessed twice (interval: 2-4 weeks; test-retest reliability studies) in 294 patients who experienced GBS in the past (n = 174) or currently have stable CIDP (n = 80) or MGUSP (n = 40). Data were analyzed using the Rasch unidimensional measurement model (RUMM2020). The preliminary R-ODS did not meet the Rasch model expectations. Based on disordered thresholds, misfit statistics, item bias, and local dependency, items were systematically removed to improve the model fit, regularly controlling the class intervals and model statistics. Finally, we succeeded in constructing a 24-item scale that fulfilled all Rasch requirements. "Reading a newspaper/book" and "eating" were the 2 easiest items; "standing for hours" and "running" were the most difficult ones. Good validity and reliability were obtained. The R-ODS is a linearly weighted scale that specifically captures activity and social participation limitations in patients with GBS, CIDP, and MGUSP. Compared to the Overall Disability Sum Score, the R-ODS represents a wider range of item difficulties, thereby better targeting patients with different ability levels. If responsive, the R-ODS will be valuable for future clinical trials and follow-up studies in these conditions.

  11. Measuring situational avoidance in older drivers: An application of Rasch analysis.

    Science.gov (United States)

    Davis, Jessica; Conlon, Elizabeth; Ownsworth, Tamara; Morrissey, Shirley

    2016-02-01

    Situational avoidance is a form of driving self-regulation at the strategic level of driving behaviour. It has typically been defined as the purposeful avoidance of driving situations perceived as challenging or potentially hazardous. To date, assessment of the psychometric properties of existing scales that measure situational avoidance has been sparse. This study examined the contribution of Rasch analysis to the situational avoidance construct. Three hundred and ninety-nine Australian drivers (M=66.75, SD=10.14, range: 48-91 years) completed the Situational Avoidance Questionnaire (SAQ). Following removal of the item Parallel Parking, the scale conformed to a Rasch model, showing good person separation, sufficient reliability, little disordering of thresholds, and no evidence of differential item functioning by age or gender. The residuals were independent supporting the assumption of unidimensionality and in conforming to a Rasch model, SAQ items were found to be hierarchical or cumulative. Increased avoidance was associated with factors known to be related to driving self-regulation more broadly, including older age, female gender, reduced driving space and frequency, reporting a change in driving in the past five years and poorer indices of health (i.e., self-rated mood, vision and cognitive function). Overall, these results support the use of the SAQ as a psychometrically sound measure of situational avoidance. Application of Rasch analysis to this area of research advances understanding of the driving self-regulation construct and its practice by drivers in baby boomer and older adult generations. Copyright © 2015 Elsevier Ltd. All rights reserved.

  12. Scale construction utilising the Rasch unidimensional measurement model: A measurement of adolescent attitudes towards abortion

    Directory of Open Access Journals (Sweden)

    Jacqueline Hendriks

    2012-05-01

    Full Text Available BackgroundMeasurement scales seeking to quantify latent traits likeattitudes, are often developed using traditionalpsychometric approaches. Application of the Raschunidimensional measurement model may complement orreplace these techniques, as the model can be used toconstruct scales and check their psychometric properties. Ifdata fit the model, then a scale with invariant measurementproperties, including interval-level scores, will have beendeveloped.AimsThis paper highlights the unique properties of the Raschmodel. Items developed to measure adolescent attitudestowards abortion are used to exemplify the process.MethodTen attitude and intention items relating to abortion wereanswered by 406 adolescents aged 12 to 19 years, as part ofthe “Teen Relationships Study”. The sampling frameworkcaptured a range of sexual and pregnancy experiences.Items were assessed for fit to the Rasch model includingchecks for Differential Item Functioning (DIF by gender,sexual experience or pregnancy experience.ResultsRasch analysis of the original dataset initially demonstratedthat some items did not fit the model. Rescoring of one item(B5 and removal of another (L31 resulted in fit, as shownby a non-significant item-trait interaction total chi-squareand a mean log residual fit statistic for items of -0.05(SD=1.43. No DIF existed for the revised scale. However,items did not distinguish as well amongst persons with themost intense attitudes as they did for other persons. Aperson separation index of 0.82 indicated good reliability.ConclusionApplication of the Rasch model produced a valid andreliable scale measuring adolescent attitudes towardsabortion, with stable measurement properties. The Raschprocess provided an extensive range of diagnosticinformation concerning item and person fit, enablingchanges to be made to scale items. This example shows thevalue of the Rasch model in developing scales for bothsocial science and health disciplines.

  13. Quantitative Reasoning in Environmental Science: Rasch Measurement to Support QR Assessment

    Directory of Open Access Journals (Sweden)

    Robert L. Mayes

    2015-07-01

    Full Text Available The ability of middle and high school students to reason quantitatively within the context of environmental science was investigated. A quantitative reasoning (QR learning progression, with associated QR assessments in the content areas of biodiversity, water, and carbon, was developed based on three QR progress variables: quantification act, quantitative interpretation, and quantitative modeling. Diagnostic instruments were developed specifically for the progress variable quantitative interpretation (QI, each consisting of 96 Likert-scale items. Each content version of the instrument focused on three scale levels (macro scale, micro scale, and landscape scale and four elements of QI identified in prior research (trend, translation, prediction, and revision. The QI assessments were completed by 362, 6th to 12th grade students in three U.S. states. Rasch (1960/1980 measurement was used to determine item and person measures for the QI instruments, both to examine validity and reliability characteristics of the instrument administration and inform the evolution of the learning progression. Rasch methods allowed identification of several QI instrument revisions, including modification of specific items, reducing number of items to avoid cognitive fatigue, reconsidering proposed item difficulty levels, and reducing Likert scale to 4 levels. Rasch diagnostics also indicated favorable levels of instrument reliability and appropriate targeting of item abilities to student abilities for the majority of participants. A revised QI instrument is available for STEM researchers and educators.

  14. Application of Rasch analysis to the parent adherence report questionnaire in juvenile idiopathic arthritis.

    Science.gov (United States)

    Toupin April, Karine; Higgins, Johanne; Ehrmann Feldman, Debbie

    2016-07-28

    Adherence to treatment in children with juvenile idiopathic arthritis (JIA) is associated with better outcomes. Assessing patient adherence in JIA, as well as attitudes and beliefs about prescribed treatments, is important for the clinician in order to optimize patient management. The objective of the current study was to evaluate the psychometric properties of the Parent (proxy-report) Adherence Report Questionnaires (PARQ), which assesses beliefs and behaviors related to adherence to treatments prescribed for JIA. A Rasch analysis was conducted on data collected with parents of children with JIA from two studies in which the PARQ was used as a measure of adherence. The PARQ showed preliminary evidence of multidimensionality with two factors, accounting for 38 % and 27 % of the variance respectively. The PARQ in its original version does not adhere to expectations of the Rasch model. A transformed version of the PARQ obtained by deletion of the general adherence scale and modification of visual analog scales into 5-point likert scales improved fit to the model and showed preliminary evidence of unidimensionality. The PARQ was transformed based on the results of the Rasch analysis. The transformed version of the PARQ shows preliminary evidence of unidimensionality and may allow computation of a total score, although further testing is needed to verify these findings.

  15. Revalidating the Arabic Scale for Teachers' Ratings of Basic Education Gifted Students' Characteristics Using Rasch Modeling

    Directory of Open Access Journals (Sweden)

    Salah Eldin Farah Atallah Bakheit

    2013-12-01

    Full Text Available The Arabic scale for teachers' ratings of basic education gifted students' characteristics is one of the most common Arabic measures used for initial identification of gifted students in some Arabic countries. One of the shortcomings of this scale is that it is based on the classical the-ory of measurement. This study sought to reval-idate the scale in the light of Rasch modeling which rests upon the modern theory of meas-urement and to develop different criteria for in-terpreting the levels of individuals' traits. The scale was administered to 830 of Basic Educa-tion students in Khartoum (ages ranged from 7 to 12 years. Two groups of students partici-pated in the study: a calibration sample (N = 250 and a standardization sample (N = 580. The statistical treatments were performed using the PSAW 18 and RUMM 2020 programs ac-cording to Rasch's unidimentional model. Six of the scale's items were deleted for not conform-ing to Rasch Modeling. This left the scale with 31 items. Besides, new criteria for the scale were developed by obtaining the t-scores and special education scores that match the various ratings of the individuals' ability.

  16. Rasch analysis suggested three unidimensional domains for Affiliate Stigma Scale: additional psychometric evaluation.

    Science.gov (United States)

    Chang, Chih-Cheng; Su, Jian-An; Tsai, Ching-Shu; Yen, Cheng-Fang; Liu, Jiun-Horng; Lin, Chung-Ying

    2015-06-01

    To examine the psychometrics of the Affiliate Stigma Scale using rigorous psychometric analysis: classical test theory (CTT) (traditional) and Rasch analysis (modern). Differential item functioning (DIF) items were also tested using Rasch analysis. Caregivers of relatives with mental illness (n = 453; mean age: 53.29 ± 13.50 years) were recruited from southern Taiwan. Each participant filled out four questionnaires: Affiliate Stigma Scale, Rosenberg Self-Esteem Scale, Beck Anxiety Inventory, and one background information sheet. CTT analyses showed that the Affiliate Stigma Scale had satisfactory internal consistency (α = 0.85-0.94) and concurrent validity (Rosenberg Self-Esteem Scale: r = -0.52 to -0.46; Beck Anxiety Inventory: r = 0.27-0.34). Rasch analyses supported the unidimensionality of three domains in the Affiliate Stigma Scale and indicated four DIF items (affect domain: 1; cognitive domain: 3) across gender. Our findings, based on rigorous statistical analysis, verified the psychometrics of the Affiliate Stigma Scale and reported its DIF items. We conclude that the three domains of the Affiliate Stigma Scale can be separately used and are suitable for measuring the affiliate stigma of caregivers of relatives with mental illness. Copyright © 2015 Elsevier Inc. All rights reserved.

  17. Validating Quantitative Measurement Using Qualitative Data: Combining Rasch Scaling and Latent Semantic Analysis in Psychiatry

    Science.gov (United States)

    Lange, Rense

    2015-02-01

    An extension of concurrent validity is proposed that uses qualitative data for the purpose of validating quantitative measures. The approach relies on Latent Semantic Analysis (LSA) which places verbal (written) statements in a high dimensional semantic space. Using data from a medical / psychiatric domain as a case study - Near Death Experiences, or NDE - we established concurrent validity by connecting NDErs qualitative (written) experiential accounts with their locations on a Rasch scalable measure of NDE intensity. Concurrent validity received strong empirical support since the variance in the Rasch measures could be predicted reliably from the coordinates of their accounts in the LSA derived semantic space (R2 = 0.33). These coordinates also predicted NDErs age with considerable precision (R2 = 0.25). Both estimates are probably artificially low due to the small available data samples (n = 588). It appears that Rasch scalability of NDE intensity is a prerequisite for these findings, as each intensity level is associated (at least probabilistically) with a well- defined pattern of item endorsements.

  18. A Rasch and factor analysis of the Functional Assessment of Cancer Therapy-General (FACT-G

    Directory of Open Access Journals (Sweden)

    Selby Peter J

    2007-04-01

    Full Text Available Abstract Background Although the Functional Assessment of Cancer Therapy – General questionnaire (FACT-G has been validated few studies have explored the factor structure of the instrument, in particular using non-sample dependent measurement techniques, such as Rasch Models. Furthermore, few studies have explored the relationship between item fit to the Rasch Model and clinical utility. The aim of this study was to investigate the dimensionality and measurement properties of the FACT-G with Rasch Models and Factor analysis. Methods A factor analysis and Rasch analysis (Partial Credit Model was carried out on the FACT-G completed by a heterogeneous sample of cancer patients (n = 465. For the Rasch analysis item fit (infit mean squares ≥ 1.30, dimensionality and item invariance were assessed. The impact of removing misfitting items on the clinical utility of the subscales and FACT-G total scale was also assessed. Results The factor analysis demonstrated a four factor structure of the FACT-G which broadly corresponded to the four subscales of the instrument. Internal consistency for these four scales was very good (Cronbach's alpha 0.72 – 0.85. The Rasch analysis demonstrated that each of the subscales and the FACT-G total scale had misfitting items (infit means square ≥ 1.30. All these scales with the exception of the Social & Family Well-being Scale (SFWB were unidimensional. When misfitting items were removed, the effect sizes and the clinical utility of the instrument were maintained for the subscales and the total FACT-G scores. Conclusion The results of the traditional factor analysis and Rasch analysis of the FACT-G broadly agreed. Caution should be exercised when utilising the Social & Family Well-being scale and further work is required to determine whether this scale is best represented by two factors. Additionally, removing misfitting items from scales should be performed alongside an assessment of the impact on clinical utility.

  19. Rasch analysis of the Dutch version of the Oxford elbow score

    Directory of Open Access Journals (Sweden)

    de Haan J

    2011-08-01

    Full Text Available Jeroen de Haan1, Niels Schep2, Wim Tuinebreijer2, Peter Patka2, Dennis den Hartog21Department of Surgery and Traumatology, Westfriesgasthuis, Hoorn, the Netherlands; 2Department of Surgery and Traumatology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, the NetherlandsBackground: The Oxford elbow score (OES is a patient-rated, 12-item questionnaire that measures quality of life in relation to elbow disorders. This English questionnaire has been proven to be a reliable and valid instrument. Recently, the OES has been translated into Dutch and examined for its reliability, validity, and responsiveness in a group of Dutch patients with elbow pathology. The aim of this study was to analyze the Dutch version of the OES (OES-DV in combination with Rasch analysis or the one-parameter item response theory to examine the structure of the questionnaire.Methods: The OES-DV was administered to 103 patients (68 female, 35 male. The mean age of the patients was 44.3 ± 14.7 (range 15–75 years. Rasch analysis was performed using the Winsteps® Rasch Measurement Version 3.70.1.1 and a rating scale parameterization.Results: The person separation index, which is a measure of person reliability, was excellent (2.30. All the items of the OES had a reasonable mean square infit or outfit value between 0.6 and 1.7. The threshold of items were ordered, so the categories can function as intended. Principal component analysis of the residuals partly confirmed the multidimensionality of the English version of the OES. The OES distinguished 3.4 strata, which indicates that about three ranges can be differentiated.Conclusion: Rasch analysis of the OES-DV showed that the data fit to the stringent Rasch model. The multidimensionality of the English version of the OES was partly confirmed, and the four items of the function and three items of the pain domain were recognized as separate domains. The category rating scale of the OES-DV works well. The OES can

  20. Emotional Intelligence and Nurse Recruitment: Rasch and confirmatory factor analysis of the trait emotional intelligence questionnaire short form.

    Science.gov (United States)

    Snowden, Austyn; Watson, Roger; Stenhouse, Rosie; Hale, Claire

    2015-12-01

    To examine the construct validity of the Trait Emotional Intelligence Questionnaire Short form. Emotional intelligence involves the identification and regulation of our own emotions and the emotions of others. It is therefore a potentially useful construct in the investigation of recruitment and retention in nursing and many questionnaires have been constructed to measure it. Secondary analysis of existing dataset of responses to Trait Emotional Intelligence Questionnaire Short form using concurrent application of Rasch analysis and confirmatory factor analysis. First year undergraduate nursing and computing students completed Trait Emotional Intelligence Questionnaire-Short Form in September 2013. Responses were analysed by synthesising results of Rasch analysis and confirmatory factor analysis. Participants (N = 938) completed Trait Emotional Intelligence Questionnaire Short form. Rasch analysis showed the majority of the Trait Emotional Intelligence Questionnaire-Short Form items made a unique contribution to the latent trait of emotional intelligence. Five items did not fit the model and differential item functioning (gender) accounted for this misfit. Confirmatory factor analysis revealed a four-factor structure consisting of: self-confidence, empathy, uncertainty and social connection. All five misfitting items from the Rasch analysis belonged to the 'social connection' factor. The concurrent use of Rasch and factor analysis allowed for novel interpretation of Trait Emotional Intelligence Questionnaire Short form. Much of the response variation in Trait Emotional Intelligence Questionnaire Short form can be accounted for by the social connection factor. Implications for practice are discussed. © 2015 John Wiley & Sons Ltd.

  1. The construct validity of the Major Depression Inventory: A Rasch analysis of a self-rating scale in primary care.

    Science.gov (United States)

    Nielsen, Marie Germund; Ørnbøl, Eva; Vestergaard, Mogens; Bech, Per; Christensen, Kaj Sparle

    2017-06-01

    We aimed to assess the measurement properties of the ten-item Major Depression Inventory when used on clinical suspicion in general practice by performing a Rasch analysis. General practitioners asked consecutive persons to respond to the web-based Major Depression Inventory on clinical suspicion of depression. We included 22 practices and 245 persons. Rasch analysis was performed using RUMM2030 software. The Rasch model fit suggests that all items contribute to a single underlying trait (defined as internal construct validity). Mokken analysis was used to test dimensionality and scalability. Our Rasch analysis showed misfit concerning the sleep and appetite items (items 9 and 10). The response categories were disordered for eight items. After modifying the original six-point to a four-point scoring system for all items, we achieved ordered response categories for all ten items. The person separation reliability was acceptable (0.82) for the initial model. Dimensionality testing did not support combining the ten items to create a total score. The scale appeared to be well targeted to this clinical sample. No significant differential item functioning was observed for gender, age, work status and education. The Rasch and Mokken analyses revealed two dimensions, but the Major Depression Inventory showed fit to one scale if items 9 and 10 were excluded. Our study indicated scalability problems in the current version of the Major Depression Inventory. The conducted analysis revealed better statistical fit when items 9 and 10 were excluded. Copyright © 2017 Elsevier Inc. All rights reserved.

  2. Spurious Latent Class Problem in the Mixed Rasch Model: A Comparison of Three Maximum Likelihood Estimation Methods under Different Ability Distributions

    Science.gov (United States)

    Sen, Sedat

    2018-01-01

    Recent research has shown that over-extraction of latent classes can be observed in the Bayesian estimation of the mixed Rasch model when the distribution of ability is non-normal. This study examined the effect of non-normal ability distributions on the number of latent classes in the mixed Rasch model when estimated with maximum likelihood…

  3. Assessment of upper limb capacity in children with unilateral cerebral palsy: construct validity of a Rasch-reduced Modified House Classification

    NARCIS (Netherlands)

    Geerdink, Yvonne; Lindeboom, Robert; de Wolf, Sander; Steenbergen, Bert; Geurts, Alexander C. H.; Aarts, Pauline

    2014-01-01

    The aim of this study was to test and improve the unidimensionality and item hierarchy of the Modified House Classification (MHC) for the assessment of upper limb capacity in children with unilateral cerebral palsy (CP) using Rasch analysis. The construct validity of the Rasch-reduced item set was

  4. Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches

    Directory of Open Access Journals (Sweden)

    Kelly D. Bradley

    2016-07-01

    Full Text Available This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA and Rasch modeling, the authors investigate the (a an overall assessment of dimensionality using EFA, (b a secondary assessment of dimensionality using a principal components analysis (PCA of the residuals when the items are fit to the Rasch model, and (c an assessment of item-level properties using item-level statistics provided when the items are fit to the Rasch model. The results support the usage of the scale as a supplement to high-stakes decision making such as tenure. However, the lack of precise targeting of item difficulty to person ability combined with the low person separation index renders rank-ordering professors according to minuscule differences in overall subscale scores a highly questionable practice.

  5. Organizational Culture Influence On Total Productive Maintenance (TPM and Operational Performance Using RASCH Model Analysis

    Directory of Open Access Journals (Sweden)

    Mohd Norhasni Mohd Asaad

    2014-02-01

    Full Text Available Abstract. Market globalization, competitive product and services, high economic crises are the most critical factors that influence the success of the manufacturing companies in global market. Therefore it is critical to the manufacturing companies to be efficient in production and lean tool may used to achieve that.  The most frequently used is the Total Preventive Maintenance (TPM, even though there are many studies have been conducted in relation to the TPM but there is limited research in investigating the effects of the TPM on operational performance. However, the result of the studies was not consistent, where TPM practice may have positive and negative impact on operational performance. Among the reason is the culture of the organization that influenced the implementation of TPM and operational performance. Due to that this study attempts to investigate the influence of organizational culture on the TPM implementation and operational performance.  Rasch model is used in this study due to its ability in interpreting and analyzing the ability of respondents in performing the difficult items. The online questionnaires were distributed to 63 randomly selected automotive companies located at Northern Region of Malaysia.  Results of the study revealed that the organizational culture has influenced on the successful implementation of TPM and operational performance. Therefore by the implementation of TPM in outstanding organizational culture can improve operational performance.   Keyword: Total Preventive Maintenance (TPM, Lean manufacturing, Operational performance, Organizational culture, Rasch modeldoi:10.12695/ajtm.2013.6.2.2How to cite this article:Mohd Asaad, M.N and Yusoff, R.Z. (2013. Organizational Culture Influence On Total Productive Maintenance (TPM and Operational Performance Using RASCH Model Analysis . The Asian Journal of Technology Management 6 (2: 72-81. Print ISSN: 1978-6956; Online ISSN: 2089-791X.  doi:10.12695/ajtm

  6. Comparison of formula and number-right scoring in undergraduate medical training: a Rasch model analysis.

    Science.gov (United States)

    Cecilio-Fernandes, Dario; Medema, Harro; Collares, Carlos Fernando; Schuwirth, Lambert; Cohen-Schotanus, Janke; Tio, René A

    2017-11-09

    Progress testing is an assessment tool used to periodically assess all students at the end-of-curriculum level. Because students cannot know everything, it is important that they recognize their lack of knowledge. For that reason, the formula-scoring method has usually been used. However, where partial knowledge needs to be taken into account, the number-right scoring method is used. Research comparing both methods has yielded conflicting results. As far as we know, in all these studies, Classical Test Theory or Generalizability Theory was used to analyze the data. In contrast to these studies, we will explore the use of the Rasch model to compare both methods. A 2 × 2 crossover design was used in a study where 298 students from four medical schools participated. A sample of 200 previously used questions from the progress tests was selected. The data were analyzed using the Rasch model, which provides fit parameters, reliability coefficients, and response option analysis. The fit parameters were in the optimal interval ranging from 0.50 to 1.50, and the means were around 1.00. The person and item reliability coefficients were higher in the number-right condition than in the formula-scoring condition. The response option analysis showed that the majority of dysfunctional items emerged in the formula-scoring condition. The findings of this study support the use of number-right scoring over formula scoring. Rasch model analyses showed that tests with number-right scoring have better psychometric properties than formula scoring. However, choosing the appropriate scoring method should depend not only on psychometric properties but also on self-directed test-taking strategies and metacognitive skills.

  7. A Rasch and confirmatory factor analysis of the General Health Questionnaire (GHQ - 12

    Directory of Open Access Journals (Sweden)

    Velikova Galina

    2010-04-01

    Full Text Available Abstract Background The General Health Questionnaire (GHQ - 12 was designed as a short questionnaire to assess psychiatric morbidity. Despite the fact that studies have suggested a number of competing multidimensional factor structures, it continues to be largely used as a unidimensional instrument. This may have an impact on the identification of psychiatric morbidity in target populations. The aim of this study was to explore the dimensionality of the GHQ-12 and to evaluate a number of alternative models for the instrument. Methods The data were drawn from a large heterogeneous sample of cancer patients. The Partial Credit Model (Rasch was applied to the 12-item GHQ. Item misfit (infit mean square ≥ 1.3 was identified, misfitting items removed and unidimensionality and differential item functioning (age, gender, and treatment aims were assessed. The factor structures of the various alternative models proposed in the literature were explored and optimum model fit evaluated using Confirmatory Factor Analysis. Results The Rasch analysis of the 12-item GHQ identified six misfitting items. Removal of these items produced a six-item instrument which was not unidimensional. The Rasch analysis of an 8-item GHQ demonstrated two unidimensional structures corresponding to Anxiety/Depression and Social Dysfunction. No significant differential item functioning was observed by age, gender and treatment aims for the six- and eight-item GHQ. Two models competed for best fit from the confirmatory factor analysis, namely the GHQ-8 and Hankin's (2008 unidimensional model, however, the GHQ-8 produced the best overall fit statistics. Conclusions The results are consistent with the evidence that the GHQ-12 is a multi-dimensional instrument. Use of the summated scores for the GHQ-12 could potentially lead to an incorrect assessment of patients' psychiatric morbidity. Further evaluation of the GHQ-12 with different target populations is warranted.

  8. Evaluation of the Edinburgh Post Natal Depression Scale using Rasch analysis

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2006-06-01

    Full Text Available Abstract Background The Edinburgh Postnatal Depression Scale (EPDS is a 10 item self-rating post-natal depression scale which has seen widespread use in epidemiological and clinical studies. Concern has been raised over the validity of the EPDS as a single summed scale, with suggestions that it measures two separate aspects, one of depressive feelings, the other of anxiety. Methods As part of a larger cross-sectional study conducted in Melbourne, Australia, a community sample (324 women, ranging in age from 18 to 44 years: mean = 32 yrs, SD = 4.6, was obtained by inviting primiparous women to participate voluntarily in this study. Data from the EPDS were fitted to the Rasch measurement model and tested for appropriate category ordering, for item bias through Differential Item Functioning (DIF analysis, and for unidimensionality through tests of the assumption of local independence. Results Rasch analysis of the data from the ten item scale initially demonstrated a lack of fit to the model with a significant Item-Trait Interaction total chi-square (chi Square = 82.8, df = 40; p Conclusion The results of this study suggest that EPDS, in its original 10 item form, is not a viable scale for the unidimensional measurement of depression. Rasch analysis suggests that a revised eight item version (EPDS-8 would provide a more psychometrically robust scale. The revised cut points of 7/8 and 9/10 for the EPDS-8 show high levels of agreement with the original case identification for the EPDS-10.

  9. Factor and Rasch analysis of the Fonseca anamnestic index for the diagnosis of myogenous temporomandibular disorder.

    Science.gov (United States)

    Rodrigues-Bigaton, Delaine; de Castro, Ester M; Pires, Paulo F

    Rasch analysis has been used in recent studies to test the psychometric properties of a questionnaire. The conditions for use of the Rasch model are one-dimensionality (assessed via prior factor analysis) and local independence (the probability of getting a particular item right or wrong should not be conditioned upon success or failure in another). To evaluate the dimensionality and the psychometric properties of the Fonseca anamnestic index (FAI), such as the fit of the data to the model, the degree of difficulty of the items, and the ability to respond in patients with myogenous temporomandibular disorder (TMD). The sample consisted of 94 women with myogenous TMD, diagnosed by the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD), who answered the FAI. For the factor analysis, we applied the Kaiser-Meyer-Olkin test, Bartlett's sphericity, Spearman's correlation, and the determinant of the correlation matrix. For extraction of the factors/dimensions, an eigenvalue >1.0 was used, followed by oblique oblimin rotation. The Rasch analysis was conducted on the dimension that showed the highest proportion of variance explained. Adequate sample "n" and FAI multidimensionality were observed. Dimension 1 (primary) consisted of items 1, 2, 3, 6, and 7. All items of dimension 1 showed adequate fit to the model, being observed according to the degree of difficulty (from most difficult to easiest), respectively, items 2, 1, 3, 6, and 7. The FAI presented multidimensionality with its main dimension consisting of five reliable items with adequate fit to the composition of its structure. Copyright © 2017 Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia. Publicado por Elsevier Editora Ltda. All rights reserved.

  10. Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure

    Science.gov (United States)

    McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.

    2013-01-01

    Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342

  11. A developmental screening tool for toddlers with multiple domains based on Rasch analysis.

    Science.gov (United States)

    Hwang, Ai-Wen; Chou, Yeh-Tai; Hsieh, Ching-Lin; Hsieh, Wu-Shiun; Liao, Hua-Fang; Wong, Alice May-Kuen

    2015-01-01

    Using multidomain developmental screening tools is a feasible method for pediatric health care professionals to identify children at risk of developmental problems in multiple domains simultaneously. The purpose of this study was to develop a Rasch-based tool for Multidimensional Screening in Child Development (MuSiC) for children aged 0-3 years. The MuSic was developed by constructing items bank based on three commonly used screening tools, validating with developmental status (at risk for delay or not) on five developmental domains. Parents of a convenient sample of 632 children (aged 3-35.5 months) with and without developmental delays responded to items from the three screening tools funded by health authorities in Taiwan. Item bank was determined by item fit of Rasch analysis for each of the five developmental domains (cognitive skills, language skills, gross motor skills, fine motor skills, and socioadaptive skills). Children's performance scores in logits derived in Rasch analysis were validated with developmental status for each domain using the area under receiver operating characteristic curves. MuSiC, a 75-item developmental screening tool for five domains, was derived. The diagnostic validity of all five domains was acceptable for all stages of development, except for the infant stage (≤11 months and 15 days). MuSiC can be applied simultaneously to well-child care visits as a universal screening tool for children aged 1-3 years on multiple domains. Items with sound validity for infants need to be further developed. Copyright © 2014. Published by Elsevier B.V.

  12. Catquest-9SF questionnaire: validation of Malay and Chinese-language versions using Rasch analysis.

    Science.gov (United States)

    Adnan, Tassha Hilda; Mohamed Apandi, Mokhlisoh; Kamaruddin, Haireen; Salowi, Mohamad Aziz; Law, Kian Boon; Haniff, Jamaiyah; Goh, Pik Pin

    2018-01-05

    Catquest questionnaire was originally developed in Swedish to measure patients' self-assessed visual function to evaluate the benefit of cataract surgery. The result of the Rasch analysis leading to the creation of the nine-item short form of Catquest, (Catquest-9SF), and it had been translated and validated in English. The aim is therefore to evaluate the translated Catquest-9SF questionnaire in Malay and Chinese (Mandarin) language version for measuring patient-reported visual function among cataract population in Malaysia. The English version of Catquest-9SF questionnaire was translated and back translated into Malay and Chinese languages. The Malay and Chinese translated versions were self-administered by 236 and 202 pre-operative patients drawn from a cataract surgery waiting list, respectively. The translated Catquest-9SF data and its four response options were assessed for fit to the Rasch model. The Catquest-9SF performed well in the Malay and Chinese translated versions fulfilling all criteria for valid measurement, as demonstrated by Rasch analysis. Both versions of questionnaire had ordered response thresholds, with a good person separation (Malay 2.84; and Chinese 2.59) and patient separation reliability (Malay 0.89; Chinese 0.87). Targeting was 0.30 and -0.11 logits in Malay and Chinese versions respectively, indicating that the item difficulty was well suited to the visual abilities of the patients. All items fit a single overall construct (Malay infit range 0.85-1.26, outfit range 0.73-1.13; Chinese infit range 0.80-1.51, outfit range 0.71-1.36), unidimensional by principal components analysis, and was free of Differential Item Functioning (DIF). These results support the good overall functioning of the Catquest-9SF in patients with cataract. The translated questionnaire to Malay and Chinese-language versions are reliable and valid in measuring visual disability outcomes in the Malaysian cataract population.

  13. Psychometrics evaluation of Charcot-Marie-Tooth Neuropathy Score (CMTNSv2) second version, using Rasch analysis.

    Science.gov (United States)

    Sadjadi, Reza; Reilly, Mary M; Shy, Michael E; Pareyson, Davide; Laura, Matilde; Murphy, Sinead; Feely, Shawna M E; Grider, Tiffany; Bacon, Chelsea; Piscosquito, Giuseppe; Calabrese, Daniela; Burns, Ted M

    2014-09-01

    Charcot-Marie-Tooth Neuropathy Score second version (CMTNSv2) is a validated clinical outcome measure developed for use in clinical trials to monitor disease impairment and progression in affected CMT patients. Currently, all items of CMTNSv2 have identical contribution to the total score. We used Rasch analysis to further explore psychometric properties of CMTNSv2, and in particular, category response functioning, and their weight on the overall disease progression. Weighted category responses represent a more accurate estimate of actual values measuring disease severity and therefore could potentially be used in improving the current version. © 2014 Peripheral Nerve Society.

  14. Using the Rasch model as an objective and probabilistic technique to integrate different soil properties

    Science.gov (United States)

    Rebollo, Francisco J.; Jesús Moral García, Francisco

    2016-04-01

    Soil apparent electrical conductivity (ECa) is one of the simplest, least expensive soil measurements that integrates many soil properties affecting crop productivity, including, for instance, soil texture, water content, and cation exchange capacity. The ECa measurements obtained with a 3100 Veris sensor, operating in both shallow (0-30 cm), ECs, and deep (0-90 cm), ECd, mode, can be used as an additional and essential information to be included in a probabilistic model, the Rasch model, with the aim of quantifying the overall soil fertililty potential in an agricultural field. This quantification should integrate the main soil physical and chemical properties, with different units. In this work, the formulation of the Rasch model integrates 11 soil properties (clay, silt and sand content, organic matter -OM-, pH, total nitrogen -TN-, available phosphorus -AP- and potassium -AK-, cation exchange capacity -CEC-, ECd, and ECs) measured at 70 locations in a field. The main outputs of the model include a ranking of all soil samples according to their relative fertility potential and the unexpected behaviours of some soil samples and properties. In the case study, the considered soil variables fit the model reasonably, having an important influence on soil fertility, except pH, probably due to its homogeneity in the field. Moreover, ECd, ECs are the most influential properties on soil fertility and, on the other hand, AP and AK the less influential properties. The use of the Rasch model to estimate soil fertility potential (always in a relative way, taking into account the characteristics of the studied soil) constitutes a new application of great practical importance, enabling to rationally determine locations in a field where high soil fertility potential exists and establishing those soil samples or properties which have any anomaly; this information can be necessary to conduct site-specific treatments, leading to a more cost-effective and sustainable field

  15. Rasch analysis of the 23-item version of the Roland Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Kent, Peter; Grotle, Margreth; Dunn, Kate M

    2015-01-01

    OBJECTIVE: To determine the psychometric properties of the 23-item version of the Roland Morris Disability Questionnaire (RMDQ-23) and to quantify their stability across 2 cultures/languages and 2 types of care-settings. METHODS: Rasch analysis of data from 1,000 patients with low back pain from...... clinical characteristics (such as age, gender, pain intensity, pain duration and care setting), depending on the country. CONCLUSION: As similar results have been found for the RMDQ-24, we believe it is timely to reconsider whether: (i) the RMDQ should be reconstructed using an item-response theory...

  16. Assessing Pre-Service Physics Teachers’ Energy Literacy: An Application of Rasch measurement

    Science.gov (United States)

    Yusup, M.; Setiawan, A.; Rustaman, N. Y.; Kaniawati, I.

    2017-09-01

    This paper aims to present a summary of pre-service physics teachers’ responses on energy literacy assessment. A total of 123 pre-service physics teacher in first through third year of education participated. Data were analyzed using Rasch modeling. Research findings indicate that pre-service physics teachers show their low self-system toward energy conservation. They were also still lack of metacognitive and cognitive competencies. These finding provide information for the future development of curriculum, teaching and learning that can improve pre-service physics teachers’ energy literacy.

  17. Measuring Math Anxiety (in Spanish) with the Rasch Rating Scale Model.

    Science.gov (United States)

    Prieto, Gerardo; Delgado, Ana R

    2007-01-01

    Two successive studies probed the psychometric properties of a Math Anxiety questionnaire (in Spanish) by means of the Rasch Rating Scale Model. Participants were 411 and 216 Spanish adolescents. Convergent validity was examined by correlating the scale with both the Fennema and Sherman Attitude Scale and a math achievement test. The results show that the scores are psychometrically appropriate, and replicate those reported in meta-analyses: medium-sized negative correlations with achievement and with attitudes toward mathematics, as well as moderate sex-related differences (with girls presenting higher anxiety levels than boys).

  18. Rasch validation of the Chinese parent-child interaction scale (CPCIS).

    Science.gov (United States)

    Ip, Patrick; Tso, Winnie; Rao, Nirmala; Ho, Frederick Ka Wing; Chan, Ko Ling; Fu, King Wa; Li, Sophia Ling; Goh, Winnie; Wong, Wilfred Hing-Sang; Chow, Chun Bong

    2018-03-15

    Proper parent-child interaction is crucial for child development, but an assessment tool in Chinese is currently lacking. This study aimed to develop and validate a parent-reported parent-child interaction scale for Chinese preschool children. The Chinese parent-child interaction scale (CPCIS) was designed by an expert panel based on the literature and clinical observations in the Chinese context. The initial CPCIS had 14 parent-child interactive activity items. Psychometric properties of the CPCIS were examined using the Rasch model and confirmatory factor analysis (CFA). Convergent validity was investigated by the associations between CPCIS and family income, maternal education level, and children's school readiness. The study recruited 567 Chinese parent-child pairs from diverse socioeconomic backgrounds, who completed the CPCIS. Six out of the 14 items in the initial CPCIS were dropped due to suboptimal fit values. The refined 8-item CPCIS was shown to be valid and reliable by Rasch models and CFA. The person separation reliability and Cronbach's α of the CPCIS were 0.81 and 0.82, respectively. The CPCIS scores were positively associated with family's socioeconomic status (η 2  = 0.05, P parent-child interactions in Chinese families.

  19. Clinical usefulness of the clock drawing test applying rasch analysis in predicting of cognitive impairment.

    Science.gov (United States)

    Yoo, Doo Han; Lee, Jae Shin

    2016-07-01

    [Purpose] This study examined the clinical usefulness of the clock drawing test applying Rasch analysis for predicting the level of cognitive impairment. [Subjects and Methods] A total of 187 stroke patients with cognitive impairment were enrolled in this study. The 187 patients were evaluated by the clock drawing test developed through Rasch analysis along with the mini-mental state examination of cognitive evaluation tool. An analysis of the variance was performed to examine the significance of the mini-mental state examination and the clock drawing test according to the general characteristics of the subjects. Receiver operating characteristic analysis was performed to determine the cutoff point for cognitive impairment and to calculate the sensitivity and specificity values. [Results] The results of comparison of the clock drawing test with the mini-mental state showed significant differences in according to gender, age, education, and affected side. A total CDT of 10.5, which was selected as the cutoff point to identify cognitive impairement, showed a sensitivity, specificity, Youden index, positive predictive, and negative predicive values of 86.4%, 91.5%, 0.8, 95%, and 88.2%. [Conclusion] The clock drawing test is believed to be useful in assessments and interventions based on its excellent ability to identify cognitive disorders.

  20. A Multi-Marker Genetic Association Test Based on the Rasch Model Applied to Alzheimer's Disease.

    Directory of Open Access Journals (Sweden)

    Wenjia Wang

    Full Text Available Results from Genome-Wide Association Studies (GWAS have shown that the genetic basis of complex traits often include many genetic variants with small to moderate effects whose identification remains a challenging problem. In this context multi-marker analysis at the gene and pathway level can complement traditional point-wise approaches that treat the genetic markers individually. In this paper we propose a novel statistical approach for multi-marker analysis based on the Rasch model. The method summarizes the categorical genotypes of SNPs by a generalized logistic function into a genetic score that can be used for association analysis. Through different sets of simulations, the false-positive rate and power of the proposed approach are compared to a set of existing methods, and shows good performances. The application of the Rasch model on Alzheimer's Disease (AD ADNI GWAS dataset also allows a coherent interpretation of the results. Our analysis supports the idea that APOE is a major susceptibility gene for AD. In the top genes selected by proposed method, several could be functionally linked to AD. In particular, a pathway analysis of these genes also highlights the metabolism of cholesterol, that is known to play a key role in AD pathogenesis. Interestingly, many of these top genes can be integrated in a hypothetic signalling network.

  1. Using the Rasch measurement model to design a report writing assessment instrument.

    Science.gov (United States)

    Carlson, Wayne R

    2013-01-01

    This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

  2. Controlling response dependence in the measurement of change using the Rasch model.

    Science.gov (United States)

    Andrich, David

    2017-01-01

    The advantages of using person location estimates from the Rasch model over raw scores for the measurement of change using a common test include the linearization of scores and the automatic handling of statistical properties of repeated measurements. However, the application of the model requires that the responses to the items are statistically independent in the sense that the specific responses to the items on the first time of testing do not affect the responses at a second time. This requirement implies that the responses to the items at both times of assessment are governed only by the invariant location parameters of the items at the two times of testing and the location parameters of each person each time. A specific form of dependence that is pertinent when the same items are used is when the observed response to an item at the second time of testing is affected by the response to the same item at the first time, a form of dependence which has been referred to as response dependence. This paper presents the logic of applying the Rasch model to quantify, control and remove the effect of response dependence in the measurement of change when the same items are used on two occasions. The logic is illustrated with four sets of simulation studies with dichotomous items and with a small example of real data. It is shown that the presence of response dependence can reduce the evidence of change, a reduction which may impact interpretations at the individual, research, and policy levels.

  3. Multi-faceted Rasch measurement and bias patterns in EFL writing performance assessment.

    Science.gov (United States)

    He, Tung-Hsien; Gou, Wen Johnny; Chien, Ya-Chen; Chen, I-Shan Jenny; Chang, Shan-Mao

    2013-04-01

    This study applied multi-faceted Rasch measurement to examine rater bias in the assessment of essays written by college students learning English as a foreign language. Four raters who had received different academic training from four distinctive disciplines applied a six-category rating scale to analytically rate essays on an argumentative topic and on a descriptive topic. FACETS, a Rasch computer program, was utilized to pinpoint bias patterns by analyzing the rater-topic, rater-category, and topic-category interactions. Results showed: argumentative essays were rated more severely than were descriptive essays; the linguistics-major rater was the most lenient rater, while the literature-major rater was the severest one; and the category of language use received the severest ratings, whereas content was given the most lenient ratings. The severity hierarchies for raters, essay topics, and rating categories suggested that raters' academic training and their perceptions of the importance of categories were associated with their bias patterns. Implications for rater training are discussed.

  4. Identifying potential misfit items in cognitive process of learning engineering mathematics based on Rasch model

    International Nuclear Information System (INIS)

    Ataei, Sh; Mahmud, Z; Khalid, M N

    2014-01-01

    The students learning outcomes clarify what students should know and be able to demonstrate after completing their course. So, one of the issues on the process of teaching and learning is how to assess students' learning. This paper describes an application of the dichotomous Rasch measurement model in measuring the cognitive process of engineering students' learning of mathematics. This study provides insights into the perspective of 54 engineering students' cognitive ability in learning Calculus III based on Bloom's Taxonomy on 31 items. The results denote that some of the examination questions are either too difficult or too easy for the majority of the students. This analysis yields FIT statistics which are able to identify if there is data departure from the Rasch theoretical model. The study has identified some potential misfit items based on the measurement of ZSTD where the removal misfit item was accomplished based on the MNSQ outfit of above 1.3 or less than 0.7 logit. Therefore, it is recommended that these items be reviewed or revised to better match the range of students' ability in the respective course.

  5. Rasch Analyses of Very Low Food Security among Households and Children in the Three City Study.

    Science.gov (United States)

    Moffitt, Robert A; Ribar, David C

    2016-04-01

    The longitudinal Three City Study of low-income families with children measures food hardships using fewer questions and some different questions from the standard U.S. instrument for measuring food security, the Household Food Security Survey Module (HFSSM) in the Current Population Survey (CPS). We utilize a Rasch measurement model to identify thresholds of very low food security among households and very low food security among children in the Three City Study that are comparable to thresholds from the HFSSM. We also use the Three City Study to empirically investigate the determinants of food insecurity and of these specific food insecurity outcomes, estimating a multivariate behavioral Rasch model that is adapted to address longitudinal data. The estimation results indicate that participation in the Supplemental Nutrition Assistance Program and the Temporary Assistance for Needy Families program reduce food insecurity, while poverty and disability among caregivers increase it. Besides its longitudinal structure, the Three City Study measures many more characteristics about households than the CPS. Our estimates reveal that financial assistance through social networks and a household's own financial assets reduce food insecurity, while its outstanding loans increase insecurity.

  6. Rasch Analyses of Very Low Food Security among Households and Children in the Three City Study*

    Science.gov (United States)

    Moffitt, Robert A.; Ribar, David C.

    2017-01-01

    The longitudinal Three City Study of low-income families with children measures food hardships using fewer questions and some different questions from the standard U.S. instrument for measuring food security, the Household Food Security Survey Module (HFSSM) in the Current Population Survey (CPS). We utilize a Rasch measurement model to identify thresholds of very low food security among households and very low food security among children in the Three City Study that are comparable to thresholds from the HFSSM. We also use the Three City Study to empirically investigate the determinants of food insecurity and of these specific food insecurity outcomes, estimating a multivariate behavioral Rasch model that is adapted to address longitudinal data. The estimation results indicate that participation in the Supplemental Nutrition Assistance Program and the Temporary Assistance for Needy Families program reduce food insecurity, while poverty and disability among caregivers increase it. Besides its longitudinal structure, the Three City Study measures many more characteristics about households than the CPS. Our estimates reveal that financial assistance through social networks and a household's own financial assets reduce food insecurity, while its outstanding loans increase insecurity. PMID:29187764

  7. Diagnosis of students' ability in a statistical course based on Rasch probabilistic outcome

    Science.gov (United States)

    Mahmud, Zamalia; Ramli, Wan Syahira Wan; Sapri, Shamsiah; Ahmad, Sanizah

    2017-06-01

    Measuring students' ability and performance are important in assessing how well students have learned and mastered the statistical courses. Any improvement in learning will depend on the student's approaches to learning, which are relevant to some factors of learning, namely assessment methods carrying out tasks consisting of quizzes, tests, assignment and final examination. This study has attempted an alternative approach to measure students' ability in an undergraduate statistical course based on the Rasch probabilistic model. Firstly, this study aims to explore the learning outcome patterns of students in a statistics course (Applied Probability and Statistics) based on an Entrance-Exit survey. This is followed by investigating students' perceived learning ability based on four Course Learning Outcomes (CLOs) and students' actual learning ability based on their final examination scores. Rasch analysis revealed that students perceived themselves as lacking the ability to understand about 95% of the statistics concepts at the beginning of the class but eventually they had a good understanding at the end of the 14 weeks class. In terms of students' performance in their final examination, their ability in understanding the topics varies at different probability values given the ability of the students and difficulty of the questions. Majority found the probability and counting rules topic to be the most difficult to learn.

  8. Rasch analysis of the Rosenberg Self-Esteem Scale with African Americans.

    Science.gov (United States)

    Chao, Ruth Chu-Lien; Vidacovich, Courtney; Green, Kathy E

    2017-03-01

    Effectively diagnosing African Americans' self-esteem has posed an unresolved challenge. To address this assessment issue, we conducted exploratory factor analysis and Rasch analysis to assess the psychometric characteristics of the Rosenberg Self-Esteem Scale (RSES, Rosenberg, 1965) for African American college students. The dimensional structure of the RSES was first identified with the first subsample (i.e., calibration subsample) and then held up under cross-validation with a second subsample (i.e., validation subsample). Exploratory factor analysis and Rasch analysis both supported unidimensionality of the measure, with that finding replicated for a random split of the sample. Response scale use was generally appropriate, items were endorsed at a high level reflecting high levels of self-esteem, and person separation and reliability of person separation were adequate, and reflected results similar to those found in prior research. However, as some categories were infrequently used, we also collapsed scale points and found a slight improvement in scale and item indices. No differential item functioning was found by sex or having received professional assistance versus not; there were no mean score differences by age group, marital status, or year in college. Two items were seen as problematic. Implications for theory and research on multicultural mental health are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  9. Measuring Engagement in Later Life Activities: Rasch-Based Scenario Scales for Work, Caregiving, Informal Helping, and Volunteering

    Science.gov (United States)

    Ludlow, Larry H.; Matz-Costa, Christina; Johnson, Clair; Brown, Melissa; Besen, Elyssa; James, Jacquelyn B.

    2014-01-01

    The development of Rasch-based "comparative engagement scenarios" based on Guttman's facet theory and sentence mapping procedures is described. The scenario scales measuring engagement in work, caregiving, informal helping, and volunteering illuminate the lived experiences of role involvement among older adults and offer multiple…

  10. Rasch Analysis of the Bruininks-Oseretsky Test of Motor Proficiency--Second Edition in Intellectual Disabilities

    Science.gov (United States)

    Wuang, Yee-Pay; Lin, Yueh-Hsien; Su, Chwen-Yng

    2009-01-01

    The Bruininks-Oseretsky Test of Motor Proficiency-Second Edition (BOT-2) is widely used to assess motor skills for both clinical and research purposes; however, its validity has not been adequately assessed in intellectual disabilities (ID). This study used partial credit Rasch model to examine the measurement properties of the BOT-2 among 446…

  11. Saving energy in 1-D : tailoring energy-saving advice using a Rasch-based energy recommender system

    NARCIS (Netherlands)

    Starke, Alain; Willemsen, Martijn; Snijders, Chris; Ge, Mouhzi; Ricci, Francesco

    2015-01-01

    Although there are numerous possibilities to save energy, conservation initiatives often do not tailor their content to the consumer. By considering energy conservation as a one-dimensional construct, where different behaviors have different execution difficulties, we have set out a Rasch-based

  12. Developing a Measure of Therapist Adherence to Contingency Management: An Application of the Many-Facet Rasch Model

    Science.gov (United States)

    Chapman, Jason E.; Sheidow, Ashli J.; Henggeler, Scott W.; Halliday-Boykins, Colleen A.; Cunningham, Phillippe B.

    2008-01-01

    A unique application of the Many-Facet Rasch Model (MFRM) is introduced as the preferred method for evaluating the psychometric properties of a measure of therapist adherence to Contingency Management (CM) treatment of adolescent substance use. The utility of psychometric methods based in Classical Test Theory was limited by complexities of the…

  13. Rasch Analysis of the Adult Strabismus Quality of Life Questionnaire (AS-20 among Chinese Adult Patients with Strabismus.

    Directory of Open Access Journals (Sweden)

    Zonghua Wang

    Full Text Available The impact of strabismus on visual function, self-image, self-esteem, and social interactions decrease health-related quality of life (HRQoL.The purpose of this study was to evaluate and refine the adult strabismus quality of life questionnaire (AS-20 by using Rasch analysis among Chinese adult patients with strabismus.We evaluated the fitness of the AS-20 with Rasch model in Chinese population by assessing unidimensionality, infit and outfit, person and item separation index and reliability, response ordering, targeting and differential item functioning (DIF.The overall AS-20 did not demonstrate unidimensional; however, it was achieved separately in the two Rasch-revised subscales: the psychosocial subscale (11 items and the function subscale (9 items. The features of good targeting, optimal item infit and outfit, and no notable local dependence were found for each of the subscales. The rating scale was appropriate for the psychosocial subscale but a reduction to four response categories was required for the function subscale. No significant DIF were revealed for any demographic and clinical factors (e.g., age, gender, and strabismus types.The AS-20 was demonstrated by Rasch analysis to be a rigorous instrument for measuring health-related quality of life in Chinese strabismus patents if some revisions were made regarding the subscale construct and response options.

  14. Analysis of the Professional Choice Self-Efficacy Scale Using the Rasch-Andrich Rating Scale Model

    Science.gov (United States)

    Ambiel, Rodolfo A. M.; Noronha, Ana Paula Porto; de Francisco Carvalho, Lucas

    2015-01-01

    The aim of this research was to analyze the psychometrics properties of the professional choice self-efficacy scale (PCSES), using the Rasch-Andrich rating scale model. The PCSES assesses four factors: self-appraisal, gathering occupational information, practical professional information search and future planning. Participants were 883 Brazilian…

  15. Protocol: validation of the INCODE barometer to measure the innovation compe-tence through the Rasch Measurement Theory

    Directory of Open Access Journals (Sweden)

    Lidia Sanchez

    2017-06-01

    Full Text Available This communication presents a protocol in order to show the different phases that must be followed in order to validate the INCODE barometer, which is used to measure the innovation competence, with Rasch Measurement Theory. Five phases are stated: dimensionality analysis, individual reliability and validity analysis of ítems and persons, global reliability and validity analysis, and cathegory analysis.

  16. Measurement of Online Student Engagement: Utilization of Continuous Online Student Behavior Indicators as Items in a Partial Credit Rasch Model

    Science.gov (United States)

    Anderson, Elizabeth

    2017-01-01

    Student engagement has been shown to be essential to the development of research-based best practices for K-12 education. It has been defined and measured in numerous ways. The purpose of this research study was to develop a measure of online student engagement for grades 3 through 8 using a partial credit Rasch model and validate the measure…

  17. Rasch-built Overall Disability Scale for patients with chemotherapy-induced peripheral neuropathy (CIPN-R-ODS).

    Science.gov (United States)

    Binda, D; Vanhoutte, E K; Cavaletti, G; Cornblath, D R; Postma, T J; Frigeni, B; Alberti, P; Bruna, J; Velasco, R; Argyriou, A A; Kalofonos, H P; Psimaras, D; Ricard, D; Pace, A; Galiè, E; Briani, C; Dalla Torre, C; Lalisang, R I; Boogerd, W; Brandsma, D; Koeppen, S; Hense, J; Storey, D; Kerrigan, S; Schenone, A; Fabbri, S; Rossi, E; Valsecchi, M G; Faber, C G; Merkies, I S J; Galimberti, S; Lanzani, F; Mattavelli, L; Piatti, M L; Bidoli, P; Cazzaniga, M; Cortinovis, D; Lucchetta, M; Campagnolo, M; Bakkers, M; Brouwer, B; Boogerd, W; Grant, R; Reni, L; Piras, B; Pessino, A; Padua, L; Granata, G; Leandri, M; Ghignotti, I; Plasmati, R; Pastorelli, F; Heimans, J J; Eurelings, M; Meijer, R J; Grisold, W; Lindeck Pozza, E; Mazzeo, A; Toscano, A; Russo, M; Tomasello, C; Altavilla, G; Penas Prado, M; Dominguez Gonzalez, C; Dorsey, S G

    2013-09-01

    Chemotherapy-induced peripheral neuropathy (CIPN) is a common neurological side-effect of cancer treatment and may lead to declines in patients' daily functioning and quality of life. To date, there are no modern clinimetrically well-evaluated outcome measures available to assess disability in CIPN patients. The objective of the study was to develop an interval-weighted scale to capture activity limitations and participation restrictions in CIPN patients using the Rasch methodology and to determine its validity and reliability properties. A preliminary Rasch-built Overall Disability Scale (pre-R-ODS) comprising 146 items was assessed twice (interval: 2-3 weeks; test-retest reliability) in 281 CIPN patients with a stable clinical condition. The obtained data were subjected to Rasch analyses to determine whether model expectations would be met, and if necessarily, adaptations were made to obtain proper model fit (internal validity). External validity was obtained by correlating the CIPN-R-ODS with the National Cancer Institute-Common Toxicity Criteria (NCI-CTC) neuropathy scales and the Pain-Intensity Numeric-Rating-Scale (PI-NRS). The preliminary R-ODS did not meet Rasch model's expectations. Items displaying misfit statistics, disordered thresholds, item bias or local dependency were systematically removed. The final CIPN-R-ODS consisting of 28 items fulfilled all the model's expectations with proper validity and reliability, and was unidimensional. The final CIPN-R-ODS is a Rasch-built disease-specific, interval measure suitable to detect disability in CIPN patients and bypasses the shortcomings of classical test theory ordinal-based measures. Its use is recommended in future clinical trials in CIPN. Copyright © 2013 Elsevier Ltd. All rights reserved.

  18. Psychometric validation of the Persian Bergen Social Media Addiction Scale using classic test theory and Rasch models.

    Science.gov (United States)

    Lin, Chung-Ying; Broström, Anders; Nilsen, Per; Griffiths, Mark D; Pakpour, Amir H

    2017-12-01

    Background and aims The Bergen Social Media Addiction Scale (BSMAS), a six-item self-report scale that is a brief and effective psychometric instrument for assessing at-risk social media addiction on the Internet. However, its psychometric properties in Persian have never been examined and no studies have applied Rasch analysis for the psychometric testing. This study aimed to verify the construct validity of the Persian BSMAS using confirmatory factor analysis (CFA) and Rasch models among 2,676 Iranian adolescents. Methods In addition to construct validity, measurement invariance in CFA and differential item functioning (DIF) in Rasch analysis across gender were tested for in the Persian BSMAS. Results Both CFA [comparative fit index (CFI) = 0.993; Tucker-Lewis index (TLI) = 0.989; root mean square error of approximation (RMSEA) = 0.057; standardized root mean square residual (SRMR) = 0.039] and Rasch (infit MnSq = 0.88-1.28; outfit MnSq = 0.86-1.22) confirmed the unidimensionality of the BSMAS. Moreover, measurement invariance was supported in multigroup CFA including metric invariance (ΔCFI = -0.001; ΔSRMR = 0.003; ΔRMSEA = -0.005) and scalar invariance (ΔCFI = -0.002; ΔSRMR = 0.005; ΔRMSEA = 0.001) across gender. No item displayed DIF (DIF contrast = -0.48 to 0.24) in Rasch across gender. Conclusions Given the Persian BSMAS was unidimensional, it is concluded that the instrument can be used to assess how an adolescent is addicted to social media on the Internet. Moreover, users of the instrument may comfortably compare the sum scores of the BSMAS across gender.

  19. Evaluation of the Edinburgh Post Natal Depression Scale using Rasch analysis

    Science.gov (United States)

    Pallant, Julie F; Miller, Renée L; Tennant, Alan

    2006-01-01

    Background The Edinburgh Postnatal Depression Scale (EPDS) is a 10 item self-rating post-natal depression scale which has seen widespread use in epidemiological and clinical studies. Concern has been raised over the validity of the EPDS as a single summed scale, with suggestions that it measures two separate aspects, one of depressive feelings, the other of anxiety. Methods As part of a larger cross-sectional study conducted in Melbourne, Australia, a community sample (324 women, ranging in age from 18 to 44 years: mean = 32 yrs, SD = 4.6), was obtained by inviting primiparous women to participate voluntarily in this study. Data from the EPDS were fitted to the Rasch measurement model and tested for appropriate category ordering, for item bias through Differential Item Functioning (DIF) analysis, and for unidimensionality through tests of the assumption of local independence. Results Rasch analysis of the data from the ten item scale initially demonstrated a lack of fit to the model with a significant Item-Trait Interaction total chi-square (chi Square = 82.8, df = 40; p < .001). Removal of two items (items 7 and 8) resulted in a non-significant Item-Trait Interaction total chi-square with a residual mean value for items of -0.467 with a standard deviation of 0.850, showing fit to the model. No DIF existed in the final 8-item scale (EPDS-8) and all items showed fit to model expectations. Principal Components Analysis of the residuals supported the local independence assumption, and unidimensionality of the revised EPDS-8 scale. Revised cut points were identified for EPDS-8 to maintain the case identification of the original scale. Conclusion The results of this study suggest that EPDS, in its original 10 item form, is not a viable scale for the unidimensional measurement of depression. Rasch analysis suggests that a revised eight item version (EPDS-8) would provide a more psychometrically robust scale. The revised cut points of 7/8 and 9/10 for the EPDS-8 show high

  20. Rasch-family models are more valuable than score-based approaches for analysing longitudinal patient-reported outcomes with missing data.

    Science.gov (United States)

    de Bock, Élodie; Hardouin, Jean-Benoit; Blanchin, Myriam; Le Neel, Tanguy; Kubis, Gildas; Bonnaud-Antignac, Angélique; Dantan, Étienne; Sébille, Véronique

    2016-10-01

    The objective was to compare classical test theory and Rasch-family models derived from item response theory for the analysis of longitudinal patient-reported outcomes data with possibly informative intermittent missing items. A simulation study was performed in order to assess and compare the performance of classical test theory and Rasch model in terms of bias, control of the type I error and power of the test of time effect. The type I error was controlled for classical test theory and Rasch model whether data were complete or some items were missing. Both methods were unbiased and displayed similar power with complete data. When items were missing, Rasch model remained unbiased and displayed higher power than classical test theory. Rasch model performed better than the classical test theory approach regarding the analysis of longitudinal patient-reported outcomes with possibly informative intermittent missing items mainly for power. This study highlights the interest of Rasch-based models in clinical research and epidemiology for the analysis of incomplete patient-reported outcomes data. © The Author(s) 2013.

  1. Validity study of the Beck Anxiety Inventory (Portuguese version by the Rasch Rating Scale model

    Directory of Open Access Journals (Sweden)

    Sónia Quintão

    2013-01-01

    Full Text Available Our objective was to conduct a validation study of the Portuguese version of the Beck Anxiety Inventory (BAI by means of the Rasch Rating Scale Model, and then compare it with the most used scales of anxiety in Portugal. The sample consisted of 1,160 adults (427 men and 733 women, aged 18-82 years old (M=33.39; SD=11.85. Instruments were Beck Anxiety Inventory, State-Trait Anxiety Inventory and Zung Self-Rating Anxiety Scale. It was found that Beck Anxiety Inventory's system of four categories, the data-model fit, and people reliability were adequate. The measure can be considered as unidimensional. Gender and age-related differences were not a threat to the validity. BAI correlated significantly with other anxiety measures. In conclusion, BAI shows good psychometric quality.

  2. Physics Metacognition Inventory Part II: Confirmatory factor analysis and Rasch analysis

    Science.gov (United States)

    Taasoobshirazi, Gita; Bailey, MarLynn; Farley, John

    2015-11-01

    The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. The college students' scores on the inventory were found to be reliable and related to students' physics motivation and physics grade. However, the results of the exploratory factor analysis indicated that the questionnaire could be revised to improve its construct validity. The goal of this study was to revise the questionnaire and establish its construct validity through a confirmatory factor analysis. In addition, a Rasch analysis was applied to the data to better understand the psychometric properties of the inventory and to further evaluate the construct validity. Results indicated that the final, revised inventory is a valid, reliable, and efficient tool for assessing student metacognition for physics problem solving.

  3. Gendered language attitudes: exploring language as a gendered construct using Rasch measurement theory.

    Science.gov (United States)

    Knisely, Kris A; Wind, Stefanie A

    2015-01-01

    Gendered language attitudes (GLAs) are gender-based perceptions of language varieties based on connections between gender-related and linguistic characteristics of individuals, including the perception of language varieties as possessing degrees of masculinity and femininity. This study combines substantive theory about language learning and gender with a model based on Rasch measurement theory to explore the psychometric properties of a new measure of GLAs. Findings suggest that GLAs is a unidimensional construct and that the items used can be used to describe differences among students in terms of the strength of their GLAs. Implications for research, theory, and practice are discussed. Special emphasis is given to the teaching and learning of languages.

  4. Uso del modelo de Rasch para poner en la misma escala las puntuaciones de distintos tests

    Directory of Open Access Journals (Sweden)

    Gerardo Prieto-Adánez

    2003-01-01

    Full Text Available Los usuarios de los tests tienen que poner en una escala común las puntuaciones de distintos instrumentos en varias situaciones prácticas, tales como la evaluación académica, la selección de personal, los estudios acerca del cambio de un atributo psicológico o educativo, la construcción de bancos de ítems, la validación intercultural de tests y los estudios sobre el funcionamiento diferencial de los ítems. Situar en una escala común las puntuaciones de diferentes tests es una de las principales aplicaciones del modelo de Rasch. En este artículo, mostramos el proceso de equiparación de dos tests (diseño, análisis de datos e interpretación usando como anclaje un conjunto de ítems comunes.

  5. Rasch Measurement in Language Research: Creating the Foreign Language Classroom Anxiety Inventory

    Directory of Open Access Journals (Sweden)

    Miranda J. Walker

    2014-11-01

    Full Text Available The purpose of this study was to construct a new scale for measuring foreign language classroom anxiety (FLCA. It begun with the creation of an extended item pool generated by qualitative methods. Subsequent Rasch and semantic analyses led to the final 18-item Foreign Language Classroom Anxiety Inventory (FLCAI. In comparison with the Foreign Language Classroom Anxiety Scale (FLCAS, the FLCAI demonstrated more convincing evidence of unidimensionality and the optimal 5-point Likert scale functioned better. The FLCAI, while 55% the length of the FLCAS, thus more practical for classroom practitioners to administer and analyse, maintains its psychometric properties and covers a wider range on the construct continuum thus improving the degree of validity of the instrument. Finally, test anxiety was shown to be a component of FLCA.

  6. Profil Perencanaan Karir Siswa Sekolah Menengah Kejuruan dengan Pemodelan Rasch Berdasarkan Jenis Kelamin

    Directory of Open Access Journals (Sweden)

    Itsar Bolo Rangka

    2017-08-01

    Full Text Available This research aimed to (1 perform inventory career planning of students, and (2 measuring students career planning based on gender. Data analysis used Rasch model for 45 students with actual power measurement 0.9272652. The research findings showed (1 inventory career planning has been fit with the theoretic model, and (2 female student have a tendency to a higher career planning rather than male student. In the future, to measurement of student’s career planning by using this inventory can only produce a high measurement information for students who have a mediocre ability. Further, the researcher need to consider to eliminate item No. 12 in this inventory due to the biased towards the male gender.

  7. An introduction to Item Response Theory and Rasch Analysis of the Eating Assessment Tool (EAT-10).

    Science.gov (United States)

    Kean, Jacob; Brodke, Darrel S; Biber, Joshua; Gross, Paul

    2018-03-01

    Item response theory has its origins in educational measurement and is now commonly applied in health-related measurement of latent traits, such as function and symptoms. This application is due in large part to gains in the precision of measurement attributable to item response theory and corresponding decreases in response burden, study costs, and study duration. The purpose of this paper is twofold: introduce basic concepts of item response theory and demonstrate this analytic approach in a worked example, a Rasch model (1PL) analysis of the Eating Assessment Tool (EAT-10), a commonly used measure for oropharyngeal dysphagia. The results of the analysis were largely concordant with previous studies of the EAT-10 and illustrate for brain impairment clinicians and researchers how IRT analysis can yield greater precision of measurement.

  8. Measuring students' perceptions of plagiarism: modification and Rasch validation of a plagiarism attitude scale.

    Science.gov (United States)

    Howard, Steven J; Ehrich, John F; Walton, Russell

    2014-01-01

    Plagiarism is a significant area of concern in higher education, given university students' high self-reported rates of plagiarism. However, research remains inconsistent in prevalence estimates and suggested precursors of plagiarism. This may be a function of the unclear psychometric properties of the measurement tools adopted. To investigate this, we modified an existing plagiarism scale (to broaden its scope), established its psychometric properties using traditional (EFA, Cronbach's alpha) and modern (Rasch analysis) survey evaluation approaches, and examined results of well-functioning items. Results indicated that traditional and modern psychometric approaches differed in their recommendations. Further, responses indicated that although most respondents acknowledged the seriousness of plagiarism, these attitudes were neither unanimous nor consistent across the range of issues assessed. This study thus provides rigorous psychometric testing of a plagiarism attitude scale and baseline data from which to begin a discussion of contextual, personal, and external factors that influence students' plagiarism attitudes.

  9. El modelo de rasch en dirección de operaciones

    Directory of Open Access Journals (Sweden)

    Lidia Sanchez

    2012-11-01

    Full Text Available Durante décadas, en el área de Dirección de Operaciones, se ha destacado la necesidad de un acercamiento entre el mundo académico y el profesional, reclamando la realización de estudios empíricos que aporten soluciones prácticas a los profesionales. De ahí que durante los últimos años se hayan producido dos fenómenos clave: la convergencia entre los temas objeto de investigación y los temas de interés para las empresas; y un aumento en el  número de estudios empíricos realizados.Ahora bien, otro factor importantísimo a la hora de aportar conocimientos prácticos a la disciplina es la herramienta o metodología aplicada. Por ello, el desarrollo de nuevas herramientas o la aplicación de otras ya existentes en otros campos es un tema interesante. Es en este punto donde adquiere importancia la Metodología de Rasch.Esta técnica ha sido tradicionalmente utilizada en disciplinas tales como la Psicología o la Medicina. Sin embargo, ya hace algunos años, ha comenzado a utilizarse en otras áreas de conocimiento, entre ellas, el área de Administración y Dirección de Empresas. No obstante, su aplicación al área concreta de Operaciones es escasa y, por ello, las posibilidades de desarrollo e investigaciones futuras son numerosas.La Metodología de Rasch, útil para el diseño y la explotación de encuestas, se basa en tres principios, unidimensionalidad, aditividad e invarianza, y permite obtener medidas objetivas a partir del análisis de variables categóricas. Entre sus múltiples aplicaciones destacamos las siguientes: análisis de la viabilidad y fiabilidad globales, análisis de la unidimensionalidad del constructo, análisis de escalas del cuestionario, priorización (ordenación de los ítems y/o de los sujetos, análisis DAFO… Es, por lo tanto, una metodología muy rica con multitud de posibilidades para su aplicación en la disciplina.Dado su incipiente desarrollo en esta área de conocimiento el objetivo de este

  10. Factors Influencing Singapore Students' Choice of Physics as a Tertiary Field of Study: A Rasch analysis

    Science.gov (United States)

    Oon, Pey-Tee; Subramaniam, R.

    2013-01-01

    Asian students often perform well in international science and mathematics assessments. Their attitude toward technical subjects, such as physics, remains curious for many. The present study examines Singapore school students' views on various aspects of physics according to whether they intend to choose physics as an advanced field of study. A sample of 1076 physics students, from 16 secondary schools and junior colleges, participated in this study. The students were categorized as physics choosers or non-choosers according to their indicated intention, as sought in the survey, to study or not to study physics as a major subject at university after their leaving level examinations. Rasch-anchored analysis was employed to interpret the results; the use of Rasch analysis has helped to overcome significantly the psychometric limitations inherent in the treatment of Likert scale type of data using traditional analysis. As expected, the image of physics as a difficult subject surfaced in the samples used in our study. The students recognized unequivocally the utilitarian value of physics: physics is said to enhance career options and is necessary for technological progress to occur in a country. They also showed high interest in school physics-this is so even for students who are not keen to study physics in the future, a finding which is at variance with other studies reported from Western countries. School physics is seen to be relevant, and physics teachers are viewed as being able to foster students' interest in physics. Laboratory work, enrichment activities, and physics textbooks were reported to be important in order to encourage students to like physics. Though the physics choosers showed greater intention in physics, they were generally not inclined to pursue physics-related careers after graduation. Parents and peers at school, on the other hand, are perceived to display unenthusiastic attitudes toward physics. Possible reasons for these are discussed along

  11. Exploring students’ perceived and actual ability in solving statistical problems based on Rasch measurement tools

    Science.gov (United States)

    Azila Che Musa, Nor; Mahmud, Zamalia; Baharun, Norhayati

    2017-09-01

    One of the important skills that is required from any student who are learning statistics is knowing how to solve statistical problems correctly using appropriate statistical methods. This will enable them to arrive at a conclusion and make a significant contribution and decision for the society. In this study, a group of 22 students majoring in statistics at UiTM Shah Alam were given problems relating to topics on testing of hypothesis which require them to solve the problems using confidence interval, traditional and p-value approach. Hypothesis testing is one of the techniques used in solving real problems and it is listed as one of the difficult concepts for students to grasp. The objectives of this study is to explore students’ perceived and actual ability in solving statistical problems and to determine which item in statistical problem solving that students find difficult to grasp. Students’ perceived and actual ability were measured based on the instruments developed from the respective topics. Rasch measurement tools such as Wright map and item measures for fit statistics were used to accomplish the objectives. Data were collected and analysed using Winsteps 3.90 software which is developed based on the Rasch measurement model. The results showed that students’ perceived themselves as moderately competent in solving the statistical problems using confidence interval and p-value approach even though their actual performance showed otherwise. Item measures for fit statistics also showed that the maximum estimated measures were found on two problems. These measures indicate that none of the students have attempted these problems correctly due to reasons which include their lack of understanding in confidence interval and probability values.

  12. An application of dichotomous and polytomous Rasch models for scoring energy insecurity

    International Nuclear Information System (INIS)

    Murray, Anthony G.; Mills, Bradford F.

    2012-01-01

    Household food security in the United States has been extensively researched and a number of indexes have been generated. However, household energy security has been largely ignored even though low-income households spend almost equal income shares on food and energy. This paper uses Rasch models and household responses to energy security questions in the 2005 Residential Energy Consumption Survey to generate an energy insecurity index that is consistent with those found in the food insecurity literature. The analysis yields several important findings for the generation of policy relevant household energy insecurity indexes. Questions that indicate reduction of basic expenditures, such as food, clothing, and shelter, are easiest for households to affirm implying low exposure to energy insecurity. Conversely, questions that concern households leaving the residence due to extreme temperatures consistently imply high exposure to energy insecurity. Households that score in the top decile of the energy insecurity index are more likely to be headed by single-females, be younger, and have a Black household head. Rasch models also identify flaws within survey. Particularly, the scope of the questions is quite broad and a refinement of the survey questions to focus on specific attributes of energy insecurity would likely improve future energy security indexes. - Highlights: ► A novel household energy insecurity index is generated for low-income U.S. families. ► Severely energy insecure households have unique characteristics. ► Energy insecure households are more likely to participate in LIHEAP. ► RECS survey questions should be modified for an improved energy insecurity index.

  13. Using Rasch models to develop and validate an environmental thinking learning progression

    Science.gov (United States)

    Hashimoto-Martell, Erin A.

    Environmental understanding is highly relevant in today's global society. Social, economic, and political structures are connected to the state of environmental degradation and exploitation, and disproportionately affect those in poor or urban communities (Brulle & Pellow, 2006; Executive Order No. 12898, 1994). Environmental education must challenge the way we live, and our social and ecological quality of life, with the goal of responsible action. The development of a learning progression in environmental thinking, along with a corresponding assessment, could provide a tool that could be used across environmental education programs to help evaluate and guide programmatic decisions. This study sought to determine if a scale could be constructed that allowed individuals to be ordered along a continuum of environmental thinking. First, I developed the Environmental Thinking Learning Progression, a scale of environmental thinking from novice to advanced, based on the current available research and literature. The scale consisted of four subscales, each measuring a different aspect of environmental thinking: place consciousness, human connection, agency, and science concepts. Second, a measurement instrument was developed, so that the data appropriately fit the model using Rasch analysis. A Rasch analysis of the data placed respondents along a continuum, given the range of item difficulty for each subscale. Across three iterations of instrument revision and data collection, findings indicated that the items were ordered in a hierarchical way that corresponded to the construct of environmental thinking. Comparisons between groups showed that the average score of respondents who had participated in environmental education programs was significantly higher than those who had not. A comparison between males and females showed no significant difference in average measure, however, there were varied significant differences between how racial/ethnic groups performed. Overall

  14. Análise de Rasch aplicada a questionário sobre consumo de tabaco em escolares adolescentes = Rasch analysis applied to a questionnaire on tobacco use among adolescent students

    Directory of Open Access Journals (Sweden)

    Santos, Wendel Mombaque dos

    2014-01-01

    Conclusões: O uso do método de Rasch possibilitou verificar a exposição de cada participante às diferentes condições de exposição ao tabaco, assim como demonstrou que o questionário que avalia a exposição ao tabaco deve tratar cada questão com pesos diferentes

  15. Inter-regional metric disadvantages when comparing countries’ happiness on a global scale. A Rasch based consequential validity analysis

    Directory of Open Access Journals (Sweden)

    Diego Fernando Rojas-Gualdrón

    2017-07-01

    Full Text Available Measurement confounding due to socioeconomic differences between world regions may bias the estimations of countries’ happiness and global inequality. Potential implications of this bias have not been researched. In this study, the consequential validity of the Happy Planet Index, 2012 as an indicator of global inequality is evaluated from the Rasch measurement perspective. Differential Item Functioning by world region and bias in the estimated magnitude of inequalities were analyzed. The recalculated measure showed a good fit to Rasch model assumptions. The original index underestimated relative inequalities between world regions by 20%. DIF had no effect on relative measures but affected absolute measures by overestimating world average happiness and underestimating its variance. These findings suggest measurement confounding by unmeasured characteristics. Metric disadvantages must be adjusted to make fair comparisons. Public policy decisions based on biased estimations could have relevant negative consequences on people’s health and well-being by not focusing efforts on real vulnerable populations.

  16. Item and response-category functioning of the Persian version of the KIDSCREEN-27: Rasch partial credit model

    Directory of Open Access Journals (Sweden)

    Jafari Peyman

    2012-10-01

    Full Text Available Abstract Background The purpose of the study was to determine whether the Persian version of the KIDSCREEN-27 has the optimal number of response category to measure health-related quality of life (HRQoL in children and adolescents. Moreover, we aimed to determine if all the items contributed adequately to their own domain. Findings The Persian version of the KIDSCREEN-27 was completed by 1083 school children and 1070 of their parents. The Rasch partial credit model (PCM was used to investigate item statistics and ordering of response categories. The PCM showed that no item was misfitting. The PCM also revealed that, successive response categories for all items were located in the expected order except for category 1 in self- and proxy-reports. Conclusions Although Rasch analysis confirms that all the items belong to their own underlying construct, response categories should be reorganized and evaluated in further studies, especially in children with chronic conditions.

  17. Validation of the brief version of the Recovery Self-Assessment (RSA-B) using Rasch measurement theory.

    Science.gov (United States)

    Barbic, Skye P; Kidd, Sean A; Davidson, Larry; McKenzie, Kwame; O'Connell, Maria J

    2015-12-01

    In psychiatry, the recovery paradigm is increasingly identified as the overarching framework for service provision. Currently, the Recovery Self-Assessment (RSA), a 36-item rating scale, is commonly used to assess the uptake of a recovery orientation in clinical services. However, the consumer version of the RSA has been found challenging to complete because of length and the reading level required. In response to this feedback, a brief 12-item version of the RSA was developed (RSA-B). This article describes the development of the modified instrument and the application of traditional psychometric analysis and Rasch Measurement Theory to test the psychometrics properties of the RSA-B. Data from a multisite study of adults with serious mental illnesses (n = 1256) who were followed by assertive community treatment teams were examined for reliability, clinical meaning, targeting, response categories, model fit, reliability, dependency, and raw interval-level measurement. Analyses were performed using the Rasch Unidimensional Measurement Model (RUMM 2030). Adequate fit to the Rasch model was observed (χ2 = 112.46, df = 90, p = .06) and internal consistency was good (r = .86). However, Rasch analysis revealed limitations of the 12-item version, with items covering only 39% of the targeted theoretical continuum, 2 misfitting items, and strong evidence for the 5 option response categories not working as intended. This study revealed areas for improvement in the shortened version of the 12-item RSA-B. A revisit of the conceptual model and original 36-item rating scale is encouraged to select items that will help practitioners and researchers measure the full range of recovery orientation. (c) 2015 APA, all rights reserved).

  18. Linguistic validation of stigmatisation degree, self-esteem and knowledge questionnaire among asthma patients using Rasch analysis.

    Science.gov (United States)

    Ahmad, Sohail; Ismail, Ahmad Izuanuddin; Khan, Tahir Mehmood; Akram, Waqas; Mohd Zim, Mohd Arif; Ismail, Nahlah Elkudssiah

    2017-04-01

    The stigmatisation degree, self-esteem and knowledge either directly or indirectly influence the control and self-management of asthma. To date, there is no valid and reliable instrument that can assess these key issues collectively. The main aim of this study was to test the reliability and validity of the newly devised and translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" among adult asthma patients using the Rasch measurement model. This cross-sectional study recruited thirty adult asthma patients from two respiratory specialist clinics in Selangor, Malaysia. The newly devised self-administered questionnaire was adapted from relevant publications and translated into the Malay language using international standard translation guidelines. Content and face validation was done. The data were extracted and analysed for real item reliability and construct validation using the Rasch model. The translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" showed high real item reliability values of 0.90, 0.86 and 0.89 for stigmatisation degree, self-esteem, and knowledge of asthma, respectively. Furthermore, all values of point measure correlation (PTMEA Corr) analysis were within the acceptable specified range of the Rasch model. Infit/outfit mean square values and Z standard (ZSTD) values of each item verified the construct validity and suggested retaining all the items in the questionnaire. The reliability analyses and output tables of item measures for construct validation proved the translated Malaysian version of "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" as a valid and highly reliable questionnaire.

  19. Development of Rasch-based item banks for the assessment of work performance in patients with musculoskeletal diseases.

    Science.gov (United States)

    Mueller, Evelyn A; Bengel, Juergen; Wirtz, Markus A

    2013-12-01

    This study aimed to develop a self-description assessment instrument to measure work performance in patients with musculoskeletal diseases. In terms of the International Classification of Functioning, Disability and Health (ICF), work performance is defined as the degree of meeting the work demands (activities) at the actual workplace (environment). To account for the fact that work performance depends on the work demands of the job, we strived to develop item banks that allow a flexible use of item subgroups depending on the specific work demands of the patients' jobs. Item development included the collection of work tasks from literature and content validation through expert surveys and patient interviews. The resulting 122 items were answered by 621 patients with musculoskeletal diseases. Exploratory factor analysis to ascertain dimensionality and Rasch analysis (partial credit model) for each of the resulting dimensions were performed. Exploratory factor analysis resulted in four dimensions, and subsequent Rasch analysis led to the following item banks: 'impaired productivity' (15 items), 'impaired cognitive performance' (18), 'impaired coping with stress' (13) and 'impaired physical performance' (low physical workload 20 items, high physical workload 10 items). The item banks exhibited person separation indices (reliability) between 0.89 and 0.96. The assessment of work performance adds the activities component to the more commonly employed participation component of the ICF-model. The four item banks can be adapted to specific jobs where necessary without losing comparability of person measures, as the item banks are based on Rasch analysis.

  20. The Reliability and Validity of the Power-Load-Margin Inventory: A Rasch Analysis.

    Science.gov (United States)

    Hardigan, Patrick C; Cohen, Stanley R; Hagen, Kathleen P

    2015-01-01

    Margin is a function of the relationship of stress to strength. The greater the margin, the more likely students are able to successfully navigate academic structures. This study examined the psychometric properties of a newly created instrument designed to measure margin - the Power-Load-Margin Inventory (PLMI). The PLMI was created using eight domains: (A) Student's aptitude and ability, (B) Course structure, (C) External motivation, (D) Student health, (E) Instructor style, (F) Internal motivation, (G) Life opportunities, and (H) University support structure. A three-point response scale was used to measure the domains: (1) stress, (2) neither stress nor strength, and (3) strength. The PLMI was administered to 586 medical, dental, and pharmacy students. A Rasch rating scale model was used to examine the psychometric properties of the PLMI. The PLMI demonstrated acceptable psychometric properties for use with pharmacy, dental, and medical students. The PLMI's primary weakness was with the subscales' reliability. We attribute this to the small number of items per subscale.

  1. La variable latente calidad medida a través del modelo de Rasch.

    Directory of Open Access Journals (Sweden)

    Guerrero, Mª M.

    1997-01-01

    Full Text Available La obtención de aceites de oliva de calidad requiere unos cuidados especiales en todas y cada una de las sucesivas fases de elaboración de los mismos, es una cadena que comienza en el olivo y termina en el consumo. Condición indispensable para ello es conocer las características organolépticas del aceite (a fin de potenciar sus atributos y eliminar, en la medida de los posible, sus defectos, y la influencia del proceso de elaboración en las mismas. El control y medida de estos caracteres se hará mediante las catas, realizadas por expertos catadores utilizando para ello las fichas de cata del Consejo Oleícola Internacional. El modelo de Rasch, que emplearemos para obtener la evaluación sensorial de los aceites de oliva virgen, nos permitirá no sólo dar una calificación organoléptica global al aceite (que ya podemos realizar sin necesidad de aplicar ningún método, siguiendo la metodología de valoración del Consejo Oleícola Internacional, sino también clasificar y medir los factores sensoriales que intervienen en la calidad, lo que nos permitirá realizar las acciones oportunas encaminadas a obtener aceites de oliva de cualidades óptimas.

  2. Exploring Variability Sources in Student Evaluation of Teaching via Many-Facet Rasch Model

    Directory of Open Access Journals (Sweden)

    Bengü BÖRKAN

    2017-03-01

    Full Text Available Evaluating quality of teaching is important in nearly every higher education institute. The most common way of assessing teaching effectiveness takes place through students. Student Evaluation of Teaching (SET is used to gather information about students’ experiences with a course and instructor’s performance at some point of semester. SET can be considered as a type of rater mediated performance assessment where students are the raters and instructors are the examinees. When performance assessment becomes a rater mediated assessment process, extra measures need to be taken into consideration in order to create more reliable and fair assessment practices. The study has two main purposes; (a to examine the extent to which the facets (instructor, student, and rating items contribute to instructors’ score variance and (b to examine the students’ judging behavior in order to detect any potential source of bias in student evaluation of teaching by using the Many-Facet Rasch Model. The data set includes one thousand 235 students’ responses from 254 courses. The results show that a students greatly differ in the severity while rating instructors, b students were fairly consistent in their ratings, c students as a group and individual level are tend to display halo effect in their ratings, d students are clustered at the highest two categories of the scale and e the variation in item measures is fairly low. The findings have practical implications for the SET practices by improving the psychometric quality of measurement.

  3. Funding Medical Research Projects: Taking into Account Referees' Severity and Consistency through Many-Faceted Rasch Modeling of Projects' Scores.

    Science.gov (United States)

    Tesio, Luigi; Simone, Anna; Grzeda, Mariuzs T; Ponzio, Michela; Dati, Gabriele; Zaratin, Paola; Perucca, Laura; Battaglia, Mario A

    2015-01-01

    The funding policy of research projects often relies on scores assigned by a panel of experts (referees). The non-linear nature of raw scores and the severity and inconsistency of individual raters may generate unfair numeric project rankings. Rasch measurement (many-facets version, MFRM) provides a valid alternative to scoring. MFRM was applied to the scores achieved by 75 research projects on multiple sclerosis sent in response to a previous annual call by FISM-Italian Foundation for Multiple Sclerosis. This allowed to simulate, a posteriori, the impact of MFRM on the funding scenario. The applications were each scored by 2 to 4 independent referees (total = 131) on a 10-item, 0-3 rating scale called FISM-ProQual-P. The rotation plan assured "connection" of all pairs of projects through at least 1 shared referee.The questionnaire fulfilled satisfactorily the stringent criteria of Rasch measurement for psychometric quality (unidimensionality, reliability and data-model fit). Arbitrarily, 2 acceptability thresholds were set at a raw score of 21/30 and at the equivalent Rasch measure of 61.5/100, respectively. When the cut-off was switched from score to measure 8 out of 18 acceptable projects had to be rejected, while 15 rejected projects became eligible for funding. Some referees, of various severity, were grossly inconsistent (z-std fit indexes less than -1.9 or greater than 1.9). The FISM-ProQual-P questionnaire seems a valid and reliable scale. MFRM may help the decision-making process for allocating funds to MS research projects but also in other fields. In repeated assessment exercises it can help the selection of reliable referees. Their severity can be steadily calibrated, thus obviating the need to connect them with other referees assessing the same projects.

  4. Emotional vitality in caregivers: application of Rasch Measurement Theory with secondary data to development and test a new measure.

    Science.gov (United States)

    Barbic, Skye P; Bartlett, Susan J; Mayo, Nancy E

    2015-07-01

    To describe the practical steps in identifying items and evaluating scoring strategies for a new measure of emotional vitality in informal caregivers of individuals who have experienced a significant health event. The psychometric properties of responses to selected items from validated health-related quality of life and other psychosocial questionnaires administered four times over a one-year period were evaluated using Rasch Measurement Theory. Community. A total of 409 individuals providing informal care at home to older adults who had experienced a recent stroke. Rasch Measurement Theory was used to test the ordering of response option thresholds, fit, spread of the item locations, residual correlations, person separation index, and stability across time. Based on a theoretical framework developed in earlier work, we identified 22 candidate items from a pool of relevant psychosocial measures available. Of these, additional evaluation resulted in 19 items that could be used to assess the five core domains. The overall model fit was reasonable (χ(2) = 202.26, DF = 117, p = 0.06), stable across time, with borderline evidence of multidimensionality (10%). Items and people covered a continuum ranging from -3.7 to +2.7 logits, reflecting coverage of the measurement continuum, with a person separation index of 0.85. Mean fit of caregivers was lower than expected (-1.31 ±1.10 logits). Established methods from the Rasch Measurement Theory were applied to develop a prototype measure of emotional vitality that is acceptable, reliable, and can be used to obtain an interval level score for use in future research and clinical settings. © The Author(s) 2014.

  5. Applying computerized adaptive testing to the Negative Acts Questionnaire-Revised: Rasch analysis of workplace bullying.

    Science.gov (United States)

    Ma, Shu-Ching; Chien, Tsair-Wei; Wang, Hsiu-Hung; Li, Yu-Chi; Yui, Mei-Shu

    2014-02-17

    Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory-based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than -4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. With CAT-based administration of the NAQ-R for nurses, their burden was substantially reduced without compromising measurement precision.

  6. Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank.

    Science.gov (United States)

    Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Vonkeman, Harald E; van de Laar, Mart A F J

    2017-11-01

    Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Seventy-two items generated from patient interviews and mapped to the International Classification of Functioning, Disability and Health (ICF) domestic life chapter were administered to 1128 adults representative of the Dutch population. The partial credit model was fitted to the item responses and evaluated with respect to its assumptions, model fit, and differential item functioning (DIF). Measurement performance of a computerized adaptive testing (CAT) algorithm was compared with the SF-36 physical functioning scale (PF-10). A final bank of 41 items was developed. All items demonstrated acceptable fit to the partial credit model and measurement invariance across age, sex, and educational level. Five- and ten-item CAT simulations were shown to have high measurement precision, which exceeded that of SF-36 physical functioning scale across the physical function continuum. Floor effects were absent for a 10-item empirical CAT simulation, and ceiling effects were low (13.5%) compared with SF-36 physical functioning (38.1%). CAT also discriminated better than SF-36 physical functioning between age groups, number of chronic conditions, and respondents with or without rheumatic conditions. The Rasch assessment of everyday activity limitations (REAL) item bank will hopefully prove a useful instrument for assessing everyday activity limitations. T-scores obtained using derived measures can be used to benchmark physical function outcomes against the general Dutch adult population.

  7. Rasch Validation of a Measure of Reform-Oriented Science Teaching Practices

    Science.gov (United States)

    You, Hye Sun

    2016-06-01

    Growing evidence from recent curriculum documents and previous research suggests that reform-oriented science teaching practices promote students' conceptual understanding, levels of achievement, and motivation to learn, especially when students are actively engaged in constructing their ideas through scientific inquiries. However, it is difficult to identify to what extent science teachers engage students in reform-oriented teaching practices (RTPs) in their science classrooms. In order to exactly diagnose the current status of science teachers' implementation of the RTPs, a valid and reliable instrument tool is needed. The principles of validity and reliability are fundamental cornerstones in developing a robust measurement tool. As such, this study was motivated by the desire to point out the limitations of the existing statistical and psychometric analyses and to further examine the validation of the RTP survey instrument. This paper thus aims at calibrating the items of the RTPs for science teachers using the Rasch model. The survey instrument scale was adapted from the 2012 National Survey of Science and Mathematics Education (NSSME) data. A total of 3701 science teachers from 1403 schools from across the USA participated in the NSSME survey. After calibrating the RTP items and persons on the same scale, the RTP instrument well represented the population of US science teachers. Model-data fit determined by Infit and Outfit statistics was within an appropriate range (0.5-1.5), supporting the unidimensional structure of the RTPs. The ordered category thresholds and the probability of the thresholds showed that the five-point rating scale functioned well. The results of this study support the use of the RTP measure from the 2012 NSSME in assessing usage of RTPs.

  8. A Rasch analysis of patients' opinions of primary health care professionals' ethical behaviour with respect to communication issues.

    Science.gov (United States)

    González-de Paz, Luis; Kostov, Belchin; López-Pina, Jose A; Solans-Julián, Pilar; Navarro-Rubio, M Dolors; Sisó-Almirall, Antoni

    2015-04-01

    Patients' opinions are crucial in assessing the effectiveness of the ethical theories which underlie the care relationship between patients and primary health care professionals. To study the ethical behaviour of primary health care professionals with respect to communication issues according to patients' opinions. Cross-sectional study using a self-administered questionnaire in patients from a network of 15 urban primary health centres. Participants were patients attended at the centres when the study was conducted. We used a Rasch analysis to verify the structure of the 17 questionnaire items, and to calculate interval level measures for patients and items. We analysed differences according to patient subgroups using analysis of variance tests and differences between the endorsement of each item. We analysed 1013 (70.34%) of questionnaires. Data fit to the Rasch model was achieved after collapsing two categories and eliminating five items. Items with the lowest degree of endorsement were related to the management of differences in conflictive situations between patients and health care professionals. We found significant differences (P communication skills were respected by family physicians and nurses. However, opinions on endorsement were lower when patients disagreed with health care professionals. The differences found between patient subgroups demonstrated the importance of trust and confidence between patients and professionals. © The Author 2014. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  9. The validity of a professional competence tool for physiotherapy students in simulation-based clinical education: a Rasch analysis.

    Science.gov (United States)

    Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J

    2016-08-05

    Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.

  10. Classical test theory and Rasch analysis validation of the Upper Limb Functional Index in subjects with upper limb musculoskeletal disorders.

    Science.gov (United States)

    Bravini, Elisabetta; Franchignoni, Franco; Giordano, Andrea; Sartorio, Francesco; Ferriero, Giorgio; Vercelli, Stefano; Foti, Calogero

    2015-01-01

    To perform a comprehensive analysis of the psychometric properties and dimensionality of the Upper Limb Functional Index (ULFI) using both classical test theory and Rasch analysis (RA). Prospective, single-group observational design. Freestanding rehabilitation center. Convenience sample of Italian-speaking subjects with upper limb musculoskeletal disorders (N=174). Not applicable. The Italian version of the ULFI. Data were analyzed using parallel analysis, exploratory factor analysis, and RA for evaluating dimensionality, functioning of rating scale categories, item fit, hierarchy of item difficulties, and reliability indices. Parallel analysis revealed 2 factors explaining 32.5% and 10.7% of the response variance. RA confirmed the failure of the unidimensionality assumption, and 6 items out of the 25 misfitted the Rasch model. When the analysis was rerun excluding the misfitting items, the scale showed acceptable fit values, loading meaningfully to a single factor. Item separation reliability and person separation reliability were .98 and .89, respectively. Cronbach alpha was .92. RA revealed weakness of the scale concerning dimensionality and internal construct validity. However, a set of 19 ULFI items defined through the statistical process demonstrated a unidimensional structure, good psychometric properties, and clinical meaningfulness. These findings represent a useful starting point for further analyses of the tool (based on modern psychometric approaches and confirmatory factor analysis) in larger samples, including different patient populations and nationalities. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  11. A psychometric evaluation of the Swedish version of the Research Utilization Questionnaire using a Rasch measurement model.

    Science.gov (United States)

    Lundberg, Veronica; Boström, Anne-Marie; Malinowsky, Camilla

    2017-07-30

    Evidence-based practice and research utilisation has become a commonly used concept in health care. The Research Utilization Questionnaire (RUQ) has been recognised to be a widely used instrument measuring the perception of research utilisation among nursing staff in clinical practice. Few studies have however analysed the psychometric properties of the RUQ. The aim of this study was to examine the psychometric properties of the Swedish version of the three subscales in RUQ using a Rasch measurement model. This study has a cross-sectional design using a sample of 163 staff (response rate 81%) working in one nursing home in Sweden. Data were collected using the Swedish version of RUQ in 2012. The three subscales Attitudes towards research, Availability of and support for research use and Use of research findings in clinical practice were investigated. Data were analysed using a Rasch measurement model. The results indicate presence of multidimensionality in all subscales. Moreover, internal scale validity and person response validity also provide some less satisfactory results, especially for the subscale Use of research findings. Overall, there seems to be a problem with the negatively worded statements. The findings suggest that clarification and refining of items, including additional psychometric evaluation of the RUQ, are needed before using the instrument in clinical practice and research studies among staff in nursing homes. © 2017 Nordic College of Caring Science.

  12. Fitting a Mixture Rasch Model to English as a Foreign Language Listening Tests: The Role of Cognitive and Background Variables in Explaining Latent Differential Item Functioning

    Science.gov (United States)

    Aryadoust, Vahid

    2015-01-01

    The present study uses a mixture Rasch model to examine latent differential item functioning in English as a foreign language listening tests. Participants (n = 250) took a listening and lexico-grammatical test and completed the metacognitive awareness listening questionnaire comprising problem solving (PS), planning and evaluation (PE), mental…

  13. A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D) in a Rheumatoid Arthritis Population using Rasch Analysis

    Science.gov (United States)

    Covic, Tanya; Pallant, Julie F; Conaghan, Philip G; Tennant, Alan

    2007-01-01

    Background The aim of this study was to test the internal validity of the total Center for Epidemiologic Studies-Depression (CES-D) scale using Rasch analysis in a rheumatoid arthritis (RA) population. Methods CES-D was administered to 157 patients with RA over three time points within a 12 month period. Rasch analysis was applied using RUMM2020 software to assess the overall fit of the model, the response scale used, individual item fit, differential item functioning (DIF) and person separation. Results Pooled data across three time points was shown to fit the Rasch model with removal of seven items from the original 20-item CES-D scale. It was necessary to rescore the response format from four to three categories in order to improve the scale's fit. Two items demonstrated some DIF for age and gender but were retained within the 13-item CES-D scale. A new cut point for depression score of 9 was found to correspond to the original cut point score of 16 in the full CES-D scale. Conclusion This Rasch analysis of the CES-D in a longstanding RA cohort resulted in the construction of a modified 13-item scale with good internal validity. Further validation of the modified scale is recommended particularly in relation to the new cut point for depression. PMID:17629902

  14. A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D in a Rheumatoid Arthritis Population using Rasch Analysis

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2007-07-01

    Full Text Available Abstract Background The aim of this study was to test the internal validity of the total Center for Epidemiologic Studies-Depression (CES-D scale using Rasch analysis in a rheumatoid arthritis (RA population. Methods CES-D was administered to 157 patients with RA over three time points within a 12 month period. Rasch analysis was applied using RUMM2020 software to assess the overall fit of the model, the response scale used, individual item fit, differential item functioning (DIF and person separation. Results Pooled data across three time points was shown to fit the Rasch model with removal of seven items from the original 20-item CES-D scale. It was necessary to rescore the response format from four to three categories in order to improve the scale's fit. Two items demonstrated some DIF for age and gender but were retained within the 13-item CES-D scale. A new cut point for depression score of 9 was found to correspond to the original cut point score of 16 in the full CES-D scale. Conclusion This Rasch analysis of the CES-D in a longstanding RA cohort resulted in the construction of a modified 13-item scale with good internal validity. Further validation of the modified scale is recommended particularly in relation to the new cut point for depression.

  15. Development and validation of the Brazilian version of the Attitudes to Aging Questionnaire (AAQ: An example of merging classical psychometric theory and the Rasch measurement model

    Directory of Open Access Journals (Sweden)

    Trentini Clarissa M

    2008-01-01

    Full Text Available Abstract Background Aging has determined a demographic shift in the world, which is considered a major societal achievement, and a challenge. Aging is primarily a subjective experience, shaped by factors such as gender and culture. There is a lack of instruments to assess attitudes to aging adequately. In addition, there is no instrument developed or validated in developing region contexts, so that the particularities of ageing in these areas are not included in the measures available. This paper aims to develop and validate a reliable attitude to aging instrument by combining classical psychometric approach and Rasch analysis. Methods Pilot study and field trial are described in details. Statistical analysis included classic psychometric theory (EFA and CFA and Rasch measurement model. The latter was applied to examine unidimensionality, response scale and item fit. Results Sample was composed of 424 Brazilian old adults, which was compared to an international sample (n = 5238. The final instrument shows excellent psychometric performance (discriminant validity, confirmatory factor analysis and Rasch fit statistics. Rasch analysis indicated that modifications in the response scale and item deletions improved the initial solution derived from the classic approach. Conclusion The combination of classic and modern psychometric theories in a complementary way is fruitful for development and validation of instruments. The construction of a reliable Brazilian Attitudes to Aging Questionnaire is important for assessing cultural specificities of aging in a transcultural perspective and can be applied in international cross-cultural investigations running less risk of cultural bias.

  16. Using Rasch Measurement To Investigate the Cross-form Equivalence and Clinical Utility of Spanish and English Versions of a Diabetes Questionnaire: A Pilot Study.

    Science.gov (United States)

    Gerber, Ben; Smith, Everett V., Jr.; Girotti, Mariela; Pelaez, Lourdes; Lawless, Kimberly; Smolin, Louanne; Brodsky, Irwin; Eiser, Arnold

    2002-01-01

    Used Rasch measurement to study the psychometric properties of data obtained from a newly developed Diabetes Questionnaire designed to measure diabetes knowledge, attitudes, and self-care. Responses of 26 diabetes patients to the English version of the questionnaire and 24 patients to the Spanish version support the cross-form equivalence and…

  17. Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments: An Illustration with the Advanced Placement Environmental Science Exam

    Science.gov (United States)

    Kaliski, Pamela K.; Wind, Stefanie A.; Engelhard, George, Jr.; Morgan, Deanna L.; Plake, Barbara S.; Reshetar, Rosemary A.

    2013-01-01

    The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

  18. Rasch Validation and Cross-validation of the Health of Nation Outcome Scales (HoNOS) for Monitoring of Psychiatric Disability in Traumatized Refugees in Western Psychiatric Care

    DEFF Research Database (Denmark)

    Palic, Sabina; Kappel, Michelle Lind; Makransky, Guido

    2016-01-01

    group. A revised 10-item HoNOS fit the Rasch model at pre-treatment, and also showed excellent fit within the cross-validation data. Culture, gender, and need for translation did not exert serious bias on the measure’s performance. The results establish good monitoring properties of the 10-item Ho...

  19. Validación de la escala para manía de la Universidad Nacional de Colombia usando el análisis de Rasch

    Directory of Open Access Journals (Sweden)

    Ricardo Sánchez

    2011-03-01

    Conclusiones. En este primer estudio de la escala para manías usando el análisis de Rasch, se detectó mal ajuste y redundancia de algunos ítems. El síndrome maníaco no queda completamente evaluado por la escala. El instrumento podría mejorarse agregando síntomas depresivos.

  20. Factors associated with knowledge of diabetes in patients with type 2 diabetes using the Diabetes Knowledge Test validated with Rasch analysis.

    Directory of Open Access Journals (Sweden)

    Eva K Fenwick

    Full Text Available OBJECTIVE: In patients with Type 2 diabetes, to determine the factors associated with diabetes knowledge, derived from Rasch analysis, and compare results with a traditional raw scoring method. RESEARCH DESIGN & METHODS: Participants in this cross-sectional study underwent a comprehensive clinical and biochemical assessment. Diabetes knowledge (main outcome was assessed using the Diabetes Knowledge Test (DKT which was psychometrically validated using Rasch analysis. The relationship between diabetes knowledge and risk factors identified during univariate analyses was examined using multivariable linear regression. The results using raw and Rasch-transformed methods were descriptively compared. RESULTS: 181 patients (mean age±standard deviation = 66.97±9.17 years; 113 (62% male were included. Using Rasch-derived DKT scores, those with greater education (β = 1.14; CI: 0.25,2.04, p = 0.013; had seen an ophthalmologist (β = 1.65; CI: 0.63,2.66, p = 0.002, and spoke English at home (β = 1.37; CI: 0.43,2.31, p = 0.005 had significantly better diabetes knowledge than those with less education, had not seen an ophthalmologist and spoke a language other than English, respectively. Patients who were members of the National Diabetes Service Scheme (NDSS and had seen a diabetes educator also had better diabetes knowledge than their counterparts. Higher HbA1c level was independently associated with worse diabetes knowledge. Using raw measures, access to an ophthalmologist and NDSS membership were not independently associated with diabetes knowledge. CONCLUSIONS: Sociodemographic, clinical and service use factors were independently associated with diabetes knowledge based on both raw scores and Rasch-derived scores, which supports the implementation of targeted interventions to improve patients' knowledge. Choice of psychometric analytical method can affect study outcomes and should be considered during intervention

  1. Factors Associated with Knowledge of Diabetes in Patients with Type 2 Diabetes Using the Diabetes Knowledge Test Validated with Rasch Analysis

    Science.gov (United States)

    Fenwick, Eva K.; Xie, Jing; Rees, Gwyn; Finger, Robert P.; Lamoureux, Ecosse L.

    2013-01-01

    Objective In patients with Type 2 diabetes, to determine the factors associated with diabetes knowledge, derived from Rasch analysis, and compare results with a traditional raw scoring method. Research Design & Methods Participants in this cross-sectional study underwent a comprehensive clinical and biochemical assessment. Diabetes knowledge (main outcome) was assessed using the Diabetes Knowledge Test (DKT) which was psychometrically validated using Rasch analysis. The relationship between diabetes knowledge and risk factors identified during univariate analyses was examined using multivariable linear regression. The results using raw and Rasch-transformed methods were descriptively compared. Results 181 patients (mean age±standard deviation = 66.97±9.17 years; 113 (62%) male) were included. Using Rasch-derived DKT scores, those with greater education (β = 1.14; CI: 0.25,2.04, p = 0.013); had seen an ophthalmologist (β = 1.65; CI: 0.63,2.66, p = 0.002), and spoke English at home (β = 1.37; CI: 0.43,2.31, p = 0.005) had significantly better diabetes knowledge than those with less education, had not seen an ophthalmologist and spoke a language other than English, respectively. Patients who were members of the National Diabetes Service Scheme (NDSS) and had seen a diabetes educator also had better diabetes knowledge than their counterparts. Higher HbA1c level was independently associated with worse diabetes knowledge. Using raw measures, access to an ophthalmologist and NDSS membership were not independently associated with diabetes knowledge. Conclusions Sociodemographic, clinical and service use factors were independently associated with diabetes knowledge based on both raw scores and Rasch-derived scores, which supports the implementation of targeted interventions to improve patients' knowledge. Choice of psychometric analytical method can affect study outcomes and should be considered during intervention development. PMID:24312484

  2. Brazilian WHOQOL-OLD Module version: a Rasch analysis of a new instrument Versão em português do Módulo WHOQOL-OLD: análise de Rasch de um novo instrumento

    Directory of Open Access Journals (Sweden)

    Eduardo Chachamovich

    2008-04-01

    Full Text Available OBJECTIVE: To evaluate the Brazilian version of WHOQOL-OLD Module and to test potential changes to the instrument to increase its psychometric adequacy. METHODS: A total of 424 older adults living in a city in Southern Brazil completed the WHOQOL-OLD instrument, in 2005. Rasch analysis was used to explore the psychometric performance of the scale, as implemented by the RUMM2020 software. Item-trait interaction, threshold disorders, presence of differential item functioning and item fit, were analyzed. RESULTS: Two ("death and dying" and "sensory abilities" out of six domains showed inadequate item-trait interactions. Rescoring the response scale and deleting the most misperforming items led to scale improvement. The evaluation of domains and items individually showed that the "intimacy" domain does perform well in contrast to the findings using the classical approach. In addition, the "sensory abilities" domain does not derive an interval measure in its current format. CONCLUSIONS: Unidimensionality and local independence were seen in all domains. Changes in the response scale and deletion of problematic items improved the scale's performance.OBJETIVO: Analisar a versão brasileira do Módulo WHOQOL-OLD, indicando alterações potenciais do instrumento para aumentar a adequação psicométrica. MÉTODOS: O total de 424 idosos residentes em Porto Alegre, RS, responderam o instrumento WHOQOL-OLD em 2005. O modelo de Rasch foi utilizado para a análise do desempenho psicométrico da escala, a partir do software RUMM2020. Foram analisadas a interação item-traço, a presença de funcionamento diferencial dos itens e a adequação dos itens ao modelo de Rasch. RESULTADOS: Dois domínios ("morte e morrer" e "funcionamento do sensório" apresentaram interação item-total insuficiente. Remodelar a escala de resposta e excluir itens com pior performance resultou em melhora da escala. A análise dos domínios e itens individualmente foi capaz de indicar

  3. Measuring health-related problem solving among African Americans with multiple chronic conditions: application of Rasch analysis.

    Science.gov (United States)

    Fitzpatrick, Stephanie L; Hill-Briggs, Felicia

    2015-10-01

    Identification of patients with poor chronic disease self-management skills can facilitate treatment planning, determine effectiveness of interventions, and reduce disease complications. This paper describes the use of a Rasch model, the Rating Scale Model, to examine psychometric properties of the 50-item Health Problem-Solving Scale (HPSS) among 320 African American patients with high risk for cardiovascular disease. Items on the positive/effective HPSS subscales targeted patients at low, moderate, and high levels of positive/effective problem solving, whereas items on the negative/ineffective problem solving subscales mostly targeted those at moderate or high levels of ineffective problem solving. Validity was examined by correlating factor scores on the measure with clinical and behavioral measures. Items on the HPSS show promise in the ability to assess health-related problem solving among high risk patients. However, further revisions of the scale are needed to increase its usability and validity with large, diverse patient populations in the future.

  4. Developing a Measure of Therapist Adherence to Contingency Management: An Application of the Many-Facet Rasch Model.

    Science.gov (United States)

    Chapman, Jason E; Sheidow, Ashli J; Henggeler, Scott W; Halliday-Boykins, Colleen; Cunningham, Phillippe B

    2008-06-01

    A unique application of the Many-Facet Rasch Model (MFRM) is introduced as the preferred method for evaluating the psychometric properties of a measure of therapist adherence to Contingency Management (CM) treatment of adolescent substance use. The utility of psychometric methods based in Classical Test Theory was limited by complexities of the data, including: (a) ratings provided by multiple informants (i.e., youth, caregivers, and therapists), (b) data from separate research studies, (c) repeated measurements, (d) multiple versions of the questionnaire, and (e) missing data. Two dimensions of CM adherence were supported: adherence to Cognitive Behavioral components and adherence to Monitoring components. The rating scale performed differently for items in these subscales, and of 11 items evaluated, eight were found to perform well. The MFRM is presented as a highly flexible approach that can be used to overcome the limitations of traditional methods in the development of adherence measures for evidence-based practices.

  5. Investigation of the prominent barriers to lean manufacturing implementation in Malaysian food and beverages industry using Rasch Model

    Science.gov (United States)

    Khusaini, N. S.; Ismail, A.; Rashid, A. A.

    2016-02-01

    This paper presents a preliminary study on the prominent barriers to lean manufacturing implementation in Malaysian Food and Beverages Industry. A survey was carried out to determine the most prominent barriers of lean manufacturing implementation that are currently being faced in this industry. The amount of barriers identified for this study is twenty seven. Out of 1309 available organizations, a total of 300 organizations have been randomly selected as respondents, and 53 organizations responded. From the variable map, the analysis shows that, the negative perception towards lean manufacturing top the list as the most agreeable barrier, while the technical barriers came after it. It can also be seen from the variable map that averagely, lack of vision and direction is the barrier that is being faced. Finally, this is perhaps the first attempt in investigating the prominent barriers to Lean Manufacturing implementation in Malaysian food and beverages industry using Rasch Model.

  6. The Cervical Dystonia Impact Profile (CDIP-58: Can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

    Directory of Open Access Journals (Sweden)

    Bhatia Kailash P

    2008-08-01

    Full Text Available Abstract Background The United States Food and Drug Administration (FDA are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58, a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1 provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2 enable researchers and clinicians to compare it with existing dystonia PROMs; and 3 help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. Methods We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. Results A total of 391 people returned completed questionnaires (corrected response rate 87%. Analyses showed: 1 data quality was high (low missing data ≤ 4%, subscale scores could be computed for > 96% of the sample; 2 item groupings passed tests for scaling assumptions; 3 good targeting (except for the Sleep subscale, ceiling effect = 27%; 4 good reliability (Cronbach's alpha ≥ 0.92, test-retest intraclass correlations ≥ 0.83; and 5 validity was supported. Conclusion This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis.

  7. Psychometric properties of the Zarit Caregiver Burden Interview administered to caregivers to patients with Duchenne muscular dystrophy: a Rasch analysis.

    Science.gov (United States)

    Landfeldt, Erik; Mayhew, Anna; Straub, Volker; Bushby, Katharine; Lochmüller, Hanns; Lindgren, Peter

    2017-12-18

    To explore the psychometric properties of the full 22-item English (UK and US) version of the Zarit Caregiver Burden Interview administered to caregivers to patients with Duchenne muscular dystrophy. Caregivers to patients with Duchenne muscular dystrophy from the United Kingdom and the United States, recruited through the TREAT-NMD network, completed the Zarit Caregiver Burden Interview online. The psychometric properties of the Zarit Caregiver Burden Interview were examined using Rasch analysis. A total of 475 caregivers completed the Zarit Caregiver Burden Interview. Model misfit was identified for 9 of 22 items (mean item fit residual 0.061, SD: 2.736) and 13 of 22 items displayed disordered thresholds. The overall item-trait interaction chi-square value was 499 (198 degrees of freedom, p Interview fails to fully operationalize a quantitative conceptualization of caregiver burden among caregivers to patients with Duchenne muscular dystrophy from the United Kingdom and the United States. Further research is needed to understand the psychometric properties of the Zarit Caregiver Burden Interview in other populations and settings. Implications for Rehabilitation Duchenne muscular dystrophy is a terminal disease characterized by progressive muscle degeneration resulting in substantial disability and a significant burden on family caregivers. The Zarit Caregiver Burden Interview is one of the most widely applied measures of caregiver burden. Our Rasch analysis suggests that the Zarit Caregiver Burden Interview is not fit for purpose to measure burden in UK and US caregivers to patients with Duchenne muscular dystrophy. Clinicians and decision-makers should interpret Zarit Caregiver Burden Interview data from these populations with caution.

  8. The nutrition for sport knowledge questionnaire (NSKQ): development and validation using classical test theory and Rasch analysis.

    Science.gov (United States)

    Trakman, Gina Louise; Forsyth, Adrienne; Hoye, Russell; Belski, Regina

    2017-01-01

    Appropriate dietary intake can have a significant influence on athletic performance. There is a growing consensus on sports nutrition and professionals working with athletes often provide dietary education. However, due to the limitations of existing sports nutrition knowledge questionnaires, previous reports of athletes' nutrition knowledge may be inaccurate. An updated questionnaire has been developed based on a recent review of sports nutrition guidelines. The tool has been validated using a robust methodology that incorporates relevant techniques from classical test theory (CTT) and Item response theory (IRT), namely, Rasch analysis. The final questionnaire has 89 questions and six sub-sections (weight management, macronutrients, micronutrients, sports nutrition, supplements, and alcohol). The content and face validity of the tool have been confirmed based on feedback from expert sports dietitians and university sports students, respectively. The internal reliability of the questionnaire as a whole is high (KR = 0.88), and most sub-sections achieved an acceptable internal reliability. Construct validity has been confirmed, with an independent T-test revealing a significant ( p  < 0.001) difference in knowledge scores of nutrition (64 ± 16%) and non-nutrition students (51 ± 19%). Test-retest reliability has been assured, with a strong correlation ( r  = 0.92, p  < 0.001) between individuals' scores on two attempts of the test, 10 days to 2 weeks apart. Three of the sub-sections fit the Rasch Unidimensional Model. The final version of the questionnaire represents a significant improvement over previous tools. Each nutrition sub-section is unidimensional, and therefore researchers and practitioners can use these individually, as required. Use of the questionnaire will allow researchers to draw conclusions about the effectiveness of nutrition education programs, and differences in knowledge across athletes of varying ages, genders, and athletic

  9. Predicting the need for institutional care shortly after admission to rehabilitation: Rasch analysis and predictive validity of the BRASS Index.

    Science.gov (United States)

    Panella, L; La Porta, F; Caselli, S; Marchisio, S; Tennant, A

    2012-09-01

    Effective discharge planning is increasingly recognised as a critical component of hospital-based Rehabilitation. The BRASS index is a risk screening tool for identification, shortly after hospital admission, of patients who are at risk of post-discharge problems. To evaluate the internal construct validity and reliability of the Blaylock Risk Assessment Screening Score (BRASS) within the rehabilitation setting. Observational prospective study. Rehabilitation ward of an Italian district hospital. One hundred and four consecutively admitted patients. Using classical psychometric methods and Rasch analysis (RA), the internal construct validity and reliability of the BRASS were examined. Also, external and predictive validity of the Rasch-modified BRASS (RMB) score were determined. Reliability of the original BRASS was low (Cronbach's alpha=0.595) and factor analyses showed that it was clearly multidimensional. A RA, based on a reduced 7-BRASS item set (RMB), satisfied model's expectations. Reliability was 0.777. The RMB scores strongly correlated with the original BRASS (rho=0.952; P28 days (RR=7.6, 95%CI=1.8-31.9). This study demonstrated that the original BRASS was multidimensional and unreliable. However, the RMB holds adequate internal construct validity and is sufficiently reliable as a predictor of discharge problems for group, but not individual use. The application of tools and methods (such as the BRASS Index) developed under the biomedical paradigm in a Physical and Rehabilitation Medicine setting may have limitations. Further research is needed to develop, within the rehabilitation setting, a valid measuring tool of risk of post-discharge problems at the individual level.

  10. Validation of the Danish version of the McGill Ingestive Skills Assessment using classical test theory and the Rasch model

    DEFF Research Database (Denmark)

    Hansen, Tina; Lambert, Heather C; Faber, Jens

    2012-01-01

    Purpose: The study aimed to validate the Danish version of the Canadian the "McGill Ingestive Skills Assessment" (MISA-DK) for measuring dysphagia in frail elders. Method: One-hundred and ten consecutive older medical patients were recruited to the study. Reliability was assessed by internal...... consistency (Chronbach's alpha). External construct validity (convergent and known-groups validity) was evaluated against theoretical constructs assessing the complex concept of ingestive skills. Internal construct validity was tested using Rasch analysis. Results: High internal consistency reliability...... with Chronbach's alpha of 0.77-0.95 was evident. External construct validity was supported by expected high correlations with most of the constructs related to ingestive skills (r(s)¿=¿0.53 to r(s)¿=¿0.66). The MISA-DK discriminated significantly between known-groups. Fit to the Rasch model (x(2) (df)¿=¿12 (12...

  11. Rasch models suggested the satisfactory psychometric properties of the World Health Organization Quality of Life-Brief among lung cancer patients.

    Science.gov (United States)

    Lin, Chung-Ying; Yang, Szu-Chun; Lai, Wu-Wei; Su, Wu-Chou; Wang, Jung-Der

    2017-03-01

    The study examined whether the items of the World Health Organization Quality of Life-Brief questionnaire can assess its four underlying domains (Physical, Psychological, Social, and Environment) in a sample of lung cancer patients. All patients ( n = 1150) were recruited from a medical center in Tainan, and each participant completed the World Health Organization Quality of Life-Brief. Several Rasch rating scale models were used to examine the data-model fit, and Rasch analyses corroborated that each domain of the World Health Organization Quality of Life-Brief could be unidimensional. Although three items were found to have a poor fit, all the other items fit the unidimensionality with ordered thresholds.

  12. Quality of life in the Danish general population--normative data and validity of WHOQOL-BREF using Rasch and item response theory models

    DEFF Research Database (Denmark)

    Noerholm, V; Groenvold, M; Watt, T

    2004-01-01

    BACKGROUND: The main objective of this study was to investigate the construct validity of the WHOQOL-BREF by use of Rasch and Item Response Theory models and to examine the stability of the model across high/low scoring individuals, gender, education, and depressive illness. Furthermore......, the objective of the study was to estimate the reference data for the quality of life questionnaire WHOQOL-BREF in the general Danish population and in subgroups defined by age, gender, and education. METHODS: Mail-out-mail-back questionnaires were sent to a randomly selected sample of the Danish general...... population. The response rate was 68.5%, and the sample reported here contained 1101 respondents: 578 women and 519 men (four respondents did not indicate their genders). RESULTS: Each of the four domains of the WHOQOL-BREF scale fitted a two-parameter IRT model, but did not fit the Rasch model. Due...

  13. Cross-cultural validity of the Spanish version of PHQ-9 among pregnant Peruvian women: a Rasch item response theory analysis.

    Science.gov (United States)

    Zhong, Qiuyue; Gelaye, Bizu; Fann, Jesse R; Sanchez, Sixto E; Williams, Michelle A

    2014-04-01

    We sought to evaluate the validity of the Spanish language version of the patient health questionnaire-9 (PHQ-9) depression scale in a large sample of pregnant Peruvian women using Rasch item response theory (IRT) approaches. We further sought to examine the appropriateness of the response formats, reliability and potential differential item functioning (DIF) by maternal age, educational attainment and employment status. This cross-sectional study was conducted among 1520 pregnant women in Lima, Peru. A structured interview was used to collect information on demographic characteristics and PHQ-9 items. Data from the PHQ-9 were fitted to the Rasch IRT model and tested for appropriate category ordering, the assumptions of unidimensionality and local independence, item fit, reliability and presence of DIF. The Spanish language version of PHQ-9 demonstrated unidimensionality, local independence, and acceptable fit for the Rasch IRT model. However, we detected disordered response categories for the original four response categories. After collapsing "more than half the days" and "nearly every day", the response categories ordered properly and the PHQ-9 fit the Rasch IRT model. The PHQ-9 had moderate internal consistency (person separation index, PSI=0.72). Additionally, the items of PHQ-9 were free of DIF with regard to age, educational attainment, and employment status. The Spanish language version of the PHQ-9 was shown to have item properties of an effective screening instrument. Collapsing rating scale categories and reconstructing three-point Likert scale for all items improved the fit of the instrument. Future studies are warranted to establish new cutoff scores and criterion validity of the three-point Likert scale response options for the Spanish language version of the PHQ-9. Copyright © 2014 Elsevier B.V. All rights reserved.

  14. With hiccups and bumps: the development of a Rasch-based instrument to measure elementary students' understanding of the nature of science.

    Science.gov (United States)

    Peoples, Shelagh M; O'Dwyer, Laura M; Shields, Katherine A; Wang, Yang

    2013-01-01

    This research describes the development process, psychometric analyses and part validation study of a theoretically-grounded Rasch-based instrument, the Nature of Science Instrument-Elementary (NOSI-E). The NOSI-E was designed to measure elementary students' understanding of the Nature of Science (NOS). Evidence is provided for three of the six validity aspects (content, substantive and generalizability) needed to support the construct validity of the NOSI-E. A future article will examine the structural and external validity aspects. Rasch modeling proved especially productive in scale improvement efforts. The instrument, designed for large-scale assessment use, is conceptualized using five construct domains. Data from 741 elementary students were used to pilot the Rasch scale, with continuous improvements made over three successive administrations. The psychometric properties of the NOSI-E instrument are consistent with the basic assumptions of Rasch measurement, namely that the items are well-fitting and invariant. Items from each of the five domains (Empirical, Theory-Laden, Certainty, Inventive, and Socially and Culturally Embedded) are spread along the scale's continuum and appear to overlap well. Most importantly, the scale seems appropriately calibrated and responsive for elementary school-aged children, the target age group. As a result, the NOSI-E should prove beneficial for science education research. As the United States' science education reform efforts move toward students' learning science through engaging in authentic scientific practices (NRC, 2011), it will be important to assess whether this new approach to teaching science is effective. The NOSI-E can be used as one measure of whether this reform effort has an impact.

  15. Construct validity of the Heart Failure Screening Tool (Heart-FaST) to identify heart failure patients at risk of poor self-care: Rasch analysis.

    Science.gov (United States)

    Reynolds, Nicholas A; Ski, Chantal F; McEvedy, Samantha M; Thompson, David R; Cameron, Jan

    2018-02-14

    The aim of this study was to psychometrically evaluate the Heart Failure Screening Tool (Heart-FaST) via: (1) examination of internal construct validity; (2) testing of scale function in accordance with design; and (3) recommendation for change/s, if items are not well adjusted, to improve psychometric credential. Self-care is vital to the management of heart failure. The Heart-FaST may provide a prospective assessment of risk, regarding the likelihood that patients with heart failure will engage in self-care. Psychometric validation of the Heart-FaST using Rasch analysis. The Heart-FaST was administered to 135 patients (median age = 68, IQR = 59-78 years; 105 males) enrolled in a multidisciplinary heart failure management program. The Heart-FaST is a nurse-administered tool for screening patients with HF at risk of poor self-care. A Rasch analysis of responses was conducted which tested data against Rasch model expectations, including whether items serve as unbiased, non-redundant indicators of risk and measure a single construct and that rating scales operate as intended. The results showed that data met Rasch model expectations after rescoring or deleting items due to poor discrimination, disordered thresholds, differential item functioning, or response dependence. There was no evidence of multidimensionality which supports the use of total scores from Heart-FaST as indicators of risk. Aggregate scores from this modified screening tool rank heart failure patients according to their "risk of poor self-care" demonstrating that the Heart-FaST items constitute a meaningful scale to identify heart failure patients at risk of poor engagement in heart failure self-care. © 2018 John Wiley & Sons Ltd.

  16. Unified Balance Scale: an activity-based, bed to community, and aetiology-independent measure of balance calibrated with Rasch analysis.

    Science.gov (United States)

    La Porta, Fabio; Franceschini, Marco; Caselli, Serena; Cavallini, Paola; Susassi, Sonia; Tennant, Alan

    2011-04-01

    To build a new activity-based, "bed to community", aetiology-independent measure of balance within the neurological rehabilitation setting by merging some existing scales. Balance scales were selected using a conceptual framework and subsequently administered to a convenience sample of adult patients with balance problems due to different neurological aetiologies. Data were then processed using classical psychometric analyses and Rasch analysis in order to construct a new balance measurement tool. The Berg Balance Scale, the Tinetti Scales and the Fullerton Advanced Balance Scale were selected and administered to a sample of patients, giving 302 observations. Classical psychometric analyses (item and scale analysis; confirmatory factor analysis) were undertaken on the pooled 40-item set with confirmation of unidimensionality. The subsequent Rasch analysis allowed the identification of a 27-item set satisfying the Rasch Model's requirements for fundamental measurement, with further confirmation of unidimensionality by post-hoc confirmatory factor analysis. The new scale (Unified Balance Scale) holds proven measurement properties and may be a candidate tool for "bed to community" balance measurement for patients with balance problems within the neuro-rehabilitation setting. Future studies are warranted to explore further its external validity and other clinical properties, as well as to improve its usability.

  17. Improving Measurement of Trait Competitiveness: A Rasch Analysis of the Revised Competitiveness Index With Samples From New Zealand and US University Students.

    Science.gov (United States)

    Krägeloh, Christian U; Medvedev, Oleg N; Hill, Erin M; Webster, Craig S; Booth, Roger J; Henning, Marcus A

    2018-01-01

    Measuring competitiveness is necessary to fully understand variables affecting student learning. The 14-item Revised Competitiveness Index has become a widely used measure to assess trait competitiveness. The current study reports on a Rasch analysis to investigate the psychometric properties of the Revised Competitiveness Index and to improve its precision for international comparisons. Students were recruited from medical studies at a university in New Zealand, undergraduate health sciences courses at another New Zealand university, and a psychology undergraduate class at a university in the United States. Rasch model estimate parameters were affected by local dependency and item misfit. Best fit to the Rasch model (χ 2 (20) = 15.86, p = .73, person separation index = .95) was obtained for the Enjoyment of Competition subscale after combining locally dependent items into a subtest and discarding the highly misfitting Item 9. The only modifications required to obtain a suitable fit (χ 2 (25) = 25.81, p = .42, person separation index = .77) for the Contentiousness subscale were a subtest to combine two locally dependent items and splitting this subtest by country to deal with differential item functioning. The results support reliability and internal construct validity of the modified Revised Competitiveness Index. Precision of the measure may be enhanced using the ordinal-to-interval conversion algorithms presented here, allowing the use of parametric statistics without breaking fundamental statistical assumptions.

  18. Examination of an eHealth literacy scale and a health literacy scale in a population with moderate to high cardiovascular risk: Rasch analyses.

    Directory of Open Access Journals (Sweden)

    Sarah S Richtering

    Full Text Available Electronic health (eHealth strategies are evolving making it important to have valid scales to assess eHealth and health literacy. Item response theory methods, such as the Rasch measurement model, are increasingly used for the psychometric evaluation of scales. This paper aims to examine the internal construct validity of an eHealth and health literacy scale using Rasch analysis in a population with moderate to high cardiovascular disease risk.The first 397 participants of the CONNECT study completed the electronic health Literacy Scale (eHEALS and the Health Literacy Questionnaire (HLQ. Overall Rasch model fit as well as five key psychometric properties were analysed: unidimensionality, response thresholds, targeting, differential item functioning and internal consistency.The eHEALS had good overall model fit (χ2 = 54.8, p = 0.06, ordered response thresholds, reasonable targeting and good internal consistency (person separation index (PSI 0.90. It did, however, appear to measure two constructs of eHealth literacy. The HLQ subscales (except subscale 5 did not fit the Rasch model (χ2: 18.18-60.60, p: 0.00-0.58 and had suboptimal targeting for most subscales. Subscales 6 to 9 displayed disordered thresholds indicating participants had difficulty distinguishing between response options. All subscales did, nonetheless, demonstrate moderate to good internal consistency (PSI: 0.62-0.82.Rasch analyses demonstrated that the eHEALS has good measures of internal construct validity although it appears to capture different aspects of eHealth literacy (e.g. using eHealth and understanding eHealth. Whilst further studies are required to confirm this finding, it may be necessary for these constructs of the eHEALS to be scored separately. The nine HLQ subscales were shown to measure a single construct of health literacy. However, participants' scores may not represent their actual level of ability, as distinction between response categories was unclear for

  19. Psychometric properties of the International Classification of Functioning, Disability and Health set for spinal cord injury nursing based on Rasch analysis.

    Science.gov (United States)

    Li, Kun; Yan, Tiebin; You, Liming; Xie, Sumei; Li, Yun; Tang, Jie; Wang, Yingmin; Gao, Yan

    2018-02-01

    To examine the psychometric properties of the International Classification of Functioning, Disability and Health (ICF) set for spinal cord injury nursing (ICF-SCIN) using Rasch analysis. A total of 140 spinal cord injury patients were recruited between December 2013 and March 2014 through convenience sampling. Nurses used the components body functions (BF), body structures (BS), and activities and participation (AP) of the ICF-SCIN to rate the patients' functioning. Rasch analysis was performed using RUMM 2030 software. In each component, categories were rescored from 01234 to 01112 because of reversed thresholds. Nine testlets were created to overcome local dependency. Four categories which fit to the Rasch model poorly were deleted. After modification, the components BF, BS, and AP showed good fit to the Rasch model with a Bonferroni-adjusted significant level (χ 2  =   86.29, p = 0.006; χ 2  =   22.44, p = 0.130; χ 2  =   39.92, p = 0.159). The person separation indices (PSIs) for the three components were 0.80, 0.54, and 0.97, respectively. No differential item functioning (DIF) was detected across age, gender, or educational level. The fit properties of the ICF set were satisfactory after modifications. The ICF-SCIN has the potential as a nursing assessment instrument for measuring the functioning of patients with spinal cord injury. Implications for rehabilitation The International Classification of Functioning, Disability and Health (ICF) set for spinal cord injury nursing contains a group of categories which can reflect the functioning of spinal cord injury patients from the perspective of nurses. The components body functions (BF), body structures (BS), and activities and participation (AP) of the ICF set for spinal cord injury achieved the fit to the Rasch model through rescoring, generating testlets, and deleting categories with poor fit. The ICF set for spinal cord injury nursing (ICF-SCIN) has the potential to be used as a

  20. Validation of the malaysian versions of parents and children health survey for asthma by using rasch-model.

    Science.gov (United States)

    Hussein, Maryam Se; Akram, Waqas; Mamat, Mohd Nor; Majeed, Abu Bakar Abdul; Ismail, Nahlah Elkudssiah Binti

    2015-04-01

    In recent years, health-related quality of life (HRQOL) has become an important outcome measure in epidemiologic studies and clinical trials. For patients with asthma there are many instruments but most of them have been developed in English. With the increase in research project, researchers working in other languages have two options; either to develop a new measure or to translate an already developed measure. Children Health Survey for Asthma is developed by American Academy of Paediatrics which has two versions one for the parents (CHSA) and the other for the child (CHSA-C). However, there is no Malay version of the CHSA or the CHSA-C. The aim of this study was to translate and determine the validity and reliability of the Malaysian versions of Parent and Children Health Survey for Asthma. Questionnaires were translated to Bahasa Malayu using previously established guidelines, data from 180 respondents (asthmatic children and their parent) were analysed using Rasch-Model; as, it is an approach that has been increasingly used in health field and also it explores the performance of each item rather than total set score. The internal consistency was high for the parent questionnaire (CHSA) (reliability score for persons = 0.88 and for items was 0.97), and good for child questionnaire (CHSA-C) (reliability score for persons = 0.83 and for items was 0.94). Also, this study shows that all items measure for both questionnaires (CHSA and CHSA-C) are fitted to Rasch-Model. This study produced questionnaires that are conceptually equivalent to the original, easy to understand for the children and their parents, and good in terms of internal consistency. Because of the questionnaire has two versions one for the child and the other for the parents, they could be used in clinical practice to measure the effect of asthma on the child and their families. This current research had translated two instruments to other language (BahasaMalayu) and evaluated their reliability and

  1. Rasch measurement of self-regulated learning in an information and communication technology (ICT)-rich environment.

    Science.gov (United States)

    Njiru, Joseph N; Waugh, Russell F

    2007-01-01

    This report describes how a linear scale of self-regulated learning in an ICT-rich environment was created by analysing student data using the Rasch measurement model. A person convenience sample of (N = 409) university students in Western Australia was used. The stem-item sample was initially 41, answered in two perspectives ("I aim for this" and "I actually do this"), and reduced to 16 that fitted the measurement model to form a unidimensional scale. Items for motivation (extrinsic rewards, intrinsic rewards, and social rewards), academic goals (fear of performing poorly) (but not standards), self-learning beliefs (ability and interest), task management (strategies and time management) (but not cooperative learning), Volition (action control (but not environmental control), and self-evaluation (cognitive self-evaluation and metacognition) fitted the measurement model. The proportion of observed variance considered true was 0.90. A new instrument is proposed to handle the conceptually valid but non-fitting items. Characteristics of high self-regulated learners are measured.

  2. Psychometric properties of the Oswestry disability index: Rasch analysis of responses in a work-disabled population.

    Science.gov (United States)

    Lochhead, Lois E; MacMillan, Peter D

    2013-01-01

    The Oswestry disability index (ODI) is the most widely used measure of perceived disability for low back conditions. It has been adopted without adaptation in functional capacity evaluation (FCE). Rigorous testing of the ODI with modern psychometric methods, in this setting, is warranted. To determine the psychometric properties of the ODI in FCE: unidimensionality; differential item functioning; item coverage and to identify poorly functioning items, allowing for improvement of these items and recalibration of the scale. Rasch analysis, specifically Masters' partial credit model, was conducted on data. 133 work-disabled individuals presenting for FCE in northern British Columbia, Canada. All items had one poorly functioning option. Items were rescaled from six categories to five, improving the psychometric properties of the ODI as a unidimensional (disability due to back pain) scale. Item difficulty range is sufficient for a population with mild to severe disability. Although two of the ten ODI items functioned marginally unsatisfactorily in the unrevised state, the 5-option revised ODI appears superior. Use in clinical settings across a broad spectrum of disability levels could help establish its psychometric properties. Health professionals should be aware that the ODI may perform differently depending on client population.

  3. Assessment of Student Performance for Course Examination Using Rasch Measurement Model: A Case Study of Information Technology Fundamentals Course

    Directory of Open Access Journals (Sweden)

    Amir Mohamed Talib

    2018-01-01

    Full Text Available This paper describes a measurement model that is used to measure the student performance in the final examination of Information Technology (IT Fundamentals (IT280 course in the Information Technology (IT Department, College of Computer & Information Sciences (CCIS, Al-Imam Mohammad Ibn Saud Islamic University (IMSIU. The assessment model is developed based on students’ mark entries of final exam results for the second year IT students, which are compiled and tabulated for evaluation using Rasch Measurement Model, and it can be used to measure the students’ performance towards the final examination of the course. A study on 150 second year students (male = 52; female = 98 was conducted to measure students’ knowledge and understanding for IT280 course according to the three level of Bloom’s Taxonomy. The results concluded that students can be categorized as poor (10%, moderate (42%, good (18%, and successful (24% to achieve Level 3 of Bloom’s Taxonomy. This study shows that the students’ performance for the set of IT280 final exam questions was comparatively good. The result generated from this study can be used to guide us to determine the appropriate improvement of teaching method and the quality of question prepared.

  4. Meeting the requirements of both classroom-based and systemic assessment of mathematics proficiency: The potential of Rasch measurement theory

    Directory of Open Access Journals (Sweden)

    Tim Dunne

    2012-11-01

    Full Text Available The challenges inherent in assessing mathematical proficiency depend on a number of factors, amongst which are an explicit view of what constitutes mathematical proficiency, an understanding of how children learn and the purpose and function of teaching. All of these factors impact on the choice of approach to assessment. In this article we distinguish between two broad types of assessment, classroom-based and systemic assessment. We argue that the process of assessment informed by Rasch measurement theory (RMT can potentially support the demands of both classroom-based and systemic assessment, particularly if a developmental approach to learning is adopted, and an underlying model of developing mathematical proficiency is explicit in the assessment instruments and their supporting material. An example of a mathematics instrument and its analysis which illustrates this approach, is presented. We note that the role of assessment in the 21st century is potentially powerful. This influential role can only be justified if the assessments are of high quality and can be selected to match suitable moments in learning progress and the teaching process. Users of assessment data must have sufficient knowledge and insight to interpret the resulting numbers validly, and have sufficient discernment to make considered educational inferences from the data for teaching and learning responses.

  5. Validation of a Targeted Peer Relations Scale for Adolescents Treated for Substance Use Disorder: An Application of Rasch Modeling

    Directory of Open Access Journals (Sweden)

    James R. Ciesla

    2011-01-01

    Full Text Available The objective of this research is to use item response theory (IRT to validate a 14-item peer relations scale for use in the adolescent treatment population. Subjects are 509 adolescents discharged from substance abuse treatment from 2004–2009. The person reliability is 0.76 and the Cronbach's alpha person raw score reliability is 0.93 both indicating the scale is a strong metric. The item reliability of 0.99 is high showing the model is reliable. The real separation (8.49 meaning items are placed on the Rasch “ruler” with about eight levels of importance identified. The mean-square statistics of the infit and outfit values were between 0.5 and 1.5 for the items indicating a low level of randomness and thus unidimensionality of the scale. Inspection of a Wright Item Map shows the hierarchical structure of the scale with a moderate degree of inter-item spread. The analysis shows the scale is a reliable unidimensional metric.

  6. University Programme Preferences of High School Science Students in Singapore and Reasons that Matter in their Preferences: A Rasch analysis

    Science.gov (United States)

    Oon, Pey-Tee; Subramaniam, R.

    2015-01-01

    This study explored an under-researched area in science education-the university programmes preferred by high school students who take physical science subjects and the reasons that matter in their preferences. A total of 1,071 upper secondary and pre-university students in Singapore, who take physical science subjects among their range of subjects, participated in this study. A survey method was adopted and the Rasch model was used to analyse the data. Overall, Business Studies was ranked as the predominant choice; nonetheless, scientific programmes such as Science, Engineering, and Mathematics are generally still well liked by the students. When gender differences were examined, we found that students largely followed gender-typical programme preferences, in which males tend to incline towards Engineering while females tend to incline towards Arts and Social Sciences. Students prefer a university programme based on their individual interest and ability, with career aspiration and remuneration coming next. Interestingly, females place greater emphasis on career aspiration than males. Some implications of the study are discussed.

  7. Developing the Polish Educational Needs Assessment Tool (Pol-ENAT) in rheumatoid arthritis and systemic sclerosis: a cross-cultural validation study using Rasch analysis.

    Science.gov (United States)

    Sierakowska, Matylda; Sierakowski, Stanisław; Sierakowska, Justyna; Horton, Mike; Ndosi, Mwidimi

    2015-03-01

    To undertake cross-cultural adaptation and validation of the educational needs assessment tool (ENAT) for use with people with rheumatoid arthritis (RA) and systemic sclerosis (SSc) in Poland. The study involved two main phases: (1) cross-cultural adaptation of the ENAT from English into Polish and (2) Cross-cultural validation of Polish Educational Needs Assessment Tool (Pol-ENAT). The first phase followed an established process of cross-cultural adaptation of self-report measures. The second phase involved completion of the Pol-ENAT by patients and subjecting the data to Rasch analysis to assess the construct validity, unidimensionality, internal consistency and cross-cultural invariance. An adequate conceptual equivalence was achieved following the adaptation process. The dataset for validation comprised a total of 278 patients, 237 (85.3 %) of which were female. In each disease group (145, RA and 133, SSc), the 7 domains of the Pol-ENAT were found to fit the Rasch model, X (2)(df) = 16.953(14), p = 0.259 and 8.132(14), p = 0.882 for RA and SSc, respectively. Internal consistency of the Pol-ENAT was high (patient separation index = 0.85 and 0.89 for SSc and RA, respectively), and unidimensionality was confirmed. Cross-cultural differential item functioning (DIF) was detected in some subscales, and DIF-adjusted conversion tables were calibrated to enable cross-cultural comparison of data between Poland and the UK. Using a standard process in cross-cultural adaptation, conceptual equivalence was achieved between the original (UK) ENAT and the adapted Pol-ENAT. Fit to the Rasch model, confirmed that the construct validity, unidimensionality and internal consistency of the ENAT have been preserved.

  8. Construct validity of the psychological general well being index (PGWBI in a sample of patients undergoing treatment for stress-related exhaustion: a rasch analysis

    Directory of Open Access Journals (Sweden)

    Lundgren-Nilsson Åsa

    2013-01-01

    Full Text Available Abstract Purpose The Psychological General Well Being Index (PGWBI is a widely used scale across many conditions. Over time issues have been raised about the dimensional structure of the scale, and it has not yet been subjected to scrutiny by modern Psychometric approaches. The current study thus evaluates the PGWBI with Rasch- and factor analysis. Methods Consecutive patients recruited to a tertiary stress clinic were administered the PGBWI as part of routine clinical assessment at baseline and three months. Data from the scale was subjected to Factor Analyses and to Rasch analysis. In both cases adjustments for local independence violations were allowed. Results 179 patients were recruited, with a mean age of 43 years, and of whom 70% were female. An initial Confirmatory Factor Analysis (CFA with baseline data failed, but the modification indices also indicated considerable levels of local dependency requiring errors to be correlated. An EFA highlighted positive and negative effect domains. Rasch analysis confirmed that fit of data to the model was influenced by local dependency, and that in practice if the items from the six underlying domains were treated as six ‘super’ items, the scale was shown to measure one dominant construct of well being. An interval scale transformation was therefore possible. A significant improvement in well-being was observed over a three month period. Conclusion The PGWBI scale has satisfactory internal construct validity when tested with modern psychometric techniques, using data obtained from patients treated for stress-related exhaustion. The instrument has qualities that make it suitable also for monitoring well-being during interventions for stress-related exhaustion/clinical burnout.

  9. Rasch Analysis of the Premature Ejaculation Diagnostic Tool (PEDT and the International Index of Erectile Function (IIEF in an Iranian Sample of Prostate Cancer Patients.

    Directory of Open Access Journals (Sweden)

    Chung-Ying Lin

    Full Text Available Male sexual dysfunction is an increasing problem across a variety of general and clinical populations, such as cancer populations; especially among prostate cancer patients who tend to receive treatments that often result in erectile dysfunction (ED and/or premature ejaculation (PE. Therefore, in order to diagnose ED and PE in these populations, adequate and efficient instruments such as the International Index of Erectile Function 5-item version (IIEF-5 and the Premature Ejaculation Diagnostic Tool (PEDT are needed. However, since this is an important topic additional evidence of psychometric properties of the IIEF-5 and the PEDT in such samples are required. Thus the aim of the present study was to use Rasch models to investigate the construct validity, local dependency, score order, and differential item functioning (DIF of both questionnaires in a sample of prostate cancer patients.Prostate cancer patients (n = 1058, mean±SD age = 64.07±6.84 years who visited urology clinics were invited to fill out the IIEF-5 and the PEDT. Construct validity was examined using infit and outfit mean square (MnSq and local dependency using correlations between each two residual Rasch scores. Score order was investigated using step and average measures of difficulty and DIF using DIF contrast.All IIEF-5 and PEDT items had acceptable infit and outfit MnSq. Step measures revealed that all but two items had disordered categories in terms of scores 1 to 3. Only one local dependency was found, and no items displayed DIF across age, educational level, and help seeking.The results showed that both the IIEF-5 and the PEDT had sound psychometric properties in the Rasch analyses, although some score disordering could be detected in both instruments. The results of no DIF items in both instruments suggest using them to compare ED and PE across age and educational level is adequate.

  10. Imputation by the mean score should be avoided when validating a Patient Reported Outcomes questionnaire by a Rasch model in presence of informative missing data

    LENUS (Irish Health Repository)

    Hardouin, Jean-Benoit

    2011-07-14

    Abstract Background Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of this paper is to compare sixteen methods for handling the missing data (mainly based on simple imputation) in the context of psychometric validation of PRO by a Rasch model. The main indexes used for validation by a Rasch model are compared. Methods A simulation study was performed allowing to consider several cases, notably the possibility for the missing values to be informative or not and the rate of missing data. Results Several imputations methods produce bias on psychometrical indexes (generally, the imputation methods artificially improve the psychometric qualities of the scale). In particular, this is the case with the method based on the Personal Mean Score (PMS) which is the most commonly used imputation method in practice. Conclusions Several imputation methods should be avoided, in particular PMS imputation. From a general point of view, it is important to use an imputation method that considers both the ability of the patient (measured for example by his\\/her score), and the difficulty of the item (measured for example by its rate of favourable responses). Another recommendation is to always consider the addition of a random process in the imputation method, because such a process allows reducing the bias. Last, the analysis realized without imputation of the missing data (available case analyses) is an interesting alternative to the simple imputation in this context.

  11. A Comparison between Discrimination Indices and Item-Response Theory Using the Rasch Model in a Clinical Course Written Examination of a Medical School.

    Science.gov (United States)

    Park, Jong Cook; Kim, Kwang Sig

    2012-03-01

    The reliability of test is determined by each items' characteristics. Item analysis is achieved by classical test theory and item response theory. The purpose of the study was to compare the discrimination indices with item response theory using the Rasch model. Thirty-one 4th-year medical school students participated in the clinical course written examination, which included 22 A-type items and 3 R-type items. Point biserial correlation coefficient (C(pbs)) was compared to method of extreme group (D), biserial correlation coefficient (C(bs)), item-total correlation coefficient (C(it)), and corrected item-total correlation coeffcient (C(cit)). Rasch model was applied to estimate item difficulty and examinee's ability and to calculate item fit statistics using joint maximum likelihood. Explanatory power (r2) of Cpbs is decreased in the following order: C(cit) (1.00), C(it) (0.99), C(bs) (0.94), and D (0.45). The ranges of difficulty logit and standard error and ability logit and standard error were -0.82 to 0.80 and 0.37 to 0.76, -3.69 to 3.19 and 0.45 to 1.03, respectively. Item 9 and 23 have outfit > or =1.3. Student 1, 5, 7, 18, 26, 30, and 32 have fit > or =1.3. C(pbs), C(cit), and C(it) are good discrimination parameters. Rasch model can estimate item difficulty parameter and examinee's ability parameter with standard error. The fit statistics can identify bad items and unpredictable examinee's responses.

  12. Using Rasch Analysis to Evaluate the Reliability and Validity of the Swallowing Quality of Life Questionnaire: An Item Response Theory Approach.

    Science.gov (United States)

    Cordier, Reinie; Speyer, Renée; Schindler, Antonio; Michou, Emilia; Heijnen, Bas Joris; Baijens, Laura; Karaduman, Ayşe; Swan, Katina; Clavé, Pere; Joosten, Annette Veronica

    2018-02-01

    The Swallowing Quality of Life questionnaire (SWAL-QOL) is widely used clinically and in research to evaluate quality of life related to swallowing difficulties. It has been described as a valid and reliable tool, but was developed and tested using classic test theory. This study describes the reliability and validity of the SWAL-QOL using item response theory (IRT; Rasch analysis). SWAL-QOL data were gathered from 507 participants at risk of oropharyngeal dysphagia (OD) across four European countries. OD was confirmed in 75.7% of participants via videofluoroscopy and/or fiberoptic endoscopic evaluation, or a clinical diagnosis based on meeting selected criteria. Patients with esophageal dysphagia were excluded. Data were analysed using Rasch analysis. Item and person reliability was good for all the items combined. However, person reliability was poor for 8 subscales and item reliability was poor for one subscale. Eight subscales exhibited poor person separation and two exhibited poor item separation. Overall item and person fit statistics were acceptable. However, at an individual item fit level results indicated unpredictable item responses for 28 items, and item redundancy for 10 items. The item-person dimensionality map confirmed these findings. Results from the overall Rasch model fit and Principal Component Analysis were suggestive of a second dimension. For all the items combined, none of the item categories were 'category', 'threshold' or 'step' disordered; however, all subscales demonstrated category disordered functioning. Findings suggest an urgent need to further investigate the underlying structure of the SWAL-QOL and its psychometric characteristics using IRT.

  13. Use of Rasch Analysis to Evaluate and Refine the Community Balance and Mobility Scale for Use in Ambulatory Community-Dwelling Adults Following Stroke

    Science.gov (United States)

    Pollock, Courtney L.; Brouwer, Brenda; Garland, S. Jayne

    2016-01-01

    Background The Community Balance and Mobility Scale (CB&M) is increasingly used to evaluate walking balance following stroke. Objective This study applied Rasch analysis to evaluate and refine the CB&M for use in ambulatory community-dwelling adults following stroke. Methods The CB&M content was linked to task demands and motor skill classifications. Rasch analysis was used to evaluate internal construct validity (structural validity) and refine the CB&M for use with ambulatory community-dwelling adults following stroke. The CB&M data were collected at 3 time points: at discharge from inpatient rehabilitation and at 6 and 12 months postdischarge (N=238). Rasch analysis evaluated scale dimensionality, item and person fit, item response bias, scoring hierarchy, and targeting. Disordered scoring hierarchy was resolved by collapsing scoring categories. Highly correlated and “misfitting” items were removed. Sensitivity to change was evaluated with standardized response means (SRMs) and one-way repeated-measures analysis of variance. Results The CB&M was primarily linked to closed body transport task demands. Significant item-trait interaction, disordered scoring hierarchies, and multidimensionality were found. Scoring categories were collapsed in 15/19 items, and 5 misfitting items were removed. The resulting stroke-specific 14-item unidimensional CB&M (CB&MStroke) fit Rasch model expectations, with no item response bias, acceptable targeting (13% floor effects and 0% ceiling effects), and moderate-to-strong sensitivity to change at 6 months postdischarge (SRM=0.63; 95% confidence interval=−1.523, −0.142) and 12 months postdischarge (SRM=0.73; 95% confidence interval=−2.318, −0.760). Limitations Findings are limited to a modest-sized sample of individuals with mild-to-moderate balance impairment following stroke. Conclusions The CB&MStroke shows promise as a clinical scale for measuring change in walking balance in ambulatory community-dwelling adults

  14. Seeking missing pieces in science concept assessments: Reevaluating the Brief Electricity and Magnetism Assessment through Rasch analysis

    Science.gov (United States)

    Ding, Lin

    2014-02-01

    Discipline-based science concept assessments are powerful tools to measure learners' disciplinary core ideas. Among many such assessments, the Brief Electricity and Magnetism Assessment (BEMA) has been broadly used to gauge student conceptions of key electricity and magnetism (E&M) topics in college-level introductory physics courses. Differing from typical concept inventories that focus only on one topic of a subject area, BEMA covers a broad range of topics in the electromagnetism domain. In spite of this fact, prior studies exclusively used a single aggregate score to represent individual students' overall understanding of E&M without explicating the construct of this assessment. Additionally, BEMA has been used to compare traditional physics courses with a reformed course entitled Matter and Interactions (M&I). While prior findings were in favor of M&I, no empirical evidence was sought to rule out possible differential functioning of BEMA that may have inadvertently advantaged M&I students. In this study, we used Rasch analysis to seek two missing pieces regarding the construct and differential functioning of BEMA. Results suggest that although BEMA items generally can function together to measure the same construct of application and analysis of E&M concepts, several items may need further revision. Additionally, items that demonstrate differential functioning for the two courses are detected. Issues such as item contextual features and student familiarity with question settings may underlie these findings. This study highlights often overlooked threats in science concept assessments and provides an exemplar for using evidence-based reasoning to make valid inferences and arguments.

  15. Do patients and health care professionals view the communication processes of clinical research differently? A Rasch analysis from a survey.

    Science.gov (United States)

    González-de Paz, Luis; Kostov, Belchin; Solans-Julian, Pilar; Navarro-Rubio, M Dolores; Sisó-Almirall, Antoni

    2015-10-01

    The increasing amount of the clinical research conducted in the primary health care has enabled extending research beyond traditional settings, but this transfer has implied some trade-offs. Health care professionals who conduct research with trusted patients require assuming the ethical standards of research and communication skills to enable patients' autonomy and freedom of choice. This study aims to measure the opinions of health professionals and patients on issues of communication in clinical research. A cross-sectional study with health care professionals and patients from primary health care centres in Barcelona (Spain). Each group completed a similar self-administered questionnaire. A Rasch model was fitted to data. After examination of goodness-of-fit, differences between groups were compared using analysis of variance, and patients' measures were calibrated to professionals' measures to compare overall mean measures. Professionals and patients found the ethical attitudes most difficult to endorse related to trust in clinical researchers and conflicts of interest. Patients' perceptions of professional ethical behaviour were significantly lower than professionals'. Different item functioning between nurses and family doctors was found in the item on seeking ethical collaboration when collaborating in clinical research. Effective knowledge of ethical norms was associated with greater perceived ethical values in clinical research and confidence in health care professionals among patients. Differences in the views of the communication process between patients and professionals could alert research boards, health care institutions and researchers to the need for greater transparency, trust and ethical instruction when patients are involved in clinical research. © 2015 John Wiley & Sons, Ltd.

  16. Seeking missing pieces in science concept assessments: Reevaluating the Brief Electricity and Magnetism Assessment through Rasch analysis

    Directory of Open Access Journals (Sweden)

    Lin Ding

    2014-02-01

    Full Text Available Discipline-based science concept assessments are powerful tools to measure learners’ disciplinary core ideas. Among many such assessments, the Brief Electricity and Magnetism Assessment (BEMA has been broadly used to gauge student conceptions of key electricity and magnetism (E&M topics in college-level introductory physics courses. Differing from typical concept inventories that focus only on one topic of a subject area, BEMA covers a broad range of topics in the electromagnetism domain. In spite of this fact, prior studies exclusively used a single aggregate score to represent individual students’ overall understanding of E&M without explicating the construct of this assessment. Additionally, BEMA has been used to compare traditional physics courses with a reformed course entitled Matter and Interactions (M&I. While prior findings were in favor of M&I, no empirical evidence was sought to rule out possible differential functioning of BEMA that may have inadvertently advantaged M&I students. In this study, we used Rasch analysis to seek two missing pieces regarding the construct and differential functioning of BEMA. Results suggest that although BEMA items generally can function together to measure the same construct of application and analysis of E&M concepts, several items may need further revision. Additionally, items that demonstrate differential functioning for the two courses are detected. Issues such as item contextual features and student familiarity with question settings may underlie these findings. This study highlights often overlooked threats in science concept assessments and provides an exemplar for using evidence-based reasoning to make valid inferences and arguments.

  17. Rasch Analysis of the Activities-specific Balance Confidence (ABC) Scale in Older Adults Seeking Outpatient Rehabilitation Services.

    Science.gov (United States)

    Wang, Ying-Chih; Sindhu, Bhagwant; Lehman, Leigh; Li, Xiaoyan; Yen, Sheng-Che; Kapellusch, Jay

    2018-03-30

    Study Design Cross-sectional study of 5,012 older patients seeking outpatient rehabilitation therapy in 123 clinics. Background The Activities-Specific Balance Confidence (ABC) Scale measures confidence in performing various ambulatory activities without falling or experiencing a sense of unsteadiness. Objectives Our purposes were to: (1) examine the ABC Scale (0-100) using the Rasch analysis, (2) assess statistically reliable change, and (3) develop a functional staging to guide clinical interpretation of the patient's improvement. Methods We examined rating scale structure, item difficulty hierarchy, item fit, person-item match, separation index, differential item functioning (DIF), test precision, and unidimensionality. Additionally, we estimated the minimal detectable change (MDC) and developed a functional staging. Results Item 'walking outside on icy sidewalks' was the most difficult item, while 'reach for a small can off a shelf at eye level' was the easiest item. Overall, average patient ability estimates of 56.2 (20.3) was slightly higher than the average item difficulty estimates of 45.9 (7.8). With a separation index equaled to 3.65, the ABC items can differentiate persons into 5.2 statistically distinct strata. Most ABC items were free of DIF. For example, 'walk outside on icy sidewalks' was easier for patients who was underweight. Results supported unidimensionality of the ABC Scale, with the first factor explained 77% of the total variance. The estimated MDC was 15 points. We provided an example of functional staging application. Conclusion Results supported sound psychometric properties and clinical usage of the ABC Scale for older adults seeking outpatient rehabilitation therapy. Level of Evidence 2c. J Orthop Sports Phys Ther, Epub 30 Mar 2018. doi:10.2519/jospt.2018.8023.

  18. Patient self-report section of the ASES questionnaire: a Spanish validation study using classical test theory and the Rasch model.

    Science.gov (United States)

    Vrotsou, Kalliopi; Cuéllar, Ricardo; Silió, Félix; Rodriguez, Miguel Ángel; Garay, Daniel; Busto, Gorka; Trancho, Ziortza; Escobar, Antonio

    2016-10-18

    The aim of the current study was to validate the self-report section of the American Shoulder and Elbow Surgeons questionnaire (ASES-p) into Spanish. Shoulder pathology patients were recruited and followed up to 6 months post treatment. The ASES-p, Constant, SF-36 and Barthel scales were filled-in pre and post treatment. Reliability was tested with Cronbach's alpha, convergent validity with Spearman's correlations coefficients. Confirmatory factor analysis (CFA) and the Rasch model were implemented for assessing structural validity and unidimensionality of the scale. Models with and without the pain item were considered. Responsiveness to change was explored via standardised effect sizes. Results were acceptable for both tested models. Cronbach's alpha was 0.91, total scale correlations with Constant and physical SF-36 dimensions were >0.50. Factor loadings for CFA were >0.40. The Rasch model confirmed unidimensionality of the scale, even though item 10 "do usual sport" was suggested as non-informative. Finally, patients with improved post treatment shoulder function and those receiving surgery had higher standardised effect sizes. The adapted Spanish ASES-p version is a valid and reliable tool for shoulder evaluation and its unidimensionality is supported by the data.

  19. Towards the development of clinical measures for spinal cord injury based on the International Classification of Functioning, Disability and Health with Rasch analyses.

    Science.gov (United States)

    Ballert, Carolina S; Stucki, Gerold; Biering-Sørensen, Fin; Cieza, Alarcos

    2014-09-01

    To determine whether the International Classification of Functioning, Disability and Health (ICF) categories relevant to spinal cord injury (SCI) can be integrated in clinical measures and to obtain insights to guide their future operationalization. Specific aims are to find out whether the ICF categories relevant to SCI fit a Rasch model taking into consideration the dimensionality found in previous investigations, local item dependencies, or differential item functioning. All second-level ICF categories collected in the Development of ICF Core Sets for SCI project in specialized centers within 15 countries from 2006 through 2008. Secondary data analysis. Adults (N=1048) with SCI from the early postacute and long-term living context. Not applicable. Two unidimensional Rasch analyses: one for the ICF categories from body functions and body structures components and another for the ICF categories from the activities and participation component. Results support good reliability and targeting of the ICF categories in both dimensions. In each dimension, few ICF categories were subject to misfit. Local item dependency was observed between ICF categories of the same chapters. Group effects for age and sex were observed only to a small extent. The validity of ICF categories to develop measures of functioning in SCI for clinical practice and research is to some extent supported. Model adjustments were suggested to further improve their operationalization and psychometrics. Copyright © 2014 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  20. Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey

    Directory of Open Access Journals (Sweden)

    Tsair-Wei Chien

    2017-01-01

    Full Text Available Abstract Background Many continuous item responses (CIRs are encountered in healthcare settings, but no one uses item response theory’s (IRT probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required. To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey. Methods Using Microsoft Excel VBA (Visual Basic for Applications, we designed a computer module that minimizes the residuals and calculates model’s expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey. Results The author-made CIR module yielded OUTFIT mean square (MNSQ and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory. Conclusions Because of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.

  1. Bilimsel Araştırma Ödevlerinin Çok Yüzeyli Rasch Ölçme Modeli ile Değerlendirilmesi

    Directory of Open Access Journals (Sweden)

    Ramazan BAŞTÜRK

    2010-06-01

    Full Text Available The purpose of this study is to investigate the usefulness of the many-facet Rasch model (MFRM in evaluating the quality of performance related to preparing Research assignment in higher education. The Rasch Model utilizes item response theory stating that the probability of a correct response to a test item/task depends largely on a single parameter, the ability of the person. MFRM extends this one-parameter model to other facets, for example, rater severity, rating scale format, task difficulty levels. This paper specifically investigated research preparation ability in terms of items/task difficulty and rater severity/leniency. Fourth year counseling students prepared research assignments during the autumn semester of the 2009-2010 school years in the “Research Methods in Education” course. Six judges evaluated each students assignments using “Research Assignment Evaluation Rubric”. The results of this study demonstrated that the MFRM is a powerful tool for handling polytomous data in performance and peer assessment in higher education.

  2. Rasch modeling of the Spanish self-report version of the Liebowitz Social Anxiety Scale for Children and Adolescents (LSAS-CA-SR

    Directory of Open Access Journals (Sweden)

    José A. López-Pina

    2008-01-01

    Full Text Available El objetivo de este estudio instrumental fue analizar la estructura unidimensional de las subescalas de miedo y evitación de la versión española de la escala de ansiedad social LSAS-CA-SR para niños y adolescentes bajo la familia de modelos de Rasch. La muestra estuvo formada por 454 estudiantes (236 varones y 218 mujeres de educación primaria y secundaria cuya edad variaba entre 10 y 17 años. El modelo de escalas de valoración fue ajustado a los datos de ambas subescalas. Los estadísticos de ajuste (media cuadrática ponderada y media cuadrática no ponderada mostraron un buen ajuste de los ítems al modelo, excepto en los ítems 10 y 16 en la subescala de miedo, y los ítems 6, 7 y 21 en la subescala de evitación. Además, la subdivisión de la muestra global en dos submuestras aleatorias de 150 personas probó que el modelo de escalas de valoración produjo un ordenamiento invariante de los parámetros de los ítems y de los parámetros de las personas. Este estudio respalda, así, la utilidad del modelo de Rasch y su familia para determinar la unidimensionalidad en un test psicológico.

  3. Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey.

    Science.gov (United States)

    Chien, Tsair-Wei; Shao, Yang; Kuo, Shu-Chun

    2017-01-10

    Many continuous item responses (CIRs) are encountered in healthcare settings, but no one uses item response theory's (IRT) probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required. To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey. Using Microsoft Excel VBA (Visual Basic for Applications), we designed a computer module that minimizes the residuals and calculates model's expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey. The author-made CIR module yielded OUTFIT mean square (MNSQ) and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory. Because of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.

  4. Utilizing Multifaceted Rasch Measurement through Facets to Evaluate Science Education Data Sets Composed of Judges, Respondents, and Rating Scale Items: An Exemplar Utilizing the Elementary Science Teaching Analysis Matrix Instrument

    Science.gov (United States)

    Boone, William J.; Townsend, J. Scott; Staver, John R.

    2016-01-01

    When collecting data, science education researchers frequently have multiple respondents evaluate multiple artifacts using multiple criteria. Herein, the authors introduce Multifaceted Rasch Measurement (MFRM) analysis and explain why MFRM must be used when "judges'" data are collected. The authors use data from elementary science…

  5. Improving the measurement of health-related quality of life in adolescent with idiopathic scoliosis: the SRS-7, a Rasch-developed short form of the SRS-22 questionnaire.

    Science.gov (United States)

    Caronni, Antonio; Zaina, Fabio; Negrini, Stefano

    2014-04-01

    Scoliosis Research Society-22 (SRS-22) questionnaire was developed to evaluate health-related quality of life (HRQL) in adolescent idiopathic scoliosis (AIS) patients. Rasch analysis (RA) is a statistical procedure which turns questionnaire ordinal scores into interval measures. Measures from Rasch-compatible questionnaires can be used, similar to body temperature or blood pressure, to quantify disease severity progression and treatment efficacy. Purpose of the current work is to present Rasch analysis (RA) of the SRS-22 questionnaire and to develop an SRS-22 Rasch-approved short form. 300 SRS-22 were randomly collected from 2447 consecutive IS adolescents at their first evaluation (229 females; 13.9 ± 1.9 years; 26.9 ± 14.7 Cobb°) in a scoliosis outpatient clinic. RA showed both disordered thresholds and overall misfit of the SRS-22. Sixteen items were re-scored and two misfitting items (6 and 14) removed to obtain a Rasch-compatible questionnaire. Participants HRQL measured too high with the rearranged questionnaire, indicating a severe SRS-22 ceiling effect. RA also highlighted SRS-22 multidimensionality, with pain/function not merging with self-image/mental health items. Item 3 showed differential item functioning (DIF) for both curve and hump amplitude. A 7-item questionnaire (SRS-7) was prepared by selecting single items from the original SRS-22. SRS-7 showed fit to the model, unidimensionality and no DIF. Compared with the SRS-22, the short form scale shows better targeting of the participants' population. RA shows that SRS-22 has poor clinimetric properties; moreover, when used with AIS at first evaluation, SRS-22 is affected by a severe ceiling effect. SRS-7, an SRS-22 7-item short form questionnaire, provides an HRQL interval measure better tailored to these participants. Copyright © 2014 Elsevier Ltd. All rights reserved.

  6. Measuring Health-Related Quality of Life in Strabismus: A Modification of the Adult Strabismus-20 (AS-20 Questionnaire Using Rasch Analysis.

    Directory of Open Access Journals (Sweden)

    Vijaya K Gothwal

    Full Text Available To evaluate the psychometric properties of the Adult Strabismus-20 (AS-20- a health-related quality of life (HRQoL questionnaire in adults with strabismus, and if flawed, to revise the AS-20 and its subscales creating valid measurement scales.584 adults (meanage, 27.5 years with strabismus were recruited from an outpatient clinic at a South Indian tertiary eye care centre and were administered the AS-20 questionnaire.The AS-20 was translated and back translated into two Indian languages. The AS-20 and its two 10-item subscales - 'psychosocial' and 'function'were assessed separately for fit to the Rasch model, including an assessment of the rating scale, unidimensionality (by principal components analysis, measurement precision by person separation reliability, PSR, targeting, and differential item functioning (DIF; notable > 1.0 logits.Response categories were not used as intended, thereby, required re-organization and reducing their number from 5 to 3. The AS-20 had adequate measurement precision (PSR = 0.87 but lacked unidimensionality; however, deletion of the six multi-dimensionality causing items and an additional three misfitting items resulted in 11-item unidimensional questionnaire (AS-11. Two items failed to satisfy the model expectations in the 'psychosocial' subscale and were deleted - resulting in an 8-item unidimensional scale with adequate PSR (0.81 and targeting (0.23 logits. One item misfit in the 'function' subscale and was deleted-resulting in a 9 item Rasch-revised unidimensional subscale with acceptable PSR (0.80 and targeting (0.97 logits.None of the items displayed notable DIF by age, gender and level of education.The AS-11 and its two Rasch-revised subscales - 8-item psychosocial and 9-item function subscale may be more appropriate than the original AS-20 and its two 10-item subscales for use as unidimensional measures of HRQoL in adults with strabismus in India. Further work is required to establish the validity of the

  7. Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS: a Rasch analysis using data from the Scottish Health Education Population Survey

    Directory of Open Access Journals (Sweden)

    Platt Stephen

    2009-02-01

    Full Text Available Abstract Background The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS was developed to meet demand for instruments to measure mental well-being. It comprises 14 positively phrased Likert-style items and fulfils classic criteria for scale development. We report here the internal construct validity of WEMWBS from the perspective of the Rasch measurement model. Methods The model was applied to data collected from 779 respondents in Wave 12 (Autumn 2006 of the Scottish Health Education Population Survey. Respondents were aged 16–74 (average 41.9 yrs. Results Initial fit to model expectations was poor. The items 'I've been feeling good about myself', 'I've been interested in new things' and 'I've been feeling cheerful' all showed significant misfit to model expectations, and were deleted. This led to a marginal improvement in fit to the model. After further analysis, more items were deleted and a strict unidimensional seven item scale (the Short Warwick Edinburgh Mental Well-Being Scale (SWEMWBS was resolved. Many items deleted because of misfit with model expectations showed considerable bias for gender. Two retained items also demonstrated bias for gender but, at the scale level, cancelled out. One further retained item 'I've been feeling optimistic about the future' showed bias for age. The correlation between the 14 item and 7 item versions was 0.954. Given fit to the Rasch model, and strict unidimensionality, SWEMWBS provides an interval scale estimate of mental well-being. Conclusion A short 7 item version of WEMWBS was found to satisfy the strict unidimensionality expectations of the Rasch model, and be largely free of bias. This scale, SWEMWBS, provides a raw score-interval scale transformation for use in parametric procedures. In terms of face validity, SWEMWBS presents a more restricted view of mental well-being than the 14 item WEMWBS, with most items representing aspects of psychological and eudemonic well-being, and few covering

  8. Construct validity in Operations Management by using Rasch Measurement Theory. The case of the construct “motivation to implement continuous improvement"

    Directory of Open Access Journals (Sweden)

    Lidia Sanchez-Ruiz

    2016-12-01

    Full Text Available Construct design and validation is a common practise in the Operations Management field. In this sense, the aim of this study is to present Rasch Measurement Theory (RMT as richful and useful methodology in order to validate constructs. In order to do so, the measurement controversy in the social science is presented; then, RMT is explained as a solution for this measurement issue; after that, the different applications of RMT are described and, finally, the different stages of the validation process are presented. Thus, this work aims to serve as a guide for those researchers interested in the methodology. Therefore, a specific case is included: the validation of the construct “motivation to implement continuous improvement”.

  9. The importance of statistical modelling in clinical research : Comparing multidimensional Rasch-, structural equation and linear regression models for analyzing the depression of relatives of psychiatric patients.

    Science.gov (United States)

    Alexandrowicz, Rainer W; Jahn, Rebecca; Friedrich, Fabian; Unger, Anne

    2016-06-01

    Various studies have shown that caregiving relatives of schizophrenic patients are at risk of suffering from depression. These studies differ with respect to the applied statistical methods, which could influence the findings. Therefore, the present study analyzes to which extent different methods may cause differing results. The present study contrasts by means of one data set the results of three different modelling approaches, Rasch Modelling (RM), Structural Equation Modelling (SEM), and Linear Regression Modelling (LRM). The results of the three models varied considerably, reflecting the different assumptions of the respective models. Latent trait models (i. e., RM and SEM) generally provide more convincing results by correcting for measurement error and the RM specifically proves superior for it treats ordered categorical data most adequately.

  10. Gender fairness in self-efficacy? A Rasch-based validity study of the General Academic Self-efficacy scale (GASE)

    DEFF Research Database (Denmark)

    Nielsen, Tine; Vang, Maria Louison; Dammeyer, Jesper

    2018-01-01

    Studies have reported gender differences in academic self-efficacy. However, how and if academic self-efficacy questionnaires are gender-biased has not been psychometrically investigated. The psychometric properties of a general version of The Physics Self-Efficacy Questionnaire – the General...... Academic Self-Efficacy Scale (GASE) – were analyzed using Rasch measurement models, with data from 1018 Danish university students (psychology and technical), focusing on gender invariance and the sufficiency of the score. The short 4-item GASE scale was found to be essentially objective and construct...... valid and satisfactorily reliable, though differential item functioning was found relative to gender and academic discipline, and can be used to assess students’ general academic self-efficacy. Research on gender and self-efficacy needs to take gender into account and equate scores appropriately...

  11. Towards the Development of Clinical Measures for Spinal Cord Injury Based on the International Classification of Functioning, Disability and Health With Rasch Analyses

    DEFF Research Database (Denmark)

    Ballert, Carolina S; Stucki, Gerold; Biering-Sørensen, Fin

    2014-01-01

    item dependency was observed between ICF categories of the same chapters. Group effects for age and sex were observed only to a small extent. CONCLUSIONS: The validity of ICF categories to develop measures of functioning in SCI for clinical practice and research is to some extent supported. Model......OBJECTIVES: To determine whether the International Classification of Functioning, Disability and Health (ICF) categories relevant to spinal cord injury (SCI) can be integrated in clinical measures and to obtain insights to guide their future operationalization. Specific aims are to find out whether...... in specialized centers within 15 countries from 2006 through 2008. SETTING: Secondary data analysis. PARTICIPANTS: Adults (N=1048) with SCI from the early postacute and long-term living context. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Two unidimensional Rasch analyses: one for the ICF categories...

  12. A comparison of Rasch item-fit and Cronbach's alpha item reduction analysis for the development of a Quality of Life scale for children and adolescents.

    Science.gov (United States)

    Erhart, M; Hagquist, C; Auquier, P; Rajmil, L; Power, M; Ravens-Sieberer, U

    2010-07-01

    This study compares item reduction analysis based on classical test theory (maximizing Cronbach's alpha - approach A), with analysis based on the Rasch Partial Credit Model item-fit (approach B), as applied to children and adolescents' health-related quality of life (HRQoL) items. The reliability and structural, cross-cultural and known-group validity of the measures were examined. Within the European KIDSCREEN project, 3019 children and adolescents (8-18 years) from seven European countries answered 19 HRQoL items of the Physical Well-being dimension of a preliminary KIDSCREEN instrument. The Cronbach's alpha and corrected item total correlation (approach A) were compared with infit mean squares and the Q-index item-fit derived according to a partial credit model (approach B). Cross-cultural differential item functioning (DIF ordinal logistic regression approach), structural validity (confirmatory factor analysis and residual correlation) and relative validity (RV) for socio-demographic and health-related factors were calculated for approaches (A) and (B). Approach (A) led to the retention of 13 items, compared with 11 items with approach (B). The item overlap was 69% for (A) and 78% for (B). The correlation coefficient of the summated ratings was 0.93. The Cronbach's alpha was similar for both versions [0.86 (A); 0.85 (B)]. Both approaches selected some items that are not strictly unidimensional and items displaying DIF. RV ratios favoured (A) with regard to socio-demographic aspects. Approach (B) was superior in RV with regard to health-related aspects. Both types of item reduction analysis should be accompanied by additional analyses. Neither of the two approaches was universally superior with regard to cultural, structural and known-group validity. However, the results support the usability of the Rasch method for developing new HRQoL measures for children and adolescents.

  13. Measurement properties of the Health Literacy Questionnaire (HLQ) among older adults who present to the emergency department after a fall: a Rasch analysis.

    Science.gov (United States)

    Morris, Rebecca L; Soh, Sze-Ee; Hill, Keith D; Buchbinder, Rachelle; Lowthian, Judy A; Redfern, Julie; Etherton-Beer, Christopher D; Hill, Anne-Marie; Osborne, Richard H; Arendts, Glenn; Barker, Anna L

    2017-08-29

    Health literacy is an important concept associated with participation in preventive health initiatives, such as falls prevention programs. A comprehensive health literacy measurement tool, appropriate for this population, is required. The aim of this study was to evaluate the measurement properties of the Health Literacy Questionnaire (HLQ) in a cohort of older adults who presented to a hospital emergency department (ED) after a fall. Older adults who presented to an ED after a fall had their health literacy assessed using the HLQ (n = 433). Data were collected as part of a multi-centre randomised controlled trial of a falls prevention program. Measurement properties of the HLQ were assessed using Rasch analysis. All nine scales of the HLQ were unidimensional, with good internal consistency reliability. No item bias was found for most items (43 of 44). A degree of overall misfit to the Rasch model was evident for six of the nine HLQ scales. The majority of misfit indicated content overlap between some items and does not compromise measurement. A measurement gap was identified for this cohort at mid to high HLQ score. The HLQ demonstrated good measurement properties in a cohort of older adults who presented to an ED after a fall. The summation of the HLQ items within each scale, providing unbiased information on nine separate areas of health literacy, is supported. Clinicians, researchers and policy makers may have confidence using the HLQ scale scores to gain information about health literacy in older people presenting to the ED after a fall. This study was registered with the Australian New Zealand Clinical Trials Registry, number ACTRN12614000336684 (27 March 2014).

  14. Comparative study of middle school students' attitudes towards science: Rasch analysis of entire TIMSS 2011 attitudinal data for England, Singapore and the U.S.A. as well as psychometric properties of attitudes scale

    Science.gov (United States)

    Pey Tee, Oon; Subramaniam, R.

    2018-02-01

    We report here on a comparative study of middle school students' attitudes towards science involving three countries: England, Singapore and the U.S.A. Complete attitudinal data sets from TIMSS (Trends in International Mathematics and Science Study) 2011 were used, thus giving a very large sample size (N = 20,246), compared to other studies in the journal literature. The Rasch model was used to analyse the data, and the findings have shed some useful light on not only how the Western and Asian students responded on a comparative basis in the various scales related to attitudes but also on the validity, reliability, and unidimensionality of the attitudes instrument used in TIMSS 2011. There may be a need for TIMSS test developers to consider doing away with negatively phrased items in the attitudes instrument and phrasing these positively as the Rasch framework shows that response bias is associated with these statements.

  15. The ProQOL-21: A revised version of the Professional Quality of Life (ProQOL) scale based on Rasch analysis

    Science.gov (United States)

    Rees, Clare S.; Hegney, Desley G.

    2018-01-01

    The Professional Quality of Life scale is a measure intended to provide practitioners and researchers with an indication of a caring professional’s compassion satisfaction, burnout, and secondary traumatic stress. While this measure has been used extensively in nursing research, owing to the relevancy of patient-care associated satisfaction and fatigue within this profession, information regarding the construct validity of this measure is less well represented in the literature. We examined the construct validity of the Professional Quality of Life scale using a Rasch analysis procedure on each of its three scales, as a means of substantiating their measurement adequacy. Responses on the Professional Quality of Life scale from 1615 registered nurses (age x̅ = 46.48 years, SD = 11.78) were analysed. While support for the measurement adequacy (invariance, person/item fit, and unidimensionality) of the compassion satisfaction scale was found, the burnout and secondary traumatic stress scales did not demonstrate adequate measurement properties. We instead present an alternative measurement model of these subscales, involving items from each, to form a robust measure of compassion fatigue, and provide recoding, scoring, and normed scores for both measures. Our findings indicate that use of the Professional Quality of Life scale’s burnout and secondary traumatic stress scales may require caution, while our revised compassion satisfaction and fatigue scales provide robust measurement options for practitioners and researchers. PMID:29489875

  16. The ProQOL-21: A revised version of the Professional Quality of Life (ProQOL scale based on Rasch analysis.

    Directory of Open Access Journals (Sweden)

    Brody Heritage

    Full Text Available The Professional Quality of Life scale is a measure intended to provide practitioners and researchers with an indication of a caring professional's compassion satisfaction, burnout, and secondary traumatic stress. While this measure has been used extensively in nursing research, owing to the relevancy of patient-care associated satisfaction and fatigue within this profession, information regarding the construct validity of this measure is less well represented in the literature. We examined the construct validity of the Professional Quality of Life scale using a Rasch analysis procedure on each of its three scales, as a means of substantiating their measurement adequacy. Responses on the Professional Quality of Life scale from 1615 registered nurses (age x̅ = 46.48 years, SD = 11.78 were analysed. While support for the measurement adequacy (invariance, person/item fit, and unidimensionality of the compassion satisfaction scale was found, the burnout and secondary traumatic stress scales did not demonstrate adequate measurement properties. We instead present an alternative measurement model of these subscales, involving items from each, to form a robust measure of compassion fatigue, and provide recoding, scoring, and normed scores for both measures. Our findings indicate that use of the Professional Quality of Life scale's burnout and secondary traumatic stress scales may require caution, while our revised compassion satisfaction and fatigue scales provide robust measurement options for practitioners and researchers.

  17. The Number of Response Categories and the Reverse Directional Item Problem in Likert-Type Scales: A Study with the Rasch Model

    Directory of Open Access Journals (Sweden)

    Mustafa İLHAN

    2017-09-01

    Full Text Available This study addressed reverse directional item and the number of response categories problems in Likert-type scales. The Fear of Negative Evaluation Scale (FNES and the Oxford Happiness Questionnaire (OHQ were used as data collection tools. The data of the study were analyzed according to the Rasch model. The analysis found that the observed and expected test characteristic curves were largely overlapped, each of the three rating scales worked effectively, and the differences between response categories could be distinguished successfully by the participants in straightforward directional items. On the other hand, it was determined that there were significant differences between the observed and expected test characteristic curves in reverse directional items. It was also found that no matter which one of these three, five and seven-point rating scales was used, the participants could not distinguish the response categories of the reverse directional items on the FNES and the OHQ. Afterwards, the reverse directional items were removed from the data file, and the analysis was repeated. The analysis results revealed that item discrimination, reliability coefficients for person facet, separation ratios and Chi square values calculated for the facets of person and items were higher in five-pointed rating compared to three and seven pointed rating.

  18. Impact of Rating Scale Categories on Reliability and Fit Statistics of the Malay Spiritual Well-Being Scale using Rasch Analysis.

    Science.gov (United States)

    Daher, Aqil Mohammad; Ahmad, Syed Hassan; Winn, Than; Selamat, Mohd Ikhsan

    2015-01-01

    Few studies have employed the item response theory in examining reliability. We conducted this study to examine the effect of Rating Scale Categories (RSCs) on the reliability and fit statistics of the Malay Spiritual Well-Being Scale, employing the Rasch model. The Malay Spiritual Well-Being Scale (SWBS) with the original six; three and four newly structured RSCs was distributed randomly among three different samples of 50 participants each. The mean age of respondents in the three samples ranged between 36 and 39 years old. The majority was female in all samples, and Islam was the most prevalent religion among the respondents. The predominating race was Malay, followed by Chinese and Indian. The original six RSCs indicated better targeting of 0.99 and smallest model error of 0.24. The Infit Mnsq (mean square) and Zstd (Z standard) of the six RSCs were "1.1"and "-0.1"respectively. The six RSCs achieved the highest person and item reliabilities of 0.86 and 0.85 respectively. These reliabilities yielded the highest person (2.46) and item (2.38) separation indices compared to other the RSCs. The person and item reliability and, to a lesser extent, the fit statistics, were better with the six RSCs compared to the four and three RSCs.

  19. Assessment of score- and Rasch-based methods for group comparison of longitudinal patient-reported outcomes with intermittent missing data (informative and non-informative).

    Science.gov (United States)

    de Bock, Élodie; Hardouin, Jean-Benoit; Blanchin, Myriam; Le Neel, Tanguy; Kubis, Gildas; Sébille, Véronique

    2015-01-01

    The purpose of this study was to identify the most adequate strategy for group comparison of longitudinal patient-reported outcomes in the presence of possibly informative intermittent missing data. Models coming from classical test theory (CTT) and item response theory (IRT) were compared. Two groups of patients' responses to dichotomous items with three times of assessment were simulated. Different cases were considered: presence or absence of a group effect and/or a time effect, a total of 100 or 200 patients, 4 or 7 items and two different values for the correlation coefficient of the latent trait between two consecutive times (0.4 or 0.9). Cases including informative and non-informative intermittent missing data were compared at different rates (15, 30 %). These simulated data were analyzed with CTT using score and mixed model (SM) and with IRT using longitudinal Rasch mixed model (LRM). The type I error, the power and the bias of the group effect estimations were compared between the two methods. This study showed that LRM performs better than SM. When the rate of missing data rose to 30 %, estimations were biased with SM mainly for informative missing data. Otherwise, LRM and SM methods were comparable concerning biases. However, regardless of the rate of intermittent missing data, power of LRM was higher compared to power of SM. In conclusion, LRM should be favored when the rate of missing data is higher than 15 %. For other cases, SM and LRM provide similar results.

  20. Creating a brief rating scale for the assessment of learning disabilities using reliability and true score estimates of the scale's items based on the Rasch model.

    Science.gov (United States)

    Sideridis, Georgios; Padeliadu, Susana

    2013-01-01

    The purpose of the present studies was to provide the means to create brief versions of instruments that can aid the diagnosis and classification of students with learning disabilities and comorbid disorders (e.g., attention-deficit/hyperactivity disorder). A sample of 1,108 students with and without a diagnosis of learning disabilities took part in study 1. Using information from modern theory methods (i.e., the Rasch model), a scale was created that included fewer than one third of the original battery items designed to assess reading skills. This best item synthesis was then evaluated for its predictive and criterion validity with a valid external reading battery (study 2). Using a sample of 232 students with and without learning disabilities, results indicated that the brief version of the scale was equally effective as the original scale in predicting reading achievement. Analysis of the content of the brief scale indicated that the best item synthesis involved items from cognition, motivation, strategy use, and advanced reading skills. It is suggested that multiple psychometric criteria be employed in evaluating the psychometric adequacy of scales used for the assessment and identification of learning disabilities and comorbid disorders.

  1. Psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale: A Rasch rating scale analysis and confirmatory factor analysis.

    Science.gov (United States)

    Pilatti, Angelina; Lozano, Oscar M; Cyders, Melissa A

    2015-12-01

    The present study was aimed at determining the psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale in a sample of college students. Participants were 318 college students (36.2% men; mean age = 20.9 years, SD = 6.4 years). The psychometric properties of this Spanish version were analyzed using the Rasch model, and the factor structure was examined using confirmatory factor analysis. The verification of the global fit of the data showed adequate indexes for persons and items. The reliability estimates were high for both items and persons. Differential item functioning across gender was found for 23 items, which likely reflects known differences in impulsivity levels between men and women. The factor structure of the Spanish version of the UPPS-P replicates previous work with the original UPPS-P Scale. Overall, results suggest that test scores from the Spanish version of the UPPS-P show adequate psychometric properties to accurately assess the multidimensional model of impulsivity, which represents the most exhaustive measure of this construct. (c) 2015 APA, all rights reserved).

  2. Redefining diagnostic symptoms of depression using Rasch analysis: testing an item bank suitable for DSM-V and computer adaptive testing.

    Science.gov (United States)

    Mitchell, Alex J; Smith, Adam B; Al-salihy, Zerak; Rahim, Twana A; Mahmud, Mahmud Q; Muhyaldin, Asma S

    2011-10-01

    We aimed to redefine the optimal self-report symptoms of depression suitable for creation of an item bank that could be used in computer adaptive testing or to develop a simplified screening tool for DSM-V. Four hundred subjects (200 patients with primary depression and 200 non-depressed subjects), living in Iraqi Kurdistan were interviewed. The Mini International Neuropsychiatric Interview (MINI) was used to define the presence of major depression (DSM-IV criteria). We examined symptoms of depression using four well-known scales delivered in Kurdish. The Partial Credit Model was applied to each instrument. Common-item equating was subsequently used to create an item bank and differential item functioning (DIF) explored for known subgroups. A symptom level Rasch analysis reduced the original 45 items to 24 items of the original after the exclusion of 21 misfitting items. A further six items (CESD13 and CESD17, HADS-D4, HADS-D5 and HADS-D7, and CDSS3 and CDSS4) were removed due to misfit as the items were added together to form the item bank, and two items were subsequently removed following the DIF analysis by diagnosis (CESD20 and CDSS9, both of which were harder to endorse for women). Therefore the remaining optimal item bank consisted of 17 items and produced an area under the curve (AUC) of 0.987. Using a bank restricted to the optimal nine items revealed only minor loss of accuracy (AUC = 0.989, sensitivity 96%, specificity 95%). Finally, when restricted to only four items accuracy was still high (AUC was still 0.976; sensitivity 93%, specificity 96%). An item bank of 17 items may be useful in computer adaptive testing and nine or even four items may be used to develop a simplified screening tool for DSM-V major depressive disorder (MDD). Further examination of this item bank should be conducted in different cultural settings.

  3. The Major Depressive Disorder Hierarchy: Rasch Analysis of 6 items of the Hamilton Depression Scale Covering the Continuum of Depressive Syndrome.

    Directory of Open Access Journals (Sweden)

    Lucas Primo de Carvalho Alves

    Full Text Available Melancholic features of depression (MFD seem to be a unidimensional group of signs and symptoms. However, little importance has been given to the evaluation of what features are related to a more severe disorder. That is, what are the MFD that appear only in the most depressed patients. We aim to demonstrate how each MFD is related to the severity of the major depressive disorder.We evaluated both the Hamilton depression rating scale (HDRS-17 and its 6-item melancholic subscale (HAM-D6 in 291 depressed inpatients using Rasch analysis, which computes the severity of each MFD. Overall measures of model fit were mean (±SD of items and persons residual = 0 (±1; low χ2 value; p>0.01.For the HDRS-17 model fit, mean (±SD of item residuals = 0.35 (±1.4; mean (±SD of person residuals = -0.15 (±1.09; χ2 = 309.74; p<0.00001. For the HAM-D6 model fit, mean (±SD of item residuals = 0.5 (±0.86; mean (±SD of person residuals = 0.15 (±0.91; χ2 = 56.13; p = 0.196. MFD ordered by crescent severity were depressed mood, work and activities, somatic symptoms, psychic anxiety, guilt feelings, and psychomotor retardation.Depressed mood is less severe, while guilt feelings and psychomotor retardation are more severe MFD in a psychiatric hospitalization. Understanding depression as a continuum of symptoms can improve the understanding of the disorder and may improve its perspective of treatment.

  4. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples.

    Science.gov (United States)

    Petrillo, Jennifer; Cano, Stefan J; McLeod, Lori D; Coon, Cheryl D

    2015-01-01

    To provide comparisons and a worked example of item- and scale-level evaluations based on three psychometric methods used in patient-reported outcome development-classical test theory (CTT), item response theory (IRT), and Rasch measurement theory (RMT)-in an analysis of the National Eye Institute Visual Functioning Questionnaire (VFQ-25). Baseline VFQ-25 data from 240 participants with diabetic macular edema from a randomized, double-masked, multicenter clinical trial were used to evaluate the VFQ at the total score level. CTT, RMT, and IRT evaluations were conducted, and results were assessed in a head-to-head comparison. Results were similar across the three methods, with IRT and RMT providing more detailed diagnostic information on how to improve the scale. CTT led to the identification of two problematic items that threaten the validity of the overall scale score, sets of redundant items, and skewed response categories. IRT and RMT additionally identified poor fit for one item, many locally dependent items, poor targeting, and disordering of over half the response categories. Selection of a psychometric approach depends on many factors. Researchers should justify their evaluation method and consider the intended audience. If the instrument is being developed for descriptive purposes and on a restricted budget, a cursory examination of the CTT-based psychometric properties may be all that is possible. In a high-stakes situation, such as the development of a patient-reported outcome instrument for consideration in pharmaceutical labeling, however, a thorough psychometric evaluation including IRT or RMT should be considered, with final item-level decisions made on the basis of both quantitative and qualitative results. Copyright © 2015. Published by Elsevier Inc.

  5. Exploring differential item functioning (DIF) with the Rasch model: a comparison of gender differences on eighth grade science items in the United States and Spain.

    Science.gov (United States)

    Babiar, Tasha Calvert

    2011-01-01

    Traditionally, women and minorities have not been fully represented in science and engineering. Numerous studies have attributed these differences to gaps in science achievement as measured by various standardized tests. Rather than describe mean group differences in science achievement across multiple cultures, this study focused on an in-depth item-level analysis across two countries: Spain and the United States. This study investigated eighth-grade gender differences on science items across the two countries. A secondary purpose of the study was to explore the nature of gender differences using the many-faceted Rasch Model as a way to estimate gender DIF. A secondary analysis of data from the Third International Mathematics and Science Study (TIMSS) was used to address three questions: 1) Does gender DIF in science achievement exist? 2) Is there a relationship between gender DIF and characteristics of the science items? 3) Do the relationships between item characteristics and gender DIF in science items replicate across countries. Participants included 7,087 eight grade students from the United States and 3,855 students from Spain who participated in TIMSS. The Facets program (Linacre and Wright, 1992) was used to estimate gender DIF. The results of the analysis indicate that the content of the item seemed to be related to gender DIF. The analysis also suggests that there is a relationship between gender DIF and item format. No pattern of gender DIF related to cognitive demand was found. The general pattern of gender DIF was similar across the two countries used in the analysis. The strength of item-level analysis as opposed to group mean difference analysis is that gender differences can be detected at the item level, even when no mean differences can be detected at the group level.

  6. Exploring differential item functioning (DIF) with the Rasch model: A comparison of gender differences on eighth-grade science items in the United States and Spain

    Science.gov (United States)

    Calvert, Tasha

    Despite the attention that has been given to gender and science, boys continue to outperform girls in science achievement, particularly by the end of secondary school. Because it is unclear whether gender differences have narrowed over time (Leder, 1992; Willingham & Cole, 1997), it is important to continue a line of inquiry into the nature of gender differences, specifically at the international level. The purpose of this study was to investigate gender differences in science achievement across two countries: United States and Spain. A secondary purpose was to demonstrate an alternative method for exploring gender differences based on the many-faceted Rasch model (1980). A secondary analysis of the data from the Third International Mathematics and Science Study (TIMSS) was used to examine the relationship between gender DIF (differential item functioning) and item characteristics (item type, content, and performance expectation) across both countries. Nationally representative samples of eighth grade students in the United States and Spain who participated in TIMSS were analyzed to answer the research questions in this study. In both countries, girls showed an advantage over boys on life science items and most extended response items, whereas boys, by and large, had an advantage on earth science, physics, and chemistry items. However, even within areas that favored boys, such as physics, there were items that were differentially easier for girls. In general, patterns in gender differences were similar across both countries although there were a few differences between the countries on individual items. It was concluded that simply looking at mean differences does not provide an adequate understanding of the nature of gender differences in science achievement.

  7. Applying the Rasch Model to Measure Mobility of Women: A Comparative Analysis of Mobility of Informal Workers in Fisheries in Kerala, India.

    Science.gov (United States)

    Menon, Nikhila

    2016-01-01

    Mobility or freedom and ability to move is gendered in many cultural contexts. In this paper I analyse mobility associated with work from the capability approach perspective of Sen. This is an empirical paper which uses the Rasch Rating Scale Model (RSM) to construct the measure of mobility of women for the first time in the development studies discourse. I construct a measure of mobility (latent trait) of women workers engaged in two types of informal work, namely, peeling work and fish vending, in fisheries in the cultural context of India. The scale measure enables first, to test the unidimensionality of my construct of mobility of women and second, to analyse the domains of mobility of women workers. The comparative analysis of the scale of permissibility of mobility constructed using the RSM for the informal women workers shows that women face constraints on mobility in social and personal spaces in the socially advanced state of Kerala in India. Work mobility does not expand the real freedoms, hence work mobility can be termed as bounded capability which is a capability limited or bounded by either the social, cultural and gender norms or a combination of all of these. Therefore at the macro level, growth in informal employment in sectors like fisheries which improve mobility of women through work mobility does not necessarily expand the capability sets by contributing to greater freedoms and transformational mobility. This paper has a significant methodological contribution in that it uses an innovative method for the measurement of mobility of women in the development studies discipline.

  8. Rasch Measurement Analysis of a 25-Item Version of the Mueller/McCloskey Nurse Job Satisfaction Scale in a Sample of Nurses in Lebanon and Qatar

    Directory of Open Access Journals (Sweden)

    Michael Clinton

    2015-06-01

    Full Text Available The Mueller/McCloskey Nurse Job Satisfaction Scale (MMSS is widely used, but its psychometric characteristics have not been sufficiently validated for use in Middle Eastern countries. The objective of our methodological study was to determine the psychometric suitability of a 25-item version of the MMSS (MMSS-25 for use in middle-income and high-income Middle Eastern countries. A total of 1,322 registered nurses, 859 in Lebanon and 463 in Qatar, completed the MMSS-25 as part of a cross-sectional multinational investigation of nursing shortages in the region. We used the Rasch rating scale model to investigate the psychometric performance of the MMSS-25. We identified possible item bias among MMSS-25 items. We conducted confirmatory factor analyses (CFA to compare the fit to our data of five factor structures reported in the literature. We concluded that irrespective of administration in English or Arabic, the MMSS-25 is not sufficiently productive of measurement for use in the region. A core set of 13 items (MMSS-13, Cronbach’s α = .82 loading on five dimensions eliminates redundant MMSS items and is suitable for initial screening of nurses’ satisfaction. Of the five factor structures we examined, the MMSS-13 was the only close fit to our data (comparative fit index = 0.951; Tucker–Lewis index = 0.931; root mean square error of approximation = 0.051; p value = .401. The MMSS-13 has psychometric characteristics superior to MMSS-25, but additional items are required to meet the research-specific objectives of future studies of nurses’ job satisfaction in Middle Eastern countries.

  9. A comparison of three methods of assessing differential item functioning (DIF) in the Hospital Anxiety Depression Scale: ordinal logistic regression, Rasch analysis and the Mantel chi-square procedure.

    Science.gov (United States)

    Cameron, Isobel M; Scott, Neil W; Adler, Mats; Reid, Ian C

    2014-12-01

    It is important for clinical practice and research that measurement scales of well-being and quality of life exhibit only minimal differential item functioning (DIF). DIF occurs where different groups of people endorse items in a scale to different extents after being matched by the intended scale attribute. We investigate the equivalence or otherwise of common methods of assessing DIF. Three methods of measuring age- and sex-related DIF (ordinal logistic regression, Rasch analysis and Mantel χ(2) procedure) were applied to Hospital Anxiety Depression Scale (HADS) data pertaining to a sample of 1,068 patients consulting primary care practitioners. Three items were flagged by all three approaches as having either age- or sex-related DIF with a consistent direction of effect; a further three items identified did not meet stricter criteria for important DIF using at least one method. When applying strict criteria for significant DIF, ordinal logistic regression was slightly less sensitive. Ordinal logistic regression, Rasch analysis and contingency table methods yielded consistent results when identifying DIF in the HADS depression and HADS anxiety scales. Regardless of methods applied, investigators should use a combination of statistical significance, magnitude of the DIF effect and investigator judgement when interpreting the results.

  10. Rasch analysis of the Mini-Mental Adjustment to Cancer Scale (mini-MAC among a heterogeneous sample of long-term cancer survivors: A cross-sectional study

    Directory of Open Access Journals (Sweden)

    Zucca Alison

    2012-05-01

    Full Text Available Abstract Background The mini-Mental Adjustment to Cancer Scale (mini-MAC is a well-recognised, popular measure of coping in psycho-oncology and assesses five cancer-specific coping strategies. It has been suggested that these five subscales could be grouped to form the over-arching adaptive and maladptive coping subscales to facilitate the interpretation and clinical application of the scale. Despite the popularity of the mini-MAC, few studies have examined its psychometric properties among long-term cancer survivors, and further validation of the mini-MAC is needed to substantiate its use with the growing population of survivors. Therefore, this study examined the psychometric properties and dimensionality of the mini-MAC in a sample of long-term cancer survivors using Rasch analysis. Methods RUMM 2030 was used to analyse the mini-MAC data (n=851. Separate Rasch analyses were conducted for each of the original mini-MAC subscales as well as the over-arching adaptive and maladaptive coping subscales to examine summary and individual model fit statistics, person separation index (PSI, response format, local dependency, targeting, item bias (or differential item functioning -DIF, and dimensionality. Results For the fighting spirit, fatalism, and helplessness-hopelessness subscales, a revised three-point response format seemed more optimal than the original four-point response. To achieve model fit, items were deleted from four of the five subscales – Anxious Preoccupation items 7, 25, and 29; Cognitive Avoidance items 11 and 17; Fighting Spirit item 18; and Helplessness-Hopelessness items 16 and 20. For those subscales with sufficient items, analyses supported unidimensionality. Combining items to form the adaptive and maladaptive subscales was partially supported. Conclusions The original five subscales required item deletion and/or rescaling to improve goodness of fit to the Rasch model. While evidence was found for overarching subscales of

  11. Rasch analysis of the Mini-Mental Adjustment to Cancer Scale (mini-MAC) among a heterogeneous sample of long-term cancer survivors: a cross-sectional study.

    Science.gov (United States)

    Zucca, Alison; Lambert, Sylvie D; Boyes, Allison W; Pallant, Julie F

    2012-05-20

    The mini-Mental Adjustment to Cancer Scale (mini-MAC) is a well-recognised, popular measure of coping in psycho-oncology and assesses five cancer-specific coping strategies. It has been suggested that these five subscales could be grouped to form the over-arching adaptive and maladptive coping subscales to facilitate the interpretation and clinical application of the scale. Despite the popularity of the mini-MAC, few studies have examined its psychometric properties among long-term cancer survivors, and further validation of the mini-MAC is needed to substantiate its use with the growing population of survivors. Therefore, this study examined the psychometric properties and dimensionality of the mini-MAC in a sample of long-term cancer survivors using Rasch analysis. RUMM 2030 was used to analyse the mini-MAC data (n=851). Separate Rasch analyses were conducted for each of the original mini-MAC subscales as well as the over-arching adaptive and maladaptive coping subscales to examine summary and individual model fit statistics, person separation index (PSI), response format, local dependency, targeting, item bias (or differential item functioning -DIF), and dimensionality. For the fighting spirit, fatalism, and helplessness-hopelessness subscales, a revised three-point response format seemed more optimal than the original four-point response. To achieve model fit, items were deleted from four of the five subscales - Anxious Preoccupation items 7, 25, and 29; Cognitive Avoidance items 11 and 17; Fighting Spirit item 18; and Helplessness-Hopelessness items 16 and 20. For those subscales with sufficient items, analyses supported unidimensionality. Combining items to form the adaptive and maladaptive subscales was partially supported. The original five subscales required item deletion and/or rescaling to improve goodness of fit to the Rasch model. While evidence was found for overarching subscales of adaptive and maladaptive coping, extensive modifications were

  12. Propriedades psicométricas da versão brasileira da escala de qualidade de vida específica para acidente vascular encefálico: aplicação do modelo Rasch Psychometric properties of the Brazilian version of the Stroke Specific Quality of Life Scale: application of the Rasch model

    Directory of Open Access Journals (Sweden)

    RCM Lima

    2008-04-01

    Full Text Available CONTEXTUALIZAÇÃO: O acidente vascular encefálico (AVE produz déficits importantes na qualidade de vida (QV dos indivíduos. Medidas específicas de QV são necessárias para compreender e quantificar o impacto dessa patologia. OBJETIVO: O objetivo desse estudo foi adaptar transculturalmente o Stroke Specific Quality of Life Scale (SSQOL para o Português (Brasil e avaliar suas propriedades psicométricas. MATERIAIS E MÉTODOS: O SSQOL foi traduzido e adaptado seguindo instruções padronizadas e submetido a exame de confiabilidade teste-reteste (10 hemiplégicos. As propriedades psicométricas foram investigadas pela análise Rasch em 50 hemiplégicos. RESULTADOS: Foram detectados coeficientes de confiabilidade de 0,92 para itens e indivíduos. O índice de separação dos hemiplégicos foi 3,34 e dos itens, 3,36, ou seja, os itens separaram as pessoas em pelo menos três níveis de QV e em três níveis de QV - baixa, média e alta. Dos 49 itens, quatro não se enquadram no modelo, o que compromete a validade de constructo do instrumento, embora o padrão errático dos itens se justifique na amostra examinada. CONCLUSÕES: O instrumento mostrou-se clinicamente útil na população avaliada. Novos estudos em populações com outras características já estão em andamento.BACKGROUND: Stroke results in important deficits, which reduce individuals’ quality of life (QOL. Specific QOL measurements are necessary to understand and quantify the impact of this pathological condition. OBJECTIVE: The aim of this study was to make a transcultural adaptation of the Stroke Specific Quality of Life Scale (SSQOL into Brazilian Portuguese and to assess its psychometric properties. METHODS: The SSQOL was translated and adapted in accordance with standardized procedures and was subjected to test-retest reliability analysis with 10 hemiplegic subjects. The psychometric properties were investigated using Rasch analysis on 50 hemiplegics. RESULTS: Reliability

  13. Doktora Yeterlikler Çerçevesinde Öğretim Üyesi, Akran ve Öz Değerlendirmelerin Rasch Ölçme Modeliyle Analizi

    Directory of Open Access Journals (Sweden)

    Çetin SEMERCİ

    2011-12-01

    Full Text Available The aim of this study is to perform the analysis of faculty member, peer and self evaluation by applying Rasch model within the scope of doctorate competencies. In this study in which survey method was used, the faculty members and researchers were chosen entirely on a voluntary basis. The Rasch model has three levels. In the study, the levels comprise of 11 evaluators, 5 of whom are faculty members and 6 are postgraduate students specified in the jury , 15 competencies which are adopted by the Council of Higher Education and are criteria being currently developed and 6 postgraduate students evaulated. The study group is composed of 5 faculty members working in the division of Curriculum and Intruction as of May 2011 and 6 postgraduate students educated in this department in Fırat University. According to the study findings, within the framework of determined criteria, the ones giving an outstanding performance were P1 and P2. In other words, P1 and P2 coded students were decided to be more adequate and P5 and P6 coded students were less adequate than the others.It was confirmed that J5 was the most lenient and J4 was the severest ones among the juries carrying out the evaluation. The most difficult task was B3 (taking the lead in specific and interdisciplinary studies and the easiest task was I3 (using a language at least at C1 level taking part in The European Language Portfolio; the ability of written, oral or visual communucation at an advanced level and discussion. In this study, it was observed differences between the competencies of the postgraduate students.It is recommended that training programs for resolving these observed differences should be provided for instructors and postgraduate students

  14. Rasch-ionale for neurologists

    NARCIS (Netherlands)

    Vanhoutte, Els K.; Hermans, Mieke C. E.; Faber, Catharina G.; Gorson, Kenneth C.; Merkies, Ingemar S. J.; Thonnard, Jean-L.; Barreira, A. A.; Bennett, D.; Hadden, R. D.; Hughes, R. A. C.; Lunn, M. P. T.; Reilly, M. M.; van den Berg, L. H.; van Doorn, P. A.; Faber, C. G.; van der Kooi, A. J.; Merkies, I. S. J.; Notermans, N. C.; Raaphorts, J.; van Schaik, I. N.; de Visser, M.; Cats, E. A.; van den Bergh, P. Y. K.; Bombelli, F.; Costa, R.; Franques, J.; Léger, J.-M.; Pouget, J.; Bril, V.; Hahn, A. F.; Katzberg, H.; Campanella, A.; Devigili, G.; Gallia, F.; Lauria, G.; Nobile-Orazio, E.; Padua, L.; Cornblath, D. R.; Gorson, K. C.; Lewis, R. A.; Illa, I.; Querol, L.; van Nes, S. I.

    2015-01-01

    Outcome measures are considered the most important tools to monitor patients' outcome in both clinical and research settings. Measuring the clinical state of patients is a fundamental part of our daily clinical practice and research that sometimes is taken for granted. In peripheral neuropathies,

  15. Cross-cultural adaptation and analysis of the psychometric properties of the Balance Evaluation Systems Test and MiniBESTest in the elderly and individuals with Parkinson's disease: application of the Rasch model

    Directory of Open Access Journals (Sweden)

    Angelica C. Maia

    2013-06-01

    Full Text Available BACKGROUND: Older adults and individuals with neurological problems such as Parkinson's disease (PD exhibit balance deficits that might impair their mobility and independence. The assessment of balance must be useful in identifying the presence of instability and orient interventions. OBJECTIVE: To translate and perform a cross-cultural adaptation of the Balance Evaluation Systems Test (BESTest and MiniBESTest to Brazilian Portuguese and analyze its psychometric properties. METHOD: The tests were translated and adapted to Portuguese according to a standard method and then subjected to a test-retest reliability assessment (10 older adults; 10 individuals with PD. The psychometric properties were assessed by the Rasch model (35 older adults; 35 individuals with PD. RESULTS: The reliability coefficient of the tests relative to the items and subjects varied from 0.91 and 0.98, which is indicative of the stability and reproducibility of the measures. In the BESTest, the person (4.19 and item (5.36 separation index established six balance ability levels and seven levels of difficulty, respectively. In the MiniBESTest, the person (3.16 and item (6.41 separation index established four balance ability levels and nine levels of difficulty, respectively. Two items in the BESTest did not fit with the model expectations, but the construct validity was not compromised. No item in the MiniBESTest was erratic. CONCLUSIONS: The results corroborate the diagnostic and screening functions of the BESTest and MiniBESTest, respectively, and indicate that the Brazilian versions exhibit adequate reliability, construct validity, response stability, and capacity to distinguish among various balance ability levels in older adults and individuals with PD.

  16. Rasch models with exchangeable rows and columns

    DEFF Research Database (Denmark)

    Lauritzen, Steffen Lilholt

    The article studies distributions of doubly infinite binary matrices with exchangeable rows and columns which satify the further property that the probability of any $m \\times n$ submatrix is a function of the row- and column sums of that matrix. We show that any such distribution is a (unique...

  17. Computerized Classification Testing with the Rasch Model

    Science.gov (United States)

    Eggen, Theo J. H. M.

    2011-01-01

    If classification in a limited number of categories is the purpose of testing, computerized adaptive tests (CATs) with algorithms based on sequential statistical testing perform better than estimation-based CATs (e.g., Eggen & Straetmans, 2000). In these computerized classification tests (CCTs), the Sequential Probability Ratio Test (SPRT) (Wald,…

  18. Rasch Analysis of the Fullerton Advanced Balance (FAB) Scale

    OpenAIRE

    Klein, Penelope J.; Fiedler, Roger C.; Rose, Debra J.

    2011-01-01

    Purpose: This cross-sectional study explores the psychometric properties and dimensionality of the Fullerton Advanced Balance (FAB) Scale, a multi-item balance test for higher-functioning older adults.

  19. Tree-Based Global Model Tests for Polytomous Rasch Models

    Science.gov (United States)

    Komboz, Basil; Strobl, Carolin; Zeileis, Achim

    2018-01-01

    Psychometric measurement models are only valid if measurement invariance holds between test takers of different groups. Global model tests, such as the well-established likelihood ratio (LR) test, are sensitive to violations of measurement invariance, such as differential item functioning and differential step functioning. However, these…

  20. A constrained rasch model of trace redintegration in serial recall.

    Science.gov (United States)

    Roodenrys, Steven; Miller, Leonie M

    2008-04-01

    The notion that verbal short-term memory tasks, such as serial recall, make use of information in long-term as well as in short-term memory is instantiated in many models of these tasks. Such models incorporate a process in which degraded traces retrieved from a short-term store are reconstructed, or redintegrated (Schweickert, 1993), through the use of information in long-term memory. This article presents a conceptual and mathematical model of this process based on a class of item-response theory models. It is demonstrated that this model provides a better fit to three sets of data than does the multinomial processing tree model of redintegration (Schweickert, 1993) and that a number of conceptual accounts of serial recall can be related to the parameters of the model.

  1. Modifying the Medical Research Council grading system through Rasch analyses

    NARCIS (Netherlands)

    Vanhoutte, Els Karla; Faber, Catharina Gerritdina; van Nes, Sonja Ingrid; Jacobs, Bart Casper; van Doorn, Pieter Antoon; van Koningsveld, Rinske; Cornblath, David Reid; van der Kooi, Anneke Jelly; Cats, Elisabeth Aviva; van den Berg, Leonard Hendrik; Notermans, Nicolette Claudia; van der Pol, Willem Lodewijk; Hermans, Mieke Catharina Elisabeth; van der Beek, Nadine Anna Maria Elisabeth; Gorson, Kenneth Craig; Eurelings, Marijke; Engelsman, Jeroen; Boot, Hendrik; Meijer, Ronaldus Jacobus; Lauria, Giuseppe; Tennant, Alan; Merkies, Ingemar Sergio José; Barreira, A. A.; Bennett, D.; van den Bergh, P. Y. K.; Bril, V.; Devigili, G.; Hadden, R. D.; Hahn, A. F.; Hartung, H.-P.; Hughes, R. A. C.; Illa, I.; Katzberg, H.; Léger, J.-M.; Lewis, R. A.; Lunn, M. P. T.; Nascimento, O. J. M.; Nobile-Orazio, E.; Padua, L.; Pouget, J.; Reilly, M. M.; van Schaik, I.; Smith, B.; de Visser, M.; Walk, D.

    2012-01-01

    The Medical Research Council grading system has served through decades for the evaluation of muscle strength and has been recognized as a cardinal feature of daily neurological, rehabilitation and general medicine examination of patients, despite being respectfully criticized due to the unequal

  2. Modifying the Medical Research Council grading system through Rasch analyses

    NARCIS (Netherlands)

    E.K. Vanhoutte (Els); C.G. Faber (Carin); S.I. van Nes (Sonja); B.C. Jacobs (Bart); P.A. van Doorn (Pieter); R. van Koningsveld (Rinske); D.R. Cornblath (David); A.J. Kooj (Anneke); E.A. Cats (Elisabeth); L.H. van den Berg (Leonard); N.C. Notermans (Nicolette); W.L. van der Pol (Ludo); M.C.E. Hermans; N.A.M.E. van der Beek (Nadine); K.C. Gorson (Kenneth); M. Eurelings (Marijke); L. Engelsman (Lyda); H. Boot (Hendrik); R.J. Meijer (Ron); G. Lauria (Giuseppe); C. Tennant (Christopher); I.S.J. Merkies (Ingemar)

    2012-01-01

    textabstractThe Medical Research Council grading system has served through decades for the evaluation of muscle strength and has been recognized as a cardinal feature of daily neurological, rehabilitation and general medicine examination of patients, despite being respectfully criticized due to the

  3. RhinAsthma patient perspective: A Rasch validation study.

    Science.gov (United States)

    Molinengo, Giorgia; Baiardini, Ilaria; Braido, Fulvio; Loera, Barbara

    2018-02-01

    In daily practice, Health-Related Quality of Life (HRQoL) tools are useful for supplementing clinical data with the patient's perspective. To encourage their use by clinicians, the availability of tools that can quickly provide valid results is crucial. A new HRQoL tool has been proposed for patients with asthma and rhinitis: the RhinAsthma Patient Perspective-RAPP. The aim of this study was to evaluate the psychometric robustness of the RAPP using the Item Response Theory (IRT) approach, to evaluate the scalability of items and test whether or not patients use the items response scale correctly. 155 patients (53.5% women, mean age 39.1, range 16-76) were recruited during a multicenter study. RAPP metric properties were investigated using IRT models. Differential item functioning (DIF) was used for gender, age, and asthma control test (ACT). The RAPP adequately fitted the Rating Scale model, demonstrating the equality of the rating scale structure for all items. All statistics on items were satisfactory. The RAPP had adequate internal reliability and showed good ability to discriminate among different groups of participants. DIF analysis indicated that there were no differential item functioning issues for gender. One item showed a DIF by age and four items by ACT. The psychometric evaluation performed using IRT models demonstrated that the RAPP met all the criteria to be considered a reliable and valid method of measurement. From a clinical perspective, this will allow physicians to confidently interpret scores as good indicators of Quality of Life of patients with asthma.

  4. Analysis of Rater Agreement by Rasch and IRT Models

    DEFF Research Database (Denmark)

    Petersen, Jørgen Holm

    2013-01-01

    by obstetricians to asses the status of a fetus. Meta analyses of the randomized clinical trials have shown a 49% reduction in perinatal mortality on using the technique on high-risk pregnancies. It is clear from these considerations that the variations in effects of using the ultrasound technique may in part...

  5. Rasch analysis of the Multiple Sclerosis Impact Scale (MSIS-29)

    OpenAIRE

    Ramp, Melina; Khan, Fary; Misajon, Rose Anne; Pallant, Julie F

    2009-01-01

    Abstract Background Multiple Sclerosis (MS) is a degenerative neurological disease that causes impairments, including spasticity, pain, fatigue, and bladder dysfunction, which negatively impact on quality of life. The Multiple Sclerosis Impact Scale (MSIS-29) is a disease-specific health-related quality of life (HRQoL) instrument, developed using the patient's perspective on disease impact. It consists of two subscales assessing the physical (MSIS-29-PHYS) and psychological (MSIS-29-PSYCH) im...

  6. Application of Rasch Measurement to Item Banking in Language Testing

    OpenAIRE

    中村, 優治

    2010-01-01

    ラッシュモデルの具体的応用例として考えられるのが,アイテムバンキングへの活用である.アイテムバンクは項目反応理論の分析手法を用いて統計処理を行った項目(アイテム)を蓄積したもので大規模な言語テストの開発のみならず,クラスルームにおける身近なテスト作成・テスト結果の考察にも威力を発揮するものである.本稿では理論的側面を概観したのち,50項目のテストデータを用いて,アイテムバンクの構築手順ならびにその長所,短所をのべ,さらに,実際の読解力テスト項目構築時の問題点などを指摘し今後の研究への示唆を行う....

  7. Branched Adaptive Testing with a Rasch-Model-Calibrated Test: Analysing Item Presentation's Sequence Effects Using the Rasch-Model-Based LLTM

    Science.gov (United States)

    Kubinger, Klaus D.; Reif, Manuel; Yanagida, Takuya

    2011-01-01

    Item position effects provoke serious problems within adaptive testing. This is because different testees are necessarily presented with the same item at different presentation positions, as a consequence of which comparing their ability parameter estimations in the case of such effects would not at all be fair. In this article, a specific…

  8. Early career burnout among Dutch nurses : A process captured in a Rasch model

    NARCIS (Netherlands)

    de Vos, Jan Alexander; Brouwers, Andre; Schoot, Tineke; Pat-El, Ron; Verboon, Peter; Näring, Gerard

    2016-01-01

    This study investigates burnout among Dutch nursing graduates as a process by testing a sequential-developmental model. A sample of 237 respondents was recruited from a population of Dutch early career nurses. Burnout was measured with the Dutch version of the Maslach Burnout Inventory Human

  9. Early career burnout among Dutch nurses: A process captured in a Rasch model

    NARCIS (Netherlands)

    Vos, J.A. de; Brouwers, A.; Schoot, T.; Pat-El, R.; Verboon, P.; Näring, G.W.B.

    2016-01-01

    This study investigates burnout among Dutch nursing graduates as a process by testing a sequential-developmental model. A sample of 237 respondents was recruited from a population of Dutch early career nurses. Burnout was measured with the Dutch version of the Maslach Burnout Inventory Human

  10. Development and Psychometric Evaluation of the School Bullying Scales: A Rasch Measurement Approach

    Science.gov (United States)

    Cheng, Ying-Yao; Chen, Li-Ming; Liu, Kun-Shia; Chen, Yi-Ling

    2011-01-01

    The study aims to develop three school bullying scales--the Bully Scale, the Victim Scale, and the Witness Scale--to assess secondary school students' bullying behaviors, including physical bullying, verbal bullying, relational bullying, and cyber bullying. The items of the three scales were developed from viewpoints of bullies, victims, and…

  11. Rasch analysis of the 23-item version of the Roland Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Kent, Peter; Grotle, Margreth; Dunn, Kate

    2015-01-01

    participants (35 villagers and 13 healthcare providers). Analysis included constant comparative methods followed by a structured approach to identify and assemble walking stick text for interpretation. Results: Observations and discussions revealed that many walking sticks were handcrafted from natural...... or household objects. From a therapeutic perspective, homemade and commercial aids were improperly fitted and poorly maintained. Villagers reported walking stick use to: uphold posture and balance; relieve MuBoJo pain; honour fashionable tradition; and assist visually impaired persons to negotiate rough...

  12. Organizational Culture Influence on Total Productive Maintenance (TPM) and Operational Performance Using RASCH Model Analysis

    OpenAIRE

    Mohd Asaad, Mohd Norhasni; Yusoff, Rushami Zien

    2013-01-01

    Abstract. Market globalization, competitive product and services, high economic crises are the most critical factors that influence the success of the manufacturing companies in global market. Therefore it is critical to the manufacturing companies to be efficient in production and lean tool may used to achieve that.  The most frequently used is the Total Preventive Maintenance (TPM), even though there are many studies have been conducted in relation to the TPM but there is limited research i...

  13. Imitation from 12 to 24 Months in Autism and Typical Development: A Longitudinal Rasch Analysis

    Science.gov (United States)

    Young, Gregory S.; Rogers, Sally J.; Hutman, Ted; Rozga, Agata; Sigman, Marian; Ozonoff, Sally

    2011-01-01

    The development of imitation during the second year of life plays an important role in domains of sociocognitive development such as language and social learning. Deficits in imitation ability in persons with autism spectrum disorder (ASD) from toddlerhood into adulthood have also been repeatedly documented, raising the possibility that early…

  14. Using Rasch Modeling to Investigate a Learning Progression for Energy Ideas

    Science.gov (United States)

    Herrmann-Abell, Cari F.; DeBoer, George E.

    2016-01-01

    Energy is a core concept in the teaching of science. Therefore, it is important to know how students' thinking about energy develops so that elementary, middle, and high school students can be appropriately supported in their understanding of energy. This study tests the validity of a proposed theoretical model of students' growth of understanding…

  15. Development of Objective Standard Setting Using Rasch Measurement Model in Malaysian Institution of Higher Learning

    Science.gov (United States)

    Khatimin, Nuraini; Aziz, Azrilah Abdul; Zaharim, Azami; Yasin, Siti Hanani Mat

    2013-01-01

    Measurement and evaluation of students' achievement are an important aspect to make sure that students really understand the course content and monitor students' achievement level. Performance is not only reflected from the numbers of high achievers of the students, but also on quality of the grade obtained; does the grade "A" truly…

  16. Item Construction Using Reflective, Formative, or Rasch Measurement Models: Implications for Group Work

    Science.gov (United States)

    Peterson, Christina Hamme; Gischlar, Karen L.; Peterson, N. Andrew

    2017-01-01

    Measures that accurately capture the phenomenon are critical to research and practice in group work. The vast majority of group-related measures were developed using the reflective measurement model rooted in classical test theory (CTT). Depending on the construct definition and the measure's purpose, the reflective model may not always be the…

  17. Attention Deficit Hyperactivity Disorder: A Rasch Analysis of the SWAN Rating Scale

    Science.gov (United States)

    Young, Deidra J.; Levy, Florence; Martin, Neilson C.; Hay, David A.

    2009-01-01

    The prevalence of attention-deficit/hyperactivity disorder (ADHD) has been estimated at 3-7% in the population. Children with this disorder are often characterized by symptoms of inattention and/or impulsivity and hyperactivity, which can significantly impact on many aspects of their behaviour and performance. This study investigated the…

  18. Assessment of the Measurement Properties of the NHCAHPS Family Survey: A Rasch Scaling Approach

    Science.gov (United States)

    O'Connor, Matthew S.

    2013-01-01

    The introduction of the Consumer Assessment of Healthcare Providers and Systems (CAHPS), a family of survey instruments designed to capture and report people's experiences obtaining health care could soon add satisfaction as a consistent dimension of quality that skilled nursing facilities (SNFs) are required to assess and report. The SNF setting…

  19. Estimation for the Rasch Model When Both Ability and Difficulty Parameters are Random.

    Science.gov (United States)

    1987-02-01

    Earles University of Leyden Air Force Human Resources Lab Education Research Center Brooks AFB, TX 78235 Boerhaavelaan 2 2334 EN Leyden Dr. Kent Eaton...Center for Naval Analysis NPRDC Code 13 4401 Ford Avenue San Diego, CA 92152-6800 P.O. Box 16268 Alexandria, VA 22302-0268 Ms. Kathleen Moreno Navy

  20. International Assessment: A Rasch Model and Teachers' Evaluation of TIMSS Science Achievement Items

    Science.gov (United States)

    Glynn, Shawn M.

    2012-01-01

    The Trends in International Mathematics and Science Study (TIMSS) is a comparative assessment of the achievement of students in many countries. In the present study, a rigorous independent evaluation was conducted of a representative sample of TIMSS science test items because item quality influences the validity of the scores used to inform…

  1. Rasches Wachstum, frühe Reifung und kurze Generationenzeit bei afrikanischen annuellen Fischen.

    Czech Academy of Sciences Publication Activity Database

    Blažek, Radim; Polačik, Matej; Reichard, Martin

    2017-01-01

    Roč. 49, č. 3 (2017), s. 131-141 ISSN 0179-4957 R&D Projects: GA ČR(CZ) GAP506/11/0112 Institutional support: RVO:68081766 Keywords : extreme life history * annual fish * explosive growth * rapid maturation * generation time * killifish * diapause * vertebrate * reaction norm * Savanna Subject RIV: EG - Zoology

  2. Rasch analysis of the Knee injury and Osteoarthritis Outcome Score (KOOS): a statistical re-evaluation

    DEFF Research Database (Denmark)

    Comins, J; Brodersen, J; Krogsgaard, M

    2008-01-01

    The knee injury and Osteoarthritis Outcome Score (KOOS), based on the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), is widely used to evaluate subjective outcome in anterior cruciate ligament (ACL) reconstructed patients. However, the validity of KOOS has not been assessed...

  3. Modeling Repeated Count Data : Some Extensions of the Rasch Poisson Counts Model

    NARCIS (Netherlands)

    van Duijn, M.A.J.; Jansen, Margo

    1995-01-01

    We consider data that can be summarized as an N X K table of counts-for example, test data obtained by administering K tests to N subjects. The cell entries y(ij) are assumed to be conditionally independent Poisson-distributed random variables, given the NK Poisson intensity parameters mu(ij). The

  4. Penskalaan Butir Format Respons Pilihan dan Respons Bebas Berdasarkan Model Rasch dan Partial Credit

    Directory of Open Access Journals (Sweden)

    Eko Hariadi

    2007-06-01

    Full Text Available Penelitian melihat pengaruh jumlah parameter butir, kategori respons bebas (RB, pengaruh sampel terhadap akurasi estimasi parameter kemampuan untuk menghasilkan estimasi yang stabil dan pengaruh pembobotan butir RP dan butir RB terhadap kesalahan baku. Penelitian dalam dua tahap, simulasi menggunakan 30 kondisi dengan replikasi 50 dengan variabel panjang tes, jumlah kategori, dan jumlah parameter butir, dan analisis deskriptif, dilanjutkan penerapan penskalaan gabungan butir tipe respons pilihan (rp dan butir respons bebas (rb pada konstruksi tes elektronika yang terdiri 40 butir pilihan ganda dan 4 butir jawaban tersusun, 3 butir memiliki lima kategori jawaban dan 1 butir dengan 4 kategori jawaban, melibatkan 355 siswa. Hasil penelitian menunjukkan: ukuran sampel kurang berpengaruh pada root mean square error atau (RSME> dan korelasi antara 9 dengan 0, namun berpengaruh terhadap akurasi estimasi parameter butir pilihan ganda (/>/y,dan parameter butir respons tersusun (3^- Jumlah parameter butir berpengaruh terhadap parameter kemampuan, tetapi tidak berpengaruh terhadap akurasi dari b^, dan S„,. Estimasi dari parameter tingkat kesulitan butir jawaban tersusun tiga kategori lebih akurat daripada butir jawaban tersusun lima kategori. Estimasi tahan {robust untuk parameter kesulitan butir jawaban tersusun 5 kategori memerlukan sampel minimal 250 responden, sedangkan untuk butir respons tersusun 3 kategori memerlukan sampel minimal 100 responden. Estimasi parameter kemampuan dari skor total (0^^ tidak sama dengan rata-rata jumlah tbeta dari masing-masing subtes (0^ + 0CR. Theta dari tes yang dikalibrasi bersama-sama berbeda dengan theta dari total subtes yang dikalibrasi secara terpisah. Korelasi kemampuan yang mengunakan pembobotan dan kemampuan tanpa pembobotan mempunyai suatu rentang dari 0,988 sampai 0,948. Kata kunci: penyekaiaan, model rash dan partial credit.

  5. Penskalaan Butir Format Respons Pilihan dan Respons Bebas Berdasarkan Model Rasch dan Partial Credit

    OpenAIRE

    Eko Hariadi

    2007-01-01

    Penelitian melihat pengaruh jumlah parameter butir, kategori respons bebas (RB), pengaruh sampel terhadap akurasi estimasi parameter kemampuan untuk menghasilkan estimasi yang stabil dan pengaruh pembobotan butir RP dan butir RB terhadap kesalahan baku. Penelitian dalam dua tahap, simulasi menggunakan 30 kondisi dengan replikasi 50 dengan variabel panjang tes, jumlah kategori, dan jumlah parameter butir, dan analisis deskriptif, dilanjutkan penerapan penskalaan gabungan butir tipe res...

  6. Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank

    NARCIS (Netherlands)

    Oude Voshaar, Martijn A.H.; Ten Klooster, Peter M.; Vonkeman, Harald E.; van de Laar, Mart A.F.J.

    2017-01-01

    Objective: Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Study

  7. A Comparison of Graded Response and Rasch Partial Credit Models with Subjective Well-Being.

    Science.gov (United States)

    Baker, John G.; Rounds, James B.; Zevon, Michael A.

    2000-01-01

    Compared two multiple category item response theory models using a data set of 52 mood terms with 713 undergraduate psychology students. Comparative model fit for the Samejima (F. Samejima, 1966) logistic model for graded responses and the Masters (G. Masters, 1982) partial credit model favored the former model for this data set. (SLD)

  8. Developing the Communicative Participation Item Bank: Rasch Analysis Results from a Spasmodic Dysphonia Sample

    Science.gov (United States)

    Baylor, Carolyn R.; Yorkston, Kathryn M.; Eadie, Tanya L.; Miller, Robert M.; Amtmann, Dagmar

    2009-01-01

    Purpose: The purpose of this study was to conduct the initial psychometric analyses of the Communicative Participation Item Bank--a new self-report instrument designed to measure the extent to which communication disorders interfere with communicative participation. This item bank is intended for community-dwelling adults across a range of…

  9. Measuring Student Teachers' Practices and Beliefs about Teaching Mathematics Using the Rasch Model

    Science.gov (United States)

    Kaspersen, Eivind; Pepin, Birgit; Sikko, Svein Arne

    2017-01-01

    Several attempts have been made to measure and categorize beliefs and practices of mathematics teachers [Swan, M. 2006. "Designing and Using Research Instruments to Describe the Beliefs and Practices of Mathematics Teachers." "Research in Education" 75 (1): 58-70]. One of the reasons for measuring both beliefs and practices is…

  10. Exploring Variability Sources in Student Evaluation of Teaching via Many-Facet Rasch Model

    OpenAIRE

    Bengü BÖRKAN

    2017-01-01

    Evaluating quality of teaching is important in nearly every higher education institute. The most common way of assessing teaching effectiveness takes place through students. Student Evaluation of Teaching (SET) is used to gather information about students’ experiences with a course and instructor’s performance at some point of semester. SET can be considered as a type of rater mediated performance assessment where students are the raters and instructors are the examinees. When performance as...

  11. Rasch-Master's Partial Credit Model in the assessment of children's creativity in drawings.

    Science.gov (United States)

    Nakano, Tatiana de Cássia; Primi, Ricardo

    2014-01-01

    The purpose of the present study was to use the Partial Credit Model to study the factors of the Test of Creativity in Children and identify which characteristics of the creative person would be more effective to differentiate subjects according to their ability level. A sample of 1426 students from first to eighth grades answered the instrument. The Partial Credits model was used to estimate the ability of the subjects and item difficulties on a common scale for each of the four factors, indicating which items required a higher level of creativity to be scored and will differentiate the more creative individuals. The results demonstrated that the greater part of the characteristics showed good fit indices, with values between 0.80 and 1.30 both infit and outfit, indicating a response pattern consistent with the model. The characteristics of Unusual Perspective, Expression of Emotion and Originality have been identified as better predictors of creative performance because requires greater ability level (usually above two standard deviation). These results may be used in the future development of an instrument's reduced form or simplification of the current correction model.

  12. Cross-cultural validity of the ABILOCO questionnaire for individuals with stroke, based on Rasch analysis.

    Science.gov (United States)

    Avelino, Patrick Roberto; Magalhães, Lívia Castro; Faria-Fortini, Iza; Basílio, Marluce Lopes; Menezes, Kênia Kiefer Parreiras; Teixeira-Salmela, Luci Fuscaldi

    2018-06-01

    The purpose of this study was to evaluate the cross-cultural validity of the Brazilian version of the ABILOCO questionnaire for stroke subjects. Cross-cultural adaptation of the original English version of the ABILOCO to the Brazilian-Portuguese language followed standardized procedures. The adapted version was administered to 136 stroke subjects and its measurement properties were assessed using Rash analysis. Cross-cultural validity was based on cultural invariance analyses. Goodness-of-fit analysis revealed one misfitting item. The principal component analysis of the residuals showed that the first dimension explained 45% of the variance in locomotion ability; however, the eigenvalue was 1.92. The ABILOCO-Brazil divided the sample into two levels of ability and the items into about seven levels of difficulty. The item-person map showed some ceiling effect. Cultural invariance analyses revealed that although there were differences in the item calibrations between the ABILOCO-original and ABILOCO-Brazil, they did not impact the measures of locomotion ability. The ABILOCO-Brazil demonstrated satisfactory measurement properties to be used within both clinical and research contexts in Brazil, as well cross-cultural validity to be used in international/multicentric studies. However, the presence of ceiling effect suggests that it may not be appropriate for the assessment of individuals with high levels of locomotion ability. Implications for rehabilitation Self-report measures of locomotion ability are clinically important, since they describe the abilities of the individuals within real life contexts. The ABILOCO questionnaire, specific for stroke survivors, demonstrated satisfactory measurement properties, but may not be most appropriate to assess individuals with high levels of locomotion ability The results of the cross-cultural validity showed that the ABILOCO-Original and the ABILOCO-Brazil calibrations may be used interchangeable.

  13. A developmental screening tool for toddlers with multiple domains based on Rasch analysis

    Directory of Open Access Journals (Sweden)

    Ai-Wen Hwang

    2015-01-01

    Conclusion: MuSiC can be applied simultaneously to well-child care visits as a universal screening tool for children aged 1–3 years on multiple domains. Items with sound validity for infants need to be further developed.

  14. Mixing Interviews and Rasch Modeling: Demonstrating a Procedure Used to Develop an Instrument That Measures Trust

    Science.gov (United States)

    David, Shannon L.; Hitchcock, John H.; Ragan, Brian; Brooks, Gordon; Starkey, Chad

    2018-01-01

    Developing psychometrically sound instruments can be difficult, especially if little is known about the constructs of interest. When constructs of interest are unclear, a mixed methods approach can be useful. Qualitative inquiry can be used to explore a construct's meaning in a way that informs item writing and allows the strengths of one analysis…

  15. Ordering individuals with sum scores: the introduction of the nonparametric Rasch model

    NARCIS (Netherlands)

    Zwitser, R.J.; Maris, G.

    2016-01-01

    When a simple sum or number-correct score is used to evaluate the ability of individual testees, then, from an accountability perspective, the inferences based on the sum score should be the same as the inferences based on the complete response pattern. This requirement is fulfilled if the sum score

  16. Using Rasch Measurement for the Development and Use of Affective Assessments in Science Education Research

    Science.gov (United States)

    Sondergeld, Toni A.; Johnson, Carla C.

    2014-01-01

    With the demand for quality quantitative instruments in the field of science education rising, additional measures of currently unassessed affective variables need to be constructed. In this study, we discuss the survey creation and evaluation process of the STEM Awareness Community Survey (SACS) through an application of Liu's (Liu, X.,…

  17. Identifying Professional Teaching Standards Using Rasch Model Analysis: The Case of Northern Cyprus

    Science.gov (United States)

    Alibaba Erden, Hale; Özer, Bekir

    2013-01-01

    Problem Statement: The Teacher's-Act defined for the state-school teachers of North Cyprus shows that teachers are not selected according to any specific standards. In North Cyprus, apart from the exam topics defined at the teacher's exam regulations, there is not any kind of identified standard for teachers. Training qualified teachers based upon…

  18. Developing a fluid intelligence scale through a combination of Rasch modeling and cognitive psychology.

    Science.gov (United States)

    Primi, Ricardo

    2014-09-01

    Ability testing has been criticized because understanding of the construct being assessed is incomplete and because the testing has not yet been satisfactorily improved in accordance with new knowledge from cognitive psychology. This article contributes to the solution of this problem through the application of item response theory and Susan Embretson's cognitive design system for test development in the development of a fluid intelligence scale. This study is based on findings from cognitive psychology; instead of focusing on the development of a test, it focuses on the definition of a variable for the creation of a criterion-referenced measure for fluid intelligence. A geometric matrix item bank with 26 items was analyzed with data from 2,797 undergraduate students. The main result was a criterion-referenced scale that was based on information from item features that were linked to cognitive components, such as storage capacity, goal management, and abstraction; this information was used to create the descriptions of selected levels of a fluid intelligence scale. The scale proposed that the levels of fluid intelligence range from the ability to solve problems containing a limited number of bits of information with obvious relationships through the ability to solve problems that involve abstract relationships under conditions that are confounded with an information overload and distraction by mixed noise. This scale can be employed in future research to provide interpretations for the measurements of the cognitive processes mastered and the types of difficulty experienced by examinees. PsycINFO Database Record (c) 2014 APA, all rights reserved.

  19. Assessing and quantifying inter-rater variation for dichotomous ratings using a Rasch model

    DEFF Research Database (Denmark)

    Petersen, Jørgen Holm; Larsen, Klaus; Kreiner, Svend

    2010-01-01

    quantifying the rater variation as a suitable measure of the variation of the rater odds ratios. An important example that will serve to motivate and illustrate the proposed model, is the study of Umbilical artery Doppler velocimetry used by obstetricians to assess the status of a foetus. The purpose...... of the assessment is to improve the foetus' chance of survival by choosing the optimal time of elective delivery. In the study, data related to 139 perinatal deaths were sent to 32 experts who were asked whether the use of Doppler velocimetry might have prevented each death....

  20. Effective user interface designs to increase energy-efficient behavior in a Rasch-based energy recommender system

    NARCIS (Netherlands)

    Starke, A.D.; Willemsen, M.C.; Snijders, C.C.P.

    People often struggle to find appropriate energy-saving measures to take in the household. Although recommender studies show that tailoring a system's interaction method to the domain knowledge of the user can increase energy savings, they did not actually tailor the conservation advice itself. We

  1. Rasch measurement analysis of the Mayo-Portland Adaptability Inventory (MPAI-4) in a community-based rehabilitation sample.

    Science.gov (United States)

    Kean, Jacob; Malec, James F; Altman, Irwin M; Swick, Shannon

    2011-05-01

    The precise measurement of patient outcomes depends upon clearly articulated constructs and refined clinical assessment instruments that work equally well for all subgroups within a population. This is a challenging task in those with acquired brain injury (ABI) because of the marked heterogeneity of the disorder and subsequent outcomes. Although essential, the iterative process of instrument refinement is often neglected. This present study was undertaken to examine validity, reliability, dimensionality and item estimate invariance of the Mayo-Portland Adaptability Inventory - 4 (MPAI-4), an outcome measure for persons with ABI. The sampled population included 603 persons with traumatic ABI participating in a home- and community-based rehabilitation program. Results indicated that the MPAI-4 is a valid, reliable measure of outcome following traumatic ABI, which measures a broad but unitary core construct of outcome after ABI. Further, the MPAI-4 is composed of items that are unbiased toward selected subgroups except where differences could be expected [e.g., more chronic traumatic brain injury (TBI) patients are better able to negotiate demands of transportation than more acute TBI patients]. We address the trade-offs between strict unidimensionality and clinical applicability in measuring outcome, and illustrate the advantages and disadvantages of applying single-parameter measurement models to broad constructs.

  2. Rasch Measurement Analysis of the Mayo-Portland Adaptability Inventory (MPAI-4) in a Community-Based Rehabilitation Sample

    OpenAIRE

    Kean, Jacob; Malec, James F.; Altman, Irwin M.; Swick, Shannon

    2011-01-01

    The precise measurement of patient outcomes depends upon clearly articulated constructs and refined clinical assessment instruments that work equally well for all subgroups within a population. This is a challenging task in those with acquired brain injury (ABI) because of the marked heterogeneity of the disorder and subsequent outcomes. Alhough essential, the iterative process of instrument refinement is often neglected. This present study was undertaken to examine validity, reliability, dim...

  3. Developing an Instrument for Teacher Feedback : Using the Rasch Model to Explore Teachers' Development of Effective Teaching Strategies and Behaviors

    NARCIS (Netherlands)

    van der Lans, Rikkert; van de Grift, Wim; van Veen, Klaas

    This study connects descriptions of effective teaching with descriptions of teacher development to advance an initial understanding of how effective teaching may develop. The study's main premise is that descriptions of effective teaching develop cumulatively where more basic teaching strategies and

  4. Hermen Rode - Bernt Notke kaasaegne ja tema konkurent? / Anja Rasche ; tõlkinud Anu Mänd

    Index Scriptorium Estoniae

    Rasche, Anja, 1967-

    2009-01-01

    Maalikunstnik Hermen Rode ning maalikunstnik ja puunikerdaja Bernt Notke töötasid üle 30 aasta Lübeckis, kuulusid maalijate ja klaasijate tsunfti. Kokkulangevustest ja erinevustest kahe töökoja loomingus. Lübecki maalijate ja klaasijate tsunfti Püha Luuka altarist (Hermen Rode töökoda, 1484). Lühendatud versioon ettekandest Tallinnas 10.-12. 09. 2009 toimunud konverentsil "Kunst, mälu ja patronaaž: Läänemere ruumi visuaalkultuur Bernt Notke ajal"

  5. Mini-Mental Status Examination: mixed Rasch model item analysis derived two different cognitive dimensions of the MMSE

    DEFF Research Database (Denmark)

    Schultz-Larsen, Kirsten; Kreiner, Svend; Lomholt, Rikke Kirstine

    2006-01-01

    from those obtained in previous studies, were derived. The corresponding sum scales were (1) age-correlated MMSE scale (A-MMSE scale: orientation to time, attention/calculation, naming, repetition, and three-stage command) and (2) non-age-correlated MMSE scale (B-MMSE scale: orientation to place...

  6. Low Back Pain in 17 Countries, a Rasch Analysis of the ICF Core Set for Low Back Pain

    Science.gov (United States)

    Roe, Cecilie; Bautz-Holter, Erik; Cieza, Alarcos

    2013-01-01

    Previous studies indicate that a worldwide measurement tool may be developed based on the International Classification of Functioning Disability and Health (ICF) Core Sets for chronic conditions. The aim of the present study was to explore the possibility of constructing a cross-cultural measurement of functioning for patients with low back pain…

  7. A Mixture Rasch Model with a Covariate: A Simulation Study via Bayesian Markov Chain Monte Carlo Estimation

    Science.gov (United States)

    Dai, Yunyun

    2013-01-01

    Mixtures of item response theory (IRT) models have been proposed as a technique to explore response patterns in test data related to cognitive strategies, instructional sensitivity, and differential item functioning (DIF). Estimation proves challenging due to difficulties in identification and questions of effect size needed to recover underlying…

  8. Challenges to Measuring Chinese Students' Perceptions of Freedom of Expression: An Application of Rasch Analysis

    Science.gov (United States)

    Qin, Lixia; Torres, Mario

    2018-01-01

    Rapid social development and recent changes in views concerning childhood have urged a more holistic approach to measuring children's well-being, particularly in the domain of rights. In light of articulated provisions within the United Nations Convention on the Rights of the Child, there is obvious interest in understanding more about how…

  9. Students' Use of Decision-Making Strategies with Regard to Socioscientific Issues: An Application of the Rasch Partial Credit Model

    Science.gov (United States)

    Eggert, Sabina; Bogeholz, Susanne

    2010-01-01

    Decision making about socioscientific issues is an important aspect of modern science education worldwide. Among the many topics that represent socioscientific issues, issues relating to the sustainable development of our environment are one crucial topic. However, difficulties exist with respect to the assessment of teaching outcomes related to…

  10. The Development of a Secondary-Level Solo Wind Instrument Performance Rubric Using the Multifaceted Rasch Partial Credit Measurement Model

    Science.gov (United States)

    Wesolowski, Brian C.; Amend, Ross M.; Barnstead, Thomas S.; Edwards, Andrew S.; Everhart, Matthew; Goins, Quentin R.; Grogan, Robert J., III; Herceg, Amanda M.; Jenkins, S. Ira; Johns, Paul M.; McCarver, Christopher J.; Schaps, Robin E.; Sorrell, Gary W.; Williams, Jonathan D.

    2017-01-01

    The purpose of this study was to describe the development of a valid and reliable rubric to assess secondary-level solo instrumental music performance based on principles of invariant measurement. The research questions that guided this study included (1) What is the psychometric quality (i.e., validity, reliability, and precision) of a scale…

  11. Differential item functional analysis on pedagogic and content knowledge (PCK) questionnaire for Indonesian teachers using RASCH model

    Science.gov (United States)

    Rahmani, B. D.

    2018-01-01

    The purpose of this paper is to evaluate Indonesian senior high school teacher’s pedagogical content knowledge also their perception toward curriculum changing in West Java Indonesia. The data used in this study were derived from a questionnaire survey conducted among teachers in Bandung, West Java. A total of 61 usable responses were collected. The Differential Item Functioning (DIFF) was used to analyze the data whether the item had a difference or not toward gender, education background also on school location. However, the result showed that there was no any significant difference on gender and school location toward the item response but educational background. As a conclusion, the teacher’s educational background influence on giving the response to the questionnaire. Therefore, it is suggested in the future to construct the items on the questionnaire which is coped the differences of the participant particularly the educational background.

  12. An Investigation of Students' Perceptions of Learning Benefits of Weblogs in an East Asian Context: A Rasch Analysis

    Science.gov (United States)

    Goh, Jonathan W. P.; Quek, Chin Joo; Lee, Ong Kim

    2010-01-01

    In the 1980s we witnessed the dawning of the "Information Age". Today, the use of information technology has become an integral part of our lives. Education is no exception. With the introduction of Web 2.0 tools such as weblogs, students are presented a new platform for interaction and exchanging ideas. A review of the literature…

  13. Seeking Missing Pieces in Science Concept Assessments: Reevaluating the Brief Electricity and Magnetism Assessment through Rasch Analysis

    Science.gov (United States)

    Ding, Lin

    2014-01-01

    Discipline-based science concept assessments are powerful tools to measure learners' disciplinary core ideas. Among many such assessments, the Brief Electricity and Magnetism Assessment (BEMA) has been broadly used to gauge student conceptions of key electricity and magnetism (E&M) topics in college-level introductory physics courses.…

  14. Initial Development of the Teen Screen for Dating Violence: Exploratory Factor Analysis, Rasch Model, and Psychometric Data

    Science.gov (United States)

    Emelianchik-Key, Kelly; Hays, Danica G.; Hill, Tara

    2018-01-01

    The Teen Screen for Dating Violence (TSDV) is an assessment that examines adolescent dating violence perpetration and victimization, perception and exposure to violence, and support systems. Through assessment, adolescents who are at high risk could be identified for prevention and early intervention. This article presents the development,…

  15. Development of a Short-Form Measure of Science and Technology Self-efficacy Using Rasch Analysis

    Science.gov (United States)

    Lamb, Richard L.; Vallett, David; Annetta, Leonard

    2014-10-01

    Despite an increased focus on science, technology, engineering, and mathematics (STEM) in U.S. schools, today's students often struggle to maintain adequate performance in these fields compared with students in other countries (Cheek in Thinking constructively about science, technology, and society education. State University of New York, Albany, 1992; Enyedy and Goldberg 2004; Mandinach and Lewis 2006). In addition, despite considerable pressure to promote the placement of students into STEM career fields, U.S. placement is relatively low (Sadler et al. in Sci Educ 96(3):411-427, 2012; Subotnik et al. in Identifying and developing talent in science, technology, engineering, and mathematics (STEM): an agenda for research, policy and practice. International handbook, part XII, pp 1313-1326, 2009). One explanation for the decline of STEM career placement in the U.S. rests with low student affect concerning STEM concepts and related content, especially in terms of self-efficacy. Researchers define self-efficacy as the internal belief that a student can succeed in learning, and that understanding student success lies in students' externalized actions or behaviors (Bandura in Psychol Rev 84(2):191-215, 1977). Evidence suggests that high self-efficacy in STEM can result in student selection of STEM in later educational endeavors, culminating in STEM career selection (Zeldin et al. in J Res Sci Teach 45(9):1036-1058, 2007). However, other factors such as proficiency play a role as well. The lack of appropriate measures of self-efficacy can greatly affect STEM career selection due to inadequate targeting of this affective trait and loss of opportunity for early intervention by educators. Lack of early intervention decreases selection of STEM courses and careers (Valla and Williams in J Women Minor Sci Eng 18(1), 2012; Lent et al. in J Couns Psychol 38(4), 1991). Therefore, this study developed a short-form measure of self-efficacy to help identify students in need of intervention.

  16. Clinical applications of single photon emission tomography in neuromedicine. Pt. 2. Dementia, psychotic disorders, inflammation, trauma; Klinische Anwendungen der Single-Photon-Emissionstomographie in der Neuromedizin. T. 2. Dementielle Erkrankungen, Psychosen, Entzuendungen, Schaedelhirntrauma

    Energy Technology Data Exchange (ETDEWEB)

    Bartenstein, P.; Gruenwald, F.; Kuwert, T.; Tatsch, K.; Sabri, O.; Benkert, O.; Fahlbusch, R.; Gruender, G.; Herholz, K.; Weiller, C. [Mainz Univ. (Germany). Klinik und Poliklinik fuer Nuklearmedizin

    2000-12-01

    This article gives in his second part a critical review of the clinical applications of SPECT with perfusion markers and receptor ligands in dementing disorders and psychosis. In addition this review discusses clinical applications of SPECT investigations with perfusion markers in inflammatory diseases of the central nervous system and in brain trauma. (orig.) [German] Die vorliegende Arbeit vermittelt in ihrem zweiten Teil eine kritisch wertende Uebersicht ueber die klinischen Anwendungsmoeglichkeiten von SPECT-Untersuchungen mit Perfusionsmarkern und Rezeptorliganden bei dementiellen Erkrankungen sowie affektiven und schizophrenen Psychosen. Darueber hinaus werden in dieser Uebersicht Anwendungen von SPECT-Untersuchungen mit Perfusionsmarkern bei Fragestellungen im Rahmen von Entzuendungen des zentralen Nervensystems und bei Schaedelhirntraumata diskutiert. (orig.)

  17. Developing an Instrument for Teacher Feedback: Using the Rasch Model to Explore Teachers' Development of Effective Teaching Strategies and Behaviors

    Science.gov (United States)

    van der Lans, Rikkert M.; van de Grift, Wim J. C. M.; van Veen, K.

    2018-01-01

    This study connects descriptions of effective teaching with descriptions of teacher development to advance an initial understanding of how effective teaching may develop. The study's main premise is that descriptions of effective teaching develop cumulatively where more basic teaching strategies and behaviors are required before teachers may…

  18. Toward Improving Food Safety in the Domestic Environment: A Multi-Item Rasch Scale for the Measurement of the Safety Efficacy of Domestic Food-Handling Practices

    NARCIS (Netherlands)

    Fischer, A.R.H.; Frewer, L.J.; Nauta, M.J.

    2006-01-01

    To reduce consumer health risks from foodborne diseases that result from improper domestic food handling, consumers need to know how to safely handle food. To realize improvements in public health, it is necessary to develop interventions that match the needs of individual consumers. Successful

  19. Mapping Self-Confidence Levels of Nurses in Their Provision of Nursing Care to Others with Alcohol and Tobacco Dependence, Using Rasch Scaling

    Science.gov (United States)

    Blackman, Ian; de Crespigny, Charlotte; Parker, Steve

    2006-01-01

    This study seeks to identify factors that influence the perceived complexity of providing nursing care to others (who are dependent on alcohol and tobacco) and the confidence of undergraduate student nurses to carry out this care. The research project is designed to explore whether there is a difference between the perceived complexities of 57…

  20. Exploring Differential Item Functioning (DIF) with the Rasch Model: A Comparison of Gender Differences on Eighth Grade Science Items in the United States and Spain

    Science.gov (United States)

    Babiar, Tasha Calvert

    2011-01-01

    Traditionally, women and minorities have not been fully represented in science and engineering. Numerous studies have attributed these differences to gaps in science achievement as measured by various standardized tests. Rather than describe mean group differences in science achievement across multiple cultures, this study focused on an in-depth…

  1. Item analysis using Rasch models confirms that the Danish versions of the DISABKIDS (R) chronic-generic and diabetes-specific modules are valid and reliable

    DEFF Research Database (Denmark)

    Nielsen, Julie Bøjstrup; Kyvsgaard, Julie Nyholm; Sildorf, Stine Møller

    2017-01-01

    Background: Type 1 Diabetes (T1D) has a negative impact on psychological and overall well-being. Screening for Health-related Quality of Life (HrQoL) and addressing HrQoL issues in the clinic leads to improved well-being and metabolic outcomes. The aim of this study was to translate the generic a...

  2. Random Forest as an Imputation Method for Education and Psychology Research: Its Impact on Item Fit and Difficulty of the Rasch Model

    Science.gov (United States)

    Golino, Hudson F.; Gomes, Cristiano M. A.

    2016-01-01

    This paper presents a non-parametric imputation technique, named random forest, from the machine learning field. The random forest procedure has two main tuning parameters: the number of trees grown in the prediction and the number of predictors used. Fifty experimental conditions were created in the imputation procedure, with different…

  3. Rasch analysis of the Persian version of PedsQLTM Oral Health Scale: further psychometric evaluation on item validity including differential item functioning

    Directory of Open Access Journals (Sweden)

    Chung-Ying Lin

    2016-08-01

    Conclusion: PedsQL Oral Health Scale is a valid instrument to measure OHRQoL. However,our results indicated that the parent-proxy report was inferior to the student self-report, and healthcare providers should primarily use the student self-report.

  4. Use of the Rasch Measurement Model to Explore the Relationship between Content Knowledge and Topic-Specific Pedagogical Content Knowledge for Organic Chemistry

    Science.gov (United States)

    Davidowitz, Bette; Potgieter, Marietjie

    2016-01-01

    Research has shown that a high level of content knowledge (CK) is necessary but not sufficient to develop the special knowledge base of expert teachers known as pedagogical content knowledge (PCK). This study contributes towards research to quantify the relationship between CK and PCK in science. In order to determine the proportion of the…

  5. Reducing the item number to obtain the same-length self-assessment scales: a systematic approach using result of graphical loglinear rasch models

    DEFF Research Database (Denmark)

    Nielsen, Tine; Kreiner, Svend

    2011-01-01

    The Revised Danish Learning Styles Inventory (R-D-LSI) (Nielsen 2005), which is an adaptation of Sternberg- Wagner Thinking Styles Inventory (Sternberg, 1997), comprises 14 subscales, each measuring a separate learning style. Of these 14 subscales, 9 are eight items long and 5 are seven items long...... Inventory (D-SA-LSI) comprising 14 subscales each with an item length of seven. The systematic approach to item reduction based on results of GLLRM will be presented and exemplified by its application to the R-D-LSI....

  6. Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: a study using Rasch analysis

    NARCIS (Netherlands)

    Dallmeijer, Annet J.; de Groot, Vincent; Roorda, Leo D.; Schepers, Vera P. M.; Lindeman, Eline; van den Berg, Leonard H.; Beelen, Anita; Dekker, Joost

    2007-01-01

    The aim of this study was to investigate unidimensionality and differential item functioning of the SF-36 physical functioning scale (PF10) in patients with various neurological disorders. Patients: Patients post-stroke (n = 198), with multiple sclerosis (n = 151) and amyotrophic lateral sclerosis

  7. How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-Fit Statistics in Categorical Data Analysis

    Science.gov (United States)

    Maydeu-Olivares, Alberto; Montano, Rosa

    2013-01-01

    We investigate the performance of three statistics, R [subscript 1], R [subscript 2] (Glas in "Psychometrika" 53:525-546, 1988), and M [subscript 2] (Maydeu-Olivares & Joe in "J. Am. Stat. Assoc." 100:1009-1020, 2005, "Psychometrika" 71:713-732, 2006) to assess the overall fit of a one-parameter logistic model…

  8. Comparison of proficiency in an anesthesiology course across distinct medical student cohorts: Psychometric approaches to test equating

    Directory of Open Access Journals (Sweden)

    Shu-Wei Liao

    2014-03-01

    Conclusion: Although both the chained linear equating method and Rasch analysis can be readily applied to practical test-equating issues in medical education, Rasch analysis exhibited more versatility in test parameter estimation and item bank development for clinical curriculums.

  9. Separating models, ideas, and data to avoid a paradox : Rejoinder to Humphry

    NARCIS (Netherlands)

    Sijtsma, K.; Emons, W.H.M.

    2013-01-01

    This article is a rejoinder to Humphry’s (2013) comment on Sijtsma (2012). Sijtsma argued that the Rasch paradox does not exist but Humphry replies that the Rasch paradox can occur provided the measurement procedure is precise enough. The rejoinder argues that the debates about the Rasch paradox

  10. Comparison is key.

    Science.gov (United States)

    Stone, Mark H; Stenner, A Jackson

    2014-01-01

    Several concepts from Georg Rasch's last papers are discussed. The key one is comparison because Rasch considered the method of comparison fundamental to science. From the role of comparison stems scientific inference made operational by a properly developed frame of reference producing specific objectivity. The exact specifications Rasch outlined for making comparisons are explicated from quotes, and the role of causality derived from making comparisons is also examined. Understanding causality has implications for what can and cannot be produced via Rasch measurement. His simple examples were instructive, but the implications are far reaching upon first establishing the key role of comparison.

  11. Local Equating Using the Rasch Model, the OPLM, and the 2PL IRT Model--or--What Is It Anyway if the Model Captures Everything There Is to Know about the Test Takers?

    Science.gov (United States)

    von Davier, Matthias; González B., Jorge; von Davier, Alina A.

    2013-01-01

    Local equating (LE) is based on Lord's criterion of equity. It defines a family of true transformations that aim at the ideal of equitable equating. van der Linden (this issue) offers a detailed discussion of common issues in observed-score equating relative to this local approach. By assuming an underlying item response theory model, one of…

  12. Validation of the Dutch version of the Swallowing Quality-of-Life Questionnaire (DSWAL-QoL) and the adjusted DSWAL-QoL (aDSWAL-QoL) using item analysis with the Rasch model

    DEFF Research Database (Denmark)

    Simpelaere, Ingeborg S.; Van Nuffelen, Gwen; De Bodt, Marc

    2017-01-01

    Background The Swallowing Quality-of-Life Questionnaire (SWAL-QoL) is considered the gold standard for assessing health-related QoL in oropharyngeal dysphagia. The Dutch translation (DSWAL-QoL) and its adjusted version (aDSWAL-QoL) have been validated using classical test theory (CTT). However...

  13. Comparative Study of Middle School Students' Attitudes towards Science: Rasch Analysis of Entire TIMSS 2011 Attitudinal Data for England, Singapore and the U.S.A. as Well as Psychometric Properties of Attitudes Scale

    Science.gov (United States)

    Oon, Pey Tee; Subramaniam, R.

    2018-01-01

    We report here on a comparative study of middle school students' attitudes towards science involving three countries: England, Singapore and the U.S.A. Complete attitudinal data sets from TIMSS (Trends in International Mathematics and Science Study) 2011 were used, thus giving a very large sample size (N = 20,246), compared to other studies in the…

  14. "The Role of the Unit in Physics and Psychometrics" by Stephen Humphry--One Small Step for the Rasch Model, but Possibly One Giant Leap for Measurement in the Social Sciences

    Science.gov (United States)

    Salzberger, Thomas

    2011-01-01

    Compared to traditional test theory, where person measures are typically referenced to the distribution of a population, item response theory allows for a much more meaningful interpretation of measures as they can be directly compared to item locations. However, Stephen Humphry shows that the crucial role of the unit of measurement has been…

  15. Development and Application of a Novel Rasch-Based Methodology for Evaluating Multi-Tiered Assessment Instruments: Validation and Utilization of an Undergraduate Diagnostic Test of the Water Cycle

    Science.gov (United States)

    Romine, William L.; Schaffer, Dane L.; Barrow, Lloyd

    2015-01-01

    We describe the development and validation of a three-tiered diagnostic test of the water cycle (DTWC) and use it to evaluate the impact of prior learning experiences on undergraduates' misconceptions. While most approaches to instrument validation take a positivist perspective using singular criteria such as reliability and fit with a measurement…

  16. Judging Anomalies at the 2010 Olympics in Men's Figure Skating

    Science.gov (United States)

    Looney, Marilyn A.

    2012-01-01

    The purpose of this study was to determine if the 2010 Olympic figure skating judges had trouble scoring Plushenko and the transitions program component, and if the International Skating Union's (ISU) "corridor" method flagged the same judging anomalies as the Rasch analyses. A 3-facet (skater by program component by judge) Rasch rating…

  17. Linear Logistic Test Modeling with R

    Science.gov (United States)

    Baghaei, Purya; Kubinger, Klaus D.

    2015-01-01

    The present paper gives a general introduction to the linear logistic test model (Fischer, 1973), an extension of the Rasch model with linear constraints on item parameters, along with eRm (an R package to estimate different types of Rasch models; Mair, Hatzinger, & Mair, 2014) functions to estimate the model and interpret its parameters. The…

  18. Comparison of scoring approaches for the NEI VFQ-25 in low vision.

    Science.gov (United States)

    Dougherty, Bradley E; Bullimore, Mark A

    2010-08-01

    The aim of this study was to evaluate different approaches to scoring the National Eye Institute Visual Functioning Questionnaire-25 (NEI VFQ-25) in patients with low vision including scoring by the standard method, by Rasch analysis, and by use of an algorithm created by Massof to approximate Rasch person measure. Subscale validity and use of a 7-item short form instrument proposed by Ryan et al. were also investigated. NEI VFQ-25 data from 50 patients with low vision were analyzed using the standard method of summing Likert-type scores and calculating an overall average, Rasch analysis using Winsteps software, and the Massof algorithm in Excel. Correlations between scores were calculated. Rasch person separation reliability and other indicators were calculated to determine the validity of the subscales and of the 7-item instrument. Scores calculated using all three methods were highly correlated, but evidence of floor and ceiling effects was found with the standard scoring method. None of the subscales investigated proved valid. The 7-item instrument showed acceptable person separation reliability and good targeting and item performance. Although standard scores and Rasch scores are highly correlated, Rasch analysis has the advantages of eliminating floor and ceiling effects and producing interval-scaled data. The Massof algorithm for approximation of the Rasch person measure performed well in this group of low-vision patients. The validity of the subscales VFQ-25 should be reconsidered.

  19. Pain-related Impairment of Daily Activities After Thoracic Surgery

    DEFF Research Database (Denmark)

    Ringsted, Thomas K; Wildgaard, Kim; Kreiner, Svend

    2013-01-01

    -specific questionnaire for assessment of functional impairment due to PTPS. METHODS:: Activities were obtained from the literature supplemented by interviews with patients and surgeons. The questionnaire was validated using the Rasch model in order to describe an underlying pain impairment scale. RESULTS:: Four of 17...... found. A generalized log-linear Rasch model including local dependence was constructed. Though local dependence influenced reliability, the test-retest reliability estimated under the log-linear Rasch model was high (0.88-0.96). Correlation with items from the Disability of the Arm, Shoulder and Hand...... (quick) questionnaire supported validity (γ=0.46, P...

  20. Application of the Korean version of the Modified Barthel Index: Development of a keyform for use in clinical practice

    Directory of Open Access Journals (Sweden)

    Ickpyo Hong

    2017-06-01

    Conclusions: The findings suggest that a Rasch keyform can be applied to clinical practice in Korean settings by identifying clinically and statistically meaningful test items and their step thresholds as short- and long-term goals.

  1. “Instructional Familiarity” and Discerning Authentic Learning

    African Journals Online (AJOL)

    2015 Annals of Medical and Health Sciences Research | Published by Wolters Kluwer - Medknow. Address for ..... regard to the discernment of authentic and artificial evidence .... Rasch G. Probabilistic Models for Some Intelligence and.

  2. Research Article Special Issue

    African Journals Online (AJOL)

    pc

    2018-02-24

    Feb 24, 2018 ... This is concordance with cognitive theory (Fosnot &. Perry, 1996) ..... The Psychology of Effective Learning and Teaching. Cheltenham: Nelson ... Harvey Goldstein's objections to Rasch measurement: A response from Linacre ...

  3. The construct validity of the Major Depression Inventory

    DEFF Research Database (Denmark)

    Nielsen, Marie Germund; Ørnbøl, Eva; Vestergaard, Mogens

    2017-01-01

    Objective We aimed to assess the measurement properties of the ten-item Major Depression Inventory when used on clinical suspicion in general practice by performing a Rasch analysis. Methods General practitioners asked consecutive persons to respond to the web-based Major Depression Inventory...... on clinical suspicion of depression. We included 22 practices and 245 persons. Rasch analysis was performed using RUMM2030 software. The Rasch model fit suggests that all items contribute to a single underlying trait (defined as internal construct validity). Mokken analysis was used to test dimensionality...... for gender, age, work status and education. The Rasch and Mokken analyses revealed two dimensions, but the Major Depression Inventory showed fit to one scale if items 9 and 10 were excluded. Conclusion Our study indicated scalability problems in the current version of the Major Depression Inventory...

  4. An Introduction to the Partial Credit Model for Developing Nursing Assessments.

    Science.gov (United States)

    Fox, Christine

    1999-01-01

    Demonstrates how the partial credit model, a variation of the Rasch Measurement Model, can be used to develop performance-based assessments for nursing education. Applies the model using the Practical Knowledge Inventory for Nurses. (SK)

  5. Accounting for standard errors of vision-specific latent trait in regression models.

    Science.gov (United States)

    Wong, Wan Ling; Li, Xiang; Li, Jialiang; Wong, Tien Yin; Cheng, Ching-Yu; Lamoureux, Ecosse L

    2014-07-11

    To demonstrate the effectiveness of Hierarchical Bayesian (HB) approach in a modeling framework for association effects that accounts for SEs of vision-specific latent traits assessed using Rasch analysis. A systematic literature review was conducted in four major ophthalmic journals to evaluate Rasch analysis performed on vision-specific instruments. The HB approach was used to synthesize the Rasch model and multiple linear regression model for the assessment of the association effects related to vision-specific latent traits. The effectiveness of this novel HB one-stage "joint-analysis" approach allows all model parameters to be estimated simultaneously and was compared with the frequently used two-stage "separate-analysis" approach in our simulation study (Rasch analysis followed by traditional statistical analyses without adjustment for SE of latent trait). Sixty-six reviewed articles performed evaluation and validation of vision-specific instruments using Rasch analysis, and 86.4% (n = 57) performed further statistical analyses on the Rasch-scaled data using traditional statistical methods; none took into consideration SEs of the estimated Rasch-scaled scores. The two models on real data differed for effect size estimations and the identification of "independent risk factors." Simulation results showed that our proposed HB one-stage "joint-analysis" approach produces greater accuracy (average of 5-fold decrease in bias) with comparable power and precision in estimation of associations when compared with the frequently used two-stage "separate-analysis" procedure despite accounting for greater uncertainty due to the latent trait. Patient-reported data, using Rasch analysis techniques, do not take into account the SE of latent trait in association analyses. The HB one-stage "joint-analysis" is a better approach, producing accurate effect size estimations and information about the independent association of exposure variables with vision-specific latent traits

  6. Parametric analyses of summative scores may lead to conflicting inferences when comparing groups: A simulation study.

    Science.gov (United States)

    Khan, Asaduzzaman; Chien, Chi-Wen; Bagraith, Karl S

    2015-04-01

    To investigate whether using a parametric statistic in comparing groups leads to different conclusions when using summative scores from rating scales compared with using their corresponding Rasch-based measures. A Monte Carlo simulation study was designed to examine between-group differences in the change scores derived from summative scores from rating scales, and those derived from their corresponding Rasch-based measures, using 1-way analysis of variance. The degree of inconsistency between the 2 scoring approaches (i.e. summative and Rasch-based) was examined, using varying sample sizes, scale difficulties and person ability conditions. This simulation study revealed scaling artefacts that could arise from using summative scores rather than Rasch-based measures for determining the changes between groups. The group differences in the change scores were statistically significant for summative scores under all test conditions and sample size scenarios. However, none of the group differences in the change scores were significant when using the corresponding Rasch-based measures. This study raises questions about the validity of the inference on group differences of summative score changes in parametric analyses. Moreover, it provides a rationale for the use of Rasch-based measures, which can allow valid parametric analyses of rating scale data.

  7. PET and SPECT investigations in Alzheimer's disease; Nuklearmedizin und Demenz - Anwendung bei Morbus Alzheimer

    Energy Technology Data Exchange (ETDEWEB)

    Asenbaum, S. [Universitaetsklinik fuer Nuklearmedizin, Universitaetsklinik fuer Neurologie, Wien (Austria); Abteilung fuer klinische Neurologie, Universitaetsklinik fuer Neurologie, Waehringer Guertel 18-20, 1090, Wien (Austria)

    2003-07-01

    Nuclear medicine offers a wide range of possibilities to investigate dementia. Various SPECT and PET tracers will be introduced in this article first. Different questions concerning evaluation of dementia are discussed taking Alzheimer's disease (AD) as an example. It is important to perform nuclear medicine investigations on high technical level, using standardized methods as statistical parametric mapping (SPM) for evaluation. If neuroprotective therapies are available, an early diagnosis, the determination of risk factors and longitudinal investigations will be the focus of interest and the main goal of nuclear medicine. Apart from measuring cerebral perfusion and glucose metabolism the development of new ligands, concerning the cholinergic system and the visualization of amyloid plaques, is of great importance. (orig.) [German] Nuklearmedizin bietet bei der Erfassung und Beurteilung eines dementiellen Prozesses eine Vielzahl von Untersuchungsmoeglichkeiten. Anhand des Morbus Alzheimer (DAT) werden in dem vorliegenden Artikel neben einer kurzen Schilderung der zur Verfuegung stehenden Methoden die verschiedenen nuklearmedizinisch relevante Fragestellungen angefuehrt, zu deren Beantwortung die funktionelle Bildgebung Informationen liefern kann. Durch den Einsatz bestimmter, standardisierter Auswerteverfahren wie statistical parametric mapping (SPM) ist es moeglich, entscheidende Hinweise zur Diagnose und Differenzialdiagnose der DAT zu erlangen. In Zukunft werden, insbesondere bei einer Verfuegbarkeit neuroprotektiver Therapien, eine moeglichst fruehe Diagnosestellung und die Erfassung von Risikofaktoren sowie die Moeglichkeit einer Verlaufsbeobachtung in den Mittelpunkt des Interesses und in das Zentrum nuklearmedizinischer Untersuchungen ruecken. Vor allem fuer diese Anforderungen ist neben der qualitaetsvollen Untersuchung von zerebraler Perfusion und Glukosestoffwechsel eine Weiterentwicklung spezieller Liganden v. a. das cholinerge System betreffend und

  8. Validity of the Neuromuscular Recovery Scale: a measurement model approach.

    Science.gov (United States)

    Velozo, Craig; Moorhouse, Michael; Ardolino, Elizabeth; Lorenz, Doug; Suter, Sarah; Basso, D Michele; Behrman, Andrea L

    2015-08-01

    To determine how well the Neuromuscular Recovery Scale (NRS) items fit the Rasch, 1-parameter, partial-credit measurement model. Confirmatory factor analysis (CFA) and principal components analysis (PCA) of residuals were used to determine dimensionality. The Rasch, 1-parameter, partial-credit rating scale model was used to determine rating scale structure, person/item fit, point-measure item correlations, item discrimination, and measurement precision. Seven NeuroRecovery Network clinical sites. Outpatients (N=188) with spinal cord injury. Not applicable. NRS. While the NRS met 1 of 3 CFA criteria, the PCA revealed that the Rasch measurement dimension explained 76.9% of the variance. Ten of 11 items and 91% of the patients fit the Rasch model, with 9 of 11 items showing high discrimination. Sixty-nine percent of the ratings met criteria. The items showed a logical item-difficulty order, with Stand retraining as the easiest item and Walking as the most challenging item. The NRS showed no ceiling or floor effects and separated the sample into almost 5 statistically distinct strata; individuals with an American Spinal Injury Association Impairment Scale (AIS) D classification showed the most ability, and those with an AIS A classification showed the least ability. Items not meeting the rating scale criteria appear to be related to the low frequency counts. The NRS met many of the Rasch model criteria for construct validity. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  9. Development of a Performance-Based Measure of Executive Functions in Patients with Schizophrenia.

    Directory of Open Access Journals (Sweden)

    En-Chi Chiu

    Full Text Available A performance-based measure for assessing executive functions (EF is useful to understand patients' real life performance of EF. This study aimed to develop a performance-based measure of executive functions (PEF based on the Lezak model and to examine psychometric properties (i.e., unidimensionality and reliability of the PEF using Rasch analysis in patients with schizophrenia. We developed the PEF in three phases: (1 designing the preliminary version of PEF; (2 consultation with experts, cognitive interviews with patients, and pilot tests on patients to revise the preliminary PEF; (3 establishment of the final version of the PEF and examination of unidimensionality and Rasch reliability. Two hundred patients were assessed using the revised PEF. After deleting items which did not satisfy the Rasch model's expectations, the final version of the PEF contained 1 practice item and 13 test items for assessing the four domains of EF (i.e., volition, planning, purposive action, and effective performance. For unidimensional and multidimensional Rasch analyses, the 4 domains showed good reliability (i.e., 0.77-0.85 and 0.87-0.90, respectively. Our results showed that the PEF had satisfactory unidimensionality and Rasch reliability. Therefore, clinicians and researchers could use the PEF to assess the four domains of EF in patients with schizophrenia.

  10. Psychometric Properties of the Inventário Dimensional Clínico da Personalidade (IDCP using the Rating Scale Model

    Directory of Open Access Journals (Sweden)

    Lucas de Francisco Carvalho

    2014-08-01

    Full Text Available The aim of this study was to evaluate the performance of the Dimensional Clinical Personality Inventory (DCPI using Rasch-based person and item analysis. 1281 participants were recruited, between 18 and 90 years of age (M=26.64; SD=8.94, 431 men (33.6%. Of the total sample, 127 (9.9% were patients diagnosed with axis I disorders and/or axis II according to DSM-IV-TR. Results indicated the IDCP scales performed reasonably well, and the usefulness of the analyses presented, demonstrates the Rasch model’s applicability for clinical applications. Among the important tools offered by the Rasch model, we explore the use of the person-item map, which visually presents the intuitively understandable psychological construct along the dimensional scale of the instrument.

  11. Creation of a community violence exposure scale: accounting for what, who, where, and how often.

    Science.gov (United States)

    Suglia, Shakira Franco; Ryan, Louise; Wright, Rosalind J

    2008-10-01

    Previous research has used the Rasch model, a method for obtaining a continuous scale from dichotomous survey items measuring a single latent construct, to create a scale of community violence exposure. The authors build upon previous work and describe the application of a Rasch model using the continuation ratio model to create an exposure to community violence (ETV) scale including event circumstance information previously shown to modify the impact of experienced events. They compare the Rasch ETV scale to a simpler sum ETV score, and estimate the effect of ETV on child posttraumatic stress symptoms. Incorporating detailed event circumstance information that is grounded in traumatic stress theory may reduce measurement error in the assessment of children's community violence exposure.

  12. The construct validity of the Perceived Stress Scale

    DEFF Research Database (Denmark)

    Germund Nielsen, Marie; Ørnbøl, Eva; Vestergaard, Mogens

    2016-01-01

    Objective: Stress impacts the quality of life and is associated with increased risk of mental and physical disorders. The Perceived Stress Scale (PSS) is widely used for measuring psychological distress. Although the instrument was originally defined as a single construct, several studies based...... of 32,374 citizens who completed the PSS-10 as part of the Danish National Health Survey in 2010. We investigated the construct validity of the PSS-10 by CFA. We examined the scalability by investigating the fit of the data distribution in a unidimensional Rasch model and performing modification...... of response categories, persons and items. The scale dimensionality was additionally assessed by Mokken and Rasch analysis.  Results: The PSS-10 did not fit the Rasch model. Item four indicated the largest misfit, and items four and seven displayed disordered thresholds. Unidimensionality could...

  13. Treatment of sleep disturbances in refugees suffering from post-traumatic stress disorder

    DEFF Research Database (Denmark)

    Sandahl, Hinuga; Vindbjerg, Erik; Carlsson, Jessica

    2017-01-01

    in treatment at the Competence Centre for Transcultural Psychiatry, Denmark, completed the Harvard Trauma Questionnaire (HTQ) before and after treatment. To determine item discrimination, the data was tested with a Rasch model. 99.1% reported trouble sleeping and 98.7% reported recurrent nightmares. The Rasch...... analysis displayed fit residuals of 0.05 for trouble sleeping and -1.16 for nightmares, indicating sufficient discrimination. Trouble sleeping and nightmares proved important parts of the HTQ response structure. This study indicates that sleep disturbances are a prominent part of the PTSD symptom structure...

  14. Modern psychometric approaches to analysis of scales for health-related quality of life

    DEFF Research Database (Denmark)

    Bjorner, Jakob Bue; Bech, Per

    2016-01-01

    In recent years, much effort has been invested in the development of new instruments for assessment of health-related quality of life (HRQOL). For many new instruments, modern psychometric methods, such as item response theory (IRT) models, have been used, either as supplemental to classical....... The models include Rasch models (Rasch 1980; Fischer and Molenaar 1995), other IRT models (Samejima 1969; van der Linden and Hambleton 1997), and factor analytic models for categorical data (Muthén 1984). “Modern” psychometric methods have actually a rather long history within psychiatric research (both...

  15. Further validation of the Danish version of the McGill Ingestive Skills Assessment (MISA-DK)

    DEFF Research Database (Denmark)

    Hansen, Tina

    2014-01-01

    Background/aims The McGill Ingestive Skill Assessment (MISA) for measuring dysphagic patients' functional performance during meals has been previously translated into Danish — the Danish McGill Ingestive Skill Assessment (MISA-DK) and this translated version validated. However, issues about......-DK was then tested using 102 videorecordings of geriatric patients' ingestive skill performance, and the data from the scale were examined using a second Rasch analysis. Results Initially, two of the six proposed subscales of the original MISA-DK failed to fit the Rasch model, and were removed. It was also necessary...

  16. Psychometric Properties of the COPD-Specific Beliefs About Medicine Questionnaire in an Outpatient Population

    DEFF Research Database (Denmark)

    Topp, Marie; Vestbo, Jørgen; Mortensen, Erik Lykke

    2016-01-01

    a Danish respiratory outpatient clinic. The Rasch model was used to evaluate psychometric characteristics of the BMQ-COPD and to obtain necessity and concerns scales fulfilling criteria of unidimensionality and overall fit, and with all items showing individual item fit with no local dependencies...

  17. Applying the Mixed Methods Instrument Development and Construct Validation Process: the Transformative Experience Questionnaire

    Science.gov (United States)

    Koskey, Kristin L. K.; Sondergeld, Toni A.; Stewart, Victoria C.; Pugh, Kevin J.

    2018-01-01

    Onwuegbuzie and colleagues proposed the Instrument Development and Construct Validation (IDCV) process as a mixed methods framework for creating and validating measures. Examples applying IDCV are lacking. We provide an illustrative case integrating the Rasch model and cognitive interviews applied to the development of the Transformative…

  18. The effect of differential motivation on IRT linking

    NARCIS (Netherlands)

    Mittelhaëuser, M.A.; Béguin, A.A.; Sijtsma, K.

    2015-01-01

    The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of

  19. Effects of Strength of Accent on an L2 Interactive Lecture Listening Comprehension Test

    Science.gov (United States)

    Ockey, Gary J.; Papageorgiou, Spiros; French, Robert

    2016-01-01

    This article reports on a study which aimed to determine the effect of strength of accent on listening comprehension of interactive lectures. Test takers (N = 21,726) listened to an interactive lecture given by one of nine speakers and responded to six comprehension items. The test taker responses were analyzed with the Rasch computer program…

  20. The Detection and Correction of Bias in Student Ratings of Instruction.

    Science.gov (United States)

    Haladyna, Thomas; Hess, Robert K.

    1994-01-01

    A Rasch model was used to detect and correct bias in Likert rating scales used to assess student perceptions of college teaching, using a database of ratings. Statistical corrections were significant, supporting the model's potential utility. Recommendations are made for a theoretical rationale and further research on the model. (Author/MSE)

  1. Predicting Teachers' Intentions to Implement School-Based Assessment Using the Theory of Planned Behaviour

    Science.gov (United States)

    Yan, Zi

    2014-01-01

    The theory of planned behaviour (TPB) was used to explore the Hong Kong teachers' intentions to implement school-based assessment (SBA) and the predictors of those intentions. A total of 280 teachers from Hong Kong secondary schools who had been involved in SBA were surveyed. Rasch-calibrated teacher measures were calculated for each of the 6…

  2. Development of a written assessment for a national interprofessional cardiotocography education program

    DEFF Research Database (Denmark)

    Thellesen, Line; Bergholt, Thomas; Hedegaard, Morten

    2017-01-01

    course participants n = 1679). RESULTS: The final test included 30 items and the passing score was established at 25 correct answers. All items fitted a loglinear Rasch model and the test was able to discriminate levels of competence. Seven items revealed differential item functioning in relation...

  3. Back pain and social isolation: Cross-sectional validation of the Friendship Scale for use in studies of low back pain

    DEFF Research Database (Denmark)

    Hawthorne, G.; de Morton, N.; Kent, P.

    2013-01-01

    of the worst fitting item (feeling alone), the remaining items fit the Rasch model. This, however, may have been a function of study samples. Conclusions: Generally, the FS performed well, and its descriptive system contains excess capacity beyond that needed in the study population; that is, those with LBP...

  4. Exploring Secondary Students' Knowledge and Misconceptions about Influenza: Development, validation, and implementation of a multiple-choice influenza knowledge scale

    Science.gov (United States)

    Romine, William L.; Barrow, Lloyd H.; Folk, William R.

    2013-07-01

    Understanding infectious diseases such as influenza is an important element of health literacy. We present a fully validated knowledge instrument called the Assessment of Knowledge of Influenza (AKI) and use it to evaluate knowledge of influenza, with a focus on misconceptions, in Midwestern United States high-school students. A two-phase validation process was used. In phase 1, an initial factor structure was calculated based on 205 students of grades 9-12 at a rural school. In phase 2, one- and two-dimensional factor structures were analyzed from the perspectives of classical test theory and the Rasch model using structural equation modeling and principal components analysis (PCA) on Rasch residuals, respectively. Rasch knowledge measures were calculated for 410 students from 6 school districts in the Midwest, and misconceptions were verified through the χ 2 test. Eight items measured knowledge of flu transmission, and seven measured knowledge of flu management. While alpha reliability measures for the subscales were acceptable, Rasch person reliability measures and PCA on residuals advocated for a single-factor scale. Four misconceptions were found, which have not been previously documented in high-school students. The AKI is the first validated influenza knowledge assessment, and can be used by schools and health agencies to provide a quantitative measure of impact of interventions aimed at increasing understanding of influenza. This study also adds significantly to the literature on misconceptions about influenza in high-school students, a necessary step toward strategic development of educational interventions for these students.

  5. Psychometric Properties of the Fatigue Severity Scale in Polio Survivors

    Science.gov (United States)

    Burger, Helena; Franchignoni, Franco; Puzic, Natasa; Giordano, Andrea

    2010-01-01

    The objective of this study was to evaluate by means of classical test theory and Rasch analysis the scaling characteristics and psychometric properties of the Fatigue Severity Scale (FSS) in polio survivors. A questionnaire, consisting of five general questions (sex, age, age at time of acute polio, sequelae of polio, and new symptoms), the FSS,…

  6. Measuring Attending Behavior and Short-Term Memory with Knox's Cube Test.

    Science.gov (United States)

    Stone, Mark H.; Wright, Benjamin D.

    1983-01-01

    A new revision was developed using Rasch psychometric techniques to build a Knox's Cube Test (KCT) variable and item bank using the tapping series from all previous editions. The report forms developed give a clear picture of the subject's performance set in a context that is both normative and criterion. (Author/BW)

  7. Assessing Validity of Measurement in Learning Disabilities Using Hierarchical Generalized Linear Modeling: The Roles of Anxiety and Motivation

    Science.gov (United States)

    Sideridis, Georgios D.

    2016-01-01

    The purpose of the present studies was to test the hypothesis that the psychometric characteristics of ability scales may be significantly distorted if one accounts for emotional factors during test taking. Specifically, the present studies evaluate the effects of anxiety and motivation on the item difficulties of the Rasch model. In Study 1, the…

  8. A Developmental Scale of Mental Computation with Part-Whole Numbers

    Science.gov (United States)

    Callingham, Rosemary; Watson, Jane

    2004-01-01

    In this article, data from a study of the mental computation competence of students in grades 3 to 10 are presented. Students responded to mental computation items, presented orally, that included operations applied to fractions, decimals and percents. The data were analysed using Rasch modelling techniques, and a six-level hierarchy of part-whole…

  9. A Comparison of Methods of Vertical Equating.

    Science.gov (United States)

    Loyd, Brenda H.; Hoover, H. D.

    Rasch model vertical equating procedures were applied to three mathematics computation tests for grades six, seven, and eight. Each level of the test was composed of 45 items in three sets of 15 items, arranged in such a way that tests for adjacent grades had two sets (30 items) in common, and the sixth and eighth grades had 15 items in common. In…

  10. The development and psychometric validation of the Ethical Awareness Scale.

    Science.gov (United States)

    Milliken, Aimee; Ludlow, Larry; DeSanto-Madeya, Susan; Grace, Pamela

    2018-04-19

    To develop and psychometrically assess the Ethical Awareness Scale using Rasch measurement principles and a Rasch item response theory model. Critical care nurses must be equipped to provide good (ethical) patient care. This requires ethical awareness, which involves recognizing the ethical implications of all nursing actions. Ethical awareness is imperative in successfully addressing patient needs. Evidence suggests that the ethical import of everyday issues may often go unnoticed by nurses in practice. Assessing nurses' ethical awareness is a necessary first step in preparing nurses to identify and manage ethical issues in the highly dynamic critical care environment. A cross-sectional design was used in two phases of instrument development. Using Rasch principles, an item bank representing nursing actions was developed (33 items). Content validity testing was performed. Eighteen items were selected for face validity testing. Two rounds of operational testing were performed with critical care nurses in Boston between February-April 2017. A Rasch analysis suggests sufficient item invariance across samples and sufficient construct validity. The analysis further demonstrates a progression of items uniformly along a hierarchical continuum; items that match respondent ability levels; response categories that are sufficiently used; and adequate internal consistency. Mean ethical awareness scores were in the low/moderate range. The results suggest the Ethical Awareness Scale is a psychometrically sound, reliable and valid measure of ethical awareness in critical care nurses. © 2018 John Wiley & Sons Ltd.

  11. The BETA ® nursing measure: Calibrating construct validity with ...

    African Journals Online (AJOL)

    Background: The BETA nursing measure has been introduced as a tool to routinely measure and monitor the outcomes of patients' activities of daily living in a restorative nursing care context. Objectives: To investigate the BETA's construct validity using the Rasch model with specific reference to the BETA's potential to be ...

  12. Statistical inference based on latent ability estimates

    NARCIS (Netherlands)

    Hoijtink, H.J.A.; Boomsma, A.

    The quality of approximations to first and second order moments (e.g., statistics like means, variances, regression coefficients) based on latent ability estimates is being discussed. The ability estimates are obtained using either the Rasch, oi the two-parameter logistic model. Straightforward use

  13. Algorithmic test design using classical item parameters

    NARCIS (Netherlands)

    van der Linden, Willem J.; Adema, Jos J.

    Two optimalization models for the construction of tests with a maximal value of coefficient alpha are given. Both models have a linear form and can be solved by using a branch-and-bound algorithm. The first model assumes an item bank calibrated under the Rasch model and can be used, for instance,

  14. Author Details

    African Journals Online (AJOL)

    Matore, M. E. E. M.. Vol 9, No 6S (2017) - Articles Improving the psychometric properties of the Mooney problem checklist by using Rasch measurement model. Abstract PDF. ISSN: 1112-9867. AJOL African Journals Online. HOW TO USE AJOL... for Researchers · for Librarians · for Authors · FAQ's · More about AJOL ...

  15. The GAMMA® nursing measure: Its calibration for construct validity ...

    African Journals Online (AJOL)

    Purpose: To subject the GAMMA nursing measure to the Rasch Measurement Model and to report if the measure can function as an interval scale to provide metric measurements of patients' ability to perform instrumental activities of daily living. Method: A quantitative design was followed whereby GAMMA raw scores were ...

  16. Author Details

    African Journals Online (AJOL)

    Mohamad, M. Vol 9, No 6S (2017) - Articles Improving the psychometric properties of the Mooney problem checklist by using Rasch measurement model. Abstract PDF. ISSN: 1112-9867. AJOL African Journals Online. HOW TO USE AJOL... for Researchers · for Librarians · for Authors · FAQ's · More about AJOL · AJOL's ...

  17. Improving the psychometric properties of the Mooney problem ...

    African Journals Online (AJOL)

    This study aims to examine the psychometric characteristics of Mooney Problem Checklist (MPCL) items using the Rasch measurement model framework in the context of polytechnics. The MPCL with eleven dimensions was administered to 252 respondents who were selected from seven polytechnic institutions in Malaysia ...

  18. Achievement of course outcome in vector calculus pre-test questions ...

    African Journals Online (AJOL)

    No Abstract. Keywords: pre-test; course outcome; bloom taxanomy; Rasch measurement model; vector calculus. Full Text: EMAIL FREE FULL TEXT EMAIL FREE FULL TEXT · DOWNLOAD FULL TEXT DOWNLOAD FULL TEXT · AJOL African Journals Online. HOW TO USE AJOL... for Researchers · for Librarians ...

  19. Latent Transition Analysis with a Mixture Item Response Theory Measurement Model

    Science.gov (United States)

    Cho, Sun-Joo; Cohen, Allan S.; Kim, Seock-Ho; Bottge, Brian

    2010-01-01

    A latent transition analysis (LTA) model was described with a mixture Rasch model (MRM) as the measurement model. Unlike the LTA, which was developed with a latent class measurement model, the LTA-MRM permits within-class variability on the latent variable, making it more useful for measuring treatment effects within latent classes. A simulation…

  20. Analyzing Process Quality of Early Childhood Education with Many Facet Rash Measurement Model

    Science.gov (United States)

    Basturk, Ramazan; Isikoglu, Nesrin

    2008-01-01

    Quality of early childhood education institutions specifically, dimensions of process quality should be evaluated. Purpose of this study is to analyze process quality of early childhood education by using many-facet Rasch measurement model (MFRM). In this study, data were collected from twelve early childhood education institutions by four…

  1. Differences between Mothers' and Fathers' Ratings of Family Functioning with the Family Assessment Device: The Validity of Combined Parent Scores

    Science.gov (United States)

    Cooke, Dawson; Marais, Ida; Cavanagh, Robert; Kendall, Garth; Priddis, Lynn

    2015-01-01

    The psychometric properties of the General Functioning subscale of the McMaster Family Assessment Device were examined using the Rasch Model (N = 237 couples). Mothers' and fathers' ratings of the General Functioning subscale of the McMaster Family Assessment Device are recommended, provided these are analyzed separately. More than a quarter of…

  2. Grade 12 Achievement Rating Scales in the New National Senior ...

    African Journals Online (AJOL)

    The raw score results showed a decline in proficiency in all topics, and significantly reduced skills development, with mastery of acids and bases showing the most serious decline. Rasch analysis of the data indicated that a 12 percentage point shift in preparedness occurred in 2009 compared with 2005. The contribution to ...

  3. Combined Common Person and Common Item Equating of Medical Science Examinations.

    Science.gov (United States)

    Kelley, Paul R.

    This equating study of the National Board of Medical Examiners Examinations was a combined common persons and common items equating, using the Rasch model. The 1,000-item test was administered to about 3,000 second-year medical students in seven equal-length subtests: anatomy, physiology, biochemistry, pathology, microbiology, pharmacology, and…

  4. Scaling of Advanced Theory-of-Mind Tasks

    Science.gov (United States)

    Osterhaus, Christopher; Koerber, Susanne; Sodian, Beate

    2016-01-01

    Advanced theory-of-mind (AToM) development was investigated in three separate studies involving 82, 466, and 402 elementary school children (8-, 9-, and 10-year-olds). Rasch and factor analyses assessed whether common conceptual development underlies higher-order false-belief understanding, social understanding, emotion recognition, and…

  5. Dimensionality of the Knee Numeric-Entity Evaluation Score (KNEES-ACL)

    DEFF Research Database (Denmark)

    Comins, J D; Krogsgaard, M R; Kreiner, Svend

    2013-01-01

    The benefit of anterior cruciate ligament (ACL) reconstruction has been questioned based on patient-reported outcome measures (PROMs). Valid interpretation of such results requires confirmation of the psychometric properties of the PROM. Rasch analysis is the gold standard for validation of PROMs...

  6. Achievement Testing with the Wechsler Quicktest: An Examination of Its Psychometric Properties and Applied Utility with a Greek-Cypriot Sample

    Science.gov (United States)

    Vrachimi-Souroulla, Andry; Panayiotou, Georgia; Kokkinos, Constantinos M.; Lamprianou, Iasonas

    2011-01-01

    The study aimed to field-test a Greek version of the Wechsler Quicktest and to examine its psychometric properties. The Quicktest was individually administered to 208 students, aged 5-14 years, along with a reading test. Based on the Rasch analysis, data for the Quicktest subtests showed acceptable fit to the model. Also, correlations were found…

  7. Developments in Measuring Functional Activities: Where Do We Go with the PEDI-CAT?

    Science.gov (United States)

    Ketelaar, Marjolijn; Wassenberg-Severijnen, Jeltje

    2010-01-01

    During the past 30 years many pediatric assessment and outcome measures have been developed. Based on Rasch analysis, the Pediatric Evaluation of Disability Inventory (PEDI) was designed to measure functional status by asking parents about both the skills of their children and the performance of daily tasks in three functionally important domains…

  8. Examining Measurement Properties of an English Self-Efficacy Scale for English Language Learners in Korea

    Science.gov (United States)

    Wang, Chuang; Kim, Do-Hong; Bong, Mimi; Ahn, Hyun Seon

    2013-01-01

    This study provides evidence for the validity of the Questionnaire of English Self-Efficacy in a sample of 167 college students in Korea. Results show that the scale measures largely satisfy the Rasch model for unidimensionality. The rating scale appeared to function effectively. The item hierarchy was consistent with the expected item order. The…

  9. Investigating the Measurement Properties of the Social Responsiveness Scale in Preschool Children with Autism Spectrum Disorders

    Science.gov (United States)

    Duku, Eric; Vaillancourt, Tracy; Szatmari, Peter; Georgiades, Stelios; Zwaigenbaum, Lonnie; Smith, Isabel M.; Bryson, Susan; Fombonne, Eric; Mirenda, Pat; Roberts, Wendy; Volden, Joanne; Waddell, Charlotte; Thompson, Ann; Bennett, Teresa

    2013-01-01

    The purpose of this study was to examine the measurement properties of the Social Responsiveness Scale in an accelerated longitudinal sample of 4-year-old preschool children with the complementary approaches of categorical confirmatory factor analysis and Rasch analysis. Measurement models based on the literature and other hypothesized measurement…

  10. A Comparison of the One-and Three-Parameter Logistic Models on Measures of Test Efficiency.

    Science.gov (United States)

    Benson, Jeri

    Two methods of item selection were used to select sets of 40 items from a 50-item verbal analogies test, and the resulting item sets were compared for relative efficiency. The BICAL program was used to select the 40 items having the best mean square fit to the one parameter logistic (Rasch) model. The LOGIST program was used to select the 40 items…

  11. Spinal Cord Independence Measure, version III: applicability to the UK spinal cord injured population.

    Science.gov (United States)

    Glass, Clive A; Tesio, Luigi; Itzkovich, Malka; Soni, Bakul M; Silva, Pedro; Mecci, Munawar; Chadwick, Raymond; el Masry, Waghi; Osman, Aheed; Savic, Gordana; Gardner, Brian; Bergström, Ebba; Catz, Amiram

    2009-09-01

    To examine the validity, reliability and usefulness of the Spinal Cord Independence Measure for the UK spinal cord injury population. Multi-centre cohort study. Four UK regional spinal cord injury centres. Eighty-six people with spinal cord injury. Spinal Cord Independence Measure and Functional Independence Measure on admission analysed using inferential statistics, and Rasch analysis of Spinal Cord Independence Measure. Internal consistency, inter-rater reliability, discriminant validity; Spinal Cord Independence Measure subscale match between distribution of item difficulty and patient ability measurements; reliability of patient ability measures; fit of data to Rasch model; unidimensionality of subscales; hierarchical ordering of categories within items; differential item functioning across patient groups. Scale reliability (kappa coefficients range 0.491-0.835; (p Spinal Cord Independence Measure subscales compatible with stringent Rasch requirements; mean infit indices high; distinct strata of abilities identified; most thresholds ordered; item hierarchy stable across clinical groups and centres. Misfit and differences in item hierarchy identified. Difficulties assessing central cord injuries highlighted. Conventional statistical and Rasch analyses justify the use of the Spinal Cord Independence Measure in clinical practice and research in the UK. Cross-cultural validity may be further improved.

  12. RIT Stability through the Transition to Common Core-Aligned MAP® Tests. How Using MAP to Measure Student Learning Growth is Reliable Now and in 2014

    Science.gov (United States)

    Northwest Evaluation Association, 2013

    2013-01-01

    While many educators expect the Common Core State Standards (CCSS) to be more rigorous than previous state standards, some wonder if the transition to CCSS and to a Common Core aligned MAP test will have an impact on their students' RIT scores or the NWEA norms. MAP assessments use a proprietary scale known as the RIT (Rasch unit) scale to measure…

  13. The Effect of Mini and Midi Anchor Tests on Test Equating

    Science.gov (United States)

    Arikan, Çigdem Akin

    2018-01-01

    The main purpose of this study is to compare the test forms to the midi anchor test and the mini anchor test performance based on item response theory. The research was conducted with using simulated data which were generated based on Rasch model. In order to equate two test forms the anchor item nonequivalent groups (internal anchor test) was…

  14. Improving Students' Attitudes toward Science Using Instructional Congruence

    Science.gov (United States)

    Zain, Ahmad Nurulazam Md; Samsudin, Mohd Ali; Rohandi, Robertus; Jusoh, Azman

    2010-01-01

    The objective of this study was to improve students' attitudes toward science using instructional congruence. The study was conducted in Malaysia, in three low-performing secondary schools in the state of Penang. Data collected with an Attitudes in Science instrument were analysed using Rasch modeling. Qualitative data based on the reflections of…

  15. Cross-Country Comparisons of Inattentive, Hyperactive and Impulsive Behaviour in School-Based Samples of Young Children

    Science.gov (United States)

    Merrell, Christine; Styles, Irene; Jones, Paul; Tymms, Peter; Wildy, Helen

    2013-01-01

    This paper uses the Rasch measurement model to analyse data collected on children's attention, activity and impulsiveness at the end of their first year at school by teachers in England, Scotland and Australia. The analysis offers insights into differences in teachers' perceptions of children's behaviour between countries and changes with age. The…

  16. The integration of bioclimatic indices in an objective probabilistic model for establishing and mapping viticulture suitability in a region

    Science.gov (United States)

    Moral García, Francisco J.; Rebollo, Francisco J.; Paniagua, Luis L.; García, Abelardo

    2014-05-01

    Different bioclimatic indices have been proposed to determine the wine suitability in a region. Some of them are related to the air temperature, but the hydric component of climate should also be considered which, in turn, is influenced by the precipitation during the different stages of the grapevine growing and ripening periods. In this work we propose using the information obtained from 10 bioclimatic indices and variables (heliothermal index, HI, cool night index, CI, dryness index, DI, growing season temperature, GST, the Winkler index, WI, September mean thermal amplitude, MTA, annual precipitation, AP, precipitation during flowering, PDF, precipitation before flowering, PBF, and summer precipitation, SP) as inputs in an objective and probabilistic model, the Rasch model, with the aim of integrating the individual effects of them, obtaining the climate data that summarize all main bioclimatic indices which could influence on wine suitability, and utilize the Rasch measures to generate homogeneous climatic zones. The use of the Rasch model to estimate viticultural suitability constitutes a new application of great practical importance, enabling to rationally determine locations in a region where high viticultural potential exists and establishing a ranking of the bioclimatic indices or variables which exerts an important influence on wine suitability in a region. Furthermore, from the measures of viticultural suitability at some locations, estimates can be computed using a geostatistical algorithm, and these estimates can be utilized to map viticultural suitability potential in a region. To illustrate the process, an application to Extremadura, southewestern Spain, is shown. Keywords: Rasch model, bioclimatic indices, GIS.

  17. Career Motivation of Secondary Students in STEM: A Cross-Cultural Study between Korea and Indonesia

    Science.gov (United States)

    Shin, Sein; Rachmatullah, Arif; Roshayanti, Fenny; Ha, Minsu; Lee, Jun-Ki

    2018-01-01

    The purpose of this study was to understand the career motivation of secondary students in science, technology, engineering, and mathematics (STEM) by comparing Korean and Indonesian students. Effects of gender and educational level on students' STEM career motivation were also examined. To test for differences, we used Rasch analysis, 3-way…

  18. Testing the generalized partial credit model

    NARCIS (Netherlands)

    Glas, Cornelis A.W.

    1996-01-01

    The partial credit model (PCM) (G.N. Masters, 1982) can be viewed as a generalization of the Rasch model for dichotomous items to the case of polytomous items. In many cases, the PCM is too restrictive to fit the data. Several generalizations of the PCM have been proposed. In this paper, a

  19. Detection of differential item functioning using Lagrange multiplier tests

    NARCIS (Netherlands)

    Glas, Cornelis A.W.

    1998-01-01

    Abstract: In the present paper it is shown that differential item functioning can be evaluated using the Lagrange multiplier test or Rao’s efficient score test. The test is presented in the framework of a number of IRT models such as the Rasch model, the OPLM, the 2-parameter logistic model, the

  20. Detection of differential item functioning using Lagrange multiplier tests

    NARCIS (Netherlands)

    Glas, Cornelis A.W.

    1996-01-01

    In this paper it is shown that differential item functioning can be evaluated using the Lagrange multiplier test or C. R. Rao's efficient score test. The test is presented in the framework of a number of item response theory (IRT) models such as the Rasch model, the one-parameter logistic model, the

  1. Partially Observed Mixtures of IRT Models: An Extension of the Generalized Partial-Credit Model

    Science.gov (United States)

    Von Davier, Matthias; Yamamoto, Kentaro

    2004-01-01

    The generalized partial-credit model (GPCM) is used frequently in educational testing and in large-scale assessments for analyzing polytomous data. Special cases of the generalized partial-credit model are the partial-credit model--or Rasch model for ordinal data--and the two parameter logistic (2PL) model. This article extends the GPCM to the…

  2. Assessing the Efficacy of a Student Expectations Questionnaire

    Science.gov (United States)

    Warwick, Jon

    2012-01-01

    This article uses Rasch analysis to explore the efficacy of a questionnaire designed to assist university teaching staff in identifying those Level 4 students most in need of mathematics support. The students were all taking a mathematics module as part of their first year Computing curriculum, and the questionnaire explores the students' previous…

  3. Development of a Patient-Reported Palliative Care-Specific Health Classification System: The POS-E.

    Science.gov (United States)

    Dzingina, Mendwas; Higginson, Irene J; McCrone, Paul; Murtagh, Fliss E M

    2017-06-01

    Generic preference-based measures are commonly used to estimate quality-adjusted life-years (QALYs) to inform resource-allocation decisions. However, concerns have been raised that generic measures may be inappropriate in palliative care. Our objective was to derive a health-state classification system that is amenable to valuation from the ten-item Palliative Care Outcome Scale (POS), a widely used patient-reported outcome measure in palliative care. The dimensional structure of the original POS was assessed using factor analysis. Item performance was assessed, using Rasch analysis and psychometric criteria, to enable the selection of items that represent the dimensions covered by the POS. Data from six studies of patients receiving palliative care were combined (N = 1011) and randomly split into two halves for development and validation. Analysis was undertaken on the development data, and results were validated by repeating the analysis with the validation dataset. Following Rasch and factor analyses, a classification system of seven items was derived. Each item had two to three levels. Rasch threshold map helped identify a set of 14 plausible health states that can be used for the valuation of the instrument to derive a preference-based index. Combining factor analysis and Rasch analysis with psychometric criteria provides a valid method of constructing a classification system for a palliative care-specific preference-based measure. The next stage is to obtain preference weights so the measure can be used in economic evaluations in palliative care.

  4. Reliability and Validity of the Research Methods Skills Assessment

    Science.gov (United States)

    Smith, Tamarah; Smith, Samantha

    2018-01-01

    The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

  5. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 2. Technical Report #1201

    Science.gov (United States)

    Lai, Cheng-Fei; Irvin, P. Shawn; Alonzo, Julie; Park, Bitnara Jasmine; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the second-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  6. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 3. Technical Report #1202

    Science.gov (United States)

    Lai, Cheng-Fei; Irvin, P. Shawn; Park, Bitnara Jasmine; Alonzo, Julie; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the third-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  7. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 5. Technical Report #1204

    Science.gov (United States)

    Park, Bitnara Jasmine; Irvin, P. Shawn; Lai, Cheng-Fei; Alonzo, Julie; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the fifth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  8. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 4. Technical Report #1203

    Science.gov (United States)

    Park, Bitnara Jasmine; Irvin, P. Shawn; Alonzo, Julie; Lai, Cheng-Fei; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the fourth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  9. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 6. Technical Report #1205

    Science.gov (United States)

    Irvin, P. Shawn; Alonzo, Julie; Park, Bitnara Jasmine; Lai, Cheng-Fei; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the sixth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  10. Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 7. Technical Report #1206

    Science.gov (United States)

    Irvin, P. Shawn; Alonzo, Julie; Lai, Cheng-Fei; Park, Bitnara Jasmine; Tindal, Gerald

    2012-01-01

    In this technical report, we present the results of a reliability study of the seventh-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

  11. Examining the Psychometric Quality of Multiple-Choice Assessment Items using Mokken Scale Analysis.

    Science.gov (United States)

    Wind, Stefanie A

    The concept of invariant measurement is typically associated with Rasch measurement theory (Engelhard, 2013). Concerned with the appropriateness of the parametric transformation upon which the Rasch model is based, Mokken (1971) proposed a nonparametric procedure for evaluating the quality of social science measurement that is theoretically and empirically related to the Rasch model. Mokken's nonparametric procedure can be used to evaluate the quality of dichotomous and polytomous items in terms of the requirements for invariant measurement. Despite these potential benefits, the use of Mokken scaling to examine the properties of multiple-choice (MC) items in education has not yet been fully explored. A nonparametric approach to evaluating MC items is promising in that this approach facilitates the evaluation of assessments in terms of invariant measurement without imposing potentially inappropriate transformations. Using Rasch-based indices of measurement quality as a frame of reference, data from an eighth-grade physical science assessment are used to illustrate and explore Mokken-based techniques for evaluating the quality of MC items. Implications for research and practice are discussed.

  12. How Fast Do Students Forget What They Learn in Consumer Behavior? A Longitudinal Study

    Science.gov (United States)

    Bacon, Donald R.; Stewart, Kim A.

    2006-01-01

    The retention curve for knowledge acquired in a consumer behavior course is explored in a longitudinal study, tracking individual students from 8 to 101 weeks following course completion. Rasch measurement is used to link tests and to achieve intervally scaled measures of knowledge. The findings indicate that most of the knowledge gained in the…

  13. IRT-Based Measurement of Short-Term Changes of Ability, with an Application to Assessing the "Mozart Effect"

    Science.gov (United States)

    Gittler, Georg; Fischer, Gerhard

    2011-01-01

    The article extends and applies previous approaches by Klauer and Fischer to the statistical evaluation of ability changes in tests conforming to the Rasch model (RM). Exact uniformly most powerful unbiased (UMPU) hypothesis tests and uniformly most accurate (UMA) confidence intervals (CIs) for the amount of change can be constructed for each…

  14. Comparing of four IRT models when analyzing two tests for inductive reasoning

    NARCIS (Netherlands)

    de Koning, E.; Sijtsma, K.; Hamers, J.H.M.

    2002-01-01

    This article discusses the use of the nonparametric IRT Mokken models of monotone homogeneity and double monotonicity and the parametric Rasch and Verhelst models for the analysis of binary test data. First, the four IRT models are discussed and compared at the theoretical level, and for each model,

  15. Revising the ADAS-cog for a more accurate assessment of cognitive impairment

    NARCIS (Netherlands)

    Wouters, Hans; van Gool, Willem A; Schmand, Ben; Lindeboom, Robert

    2008-01-01

    BACKGROUND: To examine whether it is appropriate to sum the cognitive part of the Alzheimer Disease Assessment Scale (ADAS-cog) items to assess cognitive impairment. This assumes items to have (1) equal measurement precision and (2) hierarchically ordered categories. METHODS: Rasch analysis on the

  16. A measure of early physical functioning (EPF) post-stroke.

    Science.gov (United States)

    Finch, Lois E; Higgins, Johanne; Wood-Dauphinee, Sharon; Mayo, Nancy E

    2008-07-01

    To develop a comprehensive measure of Early Physical Functioning (EPF) post-stroke quantified through Rasch analysis and conceptualized using the International Classification of Functioning Disability and Health (ICF). An observational cohort study. A cohort of 262 subjects (mean age 71.6 (standard deviation 12.5) years) hospitalized post-acute stroke. Functional assessments were made within 3 days of stroke with items from valid and reliable indices commonly utilized to evaluate stroke survivors. Information on important variables was also collected. Principal component and Rasch analysis confirmed the factor structure, and dimensionality of the measure. Rasch analysis combined items across ICF components to develop the measure. Items were deleted iteratively, those retained fit the model and were related to the construct; reliability and validity were assessed. A 38-item unidimensional measure of the EPF met all Rasch model requirements. The item difficulty matched the person ability (mean person measure: -0.31; standard error 0.37 logits), reliability of the person-item-hierarchy was excellent at 0.97. Initial validity was adequate. The 38-item EPF measure was developed. It expands the range of assessment post acute stroke; it covers a broad spectrum of difficulty with good initial psychometric properties that, once revalidated, can assist in planning and evaluating early interventions.

  17. The Divergent Meanings of Life Satisfaction: Item Response Modeling of the Satisfaction with Life Scale in Greenland and Norway

    Science.gov (United States)

    Vitterso, Joar; Biswas-Diener, Robert; Diener, Ed

    2005-01-01

    Cultural differences in response to the Satisfaction With Life Scale (SWLS) items is investigated. Data were fit to a mixed Rasch model in order to identify latent classes of participants in a combined sample of Norwegians (N = 461) and Greenlanders (N = 180). Initial analyses showed no mean difference in life satisfaction between the two…

  18. Parameter Recovery for the 1-P HGLLM with Non-Normally Distributed Level-3 Residuals

    Science.gov (United States)

    Kara, Yusuf; Kamata, Akihito

    2017-01-01

    A multilevel Rasch model using a hierarchical generalized linear model is one approach to multilevel item response theory (IRT) modeling and is referred to as a one-parameter hierarchical generalized linear logistic model (1-P HGLLM). Although it has the flexibility to model nested structure of data with covariates, the model assumes the normality…

  19. Latent Trait Theory Applications to Test Item Bias Methodology. Research Memorandum No. 1.

    Science.gov (United States)

    Osterlind, Steven J.; Martois, John S.

    This study discusses latent trait theory applications to test item bias methodology. A real data set is used in describing the rationale and application of the Rasch probabilistic model item calibrations across various ethnic group populations. A high school graduation proficiency test covering reading comprehension, writing mechanics, and…

  20. Development of an Individual Work Performance Questionnaire

    NARCIS (Netherlands)

    Koopmans, L.; Bernaards, C.M.; Hildebrandt, V.H.; Buuren, S. van; Beek, A.J. van der; Vet, H.C.W. de

    2013-01-01

    Design/methodology/approach - After pilot-testing, the 47-item IWPQ was field-tested amongst a representative sample of 1,181 Dutch blue, pink, and white collar workers. Factor analysis was used to examine whether the four-dimensional conceptual framework could be confirmed. Rasch analysis was used

  1. Conceptualizing Student Affect for Science and Technology at the Middle School Level: Development and Implementation of a Measure of Affect in Science and Technology (MAST)

    Science.gov (United States)

    Romine, William L.; Sadler, Troy D.; Wulff, Eric P.

    2017-01-01

    We describe the development of the Measure of Affect in Science and Technology (MAST), and study its usefulness for measuring science affect in middle school students via both classical and Rasch measurement perspectives. We then proceed to utilize the measurement structure of the MAST to understand how middle school students at varying levels of…

  2. Validation of a personality inventory scale: The MCMI P-scale (paranoia)

    DEFF Research Database (Denmark)

    Kreiner, S; Simonsen, E; Mogensen, J

    1990-01-01

    biased and heterogeneous items) of MCMI possesses the property of local homogeneity: Items are homogeneous and responses are distributed according to the Rasch model for persons belonging to groups characterized by high raw scores. The cutting lines between domains of homogeneous and heterogeneous items...

  3. Psychomteric Validation of the Health of Nation Outcome Scales (HoNOS) in Traumatized Refugees

    DEFF Research Database (Denmark)

    Palic, Sabina; Elklit, Ask; Makransky, Guido

    -treatment data from 448 consecutive patients at three Danish psychiatric clinics for refugees. A10-item HoNOS version (physical problems and daily function items excluded) of pre-treatment data fit the Rasch model well. A cross validation showed excellent fit of the post-treatment data to the 10-item model...

  4. The career distress scale

    DEFF Research Database (Denmark)

    Creed, Peter; Hood, Michelle; Praskova, Anna

    2016-01-01

    distress items for model fit, item bias, location dependency, dimensionality, reliability, suitability of response options, and construct validity. Three of the 12 items examined were removed from consideration as they did not fit the Rasch model or were not invariant across groups. The remaining 9 items...

  5. The Role of Trust between International Students and Their American Instructors at Intensive English-Language Programs at American Universities

    Science.gov (United States)

    Mirzoyants, Anastasia

    2012-01-01

    The study proposes an alternative approach to studying interpersonal trust. The researcher uses the Rasch analysis to design a quantitative instrument that can be used to measure trust when exploring the effects that various aspects of educational environment have on students' experiences. Prior empirical studies examined trust from a…

  6. Measuring Change in Academic Self-Concept Resulting from Curricular and Instructional Innovations

    Science.gov (United States)

    Anderson, Lorin W.

    1977-01-01

    The Rasch Model was applied to the results of an academic self-concept test administered to junior high school students, and some items were eliminated. The resulting scale possessed several properties permitting its use in the measurement of school-induced change in self-concept. The questionnaire is appended. (Author/MV)

  7. Psychometric validation of the Persian nine-item Internet Gaming Disorder Scale – Short Form: Does gender and hours spent online gaming affect the interpretations of item descriptions?

    Science.gov (United States)

    Wu, Tzu-Yi; Lin, Chung-Ying; Årestedt, Kristofer; Griffiths, Mark D.; Broström, Anders; Pakpour, Amir H.

    2017-01-01

    Background and aims The nine-item Internet Gaming Disorder Scale – Short Form (IGDS-SF9) is brief and effective to evaluate Internet Gaming Disorder (IGD) severity. Although its scores show promising psychometric properties, less is known about whether different groups of gamers interpret the items similarly. This study aimed to verify the construct validity of the Persian IGDS-SF9 and examine the scores in relation to gender and hours spent online gaming among 2,363 Iranian adolescents. Methods Confirmatory factor analysis (CFA) and Rasch analysis were used to examine the construct validity of the IGDS-SF9. The effects of gender and time spent online gaming per week were investigated by multigroup CFA and Rasch differential item functioning (DIF). Results The unidimensionality of the IGDS-SF9 was supported in both CFA and Rasch. However, Item 4 (fail to control or cease gaming activities) displayed DIF (DIF contrast = 0.55) slightly over the recommended cutoff in Rasch but was invariant in multigroup CFA across gender. Items 4 (DIF contrast = −0.67) and 9 (jeopardize or lose an important thing because of gaming activity; DIF contrast = 0.61) displayed DIF in Rasch and were non-invariant in multigroup CFA across time spent online gaming. Conclusions Given the Persian IGDS-SF9 was unidimensional, it is concluded that the instrument can be used to assess IGD severity. However, users of the instrument are cautioned concerning the comparisons of the sum scores of the IGDS-SF9 across gender and across adolescents spending different amounts of time online gaming. PMID:28571474

  8. Psychometric validation of the Persian nine-item Internet Gaming Disorder Scale - Short Form: Does gender and hours spent online gaming affect the interpretations of item descriptions?

    Science.gov (United States)

    Wu, Tzu-Yi; Lin, Chung-Ying; Årestedt, Kristofer; Griffiths, Mark D; Broström, Anders; Pakpour, Amir H

    2017-06-01

    Background and aims The nine-item Internet Gaming Disorder Scale - Short Form (IGDS-SF9) is brief and effective to evaluate Internet Gaming Disorder (IGD) severity. Although its scores show promising psychometric properties, less is known about whether different groups of gamers interpret the items similarly. This study aimed to verify the construct validity of the Persian IGDS-SF9 and examine the scores in relation to gender and hours spent online gaming among 2,363 Iranian adolescents. Methods Confirmatory factor analysis (CFA) and Rasch analysis were used to examine the construct validity of the IGDS-SF9. The effects of gender and time spent online gaming per week were investigated by multigroup CFA and Rasch differential item functioning (DIF). Results The unidimensionality of the IGDS-SF9 was supported in both CFA and Rasch. However, Item 4 (fail to control or cease gaming activities) displayed DIF (DIF contrast = 0.55) slightly over the recommended cutoff in Rasch but was invariant in multigroup CFA across gender. Items 4 (DIF contrast = -0.67) and 9 (jeopardize or lose an important thing because of gaming activity; DIF contrast = 0.61) displayed DIF in Rasch and were non-invariant in multigroup CFA across time spent online gaming. Conclusions Given the Persian IGDS-SF9 was unidimensional, it is concluded that the instrument can be used to assess IGD severity. However, users of the instrument are cautioned concerning the comparisons of the sum scores of the IGDS-SF9 across gender and across adolescents spending different amounts of time online gaming.

  9. Cross-cultural adaptation and validation of the Manchester Foot Pain and Disability Index into Spanish.

    Science.gov (United States)

    Gijon-Nogueron, Gabriel; Ndosi, Mwidimi; Luque-Suarez, Alejandro; Alcacer-Pitarch, Begonya; Munuera, Pedro Vicente; Garrow, Adam; Redmond, Anthony C

    2014-03-01

    The Manchester Foot Pain and Disability Index (MFPDI) is a self-assessment 19-item questionnaire developed in the UK to measure foot pain and disability. This study aimed at conducting cross-cultural adaptation and validation of the MFPDI for use in Spain. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes measures were followed in the MFPDI adaptation into Spanish. The cross-cultural validation involved Rasch analysis of pooled data sets from Spain and the UK. Spanish data set comprised 338 patients, five used in the adaptation phase and 333 in the cross-cultural validation phase, mean age (SD) = 55.2 (16.7) and 248 (74.5 %) were female. A UK data set (n = 682) added in the cross-cultural validation phase; mean age (SD) = 51.6 (15.2 %) and 416 (61.0 %) were female. A preliminary analysis of the 17-item MFPDI revealed significant local dependency of items causing significant deviation from the Rasch model. Grouping all items into testlets and re-analysing the MFPDI as a 3-testlet scale resulted in an adequate fit to the Rasch model, χ (2) (df) = 15.945 (12), p = 0.194, excellent reliability and unidimensionality. Lack of cross-cultural invariance was evident on the functional and personal appearance testlets. Splitting the affected testlets discounted the cross-cultural bias and satisfied requirements of the Rasch model. Subsequently, the MFPDI was calibrated into interval-level scales, fully adjusted to allow parametric analyses and cross-cultural data comparisons when required. Rasch analysis has confirmed that the MFPDI is a robust 3-subscale measure of foot pain, function and appearance in both its English and Spanish versions.

  10. Applicability of Item Response Theory to the Korean Nurses' Licensing Examination

    Directory of Open Access Journals (Sweden)

    Geum-Hee Jeong

    2005-06-01

    Full Text Available To test the applicability of item response theory (IRT to the Korean Nurses' Licensing Examination (KNLE, item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item KNLE administered to 12,024 examinees in January 2004 were analyzed. Unidimensionality was tested using DETECT and the goodness-of-fit was tested using WINSTEPS for the Rasch model and Bilog-MG for the two-parameter logistic model. Item analysis and ability estimation were done using WINSTEPS. Using DETECT, Dmax ranged from 0.1 to 0.23 for each subject. The mean square value of the infit and outfit values of all items using WINSTEPS ranged from 0.1 to 1.5, except for one item in pediatric nursing, which scored 1.53. Of the 330 items, 218 (42.7% were misfit using the two-parameter logistic model of Bilog-MG. The correlation coefficients between the difficulty parameter using the Rasch model and the difficulty index from classical test theory ranged from 0.9039 to 0.9699. The correlation between the ability parameter using the Rasch model and the total score from classical test theory ranged from 0.9776 to 0.9984. Therefore, the results of the KNLE fit unidimensionality and goodness-of-fit for the Rasch model. The KNLE should be a good sample for analysis according to the IRT Rasch model, so further research using IRT is possible.

  11. Validation of Catquest-9SF-A Visual Disability Instrument to Evaluate Patient Function After Corneal Transplantation.

    Science.gov (United States)

    Claesson, Margareta; Armitage, W John; Byström, Berit; Montan, Per; Samolov, Branka; Stenvi, Ulf; Lundström, Mats

    2017-09-01

    Catquest-9SF is a 9-item visual disability questionnaire developed for evaluating patient-reported outcome measures after cataract surgery. The aim of this study was to use Rasch analysis to determine the responsiveness of Catquest-9SF for corneal transplant patients. Patients who underwent corneal transplantation primarily to improve vision were included. One group (n = 199) completed the Catquest-9SF questionnaire before corneal transplantation and a second independent group (n = 199) completed the questionnaire 2 years after surgery. All patients were recorded in the Swedish Cornea Registry, which provided clinical and demographic data for the study. Winsteps software v.3.91.0 (Winsteps.com, Beaverton, OR) was used to assess the fit of the Catquest-9SF data to the Rasch model. Rasch analysis showed that Catquest-9SF applied to corneal transplant patients was unidimensional (infit range, 0.73-1.32; outfit range, 0.81-1.35), and therefore, measured a single underlying construct (visual disability). The Rasch model explained 68.5% of raw variance. The response categories of the 9-item questionnaire were ordered, and the category thresholds were well defined. Item difficulty matched the level of patients' ability (0.36 logit difference between the means). Precision in terms of person separation (3.09) and person reliability (0.91) was good. Differential item functioning was notable for only 1 item (satisfaction with vision), which had a differential item functioning contrast of 1.08 logit. Rasch analysis showed that Catquest-9SF is a valid instrument for measuring visual disability in patients who have undergone corneal transplantation primarily to improve vision.

  12. Propiedades psicométricas del Cuestionario de Apoyo Social Funcional y de la Escala de Soledad en adultos mayores no institucionalizados en España Psychometric properties of the Functional Social Support Questionnaire and the Loneliness Scale in non-institutionalized older adults in Spain

    Directory of Open Access Journals (Sweden)

    Alba Ayala

    2012-08-01

    Full Text Available Objetivos: Este estudio analiza las propiedades psicométricas del Cuestionario de Apoyo Social Funcional Duke-UNC (DUFSS, Duke-UNC Questionnaire of Functional Social Support y de la Escala de Soledad de De Jong-Gierveld en una muestra de adultos mayores no institucionalizados. Métodos: Muestra de 1106 adultos mayores no institucionalizados incluidos en una encuesta nacional sobre calidad de vida. Ambas escalas se analizaron según la teoría clásica de los tests (aceptabilidad, consistencia interna, validez interna, validez convergente, validez discriminativa y precisión y análisis Rasch. Resultados: Las puntuaciones medias ± desviación estándar fueron de 44,95 ± 8,9 para el DUFSS y 1,92 ± 1,83 para la Escala de Soledad. El α de Cronbach fue 0,94 para el DUFSS y 0,77 para la Escala de Soledad. El análisis factorial mostró dos factores en ambas escalas (varianza explicada: 73,8% para el DUFSS y 67,7% para la Escala de Soledad. Ambos instrumentos mostraron un coeficiente de correlación de -0,59 entre sí. El análisis Rasch en el DUFSS identificó dos dimensiones, con un buen ajuste al modelo, mientras que la Escala de Soledad no mostró buen ajuste de los datos al modelo. Conclusiones: El cuestionario DUFSS, con algunas modificaciones, cumple las asunciones del modelo Rasch, y aporta medidas lineales. Sin embargo, hacen falta más estudios de análisis Rasch con la Escala de Soledad. Según la teoría clásica de los tests, el DUFSS tiene buena consistencia interna para comparación de personas y la Escala de Soledad la tiene para comparación de grupos. Ambas escalas presentan una validez de constructo satisfactoria.Objectives: To examine the psychometric properties of the Social Support Questionnaire Duke-UNC (DUFSS and the De Jong-Gierveld Loneliness Scale in a sample of non-institutionalized older adults. Methods: The sample consisted of 1,106 non-institutionalized older adults included in a national survey on quality of life

  13. The Hamilton Depression Scale (HAM-D) and the Montgomery–Åsberg Depression Scale (MADRS)

    DEFF Research Database (Denmark)

    Bech, Per; Allerup, Peter; Larsen, Erik Roj

    2014-01-01

    The objective of this re-analysis of the European Genome-Based Therapeutic Drugs for Depression Study (GENDEP) was to psychometrically test the unidimensionality of the full Montgomery Åsberg Depression Rating Scale (MADRS10) and the Hamilton Depression Scale (HAM-D17) versus their respective...... subscales (MADRS5 and HAM-D6) containing the core symptoms of depression severity. Rasch analysis was applied using RUMM 2030 software to assess the overall fit for unidimensionality. Neither the MADRS10 nor the HAM-D17 was found to fit the Rasch model for unidimensionality. The HAM-D6 (containing the items...... of depressed mood, guilt, work and interests, psychomotor retardation, psychic anxiety, and somatic general) as well as the analogue MADRS5 were tested for unidimensionality by use of the RUMM 2030 programme, and only the HAM-D6 was accepted. When testing for invariance across rating weeks or centres, the RUMM...

  14. Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

    International Nuclear Information System (INIS)

    Camargo, F R; Henson, B

    2015-01-01

    The notion of that more or less of a physical feature affects in different degrees the users' impression with regard to an underlying attribute of a product has frequently been applied in affective engineering. However, those attributes exist only as a premise that cannot directly be measured and, therefore, inferences based on their assessment are error-prone. To establish and improve measurement of latent attributes it is presented in this paper the concept of a stochastic framework using the Rasch model for a wide range of independent variables referred to as an item bank. Based on an item bank, computerized adaptive testing (CAT) can be developed. A CAT system can converge into a sequence of items bracketing to convey information at a user's particular endorsement level. It is through item banking and CAT that the financial benefits of using the Rasch model in affective engineering can be realised

  15. What is the best measure for assessing diabetes distress? A comparison of the Problem Areas in Diabetes and Diabetes Distress Scale

    DEFF Research Database (Denmark)

    Fenwick, Eva K.; Rees, Gwyn; Holmes-Truscott, Elizabeth

    2018-01-01

    This study used Rasch analysis to examine the psychometric validity of the Diabetes Distress Scale and the Problem Areas in Diabetes scale to assess diabetes distress in 3338 adults with diabetes (1609 completed the Problem Areas in Diabetes scale (n = 675 type 1 diabetes; n = 934 type 2 diabetes......) and 1705 completed the Diabetes Distress Scale (n = 693 type 1 diabetes; n = 1012 type 2 diabetes)). While criterion and convergent validity were good, Rasch analysis revealed suboptimal precision and targeting, and item misfit. Unresolvable multidimensionality within the Diabetes Distress Scale suggests...... a total score should be avoided, while suboptimal precision suggests that the Physician-related and Interpersonal distress subscales should be used cautiously....

  16. A review of empirical research related to the use of small quantitative samples in clinical outcome scale development.

    Science.gov (United States)

    Houts, Carrie R; Edwards, Michael C; Wirth, R J; Deal, Linda S

    2016-11-01

    There has been a notable increase in the advocacy of using small-sample designs as an initial quantitative assessment of item and scale performance during the scale development process. This is particularly true in the development of clinical outcome assessments (COAs), where Rasch analysis has been advanced as an appropriate statistical tool for evaluating the developing COAs using a small sample. We review the benefits such methods are purported to offer from both a practical and statistical standpoint and detail several problematic areas, including both practical and statistical theory concerns, with respect to the use of quantitative methods, including Rasch-consistent methods, with small samples. The feasibility of obtaining accurate information and the potential negative impacts of misusing large-sample statistical methods with small samples during COA development are discussed.

  17. The development and validation of the core competencies scale (CCS) for the college and university students.

    Science.gov (United States)

    Ruan, Bin; Mok, Magdalena Mo Ching; Edginton, Christopher R; Chin, Ming Kai

    2012-01-01

    This article describes the development and validation of the Core Competencies Scale (CCS) using Bok's (2006) competency framework for undergraduate education. The framework included: communication, critical thinking, character development, citizenship, diversity, global understanding, widening of interest, and career and vocational development. The sample comprised 70 college and university students. Results of analysis using Rasch rating scale modelling showed that there was strong empirical evidence on the validity of the measures in contents, structure, interpretation, generalizability, and response options of the CCS scale. The implication of having developed Rasch-based valid and dependable measures in this study for gauging the value added of college and university education to their students is that the feedback generated from CCS will enable evidence-based decision and policy making to be implemented and strategized. Further, program effectiveness can be measured and thus accountability on the achievement of the program objectives.

  18. Psychometric properties of the painDETECT questionnaire in rhuematoid arthritis, psoriatic arthritis and spondyloarthritis

    DEFF Research Database (Denmark)

    Rifbjerg-Madsen, Signe; Wæhrens, Eva Elisabet Ejlersen; Danneskiold-Samsøe, Bente

    2017-01-01

    that can identify underlying pain mechanisms are needed. The painDETECT questionnaire (PDQ) was originally designed to differentiate between pain phenotypes. The objectives were to evaluate the psychometric properties of the PDQ in patients with inflammatory arthritis by applying Rasch analysis...... and to explore the reliability of pain classification by test-retest. METHODS: For the Rasch analysis 900 questionnaires from patients with RA, PsA and SpA (300 per diagnosis) were extracted from 'the DANBIO painDETECT study'. The analysis was directed at the seven items assessing somatosensory symptoms...... and included: 1) the performance of the six-category Likert scale; 2) whether a unidimensional construct was defined; 3) the reliability and precision of estimates. Another group of 30 patients diagnosed with RA, PsA or SpA participated in a test-retest study. Intraclass Correlation Coefficients (ICC...

  19. A Practitioner's Instrument for Measuring Secondary Mathematics Teachers' Beliefs Surrounding Learner-Centered Classroom Practice.

    Science.gov (United States)

    Lischka, Alyson E; Garner, Mary

    In this paper we present the development and validation of a Mathematics Teaching Pedagogical and Discourse Beliefs Instrument (MTPDBI), a 20 item partial-credit survey designed and analyzed using Rasch measurement theory. Items on the MTPDBI address beliefs about the nature of mathematics, teaching and learning mathematics, and classroom discourse practices. A Rasch partial credit model (Masters, 1982) was estimated from the pilot study data. Results show that item separation reliability is .96 and person separation reliability is .71. Other analyses indicate the instrument is a viable measure of secondary teachers' beliefs about reform-oriented mathematics teaching and learning. This instrument is proposed as a useful measure of teacher beliefs for those working with pre-service and in-service teacher development.

  20. Properties of the Tampa Scale for Kinesiophobia across Workers with Different Pain Experiences and Cultural Backgrounds

    DEFF Research Database (Denmark)

    Jørgensen, M B; Damsgård, E; Holtermann, A

    2015-01-01

    kinesiophobia by TSK (13 statement version) and number of days with pain during the past year (less than 8 days, less than 90 days and greater than 90 days). A Rasch analysis was used to evaluate the measurement properties of the TSK in the workers across pain levels, ages, genders and ethnicities. The TSK did...... not fit the Rasch model, but removing one item solved the poorness of fit. Invariance was found across the pain levels, ages and genders. Thus, with a few modifications, the TSK was shown to capture a unidimensional construct of fear of movement in workers with different pain levels, ages, and genders.......The main aim of this study was to evaluate whether the construct validity of the Tampa Scale for Kinesiophobia (TSK) is consistent with respect to its scaling properties, unidimensionality and targeting among workers with different levels of pain. The 311 participating Danish workers reported...

  1. The development of a short measure of physical function for hip OA HOOS-Physical Function Shortform (HOOS-PS)

    DEFF Research Database (Denmark)

    Davis, A M; Perruccio, A V; Canizares, M

    2008-01-01

    : The daily activity and sports and recreational items of the HOOS were reduced to five items achieving a feasible, short measure of physical function with interval level properties. This tool has potential for use as the function component of an OA severity scoring system. Further testing of this measure......OBJECTIVE: To derive a cross-culturally valid, short measure of physical function using function subscales (daily living and sports and recreation) of the Hip disability and Osteoarthritis Outcome Score (HOOS). METHODS: Rasch analysis was conducted on data from individuals from multiple countries...... who had hip osteoarthritis (OA). Fit of the data to the Rasch model was evaluated by model chi(2) and item fit statistics (chi(2), size of residual, and F-test). Differential item functioning was evaluated by gender, age and country. Unidimensionality was evaluated by factor analysis of residuals...

  2. El CRAFFT/CARLOS como Instrumento para la Identificación Temprana de Consumo de Alcohol y Otras SPA: una Adaptación al Español

    Directory of Open Access Journals (Sweden)

    Augusto Pérez Gómez

    2011-01-01

    Full Text Available El consumo de alcohol en menores es un riesgo para su salud e incrementa la probabilidad de futuros problemas con esta y con otras sustancias psicoactivas, lo que hace necesario un instrumento para identificar rápida y eficazmente a adolescentes que consumen o en riesgo de iniciar el consumo. Con una muestra de 432 jóvenes de la ciudad de Bogotá, este estudio tuvo como objetivo realizar una adaptación de lenguaje y una calibración, mediante el modelo de Rasch, del instrumento CRAFFT/CARLOS, que poseería las características antes mencionadas. La utilización del modelo de Rasch mostró que el CRAFFT y su adaptación, el CARLOS, son instrumentos útiles para identificar problemas de consumo de alcohol y otras drogas entre adolescentes.

  3. EL CRAFFT CARLOS COMO INSTRUMENTO PARA LA IDENTIFICACIÓN TEMPRANA DE CONSUMO DE ALCOHOL Y OTRAS SPA: UNA ADAPTACIÓN AL ESPAÑOL/ THE CRAFFT CARLOS AS AN INSTRUMENT FOR THE EARLY DETECTION OF ALCOHOL AND OTHER PSYCHOACTIVE SUBSTANCES USE: AN ADAPTATION TO SPANISH/ O CRAFFT CARLOS COMO INSTRUMENTO PARA A IDENTIFICAÇÃO INICIAL DE CONSUMO DE ÁLCOOL E OUTRAS SPA: UMA ADAPTAÇÃO AO ESPANHOL

    Directory of Open Access Journals (Sweden)

    Augusto Pérez Gómez

    2011-12-01

    Full Text Available El consumo de alcohol en menores es un riesgo para su salud e incrementa la probabilidad de futuros problemas con esta y con otras sustancias psicoactivas, lo que hace necesario un instrumento para identificar rápida y eficazmente a adolescentes que consumen o en riesgo de iniciar el consumo. Con una muestra de 432 jóvenes de la ciudad de Bogotá, este estudio tuvo como objetivo realizar una adaptación de lenguaje y una calibración, mediante el modelo de Rasch, del instrumento CRAFFT/CARLOS, que poseería las características antes mencionadas. La utilización del modelo de Rasch mostró que el CRAFFT y su adaptación, el CARLOS, son instrumentos útiles para identificar problemas de consumo de alcohol y otras drogas entre adolescentes.

  4. The Nordic Five to Fifteen questionnaire could provide the basis for a common neurological disability variable

    DEFF Research Database (Denmark)

    Illum, Niels Ove; Gradel, Kim Oren

    2014-01-01

    in children. Our study evaluated its internal validity and whether it could be used to generate a common disability variable across childhood neurological disorders and severities. METHODS: The 28-statement FTF questionnaire was completed by the parents of children with spina bifida, muscular disorders...... qualifier score was 3.06 (standard deviation 0.89, range 2.31-4.26), and the variances mean was 1.57 (range 0.87-2.38). The corrected code-total correlation was 0.65, and reliability was 0.96. The Rasch analysis demonstrated good fit alignment of codes. CONCLUSION: The FTF questionnaire can be used...... with children with neurological disabilities, and the Rasch scale analysis results indicate that it could form the analytical basis for developing a common disability variable....

  5. The development of a short measure of physical function for knee OA KOOS-Physical Function Shortform (KOOS-PS) - an OARSI/OMERACT initiative

    DEFF Research Database (Denmark)

    Perruccio, A V; Stefan Lohmander, L; Canizares, M

    2008-01-01

    OBJECTIVE: To develop a short measure of physical function for knee osteoarthritis (OA) using multi-national data from individuals with varying degrees of severity of knee OA. METHODS: Rasch analysis, based on the partial credit model, was conducted on Knee injury and Osteoarthritis Outcome Score...... and Western Ontario McMaster Universities' Osteoarthritis Index data from individuals with knee OA, ranging from community to pre-total knee replacement samples from five countries. Fit of the data to the Rasch model was evaluated by overall model fit and item-level fit statistics (chi(2), size of residual, F....... RESULTS: Thirteen data sets were included (n=2145), with an age range of 26-95 years, and a male/female ratio of 1:1.4. The final model included seven of the original 22 items. From easiest to most difficult, the items (logit) were as follows: rising from bed (1.366), putting on socks/stockings (1...

  6. The Linear Logistic Test Model (LLTM as the methodological foundation of item generating rules for a new verbal reasoning test

    Directory of Open Access Journals (Sweden)

    HERBERT POINSTINGL

    2009-06-01

    Full Text Available Based on the demand for new verbal reasoning tests to enrich psychological test inventory, a pilot version of a new test was analysed: the 'Family Relation Reasoning Test' (FRRT; Poinstingl, Kubinger, Skoda & Schechtner, forthcoming, in which several basic cognitive operations (logical rules have been embedded/implemented. Given family relationships of varying complexity embedded in short stories, testees had to logically conclude the correct relationship between two individuals within a family. Using empirical data, the linear logistic test model (LLTM; Fischer, 1972, a special case of the Rasch model, was used to test the construct validity of the test: The hypothetically assumed basic cognitive operations had to explain the Rasch model's item difficulty parameters. After being shaped in LLTM's matrices of weights ((qij, none of these operations were corroborated by means of the Andersen's Likelihood Ratio Test.

  7. THEORETICAL AND PRACTICAL ASPECTS OF IDENTIFICATION AND EVALUATION OF SCHOOL EDUCATION QUALITY

    Directory of Open Access Journals (Sweden)

    N. Y. Yerganova

    2014-01-01

    Full Text Available The paper considers one of the main theoretical and practical pedagogical problems of education quality assessment. The quality measurement depends on successful identification of genuine (scientific and false diagnostic methods; the process becomes more complicated in case of latent variables. As a solution, the authors recommend the Rasch measurement model for identifying an integral indicator of education quality. The method in question involves designing, approbation and analysis of diagnostic materials, as well as mathematical and statistical data processing based on specialized computer software. The paper describes the advantages and theoretical potential of the Rasch method, and emphasizes its capacity for solving the key problem of quality modeling – i.e. suitability and utility of the indicator variables for the given research.

  8. Parental Health Attributions of Childhood Health and Illness: Development of the Pediatric Cultural Health Attributions Questionnaire (Pedi-CHAQ).

    Science.gov (United States)

    Vaughn, Lisa M; McLinden, Daniel J; Shellmer, Diana; Baker, Raymond C

    2011-01-01

    The causes attributed to childhood health and illness across cultures (cultural health attributions) are key factors that are now more frequently identified as affecting the health outcomes of children. Research suggests that the causes attributed to an event such as illness are thought to affect subsequent motivation, emotional response, decision making, and behavior. To date, there is no measure of health attributions appropriate for use with parents of pediatric patients. Using the Many-Facets approach to Rasch analysis, this study assesses the psychometrics of a newly developed instrument, the Pediatric Health Attributions Questionnaire (Pedi-CHAQ), a measure designed to assess the cultural health attributions of parents in diverse communities. Results suggest acceptable Rasch model statistics of fit and reliability for the Pedi-CHAQ. A shortened version of the questionnaire was developed as a result of this study and next steps are discussed.

  9. Self-esteem among nursing assistants: reliability and validity of the Rosenberg Self-Esteem Scale.

    Science.gov (United States)

    McMullen, Tara; Resnick, Barbara

    2013-01-01

    To establish the reliability and validity of the Rosenberg Self-Esteem Scale (RSES) when used with nursing assistants (NAs). Testing the RSES used baseline data from a randomized controlled trial testing the Res-Care Intervention. Female NAs were recruited from nursing homes (n = 508). Validity testing for the positive and negative subscales of the RSES was based on confirmatory factor analysis (CFA) using structural equation modeling and Rasch analysis. Estimates of reliability were based on Rasch analysis and the person separation index. Evidence supports the reliability and validity of the RSES in NAs although we recommend minor revisions to the measure for subsequent use. Establishing reliable and valid measures of self-esteem in NAs will facilitate testing of interventions to strengthen workplace self-esteem, job satisfaction, and retention.

  10. Escala fatorial de socialização: versão reduzida: seleção de itens e propriedades psicométricas Agreeableness scale: short version: item selection and psychometric properties

    Directory of Open Access Journals (Sweden)

    Maiana Farias Oliveira Nunes

    2010-01-01

    Full Text Available O objetivo desse estudo foi selecionar itens da Escala Fatorial de Socialização (EFS para a obtenção de uma versão reduzida, que mantivesse propriedades psicométricas adequadas. Baseou-se em uma amostra de 1.100 sujeitos. Para a seleção de itens, realizou-se análise qualitativa, buscando aqueles sem conteúdo clínico explícito e uma análise quantitativa, pelo modelo de Rasch. Tais critérios permitiram reduzir a EFS de 70 para 28 itens. As características psicométricas da versão reduzida foram verificadas pela comparação entre versões por Rasch e pela reanálise dos dados de estudos de validade realizados com a EFS. A versão reduzida manteve características psicométricas adequadas, o que sugere a possibilidade de utilização dessa versão da EFS em situações de avaliação com tempo restrito.This study aimed at selecting items from the Agreeableness Factor Scale for obtaining a short version of this test that could keep adequate psychometric properties. One thousand one hundred participants composed the sample. Items were selected using a qualitative strategy, which focused on item content that was not related to clinical descriptions and a quantitative analysis based on Rasch's model. The scale was reduced from 70 to 28 items, based on these criteria. In order to check the psychometric properties of the short version, both versions were compared by Rasch indices and by reanalyzing validity studies conducted with the original scale. The short version kept good psychometric properties, which suggests the possibility of using it when there is time restriction.

  11. Comparison of the psychometric properties of two balance scales in children with cerebral palsy

    OpenAIRE

    Jeon, Yong-Jin; Kim, Gyoung-Mo

    2016-01-01

    [Purpose] The purpose of this study was to compare the item difficulty degree between the Pediatric Balance Scale and Fullerton Advanced Balance scale for children with cerebral palsy. [Subjects and Methods] Forty children with cerebral palsy (male=17, female=23) voluntarily participated in the study. Item difficulty was expressed in the Rasch analysis using a logit value, with a higher value indicative of increasing item difficulty. [Results] Among the 24 items of the combined Pediatric Bala...

  12. Dimensionality of the UWES-17: An item response modelling analysis

    OpenAIRE

    Deon P. de Bruin; Carin Hill; Carolina M. Henn; Klaus-Peter Muller

    2013-01-01

    Orientation: Questionnaires, particularly the Utrecht Work Engagement Scale (UWES-17), are an almost standard method by which to measure work engagement. Conflicting evidence regarding the dimensionality of the UWES-17 has led to confusion regarding the interpretation of scores. Research purpose: The main focus of this study was to use the Rasch model to provide insight into the dimensionality of the UWES-17, and to assess whether work engagement should be interpreted as one single overall...

  13. Dimensionality and predictive validity of the HAM-Nat, a test of natural sciences for medical school admission.

    Science.gov (United States)

    Hissbach, Johanna C; Klusmann, Dietrich; Hampe, Wolfgang

    2011-10-14

    Knowledge in natural sciences generally predicts study performance in the first two years of the medical curriculum. In order to reduce delay and dropout in the preclinical years, Hamburg Medical School decided to develop a natural science test (HAM-Nat) for student selection. In the present study, two different approaches to scale construction are presented: a unidimensional scale and a scale composed of three subject specific dimensions. Their psychometric properties and relations to academic success are compared. 334 first year medical students of the 2006 cohort responded to 52 multiple choice items from biology, physics, and chemistry. For the construction of scales we generated two random subsamples, one for development and one for validation. In the development sample, unidimensional item sets were extracted from the item pool by means of weighted least squares (WLS) factor analysis, and subsequently fitted to the Rasch model. In the validation sample, the scales were subjected to confirmatory factor analysis and, again, Rasch modelling. The outcome measure was academic success after two years. Although the correlational structure within the item set is weak, a unidimensional scale could be fitted to the Rasch model. However, psychometric properties of this scale deteriorated in the validation sample. A model with three highly correlated subject specific factors performed better. All summary scales predicted academic success with an odds ratio of about 2.0. Prediction was independent of high school grades and there was a slight tendency for prediction to be better in females than in males. A model separating biology, physics, and chemistry into different Rasch scales seems to be more suitable for item bank development than a unidimensional model, even when these scales are highly correlated and enter into a global score. When such a combination scale is used to select the upper quartile of applicants, the proportion of successful completion of the curriculum

  14. The development of an instrument to measure quality of vision: the Quality of Vision (QoV) questionnaire.

    Science.gov (United States)

    McAlinden, Colm; Pesudovs, Konrad; Moore, Jonathan E

    2010-11-01

    To develop an instrument to measure subjective quality of vision: the Quality of Vision (QoV) questionnaire. A 30-item instrument was designed with 10 symptoms rated in each of three scales (frequency, severity, and bothersome). The QoV was completed by 900 subjects in groups of spectacle wearers, contact lens wearers, and those having had laser refractive surgery, intraocular refractive surgery, or eye disease and investigated with Rasch analysis and traditional statistics. Validity and reliability were assessed by Rasch fit statistics, principal components analysis (PCA), person separation, differential item functioning (DIF), item targeting, construct validity (correlation with visual acuity, contrast sensitivity, total root mean square [RMS] higher order aberrations [HOA]), and test-retest reliability (two-way random intraclass correlation coefficients [ICC] and 95% repeatability coefficients [R(c)]). Rasch analysis demonstrated good precision, reliability, and internal consistency for all three scales (mean square infit and outfit within 0.81-1.27; PCA >60% variance explained by the principal component; person separation 2.08, 2.10, and 2.01 respectively; and minimal DIF). Construct validity was indicated by strong correlations with visual acuity, contrast sensitivity and RMS HOA. Test-retest reliability was evidenced by a minimum ICC of 0.867 and a minimum 95% R(c) of 1.55 units. The QoV Questionnaire consists of a Rasch-tested, linear-scaled, 30-item instrument on three scales providing a QoV score in terms of symptom frequency, severity, and bothersome. It is suitable for measuring QoV in patients with all types of refractive correction, eye surgery, and eye disease that cause QoV problems.

  15. Assessment on Hybrid E-Learning Instrument

    OpenAIRE

    Intan Farahana Kamsin; Rosseni Din

    2015-01-01

    This study aims to improve Hybrid e-Learning 9.3. A total of 233 students of International Islamic University Malaysia, Gombak who have the experience in hybrid teaching and learning were involved as respondents. Rasch Measurement Model was used for this study. Validity analyses conducted were on (i) the compatibility of the items, (ii) mapping of items and respondents, (iii) scaling of instruments, and (iv) unidimentional items. The findings of the study show that (i) the items developed cor...

  16. PANSS-6

    DEFF Research Database (Denmark)

    Østergaard, S D; Lemming, O M; Mors, O

    2016-01-01

    randomized placebo-controlled trials in schizophrenia, we tested the scalability of PANSS-30, PANSS-14 and PANSS-8 by means of the parametric Rasch rating scale model. Furthermore, we tested whether a scalable PANSS version could separate efficacy of haloperidol and sertindole from placebo. RESULTS: Neither...... reduction and higher remission rates during treatment with haloperidol and sertindole vs. placebo. CONCLUSION: PANSS-6 is a short schizophrenia severity rating scale that adequately separates antipsychotic efficacy from that of placebo....

  17. ACER Mathematics Profile Series: Number Test. (Test Booklet, Answer and Record Sheet, Score Key, and Teachers Handbook).

    Science.gov (United States)

    Cornish, Greg; Wines, Robin

    The Number Test of the ACER Mathematics Profile Series, contains 30 items, for each of three suggested grade levels: 7-8, 8-9, and 9-10. Raw scores on all tests in the ACER Mathematics Profile Series (Number, Operations, Space and Measurement) are converted to a common scale called MAPS, a major feature of the Series. Based on the Rasch Model,…

  18. Measuring the impact of health problems among adults with limited mobility in Thailand: further validation of the Perceived Impact of Problem Profile

    Directory of Open Access Journals (Sweden)

    Manderson Lenore

    2008-01-01

    Full Text Available Abstract Background The Perceived Impact of Problem Profile (PIPP was developed to provide a tool for measuring the impact of a health condition from the individual's perspective, using the ICF model as a framework. One of the aims of the ICF is to enable the comparison of data across countries, however, relatively little is known about the subjective experience of disability in middle and low-income countries. The aim of this study was to assess the validity of the Perceived Impact of Problem Profile (PIPP for use among adults with a disability in Thailand using Rasch analysis. Methods A total of 210 adults with mobility impairment from the urban, rural and remote areas of northeast Thailand completed the PIPP, which contains 23 items assessing both impact and distress across five key domains (Self-care, Mobility, Participation, Relationships, and Psychological Well-being. Rasch analysis, using RUMM2020, was conducted to assess the internal validity and psychometric properties of the PIPP Impact subscales. Validation of the PIPP Impact scales was conducted by comparing scores across the different response levels of the EQ5D items. Results Rasch analysis indicated that participants did not clearly differentiate between 'impact' and 'distress,' the two aspects assessed by the PIPP. Further analyses were therefore limited to the PIPP Impact subscales. These showed adequate psychometric properties, demonstrating fit to the Rasch model and good person separation reliability. Preliminary validity testing using the EQ5D items provided support for the PIPP Impact subscales. Conclusion The results provide further support for the psychometric properties of the PIPP Impact scales and indicate that it is a suitable tool for use among adults with a locomotor disability in Thailand. Further research is needed to validate the PIPP across different cultural contexts and health conditions and to assess the usefulness of separate Impact and Distress subscales.

  19. Measuring the impact of health problems among adults with limited mobility in Thailand: further validation of the Perceived Impact of Problem Profile

    Science.gov (United States)

    Misajon, RoseAnne; Pallant, Julie F; Manderson, Lenore; Chirawatkul, Siriporn

    2008-01-01

    Background The Perceived Impact of Problem Profile (PIPP) was developed to provide a tool for measuring the impact of a health condition from the individual's perspective, using the ICF model as a framework. One of the aims of the ICF is to enable the comparison of data across countries, however, relatively little is known about the subjective experience of disability in middle and low-income countries. The aim of this study was to assess the validity of the Perceived Impact of Problem Profile (PIPP) for use among adults with a disability in Thailand using Rasch analysis. Methods A total of 210 adults with mobility impairment from the urban, rural and remote areas of northeast Thailand completed the PIPP, which contains 23 items assessing both impact and distress across five key domains (Self-care, Mobility, Participation, Relationships, and Psychological Well-being). Rasch analysis, using RUMM2020, was conducted to assess the internal validity and psychometric properties of the PIPP Impact subscales. Validation of the PIPP Impact scales was conducted by comparing scores across the different response levels of the EQ5D items. Results Rasch analysis indicated that participants did not clearly differentiate between 'impact' and 'distress,' the two aspects assessed by the PIPP. Further analyses were therefore limited to the PIPP Impact subscales. These showed adequate psychometric properties, demonstrating fit to the Rasch model and good person separation reliability. Preliminary validity testing using the EQ5D items provided support for the PIPP Impact subscales. Conclusion The results provide further support for the psychometric properties of the PIPP Impact scales and indicate that it is a suitable tool for use among adults with a locomotor disability in Thailand. Further research is needed to validate the PIPP across different cultural contexts and health conditions and to assess the usefulness of separate Impact and Distress subscales. PMID:18208616

  20. Pharmacy students' opinions of direct-to-consumer advertising: a pilot study at one university.

    Science.gov (United States)

    Harrington, Amanda R; Desselle, Shane P; Apgar, David A; Hesselbacher, Elizabeth; Pié, Aaron; Quesnel, Aimee; Warholak, Terri L

    2013-01-01

    Direct-to-consumer advertisement (DTCA) of prescription medications has become an important informational source for health care consumers. As future health care professionals on the front line of potential communication and dispensing of products emerging from DTCA, it is important to elicit the attitudes of student-pharmacists. This study aims to (1) evaluate the validity of the DTCA attitudinal questionnaire using Rasch rating scale analysis and (2) investigate the attitudes of pharmacy students toward DTCA and determine whether these attitudes were associated with years of pharmacy education and demographic characteristics. This investigation used a cross-sectional print-based questionnaire to evaluate the attitudes of pharmacy students toward DTCA of prescription medications. The 16-item questionnaire included items addressing the attitudes of pharmacy students toward DTCA with respect to patients' knowledge of medications, pharmacists' interaction with patients, and overall consumer judgment of medical prescriptions. Analyses included Rasch analysis and a multiple linear regression. A total of 243 students submitted usable questionnaires (85% response rate). Item response categories were collapsed from 5 categories to 3, and 4 items were removed to achieve acceptable Rasch model fit. Pharmacy students demonstrated little difficulty in agreeing with the statements suggesting that DTCA helps patients take a more active role in health care and had the most difficulty in agreeing with items suggesting that DTCA may lead to inappropriate prescribing to satisfy patient requests. Students' overall support for DTCA was the only variable that predicted the questionnaire score (P<.001). In conclusion, the Rasch analysis evaluated the psychometric properties of the instrument and identified the necessity to adapt the questionnaire from previous iterations to adequately fit the student population. Future research should examine factors that contribute to the variance in

  1. Dimensionality and predictive validity of the HAM-Nat, a test of natural sciences for medical school admission

    Directory of Open Access Journals (Sweden)

    Hissbach Johanna C

    2011-10-01

    Full Text Available Abstract Background Knowledge in natural sciences generally predicts study performance in the first two years of the medical curriculum. In order to reduce delay and dropout in the preclinical years, Hamburg Medical School decided to develop a natural science test (HAM-Nat for student selection. In the present study, two different approaches to scale construction are presented: a unidimensional scale and a scale composed of three subject specific dimensions. Their psychometric properties and relations to academic success are compared. Methods 334 first year medical students of the 2006 cohort responded to 52 multiple choice items from biology, physics, and chemistry. For the construction of scales we generated two random subsamples, one for development and one for validation. In the development sample, unidimensional item sets were extracted from the item pool by means of weighted least squares (WLS factor analysis, and subsequently fitted to the Rasch model. In the validation sample, the scales were subjected to confirmatory factor analysis and, again, Rasch modelling. The outcome measure was academic success after two years. Results Although the correlational structure within the item set is weak, a unidimensional scale could be fitted to the Rasch model. However, psychometric properties of this scale deteriorated in the validation sample. A model with three highly correlated subject specific factors performed better. All summary scales predicted academic success with an odds ratio of about 2.0. Prediction was independent of high school grades and there was a slight tendency for prediction to be better in females than in males. Conclusions A model separating biology, physics, and chemistry into different Rasch scales seems to be more suitable for item bank development than a unidimensional model, even when these scales are highly correlated and enter into a global score. When such a combination scale is used to select the upper quartile of

  2. Psychometric Properties of the Quantitative Myasthenia Gravis Score and the Myasthenia Gravis Composite Scale.

    Science.gov (United States)

    Barnett, Carolina; Merkies, Ingemar S J; Katzberg, Hans; Bril, Vera

    2015-09-02

    The Quantitative Myasthenia Gravis Score and the Myasthenia Gravis Composite are two commonly used outcome measures in Myasthenia Gravis. So far, their measurement properties have not been compared, so we aimed to study their psychometric properties using the Rasch model. 251 patients with stable myasthenia gravis were assessed with both scales, and 211 patients returned for a second assessment. We studied fit to the Rasch model at the first visit, and compared item fit, thresholds, differential item functioning, local dependence, person separation index, and tests for unidimensionality. We also assessed test-retest reliability and estimated the Minimal Detectable Change. Neither scale fit the Rasch model (X2p Myasthenia Gravis Composite had lower discrimination properties than the Quantitative Myasthenia Gravis Scale (Person Separation Index: 0.14 and 0.7). There was local dependence in both scales, as well as differential item functioning for ocular and generalized disease. Disordered thresholds were found in 6(60%) items of the Myasthenia Gravis Composite and in 4(31%) of the Quantitative Myasthenia Gravis Score. Both tools had adequate test-retest reliability (ICCs >0.8). The minimally detectable change was 4.9 points for the Myasthenia Gravis Composite and 4.3 points for the Quantitative Myasthenia Gravis Score. Neither scale fulfilled Rasch model expectations. The Quantitative Myasthenia Gravis Score has higher discrimination than the Myasthenia Gravis Composite. Both tools have items with disordered thresholds, differential item functioning and local dependency. There was evidence of multidimensionality in the QMGS. The minimal detectable change values are higher than previous studies on the minimal significant change. These findings might inform future modifications of these tools.

  3. A comparison between patients with epiphora and cataract of the activity limitations they experience in daily life due to their visual disability.

    Science.gov (United States)

    Bohman, Elin; Wyon, Maria; Lundström, Mats; Dafgård Kopp, Eva

    2018-02-01

    The objective of this study was to compare patients with epiphora and cataract in terms of the activity limitations they experience in daily life due to their visual disability and to validate the use of the Catquest-9SF questionnaire for epiphora patients. Seventy-two consecutively encountered adult patients with confirmed lacrimal obstruction and listed for dacryocystorhinostomy (DCR) or lacrimal intubation at the St. Erik Eye Hospital, Stockholm, Sweden, completed the Catquest-9SF questionnaire, which measures activity limitations in daily life due to visual disability. The psychometric qualities of the Catquest-9SF results obtained from this group of patients were evaluated by Rasch analysis. Rasch analysis was further employed to convert the ordinal raw data to a Rasch score for comparison with the preoperative scores of patients registered in the Swedish National Cataract Register (NCR) during March 2013. The Catquest-9SF exhibited good psychometric qualities when investigating epiphora patients, with the exception of a misfit for Item 4, the item regarding facial recognition. On the Rasch scale (-5.43 = no activity limitations to +5.01 = severe activity limitations), the mean score for epiphora patients was -0.82 while for patients listed for 1st eye and 2nd eye cataract surgery it was -0.17 and -0.76, respectively. An equivalence test confirmed that the reported visual disability of epiphora patients was not significantly different from visual disability reported by patients waiting for 2nd eye cataract surgery. The Catquest-9SF is a valid measure of visual disability in patients with epiphora. Epiphora patients experience visual disability to the same degree as patients awaiting 2nd eye cataract surgery. © 2017 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

  4. Problems with the factor analysis of items: Solutions based on item response theory and item parcelling

    Directory of Open Access Journals (Sweden)

    Gideon P. De Bruin

    2004-10-01

    Full Text Available The factor analysis of items often produces spurious results in the sense that unidimensional scales appear multidimensional. This may be ascribed to failure in meeting the assumptions of linearity and normality on which factor analysis is based. Item response theory is explicitly designed for the modelling of the non-linear relations between ordinal variables and provides a strong alternative to the factor analysis of items. Items may also be combined in parcels that are more likely to satisfy the assumptions of factor analysis than do the items. The use of the Rasch rating scale model and the factor analysis of parcels is illustrated with data obtained with the Locus of Control Inventory. The results of these analyses are compared with the results obtained through the factor analysis of items. It is shown that the Rasch rating scale model and the factoring of parcels produce superior results to the factor analysis of items. Recommendations for the analysis of scales are made. Opsomming Die faktorontleding van items lewer dikwels misleidende resultate op, veral in die opsig dat eendimensionele skale as meerdimensioneel voorkom. Hierdie resultate kan dikwels daaraan toegeskryf word dat daar nie aan die aannames van lineariteit en normaliteit waarop faktorontleding berus, voldoen word nie. Itemresponsteorie, wat eksplisiet vir die modellering van die nie-liniêre verbande tussen ordinale items ontwerp is, bied ’n aantreklike alternatief vir die faktorontleding van items. Items kan ook in pakkies gegroepeer word wat meer waarskynlik aan die aannames van faktorontleding voldoen as individuele items. Die gebruik van die Rasch beoordelingskaalmodel en die faktorontleding van pakkies word aan die hand van data wat met die Lokus van Beheervraelys verkry is, gedemonstreer. Die resultate van hierdie ontledings word vergelyk met die resultate wat deur ‘n faktorontleding van die individuele items verkry is. Die resultate dui daarop dat die Rasch

  5. Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation

    OpenAIRE

    Kelly D. Bradley; Michael Peabody; Shannon O. Sampson

    2015-01-01

    This study utilized the Rasch model to assess the quality of a survey instrument designed to measure attitudes of administrators and teachers concerning a differentiated teacher compensation program piloted in Kentucky.  Researchers addressing potentially contentious issues should ensure their methods stand up to rigorous criticism.  The results indicate that the rating scale does not function as expected, with items being too easy to endorse.  Future iterations of this survey should be revis...

  6. Identifying Core Competencies of Infection Control Nurse Specialists in Hong Kong.

    Science.gov (United States)

    Chan, Wai Fong; Bond, Trevor G; Adamson, Bob; Chow, Meyrick

    2016-01-01

    To confirm a core competency scale for Hong Kong infection control nurses at the advanced nursing practice level from the core competency items proposed in a previous phase of this study. This would serve as the foundation of competency assurance in Hong Kong hospitals. A cross-sectional survey design was used. All public and private hospitals in Hong Kong. All infection control nurses in hospitals of Hong Kong. The 83-item proposed core competency list established in an earlier study was transformed into a questionnaire and sent to 112 infection control nurses in 48 hospitals in Hong Kong. They were asked to rate the importance of each infection prevention and control item using Likert-style response categories. Data were analyzed using the Rasch model. The response rate of 81.25% was achieved. Seven items were removed from the proposed core competency list, leaving a scale of 76 items that fit the measurement requirements of the unidimensional Rasch model. Essential core competency items of advanced practice for infection control nurses in Hong Kong were identified based on the measurement criteria of the Rasch model. Several items of the scale that reflect local Hong Kong contextual characteristics are distinguished from the overseas standards. This local-specific competency list could serve as the foundation for education and for certification of infection control nurse specialists in Hong Kong. Rasch measurement is an appropriate analytical tool for identifying core competencies of advanced practice nurses in other specialties and in other locations in a manner that incorporates practitioner judgment and expertise.

  7. Evaluation properties of the French version of the OUT-PATSAT35 satisfaction with care questionnaire according to classical and item response theory analyses.

    Science.gov (United States)

    Panouillères, M; Anota, A; Nguyen, T V; Brédart, A; Bosset, J F; Monnier, A; Mercier, M; Hardouin, J B

    2014-09-01

    The present study investigates the properties of the French version of the OUT-PATSAT35 questionnaire, which evaluates the outpatients' satisfaction with care in oncology using classical analysis (CTT) and item response theory (IRT). This cross-sectional multicenter study includes 692 patients who completed the questionnaire at the end of their ambulatory treatment. CTT analyses tested the main psychometric properties (convergent and divergent validity, and internal consistency). IRT analyses were conducted separately for each OUT-PATSAT35 domain (the doctors, the nurses or the radiation therapists and the services/organization) by models from the Rasch family. We examined the fit of the data to the model expectations and tested whether the model assumptions of unidimensionality, monotonicity and local independence were respected. A total of 605 (87.4%) respondents were analyzed with a mean age of 64 years (range 29-88). Internal consistency for all scales separately and for the three main domains was good (Cronbach's α 0.74-0.98). IRT analyses were performed with the partial credit model. No disordered thresholds of polytomous items were found. Each domain showed high reliability but fitted poorly to the Rasch models. Three items in particular, the item about "promptness" in the doctors' domain and the items about "accessibility" and "environment" in the services/organization domain, presented the highest default of fit. A correct fit of the Rasch model can be obtained by dropping these items. Most of the local dependence concerned items about "information provided" in each domain. A major deviation of unidimensionality was found in the nurses' domain. CTT showed good psychometric properties of the OUT-PATSAT35. However, the Rasch analysis revealed some misfitting and redundant items. Taking the above problems into consideration, it could be interesting to refine the questionnaire in a future study.

  8. Use of Robust z in Detecting Unstable Items in Item Response Theory Models

    Science.gov (United States)

    Huynh, Huynh; Meyer, Patrick

    2010-01-01

    The first part of this paper describes the use of the robust z[subscript R] statistic to link test forms using the Rasch (or one-parameter logistic) model. The procedure is then extended to the two-parameter and three-parameter logistic and two-parameter partial credit (2PPC) models. A real set of data was used to illustrate the extension. The…

  9. Affective stress responses during leisure time: Validity evaluation of a modified version of the Stress-Energy Questionnaire.

    Science.gov (United States)

    Hadžibajramović, Emina; Ahlborg, Gunnar; Håkansson, Carita; Lundgren-Nilsson, Åsa; Grimby-Ekman, Anna

    2015-12-01

    Psychosocial stress at work is one of the most important factors behind increasing sick-leave rates. In addition to work stressors, it is important to account for non-work-related stressors when assessing stress responses. In this study, a modified version of the Stress-Energy Questionnaire (SEQ), the SEQ during leisure time (SEQ-LT) was introduced for assessing the affective stress response during leisure time. The aim of this study was to investigate the internal construct validity of the SEQ-LT. A second aim was to define the cut-off points for the scales, which could indicate high and low levels of leisure-time stress and energy, respectively. Internal construct validity of the SEQ-LT was evaluated using a Rasch analysis. We examined the unidimensionality and other psychometric properties of the scale by the fit to the Rasch model. A criterion-based approach was used for classification into high and low stress/energy levels. The psychometric properties of the stress and energy scales of the SEQ-LT were satisfactory, having accommodated for local dependency. The cut-off point for low stress was proposed to be in the interval between 2.45 and 3.02 on the Rasch metric score; while for high stress, it was between 3.65 and 3.90. The suggested cut-off points for the low and high energy levels were values between 1.73-1.97 and 2.66-3.08, respectively. The stress and energy scale of the SEQ-LT satisfied the measurement criteria defined by the Rasch analysis and it provided a useful tool for non-work-related assessment of stress responses. We provide guidelines on how to interpret the scale values. © 2015 the Nordic Societies of Public Health.

  10. Reliability of Composite Dichotomous Measurements

    Czech Academy of Sciences Publication Activity Database

    Martinková, Patrícia; Zvára, Karel

    2010-01-01

    Roč. 6, č. 2 (2010), s. 103-109 ISSN 1801-5603 R&D Projects: GA MŠk(CZ) 1M06014 Institutional research plan: CEZ:AV0Z10300504 Keywords : reliability * binary data * logistic regression * Cronbach alpha * Rasch model * myocardial perfusion diagnosis Subject RIV: BB - Applied Statistics, Operational Research http://www.ejbi.cz/articles/201012/65/1.html

  11. Mesoscale Frontogenesis: An Analysis of Two Cold Front Case Studies

    Science.gov (United States)

    1993-01-01

    marked the boundary of warm air or the "warm sector". Further development of this cyclone model by Bjerknes and Solberg (1922) and Bergeron (1928) provided...represent 25 mn s -1 Relative humidity of greater than 80% indicated by the shaded region in gray. Frontal zones marked with solid black lines. 24 two... Zuckerberg , J.T. Schaefer, and G.E. Rasch, 1986: Forecast problems: The meteorological and operational factors, In: Mesoscale Meteorology and Forecasting

  12. Dimensionality and scaling properties of the Patient Categorisation Tool in patients with complex rehabilitation needs following acquired brain injury

    Directory of Open Access Journals (Sweden)

    Richard J. Siegert

    2018-03-01

    Full Text Available Objective: To investigate the scaling properties of the Patient Categorisation Tool (PCAT as an instrument to measure complexity of rehabilitation needs. Design: Psychometric analysis in a multicentre cohort from the UK national clinical database. Patients: A total of 8,222 patents admitted for specialist inpatient rehabilitation following acquired brain injury. Methods: Dimensionality was explored using principal components analysis with Varimax rotation, followed by Rasch analysis on a random sample of n = 500. Results: Principal components analysis identified 3 components explaining 50% of variance. The partial credit Rasch model was applied for the 17-item PCAT scale using a “super-items” methodology based on the principal components analysis results. Two out of 5 initially created super-items displayed signs of local dependency, which significantly affected the estimates. They were combined into a single super-item resulting in satisfactory model fit and unidimensionality. Differential item functioning (DIF of 2 super-items was addressed by splitting between age groups (<65 and ≥ 65 years to produce the best model fit (χ2/df = 54.72, p = 0.235 and reliability (Person Separation Index (PSI = 0.79. Ordinal-to-interval conversion tables were produced. Conclusion: The PCAT has satisfied expectations of the unidimensional Rasch model in the current sample after minor modifications, and demonstrated acceptable reliability for individual assessment of rehabilitation complexity.

  13. Instrument adaptation and validation to evaluate psychosocial skills and healthy habits in schoolchildren

    Directory of Open Access Journals (Sweden)

    Lucila Niño-Bautista

    2017-12-01

    Full Text Available Objective: To adapt and validate an evaluation tool on psychosocial skills for life and healthy habits in Schoolchildren from a locality in Bogota, Colombia. Materials and methods: This quantitative transversal with empirical analytical non-experimental approach study evaluated responses of schoolchildren in third and fourth grade of primary school with the instrument adapted and reconstructed to establish technical quality of items, reliability and validity of it. The instrument (18 psychosocial skills and 19 healthy habits, plus 4 identification items was self-diligence with Yes, No dichotomous answer option. It had evidence of apparent validity with schoolchildren from other peer institutions and was tested at 32 Public schools and analyzed using the Rasch model. Results: 1,066 schoolchildren participated in total. The items of the two constructs showed a good fit to the Rasch model as well as unidimensionality, reliability and separation measures above the recommended values. There was no differential functioning of the item by sex. Conclusion: The instrument of 37 items presented good properties of validity, reliability and adjustment to Rasch; although it does not have enough items of high difficulty level, which can be corrected in future applications.

  14. A medical/vocational case coordination system for persons with brain injury: an evaluation of employment outcomes.

    Science.gov (United States)

    Malec, J F; Buffington, A L; Moessner, A M; Degiorgio, L

    2000-08-01

    To evaluate initial placement and 1-year employment outcomes of a Medical/Vocational Case Coordination System (MVCCS) for persons with brain injury (BI) that provides: (1) early case identification and coordination, (2) appropriate medical and vocational rehabilitation interventions, (3) work trials, and (4) supported employment interventions including job coaching. One hundred fourteen Minnesota residents, ages 18 to 65 years, with acquired BI. Five levels of Vocational Independence Scale (VIS). Preinjury employment status (VIS) and years of education, severity of initial injury, time since injury, current impairment/disability as measured by the Rasch-analyzed Staff Mayo-Portland Adaptability Inventory (MPAI), and impaired self-awareness measured by staff rating and the difference between Staff MPAI and Survivor MPAI. At placement, 46% in independent work; 25% in transitional placements; 9% in long-term supported employment; 10% in sheltered work; and 10% not placed. At 1-year follow-up (n = 101), 53% in independent work; 19% in transitional placement; 9% in supported work; 6% in sheltered work; and 13% unemployed. Regression analyses showed time since injury and Rasch Staff MPAI predicted VIS at placement; only VIS at placement independently predicted VIS at 1-year follow-up; Rasch Staff MPAI and preinjury education level predicted time to placement. The MVCCS optimized vocational outcome after BI. Time since injury and impairment/disability best predicted vocational placement. Level of initial placement best predicted employment status at follow-up. Persons with greater disability required more extended time and more extensive rehabilitation services before placement.

  15. [Awareness of dysphagia in Parkinson's disease].

    Science.gov (United States)

    Bayés-Rusiñol, Àngels; Forjaz, Maria J; Ayala, Alba; Crespo, M de la Cruz; Prats, Anna; Valles, Esther; Petit, Cristina; Casanovas, Mercè; Garolera-Freixa, Maite

    2011-12-01

    In order to be able to assess the level of awareness of swallowing disorders in Parkinson's disease (PD), a specific questionnaire was designed and validated: the Dysphapark questionnaire. A total of 470 persons with PD were asked whether they believe they have problems swallowing or not, and then they filled in a self-administered questionnaire that evaluates the effectiveness and safety of swallowing. The Dysphapark questionnaire was validated by means of Rasch analysis and classical psychometric methods. The safety and effectiveness dimensions of the Dysphapark fit the Rasch model well. The efficacy dimension showed significant differences for gender, length of the illness, awareness of dysphagia and length of meals. Significant differences were also found in the safety dimension for length and severity of illness, awareness of dysphagia, speech therapy and knowledge of thickening agents. Despite the fact that 90% of patients had problems concerning effectiveness and safety in swallowing, 79.45% were not aware that they suffered from dysphagia. The Dysphapark questionnaire is a suitable measure of dysphagia in PD, according to the Rasch analysis. A high proportion of patients with PD have dysphagia, although it has been observed that they have a low level of awareness of the condition, of the consequences it may have and of the possibility of using thickening agents. Given that some of the swallowing disorders in PD are asymptomatic and that the level of awareness of the disorder is low, we recommend including specific questionnaires as well as clinical and instrumental evaluation of dysphagia in clinical practice.

  16. Measurement properties of the CLOX Executive Clock Drawing Task in an inpatient stroke rehabilitation setting.

    Science.gov (United States)

    Zuverza-Chavarria, Virginia; Tsanadis, John

    2011-05-01

    The goal of this study was to explore the psychometric properties of the CLOX Executive Clock Drawing Task (Royall, Cordes, & Polk, 1998) in persons who had sustained a stroke and were receiving inpatient rehabilitation. Rasch modeling was utilized to examine the psychometric properties of the CLOX. Separate analyses were conducted for the free draw (CLOX 1) and copy (CLOX 2) portions of the measure to investigate each presentation mode independently. The sample consisted of 66 inpatient adults who had sustained a stroke. CLOX 1 met most Rasch model expectations for item fit, unidimensionality, test reliability, and sample targeting. CLOX 2 was less psychometrically sound and contained two items with significant misfit. CLOX 2 demonstrated a significant ceiling effect that resulted in poor sample targeting. CLOX 1 is a psychometrically sound screening instrument for assessing persons with stroke receiving inpatient rehabilitation. In addition to the psychometric weaknesses of CLOX 2, its interpretive yield is minimal and clinicians may consider omitting it. Recommendations are made for using the Rasch item-person maps in clinical practice.

  17. Validation and reliability of the VF-14 questionnaire in a German population.

    Science.gov (United States)

    Chiang, Peggy Pei-Chia; Fenwick, Eva; Marella, Manjula; Finger, Robert; Lamoureux, Ecosse

    2011-11-21

    To evaluate the validity, reliability, and measurement characteristics of the Visual Function 14 (VF-14) in a German sample using Rasch analysis. This was a clinic-based, cross-sectional study with 184 patients with low vision recruited from an outpatient clinic at a German eye hospital. Participants underwent a clinical examination and completed the German VF-14 scale. The validity of the VF-14 scale was assessed using Rasch analysis. The main outcome measure was the overall functional score provided by the VF-14. After collapsing two response categories for items 13 and 14, the VF-14 scale satisfied fundamental criteria to achieve fit to the Rasch model, namely, ordered thresholds, the ability to distinguish between different strata of participant ability, absence of misfitting items, no evidence of unidimensionality, and no significant differential item functioning for key sociodemographic covariates. The VF-14 is able to discriminate between participants with different levels of vision impairment and across different cultural groups. The VF-14 is a valid, reliable, and unidimensional questionnaire for use in a German population. These findings contribute to the growing evidence base for second generation patient reported outcome measures in ophthalmology, and support the use of the German VF-14 in tertiary eye clinics in Germany to capture the impact of visual impairment on visual function from the patient's perspective and to inform low vision rehabilitation and interventions.

  18. Validity of the impact on participation and autonomy questionnaire: a comparison between two countries.

    Science.gov (United States)

    Kersten, Paula; Cardol, Mieke; George, Steve; Ward, Christopher; Sibley, Andrew; White, Barney

    2007-10-15

    To evaluate the cross-cultural validity of the five subscales of the Impact on Participation and Autonomy (IPA) measure and the full 31-item scale. Data from two validation studies (Dutch and English) were pooled (n = 106). Participants (aged 18-75), known to rehabilitation services or GP practices, had conditions ranging from minor ailments to significant disability. Validity of the five subscales and the total scale was examined using Rasch analysis (Partial Credit Model). P values smaller than 0.01 were employed to allow for multiple testing. A number of items in all the subscales except 'Outdoor Autonomy' needed rescoring. One 'Indoor Autonomy' item showed uniform DIF by country and was split by country. One 'Work and Education' item displayed uniform and non-uniform DIF by gender. All the subscales fitted the Rasch model and were invariant across country. A 30-item IPA also fitted the Rasch model. The IPA subscales and a 30-item scale are invariant across the two cultures and gender. The IPA can be used validly to assess participation and autonomy in these populations. Further analyses are required to examine whether the IPA is invariant across differing levels of disability and other disease groups not included in this study.

  19. Pain-related impairment of daily activities after thoracic surgery: a questionnaire validation.

    Science.gov (United States)

    Ringsted, Thomas K; Wildgaard, Kim; Kreiner, Svend; Kehlet, Henrik

    2013-09-01

    Persistent postoperative pain is an acknowledged entity that reduces daily activities. Evaluation of the post-thoracotomy pain syndrome (PTPS) is often measured using traditional pain scales without in-depth questions on pain impairment. Thus, the purpose was to create a procedure-specific questionnaire for assessment of functional impairment due to PTPS. Activities were obtained from the literature supplemented by interviews with patients and surgeons. The questionnaire was validated using the Rasch model in order to describe an underlying pain impairment scale. Four of 17 questions were redundant. The remaining 13 questions from low to intensive activity described functional impairment following persistent pain from thoracotomy and video-assisted thoracic surgery (VATS). No evidence for differential item functioning for gender, age or differences between open or VATS, were found. A generalized log-linear Rasch model including local dependence was constructed. Though local dependence influenced reliability, the test-retest reliability estimated under the log-linear Rasch model was high (0.88-0.96). Correlation with items from the Disability of the Arm, Shoulder and Hand (quick) questionnaire supported validity (γ = 0.46, P impairment questionnaire measured 2 qualitatively different pain dimensions although highly correlated (γ = 0.76). This study presents method, results and validation of a new unidimensional scale measuring procedure specific functional impairment due to PTPS following open surgery and VATS. Procedure specific tools such as this could provide important outcomes measures for future trials on persistent postsurgical pain states allowing better assessment of interventions (250).

  20. Development of a patient reported outcome scale for fatigue in multiple sclerosis: The Neurological Fatigue Index (NFI-MS

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2010-02-01

    Full Text Available Abstract Background Fatigue is a common and debilitating symptom in multiple sclerosis (MS. Best-practice guidelines suggest that health services should repeatedly assess fatigue in persons with MS. Several fatigue scales are available but concern has been expressed about their validity. The objective of this study was to examine the reliability and validity of a new scale for MS fatigue, the Neurological Fatigue Index (NFI-MS. Methods Qualitative analysis of 40 MS patient interviews had previously contributed to a coherent definition of fatigue, and a potential 52 item set representing the salient themes. A draft questionnaire was mailed out to 1223 people with MS, and the resulting data subjected to both factor and Rasch analysis. Results Data from 635 (51.9% response respondents were split randomly into an 'evaluation' and 'validation' sample. Exploratory factor analysis identified four potential subscales: 'physical', 'cognitive', 'relief by diurnal sleep or rest' and 'abnormal nocturnal sleep and sleepiness'. Rasch analysis led to further item reduction and the generation of a Summary scale comprising items from the Physical and Cognitive subscales. The scales were shown to fit Rasch model expectations, across both the evaluation and validation samples. Conclusion A simple 10-item Summary scale, together with scales measuring the physical and cognitive components of fatigue, were validated for MS fatigue.

  1. Measuring practical knowledge about balanced meals: development and validation of the brief PKB-7 scale.

    Science.gov (United States)

    Mötteli, S; Barbey, J; Keller, C; Bucher, T; Siegrist, M

    2016-04-01

    As a high-quality diet is associated with a lower risk for several diseases and all-cause mortality, current nutrition education tools provide people with information regarding how to build a healthy and a balanced meal. To assess this basic nutrition knowledge, the research aim was to develop and validate a brief scale to measure the Practical Knowledge about Balanced meals (PKB-7). A pool of 25 items was pretested with experts and laypeople before being tested on a random sample in Switzerland (n=517). For item selection, a Rasch model analysis was applied. The validity and reliability of the new scale were assessed by three additional studies including laypeople (n=597; n=145) and nutrition experts (n=59). The final scale consists of seven multiple-choice items, which met the assumptions of the Rasch model. The validity of the new scale was shown by several aspects: the Rasch model was replicated in a second study, and nutrition experts achieved significantly higher scores than laypeople (t(148)=20.27, Pbalanced meals based on current dietary guidelines. This brief and easy-to-use scale is intended for application in both research and practice.

  2. Towards an ICF-based clinical measure of functioning in people with ankylosing spondylitis: a methodological exploration.

    Science.gov (United States)

    Cieza, A; Hilfiker, R; Boonen, A; van der Heijde, D; Braun, J; Stucki, G

    2009-01-01

    To explore whether it is possible to construct clinical measures of functioning for patients with ankylosing spondylitis (AS) by integrating information obtained across categories of the International Classification of Functioning, Disability and Health (ICF). Sixty-eight ICF categories that were identified as relevant by patients with AS and that covered body functions, structures, and activity and participation were analysed based on the Rasch model for ordered response options. The following properties were studied: unidimensionality, reliability, fit of the ICF categories to the Rasch model, the appropriateness of the order of the response options of the ICF qualifier, and the targeting between the ICF categories and the person's abilities. After accounting for disordered thresholds and misfitting ICF categories, a clinical measure of functioning for AS was proposed that contained 64 ICF categories. On the basis of a transformation table, the raw scores obtained by adding the answers to the 64 ICF categories can be transformed to the Rasch logit scale and to a meaningful interval scale ranging from zero to 100. For the first time, it has been shown that clinical measures of functioning, in principle, can be constructed based on the comprehensive ICF framework covering body functions and structures and activities and participation domains. The results of this investigation are preliminary and must be validated, but they are promising and can contribute to the acceptance and usefulness of the ICF in clinical practice.

  3. Development of a Computerized Adaptive Test of Children's Gross Motor Skills.

    Science.gov (United States)

    Huang, Chien-Yu; Tung, Li-Chen; Chou, Yeh-Tai; Wu, Hing-Man; Chen, Kuan-Lin; Hsieh, Ching-Lin

    2018-03-01

    To (1) develop a computerized adaptive test for gross motor skills (GM-CAT) as a diagnostic test and an outcome measure, using the gross motor skills subscale of the Comprehensive Developmental Inventory for Infants and Toddlers (CDIIT-GM) as the candidate item bank; and (2) examine the psychometric properties and the efficiency of the GM-CAT. Retrospective study. A developmental center of a medical center. Children with and without developmental delay (N=1738). Not applicable. The CDIIT-GM contains 56 universal items on gross motor skills assessing children's antigravity control, locomotion, and body movement coordination. The item bank of the GM-CAT had 44 items that met the dichotomous Rasch model's assumptions. High Rasch person reliabilities were found for each estimated gross motor skill for the GM-CAT (Rasch person reliabilities =.940-.995, SE=.68-2.43). For children aged 6 to 71 months, the GM-CAT had good concurrent validity (r values =.97-.98), adequate to excellent diagnostic accuracy (area under receiver operating characteristics curve =.80-.98), and moderate to large responsiveness (effect size =.65-5.82). The averages of items administered for the GM-CAT were 7 to 11, depending on the age group. The results of this study support the use of the GM-CAT as a diagnostic and outcome measure to estimate children's gross motor skills in both research and clinical settings. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  4. Preliminary study to evaluate the validity of the mini-mental state examination in a normal population in Turkey.

    Science.gov (United States)

    Küçükdeveci, Ayse A; Kutlay, Sehim; Elhan, Atilla H; Tennant, Alan

    2005-03-01

    Although the Mini-Mental State Examination (MMSE) is widely used in clinical practice, normative scores for a healthy population have not been documented in Turkey. The aim in this study was to validate the MMSE in a healthy population and to provide normal scores. Internal construct validity of the Turkish version of MMSE among a preliminary sample of 406 normal people was assessed by Rasch unidimensional measurement model. Scores of the normal sample varied according to age and education but not according to sex. The data derived from this sample showed poor fit to the Rasch model (mean item fit, -2.082, SD 3.022). Only four of 11 items met model expectations. There was also differential item functioning by education and age for most items. Thus the internal construct validity of the Turkish MMSE in a normative sample could not be demonstrated by Rasch analysis. The scale failed modern psychometric criteria for scalability. We would therefore suggest other large normative MMSE data sets to be tested in terms of internal construct validity. If these findings are replicated, the validity of MMSE norms and their consequent use in clinical practice should be reconsidered.

  5. Measuring Life Satisfaction in Parkinson's Disease and Healthy Controls Using the Satisfaction With Life Scale.

    Science.gov (United States)

    Løvereide, Lise; Hagell, Peter

    2016-01-01

    The 5-item Satisfaction With Life Scale (SWLS) was designed to measure general life satisfaction (LS). Here we examined the psychometric properties of the SWLS in a cohort of persons with Parkinson`s disease (PwPD) and age and gender matched individuals without PD. The SWLS was administered to PwPD and controls from the Norwegian ParkWest study at 5 and 7 years after the time of diagnosis. Data were analysed according to classical test theory (CTT) and Rasch measurement theory. CTT scaling assumptions for computation of a SWLS total score were met (corrected item-total correlations >0.58). The SWLS was reasonably well targeted to the sample and had good reliability (ordinal alpha, 0.92). The scale exhibited good fit to the Rasch model and successfully separated between 5 statistically distinct strata of people (levels of SWLS). The seven response categories did not work as intended and the scale may benefit from reduction to five response categories. There was no clinically significant differential item functioning. Separate analyses in PwPD and controls yielded very similar results to those from the pooled analysis. This study supports the SWLS as a valid instrument for measuring LS in PD and controls. However, Rasch analyses provided new insights into the performance and validity of the SWLS and identified areas for future revisions in order to further improve the scale.

  6. Integration of climatic indices in an objective probabilistic model for establishing and mapping viticultural climatic zones in a region

    Science.gov (United States)

    Moral, Francisco J.; Rebollo, Francisco J.; Paniagua, Luis L.; García, Abelardo; Honorio, Fulgencio

    2016-05-01

    Different climatic indices have been proposed to determine the wine suitability in a region. Some of them are related to the air temperature, but the hydric component of climate should also be considered which, in turn, is influenced by the precipitation during the different stages of the grapevine growing and ripening periods. In this study, we propose using the information obtained from ten climatic indices [heliothermal index (HI), cool night index (CI), dryness index (DI), growing season temperature (GST), the Winkler index (WI), September mean thermal amplitude (MTA), annual precipitation (AP), precipitation during flowering (PDF), precipitation before flowering (PBF), and summer precipitation (SP)] as inputs in an objective and probabilistic model, the Rasch model, with the aim of integrating the individual effects of them, obtaining the climate data that summarize all main climatic indices, which could influence on wine suitability from a climate viewpoint, and utilizing the Rasch measures to generate homogeneous climatic zones. The use of the Rasch model to estimate viticultural climatic suitability constitutes a new application of great practical importance, enabling to rationally determine locations in a region where high viticultural potential exists and establishing a ranking of the climatic indices which exerts an important influence on wine suitability in a region. Furthermore, from the measures of viticultural climatic suitability at some locations, estimates can be computed using a geostatistical algorithm, and these estimates can be utilized to map viticultural climatic zones in a region. To illustrate the process, an application to Extremadura, southwestern Spain, is shown.

  7. The Swedish version of the Acceptance of Chronic Health Conditions Scale for people with multiple sclerosis: Translation, cultural adaptation and psychometric properties.

    Science.gov (United States)

    Forslin, Mia; Kottorp, Anders; Kierkegaard, Marie; Johansson, Sverker

    2016-11-11

    To translate and culturally adapt the Acceptance of Chronic Health Conditions (ACHC) Scale for people with multiple sclerosis into Swedish, and to analyse the psychometric properties of the Swedish version. Ten people with multiple sclerosis participated in translation and cultural adaptation of the ACHC Scale; 148 people with multiple sclerosis were included in evaluation of the psychometric properties of the scale. Translation and cultural adaptation were carried out through translation and back-translation, by expert committee evaluation and pre-test with cognitive interviews in people with multiple sclerosis. The psychometric properties of the Swedish version were evaluated using Rasch analysis. The Swedish version of the ACHC Scale was an acceptable equivalent to the original version. Seven of the original 10 items fitted the Rasch model and demonstrated ability to separate between groups. A 5-item version, including 2 items and 3 super-items, demonstrated better psychometric properties, but lower ability to separate between groups. The Swedish version of the ACHC Scale with the original 10 items did not fit the Rasch model. Two solutions, either with 7 items (ACHC-7) or with 2 items and 3 super-items (ACHC-5), demonstrated acceptable psychometric properties. Use of the ACHC-5 Scale with super-items is recommended, since this solution adjusts for local dependency among items.

  8. Validation of the educational needs assessment tool as a generic instrument for rheumatic diseases in seven European countries.

    Science.gov (United States)

    Ndosi, Mwidimi; Bremander, Ann; Hamnes, Bente; Horton, Mike; Kukkurainen, Marja Leena; Machado, Pedro; Marques, Andrea; Meesters, Jorit; Stamm, Tanja A; Tennant, Alan; de la Torre-Aboki, Jenny; Vliet Vlieland, Theodora P M; Zangi, Heidi A; Hill, Jackie

    2014-12-01

    To validate the educational needs assessment tool (ENAT) as a generic tool for assessing the educational needs of patients with rheumatic diseases in European Countries. A convenience sample of patients from seven European countries was included comprising the following diagnostic groups: ankylosing spondylitis, psoriatic arthritis, systemic sclerosis, systemic lupus erythematosus, osteoarthritis (OA) and fibromyalgia syndrome. Translated versions of the ENAT were completed through surveys in each country. Rasch analysis was used to assess the construct validity of the adapted ENATs including differential item functioning by culture (cross-cultural DIF). Initially, the data from each country and diagnostic group were fitted to the Rasch model separately, and then the pooled data from each diagnostic group. The sample comprised 3015 patients; the majority, 1996 (66.2%), were women. Patient characteristics (stratified by diagnostic group) were comparable across countries except the educational background, which was variable. In most occasions, the 39-item ENAT deviated significantly from the Rasch model expectations (item-trait interaction χ(2) pseven domains and analysing them as 'testlets'), fit to the model was satisfied (item-trait interaction χ(2) p>0.18) in all pooled disease group datasets except OA (χ(2)=99.91; p=0.002). The internal consistency in each group was high (Person Separation Index above 0.90). There was no significant DIF by person characteristics. Cross-cultural DIF was found in some items, which required adjustments. Subsequently, interval-level scales were calibrated to enable transformation of ENAT scores when required. The adapted ENAT is a valid tool with high internal consistency providing accurate estimation of the educational needs of people with rheumatic diseases. Cross-cultural comparison of educational needs is now possible. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a

  9. Evaluating judge performance in sport.

    Science.gov (United States)

    Looney, Marilyn A

    2004-01-01

    Many sports, such as, gymnastics, diving, ski jumping, and figure skating, use judges' scores to determine the winner of a competition. These judges use some type of rating scale when judging performances (e.g., figure skating: 0.0 - 6.0). Sport governing bodies have the responsibility of setting and enforcing quality control parameters for judge performance. Given the judging scandals in figure skating at the 1998 and 2002 Olympics, judge performance in sport is receiving greater scrutiny. The purpose of this article is to illustrate how results from Rasch analyses can be used to provide in-depth feedback to judges about their scoring patterns. Nine judges' scores for 20 pairs of figure skaters who competed at the 2002 Winter Olympics were analyzed using a four-faceted (skater pair ability, skating aspect difficulty, program difficulty, and judge severity) Rasch rating scale model that was not common to all judges. Fit statistics, the logical ordering of skating aspects, skating programs, and separation indices all indicated a good fit of the data to the model. The type of feedback that can be given to judges about their scoring pattern was illustrated for one judge (USA) whose performance was flagged as being unpredictable. Feedback included a detailed description of how the rating scale was used; for example, 10% of all marks given by the American judge were unexpected by the model (Z > |2|). Three figures illustrated differences between the judge's observed and expected marks arranged according to the pairs' skating order and final placement in the competition. Scores which may represent "nationalistic bias" or a skating order influence were flagged by looking at these figures. If sport governing bodies wish to improve the performance of their judges, they need to employ methods that monitor the internal consistency of each judge as a many-facet Rasch analysis does.

  10. Is the Parkinson Anxiety Scale comparable across raters?

    Science.gov (United States)

    Forjaz, Maria João; Ayala, Alba; Martinez-Martin, Pablo; Dujardin, Kathy; Pontone, Gregory M; Starkstein, Sergio E; Weintraub, Daniel; Leentjens, Albert F G

    2015-04-01

    The Parkinson Anxiety Scale is a new scale developed to measure anxiety severity in Parkinson's disease specifically. It consists of three dimensions: persistent anxiety, episodic anxiety, and avoidance behavior. This study aimed to assess the measurement properties of the scale while controlling for the rater (self- vs. clinician-rated) effect. The Parkinson Anxiety Scale was administered to a cross-sectional multicenter international sample of 362 Parkinson's disease patients. Both patients and clinicians rated the patient's anxiety independently. A many-facet Rasch model design was applied to estimate and remove the rater effect. The following measurement properties were assessed: fit to the Rasch model, unidimensionality, reliability, differential item functioning, item local independency, interrater reliability (self or clinician), and scale targeting. In addition, test-retest stability, construct validity, precision, and diagnostic properties of the Parkinson Anxiety Scale were also analyzed. A good fit to the Rasch model was obtained for Parkinson Anxiety Scale dimensions A and B, after the removal of one item and rescoring of the response scale for certain items, whereas dimension C showed marginal fit. Self versus clinician rating differences were of small magnitude, with patients reporting higher anxiety levels than clinicians. The linear measure for Parkinson Anxiety Scale dimensions A and B showed good convergent construct with other anxiety measures and good diagnostic properties. Parkinson Anxiety Scale modified dimensions A and B provide valid and reliable measures of anxiety in Parkinson's disease that are comparable across raters. Further studies are needed with dimension C. © 2014 International Parkinson and Movement Disorder Society.

  11. Another Look at the PART-O Using the Traumatic Brain Injury Model Systems National Database: Scoring to Optimize Psychometrics.

    Science.gov (United States)

    Malec, James F; Whiteneck, Gale G; Bogner, Jennifer A

    2016-02-01

    To integrate previous approaches to scoring the Participation Assessment with Recombined Tools-Objective (PART-O) in a unidimensional scale. Retrospective analysis of PART-O data from the Traumatic Brain Injury Model Systems. Community. Data from individuals (N=469) selected randomly from participants who completed 1-year follow-up in the Traumatic Brain Injury Model Systems were used in Rasch model development. The model was subsequently tested on data from additional random samples of similar size at 1-, 2-, 5-, 10-, and >15-year follow-ups. Not applicable. PART-O. After combining items for productivity and social interaction, the initial analysis at 1-year follow-up indicated relatively good fit to the Rasch model (person reliability=.80) but also suggested item misfit and that the 0-to-5 scale used for most items did not consistently show clear separation between rating levels. Reducing item rating scales to 3 levels (except combined and dichotomous items) resolved these issues and demonstrated good item level discrimination, fit, and person reliability (.81), with no evidence of multidimensionality. These results replicated in analyses at each additional follow-up period. Modifications to item scoring for the PART-O resulted in a unidimensional parametric equivalent measure that addresses previous concerns about competing item relations, and it fit the Rasch model consistently across follow-up periods. The person-item map shows a progression toward greater community participation from solitary and dyadic activities, such as leaving the house and having a friend through social and productivity activities, to group activities with others who share interests or beliefs. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

  12. Villa Marie Nursing Home, Grange, Templemore Road, Roscrea, Tipperary.

    LENUS (Irish Health Repository)

    Hardouin, Jean-Benoit

    2011-07-14

    Abstract Background Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of this paper is to compare sixteen methods for handling the missing data (mainly based on simple imputation) in the context of psychometric validation of PRO by a Rasch model. The main indexes used for validation by a Rasch model are compared. Methods A simulation study was performed allowing to consider several cases, notably the possibility for the missing values to be informative or not and the rate of missing data. Results Several imputations methods produce bias on psychometrical indexes (generally, the imputation methods artificially improve the psychometric qualities of the scale). In particular, this is the case with the method based on the Personal Mean Score (PMS) which is the most commonly used imputation method in practice. Conclusions Several imputation methods should be avoided, in particular PMS imputation. From a general point of view, it is important to use an imputation method that considers both the ability of the patient (measured for example by his\\/her score), and the difficulty of the item (measured for example by its rate of favourable responses). Another recommendation is to always consider the addition of a random process in the imputation method, because such a process allows reducing the bias. Last, the analysis realized without imputation of the missing data (available case analyses) is an interesting alternative to the simple imputation in this context.

  13. Development and initial validation of the Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) in primary care.

    Science.gov (United States)

    Van, Connie; Costa, Daniel; Mitchell, Bernadette; Abbott, Penny; Krass, Ines

    2012-01-01

    Existing validated measures of pharmacist-physician collaboration focus on measuring attitudes toward collaboration and do not measure frequency of collaborative interactions. To develop and validate an instrument to measure the frequency of collaboration between pharmacists and general practitioners (GPs) from the pharmacist's perspective. An 11-item Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) was developed and administered to 586 pharmacists in 8 divisions of general practice in New South Wales, Australia. The initial items were informed by a review of the literature in addition to interviews of pharmacists and GPs. Items were subjected to principal component and Rasch analyses to determine each item's and the overall measure's psychometric properties and for any needed refinements. Two hundred and twenty four (38%) of pharmacist surveys were completed and returned. Principal component analysis suggested removal of 1 item for a final 1-factor solution. The refined 10-item FICI-P demonstrated internal consistency reliability at Cronbach's alpha=0.90. After collapsing the original 5-point response scale to a 4-point response scale, the refined FICI-P demonstrated fit to the Rasch model. Criterion validity of the FICI-P was supported by the correlation of FICI-P scores with scores on a previously validated Physician-Pharmacist Collaboration Instrument. Validity was also supported by predicted differences in FICI-P scores between subgroups of respondents stratified on age, colocation with GPs, and interactions during the intern-training period. The refined 10-item FICI-P was shown to have good internal consistency, criterion validity, and fit to the Rasch model. The creation of such a tool may allow for the measure of impact in the evaluation of interventions designed to improve interprofessional collaboration between GPs and pharmacists. Copyright © 2012 Elsevier Inc. All rights reserved.

  14. Reliability and validity of the Turkish version of the Rapid Estimate of Adult Literacy in Dentistry (TREALD-30).

    Science.gov (United States)

    Peker, Kadriye; Köse, Taha Emre; Güray, Beliz; Uysal, Ömer; Erdem, Tamer Lütfi

    2017-04-01

    To culturally adapt the Turkish version of Rapid Estimate of Adult Literacy in Dentistry (TREALD-30) for Turkish-speaking adult dental patients and to evaluate its psychometric properties. After translation and cross-cultural adaptation, TREALD-30 was tested in a sample of 127 adult patients who attended a dental school clinic in Istanbul. Data were collected through clinical examinations and self-completed questionnaires, including TREALD-30, the Oral Health Impact Profile (OHIP), the Rapid Estimate of Adult Literacy in Medicine (REALM), two health literacy screening questions, and socio-behavioral characteristics. Psychometric properties were examined using Classical Test Theory (CTT) and Rasch analysis. Internal consistency (Cronbach's Alpha = 0.91) and test-retest reliability (Intraclass correlation coefficient = 0.99) were satisfactory for TREALD-30. It exhibited good convergent and predictive validity. Monthly family income, years of education, dental flossing, health literacy, and health literacy skills were found as stronger predictors of patients'oral health literacy (OHL). Confirmatory factor analysis (CFA) confirmed a two-factor model. The Rasch model explained 37.9% of the total variance in this dataset. In addition, TREALD-30 had eleven misfitting items, which indicated evidence of multidimensionality. The reliability indeces provided in Rasch analysis (person separation reliability = 0.91 and expected-a-posteriori/plausible reliability = 0.94) indicated that TREALD-30 had acceptable reliability. TREALD-30 showed satisfactory psychometric properties. It may be used to identify patients with low OHL. Socio-demographic factors, oral health behaviors and health literacy skills should be taken into account when planning future studies to assess the OHL in both clinical and community settings.

  15. The patient satisfaction questionnaire of EUprimecare project: measurement properties.

    Science.gov (United States)

    Cimas, Marta; Ayala, Alba; García-Pérez, Sonia; Sarria-Santamera, Antonio; Forjaz, Maria João

    2016-06-01

    The measurement of patient satisfaction is considered an essential outcome indicator to evaluate health care quality. Patient satisfaction is considered a multi-dimensional construct, which would include a variety of domains. Although a large number of studies have proposed scales to measure patient satisfaction, there is a lack of psychometric information on them. This study aims to describe the psychometric properties of the Primary Care Satisfaction Scale (PCSS) of the EUprimecare project. A cross-sectional survey of patient satisfaction with primary care was carried out by telephone interview. Primary care services of Estonia, Finland, Germany, Hungary, Lithuania, Italy and Spain. A total of 3020 adult patients aged 18-65 years old attending primary care services. Classic psychometric properties were analysed and Rasch analysis was used to assess the following measurement properties: fit to the Rasch model; uni-dimensionality; reliability; differential item functioning (DIF) by gender, age, civil status, area of residency and country; local independency; adequacy of response scale; and scale targeting. To achieve good fit to the Rasch model, the original response scales of three items (1, 2 and 6) were rescored and Item 3 (waiting time in the room) was removed. The scale was uni-dimensional and Person Separation Index was 0.79, indicating a good reliability. All items were free from bias. PCSS linear measure displayed satisfactory convergent validity with overall satisfaction with primary care. PCSS, as a reliable and valid scale, could be used to measure patient satisfaction in primary care in Europe. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

  16. Assessing normative cut points through differential item functioning analysis: An example from the adaptation of the Middlesex Elderly Assessment of Mental State (MEAMS for use as a cognitive screening test in Turkey

    Directory of Open Access Journals (Sweden)

    Kutlay Sehim

    2006-03-01

    Full Text Available Abstract Background The Middlesex Elderly Assessment of Mental State (MEAMS was developed as a screening test to detect cognitive impairment in the elderly. It includes 12 subtests, each having a 'pass score'. A series of tasks were undertaken to adapt the measure for use in the adult population in Turkey and to determine the validity of existing cut points for passing subtests, given the wide range of educational level in the Turkish population. This study focuses on identifying and validating the scoring system of the MEAMS for Turkish adult population. Methods After the translation procedure, 350 normal subjects and 158 acquired brain injury patients were assessed by the Turkish version of MEAMS. Initially, appropriate pass scores for the normal population were determined through ANOVA post-hoc tests according to age, gender and education. Rasch analysis was then used to test the internal construct validity of the scale and the validity of the cut points for pass scores on the pooled data by using Differential Item Functioning (DIF analysis within the framework of the Rasch model. Results Data with the initially modified pass scores were analyzed. DIF was found for certain subtests by age and education, but not for gender. Following this, pass scores were further adjusted and data re-fitted to the model. All subtests were found to fit the Rasch model (mean item fit 0.184, SD 0.319; person fit -0.224, SD 0.557 and DIF was then found to be absent. Thus the final pass scores for all subtests were determined. Conclusion The MEAMS offers a valid assessment of cognitive state for the adult Turkish population, and the revised cut points accommodate for age and education. Further studies are required to ascertain the validity in different diagnostic groups.

  17. Development of Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life (PROMPT-QoL): A novel instrument for medication management.

    Science.gov (United States)

    Sakthong, Phantipa; Suksanga, Phattrapa; Sakulbumrungsil, Rungpetch; Winit-Watjana, Win

    2015-01-01

    Medicines can affect a patient's health-related quality of life (HRQoL), but there exists no standardized HRQoL measure for medication management. To develop the new HRQoL instrument "Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life" (PROMPT-QoL), and to evaluate its content validity and preliminary psychometrics using a Rasch model. The PROMPT-QoL questionnaire was developed through the concept review, item generation, cognitive interviews, and initial psychometric evaluation. Its first draft was initially tested by Round-1 interviews of 120 adult outpatients taking their medicines at least three months continuously. The final draft with 43 items was then constructed and checked by 10 physicians and 5 pharmacists for the questionnaire importance and content validity. Round-2 interviews in six patient groups with 10 patients of each were conducted to elicit patients' understanding of the questionnaire and assess preliminary psychometrics using the Rasch analysis, including fit statistics, person and item reliabilities. The 43-item PROMPT-QoL comprised 10 domains: General Attitude toward Medication Use, Medicine Information, Disease Information, Medicine Effectiveness, Impacts of Medicines and Side-effects, Psychological Impacts of Medication Use, Convenience, Availability and Accessibility, Therapeutic Relationship with Healthcare Providers, and Overall QoL. Based on the patient interviews and expert review, the questionnaire was considered important, useful, and comprehensive. All items and domains yielded content validity indexes above the acceptable values of 0.80 and 0.90, respectively. In Round 2, thirty-nine problems identified in Group 1 were reduced to two issues in Group 6 after amendments. The Rasch analysis revealed eight items were misfit and two domains were reliable for both personal and item aspects (Medicine Information and Psychological Impacts of Medication Use). The newly developed PROMPT-QoL has favorable content

  18. Correlations between M-CHARTS and PHP findings and subjective perception of metamorphopsia in patients with macular diseases.

    Science.gov (United States)

    Arimura, Eiko; Matsumoto, Chota; Nomoto, Hiroki; Hashimoto, Shigeki; Takada, Sonoko; Okuyama, Sachiko; Shimomura, Yoshikazu

    2011-01-05

    To assess the correlations between a patient's subjective perception of metamorphopsia and the clinical measurements of metamorphopsia by M-CHARTS and PreView PHP (PHP). The authors designed a 10-item questionnaire focusing on the symptoms of metamorphopsia and verified its validity with a Rasch analysis. M-CHARTS measured the minimum visual angle of a dotted line needed to detect metamorphopsia, and PHP used the hyperacuity function for detection. Subjects were 39 patients with idiopathic epiretinal membrane (ERM), 22 patients with idiopathic macular hole (M-hole), 19 patients with age-related macular degeneration (AMD), and 51 healthy controls. Rasch analysis suggested the elimination of one question. The nine-item questionnaire score significantly correlated to the M-CHARTS score in ERM (r = 0.59; P = 0.0004) but not in M-hole and to the PHP result in AMD (r = -0.29; P = 0.04) but not in ERM. Eighty percent of ERM patients with greater horizontal M-CHARTS score subjectively perceived horizontal metamorphopsia more often. M-CHARTS showed better sensitivities than PHP in both ERM (89% vs. 42%) and AMD (74% vs. 68%) and better specificity (100% vs. 71%) in healthy controls. Rasch analysis indicated that the present form of the questionnaire is better suited for moderate to severe cases of metamorphopsia than for mild cases. The questionnaire appears to be a valid assessment of patient subjective perception of metamorphopsia and can be used to supplement the clinical measurements of metamorphopsia by M-CHARTS and PHP in patients with macular diseases.

  19. Metrology of human-based and other qualitative measurements

    Science.gov (United States)

    Pendrill, Leslie; Petersson, Niclas

    2016-09-01

    The metrology of human-based and other qualitative measurements is in its infancy—concepts such as traceability and uncertainty are as yet poorly developed. This paper reviews how a measurement system analysis approach, particularly invoking as performance metric the ability of a probe (such as a human being) acting as a measurement instrument to make a successful decision, can enable a more general metrological treatment of qualitative observations. Measures based on human observations are typically qualitative, not only in sectors, such as health care, services and safety, where the human factor is obvious, but also in customer perception of traditional products of all kinds. A principal challenge is that the usual tools of statistics normally employed for expressing measurement accuracy and uncertainty will probably not work reliably if relations between distances on different portions of scales are not fully known, as is typical of ordinal or other qualitative measurements. A key enabling insight is to connect the treatment of decision risks associated with measurement uncertainty to generalized linear modelling (GLM). Handling qualitative observations in this way unites information theory, the perceptive identification and choice paradigms of psychophysics. The Rasch invariant measure psychometric GLM approach in particular enables a proper treatment of ordinal data; a clear separation of probe and item attribute estimates; simple expressions for instrument sensitivity; etc. Examples include two aspects of the care of breast cancer patients, from diagnosis to rehabilitation. The Rasch approach leads in turn to opportunities of establishing metrological references for quality assurance of qualitative measurements. In psychometrics, one could imagine a certified reference for knowledge challenge, for example, a particular concept in understanding physics or for product quality of a certain health care service. Multivariate methods, such as Principal Component

  20. Development and preliminary validation of the EASE: a tool to measure perceived singing voice function.

    Science.gov (United States)

    Phyland, Debra J; Pallant, Julie F; Benninger, Michael S; Thibeault, Susan L; Greenwood, Ken M; Smith, Julian A; Vallance, Neil

    2013-07-01

    Most voice self-rating tools are disease-specific measures and are not suitable for use with healthy voice users. There is a need for a tool that is sensitive to the subtleties of a singer's voice and to perceived physical changes in the singing voice mechanism as a function of load. The aim of this study was to devise and validate a scale to assess singer's perceptions of the current status of their singing voice. Ninety-five vocal health descriptors were collected from focus group interviews of singers. These were reviewed by 25 currently performing music theater (MT) singers. Based on a consensus technique, the number of descriptors was decreased to 42 items. These were administered to a sample of 284 professional MT singers using an online survey to evaluate their perception of current singing voice status. Principal component analysis identified two subsets of items. Rasch analysis was used to evaluate and refine these sets of items to form two 10-item subscales. Both subscales demonstrated good overall fit to the Rasch model, no differential item functioning by sex or age, and good internal consistency reliability. The two subscales were strongly correlated and subsequent Rasch analysis supported their combination to form a single 20-item scale with good psychometric properties. The Evaluation of the Ability to Sing Easily (EASE) is a concise clinical tool to assess singer's perceptions of the current status of their singing voice with good measurement properties. EASE may prove a useful tool to measure changes in the singing voice as indicators of the effect of vocal load. Furthermore, it may offer a valuable means for the prediction or screening of singers "at risk" of developing voice disorders. Copyright © 2013 The Voice Foundation. All rights reserved.