WorldWideScience

Sample records for rasch psychometric approach

  1. Psychometric assessment of HIV/STI sexual risk scale among MSM: A Rasch model approach

    Directory of Open Access Journals (Sweden)

    Liu Hui

    2011-10-01

    Full Text Available Abstract Background Little research has assessed the degree of severity and ordering of different types of sexual behaviors for HIV/STI infection in a measurement scale. The purpose of this study was to apply the Rasch model on psychometric assessment of an HIV/STI sexual risk scale among men who have sex with men (MSM. Methods A cross-sectional study using respondent driven sampling was conducted among 351 MSM in Shenzhen, China. The Rasch model was used to examine the psychometric properties of an HIV/STI sexual risk scale including nine types of sexual behaviors. Results The Rasch analysis of the nine items met the unidimensionality and local independence assumption. Although the person reliability was low at 0.35, the item reliability was high at 0.99. The fit statistics provided acceptable infit and outfit values. Item difficulty invariance analysis showed that the item estimates of the risk behavior items were invariant (within error. Conclusions The findings suggest that the Rasch model can be utilized for measuring the level of sexual risk for HIV/STI infection as a single latent construct and for establishing the relative degree of severity of each type of sexual behavior in HIV/STI transmission and acquisition among MSM. The measurement scale provides a useful measurement tool to inform, design and evaluate behavioral interventions for HIV/STI infection among MSM.

  2. Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches

    Directory of Open Access Journals (Sweden)

    Kelly D. Bradley

    2016-07-01

    Full Text Available This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA and Rasch modeling, the authors investigate the (a an overall assessment of dimensionality using EFA, (b a secondary assessment of dimensionality using a principal components analysis (PCA of the residuals when the items are fit to the Rasch model, and (c an assessment of item-level properties using item-level statistics provided when the items are fit to the Rasch model. The results support the usage of the scale as a supplement to high-stakes decision making such as tenure. However, the lack of precise targeting of item difficulty to person ability combined with the low person separation index renders rank-ordering professors according to minuscule differences in overall subscale scores a highly questionable practice.

  3. Rasch Analysis for Psychometric Improvement of Science Attitude Rating Scales

    Science.gov (United States)

    Oon, Pey-Tee; Fan, Xitao

    2017-01-01

    Students' attitude towards science (SAS) is often a subject of investigation in science education research. Survey of rating scale is commonly used in the study of SAS. The present study illustrates how Rasch analysis can be used to provide psychometric information of SAS rating scales. The analyses were conducted on a 20-item SAS scale used in an…

  4. Evaluating the Psychometric Properties of the Foreign Language Classroom Anxiety Scale for Cypriot Senior High School EFL Students: The Rasch Measurement Approach

    Directory of Open Access Journals (Sweden)

    Panayiotis Panayides

    2013-08-01

    Full Text Available The aim of this study was to investigate the psychometric properties of the Foreign Language Classroom Anxiety Scale (FLCAS for Cypriot senior high school EFL students, through Rasch measurement. In doing so, the researchers clarified two discrepancies found in the literature: first the factor structure of the scale and second whether test anxiety is a component of FLCA. The Greek version of the FLCAS was administered to a sample of 304 senior high school EFL students. Results showed that after removing five items which fitted the Rasch Rating Scale model poorly, the remaining 28 items formed a unidimensional scale, one component of which is test anxiety. The degree of reliability was high. Semantic analysis of the items revealed that one of the reasons was the inclusion of many parallel items. The Rasch person-item map showed that a second reason was the narrow coverage of the construct by the items. Finally the 5-point Likert scale was shown to be marginally optimal. Suggestions are proposed for future research into the refinement of the scale.

  5. Modern psychometrics for assessing achievement goal orientation: a Rasch analysis.

    Science.gov (United States)

    Muis, Krista R; Winne, Philip H; Edwards, Ordene V

    2009-09-01

    A program of research is needed that assesses the psychometric properties of instruments designed to quantify students' achievement goal orientations to clarify inconsistencies across previous studies and to provide a stronger basis for future research. We conducted traditional psychometric and modern Rasch-model analyses of the Achievement Goals Questionnaire (AGQ, Elliot & McGregor, 2001) and the Patterns of Adaptive Learning Scale (PALS, Midgley et al., 2000) to provide an in-depth analysis of the two most popular instruments in educational psychology. For Study 1, 217 undergraduate students enrolled in educational psychology courses participated. Thirty-four were male and 181 were female (two did not respond). Participants completed the AGQ in the context of their educational psychology class. For Study 2, 126 undergraduate students enrolled in educational psychology courses participated. Thirty were male and 95 were female (one did not respond). Participants completed the PALS in the context of their educational psychology class. Traditional psychometric assessments of the AGQ and PALS replicated previous studies. For both, reliability estimates ranged from good to very good for raw subscale scores and fit for the models of goal orientations were good. Based on traditional psychometrics, the AGQ and PALS are valid and reliable indicators of achievement goals. Rasch analyses revealed that estimates of reliability for items were very good but respondent ability estimates varied from poor to good for both the AGQ and PALS. These findings indicate that items validly and reliably reflect a group's aggregate goal orientation, but using either instrument to characterize an individual's goal orientation is hazardous.

  6. Psychometric Properties on Lecturers' Beliefs on Teaching Function: Rasch Model Analysis

    Science.gov (United States)

    Mofreh, Samah Ali Mohsen; Ghafar, Mohammed Najib Abdul; Omar, Abdul Hafiz Hj; Mosaku, Monsurat; Ma'ruf, Amar

    2014-01-01

    This paper focuses on the psychometric analysis of lecturers' beliefs on teaching function (LBTF) survey using Rasch Model analysis. The sample comprised 34 Community Colleges' lecturers. The Rasch Model is applied to produce specific measurements on the lecturers' beliefs on teaching function in order to generalize results and inferential…

  7. Psychometric Properties of the HOME Inventory Using Rasch Analysis

    Science.gov (United States)

    Glad, Johan; Kottorp, Anders; Jergeby, Ulla; Gustafsson, Carina; Sonnander, Karin

    2014-01-01

    Objectives: The aim of this pilot study was to explore psychometric properties of two versions of the Home Observation for Measurement of the Environment Inventory in a Swedish social service sample. Method: Social workers employed at 22 Swedish child protections agencies participated in the data collection. Both classic test theory approaches and…

  8. Development and validation of the Brazilian version of the Attitudes to Aging Questionnaire (AAQ: An example of merging classical psychometric theory and the Rasch measurement model

    Directory of Open Access Journals (Sweden)

    Trentini Clarissa M

    2008-01-01

    Full Text Available Abstract Background Aging has determined a demographic shift in the world, which is considered a major societal achievement, and a challenge. Aging is primarily a subjective experience, shaped by factors such as gender and culture. There is a lack of instruments to assess attitudes to aging adequately. In addition, there is no instrument developed or validated in developing region contexts, so that the particularities of ageing in these areas are not included in the measures available. This paper aims to develop and validate a reliable attitude to aging instrument by combining classical psychometric approach and Rasch analysis. Methods Pilot study and field trial are described in details. Statistical analysis included classic psychometric theory (EFA and CFA and Rasch measurement model. The latter was applied to examine unidimensionality, response scale and item fit. Results Sample was composed of 424 Brazilian old adults, which was compared to an international sample (n = 5238. The final instrument shows excellent psychometric performance (discriminant validity, confirmatory factor analysis and Rasch fit statistics. Rasch analysis indicated that modifications in the response scale and item deletions improved the initial solution derived from the classic approach. Conclusion The combination of classic and modern psychometric theories in a complementary way is fruitful for development and validation of instruments. The construction of a reliable Brazilian Attitudes to Aging Questionnaire is important for assessing cultural specificities of aging in a transcultural perspective and can be applied in international cross-cultural investigations running less risk of cultural bias.

  9. Development and validation of the Brazilian version of the Attitudes to Aging Questionnaire (AAQ): An example of merging classical psychometric theory and the Rasch measurement model.

    Science.gov (United States)

    Chachamovich, Eduardo; Fleck, Marcelo P; Trentini, Clarissa M; Laidlaw, Ken; Power, Mick J

    2008-01-21

    Aging has determined a demographic shift in the world, which is considered a major societal achievement, and a challenge. Aging is primarily a subjective experience, shaped by factors such as gender and culture. There is a lack of instruments to assess attitudes to aging adequately. In addition, there is no instrument developed or validated in developing region contexts, so that the particularities of ageing in these areas are not included in the measures available. This paper aims to develop and validate a reliable attitude to aging instrument by combining classical psychometric approach and Rasch analysis. Pilot study and field trial are described in details. Statistical analysis included classic psychometric theory (EFA and CFA) and Rasch measurement model. The latter was applied to examine unidimensionality, response scale and item fit. Sample was composed of 424 Brazilian old adults, which was compared to an international sample (n = 5238). The final instrument shows excellent psychometric performance (discriminant validity, confirmatory factor analysis and Rasch fit statistics). Rasch analysis indicated that modifications in the response scale and item deletions improved the initial solution derived from the classic approach. The combination of classic and modern psychometric theories in a complementary way is fruitful for development and validation of instruments. The construction of a reliable Brazilian Attitudes to Aging Questionnaire is important for assessing cultural specificities of aging in a transcultural perspective and can be applied in international cross-cultural investigations running less risk of cultural bias.

  10. The Refractive Status and Vision Profile: evaluation of psychometric properties and comparison of Rasch and summated Likert-scaling.

    Science.gov (United States)

    Garamendi, Estibaliz; Pesudovs, Konrad; Stevens, Michael J; Elliott, David B

    2006-04-01

    The psychometric properties of the Refractive Status and Vision Profile (RSVP) questionnaire were evaluated using Rasch analysis. Ninety-one myopic patients from a refractive surgery clinic and general optometric practice completed the RSVP. Rasch analysis of the RSVP ordinal data was performed to examine for unidimensionality and item reduction. The traditional Likert-scoring system was compared with a Rasch-scored RSVP and a reduced item Rasch-scored RSVP. Rasch analysis of the original RSVP showed poor targeting of item difficulty to patient quality of life, items with a ceiling effect and underutilized response categories. Combining the underutilized response scales and removal of redundant and misfitting items improved the internal consistency and targeting of the RSVP, and the reduced 20-item Rasch scored RSVP showed greater relative precision over standard Likert scoring in discriminating between the two subject groups. A Rasch scaled quality of life questionnaire is recommended for use in refractive outcomes research.

  11. A New Approach for Testing the Rasch Model

    Science.gov (United States)

    Kubinger, Klaus D.; Rasch, Dieter; Yanagida, Takuya

    2011-01-01

    Though calibration of an achievement test within psychological and educational context is very often carried out by the Rasch model, data sampling is hardly designed according to statistical foundations. However, Kubinger, Rasch, and Yanagida (2009) recently suggested an approach for the determination of sample size according to a given Type I and…

  12. Modern psychometric approaches to analysis of scales for health-related quality of life

    DEFF Research Database (Denmark)

    Bjorner, Jakob Bue; Bech, Per

    2016-01-01

    In recent years, much effort has been invested in the development of new instruments for assessment of health-related quality of life (HRQOL). For many new instruments, modern psychometric methods, such as item response theory (IRT) models, have been used, either as supplemental to classical...... psychometric testing or as the primary methodological approach. We will use the term modern psychometric methods to refer to psychometric methods for multi-item scales that (1) examine the contribution of each item to the measurement properties of the overall scale and (2) recognize that items are categorical....... The models include Rasch models (Rasch 1980; Fischer and Molenaar 1995), other IRT models (Samejima 1969; van der Linden and Hambleton 1997), and factor analytic models for categorical data (Muthén 1984). “Modern” psychometric methods have actually a rather long history within psychiatric research (both...

  13. Evaluating the Psychometric Properties of the Eating Assessment Tool (EAT-10) Using Rasch Analysis.

    Science.gov (United States)

    Cordier, R; Joosten, A; Clavé, P; Schindler, A; Bülow, M; Demir, N; Arslan, S Serel; Speyer, R

    2017-04-01

    Early and reliable screening for oropharyngeal dysphagia (OD) symptoms in at-risk populations is important and a crucial first stage in effective OD management. The Eating Assessment Tool (EAT-10) is a commonly utilized screening and outcome measure. To date, studies using classic test theory methodologies report good psychometric properties, but the EAT-10 has not been evaluated using item response theory (e.g., Rasch analysis). The aim of this multisite study was to evaluate the internal consistency and structural validity and conduct a preliminary investigation of the cross-cultural validity of the EAT-10; floor and ceiling effects were also checked. Participants involved 636 patients deemed at risk of OD, from outpatient clinics in Spain, Turkey, Sweden, and Italy. The EAT-10 and videofluoroscopic and/or fiberoptic endoscopic evaluation of swallowing were used to confirm OD diagnosis. Patients with esophageal dysphagia were excluded to ensure a homogenous sample. Rasch analysis was used to investigate person and item fit statistics, response scale, dimensionality of the scale, differential item functioning (DIF), and floor and ceiling effect. The results indicate that the EAT-10 has significant weaknesses in structural validity and internal consistency. There are both item redundancy and lack of easy and difficult items. The thresholds of the rating scale categories were disordered and gender, confirmed OD, and language, and comorbid diagnosis showed DIF on a number of items. DIF analysis of language showed preliminary evidence of problems with cross-cultural validation, and the measure showed a clear floor effect. The authors recommend redevelopment of the EAT-10 using Rasch analysis.

  14. An in-depth psychometric analysis of the Connor-Davidson Resilience Scale: calibration with Rasch-Andrich model

    OpenAIRE

    Arias González, Víctor B.; Crespo Sierra, María Teresa; Arias Martínez, Benito; Martínez-Molina, Agustín; Ponce, Fernando P.

    2015-01-01

    Background The Connor-Davidson Resilience Scale (CD-RISC) is inarguably one of the best-known instruments in the field of resilience assessment. However, the criteria for the psychometric quality of the instrument were based only on classical test theory. Method The aim of this paper has focused on the calibration of the CD-RISC with a nonclinical sample of 444 adults using the Rasch-Andrich Rating Scale Model, in order to clarify its structure and analyze its psychometric properties at the l...

  15. Psychometric analysis of the self-harm inventory using Rasch modelling.

    Science.gov (United States)

    Latimer, Shane; Covic, Tanya; Cumming, Steven R; Tennant, Alan

    2009-08-19

    Deliberate Self-Harm (DSH) is the intentional destruction of healthy body tissue without suicidal intent. DSH behaviours in non-clinical populations vary, and instruments containing a range of behaviours may be more informative than ones with restricted content. The Self-Harm Inventory (SHI) is a widely used measure of DSH in clinical populations (mental and physical health) and covers a broad range of behaviours (self-injury, risk taking and self-defeating acts). The test authors recommend the SHI to screen for Borderline Personality Disorder (BPD) using a cut-off score of five or more. The aim of this study was to investigate the psychometric characteristics of the SHI in non-clinical samples. The SHI was administered to a sample of 423 non-clinical participants (university students, age range 17 to 30). External validation was informed by the administration of the Depression Anxiety Stress Scales 21 (DASS-21) to a sub-sample (n = 221). Rasch analysis of the SHI was conducted to provide a stringent test of unidimensionality and to identify the DSH behaviours most likely to be endorsed at each total score. The SHI showed adequate fit to the Rasch model and no modifications were required following checks of local response dependency, differential item functioning and unidimensionality. The scale identified gender and age differences in scores, with females and older participants reporting higher levels of DSH. SHI scores and DASS-21 scores were related. The recommended cut-off point of five is likely to comprise mild forms of DSH and may not be indicative of psychopathology in a non-clinical population. Rather it may be more indicative of developmentally related risk taking behaviours while a higher cut-off point may be more suggestive of psychopathology as indicated by higher levels of depression, stress and anxiety.

  16. Psychometric analysis of the Self-Harm Inventory using Rasch modelling

    Directory of Open Access Journals (Sweden)

    Cumming Steven R

    2009-08-01

    Full Text Available Abstract Background Deliberate Self-Harm (DSH is the intentional destruction of healthy body tissue without suicidal intent. DSH behaviours in non-clinical populations vary, and instruments containing a range of behaviours may be more informative than ones with restricted content. The Self-Harm Inventory (SHI is a widely used measure of DSH in clinical populations (mental and physical health and covers a broad range of behaviours (self-injury, risk taking and self-defeating acts. The test authors recommend the SHI to screen for Borderline Personality Disorder (BPD using a cut-off score of five or more. The aim of this study was to investigate the psychometric characteristics of the SHI in non-clinical samples. Methods The SHI was administered to a sample of 423 non-clinical participants (university students, age range 17 to 30. External validation was informed by the administration of the Depression Anxiety Stress Scales 21 (DASS-21 to a sub-sample (n = 221. Rasch analysis of the SHI was conducted to provide a stringent test of unidimensionality and to identify the DSH behaviours most likely to be endorsed at each total score. Results The SHI showed adequate fit to the Rasch model and no modifications were required following checks of local response dependency, differential item functioning and unidimensionality. The scale identified gender and age differences in scores, with females and older participants reporting higher levels of DSH. SHI scores and DASS-21 scores were related. Conclusion The recommended cut-off point of five is likely to comprise mild forms of DSH and may not be indicative of psychopathology in a non-clinical population. Rather it may be more indicative of developmentally related risk taking behaviours while a higher cut-off point may be more suggestive of psychopathology as indicated by higher levels of depression, stress and anxiety.

  17. Investigation of psychometric properties of the Falls Efficacy Scale using Rasch analysis in patients with hemiplegic stroke.

    Science.gov (United States)

    Park, Eun Young; Choi, Yoo Im

    2015-09-01

    [Purpose] The purpose of this study was to investigate the psychometric properties of the Falls Efficacy Scale using Rasch analysis in patients with hemiplegic stroke. [Subjects] Fifty-five community-dwelling hemiplegic stroke patients were selected as participants. [Methods] Data were analyzed using the Winsteps program (version 3.62) with the Rasch model to confirm the unidimensionality through item fit, reliability, and appropriateness of the rating scale. [Results] There were no misfit persons or items. Furthermore, infit and outfit statistics appeared adjacent. The person separation value was 3.07, and the reliability coefficient was 0.90. The reliability of all items was at an acceptable level for patients with hemiplegic stroke. [Conclusion] This was the first study to investigate the psychometric properties of the Falls Efficacy Scale using Rasch analysis. The results of this study suggest that the 6-point Falls Efficacy Scale is an appropriate tool for measuring the self-perceived fear of falling in patients with hemiplegic stroke.

  18. The Cervical Dystonia Impact Profile (CDIP-58: Can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

    Directory of Open Access Journals (Sweden)

    Bhatia Kailash P

    2008-08-01

    Full Text Available Abstract Background The United States Food and Drug Administration (FDA are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58, a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1 provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2 enable researchers and clinicians to compare it with existing dystonia PROMs; and 3 help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. Methods We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. Results A total of 391 people returned completed questionnaires (corrected response rate 87%. Analyses showed: 1 data quality was high (low missing data ≤ 4%, subscale scores could be computed for > 96% of the sample; 2 item groupings passed tests for scaling assumptions; 3 good targeting (except for the Sleep subscale, ceiling effect = 27%; 4 good reliability (Cronbach's alpha ≥ 0.92, test-retest intraclass correlations ≥ 0.83; and 5 validity was supported. Conclusion This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis.

  19. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS)

    OpenAIRE

    Tennant Alan; Shea Tracey L; Pallant Julie F

    2009-01-01

    Abstract Background There is a growing awareness of the need for easily administered, psychometrically sound screening tools to identify individuals with elevated levels of psychological distress. Although support has been found for the psychometric properties of the Depression, Anxiety and Stress Scales (DASS) using classical test theory approaches it has not been subjected to Rasch analysis. The aim of this study was to use Rasch analysis to assess the psychometric properties of the DASS-21...

  20. Psychometric Limitations of the Center for Epidemiologic Studies-Depression Scale for Assessing Depressive Symptoms among Adults with HIV/AIDS: A Rasch Analysis

    Directory of Open Access Journals (Sweden)

    Caryl L. Gay

    2016-01-01

    Full Text Available The Center for Epidemiological Studies-Depression (CES-D scale is a widely used measure of depressive symptoms, but its psychometric properties have not been adequately evaluated among adults with HIV/AIDS. This study used an item response theory approach (Rasch analysis to evaluate the CES-D’s validity and reliability in relation to key demographic and clinical variables in adults with HIV/AIDS. A convenience sample of 347 adults with HIV/AIDS (231 males, 93 females, and 23 transgenders; age range 22–77 years completed the CES-D. A Rasch model application was used to analyze the CES-D’s rating scale functioning, internal scale validity, person-response validity, person-separation validity, internal consistency, differential item functioning (DIF, and differential test functioning. CES-D scores were generally high and associated with several demographic and clinical variables. The CES-D distinguished 3 distinct levels of depression and had acceptable internal consistency but lacked unidimensionality, five items demonstrated poor fit to the model, 15% of the respondents demonstrated poor fit, and eight items demonstrated DIF related to gender, race, or AIDS diagnosis. Removal of misfitting items resulted in minimal improvement in the CES-D’s substantive and structural validity. CES-D scores should be interpreted with caution in adults with HIV/AIDS, particularly when comparing scores across gender and racial groups.

  1. Using Rasch Measurement Theory to Examine Two Instructional Approaches for Teaching and Learning of French Grammar

    Science.gov (United States)

    Vogel, Severine P.; Engelhard, George, Jr.

    2011-01-01

    The authors describe a quantitative approach based on Rasch measurement theory for evaluating classroom assessments within the context of foreign language classes. A secondary purpose was to examine the effects of two instructional approaches to teach grammar, a guided inductive and a deductive approach, through the lens of Rasch measurement…

  2. Measuring coping in parents of children with disabilities: a rasch model approach.

    Science.gov (United States)

    Gothwal, Vijaya K; Bharani, Seelam; Reddy, Shailaja P

    2015-01-01

    Parents of a child with disability must cope with greater demands than those living with a healthy child. Coping refers to a person's cognitive or behavioral efforts to manage the demands of a stressful situation. The Coping Health Inventory for Parents (CHIP) is a well-recognized measure of coping among parents of chronically ill children and assesses different coping patterns using its three subscales. The purpose of this study was to provide further insights into the psychometric properties of the CHIP subscales in a sample of parents of children with disabilities. In this cross-sectional study, 220 parents (mean age, 33.4 years; 85% mothers) caring for a child with disability enrolled in special schools as well as in mainstream schools completed the 45-item CHIP. Rasch analysis was applied to the CHIP data and the psychometric performance of each of the three subscales was tested. Subscale revision was performed in the context of Rasch analysis statistics. Response categories were not used as intended, necessitating combining categories, thereby reducing the number from 4 to 3. The subscale - 'maintaining social support' satisfied all the Rasch model expectations. Four item misfit the Rasch model in the subscale -maintaining family integration', but their deletion resulted in a 15-item scale with items that fit the Rasch model well. The remaining subscale - 'understanding the healthcare situation' lacked adequate measurement precision (current Rasch analyses add to the evidence of measurement properties of the CHIP and show that the two of its subscales (one original and the other revised) have good psychometric properties and work well to measure coping patterns in parents of children with disabilities. However the third subscale is limited by its inadequate measurement precision and requires more items.

  3. Measuring coping in parents of children with disabilities: a rasch model approach.

    Directory of Open Access Journals (Sweden)

    Vijaya K Gothwal

    Full Text Available Parents of a child with disability must cope with greater demands than those living with a healthy child. Coping refers to a person's cognitive or behavioral efforts to manage the demands of a stressful situation. The Coping Health Inventory for Parents (CHIP is a well-recognized measure of coping among parents of chronically ill children and assesses different coping patterns using its three subscales. The purpose of this study was to provide further insights into the psychometric properties of the CHIP subscales in a sample of parents of children with disabilities.In this cross-sectional study, 220 parents (mean age, 33.4 years; 85% mothers caring for a child with disability enrolled in special schools as well as in mainstream schools completed the 45-item CHIP. Rasch analysis was applied to the CHIP data and the psychometric performance of each of the three subscales was tested. Subscale revision was performed in the context of Rasch analysis statistics.Response categories were not used as intended, necessitating combining categories, thereby reducing the number from 4 to 3. The subscale - 'maintaining social support' satisfied all the Rasch model expectations. Four item misfit the Rasch model in the subscale -maintaining family integration', but their deletion resulted in a 15-item scale with items that fit the Rasch model well. The remaining subscale - 'understanding the healthcare situation' lacked adequate measurement precision (<2.0 logits.The current Rasch analyses add to the evidence of measurement properties of the CHIP and show that the two of its subscales (one original and the other revised have good psychometric properties and work well to measure coping patterns in parents of children with disabilities. However the third subscale is limited by its inadequate measurement precision and requires more items.

  4. A Psychometric Investigation of the Marlowe-Crowne Social Desirability Scale Using Rasch Measurement

    Science.gov (United States)

    Seol, Hyunsoo

    2007-01-01

    The author used Rasch measurement to examine the reliability and validity of 382 Korean university students' scores on the Marlowe-Crowne Social Desirability Scale (MCSDS; D. P. Crowne and D. Marlowe, 1960). Results revealed that item-fit statistics and principal component analysis with standardized residuals provide evidence of MCSDS'…

  5. Psychometric Properties of the Spanish Version of the UPPS-P Impulsive Behavior Scale : A Rasch Rating Scale Analysis and Confirmatory Factor Analysis

    OpenAIRE

    Pilatti, Angela; Lozano Rojas, Oscar Martín; Cyders, Melissa A.

    2015-01-01

    The present study was aimed at determining the psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale in a sample of college students. Participants were 318 college students (36.2% men; mean age = 20.9 years, SD = 6.4 years). The psychometric properties of this Spanish version were analyzed using the Rasch model, and the factor structure was examined using confirmatory factor analysis. The verification of the global fit of the data showed adequate indexes for pe...

  6. Educational Leadership Effectiveness: A Rasch Analysis

    Science.gov (United States)

    Sinnema, Claire; Ludlow, Larry; Robinson, Viviane

    2016-01-01

    Purpose: The purposes of this paper are, first, to establish the psychometric properties of the ELP tool, and, second, to test, using a Rasch item response theory analysis, the hypothesized progression of challenge presented by the items included in the tool. Design/ Methodology/ Approach: Data were collected at two time points through a survey of…

  7. The functional assessment measure (FAM) in closed traumatic brain injury outpatients: a Rasch-based psychometric study.

    Science.gov (United States)

    Tesio, L; Cantagallo, A

    1998-01-01

    The Functional Assessment Measure (FAM) has been proposed as a measure of disability in post-acute Traumatic Brain Injury (TBI) outpatients. It is comprised of the 18 items of The Functional Independence Measure (FIMSM), scored in terms of dependence, and of 12 newly designed items, scored in terms of dependence (7 items) or performance (5 items). The FIMSM covers the domains of self-care, sphincter management, mobility, locomotion, communication and social cognition. The 12 new items explore the domains of community integration, emotional status, orientation, attention, reading/writing skills, swallowing and speech intelligibility. By addressing a set of problems quite specific for TBI outpatients the FAM was intended to raise the ceiling of the FIMSM and to allow a more precise estimate of their disability. These claims, however, were never supported in previous studies. We administered the FAM to 60 TBI outpatient, 2-88 months (median 16) from trauma. Rasch analysis (rating scale model) was adopted to test the psychometric properties of the scale. The FAM was reliable (Rasch item and person reliability 0.91 and 0.93, respectively). Two of the 12 FAM-specific items were severely misfitting with the general construct, and were deleted. Within the 28-item refined FAM scale, 4 new items and 2 FIMSM items still retained signs of misfit. The FAM was on average too easy. The most difficult item (a new one, Employability) did not attain the average ability of the subjects. Also, it was only slightly more difficult than than the most difficult FIMSM item (Memory). The FAM does not seem to improve the FIMSM as a far as TBI outpatients are to be assessed.

  8. Application of Rasch analysis to examine psychometric aspects of the activities-specific balance confidence scale when used in a new cultural context.

    Science.gov (United States)

    Arnadottir, Solveig A; Lundin-Olsson, Lillemor; Gunnarsdottir, Elin D; Fisher, Anne G

    2010-01-01

    Arnadottir SA, Lundin-Olsson L, Gunnarsdottir ED, Fisher AG. Application of Rasch analysis to examine psychometric aspects of the Activities-Specific Balance Confidence Scale when used in a new cultural context. To investigate by using Rasch analysis the psychometric properties of the Activities-Specific Balance Confidence (ABC) Scale when applied in a new Icelandic context. Cross-sectional, population-based, random selection from the Icelandic National Registry. Community-based. Icelanders (N=183), 65 to 88 years old, and 48% women. Not applicable. ABC, an instrument used to evaluate how confident older people are in maintaining balance and remaining steady when moving through the environment. An Icelandic translation of the ABC (ABC-ICE) scale was evaluated by implementing Rasch rating scale analysis to transform ordinal ABC-ICE scores into interval measures and evaluating aspects of validity and reliability of the scale. Participants were not able to differentiate reliably between the 11 rating scale categories of the ABC-ICE. Additionally, 3 items failed to show acceptable goodness of fit to the ABC-ICE rating scale model. By collapsing categories and creating a new 5-category scale, only 1 item misfit. Removing that item resulted in a modified version of ABC-ICE with 5 categories and 15 items. Both item goodness-of-fit statistics and principal components analysis supported unidimensionality of the modified ABC-ICE. The ABC-ICE measures reliably separated the sample into at least 4 statistically distinct strata of balance confidence. Finally, the hierarchical order of item difficulties was consistent with theoretic expectations, and the items were reasonably well targeted to the balance confidence of the persons tested. Rasch analysis indicated a need to modify the ABC-ICE to improve its psychometric properties. Further studies are needed to determine if similar analyses of other versions of the ABC, including the original one, will yield similar results

  9. The psychometric properties of the Hopkins Symptom Checklist-10: a Rasch analysis based on adolescent data from Norway.

    Science.gov (United States)

    Kleppang, Annette Løvheim; Hagquist, Curt

    2016-12-01

    The Hopkins Symptom Checklist (HSCL-10) is widely used for both clinical and epidemiological purposes to measure psychological distress among adolescents and adults. The purpose of this study was to investigate the psychometric properties of the HSCL-10 among adolescents in Norway using Rasch analysis. The study is based on cross-sectional data from the Norwegian Youth Health Surveys, conducted by the Norwegian Institute of Public Health in 2001 and 2009. The target group comprised of 15- to 16-year olds (Grade 10 students) in Hedmark County, Norway. Ten items with four response categories, intended to measure anxiety and depression, were analysed. The analysis focused on invariance, including differential item functioning (DIF) across genders and years of investigations. In addition, the categorization of the items, targeting, possible multidimensionality and response dependency, was analysed. The HSCL-10 shows good reliability and on the whole, the items work well. However, one item, 'Sleeping difficulties', clearly misfit and some items work differently for boys and girls and between years of investigations. There is also need for a better targeting of the scale. The HSCL-10 has the potential to measure the psychological distress among adolescents but there is a room for improvement. Further judgement needs to be made as to whether the misfitting item 'Sleeping difficulties' should be removed or retained. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  10. Relationships between the Thurstone and Rasch Approaches to Item Scaling.

    Science.gov (United States)

    Andrich, David

    1978-01-01

    When the logistic function is substituted for the normal, Thurstone's Case V specialization of the law of comparative judgment for paired comparison responses gives an identical equation for the estimation of item scale values, as does the Rasch formulation for direct responses. Comparisons are made. (Author/CTM)

  11. Rasch Analysis as a Technique to Examine the Psychometric Properties of a Career Ability Placement Survey Subtest

    Science.gov (United States)

    Pomeranz, Jamie L.; Byers, Katherine L.; Moorhouse, Michael D.; Velozo, Craig A.; Spitznagel, Ronald J.

    2008-01-01

    Rasch analysis offers researchers an innovative method for developing and validating rehabilitation instruments. Despite the increased use of Rasch analysis by allied health researchers, this method continues to be underutilized by rehabilitation counseling professionals. In the rehabilitation counseling profession, vocational evaluators use…

  12. What Is Embodiment? A Psychometric Approach

    Science.gov (United States)

    Longo, Matthew R.; Schuur, Friederike; Kammers, Marjolein P. M.; Tsakiris, Manos; Haggard, Patrick

    2008-01-01

    What is it like to have a body? The present study takes a psychometric approach to this question. We collected structured introspective reports of the rubber hand illusion, to systematically investigate the structure of bodily self-consciousness. Participants observed a rubber hand that was stroked either synchronously or asynchronously with their…

  13. Psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale: A Rasch rating scale analysis and confirmatory factor analysis.

    Science.gov (United States)

    Pilatti, Angelina; Lozano, Oscar M; Cyders, Melissa A

    2015-12-01

    The present study was aimed at determining the psychometric properties of the Spanish version of the UPPS-P Impulsive Behavior Scale in a sample of college students. Participants were 318 college students (36.2% men; mean age = 20.9 years, SD = 6.4 years). The psychometric properties of this Spanish version were analyzed using the Rasch model, and the factor structure was examined using confirmatory factor analysis. The verification of the global fit of the data showed adequate indexes for persons and items. The reliability estimates were high for both items and persons. Differential item functioning across gender was found for 23 items, which likely reflects known differences in impulsivity levels between men and women. The factor structure of the Spanish version of the UPPS-P replicates previous work with the original UPPS-P Scale. Overall, results suggest that test scores from the Spanish version of the UPPS-P show adequate psychometric properties to accurately assess the multidimensional model of impulsivity, which represents the most exhaustive measure of this construct.

  14. Rasch analysis of the Persian version of PedsQLTM Oral Health Scale: further psychometric evaluation on item validity including differential item functioning

    Science.gov (United States)

    Lin, Chung-Ying; Kumar, Santhosh; Pakpour, Amir H.

    2016-01-01

    Background: The study aimed to further evaluate the psychometric properties of one recently developed oral health related quality of life (OHRQoL) instrument (PedsQL Oral Health Scale), including student self-report and parent-proxy report. Specifically, we tested the item validity,threshold order, local dependency, and differential item functioning (DIF) across gender and rater. Methods: This is a cross-sectional study, and study population was recruited in Qazvin, Iran using one-stage sampling with the unit of school. Students and their parents (1529 dyads) separately completed the Persian version of PedsQL Oral Health Scale. The psychometric properties were analyzed using Rasch rating scale model, including item validity, threshold order for response categories, and DIF across gender (boys vs. girls in student self-report) and rater (student self report vs. parent-proxy report). Results: All items had satisfactory in fit and outfit mean square error. One disordering category (the response of often) was found in parent-proxy report, while all categories were ordered in student self-report. All items were DIF-trivial across gender and rater. Conclusion: PedsQL Oral Health Scale is a valid instrument to measure OHRQoL. However, our results indicated that the parent-proxy report was inferior to the student self-report, and healthcare providers should primarily use the student self-report. PMID:27579258

  15. Psychometric Properties of the Attitudes toward Physical Activity Scale: A Rasch Analysis Based on Data From Five Locations.

    Science.gov (United States)

    Mok, Magdalena Mo Ching; Chin, Ming Kai; Chen, Shihui; Emeljanovas, Arunas; Mieziene, Brigita; Bronikowski, Michal; Laudanska-Krzeminska, Ida; Milanovic, Ivana; Pasic, Milan; Balasekaran, Govindasamy; Phua, Kia Wang; Makaza, Daga

    2015-01-01

    This article describes the development and validation of the Attitudes toward Physical Activity Scale (APAS) to measure the attitudes, beliefs, and self-efficacy toward physical activity by children at the primary school level. The framework included: physical fitness, self-efficacy, personal best goal orientation in physical activity, interest in physical activity, importance of physical activity, benefits of physical activity, contributions of video exercise to learning in school subjects, contributions of video exercise to learning about health and environmental support. The sample comprised of 630 school students between grades 1 and 7 from five countries, namely Lithuania (29%), Poland (26%), Serbia (19%), Singapore (16%) and Zimbabwe (11%). Rasch analysis found empirical evidence in support of measurement validity of the APAS in terms of Rasch item reliabilities, unidimensionality, effectiveness of response categories, and absence of gender differential item functioning (DIF). The validation of the APAS according to the Rasch model meant that a dependable tool was established for gauging programme effectiveness of intervention programs on physical activity of primary school children in classroom settings at various geographical locations globally.

  16. Evaluation of the Psychometric Properties of the Internet Addiction Test (IAT in a Sample of Cypriot High School Students: The Rasch Measurement Perspective

    Directory of Open Access Journals (Sweden)

    Panayiotis Panayides

    2012-08-01

    Full Text Available As Greek Cypriot senior high school teachers, the researchers believe that instruments assessing Internet addiction should be developed and validated for use wherever there are adolescents (the most at-risk population and Internet access. The purpose of the study was to evaluate the psychometric properties of the Internet Addiction Test (IAT. A sample of 604 randomly selected high school students from five high schools in Limassol, Cyprus participated in the study. The Rasch Rating Scale Model was used for the analyses of the data collected. Results suggested the modification of the IAT in two ways. First, the 5-point rating scale was replaced by a 3-point scale, which was found to be optimal in the pilot study. Second, item 8 was replaced by a self-rating item because it was found to be identical to item 6 both statistically and semantically. The respondents’ reliability was satisfactory (0.86 and item reliability very high (0.99. All 20 items were sufficiently spread out and describe distinct levels along the variable and do define a linear continuum of increasing difficulty. All the evidence collected supports the unidimensionality and the high degree of construct validity of the scale. Finally four recommendations for the modification of the scale and future research are proposed.

  17. Rasch analysis on OSCE data : An illustrative example

    Directory of Open Access Journals (Sweden)

    Tor E

    2011-06-01

    Full Text Available BackgroundThe Objective Structured Clinical Examination (OSCE is awidely used tool for the assessment of clinical competencein health professional education. The goal of the OSCE is tomake reproducible decisions on pass/fail status as well asstudents’ levels of clinical competence according to theirdemonstrated abilities based on the scores. This paperexplores the use of the polytomous Rasch model inevaluating the psychometric properties of OSCE scoresthrough a case study.MethodThe authors analysed an OSCE data set (comprised of 11stations for 80 fourth year medical students based on thepolytomous Rasch model in an effort to answer tworesearch questions: (1 Do the clinical tasks assessed in the11 OSCE stations map on to a common underlyingconstruct, namely clinical competence? (2 What otherinsights can Rasch analysis offer in terms of scaling, itemanalysis and instrument validation over and above theconventional analysis based on classical test theory?ResultsThe OSCE data set has demonstrated a sufficient degree offit to the Rasch model (χ2 = 17.060, DF=22, p=0.76indicating that the 11 OSCE station scores have sufficientpsychometric properties to form a measure for a commonunderlying construct, i.e. clinical competence. IndividualOSCE station scores with good fit to the Rasch model (p >0.1 for all χ2 statistics further corroborated thecharacteristic of unidimensionality of the OSCE scale forclinical competence. A Person Separation Index (PSI of0.704 indicates sufficient level of reliability for the OSCEscores. Other useful findings from the Rasch analysis thatprovide insights, over and above the analysis based onclassical test theory, are also exemplified using the data set.ConclusionThe polytomous Rasch model provides a useful andsupplementary approach to the calibration and analysis ofOSCE examination data.

  18. Reweighting Data in the Spirit of Tukey: Using Bayesian Posterior Probabilities as Rasch Residuals for Studying Misfit

    Science.gov (United States)

    Dardick, William R.; Mislevy, Robert J.

    2016-01-01

    A new variant of the iterative "data = fit + residual" data-analytical approach described by Mosteller and Tukey is proposed and implemented in the context of item response theory psychometric models. Posterior probabilities from a Bayesian mixture model of a Rasch item response theory model and an unscalable latent class are expressed…

  19. Vertical Equating: An Empirical Study of the Consistency of Thurstone and Rasch Model Approaches.

    Science.gov (United States)

    Schratz, Mary K.

    To explore the appropriateness of the Rasch model for the vertical equating of a multi-level, multi-form achievement test series, both the Rasch model and the traditional Thurstone procedures were applied to the Listening Comprehension subtest scores of the Stanford Achievement Test. Two adjacent levels of these tests were administered in 1981 to…

  20. Using Rasch rating scale model to reassess the psychometric properties of the Persian version of the PedsQLTM 4.0 Generic Core Scales in school children

    Directory of Open Access Journals (Sweden)

    Jafari Peyman

    2012-03-01

    Full Text Available Abstract Background Item response theory (IRT is extensively used to develop adaptive instruments of health-related quality of life (HRQoL. However, each IRT model has its own function to estimate item and category parameters, and hence different results may be found using the same response categories with different IRT models. The present study used the Rasch rating scale model (RSM to examine and reassess the psychometric properties of the Persian version of the PedsQLTM 4.0 Generic Core Scales. Methods The PedsQLTM 4.0 Generic Core Scales was completed by 938 Iranian school children and their parents. Convergent, discriminant and construct validity of the instrument were assessed by classical test theory (CTT. The RSM was applied to investigate person and item reliability, item statistics and ordering of response categories. Results The CTT method showed that the scaling success rate for convergent and discriminant validity were 100% in all domains with the exception of physical health in the child self-report. Moreover, confirmatory factor analysis supported a four-factor model similar to its original version. The RSM showed that 22 out of 23 items had acceptable infit and outfit statistics (0.6, person reliabilities were low, item reliabilities were high, and item difficulty ranged from -1.01 to 0.71 and -0.68 to 0.43 for child self-report and parent proxy-report, respectively. Also the RSM showed that successive response categories for all items were not located in the expected order. Conclusions This study revealed that, in all domains, the five response categories did not perform adequately. It is not known whether this problem is a function of the meaning of the response choices in the Persian language or an artifact of a mostly healthy population that did not use the full range of the response categories. The response categories should be evaluated in further validation studies, especially in large samples of chronically ill patients.

  1. Rasch-family models are more valuable than score-based approaches for analysing longitudinal patient-reported outcomes with missing data.

    Science.gov (United States)

    de Bock, Élodie; Hardouin, Jean-Benoit; Blanchin, Myriam; Le Neel, Tanguy; Kubis, Gildas; Bonnaud-Antignac, Angélique; Dantan, Étienne; Sébille, Véronique

    2016-10-01

    The objective was to compare classical test theory and Rasch-family models derived from item response theory for the analysis of longitudinal patient-reported outcomes data with possibly informative intermittent missing items. A simulation study was performed in order to assess and compare the performance of classical test theory and Rasch model in terms of bias, control of the type I error and power of the test of time effect. The type I error was controlled for classical test theory and Rasch model whether data were complete or some items were missing. Both methods were unbiased and displayed similar power with complete data. When items were missing, Rasch model remained unbiased and displayed higher power than classical test theory. Rasch model performed better than the classical test theory approach regarding the analysis of longitudinal patient-reported outcomes with possibly informative intermittent missing items mainly for power. This study highlights the interest of Rasch-based models in clinical research and epidemiology for the analysis of incomplete patient-reported outcomes data.

  2. Behavioral and Emotional Strength-Based Assessment of Finnish Elementary Students: Psychometrics of the BERS-2

    Science.gov (United States)

    Sointu, Erkko Tapio; Savolainen, Hannu; Lambert, Matthew C.; Lappalainen, Kristiina; Epstein, Michael H.

    2014-01-01

    When rating scales are used in different countries, thorough investigation of the psychometric properties is needed. We examined the internal structure of the Finnish translated Behavioral and Emotional Rating Scale-2 (BERS-2) using Rasch and confirmatory factor analysis approaches with a sample of youth, parents, and teachers. The results…

  3. Measuring students' perceptions of plagiarism: modification and Rasch validation of a plagiarism attitude scale.

    Science.gov (United States)

    Howard, Steven J; Ehrich, John F; Walton, Russell

    2014-01-01

    Plagiarism is a significant area of concern in higher education, given university students' high self-reported rates of plagiarism. However, research remains inconsistent in prevalence estimates and suggested precursors of plagiarism. This may be a function of the unclear psychometric properties of the measurement tools adopted. To investigate this, we modified an existing plagiarism scale (to broaden its scope), established its psychometric properties using traditional (EFA, Cronbach's alpha) and modern (Rasch analysis) survey evaluation approaches, and examined results of well-functioning items. Results indicated that traditional and modern psychometric approaches differed in their recommendations. Further, responses indicated that although most respondents acknowledged the seriousness of plagiarism, these attitudes were neither unanimous nor consistent across the range of issues assessed. This study thus provides rigorous psychometric testing of a plagiarism attitude scale and baseline data from which to begin a discussion of contextual, personal, and external factors that influence students' plagiarism attitudes.

  4. Thorndike, Thurstone and Rasch: A Comparison of Their Approaches to Item-Invariant Measurement.

    Science.gov (United States)

    Englehard, George, Jr.

    The methods used by E. L. Thorndike, L. L. Thurstone, and G. Rasch to address issues related to item-invariant measurement and the scoring of individual performance are compared. The analyses highlight the close connection among the three methods, and suggest that progress in measurement theory reflects the movement from essentially ad hoc methods…

  5. Theoretical and Empirical Comparison of the Mokken and the Rasch Approach to IRT.

    Science.gov (United States)

    Meijer, Rob R.; And Others

    1990-01-01

    Mokken models of monotone homogeneity and double monotonicity and the Rasch model are compared using data from 990 young adult examinees taking a Dutch verbal intelligence test--the Verbal Analogies Test. The model of monotone homogeneity was found suitable for basic testing; more sophisticated applications appear to require parametric models.…

  6. Development and Psychometric Evaluation of the School Bullying Scales: A Rasch Measurement Approach

    Science.gov (United States)

    Cheng, Ying-Yao; Chen, Li-Ming; Liu, Kun-Shia; Chen, Yi-Ling

    2011-01-01

    The study aims to develop three school bullying scales--the Bully Scale, the Victim Scale, and the Witness Scale--to assess secondary school students' bullying behaviors, including physical bullying, verbal bullying, relational bullying, and cyber bullying. The items of the three scales were developed from viewpoints of bullies, victims, and…

  7. Development and Psychometric Evaluation of the School Bullying Scales: A Rasch Measurement Approach

    Science.gov (United States)

    Cheng, Ying-Yao; Chen, Li-Ming; Liu, Kun-Shia; Chen, Yi-Ling

    2011-01-01

    The study aims to develop three school bullying scales--the Bully Scale, the Victim Scale, and the Witness Scale--to assess secondary school students' bullying behaviors, including physical bullying, verbal bullying, relational bullying, and cyber bullying. The items of the three scales were developed from viewpoints of bullies, victims, and…

  8. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2009-05-01

    Full Text Available Abstract Background There is a growing awareness of the need for easily administered, psychometrically sound screening tools to identify individuals with elevated levels of psychological distress. Although support has been found for the psychometric properties of the Depression, Anxiety and Stress Scales (DASS using classical test theory approaches it has not been subjected to Rasch analysis. The aim of this study was to use Rasch analysis to assess the psychometric properties of the DASS-21 scales, using two different administration modes. Methods The DASS-21 was administered to 420 participants with half the sample responding to a web-based version and the other half completing a traditional pencil-and-paper version. Conformity of DASS-21 scales to a Rasch partial credit model was assessed using the RUMM2020 software. Results To achieve adequate model fit it was necessary to remove one item from each of the DASS-21 subscales. The reduced scales showed adequate internal consistency reliability, unidimensionality and freedom from differential item functioning for sex, age and mode of administration. Analysis of all DASS-21 items combined did not support its use as a measure of general psychological distress. A scale combining the anxiety and stress items showed satisfactory fit to the Rasch model after removal of three items. Conclusion The results provide support for the measurement properties, internal consistency reliability, and unidimensionality of three slightly modified DASS-21 scales, across two different administration methods. The further use of Rasch analysis on the DASS-21 in larger and broader samples is recommended to confirm the findings of the current study.

  9. Enhancing measurement in science education research through Rasch analysis: Rationale and properties

    Directory of Open Access Journals (Sweden)

    Jørgen Sjaastad

    2014-10-01

    Full Text Available This article presents the basic rationale of Rasch theory and seven core properties of Rasch modeling; analyses of test targeting, person separation, person fit, item fit, differential item functioning, functioning of response categories and tests of unidimensionality. Illustrative examples are provided consecutively, drawing on Rasch analysis of data from a survey where students in the 9th grade responded to questions regarding their mathematics competence. The relationship between Rasch theory and classical test theory is commented on. Rasch theory provides science and mathematics education researchers with valuable tools to evaluate the psychometric quality of tests and questionnaires and support the development of these.

  10. Cross-cultural adaptation and analysis of the psychometric properties of the Balance Evaluation Systems Test and MiniBESTest in the elderly and individuals with Parkinson's disease: application of the Rasch model

    Directory of Open Access Journals (Sweden)

    Angelica C. Maia

    2013-06-01

    Full Text Available BACKGROUND: Older adults and individuals with neurological problems such as Parkinson's disease (PD exhibit balance deficits that might impair their mobility and independence. The assessment of balance must be useful in identifying the presence of instability and orient interventions. OBJECTIVE: To translate and perform a cross-cultural adaptation of the Balance Evaluation Systems Test (BESTest and MiniBESTest to Brazilian Portuguese and analyze its psychometric properties. METHOD: The tests were translated and adapted to Portuguese according to a standard method and then subjected to a test-retest reliability assessment (10 older adults; 10 individuals with PD. The psychometric properties were assessed by the Rasch model (35 older adults; 35 individuals with PD. RESULTS: The reliability coefficient of the tests relative to the items and subjects varied from 0.91 and 0.98, which is indicative of the stability and reproducibility of the measures. In the BESTest, the person (4.19 and item (5.36 separation index established six balance ability levels and seven levels of difficulty, respectively. In the MiniBESTest, the person (3.16 and item (6.41 separation index established four balance ability levels and nine levels of difficulty, respectively. Two items in the BESTest did not fit with the model expectations, but the construct validity was not compromised. No item in the MiniBESTest was erratic. CONCLUSIONS: The results corroborate the diagnostic and screening functions of the BESTest and MiniBESTest, respectively, and indicate that the Brazilian versions exhibit adequate reliability, construct validity, response stability, and capacity to distinguish among various balance ability levels in older adults and individuals with PD.

  11. Rasch analysis of the 23-item version of the Roland Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Kent, Peter; Grotle, Margreth; Dunn, Kate M

    2015-01-01

    OBJECTIVE: To determine the psychometric properties of the 23-item version of the Roland Morris Disability Questionnaire (RMDQ-23) and to quantify their stability across 2 cultures/languages and 2 types of care-settings. METHODS: Rasch analysis of data from 1,000 patients with low back pain from...... clinical characteristics (such as age, gender, pain intensity, pain duration and care setting), depending on the country. CONCLUSION: As similar results have been found for the RMDQ-24, we believe it is timely to reconsider whether: (i) the RMDQ should be reconstructed using an item-response theory......-based approach that includes consideration of new items and response options; or (ii) the use of alternative questionnaires should be recommended, such as the Oswestry Disability Index, that have shown evidence of fitting the Rasch model; or (iii) a completely new condition-specific questionnaire should...

  12. Career Decision Self-Efficacy Scale-Short Form: A Rasch Analysis of the Portuguese Version

    Science.gov (United States)

    Miguel, Jose P.; Silva, Jose T.; Prieto, Gerardo

    2013-01-01

    The present study analyzes the psychometric properties of the Career Decision Self-Efficacy Scale-Short Form (CDSE-SF) in a sample of Portuguese secondary education students using the Rasch model. The results indicate that the 25 items of the CDSE-SF are well fitted to a latent unidimensional structure, as required by Rasch modeling. The response…

  13. Rasch Analysis of the Locus-of-Hope Scale. Brief Report

    Science.gov (United States)

    Gadiana, Leny G.; David, Adonis P.

    2015-01-01

    The Locus-of-Hope Scale (LHS) was developed as a measure of the locus-of-hope dimensions (Bernardo, 2010). The present study adds to the emerging literature on locus-of-hope by assessing the psychometric properties of the LHS using Rasch analysis. The results from the Rasch analyses of the four subscales of LHS provided evidence on the…

  14. Propriedades psicométricas da versão brasileira da escala de qualidade de vida específica para acidente vascular encefálico: aplicação do modelo Rasch Psychometric properties of the Brazilian version of the Stroke Specific Quality of Life Scale: application of the Rasch model

    Directory of Open Access Journals (Sweden)

    RCM Lima

    2008-04-01

    Full Text Available CONTEXTUALIZAÇÃO: O acidente vascular encefálico (AVE produz déficits importantes na qualidade de vida (QV dos indivíduos. Medidas específicas de QV são necessárias para compreender e quantificar o impacto dessa patologia. OBJETIVO: O objetivo desse estudo foi adaptar transculturalmente o Stroke Specific Quality of Life Scale (SSQOL para o Português (Brasil e avaliar suas propriedades psicométricas. MATERIAIS E MÉTODOS: O SSQOL foi traduzido e adaptado seguindo instruções padronizadas e submetido a exame de confiabilidade teste-reteste (10 hemiplégicos. As propriedades psicométricas foram investigadas pela análise Rasch em 50 hemiplégicos. RESULTADOS: Foram detectados coeficientes de confiabilidade de 0,92 para itens e indivíduos. O índice de separação dos hemiplégicos foi 3,34 e dos itens, 3,36, ou seja, os itens separaram as pessoas em pelo menos três níveis de QV e em três níveis de QV - baixa, média e alta. Dos 49 itens, quatro não se enquadram no modelo, o que compromete a validade de constructo do instrumento, embora o padrão errático dos itens se justifique na amostra examinada. CONCLUSÕES: O instrumento mostrou-se clinicamente útil na população avaliada. Novos estudos em populações com outras características já estão em andamento.BACKGROUND: Stroke results in important deficits, which reduce individuals’ quality of life (QOL. Specific QOL measurements are necessary to understand and quantify the impact of this pathological condition. OBJECTIVE: The aim of this study was to make a transcultural adaptation of the Stroke Specific Quality of Life Scale (SSQOL into Brazilian Portuguese and to assess its psychometric properties. METHODS: The SSQOL was translated and adapted in accordance with standardized procedures and was subjected to test-retest reliability analysis with 10 hemiplegic subjects. The psychometric properties were investigated using Rasch analysis on 50 hemiplegics. RESULTS: Reliability

  15. [Psychometric approach of metacognition: Pilot study in clinical population].

    Science.gov (United States)

    Visinet, A; Soumet-Leman, C; Baptista, A; Bungener, C; Jouvent, R

    2017-04-01

    Metacognition describes the process of thinking about one's own thought processes. This concept was introduced by Flavell in 1979 and has since been widely developed in the cognitive approach to mood and anxiety disorders. As it happens, many recent studies have underlined the links between metacognition and anxio-depressive symptoms, pointing out the interest of assessing its various dimensions. The short form of the Metacognitions Questionnaire is a brief multidimensional measure of a range of metacognitive processes and metacognitive beliefs about worry and cognition relevant to the vulnerability to and the maintenance of emotional disorders. The aim of this study was twofold: firstly to adapt and validate a French version of the short form of the Metacognitions Questionnaire (MCQ-30) and to assess its psychometric properties in a clinical sample, and secondly to investigate metacognitive predictors of anxiety and depression in this sample. The sample included 55 clinical participants (24 men, 31 women, mean age=51.33±14.62) with DSM-IV-TR psychiatric disorders (major depression, bipolar disorder and obsessive-compulsive disorder). Instrument reliability (internal consistency), construct validity (confirmatory factor analysis), and convergent validity were measured. The total score and the five subscale scores were also compared with previous results in non-clinical samples. Reliability analyses indicated that the French version of the MCQ-30 possessed satisfactory internal consistency (Cronbach α=0.84), and confirmatory factor analysis supported the MCQ's original five-factor structure. Correlation with measurements of depression, anxiety and pathological worry demonstrated convergent validity (r=0.62, Pmetacognition, in relation to the anxio-depressive symptomatology and the subsequent management of patients. Copyright © 2016 L’Encéphale, Paris. Published by Elsevier Masson SAS. All rights reserved.

  16. psychotools - Infrastructure for Psychometric Modeling: Version 0.1-1

    OpenAIRE

    Zeileis, A.; Strobl, Carolin; Wickelmaier, F

    2011-01-01

    Infrastructure for psychometric modeling such as data classes (e.g., for paired comparisons) and basic model fitting functions (e.g., for Rasch and Bradley-Terry models). Intended especially as a common building block for fitting psychometric mixture models in package ‘‘psychomix’’ and psychometric tree models in package ‘‘psychotree’’. License: GPL-2

  17. Reducing the item number to obtain the same-length self-assessment scales: a systematic approach using result of graphical loglinear rasch models

    DEFF Research Database (Denmark)

    Nielsen, Tine; Kreiner, Svend

    2011-01-01

    approach to item reduction based on results of graphical loglinear Rasch modeling (GLLRM) was designed. This approach was then used to reduce the number of items in the subscales of the R-D-LSI which had an item-length of more than seven items, thereby obtaining the Danish Self-Assessment Learning Styles......The Revised Danish Learning Styles Inventory (R-D-LSI) (Nielsen 2005), which is an adaptation of Sternberg- Wagner Thinking Styles Inventory (Sternberg, 1997), comprises 14 subscales, each measuring a separate learning style. Of these 14 subscales, 9 are eight items long and 5 are seven items long...

  18. Fitting polytomous Rasch models in SAS

    DEFF Research Database (Denmark)

    Christensen, Karl Bang

    2006-01-01

    The item parameters of a polytomous Rasch model can be estimated using marginal and conditional approaches. This paper describes how this can be done in SAS (V8.2) for three item parameter estimation procedures: marginal maximum likelihood estimation, conditional maximum likelihood estimation......, and pairwise conditional estimation. The use of the procedures for extensions of the Rasch model is also discussed. The accuracy of the methods are evaluated using a simulation study....

  19. Was Pre-Modern Man a Child? The Quintessence of the Psychometric and Developmental Approaches

    Science.gov (United States)

    Oesterdiekhoff, Georg W.

    2012-01-01

    The essay integrates the psychometric intelligence approach with the cognitive-developmental approach or the stage theory erected by Piaget and his disciples. The latter led to Piagetian Cross-Cultural Psychology and the accumulation of an immense body of data. It shows that different IQ levels are indicative of the peculiar stages of cognitive…

  20. Was Pre-Modern Man a Child? The Quintessence of the Psychometric and Developmental Approaches

    Science.gov (United States)

    Oesterdiekhoff, Georg W.

    2012-01-01

    The essay integrates the psychometric intelligence approach with the cognitive-developmental approach or the stage theory erected by Piaget and his disciples. The latter led to Piagetian Cross-Cultural Psychology and the accumulation of an immense body of data. It shows that different IQ levels are indicative of the peculiar stages of cognitive…

  1. From Rasch scores to regression

    DEFF Research Database (Denmark)

    Christensen, Karl Bang

    2006-01-01

    Rasch models provide a framework for measurement and modelling latent variables. Having measured a latent variable in a population a comparison of groups will often be of interest. For this purpose the use of observed raw scores will often be inadequate because these lack interval scale propertie....... This paper compares two approaches to group comparison: linear regression models using estimated person locations as outcome variables and latent regression models based on the distribution of the score....

  2. Methodologically sound: Evaluating the psychometric approach to the assessment of human life history [reply to Copping, Campbell, and Muncer, 2014].

    Science.gov (United States)

    Figueredo, Aurelio José; Cabeza de Baca, Tomás; Black, Candace Jasmine; García, Rafael Antonio; Fernandes, Heitor Barcellos Ferreira; Wolf, Pedro Sofio Abril; Woodley of Menie, Michael Anthony

    2015-04-06

    Copping, Campbell, and Muncer (2014) have recently published an article critical of the psychometric approach to the assessment of life history (LH) strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS). As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1) A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2) our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3) our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4) our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledging their limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods.

  3. Methodologically Sound: Evaluating the Psychometric Approach to the Assessment of Human Life History [Reply to Copping, Campbell, and Muncer, 2014

    Directory of Open Access Journals (Sweden)

    Aurelio José Figueredo

    2015-04-01

    Full Text Available Copping, Campbell, and Muncer (2014 have recently published an article critical of the psychometric approach to the assessment of life history (LH strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS. As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1 A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2 our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3 our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4 our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledging their limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods.

  4. Using Rasch analysis to evaluate the validity of the diabetes-specific version of the Illness Perception Questionnaire--Revised.

    Science.gov (United States)

    Rees, Gwyneth; Lamoureux, Ecosse L; Xie, Jing; Sturrock, Bonnie A; Fenwick, Eva K

    2015-10-01

    This study used Rasch analysis to examine the psychometric validity of the Illness Perception Questionnaire--Revised to assess beliefs about diabetes in 470 participants with Type 2 diabetes and 71 participants with Type 1 diabetes. All Illness Perception Questionnaire--Revised scales had psychometric issues, which included poorly utilised response categories, poor scale precision and multidimensionality. Following re-engineering, only four of the eight scales (Consequences, Illness coherence, Timeline cyclical and Emotional representations) were psychometrically adequate according to the Rasch model. The diabetes-specific version of the Illness Perception Questionnaire--Revised provides suboptimal assessment of beliefs held by patients with diabetes.

  5. Development of a short version of the Aging Males' Symptoms scale: Mokken scaling analysis and Rasch analysis.

    Science.gov (United States)

    Lee, Chin-Pang; Chen, Yu; Jiang, Kun-Hao; Chu, Chun-Lin; Chiu, Yu-Wen; Chen, Jiun-Liang; Chen, Ching-Yen

    2016-06-01

    The aim of this study was to develop a psychometrically sound short version of the 17-item Aging Males' Symptoms (AMS) scale using Mokken scale analysis (MSA) and Rasch analysis. We recruited a convenient sample of 1787 men (age: mean (SD) = 43.8 (11.5) years) who visited a men's health polyclinic in Taiwan and completed the AMS scale. The scale was first assessed using MSA. The remaining items were assessed using Rasch analysis. We used a stepwise approach to remove items with χ(2) item statistics and mean square values while monitoring unidimensionality. The item reduction process resulted in a 6-item version of the AMS scale (AMS-6). The AMS-6 scale included a 5-item psychosomatic subscale (original items 1, 4, 5, 8, and 9) and a 1-item sexual subscale (original item 16). Analyses confirmed that the 5-item psychosomatic subscale was a Rasch scale. The AMS-6 correlated well with the AMS scales: the 5-item psychosomatic subscale correlated with the AMS scale (r between 0.50 and 0.92); the 1-item sexual subscale correlated with the sexual subscale of the AMS scale (r = 0.81). A 6-item short form of the AMS scale had satisfactory measurement properties. This version may be useful for estimating psychosomatic and sexual symptoms as well as health-related quality of life with a minimal burden on respondents.

  6. Measuring the dimensions of adaptive capacity: a psychometric approach

    Directory of Open Access Journals (Sweden)

    Michael Lockwood

    2015-03-01

    Full Text Available Although previous studies have examined adaptive capacity using a range of self-assessment procedures, no objective self-report approaches have been used to identify the dimensions of adaptive capacity and their relative importance. We examine the content, structure, and relative importance of dimensions of adaptive capacity as perceived by rural landholders in an agricultural landscape in South-Eastern Australia. Our findings indicate that the most important dimensions influencing perceived landholder adaptive capacity are related to their management style, particularly their change orientation. Other important dimensions are individual financial capacity, labor availability, and the capacity of communities and local networks to support landholders' management practices. Trust and confidence in government with respect to native vegetation management was not found to be a significant dimension of perceived adaptive capacity. The scale items presented, particularly those with high factor loadings, provide a solid foundation for assessment of adaptive capacity in other study areas, as well as exploration of relationships between the individual dimensions of adaptive capacity and dependent variables such as perceived resilience. Further work is needed to refine the scale items and compare the findings from this case study with those from other contexts and population samples.

  7. Comparison of proficiency in an anesthesiology course across distinct medical student cohorts: Psychometric approaches to test equating

    Directory of Open Access Journals (Sweden)

    Shu-Wei Liao

    2014-03-01

    Conclusion: Although both the chained linear equating method and Rasch analysis can be readily applied to practical test-equating issues in medical education, Rasch analysis exhibited more versatility in test parameter estimation and item bank development for clinical curriculums.

  8. With hiccups and bumps: the development of a Rasch-based instrument to measure elementary students' understanding of the nature of science.

    Science.gov (United States)

    Peoples, Shelagh M; O'Dwyer, Laura M; Shields, Katherine A; Wang, Yang

    2013-01-01

    This research describes the development process, psychometric analyses and part validation study of a theoretically-grounded Rasch-based instrument, the Nature of Science Instrument-Elementary (NOSI-E). The NOSI-E was designed to measure elementary students' understanding of the Nature of Science (NOS). Evidence is provided for three of the six validity aspects (content, substantive and generalizability) needed to support the construct validity of the NOSI-E. A future article will examine the structural and external validity aspects. Rasch modeling proved especially productive in scale improvement efforts. The instrument, designed for large-scale assessment use, is conceptualized using five construct domains. Data from 741 elementary students were used to pilot the Rasch scale, with continuous improvements made over three successive administrations. The psychometric properties of the NOSI-E instrument are consistent with the basic assumptions of Rasch measurement, namely that the items are well-fitting and invariant. Items from each of the five domains (Empirical, Theory-Laden, Certainty, Inventive, and Socially and Culturally Embedded) are spread along the scale's continuum and appear to overlap well. Most importantly, the scale seems appropriately calibrated and responsive for elementary school-aged children, the target age group. As a result, the NOSI-E should prove beneficial for science education research. As the United States' science education reform efforts move toward students' learning science through engaging in authentic scientific practices (NRC, 2011), it will be important to assess whether this new approach to teaching science is effective. The NOSI-E can be used as one measure of whether this reform effort has an impact.

  9. The Hamilton Depression Scale (HAM-D) and the Montgomery-Åsberg Depression Scale (MADRS). A psychometric re-analysis of the European Genome-Based Therapeutic Drugs for Depression Study using Rasch analysis

    DEFF Research Database (Denmark)

    Bech, Per; Allerup, Peter; Larsen, Erik Roj

    2014-01-01

    The objective of this re-analysis of the European Genome-Based Therapeutic Drugs for Depression Study (GENDEP) was to psychometrically test the unidimensionality of the full Montgomery Åsberg Depression Rating Scale (MADRS10) and the Hamilton Depression Scale (HAM-D17) versus their respective...... 2030 had to be supplemented with the Friedman two-way analysis of variance by ranks. The HAM-D6 but not the MADRS5 was accepted. It was therefore concluded that the HAM-D6 is a psychometrically valid outcome scale to measure change in clinical trials of antidepressants....

  10. Rasch Analysis of the Lubben Social Network Scale-6 (LSNS-6).

    Science.gov (United States)

    Gray, Jennifer; Kim, Jinsook; Ciesla, James R; Yao, Ping

    2016-05-01

    The purposes of this article are to review the psychometric properties of the Lubben Social Network Scale-6 (LSNS-6) and to determine its utility in assessing social networks of an older adult community sample. We tested the LSNS-6 with Rasch methodology using a sample of 196 older adults, aged 55 and above who live in public and subsidized housing facilities. Rasch analysis showed unidimensionality of the overall scale, high person and item reliability, and good fit of individual items with one exception. Principal component analysis (PCA) of Rasch model residuals suggested family and friend subdimensions. Response categories demonstrated improvement when six categories were collapsed to four. A person-threshold map indicated ceiling and floor effects due to lack of items measuring less and more developed social networks. Recommendations provided in this article can make the LSNS-6 more psychometrically sound and useful in research and practical contexts.

  11. Evaluation of the Bess TRS-CA Using the Rasch Rating Scale Model

    Science.gov (United States)

    DiStefano, Christine; Morgan, Grant B.

    2010-01-01

    This study examined the Behavioral and Emotional Screening System Teacher Rating System for Children and Adolescents (BESS TRS-CA; Kamphaus & Reynolds, 2007) screener using Rasch Rating Scale model (RSM) methodology to provide additional information about psychometric properties of items. Data from the Behavioral Assessment System for Children…

  12. Developing Information Skills Test for Malaysian Youth Students Using Rasch Analysis

    Science.gov (United States)

    Karim, Aidah Abdul; Shah, Parilah M.; Din, Rosseni; Ahmad, Mazalah; Lubis, Maimun Aqhsa

    2014-01-01

    This study explored the psychometric properties of a locally developed information skills test for youth students in Malaysia using Rasch analysis. The test was a combination of 24 structured and multiple choice items with a 4-point grading scale. The test was administered to 72 technical college students and 139 secondary school students. The…

  13. An Extension of the Rasch Model for Ratings Providing Both Location and Dispersion Parameters.

    Science.gov (United States)

    Andrich, David

    1982-01-01

    An elaboration of a psychometric model for rated data, which belongs to the class of Rasch models, is shown to provide a model with two parameters, one characterizing location and one characterizing dispersion. Characteristics of the dispersion parameter are discussed. (Author/JKS)

  14. Using Rasch Rating Scale Methodology to Examine a Behavioral Screener for Preschoolers at Risk

    Science.gov (United States)

    DiStefano, Christine; Greer, Fred W.; Kamphaus, R. W.; Brown, William H.

    2014-01-01

    A screening instrument used to identify young children at risk for behavioral and emotional difficulties, the Behavioral and Emotional Screening System Teacher Rating Scale-Preschool was examined. The Rasch Rating Scale Method was used to provide additional information about psychometric properties of items, respondents, and the response scale.…

  15. FIM measurement properties and Rasch model details.

    Science.gov (United States)

    Wright, B D; Linacre, J M; Smith, R M; Heinemann, A W; Granger, C V

    1997-12-01

    To summarize, we take issue with the criticisms of Dickson & Köhler for two main reasons: 1. Rasch analysis provides a model from which to approach the analysis of the FIM, an ordinal scale, as an interval scale. The existence of examples of items or individuals which do not fit the model does not disprove the overall efficacy of the model; and 2. the principal components analysis of FIM motor items as presented by Dickson & Köhler tends to undermine rather than support their argument. Their own analyses produce a single major factor explaining between 58.5 and 67.1% of the variance, depending upon the sample, with secondary factors explaining much less variance. Finally, analysis of item response, or latent trait, is a powerful method for understanding the meaning of a measure. However, it presumes that item scores are accurate. Another concern is that Dickson & Köhler do not address the issue of reliability of scoring the FIM items on which they report, a critical point in comparing results. The Uniform Data System for Medical Rehabilitation (UDSMRSM) expends extensive effort in the training of clinicians of subscribing facilities to score items accurately. This is followed up with a credentialing process. Phase 1 involves the testing of individual clinicians who are submitting data to determine if they have achieved mastery over the use of the FIM instrument. Phase 2 involves examining the data for outlying values. When Dickson & Köhler investigate more carefully the application of the Rasch model to their FIM data, they will discover that the results presented in their paper support rather than contradict their application of the Rasch model! This paper is typical of supposed refutations of Rasch model applications. Dickson & Köhler will find that idiosyncrasies in their data and misunderstandings of the Rasch model are the only basis for a claim to have disproven the relevance of the model to FIM data. The Rasch model is a mathematical theorem (like

  16. Measuring Disability: Application of the Rasch Model to Activities of Daily Living (ADL/IADL).

    Science.gov (United States)

    Sheehan, T. Joseph; DeChello, Laurie M.; Garcia, Ramon; Fifield, Judith; Rothfield, Naomi; Reisine, Susan

    2001-01-01

    Performed a comparative analysis of Activities of Daily Living (ADL) items administered to 4,430 older adults and Instrumental Activities of Daily Living administered to 605 people with rheumatoid arthritis scoring both with Likert and Rasch measurement models. Findings show the superiority of the Rasch approach over the Likert method. (SLD)

  17. Development of a Keratoconus-Specific Questionnaire Using Rasch Analysis.

    Science.gov (United States)

    Khadka, Jyoti; Schoneveld, Paul G; Pesudovs, Konrad

    2017-03-01

    To develop and validate a keratoconus-specific quality of life (QoL) questionnaire: the Keratoconus Outcomes Research Questionnaire (KORQ). The study was carried out in three phases. Phase I: content identifications: items were identified based on an extensive literature review, open-ended patient mail survey, and expert consultations. Each item was scored on a visual analog scale (VAS). Phase II: pilot testing using Rasch analysis. Phase III: testing psychometric properties of the final version of the KORQ. Phase I identified 44 items across 3 different content areas: activity limitation (26), symptoms (20), and convenience (8). The 44-item KORQ was self-administered to 158 people with keratoconus. The 44-item KORQ was multidimensional. Unidimensionality was restored by separating items across three content areas (subscales) as identified in phase I. The activity limitation and symptoms subscales demonstrated adequate measurement precision, but convenience (precision, 1.01) did not. Hence, the convenience subscale was discarded. Rasch analysis revealed that the VAS was disordered. The ordering of the VAS was restored by collapsing categories into 4. An iterative Rasch analysis guided item-removal resulted into a 29-item KORQ (18-item activity limitation and 11-item symptoms). The VAS was replaced by a discrete 4-option labeled categorical rating scale, and it was self-administered by 169 people with keratoconus. Both the subscales demonstrated good psychometric properties. The KORQ scores strongly correlated with visual acuity and contrast sensitivity demonstrating its construct validity. The 29-item KORQ was a psychometrically robust and valid instrument to assess the impact of keratoconus on activity limitation and symptoms.

  18. Rasch Analysis of Lebanese Nurses’ Responses to the EIS Questionnaire

    Directory of Open Access Journals (Sweden)

    Michael Clinton

    2014-08-01

    Full Text Available This study examined the psychometric characteristics of a 32-item modified version of the Ethical Issues Scale (EIS. Data were collected from 59 registered nurses at the American University of Beirut Medical Centre (AUBMC. Data were analyzed using WINSTEPS Rasch analysis software. The four-category EIS rating scale needs modification for future studies in Lebanon. All EIS scale items need rewording prior to translation into Arabic to avoid confusion among Lebanese nurses. Principal component analysis (PCA of residuals indicated the possible presence of additional dimensions. Additional EIS items are needed to improve targeting.

  19. Predicting responses from Rasch measures.

    Science.gov (United States)

    Linacre, John M

    2010-01-01

    There is a growing family of Rasch models for polytomous observations. Selecting a suitable model for an existing dataset, estimating its parameters and evaluating its fit is now routine. Problems arise when the model parameters are to be estimated from the current data, but used to predict future data. In particular, ambiguities in the nature of the current data, or overfit of the model to the current dataset, may mean that better fit to the current data may lead to worse fit to future data. The predictive power of several Rasch and Rasch-related models are discussed in the context of the Netflix Prize. Rasch-related models are proposed based on Singular Value Decomposition (SVD) and Boltzmann Machines.

  20. Psychometric Properties of the Fatigue Severity Scale in Polio Survivors

    Science.gov (United States)

    Burger, Helena; Franchignoni, Franco; Puzic, Natasa; Giordano, Andrea

    2010-01-01

    The objective of this study was to evaluate by means of classical test theory and Rasch analysis the scaling characteristics and psychometric properties of the Fatigue Severity Scale (FSS) in polio survivors. A questionnaire, consisting of five general questions (sex, age, age at time of acute polio, sequelae of polio, and new symptoms), the FSS,…

  1. Rasch Model Parameter Estimation in the Presence of a Nonnormal Latent Trait Using a Nonparametric Bayesian Approach

    Science.gov (United States)

    Finch, Holmes; Edwards, Julianne M.

    2016-01-01

    Standard approaches for estimating item response theory (IRT) model parameters generally work under the assumption that the latent trait being measured by a set of items follows the normal distribution. Estimation of IRT parameters in the presence of nonnormal latent traits has been shown to generate biased person and item parameter estimates. A…

  2. Application of the Rasch Rating Scale Model to the Assessment of Quality of Life of Persons with Intellectual Disability

    Science.gov (United States)

    Gomez, Laura E.; Arias, Benito; Verdugo, Miguel Angel; Navas, Patricia

    2012-01-01

    Background: Most instruments that assess quality of life have been validated by means of the classical test theory (CTT). However, CTT limitations have resulted in the development of alternative models, such as the Rasch rating scale model (RSM). The main goal of this paper is testing and improving the psychometric properties of the INTEGRAL…

  3. Understanding Rasch measurement: estimation methods for Rasch measures.

    Science.gov (United States)

    Linacre, J M

    1999-01-01

    Rasch parameter estimation methods can be classified as non-interative and iterative. Non-iterative methods include the normal approximation algorithm (PROX) for complete dichotomous data. Iterative methods fall into 3 types. Datum-by-datum methods include Gaussian least-squares, minimum chi-square, and the pairwise (PAIR) method. Marginal methods without distributional assumptions include conditional maximum-likelihood estimation (CMLE), joint maximum-likelihood estimation (JMLE) and log-linear approaches. Marginal methods with distributional assumptions include marginal maximum-likelihood estimation (MMLE) and the normal approximation algorithm (PROX) for missing data. Estimates from all methods are characterized by standard errors and quality-control fit statistics. Standard errors can be local (defined relative to the measure of a particular item) or general (defined relative to the abstract origin of the scale). They can also be ideal (as though the data fit the model) or inflated by the misfit to the model present in the data. Five computer programs, implementing different estimation methods, produce statistically equivalent estimates. Nevertheless, comparing estimates from different programs requires care.

  4. Rasch modeling of accuracy and confidence measures from cognitive tests.

    Science.gov (United States)

    Paek, Insu; Lee, Jihyun; Stankov, Lazar; Wilson, Mark

    2013-01-01

    The use of IRT models has not been rigorously applied in studies of the relationship between test-takers' confidence and accuracy. This study applied the Rasch measurement models to investigate the relationship between test-takers' confidence and accuracy on English proficiency tests, proposing potentially useful measures of under or overconfidence. The Rasch approach provided the scaffolding to formulate indices that can assess the discrepancy between confidence and accuracy at the item or total test level, as well as at particular ability levels locally. In addition, a "disattenuated" measure of association between accuracy and confidence, which takes measurement error into account, was obtained through a multidimensional Rasch modeling of the two constructs where the latent variance-covariance structure is directly estimated from the data. The results indicate that the participants tend to show overconfidence bias in their own cognitive abilities.

  5. Validation of the Rasch-based Depression Screening in a large scale German general population sample

    Directory of Open Access Journals (Sweden)

    Norra Christine

    2010-09-01

    Full Text Available Abstract Background The study aimed at presenting normative data for both parallel forms of the "Rasch-based Depression Screening (DESC", to examine its Rasch model conformity and convergent and divergent validity based on a representative sample of the German general population. Methods The sample was selected with the assistance of a demographic consulting company applying a face to face interview (N = 2509; mean age = 49.4, SD = 18.2; 55.8% women. Adherence to Rasch model assumptions was determined with analysis of Rasch model fit (infit and outfit, unidimensionality, local independence (principal component factor analysis of the residuals, PCFAR and differential item functioning (DIF with regard to participants' age and gender. Norm values were calculated. Convergent and divergent validity was determined through intercorrelations with the depression and anxiety subscales of the Hospital Anxiety and Depression Scale (HADS-D and HADS-A. Results Fit statistics were below critical values (rDESC-I = .61 and rDESC-II = .60, whereas correlations with HADS-A were rDESC-I = .62 and rDESC-II = .60. Conclusions This study provided further support for the psychometric quality of the DESC. Both forms of the DESC adhered to Rasch model assumptions and showed intercorrelations with HADS subscales that are in line with the literature. The presented normative data offer important advancements for the interpretation of the questionnaire scores and enhance its usefulness for clinical and research applications.

  6. Psychometric Evaluation of the Student Authorship Questionnaire: A Confirmatory Factor Analysis Approach

    Science.gov (United States)

    Ballantine, Joan; Guo, Xin; Larres, Patricia

    2015-01-01

    This research provides new insights into the measurement of students' authorial identity and its potential for minimising the incidence of unintentional plagiarism by providing evidence about the psychometric properties of the Student Authorship Questionnaire (SAQ). Exploratory and confirmatory factor analyses (EFA and CFA) are employed to…

  7. Psychometric Structure of a Comprehensive Objective Structured Clinical Examination: A Factor Analytic Approach

    Science.gov (United States)

    Volkan, Kevin; Simon, Steven R.; Baker, Harley; Todres, I. David

    2004-01-01

    Problem Statement and Background: While the psychometric properties of Objective Structured Clinical Examinations (OSCEs) have been studied, their latent structures have not been well characterized. This study examines a factor analytic model of a comprehensive OSCE and addresses implications for measurement of clinical performance. Methods: An…

  8. A Psychometric Approach to the Selection of Translation and Interpreting Students in Taiwan.

    Science.gov (United States)

    Arjona-Tseng, Etilvia

    1993-01-01

    Details the setting up of a battery of psychometric tests for selecting student interpreters for the Graduate Institute of Translation and Interpreting in Taiwan. Argues that the rigid screening (which leads to a nearly 100 percent pass rate) compares favorably with the high drop-out rate in traditional schools of interpreting. (NKA)

  9. Brazilian WHOQOL-OLD Module version: a Rasch analysis of a new instrument Versão em português do Módulo WHOQOL-OLD: análise de Rasch de um novo instrumento

    Directory of Open Access Journals (Sweden)

    Eduardo Chachamovich

    2008-04-01

    Full Text Available OBJECTIVE: To evaluate the Brazilian version of WHOQOL-OLD Module and to test potential changes to the instrument to increase its psychometric adequacy. METHODS: A total of 424 older adults living in a city in Southern Brazil completed the WHOQOL-OLD instrument, in 2005. Rasch analysis was used to explore the psychometric performance of the scale, as implemented by the RUMM2020 software. Item-trait interaction, threshold disorders, presence of differential item functioning and item fit, were analyzed. RESULTS: Two ("death and dying" and "sensory abilities" out of six domains showed inadequate item-trait interactions. Rescoring the response scale and deleting the most misperforming items led to scale improvement. The evaluation of domains and items individually showed that the "intimacy" domain does perform well in contrast to the findings using the classical approach. In addition, the "sensory abilities" domain does not derive an interval measure in its current format. CONCLUSIONS: Unidimensionality and local independence were seen in all domains. Changes in the response scale and deletion of problematic items improved the scale's performance.OBJETIVO: Analisar a versão brasileira do Módulo WHOQOL-OLD, indicando alterações potenciais do instrumento para aumentar a adequação psicométrica. MÉTODOS: O total de 424 idosos residentes em Porto Alegre, RS, responderam o instrumento WHOQOL-OLD em 2005. O modelo de Rasch foi utilizado para a análise do desempenho psicométrico da escala, a partir do software RUMM2020. Foram analisadas a interação item-traço, a presença de funcionamento diferencial dos itens e a adequação dos itens ao modelo de Rasch. RESULTADOS: Dois domínios ("morte e morrer" e "funcionamento do sensório" apresentaram interação item-total insuficiente. Remodelar a escala de resposta e excluir itens com pior performance resultou em melhora da escala. A análise dos domínios e itens individualmente foi capaz de indicar

  10. Psychometric properties of the painDETECT questionnaire in rhuematoid arthritis, psoriatic arthritis and spondyloarthritis

    DEFF Research Database (Denmark)

    Rifbjerg-Madsen, Signe; Wæhrens, Eva Elisabet Ejlersen; Danneskiold-Samsøe, Bente

    2017-01-01

    that can identify underlying pain mechanisms are needed. The painDETECT questionnaire (PDQ) was originally designed to differentiate between pain phenotypes. The objectives were to evaluate the psychometric properties of the PDQ in patients with inflammatory arthritis by applying Rasch analysis......) and classification consistency were calculated. RESULTS: The Rasch analysis revealed: (1) Acceptable psychometric rating scale properties; the frequency distribution peaked in category 0 except for item 5, threshold calibration >10 observations per category, no disorder in the category measures for all items, scale...

  11. Guessing and the Rasch Model

    Science.gov (United States)

    Holster, Trevor A.; Lake, J.

    2016-01-01

    Stewart questioned Beglar's use of Rasch analysis of the Vocabulary Size Test (VST) and advocated the use of 3-parameter logistic item response theory (3PLIRT) on the basis that it models a non-zero lower asymptote for items, often called a "guessing" parameter. In support of this theory, Stewart presented fit statistics derived from…

  12. Application of the Rasch model in measuring personality disorders Aplicação do modelo de Rasch na medida de transtornos da personalidade

    Directory of Open Access Journals (Sweden)

    Lucas de Francisco Carvalho

    2012-01-01

    Full Text Available OBJECTIVE: To describe item and person parameters obtained with the Rasch model, one of the item response theory models, in the assessment of personality disorders based on Millon's theory. METHOD: A total of 350 people participated in the study. Age ranged from 18 to 67 years (mean ± standard deviation = 27.02±10.13, and 71.7% of the participants (n = 251 were female. Of the 350 individuals, 21.1% (n = 74 answered affirmatively about being under psychiatric treatment and taking psychiatric medications. The Personality Disorders Dimensional Inventory (PDDI, an instrument designed to assess personality disorders according to Millon's theory, was applied to all participants. Data were analyzed using the Rasch model. RESULTS: Overall, analysis with the Rasch model revealed that the PDDI has adequate psychometric properties for the assessment of personality disorders. CONCLUSION: Among the contributions of item response theory models for clinical instruments, the Rasch person-item map deserves to be highlighted as a successful attempt to improve the understanding of clinical scores obtained in response to particular test items.OBJETIVO: Descrever os parâmetros de itens e pessoas obtidos com o modelo de Rasch, um dos modelos da teoria de resposta ao item, na avaliação de transtornos da personalidade de acordo com a teoria de Millon. MÉTODO: Participaram do estudo 350 pessoas. A idade variou de 18 a 67 anos (média ± desvio padrão = 27.02±10.13, e 71.7% (n = 251 eram do sexo feminino. Dos 350 participantes, 21.1% (n = 74 responderam afirmativamente sobre estarem em tratamento psiquiátrico e utilizarem medicamento psiquiátrico. O Inventário Dimensional de Transtornos da Personalidade (IDTP, destinado à avaliação dos transtornos da personalidade com base na teoria de Millon, foi aplicado a todos os participantes. Os dados foram analisados por meio do modelo de Rasch. RESULTADOS: De modo geral, os resultados da análise por meio do modelo

  13. Aplikasi Model Rasch pada Pengembangan Skala Efikasi Diri dalam Pengambilan Keputusan Karier Siswa

    Directory of Open Access Journals (Sweden)

    Difa Ardiyanti

    2016-12-01

    Full Text Available Self-efficacy has an important role in career decision making. To get an accurate student’s profile of career decision making self-efficacy, required a good instrument. Unfortunately, there was only one instument of career decision-making self-efficacy and there was no improvement or current development. That instrument developed using classical test theory, an approach that had been criticized, especially about raw score and data interval. This study focused on career decision making self-efficacy scale’s development using Rasch model, an approach that had more advantages compared with classical test theory. The subjects were 144 students of grade 11 in Yogyakarta. Based on the analysis results using Winsteps program, there were 20 fit items (from 36 items with Alpha reliability coefficient was 0,91. Overall, it can be concluded that the career decision making self-efficacy scale had been proven as a good instrument because had good psychometric properties. So in future, this instrument can be used for assessment and research.

  14. Quantifying Human Response: Linking metrological and psychometric characterisations of Man as a Measurement Instrument

    Science.gov (United States)

    Pendrill, L. R.; Fisher, William P., Jr.

    2013-09-01

    A better understanding of how to characterise human response is essential to improved person-centred care and other situations where human factors are crucial. Challenges to introducing classical metrological concepts such as measurement uncertainty and traceability when characterising Man as a Measurement Instrument include the failure of many statistical tools when applied to ordinal measurement scales and a lack of metrological references in, for instance, healthcare. The present work attempts to link metrological and psychometric (Rasch) characterisation of Man as a Measurement Instrument in a study of elementary tasks, such as counting dots, where one knows independently the expected value because the measurement object (collection of dots) is prepared in advance. The analysis is compared and contrasted with recent approaches to this problem by others, for instance using signal error fidelity.

  15. Rasch-modeling the Portuguese SOCRATES in a clinical sample.

    Science.gov (United States)

    Lopes, Paulo; Prieto, Gerardo; Delgado, Ana R; Gamito, Pedro; Trigo, Hélder

    2010-06-01

    The Stages of Change Readiness and Treatment Eagerness Scale (SOCRATES) assesses motivation for treatment in the drug-dependent population. The development of adequate measures of motivation is needed in order to properly understand the role of this construct in rehabilitation. This study probed the psychometric properties of the SOCRATES in the Portuguese population by means of the Rasch Rating Scale Model, which allows the conjoint measurement of items and persons. The participants were 166 substance abusers under treatment for their addiction. Results show that the functioning of the five response categories is not optimal; our re-analysis indicates that a three-category system is the most appropriate one. By using this response category system, both model fit and estimation accuracy are improved. The discussion takes into account other factors such as item format and content in order to make suggestions for the development of better motivation-for-treatment scales.

  16. Psychometric properties of virtual reality vignette performance measures: a novel approach for assessing adolescents' social competency skills

    National Research Council Canada - National Science Library

    Paschall, Mallie J; Fishbein, Diana H; Hubal, Robert C; Eldreth, Diana

    This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents...

  17. Physical capability scale: psychometric testing.

    Science.gov (United States)

    Resnick, Barbara; Boltz, Marie; Galik, Elizabeth; Wells, Chris

    2013-02-01

    The purpose of this study was to describe the psychometric testing of the Basic Physical Capability Scale. The study was a secondary data analysis of combined data sets from three studies. Study participants included 93 older adults, recruited from 2 acute-care settings and 110 older adults living in long-term care facilities. Rasch analysis was used for the testing of the measurement model. There was some support for construct validity based on the fit of the items to the scale across both samples. In addition, there was support for hypothesis testing as physical function was significantly associated with physical capability. There was evidence for internal consistency (Alpha coefficients of .77-.83) and interrater reliability based on an intraclass correlation of .81. This study provided preliminary support for the reliability and validity of the Basic Physical Capability Scale, and guidance for scale revisions and continued use.

  18. On Local Homogeneity and Stochastically Ordered Mixed Rasch Models

    Science.gov (United States)

    Kreiner, Svend; Hansen, Mogens; Hansen, Carsten Rosenberg

    2006-01-01

    Mixed Rasch models add latent classes to conventional Rasch models, assuming that the Rasch model applies within each class and that relative difficulties of items are different in two or more latent classes. This article considers a family of stochastically ordered mixed Rasch models, with ordinal latent classes characterized by increasing total…

  19. The Adults and Older Adults Functional Assessment Inventory: A Rasch Model Analysis.

    Science.gov (United States)

    Sousa, Liliana B; Prieto, Gerardo; Vilar, Manuela; Firmino, Horácio; Simões, Mário R

    2015-11-01

    Functional assessment methods are an important element in multidimensional neuropsychological evaluations, particularly in older adults. The Adults and Older Adults Functional Assessment Inventory is a new measure of basic and instrumental activities of daily living. Rasch model analyses were used to analyze the psychometric characteristics of the instrument in a sample of 803 participants. The original categories did not provide an optimal assessment of functional incapacity. The scale was dichotomized to achieve a better reliability score and item fit. The final 50 items revealed a moderately high variability in item difficulty, acceptable fits to items and persons, and a good Person Separation Reliability score. The scores were able to discriminate between normal controls and clinical patients. None of the items showed Differential Item Functioning associated with age, gender, or education. The instrument is able to achieve measures of functional incapacity with the useful properties of the Rasch model.

  20. Measuring situational avoidance in older drivers: An application of Rasch analysis.

    Science.gov (United States)

    Davis, Jessica; Conlon, Elizabeth; Ownsworth, Tamara; Morrissey, Shirley

    2016-02-01

    Situational avoidance is a form of driving self-regulation at the strategic level of driving behaviour. It has typically been defined as the purposeful avoidance of driving situations perceived as challenging or potentially hazardous. To date, assessment of the psychometric properties of existing scales that measure situational avoidance has been sparse. This study examined the contribution of Rasch analysis to the situational avoidance construct. Three hundred and ninety-nine Australian drivers (M=66.75, SD=10.14, range: 48-91 years) completed the Situational Avoidance Questionnaire (SAQ). Following removal of the item Parallel Parking, the scale conformed to a Rasch model, showing good person separation, sufficient reliability, little disordering of thresholds, and no evidence of differential item functioning by age or gender. The residuals were independent supporting the assumption of unidimensionality and in conforming to a Rasch model, SAQ items were found to be hierarchical or cumulative. Increased avoidance was associated with factors known to be related to driving self-regulation more broadly, including older age, female gender, reduced driving space and frequency, reporting a change in driving in the past five years and poorer indices of health (i.e., self-rated mood, vision and cognitive function). Overall, these results support the use of the SAQ as a psychometrically sound measure of situational avoidance. Application of Rasch analysis to this area of research advances understanding of the driving self-regulation construct and its practice by drivers in baby boomer and older adult generations. Copyright © 2015 Elsevier Ltd. All rights reserved.

  1. Sample Size and Statistical Conclusions from Tests of Fit to the Rasch Model According to the Rasch Unidimensional Measurement Model (Rumm) Program in Health Outcome Measurement.

    Science.gov (United States)

    Hagell, Peter; Westergren, Albert

    Sample size is a major factor in statistical null hypothesis testing, which is the basis for many approaches to testing Rasch model fit. Few sample size recommendations for testing fit to the Rasch model concern the Rasch Unidimensional Measurement Models (RUMM) software, which features chi-square and ANOVA/F-ratio based fit statistics, including Bonferroni and algebraic sample size adjustments. This paper explores the occurrence of Type I errors with RUMM fit statistics, and the effects of algebraic sample size adjustments. Data with simulated Rasch model fitting 25-item dichotomous scales and sample sizes ranging from N = 50 to N = 2500 were analysed with and without algebraically adjusted sample sizes. Results suggest the occurrence of Type I errors with N less then or equal to 500, and that Bonferroni correction as well as downward algebraic sample size adjustment are useful to avoid such errors, whereas upward adjustment of smaller samples falsely signal misfit. Our observations suggest that sample sizes around N = 250 to N = 500 may provide a good balance for the statistical interpretation of the RUMM fit statistics studied here with respect to Type I errors and under the assumption of Rasch model fit within the examined frame of reference (i.e., about 25 item parameters well targeted to the sample).

  2. Analysis of local dependence and multidimensionality in graphical loglinear Rasch models

    DEFF Research Database (Denmark)

    Kreiner, Svend; Christensen, Karl Bang

    local independence; multidimensionality, differential item functioning; uniform local dependency and DIF; graphical Rasch models; loglinear Rasch models......local independence; multidimensionality, differential item functioning; uniform local dependency and DIF; graphical Rasch models; loglinear Rasch models...

  3. Analysis of Local Dependence and Multidimensionality in Graphical Loglinear Rasch Models

    DEFF Research Database (Denmark)

    Kreiner, Svend; Christensen, Karl Bang

    2004-01-01

    Local independence; Multidimensionality; Differential item functioning; Uniform local dependence and DIF; Graphical Rasch models; Loglinear Rasch model......Local independence; Multidimensionality; Differential item functioning; Uniform local dependence and DIF; Graphical Rasch models; Loglinear Rasch model...

  4. Rasch Validation and Cross-validation of the Health of Nation Outcome Scales (HoNOS) for Monitoring of Psychiatric Disability in Traumatized Refugees in Western Psychiatric Care

    DEFF Research Database (Denmark)

    Palic, Sabina; Kappel, Michelle Lind; Makransky, Guido

    2016-01-01

    Rasch analysis we evaluated the psychometrics of the Health of Nation Outcome Scales (HoNOS) in pre-treatment data of consecutive refugee patients (N = 448) from a Danish psychiatric clinic. Then, we carried out a cross-validation of the pre-treatment HoNOS model on post-treatment data from the same...... group. A revised 10-item HoNOS fit the Rasch model at pre-treatment, and also showed excellent fit within the cross-validation data. Culture, gender, and need for translation did not exert serious bias on the measure’s performance. The results establish good monitoring properties of the 10-item Ho...

  5. Using item response theory to explore the psychometric properties of extended matching questions examination in undergraduate medical education

    Directory of Open Access Journals (Sweden)

    Lawton Gemma

    2005-03-01

    Full Text Available Abstract Background As assessment has been shown to direct learning, it is critical that the examinations developed to test clinical competence in medical undergraduates are valid and reliable. The use of extended matching questions (EMQ has been advocated to overcome some of the criticisms of using multiple-choice questions to test factual and applied knowledge. Methods We analysed the results from the Extended Matching Questions Examination taken by 4th year undergraduate medical students in the academic year 2001 to 2002. Rasch analysis was used to examine whether the set of questions used in the examination mapped on to a unidimensional scale, the degree of difficulty of questions within and between the various medical and surgical specialties and the pattern of responses within individual questions to assess the impact of the distractor options. Results Analysis of a subset of items and of the full examination demonstrated internal construct validity and the absence of bias on the majority of questions. Three main patterns of response selection were identified. Conclusion Modern psychometric methods based upon the work of Rasch provide a useful approach to the calibration and analysis of EMQ undergraduate medical assessments. The approach allows for a formal test of the unidimensionality of the questions and thus the validity of the summed score. Given the metric calibration which follows fit to the model, it also allows for the establishment of items banks to facilitate continuity and equity in exam standards.

  6. Comparative Analysis of Russian and Foreign Systems for The Neuropsychological Diagnosis of Children From the Standpoint of the Psychometric Approach and its Limitations When Used in Clinical Practice

    Directory of Open Access Journals (Sweden)

    Mikhail A. Berebin

    2012-01-01

    Full Text Available Modern approaches to the psychological diagnostics of children are based onneed analysis and the systematization of existing trends in domestic and foreignchildren’s neuropsychological diagnoses. This article highlights the strengths andweaknesses of each approach, as well as identifying possible areas of integration.One of the most acute problems is the development of experimental psychologicalmethods to determine the quantitative and expressed characteristics of themental development of children by flexibly combining qualitative and quantitativeapproaches, with a view to putting into practice foreign neuroscience principlesand standards of evidence. An analysis of contemporary publications onneuropsychological diagnosis reveals the need to consider the standardization ofneuropsychological research in the context of current approaches, requirements,and psychodiagnostic criteria. In the domestic neuropsychological literature, theseissues are need attention: standardized procedures for presenting stimuli are not,as a rule, described; basic psychometric assessment of the results of the tests islacking; no investigation of their clinical and psychometric validity is carried out.An analysis was made of the nature of the psychometric approach in foreign childneuropsychology, which relies on mathematical procedures of processing qualitative(ordinal data converted into quantitative indicators. We examined separatelythe mathematical software for clinical trials (based on the principles of «evidencebasedmedicine», which relies on the «abnormal» nature of the distribution ofclinical phenomena.

  7. Do People Agree on What Makes One Feel Loved? A Cognitive Psychometric Approach to the Consensus on Felt Love.

    Science.gov (United States)

    Oravecz, Zita; Muth, Chelsea; Vandekerckhove, Joachim

    2016-01-01

    This pragmatic study examines love as a mode of communication. Our focus is on the receiver side: what makes an individual feel loved and how felt love is defined through daily interactions. Our aim is to explore everyday life scenarios in which people might experience love, and to consider people's converging and diverging judgments about which scenarios indicate felt love. We apply a cognitive psychometric approach to quantify a receiver's ability to detect, understand, and know that they are loved. Through crowd-sourcing, we surveyed lay participants about whether various scenarios were indicators of felt love. We thus quantify these responses to make inference about consensus judgments of felt love, measure individual levels of agreement with consensus, and assess individual response styles. More specifically, we (1) derive consensus judgments on felt love; (2) describe its characteristics in qualitative and quantitative terms, (3) explore individual differences in both (a) participant agreement with consensus, and (b) participant judgment when uncertain about shared knowledge, and (4) test whether individual differences can be meaningfully linked to explanatory variables. Results indicate that people converge towards a shared cognitive model of felt love. Conversely, respondents showed heterogeneity in knowledge of consensus, and in dealing with uncertainty. We found that, when facing uncertainty, female respondents and people in relationships more frequently judge scenarios as indicators of felt love. Moreover, respondents from smaller households tend to know more about consensus judgments of felt love, while respondents from larger households are more willing to guess when unsure of consensus.

  8. Psychometric properties of virtual reality vignette performance measures: a novel approach for assessing adolescents' social competency skills.

    Science.gov (United States)

    Paschall, Mallie J; Fishbein, Diana H; Hubal, Robert C; Eldreth, Diana

    2005-02-01

    This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on adolescents' interaction with a provocative virtual teenage character. Twelve of the 18 performance measures loaded on two factors corresponding to emotional control and interpersonal communication skills, providing support for their factorial validity. The internal reliability coefficients for the two multi-item measures were 0.88 and 0.91, respectively. Additional analyses with established measures of three psychosocial factors (beliefs supporting aggression, aggressive conflict-resolution style and hostility) and behavioral criteria (e.g., self-reported behavioral misconduct and drug use) provided limited support for the construct and criterion-related validity of the performance measures. Study findings suggest that the virtual reality vignette exercises may represent a promising approach for assessing adolescents' social competency skills.

  9. 多维Rasch模型在维度分数报告中的应用一对带宽-保真度困境的解决%An M-Rasch Approach to Domain Score Reporting: Solution to Bandwidth-fidelity Dilemma

    Institute of Scientific and Technical Information of China (English)

    曾平飞; 余娜; 辛涛; 王烨晖

    2012-01-01

    Due to broad content coveiage and limited testing time, the large scale assessment is challenged by the bandwidth-fidelity dilemma. This study is to explore how the multi-dimensional Rasch model would reliability in the within-item multi-dimensionality data. The results demonstrate that both 4-dimensional imp and rove 15- dimensional Rasch models fit data, which supports the construct validity of the test. The uni-dimensional model underestimates the correlation between domains due to measurement error. The multi-dimensional Rasch analysis yields a higher level of measurement precision and a more appropriate estimate for the correlation between domains as compared to uni-dimensional approach. The comparison between 4-dimension and 15-dimension analysis shows that the increase on the number of dimensions can compensate the effect of scale length reduction to a certain extent, as long as the correlations between the specific domain and the others are relatively high enough. In conclusion, the multi-dimensional Rasch analysis yields more reliable domain score than uni-dimensional Rasch model in the within-item multidimenionality context. For the test with fixed length, reliable scores can be reported on the more specified content domains, as long as there are high correlations between domains.%分别采用四维度和十五维度Rasch模型分析包含项目内多维度结构的科学测验数据,估计两种维度结构下维度分数的信度。结果表明,对比相应的单维模型而言,四维度与十五维度Rasch模型均能够极大提高各内容维度上分数估计的信度。四维度与十五维度Rasch模型拟合结果的比较表明,对于总长度固定的测验,维度数目的增加能够补偿子维度长度减少引起的信度损失。但是这一作用必须以维度间较高的相关性为前提。

  10. Comparison for Chinese subordinates as a motivation approach: Scale Development and Psychometric Properties

    Directory of Open Access Journals (Sweden)

    Jingjing Ge

    2015-11-01

    Full Text Available Purpose: Chinese people are motivated by social comparison and temporal comparison. Based on this finding, we conceptualized lateral comparison and vertical comparison as two distinct constructs that represent individual self-enhancement toward the nature of social comparison with others and temporal comparison with self over time. We hypothesized that as stable individual psychological difference, lateral comparison and vertical comparison would have differential effects on people’s working behavior in the Chinese organizational context. Design/methodology/approach: Based on a conceptualization approach to Chinese management research, we conducted three studies to develop and validate a two-factor comparison scale which includes three-item lateral comparison and a three-item vertical comparison. Findings: Results from qualitative data in Study 1 provide evidence of convergent and discriminate validity of the scale, while Study 2 demonstrates the scale’s predictive validity. Furthermore, in Study two, a field survey in multiple Chinese organizations showed that lateral comparison and vertical comparison had differential effects on employee task performance and organizational citizenship behavior. Research implications: The theoretical and practical implications of this study are discussed in the working context in Chinese organizations and beyond. Originality/value: This finding integrates insights from previous research in social comparison and temporal comparison into a motivation approach that supervisors use toward subordinates in the Chinese organizational context.

  11. Congruence between a theoretical continuum of masculinity and the Rasch model: examining the Conformity to Masculine Norms Inventory.

    Science.gov (United States)

    Ludlow, L H; Mahalik, J R

    2001-01-01

    The purpose of this study was to examine the psychometric structure of the Conformity to Masculine Norms Inventory (CMNI) in relation to the Rasch model. The CMNI was specifically constructed to measure a set of unidimensional constructs. As such, the items were intended to define a uniform spread of locations along each construct. The CMNI measures conformity to twelve masculine norms: winning, emotional control, risk-taking, violence, dominance, playboy, self-reliance, primacy of work, power over women, disdain for homosexuals, physical toughness, and pursuit of status. Three hundred forty-eight men participated in the study. In addition to examining global Rasch characteristics and the unidimensionality of each of the 12 scales, a detailed Rasch rating scale analysis is provided for the Violence Scale with unusual response patterns discussed in terms of their clinical usefulness. The results across all 12 scales reveal an excellent congruence between the theoretically derived construct of conformity to masculine norms and the theoretically defined objectives of the Rasch rating scale model.

  12. Calibrating Charisma: The many-facet Rasch model for leader measurement and automated coaching

    Science.gov (United States)

    Barney, Matt

    2016-11-01

    No one is a leader unless others follow. Consequently, leadership is fundamentally a social judgment construct, and may be best measured via a Many Facet Rasch Model designed for this purpose. Uniquely, the MFRM allows for objective, accurate and precise estimation of leader attributes, along with identification of rater biases and other distortions of the available information. This presentation will outline a mobile computer-adaptive measurement system that measures and develops charisma, among others. Uniquely, the approach calibrates and mass-personalizes artificially intelligent, Rasch-calibrated electronic coaching that is neither too hard nor too easy but “just right” to help each unique leader develop improved charisma.

  13. A Psychometric Tool for a Virtual Reality Rehabilitation Approach for Dyslexia

    Science.gov (United States)

    Padula, Patrizia; Meardi, Maria Teresa

    2017-01-01

    Dyslexia is a chronic problem that affects the life of subjects and often influences their life choices. The standard rehabilitation methods all use a classic paper and pencil training format but these exercises are boring and demanding for children who may have difficulty in completing the treatments. It is important to develop a new rehabilitation program that would help children in a funny and engaging way. A Wii-based game was developed to demonstrate that a short treatment with an action video game, rather than phonological or orthographic training, may improve the reading abilities in dyslexic children. According to the results, an approach using cues in the context of a virtual environment may represent a promising tool to improve attentional skills. On the other hand, our results do not demonstrate an immediate effect on reading performance, suggesting that a more prolonged protocol may be a future direction. PMID:28286543

  14. A Psychometric Tool for a Virtual Reality Rehabilitation Approach for Dyslexia

    Directory of Open Access Journals (Sweden)

    Elisa Pedroli

    2017-01-01

    Full Text Available Dyslexia is a chronic problem that affects the life of subjects and often influences their life choices. The standard rehabilitation methods all use a classic paper and pencil training format but these exercises are boring and demanding for children who may have difficulty in completing the treatments. It is important to develop a new rehabilitation program that would help children in a funny and engaging way. A Wii-based game was developed to demonstrate that a short treatment with an action video game, rather than phonological or orthographic training, may improve the reading abilities in dyslexic children. According to the results, an approach using cues in the context of a virtual environment may represent a promising tool to improve attentional skills. On the other hand, our results do not demonstrate an immediate effect on reading performance, suggesting that a more prolonged protocol may be a future direction.

  15. Validation of the Spanish Short Self-Regulation Questionnaire (SSSRQ) through Rasch Analysis

    Science.gov (United States)

    Garzón Umerenkova, Angélica; de la Fuente Arias, Jesús; Martínez-Vicente, José Manuel; Zapata Sevillano, Lucía; Pichardo, Mari Carmen; García-Berbén, Ana Belén

    2017-01-01

    Background: The aim of the study was to psychometrically characterize the Spanish Short Self-Regulation Questionnaire (SSSRQ) through Rasch analysis. Materials and Methods: 831 Spaniard university students (262 men), between 17 and 39 years of age and ranging from the first to the 5th year of studies, completed the SSSRQ questionnaire. Confirmatory factor analysis (CFA) was carried out in order to establish structural adequacy. Afterward, by means of the Rasch model, a study of each sub scale was conducted to test for dimensionality, fit of the sample questions, functionality of the response categories, reliability and estimation of Differential Item Functioning by gender and course. Results: The four sub-scales comply with the unidimensionality criteria, the questions are in line with the model, the response categories operate properly and the reliability of the sample is acceptable. Nonetheless, the test could benefit from the inclusion of additional items of both high and low difficulty in order to increase construct validity, discrimination and reliability for the respondents. Several items with differences in gender and course were also identified. Discussion: The results evidence the need and adequacy of this complementary psychometric analysis strategy, in relation to the CFA to enhance the instrument. PMID:28298898

  16. A Psychometric Approach to the Development of a 5E Lesson Plan Scoring Instrument for Inquiry-Based Teaching

    Science.gov (United States)

    Goldston, M. Jenice; Dantzler, John; Day, Jeanelle; Webb, Brenda

    2013-01-01

    This research centers on the psychometric examination of the structure of an instrument, known as the 5E Lesson Plan (5E ILPv2) rubric for inquiry-based teaching. The instrument is intended to measure an individual's skill in developing written 5E lesson plans for inquiry teaching. In stage one of the instrument's development, an exploratory…

  17. Item Screening in Graphical Loglinear Rasch Models

    DEFF Research Database (Denmark)

    Kreiner, Svend; Christensen, Karl Bang

    2011-01-01

    the initial item analysis may disclose a great deal of spurious and misleading evidence of DIF and local dependence that has to disposed of during the modelling procedure. Like graphical models, graphical loglinear Rasch models possess Markov properties that are useful during the statistical analysis......In behavioural sciences, local dependence and DIF are common, and purification procedures that eliminate items with these weaknesses often result in short scales with poor reliability. Graphical loglinear Rasch models (Kreiner & Christensen, in Statistical Methods for Quality of Life Studies, ed....... by M. Mesbah, F.C. Cole & M.T. Lee, Kluwer Academic, pp. 187–203, 2002) where uniform DIF and uniform local dependence are permitted solve this dilemma by modelling the local dependence and DIF. Identifying loglinear Rasch models by a stepwise model search is often very time consuming, since...

  18. A polytomous rasch analysis of the english version of health-related quality of life for drug abusers test.

    Science.gov (United States)

    Lozano, Oscar M; Rojas Tejada, Antonio J; Foresti, Katia; Zubaran, Carlos

    2015-06-03

    The specific aim of this study was to analyze the psychometric properties of the English version of the Health-Related Quality of Life for Drug Abusers Test (HRQoLDA Test) applying the Rasch model, and emphasizing fit between empirical data and theoretical Rasch model assumptions; item(s) category probability curve; and precision in terms of information function. In this study, the authors present the results of the translation and adaptation of the original Spanish version to English, as applied to a sample of substance users in Australia. The authors evaluated 121 adults recruited from inpatient and outpatient treatment facilities in Sydney, Australia. The Rating Scale Model was used in the psychometric analysis of the English version of the HRQoLDA Test. The items and persons revealed a fit between the reported data and the model. It was also demonstrated that respondents did not discriminate among the five response categories, which led to a reduction to three response categories. The adaptation of the TECVASP to the English language, renamed the HRQoLDA test, as developed with an Australian sample revealed adequate psychometric properties.

  19. Understanding metallic bonding: Structure, process and interaction by Rasch analysis

    Science.gov (United States)

    Cheng, Maurice M. W.; Oon, Pey-Tee

    2016-08-01

    This paper reports the results of a survey of 3006 Year 10-12 students on their understandings of metallic bonding. The instrument was developed based on Chi's ontological categories of scientific concepts and students' understanding of metallic bonding as reported in the literature. The instrument has two parts. Part one probed into students' understanding of metallic bonding as (a) a submicro structure of metals, (b) a process in which individual metal atoms lose their outermost shell electrons to form a 'sea of electrons' and octet metal cations or (c) an all-directional electrostatic force between delocalized electrons and metal cations, that is, an interaction. Part two assessed students' explanation of malleability of metals, for example (a) as a submicro structural rearrangement of metal atoms/cations or (b) based on all-directional electrostatic force. The instrument was validated by the Rasch Model. Psychometric assessment showed that the instrument possessed reasonably good properties of measurement. Results revealed that it was reliable and valid for measuring students' understanding of metallic bonding. Analysis revealed that the structure, process and interaction understandings were unidimensional and in an increasing order of difficulty. Implications for the teaching of metallic bonding, particular through the use of diagrams, critiques and model-based learning, are discussed.

  20. Psychometric Functions for Shortened Administrations of a Speech Recognition Approach Using Tri-Word Presentations and Phonemic Scoring

    Science.gov (United States)

    Gelfand, Stanley A.; Gelfand, Jessica T.

    2012-01-01

    Method: Complete psychometric functions for phoneme and word recognition scores at 8 signal-to-noise ratios from -15 dB to 20 dB were generated for the first 10, 20, and 25, as well as all 50, three-word presentations of the Tri-Word or Computer Assisted Speech Recognition Assessment (CASRA) Test (Gelfand, 1998) based on the results of 12…

  1. Psychometric analysis of psychological well-being scale for adults in college students from Lima: a structural equation approach

    OpenAIRE

    Dominguez Lara, Sergio Alexis; Universidad Inca Garcilaso de la Vega

    2014-01-01

    The aim of instrumental study was to analyze the psychometric properties of the Psychological Well-being Scale for Adults (PWS-A) ina sample of 222 students psychology of a private university with ages between of 16 and 44 years (M = 20.8). The confirmatory factoranalysis reveals that data fit a four-factor structure. Furthermore, regarding reliability, the Cronbach’s alpha for the total scale and subscalesis high (α > .80). Comparison of alpha indicates that the instrument is ...

  2. Assessing and quantifying inter-rater variation for dichotomous ratings using a Rasch model

    DEFF Research Database (Denmark)

    Petersen, Jørgen Holm; Larsen, Klaus; Kreiner, Svend

    2010-01-01

    We present a new model-based approach to the analysis of agreement between raters in a situation where all raters have supplied dichotomous ratings of the same cases in a sample. The model is a logistic regression model with random effects - a Rasch model. In the rater setting, the Rasch model in...... of the assessment is to improve the foetus' chance of survival by choosing the optimal time of elective delivery. In the study, data related to 139 perinatal deaths were sent to 32 experts who were asked whether the use of Doppler velocimetry might have prevented each death.......We present a new model-based approach to the analysis of agreement between raters in a situation where all raters have supplied dichotomous ratings of the same cases in a sample. The model is a logistic regression model with random effects - a Rasch model. In the rater setting, the Rasch model...... includes parameters that allow raters to have different propensities to score a given set of individuals positively or negatively - the rater bias. An exact score test of the hypothesis of no rater bias is proposed and is shown to be an exact generalised McNemar's test. Based on the model, we suggest...

  3. Rasch modeling and confirmatory factor analysis of the systemizing quotient-revised (SQ-R) scale.

    Science.gov (United States)

    Allison, Carrie; Baron-Cohen, Simon; Stone, Mark H; Muncer, Steven J

    2015-01-01

    This study assessed the dimensionality of the Systemizing Quotient-Revised (SQ-R), a measure of how strong a person's interest is in systems, using two statistical approaches: Rasch modeling and Confirmatory Factor Analysis (CFA). Participants included N = 675 with an autism spectrum condition (ASC), N = 1369 family members of people with ASC, and N = 2014 typical controls. Data were applied to the Rasch model (Rating Scale) using WINSTEPS. The data fit the Rasch model quite well lending support to the idea that systemizing could be seen as unidimensional. Reliability estimates were .99 for items and .92 for persons. A CFA parceling approach confirmed that a unidimensional model fit the data. There was, however, differential functioning by sex in some of these items. An abbreviated 44-item version of the scale, consisting of items without differential item functioning by sex was developed. This shorter scale also was tested from a Rasch perspective and confirmed through CFA. All measures showed differences on total scale scores between those participants with and without ASC (d = 0.71, p < .005), and between sexes (d = 0.53, p < .005). We conclude that the SQ-R is an appropriate measure of systemizing which can be measured along a single dimension.

  4. Applying the Rasch sampler to identify aberrant responding through person fit statistics under fixed nominal α-level.

    Science.gov (United States)

    Spoden, Christian; Fleischer, Jens; Leutner, Detlev

    2014-01-01

    Testing hypotheses on a respondent's individual fit under the Rasch model requires knowledge of the distributional properties of a person fit statistic. We argue that the Rasch Sampler (Verhelst, 2008), a Markov chain Monte Carlo algorithm for sampling binary data matrices from a uniform distribution, can be applied for simulating the distribution of person fit statistics with the Rasch model in the same way as it used to test for other forms of misfit. Results from two simulation studies are presented which compare the approach to the original person fit statistics based on normalization formulas. Simulation 1 shows the new approach to hold the expected Type I error rates while the normalized statistics deviate from the nominal alpha-level. In Simulation 2 the power of the new approach was found to be approximately the same or higher than for the normalized statistics under most conditions.

  5. Achievement Testing with the Wechsler Quicktest: An Examination of Its Psychometric Properties and Applied Utility with a Greek-Cypriot Sample

    Science.gov (United States)

    Vrachimi-Souroulla, Andry; Panayiotou, Georgia; Kokkinos, Constantinos M.; Lamprianou, Iasonas

    2011-01-01

    The study aimed to field-test a Greek version of the Wechsler Quicktest and to examine its psychometric properties. The Quicktest was individually administered to 208 students, aged 5-14 years, along with a reading test. Based on the Rasch analysis, data for the Quicktest subtests showed acceptable fit to the model. Also, correlations were found…

  6. Sample Size Determination for Rasch Model Tests

    Science.gov (United States)

    Draxler, Clemens

    2010-01-01

    This paper is concerned with supplementing statistical tests for the Rasch model so that additionally to the probability of the error of the first kind (Type I probability) the probability of the error of the second kind (Type II probability) can be controlled at a predetermined level by basing the test on the appropriate number of observations.…

  7. Modeling psychometric functions in R.

    Science.gov (United States)

    Yssaad-Fesselier, Rosa; Knoblauch, Kenneth

    2006-02-01

    We demonstrate some procedures in the statistical computing environment R for obtaining maximum likelihood estimates of the parameters of a psychometric function by fitting a generalized nonlinear regression model to the data. A feature for fitting a linear model to the threshold (or other) parameters of several psychometric functions simultaneously provides a powerful tool for testing hypotheses about the data and, potentially, for reducing the number of parameters necessary to describe them. Finally, we illustrate procedures for treating one parameter as a random effect that would permit a simplified approach to modeling stimulus-independent variability due to factors such as lapses or interobserver differences. These tools will facilitate a more comprehensive and explicit approach to the modeling of psychometric data.

  8. Factors associated with knowledge of diabetes in patients with type 2 diabetes using the Diabetes Knowledge Test validated with Rasch analysis.

    Directory of Open Access Journals (Sweden)

    Eva K Fenwick

    Full Text Available OBJECTIVE: In patients with Type 2 diabetes, to determine the factors associated with diabetes knowledge, derived from Rasch analysis, and compare results with a traditional raw scoring method. RESEARCH DESIGN & METHODS: Participants in this cross-sectional study underwent a comprehensive clinical and biochemical assessment. Diabetes knowledge (main outcome was assessed using the Diabetes Knowledge Test (DKT which was psychometrically validated using Rasch analysis. The relationship between diabetes knowledge and risk factors identified during univariate analyses was examined using multivariable linear regression. The results using raw and Rasch-transformed methods were descriptively compared. RESULTS: 181 patients (mean age±standard deviation = 66.97±9.17 years; 113 (62% male were included. Using Rasch-derived DKT scores, those with greater education (β = 1.14; CI: 0.25,2.04, p = 0.013; had seen an ophthalmologist (β = 1.65; CI: 0.63,2.66, p = 0.002, and spoke English at home (β = 1.37; CI: 0.43,2.31, p = 0.005 had significantly better diabetes knowledge than those with less education, had not seen an ophthalmologist and spoke a language other than English, respectively. Patients who were members of the National Diabetes Service Scheme (NDSS and had seen a diabetes educator also had better diabetes knowledge than their counterparts. Higher HbA1c level was independently associated with worse diabetes knowledge. Using raw measures, access to an ophthalmologist and NDSS membership were not independently associated with diabetes knowledge. CONCLUSIONS: Sociodemographic, clinical and service use factors were independently associated with diabetes knowledge based on both raw scores and Rasch-derived scores, which supports the implementation of targeted interventions to improve patients' knowledge. Choice of psychometric analytical method can affect study outcomes and should be considered during intervention

  9. Measuring trust in nurses - Psychometric properties of the Trust in Nurses Scale in four countries.

    Science.gov (United States)

    Stolt, Minna; Charalambous, Andreas; Radwin, Laurel; Adam, Christina; Katajisto, Jouko; Lemonidou, Chryssoula; Patiraki, Elisabeth; Sjövall, Katarina; Suhonen, Riitta

    2016-12-01

    The purpose of this study was to examine psychometric properties of three translated versions of the Trust in Nurses Scale (TNS) and cancer patients' perceptions of trust in nurses in a sample of cancer patients from four European countries. A cross-sectional, cross-cultural, multi-site survey design was used. The data were collected with the Trust in Nurses Scale from patients with different types of malignancies in 17 units within five clinical sites (n = 599) between 09/2012 and 06/2014. Data were analyzed using descriptive and inferential statistics, multivariate methods and psychometrics using exploratory factor analysis, Cronbach's alpha coefficients, item analysis and Rasch analysis. The psychometric properties of the data were consistent in all countries. Within the exploratory factor analysis the principal component analysis supported the one component structure (unidimensionality) of the TNS. The internal consistency reliability was acceptable. The Rasch analysis supported the unidimensionality of the TNS cross-culturally. All items of the TNS demonstrated acceptable goodness-of-fit to the Rasch model. Cancer patients trusted nurses to a great extent although between-country differences were found. The Trust in Nurses Scale proved to be a valid and reliable tool for measuring patients' trust in nurses in oncological settings in international contexts. Copyright © 2016 Elsevier Ltd. All rights reserved.

  10. Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R

    Directory of Open Access Journals (Sweden)

    Patrick Mair

    2007-02-01

    Full Text Available Item response theory models (IRT are increasingly becoming established in social science research, particularly in the analysis of performance or attitudinal data in psychology, education, medicine, marketing and other fields where testing is relevant. We propose the R package eRm (extended Rasch modeling for computing Rasch models and several extensions. A main characteristic of some IRT models, the Rasch model being the most prominent, concerns the separation of two kinds of parameters, one that describes qualities of the subject under investigation, and the other relates to qualities of the situation under which the response of a subject is observed. Using conditional maximum likelihood (CML estimation both types of parameters may be estimated independently from each other. IRT models are well suited to cope with dichotomous and polytomous responses, where the response categories may be unordered as well as ordered. The incorporation of linear structures allows for modeling the effects of covariates and enables the analysis of repeated categorical measurements. The eRm package fits the following models: the Rasch model, the rating scale model (RSM, and the partial credit model (PCM as well as linear reparameterizations through covariate structures like the linear logistic test model (LLTM, the linear rating scale model (LRSM, and the linear partial credit model (LPCM. We use an unitary, efficient CML approach to estimate the item parameters and their standard errors. Graphical and numeric tools for assessing goodness-of-fit are provided.

  11. Estimating the Multilevel Rasch Model: With the lme4 Package

    Directory of Open Access Journals (Sweden)

    Harold Doran

    2007-02-01

    Full Text Available Traditional Rasch estimation of the item and student parameters via marginal maximum likelihood, joint maximum likelihood or conditional maximum likelihood, assume individuals in clustered settings are uncorrelated and items within a test that share a grouping structure are also uncorrelated. These assumptions are often violated, particularly in educational testing situations, in which students are grouped into classrooms and many test items share a common grouping structure, such as a content strand or a reading passage. Consequently, one possible approach is to explicitly recognize the clustered nature of the data and directly incorporate random effects to account for the various dependencies. This article demonstrates how the multilevel Rasch model can be estimated using the functions in R for mixed-effects models with crossed or partially crossed random effects. We demonstrate how to model the following hierarchical data structures: a individuals clustered in similar settings (e.g., classrooms, schools, b items nested within a particular group (such as a content strand or a reading passage, and c how to estimate a teacher × content strand interaction.

  12. The Imperforate Anus Psychosocial Questionnaire (IAPSQ: Its construction and psychometric properties

    Directory of Open Access Journals (Sweden)

    Christensson Kyllike

    2009-05-01

    Full Text Available Abstract The origin of the present study was to develop the liaison work between the disciplines of child and adolescent psychiatry and paediatric surgery and nursing, so as to improve the quality of treatment and care of a group of children with imperforate anus (IA and their families. Imperforate anus is a congenital disease involving a deformity of the anorectum. The early surgery and invasive follow-up treatment associated with IA may affect the child psychosocially, including the child-parent relationship. By developing and testing a questionnaire for children born with anorectal anomalies, a tool for measuring psychosocial functioning can be realized. Methods First, a literature review on "Imperforate Anus" was performed. Second, an exploratory interview study was conducted with patients/adolescents with IA and their parents. The findings from these interviews were the foundation for construction of the questionnaire. The Imperforate Anus Psychosocial Questionnaire (IAPSQ was tested and revised three times before its completion. It contains 45 items on Likert scales. A total of 87 children completed the IAPSQ: 25 children with IA and two comparison groups. Face and content validity were considered. The Rasch approach, an item response theory model, was used to evaluate the psychometric properties of the IAPSQ, where item difficulty and person ability are concurrently approximated. Results The findings of the Rasch analysis revealed that the psychological dimension was reasonable, and that person reliability (0.83 was moderate and item reliability (0.95 was sufficient. The social dimension showed satisfactory item reliability (0.87. The person reliability (0.52 of the social dimension was weak. Content validity seemed to be established and construct validity was recognized on the psychological dimension. Conclusion The IAPSQ provides a reasonably valid and reliable measure of psychosocial functioning for clinical use among children with IA

  13. Development and psychometric evaluation of a new team effectiveness scale for all types of community adult mental health teams: a mixed-methods approach.

    Science.gov (United States)

    El Ansari, Walid; Lyubovnikova, Joanne; Middleton, Hugh; Dawson, Jeremy F; Naylor, Paul B; West, Michael A

    2016-05-01

    Defining 'effectiveness' in the context of community mental health teams (CMHTs) has become increasingly difficult under the current pattern of provision required in National Health Service mental health services in England. The aim of this study was to establish the characteristics of multi-professional team working effectiveness in adult CMHTs to develop a new measure of CMHT effectiveness. The study was conducted between May and November 2010 and comprised two stages. Stage 1 used a formative evaluative approach based on the Productivity Measurement and Enhancement System to develop the scale with multiple stakeholder groups over a series of qualitative workshops held in various locations across England. Stage 2 analysed responses from a cross-sectional survey of 1500 members in 135 CMHTs from 11 Mental Health Trusts in England to determine the scale's psychometric properties. Based on an analysis of its structural validity and reliability, the resultant 20-item scale demonstrated good psychometric properties and captured one overall latent factor of CMHT effectiveness comprising seven dimensions: improved service user well-being, creative problem-solving, continuous care, inter-team working, respect between professionals, engagement with carers and therapeutic relationships with service users. The scale will be of significant value to CMHTs and healthcare commissioners both nationally and internationally for monitoring, evaluating and improving team functioning in practice.

  14. Evaluation of the Edinburgh Post Natal Depression Scale using Rasch analysis

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2006-06-01

    Full Text Available Abstract Background The Edinburgh Postnatal Depression Scale (EPDS is a 10 item self-rating post-natal depression scale which has seen widespread use in epidemiological and clinical studies. Concern has been raised over the validity of the EPDS as a single summed scale, with suggestions that it measures two separate aspects, one of depressive feelings, the other of anxiety. Methods As part of a larger cross-sectional study conducted in Melbourne, Australia, a community sample (324 women, ranging in age from 18 to 44 years: mean = 32 yrs, SD = 4.6, was obtained by inviting primiparous women to participate voluntarily in this study. Data from the EPDS were fitted to the Rasch measurement model and tested for appropriate category ordering, for item bias through Differential Item Functioning (DIF analysis, and for unidimensionality through tests of the assumption of local independence. Results Rasch analysis of the data from the ten item scale initially demonstrated a lack of fit to the model with a significant Item-Trait Interaction total chi-square (chi Square = 82.8, df = 40; p Conclusion The results of this study suggest that EPDS, in its original 10 item form, is not a viable scale for the unidimensional measurement of depression. Rasch analysis suggests that a revised eight item version (EPDS-8 would provide a more psychometrically robust scale. The revised cut points of 7/8 and 9/10 for the EPDS-8 show high levels of agreement with the original case identification for the EPDS-10.

  15. The Swedish version of the Acceptance of Chronic Health Conditions Scale for people with multiple sclerosis: Translation, cultural adaptation and psychometric properties.

    Science.gov (United States)

    Forslin, Mia; Kottorp, Anders; Kierkegaard, Marie; Johansson, Sverker

    2016-11-11

    To translate and culturally adapt the Acceptance of Chronic Health Conditions (ACHC) Scale for people with multiple sclerosis into Swedish, and to analyse the psychometric properties of the Swedish version. Ten people with multiple sclerosis participated in translation and cultural adaptation of the ACHC Scale; 148 people with multiple sclerosis were included in evaluation of the psychometric properties of the scale. Translation and cultural adaptation were carried out through translation and back-translation, by expert committee evaluation and pre-test with cognitive interviews in people with multiple sclerosis. The psychometric properties of the Swedish version were evaluated using Rasch analysis. The Swedish version of the ACHC Scale was an acceptable equivalent to the original version. Seven of the original 10 items fitted the Rasch model and demonstrated ability to separate between groups. A 5-item version, including 2 items and 3 super-items, demonstrated better psychometric properties, but lower ability to separate between groups. The Swedish version of the ACHC Scale with the original 10 items did not fit the Rasch model. Two solutions, either with 7 items (ACHC-7) or with 2 items and 3 super-items (ACHC-5), demonstrated acceptable psychometric properties. Use of the ACHC-5 Scale with super-items is recommended, since this solution adjusts for local dependency among items.

  16. The assessment of diabetes knowledge and self-efficacy in a diverse population using Rasch measurement.

    Science.gov (United States)

    Gerber, Ben S; Pagcatipunan, Maria; Smith, Everett V; Basu, Semonti S; Lawless, Kimberly A; Smolin, Louanne I; Berbaum, Michael L; Brodsky, Irwin G; Eiser, Arnold R

    2006-01-01

    The purpose of this research was to develop survey instruments to evaluate diabetes knowledge and self-efficacy in a diverse population, and investigate the psychometric properties of data obtained with these instruments using Rasch measurement. Two-hundred and fifty-five urban-dwelling participants with diabetes were recruited to complete surveys through independent interviews. To evaluate the association of health literacy on metabolic control, formal literacy and hemoglobin A1c fingerstick testing were performed. Rasch analysis of the data yielded item and person calibrations for self-efficacy and knowledge, with variable maps created to provide both norm and criterion-referenced interpretations. Knowledge scale person separation reliability was 0.50 and item separation reliability was 0.98; while self-efficacy scale person separation reliability was 0.72 with item separation reliability of 0.92. Statistically significant partial correlations were observed between knowledge and health literacy (r = 0.41, pdiabetes knowledge and hemoglobin A1c (r = 0.035, p = 0.29), or health literacy and A1c (r = 0.022, p = 0.36). Diabetes knowledge varied, with non-English speaking individuals having lower measures than English speakers (t(252) = -4.86, pdiabetes.

  17. Rasch analysis of the postconcussive symptom questionnaire: measuring the core construct of brain injury symptomatology.

    Science.gov (United States)

    Gardizi, Elmar; Millis, Scott R; Hanks, Robin; Axelrod, Bradley

    2012-01-01

    The Postconcussive Symptom Questionnaire (PCSQ; Lees-Haley, 1992 ) is purported to measure four constructs. These include psychological, cognitive, somatic, and infrequency (i.e., items intended to reflect negative impression management) symptoms. The utility and validity of Postconcussive Syndrome (PCS) as a diagnostic condition continues to be debated. To this end, examining the instruments used to measure postconcussive symptoms can increase our understanding with respect to this issue. The aim of this study was to derive a revised PCSQ to target the core construct of subjective symptoms reported by persons with traumatic brain injury (TBI). A total of 133 people with mild to severe TBI completed the 45-item PCSQ. Items were scored dichotomously, as symptom present or absent. Rasch analysis, based on the mathematical model formulated by Rasch ( 1960 ), was used to derive the revised PCSQ. Misfitting and redundant items were removed and a second model containing 19 items was fitted. The revised PCSQ-19 had superior psychometric qualities; reliability was 0.81. The PCSQ-19 provides a more targeted, unidimensional assessment of subjective symptoms following brain injury. The findings also revealed information related to symptom hierarchy which can further our understanding of PCS.

  18. Rasch analysis of the Rosenberg Self-Esteem Scale with African Americans.

    Science.gov (United States)

    Chao, Ruth Chu-Lien; Vidacovich, Courtney; Green, Kathy E

    2017-03-01

    Effectively diagnosing African Americans' self-esteem has posed an unresolved challenge. To address this assessment issue, we conducted exploratory factor analysis and Rasch analysis to assess the psychometric characteristics of the Rosenberg Self-Esteem Scale (RSES, Rosenberg, 1965) for African American college students. The dimensional structure of the RSES was first identified with the first subsample (i.e., calibration subsample) and then held up under cross-validation with a second subsample (i.e., validation subsample). Exploratory factor analysis and Rasch analysis both supported unidimensionality of the measure, with that finding replicated for a random split of the sample. Response scale use was generally appropriate, items were endorsed at a high level reflecting high levels of self-esteem, and person separation and reliability of person separation were adequate, and reflected results similar to those found in prior research. However, as some categories were infrequently used, we also collapsed scale points and found a slight improvement in scale and item indices. No differential item functioning was found by sex or having received professional assistance versus not; there were no mean score differences by age group, marital status, or year in college. Two items were seen as problematic. Implications for theory and research on multicultural mental health are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  19. Physics Metacognition Inventory Part II: Confirmatory factor analysis and Rasch analysis

    Science.gov (United States)

    Taasoobshirazi, Gita; Bailey, MarLynn; Farley, John

    2015-11-01

    The Physics Metacognition Inventory was developed to measure physics students' metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students' metacognition when solving physics problems including knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. The college students' scores on the inventory were found to be reliable and related to students' physics motivation and physics grade. However, the results of the exploratory factor analysis indicated that the questionnaire could be revised to improve its construct validity. The goal of this study was to revise the questionnaire and establish its construct validity through a confirmatory factor analysis. In addition, a Rasch analysis was applied to the data to better understand the psychometric properties of the inventory and to further evaluate the construct validity. Results indicated that the final, revised inventory is a valid, reliable, and efficient tool for assessing student metacognition for physics problem solving.

  20. Rasch Measurement in Language Research: Creating the Foreign Language Classroom Anxiety Inventory

    Directory of Open Access Journals (Sweden)

    Miranda J. Walker

    2014-11-01

    Full Text Available The purpose of this study was to construct a new scale for measuring foreign language classroom anxiety (FLCA. It begun with the creation of an extended item pool generated by qualitative methods. Subsequent Rasch and semantic analyses led to the final 18-item Foreign Language Classroom Anxiety Inventory (FLCAI. In comparison with the Foreign Language Classroom Anxiety Scale (FLCAS, the FLCAI demonstrated more convincing evidence of unidimensionality and the optimal 5-point Likert scale functioned better. The FLCAI, while 55% the length of the FLCAS, thus more practical for classroom practitioners to administer and analyse, maintains its psychometric properties and covers a wider range on the construct continuum thus improving the degree of validity of the instrument. Finally, test anxiety was shown to be a component of FLCA.

  1. Validity study of the Beck Anxiety Inventory (Portuguese version by the Rasch Rating Scale model

    Directory of Open Access Journals (Sweden)

    Sónia Quintão

    2013-01-01

    Full Text Available Our objective was to conduct a validation study of the Portuguese version of the Beck Anxiety Inventory (BAI by means of the Rasch Rating Scale Model, and then compare it with the most used scales of anxiety in Portugal. The sample consisted of 1,160 adults (427 men and 733 women, aged 18-82 years old (M=33.39; SD=11.85. Instruments were Beck Anxiety Inventory, State-Trait Anxiety Inventory and Zung Self-Rating Anxiety Scale. It was found that Beck Anxiety Inventory's system of four categories, the data-model fit, and people reliability were adequate. The measure can be considered as unidimensional. Gender and age-related differences were not a threat to the validity. BAI correlated significantly with other anxiety measures. In conclusion, BAI shows good psychometric quality.

  2. Measurement properties of the brief resilient coping scale in patients with systemic lupus erythematosus using rasch analysis.

    Science.gov (United States)

    López-Pina, José-Antonio; Meseguer-Henarejos, Ana-Belén; Gascón-Cánovas, Juan-José; Navarro-Villalba, Dérlis-Julián; Sinclair, Vaughn G; Wallston, Kenneth A

    2016-09-13

    Resilience has been defined as the capacity or the ability to rebound from and positively adapt to significant stressors, despite experiences of significant adversity or trauma. To capture to what extent an individual copes with stress in a resilient fashion the Brief Resilient Coping Scale (BRCS) was developed. This tool was validated in people with chronic disease, such as rheumatoid arthritis using standard psychometric techniques of classical test theory, but not yet in patients with Systemic lupus erythematosus (SLE). The aim of this study was to explore the psychometric properties of the Brief Resilient Coping Scale in patients with SLE using Rasch analysis. This study used cross-sectional data. The BRCS was administered to 232 patients with systemic lupus erythematosus. The aspects analyzed were unidimensionality, local independence and differential item functioning (DIF) to construct an interpretative scale of scores with the Rasch model. Rating scale mode (RSM) showed that the four categories used in the items of the BRCS are properly ordered. The four items provided a good fit to the polytomous Rasch model. Moreover, the parameters were sufficiently separated to measure resilience in patients with SLE. BRCS is a unidimensional scale (eigenvalue = 1.843) of resilience and the items were locally independent. There was no DIF between males and females in the sample. Only marginally significant differences depending on the level of education were found. The BRCS showed adequate discriminant validity between groups of scores. BRCS is a suitable scale for measuring resilience in patients with SLE. This scale might be useful for clinicians to obtain information concerning the degree of resilience that each patient has, allowing individuals with low resilience to be identified who need interventions aimed at developing coping skills.

  3. Alphabet Knowledge in Preschool: A Rasch Model Analysis

    Science.gov (United States)

    Drouin, Michelle; Horner, Sherri L.; Sondergeld, Toni A.

    2012-01-01

    In this study, we used Rasch model analyses to examine (1) the unidimensionality of the alphabet knowledge construct and (2) the relative difficulty of different alphabet knowledge tasks (uppercase letter recognition, names, and sounds, and lowercase letter names) within a sample of preschoolers (n=335). Rasch analysis showed that the four…

  4. Using Rasch Analysis to Identify Uncharacteristic Responses to Undergraduate Assessments

    Science.gov (United States)

    Edwards, Antony; Alcock, Lara

    2010-01-01

    Rasch Analysis is a statistical technique that is commonly used to analyse both test data and Likert survey data, to construct and evaluate question item banks, and to evaluate change in longitudinal studies. In this article, we introduce the dichotomous Rasch model, briefly discussing its assumptions. Then, using data collected in an…

  5. The psychometric properties of the Emotional Quotient Inventory 2.0 in South Africa

    Directory of Open Access Journals (Sweden)

    Casper J.J. van Zyl

    2014-02-01

    Full Text Available Orientation: Psychological assessments require continued refinement, updating and evaluation.Research purpose: The purpose of this study is to examine the psychometric properties of the Emotional Quotient Inventory (EQ-i 2.0 in South Africa. Item response and classical test theory methods are employed to investigate its item functioning and factor structure.Motivation for the study: Although there has been some scientific research published on the EQ-i in South Africa, there has been no research on the revised version, the EQ-i 2.0. In addition, criticism has been levied against the estimation of internal consistency reliability in the field of emotional intelligence. This study aims to fill these gaps in the literature.Research design, approach and method: This study followed a quantitative, non-experimental,cross-sectional design using secondary data. The sample comprised 1144 working adults(570 men and 574 women. The data were collected through an online platform as part of the standardisation process in South Africa.Main findings: Results from Rasch analysis showed that almost all the items fit the model.Cronbach’s alpha and McDonald’s omega estimates revealed satisfactory reliabilities.Confirmatory factor analysis at the composite level revealed acceptable fit with the exception of the total EQ model.Practical/managerial implications: This study supports the claim of reliability and validity ofthe EQ-i 2.0 in the South African context.Contribution/value-add: The study contributes significantly to the international body of evidence regarding the psychometric properties of the EQ-i 2.0 and provides supporting evidence for the appropriate use of this assessment in South Africa.

  6. Serbian translation of the 20-item toronto alexithymia scale: Psychometric properties and the new methodological approach in translating scales

    Directory of Open Access Journals (Sweden)

    Trajanović Nikola N.

    2013-01-01

    Full Text Available Introduction. Since inception of the alexithymia construct in 1970’s, there has been a continuous effort to improve both its theoretical postulates and the clinical utility through development, standardization and validation of assessment scales. Objective. The aim of this study was to validate the Serbian translation of the 20-item Toronto Alexithymia Scale (TAS-20 and to propose a new method of translation of scales with a property of temporal stability. Methods. The scale was expertly translated by bilingual medical professionals and a linguist, and given to a sample of bilingual participants from the general population who completed both the English and the Serbian version of the scale one week apart. Results. The findings showed that the Serbian version of the TAS-20 had a good internal consistency reliability regarding total scale (α=0.86, and acceptable reliability of the three factors (α=0.71-0.79. Conclusion. The analysis confirmed the validity and consistency of the Serbian translation of the scale, with observed weakness of the factorial structure consistent with studies in other languages. The results also showed that the method of utilizing a self-control bilingual subject is a useful alternative to the back-translation method, particularly in cases of linguistically and structurally sensitive scales, or in cases where a larger sample is not available. This method, dubbed as ‘forth-translation’, could be used to translate psychometric scales measuring properties which have temporal stability over the period of at least several weeks.

  7. Rasch family models in e-learning: analyzing architectural sketching with a digital pen.

    Science.gov (United States)

    Scalise, Kathleen; Cheng, Nancy Yen-Wen; Oskui, Nargas

    2009-01-01

    Since architecture students studying design drawing are usually assessed qualitatively on the basis of their final products, the challenges and stages of their learning have remained masked. To clarify the challenges in design drawing, we have been using the BEAR Assessment System and Rasch family models to measure levels of understanding for individuals and groups, in order to correct pedagogical assumptions and tune teaching materials. This chapter discusses the analysis of 81 drawings created by architectural students to solve a space layout problem, collected and analyzed with digital pen-and-paper technology. The approach allows us to map developmental performance criteria and perceive achievement overlaps in learning domains assumed separate, and then re-conceptualize a three-part framework to represent learning in architectural drawing. Results and measurement evidence from the assessment and Rasch modeling are discussed.

  8. Rasch Measurement of Collaborative Problem Solving in an Online Environment.

    Science.gov (United States)

    Harding, Susan-Marie E; Griffin, Patrick E

    2016-01-01

    This paper describes an approach to the assessment of human to human collaborative problem solving using a set of online interactive tasks completed by student dyads. Within the dyad, roles were nominated as either A or B and students selected their own roles. The question as to whether role selection affected individual student performance measures is addressed. Process stream data was captured from 3402 students in six countries who explored the problem space by clicking, dragging the mouse, moving the cursor and collaborating with their partner through a chat box window. Process stream data were explored to identify behavioural indicators that represented elements of a conceptual framework. These indicative behaviours were coded into a series of dichotomous items. These items represented actions and chats performed by students. The frequency of occurrence was used as a proxy measure of item difficulty. Then given a measure of item difficulty, student ability could be estimated using the difficulty estimates of the range of items demonstrated by the student. The Rasch simple logistic model was used to review the indicators to identify those that were consistent with the assumptions of the model and were invariant across national samples, language, curriculum and age of the student. The data were analysed using a one and two dimension, one parameter model. Rasch separation reliability, fit to the model, distribution of students and items on the underpinning construct, estimates for each country and the effect of role differences are reported. This study provides evidence that collaborative problem solving can be assessed in an online environment involving human to human interaction using behavioural indicators shown to have a consistent relationship between the estimate of student ability, and the probability of demonstrating the behaviour.

  9. The FACT-Melanoma quality-of-life instrument: comparison of a five-point and four-point response scale using the Rasch measurement model.

    Science.gov (United States)

    Winstanley, Julie B; Saw, Robyn; Boyle, Frances; Thompson, John

    2013-02-01

    The FACT-Melanoma (FACT-M) is one of only two validated quality-of-life instruments designed specifically for use in patients with melanoma. The instrument incorporates FACT-G, followed by a set of questionnaire items that are specific to melanoma; all items are scored on a five-point response scale. The primary aim of this study was to evaluate the five-point response format of the FACT-M for goodness of fit to the Rasch measurement model, and to investigate whether rescoring the instrument using a four-point response format improved the psychometric properties. Two data sets of similar patient sample sizes (n=127 and 123) were used to test the reliability and validity of the generic instrument (FACT-G) to measure quality of life for patients with melanoma. The Additional Concerns and Melanoma Surgery subscales were subjected to a more detailed analysis using a combination of confirmatory factor analysis and Rasch analysis techniques. The Rasch model fit of the FACT-M was improved by the use of a four-point response format, together with the deletion of three items. Principal components analysis suggested that two melanoma-specific subscales existed within the Additional Concerns subscale and each could be reduced to seven items, respectively, with improved goodness of fit to the Rasch model. The FACT-M instrument showed improved fit to the Rasch model specifications when the items adopted a four-point response format. These results point to possible improvements in the content and structure of the FACT-M for use in future melanoma clinical trials. However, further study should be conducted with larger samples, selected by disease and treatment status.

  10. Pilot analysis of the Motivation Assessment for Team Readiness, Integration, and Collaboration (MATRICx) using Rasch analysis.

    Science.gov (United States)

    Mallinson, Trudy; Lotrecchiano, Gaetano R; Schwartz, Lisa S; Furniss, Jeremy; Leblanc-Beaudoin, Tommy; Lazar, Danielle; Falk-Krzesinski, Holly J

    2016-10-01

    Healthcare services and the production of healthcare knowledge are increasingly dependent on highly functioning, multidisciplinary teams, requiring greater awareness of individuals' readiness to collaborate in translational science teams. Yet, there is no comprehensive tool of individual motivations and threats to collaboration that can guide preparation of individuals for work on well-functioning teams. This prospective pilot study evaluated the preliminary psychometric properties of the Motivation Assessment for Team Readiness, Integration, and Collaboration (MATRICx). We examined 55 items of the MATRICx in a sample of 125 faculty, students and researchers, using contemporary psychometric methods (Rasch analysis). We found that the motivator and threat items formed separate constructs relative to collaboration readiness. Further, respondents who identified themselves as inexperienced at working on collaborative projects defined the motivation construct differently from experienced respondents. These results are consistent with differences in strategic alliances described in the literature-for example, inexperienced respondents reflected features of cooperation and coordination, such as concern with sharing information and compatibility of goals. In contrast, the more experienced respondents were concerned with issues that reflected a collective purpose, more typical of collaborative alliances. While these different types of alliances are usually described as representing varying aspects along a continuum, our findings suggest that collaboration might be better thought of as a qualitatively different state than cooperation or coordination. These results need to be replicated in larger samples, but the findings have implications for the development and design of educational interventions that aim to ready scientists and clinicians for greater interdisciplinary work.

  11. Imputation by the mean score should be avoided when validating a Patient Reported Outcomes questionnaire by a Rasch model in presence of informative missing data

    LENUS (Irish Health Repository)

    Hardouin, Jean-Benoit

    2011-07-14

    Abstract Background Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO), are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of this paper is to compare sixteen methods for handling the missing data (mainly based on simple imputation) in the context of psychometric validation of PRO by a Rasch model. The main indexes used for validation by a Rasch model are compared. Methods A simulation study was performed allowing to consider several cases, notably the possibility for the missing values to be informative or not and the rate of missing data. Results Several imputations methods produce bias on psychometrical indexes (generally, the imputation methods artificially improve the psychometric qualities of the scale). In particular, this is the case with the method based on the Personal Mean Score (PMS) which is the most commonly used imputation method in practice. Conclusions Several imputation methods should be avoided, in particular PMS imputation. From a general point of view, it is important to use an imputation method that considers both the ability of the patient (measured for example by his\\/her score), and the difficulty of the item (measured for example by its rate of favourable responses). Another recommendation is to always consider the addition of a random process in the imputation method, because such a process allows reducing the bias. Last, the analysis realized without imputation of the missing data (available case analyses) is an interesting alternative to the simple imputation in this context.

  12. Imputation by the mean score should be avoided when validating a Patient Reported Outcomes questionnaire by a Rasch model in presence of informative missing data

    Directory of Open Access Journals (Sweden)

    Sébille Véronique

    2011-07-01

    Full Text Available Abstract Background Nowadays, more and more clinical scales consisting in responses given by the patients to some items (Patient Reported Outcomes - PRO, are validated with models based on Item Response Theory, and more specifically, with a Rasch model. In the validation sample, presence of missing data is frequent. The aim of this paper is to compare sixteen methods for handling the missing data (mainly based on simple imputation in the context of psychometric validation of PRO by a Rasch model. The main indexes used for validation by a Rasch model are compared. Methods A simulation study was performed allowing to consider several cases, notably the possibility for the missing values to be informative or not and the rate of missing data. Results Several imputations methods produce bias on psychometrical indexes (generally, the imputation methods artificially improve the psychometric qualities of the scale. In particular, this is the case with the method based on the Personal Mean Score (PMS which is the most commonly used imputation method in practice. Conclusions Several imputation methods should be avoided, in particular PMS imputation. From a general point of view, it is important to use an imputation method that considers both the ability of the patient (measured for example by his/her score, and the difficulty of the item (measured for example by its rate of favourable responses. Another recommendation is to always consider the addition of a random process in the imputation method, because such a process allows reducing the bias. Last, the analysis realized without imputation of the missing data (available case analyses is an interesting alternative to the simple imputation in this context.

  13. Validating Quantitative Measurement Using Qualitative Data: Combining Rasch Scaling and Latent Semantic Analysis in Psychiatry

    Science.gov (United States)

    Lange, Rense

    2015-02-01

    An extension of concurrent validity is proposed that uses qualitative data for the purpose of validating quantitative measures. The approach relies on Latent Semantic Analysis (LSA) which places verbal (written) statements in a high dimensional semantic space. Using data from a medical / psychiatric domain as a case study - Near Death Experiences, or NDE - we established concurrent validity by connecting NDErs qualitative (written) experiential accounts with their locations on a Rasch scalable measure of NDE intensity. Concurrent validity received strong empirical support since the variance in the Rasch measures could be predicted reliably from the coordinates of their accounts in the LSA derived semantic space (R2 = 0.33). These coordinates also predicted NDErs age with considerable precision (R2 = 0.25). Both estimates are probably artificially low due to the small available data samples (n = 588). It appears that Rasch scalability of NDE intensity is a prerequisite for these findings, as each intensity level is associated (at least probabilistically) with a well- defined pattern of item endorsements.

  14. Flexible Rasch Mixture Models with Package psychomix

    Directory of Open Access Journals (Sweden)

    Hannah Frick

    2012-05-01

    Full Text Available Measurement invariance is an important assumption in the Rasch model and mixture models constitute a flexible way of checking for a violation of this assumption by detecting unobserved heterogeneity in item response data. Here, a general class of Rasch mixture models is established and implemented in R, using conditional maximum likelihood estimation of the item parameters (given the raw scores along with flexible specification of two model building blocks: (1 Mixture weights for the unobserved classes can be treated as model parameters or based on covariates in a concomitant variable model. (2 The distribution of raw score probabilities can be parametrized in two possible ways, either using a saturated model or a specification through mean and variance. The function raschmix( in the R package psychomix provides these models, leveraging the general infrastructure for fitting mixture models in the flexmix package. Usage of the function and its associated methods is illustrated on artificial data as well as empirical data from a study of verbally aggressive behavior.

  15. Rasch Measurement: A Response to Payanides, Robinson and Tymms

    Science.gov (United States)

    Goldstein, Harvey

    2015-01-01

    A response is made to a paper that urges the use of the Rasch model for educational assessment. This paper argues that the model is inadequate and that claims for its efficacy are exaggerated and technically weak.

  16. Agreeableness scale- short version: item selection and psychometric properties / Escala fatorial de socialização- versão reduzida: seleção de itens e propriedades psicométricas

    Directory of Open Access Journals (Sweden)

    Maiana Farias Oliveira Nunes

    2010-01-01

    Full Text Available This study aimed at selecting items from the Agreeableness Factor Scale for obtaining a short version of this test that could keep adequate psychometric properties. One thousand one hundred participants composed the sample. Items were selected using a qualitative strategy, which focused on item content that was not related to clinical descriptions and a quantitative analysis based on Rasch's model. The scale was reduced from 70 to 28 items, based on these criteria. In order to check the psychometric properties of the short version, both versions were compared by Rasch indices and by reanalyzing validity studies conducted with the original scale. The short version kept good psychometric properties, which suggests the possibility of using it when there is time restriction.

  17. Properties of Rasch residual fit statistics.

    Science.gov (United States)

    Wu, Margaret; Adams, Richard J

    2013-01-01

    This paper examines the residual-based fit statistics commonly used in Rasch measurement. In particular, the paper analytically examines some of the theoretical properties of the residual-based fit statistics with a view to establishing the inferences that can be made using these fit statistics. More specifically, the relationships between the distributional properties of the fit statistics and sample size are discussed; some research that erroneously concludes that residual-based fit statistics are unstable is reviewed; and finally, it is analytically illustrated that, for dichotomous items, residual-based fit statistics provide a measure of the relative slope of empirical item characteristic curves. With a clear understanding of the theoretical properties of the fit statistics, the use and limitations of these statistics can be placed in the right light.

  18. Factors Influencing Singapore Students' Choice of Physics as a Tertiary Field of Study: A Rasch analysis

    Science.gov (United States)

    Oon, Pey-Tee; Subramaniam, R.

    2013-01-01

    Asian students often perform well in international science and mathematics assessments. Their attitude toward technical subjects, such as physics, remains curious for many. The present study examines Singapore school students' views on various aspects of physics according to whether they intend to choose physics as an advanced field of study. A sample of 1076 physics students, from 16 secondary schools and junior colleges, participated in this study. The students were categorized as physics choosers or non-choosers according to their indicated intention, as sought in the survey, to study or not to study physics as a major subject at university after their leaving level examinations. Rasch-anchored analysis was employed to interpret the results; the use of Rasch analysis has helped to overcome significantly the psychometric limitations inherent in the treatment of Likert scale type of data using traditional analysis. As expected, the image of physics as a difficult subject surfaced in the samples used in our study. The students recognized unequivocally the utilitarian value of physics: physics is said to enhance career options and is necessary for technological progress to occur in a country. They also showed high interest in school physics-this is so even for students who are not keen to study physics in the future, a finding which is at variance with other studies reported from Western countries. School physics is seen to be relevant, and physics teachers are viewed as being able to foster students' interest in physics. Laboratory work, enrichment activities, and physics textbooks were reported to be important in order to encourage students to like physics. Though the physics choosers showed greater intention in physics, they were generally not inclined to pursue physics-related careers after graduation. Parents and peers at school, on the other hand, are perceived to display unenthusiastic attitudes toward physics. Possible reasons for these are discussed along

  19. Psychometric properties of a Swedish version of the Consequences of Screening--Breast Cancer questionnaire.

    Science.gov (United States)

    Bolejko, Anetta; Brodersen, John; Zackrisson, Sophia; Wann-Hansson, Christine; Hagell, Peter

    2014-10-01

    To evaluate the psychometric properties of a questionnaire addressing psychosocial consequences of false-positive mammographic screening. The Consequences of Screening--Breast Cancer and Lung Cancer questionnaires target psychosocial consequences of false-positive cancer screening. The Consequences of Screening--Breast Cancer questionnaire and ten items not considered lung cancer specific from the Lung Cancer questionnaire have been adapted for use in mammographic screening in Sweden, but remain psychometrically untested. Instrument development paper with psychometric cross-sectional and test-retest design. Twelve scales of a Swedish questionnaire version were tested by the Rasch model and traditional psychometric methods. Women with false-positive (Group I, n = 640) and negative (Group II, n = 802) screening mammography responded to the study questionnaire and the Nottingham Health Profile during 2009-2011. Iterative analyses resulted in nine scales demonstrating Rasch model fit, but all scales exhibited poor targeting with relatively large floor effects. Corrected item-total correlations exceeded the recommended criterion. Score differences between Groups I and II and correlations with Nottingham Health Profile sections followed an expected pattern. Cronbach's α and test-retest reliability was acceptable for group-level assessments for ten and seven scales, respectively. Five scales (Sense of dejection, Anxiety, Behavioural, Sleep and Existential values) of the Swedish questionnaire version demonstrated the best psychometric properties. Other scales should be used more cautiously. Although filling an important gap, causes of concern were identified across scales. The questionnaire should therefore be considered for group-level assessments rather than for measurement of individual degrees of psychosocial consequences. © 2014 John Wiley & Sons Ltd.

  20. [Rasch Model in the Validation of the Paediatric Quality of Life Inventory™ 4.0 (PedsQL 4.0™) in Colombian Children and Adolescents].

    Science.gov (United States)

    Vélez, Claudia Marcela; Villada Ramírez, Adriana C; Arias, Ana Carolina Amaya; Eslava-Schmalbach, Javier H

    2016-01-01

    The aim of this study was to validate the PedsQL 4.0™ in Colombian children and adolescents using the Rasch model. The Paediatric Quality of Life Inventory (PedsQL 4.0™) has demonstrated to be a reliable and sensitive measurement to changes in health status, as well as being quick and easy to use. Validation study of measurement tools. The PedsQL 4.0™ was applied to a convenience sample of 375 children and adolescents between 5 and 17 years old and 500 caregivers of children between 2 and 18 years old in five Colombian cities. The psychometric properties were analysed according to the Rasch model, including adjustment, separation, and differential item functioning (DIF). The Rasch model provided adequate fits to data. The social dimension, for both versions, had greater difficulty than the physical health dimension. Internal consistency for the items was observed, while for individuals, the values of reliability and separation were lower than that established. The DIF occurred in very few variables, especially when comparing cities. The characteristic curves for the items presented disordered thresholds. The items had adequate internal consistency. Analysis showed adequate individual separation, but disordered thresholds were found in the response categories. No DIF was observed by sex or disease, but it is noteworthy that the DIF occurred between cities. Copyright © 2016 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

  1. Using Hospital Anxiety and Depression Scale (HADS) on patients with epilepsy: Confirmatory factor analysis and Rasch models.

    Science.gov (United States)

    Lin, Chung-Ying; Pakpour, Amir H

    2017-02-01

    The problems of mood disorders are critical in people with epilepsy. Therefore, there is a need to validate a useful tool for the population. The Hospital Anxiety and Depression Scale (HADS) has been used on the population, and showed that it is a satisfactory screening tool. However, more evidence on its construct validity is needed. A total of 1041 people with epilepsy were recruited in this study, and each completed the HADS. Confirmatory factor analysis (CFA) and Rasch analysis were used to understand the construct validity of the HADS. In addition, internal consistency was tested using Cronbachs' α, person separation reliability, and item separation reliability. Ordering of the response descriptors and the differential item functioning (DIF) were examined using the Rasch models. The HADS showed that 55.3% of our participants had anxiety; 56.0% had depression based on its cutoffs. CFA and Rasch analyses both showed the satisfactory construct validity of the HADS; the internal consistency was also acceptable (α=0.82 in anxiety and 0.79 in depression; person separation reliability=0.82 in anxiety and 0.73 in depression; item separation reliability=0.98 in anxiety and 0.91 in depression). The difficulties of the four-point Likert scale used in the HADS were monotonically increased, which indicates no disordering response categories. No DIF items across male and female patients and across types of epilepsy were displayed in the HADS. The HADS has promising psychometric properties on construct validity in people with epilepsy. Moreover, the additive item score is supported for calculating the cutoff. Copyright © 2016 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.

  2. Assessing the Psychometric Properties of Alternative Items for Certification.

    Science.gov (United States)

    Krogh, Mary Anne; Muckle, Timothy

    Alternative items were added as scored items to the National Certification Examination for Nurse Anesthetists (NCE) in 2010. A common concern related to the new items has been their measurement attributes. This study was undertaken to evaluate the psychometric impact of adding these items to the examination. Candidates had a significantly higher ability estimate in alternative items than in multiple choice questions and 6.7 percent of test candidates performed significantly differently in alternative item formats. The ability estimates of multiple choice questions correlated at r = .58. The alternative items took significantly longer time to answer than standard multiple choice questions and discriminated to a higher degree than MCQs. The alternative items exhibited unidimensionality to the same degree as MCQs and the BIC confirmed the Rasch model as acceptable for scoring. The new item types were found to have acceptable attributes for inclusion in the certification program.

  3. Rasch Analysis of a New Hierarchical Scoring System for Evaluating Hand Function on the Motor Assessment Scale for Stroke

    Directory of Open Access Journals (Sweden)

    Joyce S. Sabari

    2014-01-01

    Full Text Available Objectives. (1 To develop two independent measurement scales for use as items assessing hand movements and hand activities within the Motor Assessment Scale (MAS, an existing instrument used for clinical assessment of motor performance in stroke survivors; (2 To examine the psychometric properties of these new measurement scales. Design. Scale development, followed by a multicenter observational study. Setting. Inpatient and outpatient occupational therapy programs in eight hospital and rehabilitation facilities in the United States and Canada. Participants. Patients (N=332 receiving stroke rehabilitation following left (52% or right (48% cerebrovascular accident; mean age 64.2 years (sd 15; median 1 month since stroke onset. Intervention. Not applicable. Main Outcome Measures. Data were tested for unidimensionality and reliability, and behavioral criteria were ordered according to difficulty level with Rasch analysis. Results. The new scales assessing hand movements and hand activities met Rasch expectations of unidimensionality and reliability. Conclusion. Following a multistep process of test development, analysis, and refinement, we have redesigned the two scales that comprise the hand function items on the MAS. The hand movement scale contains an empirically validated 10-behavior hierarchy and the hand activities item contains an empirically validated 8-behavior hierarchy.

  4. Bayesian psychometric scaling

    NARCIS (Netherlands)

    Fox, G.J.A.; Berg, van den S.M.; Veldkamp, B.P.; Irwing, P.; Booth, T.; Hughes, D.

    2015-01-01

    In educational and psychological studies, psychometric methods are involved in the measurement of constructs, and in constructing and validating measurement instruments. Assessment results are typically used to measure student proficiency levels and test characteristics. Recently, Bayesian item resp

  5. Bayesian psychometric scaling

    NARCIS (Netherlands)

    Fox, Gerardus J.A.; van den Berg, Stéphanie Martine; Veldkamp, Bernard P.; Irwing, P.; Booth, T.; Hughes, D.

    2015-01-01

    In educational and psychological studies, psychometric methods are involved in the measurement of constructs, and in constructing and validating measurement instruments. Assessment results are typically used to measure student proficiency levels and test characteristics. Recently, Bayesian item

  6. Classical test theory and Rasch analysis validation of the Recent-Onset Arthritis Disability questionnaire in rheumatoid arthritis patients.

    Science.gov (United States)

    Salaffi, Fausto; Franchignoni, Franco; Giordano, Andrea; Ciapetti, Alessandro; Gasparini, Stefania; Ottonello, Marcella

    2013-02-01

    Disability has been identified as a core outcome measure in rheumatoid arthritis (RA). The aim of this study was to perform a comprehensive psychometric analysis of the Recent-Onset Arthritis Disability (ROAD) questionnaire in patients with RA. The questionnaire was completed by 583 patients with RA: 196 subjects participating in the NEW INDICES study and 387 subjects who were taking part in a long-term observational study. At confirmatory factor analysis for categorical data, data fit for a three-factor model was adequate to good (non-normed fit index = 0.98, comparative fit index = 0.99, root mean square error of approximation = 0.079, standardized root mean square residual = 0.047), with standardized item-to-factor loadings ranging from 0.60 to 0.90 and a cumulative explained variance of 83 %. The bifactor model of ROAD presented a clean independent cluster structure. The loadings in the unidimensional model were very similar to those on the general factor in the bifactor model. Rasch analysis showed a correct functioning of rating categories, a good fit of the data to the model for all three subscales, and satisfactory separation indexes and respective reliability (for both persons and items). This study, using both classical test theory and Rasch analysis methods, provides psychometric evidence of the reliability and internal and structural validity of ROAD in RA patients. Our results support the use of separate subscores for upper limb function, lower limb function, and activities of daily living/work, and the appropriateness of reporting an overall score (i.e., the mean of the three subscales).

  7. A Multidimensional Rasch Analysis of the Functional Independence Measure Based on the National Institute on Disability, Independent Living, and Rehabilitation Research Traumatic Brain Injury Model Systems National Database.

    Science.gov (United States)

    Pretz, Christopher R; Kean, Jacob; Heinemann, Allen W; Kozlowski, Allan J; Bode, Rita K; Gebhardt, Eveline

    2016-07-15

    A number of studies have evaluated the psychometric properties of the Functional Independence Measure (FIM™) using Rasch analysis, although none has done so using the National Institute on Disability, Independent Living, and Rehabilitation Research Traumatic Brain Injury Model Systems National Database, a longitudinal database that captures demographic and outcome information on persons with moderate to severe traumatic brain injury across the United States. In the current study, we examine the psychometric properties of the FIM as represented by persons within this database and demonstrate that the FIM comprises three subscales representing cognitive, self-care, and mobility domains. These subscales were analyzed simultaneously using a multivariate Rasch model in combination with a time dependent concurrent calibration scheme with the goal of creating a raw score-to-logit transformation that can be used to improve the accuracy of parametric statistical analyses. The bowel and bladder function items were removed because of misfit with the motor and cognitive items. Some motor items exhibited step disorder, which was addressed by collapsing Categories 1-3 for Toileting, Stairs, Locomotion, Tub/Shower Transfers; Categories 1 and 2 for Toilet and Bed Transfers; and Categories 2 and 3 for Grooming. The strong correlations (r = 0.82-0.96) among the three subscales suggest they should be modeled together. Coefficient alpha of 0.98 indicates high internal consistency. Keyform maps are provided to enhance clinical interpretation and application of study results.

  8. Rasch Analysis of the Premature Ejaculation Diagnostic Tool (PEDT and the International Index of Erectile Function (IIEF in an Iranian Sample of Prostate Cancer Patients.

    Directory of Open Access Journals (Sweden)

    Chung-Ying Lin

    Full Text Available Male sexual dysfunction is an increasing problem across a variety of general and clinical populations, such as cancer populations; especially among prostate cancer patients who tend to receive treatments that often result in erectile dysfunction (ED and/or premature ejaculation (PE. Therefore, in order to diagnose ED and PE in these populations, adequate and efficient instruments such as the International Index of Erectile Function 5-item version (IIEF-5 and the Premature Ejaculation Diagnostic Tool (PEDT are needed. However, since this is an important topic additional evidence of psychometric properties of the IIEF-5 and the PEDT in such samples are required. Thus the aim of the present study was to use Rasch models to investigate the construct validity, local dependency, score order, and differential item functioning (DIF of both questionnaires in a sample of prostate cancer patients.Prostate cancer patients (n = 1058, mean±SD age = 64.07±6.84 years who visited urology clinics were invited to fill out the IIEF-5 and the PEDT. Construct validity was examined using infit and outfit mean square (MnSq and local dependency using correlations between each two residual Rasch scores. Score order was investigated using step and average measures of difficulty and DIF using DIF contrast.All IIEF-5 and PEDT items had acceptable infit and outfit MnSq. Step measures revealed that all but two items had disordered categories in terms of scores 1 to 3. Only one local dependency was found, and no items displayed DIF across age, educational level, and help seeking.The results showed that both the IIEF-5 and the PEDT had sound psychometric properties in the Rasch analyses, although some score disordering could be detected in both instruments. The results of no DIF items in both instruments suggest using them to compare ED and PE across age and educational level is adequate.

  9. Rasch Analysis of the Premature Ejaculation Diagnostic Tool (PEDT) and the International Index of Erectile Function (IIEF) in an Iranian Sample of Prostate Cancer Patients

    Science.gov (United States)

    Lin, Chung-Ying; Pakpour, Amir H.; Burri, Andrea; Montazeri, Ali

    2016-01-01

    Background Male sexual dysfunction is an increasing problem across a variety of general and clinical populations, such as cancer populations; especially among prostate cancer patients who tend to receive treatments that often result in erectile dysfunction (ED) and/or premature ejaculation (PE). Therefore, in order to diagnose ED and PE in these populations, adequate and efficient instruments such as the International Index of Erectile Function 5-item version (IIEF-5) and the Premature Ejaculation Diagnostic Tool (PEDT) are needed. However, since this is an important topic additional evidence of psychometric properties of the IIEF-5 and the PEDT in such samples are required. Thus the aim of the present study was to use Rasch models to investigate the construct validity, local dependency, score order, and differential item functioning (DIF) of both questionnaires in a sample of prostate cancer patients. Methods Prostate cancer patients (n = 1058, mean±SD age = 64.07±6.84 years) who visited urology clinics were invited to fill out the IIEF-5 and the PEDT. Construct validity was examined using infit and outfit mean square (MnSq) and local dependency using correlations between each two residual Rasch scores. Score order was investigated using step and average measures of difficulty and DIF using DIF contrast. Results All IIEF-5 and PEDT items had acceptable infit and outfit MnSq. Step measures revealed that all but two items had disordered categories in terms of scores 1 to 3. Only one local dependency was found, and no items displayed DIF across age, educational level, and help seeking. Conclusions The results showed that both the IIEF-5 and the PEDT had sound psychometric properties in the Rasch analyses, although some score disordering could be detected in both instruments. The results of no DIF items in both instruments suggest using them to compare ED and PE across age and educational level is adequate. PMID:27336626

  10. Reliability of the Rasch Food Safety Practices scale.

    Science.gov (United States)

    Fischer, Arnout R H; Frewer, Lynn J

    2009-10-01

    A reduced version of the Rasch Food Safety Practices scale [Fischer, A. R. H., Frewer, L. J., & Nauta, M. J. (2006). Towards improving food safety in the domestic environment: a multi-item Rasch scale for the measurement of the safety efficacy of domestic food handling practices. Risk Analysis, 26(5), 1323-1338] was investigated to establish its reliability and robustness. A second set of survey data were collected using the reduced Rasch scale. We discuss the reliability and robustness of the original Rasch scale in terms of the second analysis. In general, the results of the reduced scale provided results that were very similar to those obtained in the original study. In both studies the goodness of fit of the different items was stable. The range of the difficulty parameters was smaller in this study than in the previous one, which may be attributed to methodological causes. The high level of similarity of the key parameters shows that the Rasch scale is reliable and robust.

  11. Classical test theory versus Rasch analysis for quality of life questionnaire reduction

    Directory of Open Access Journals (Sweden)

    Lamarca Rosa

    2003-07-01

    Full Text Available Abstract Background Although health-related quality of life (HRQOL instruments may offer satisfactory results, their length often limits the extent to which they are actually applied in clinical practice. Efforts to develop short questionnaires have largely focused on reducing existing instruments. The approaches most frequently employed for this purpose rely on statistical procedures that are considered exponents of Classical Test Theory (CTT. Despite the popularity of CTT, two major conceptual limitations have been pointed out: the lack of an explicit ordered continuum of items that represent a unidimensional construct, and the lack of additivity of rating scale data. In contrast to the CTT approach, the Rasch model provides an alternative scaling methodology that enables the examination of the hierarchical structure, unidimensionality and additivity of HRQOL measures. METHODS: In order to empirically compare CTT and Rasch Analysis (RA results, this paper presents the parallel reduction of a 38-item questionnaire, the Nottingham Health Profile (NHP, through the analysis of the responses of a sample of 9,419 individuals. Results CTT resulted in 20 items (4 dimensions whereas RA in 22 items (2 dimensions. Both instruments showed similar characteristics under CTT requirements: item-total correlation ranged 0.45–0.75 for NHP20 and 0.46–0.68 for NHP22, while reliability ranged 0.82–0.93 and 0.87–94 respectively. Conclusions Despite the differences in content, NHP20 and NHP22 convergent scores also showed high degrees of association (0.78–0.95. Although the unidimensional view of health of the NHP20 and NHP22 composite scores was also confirmed by RA, NHP20 dimensions failed to meet the goodness-of fit criteria established by the Rasch model, precluding the interval-level of measurement of its scores.

  12. On designing data-sampling for Rasch model calibrating an achievement test

    Directory of Open Access Journals (Sweden)

    TAKUYA YANAGIDA

    2009-12-01

    Full Text Available In correspondence with pertinent statistical tests, it is of practical importance to design data-sampling when the Rasch model is used for calibrating an achievement test. That is, determining the sample size according to a given type-I- and type-II-risk, and according to a certain effect of model misfit which is of practical relevance is of interest. However, pertinent Rasch model tests use chi-squared distributed test-statistics, whose degrees of freedom do not depend on the sample size or the number of testees, but only on the number of estimated parameters. We therefore suggest a new approach using an F-distributed statistic as applied within analysis of variance, where the sample size directly affects the degrees of freedom. The Rasch model’s quality of specific objective measurement is in accordance with no interaction effect in a specific analysis of variance design. In analogy to Andersen’s approach in his Likelihood-Ratio test, the testees must be divided into at least two groups according to some criterion suspected of causing differential item functioning (DIF. Then a three-way analysis of variance design (A>BxC with mixed classification is the result: There is a (fixed group factor A, a (random factor B of testees within A, and a (fixed factor C of items cross-classified with A>B; obviously the factor B is nested within A. Yet the data are dichotomous (a testee either solves an item or fails to solve it and only one observation per cell exists. The latter is not assumed to do harm, though the design is a mixed classification. But the former suggests the need to perform a simulation study in order to test whether the type-I-risk holds for the AxC interaction F-test – this interaction effect corresponds to Rasch model’s specific objectivity. If so, the critical number of testees is of interest for fulfilling the pertinent precision parameters. The simulation study (100 000 runs for each of several special cases proved that the

  13. A Multi-Marker Genetic Association Test Based on the Rasch Model Applied to Alzheimer's Disease.

    Directory of Open Access Journals (Sweden)

    Wenjia Wang

    Full Text Available Results from Genome-Wide Association Studies (GWAS have shown that the genetic basis of complex traits often include many genetic variants with small to moderate effects whose identification remains a challenging problem. In this context multi-marker analysis at the gene and pathway level can complement traditional point-wise approaches that treat the genetic markers individually. In this paper we propose a novel statistical approach for multi-marker analysis based on the Rasch model. The method summarizes the categorical genotypes of SNPs by a generalized logistic function into a genetic score that can be used for association analysis. Through different sets of simulations, the false-positive rate and power of the proposed approach are compared to a set of existing methods, and shows good performances. The application of the Rasch model on Alzheimer's Disease (AD ADNI GWAS dataset also allows a coherent interpretation of the results. Our analysis supports the idea that APOE is a major susceptibility gene for AD. In the top genes selected by proposed method, several could be functionally linked to AD. In particular, a pathway analysis of these genes also highlights the metabolism of cholesterol, that is known to play a key role in AD pathogenesis. Interestingly, many of these top genes can be integrated in a hypothetic signalling network.

  14. Applying the Many-Facet Rasch Measurement Model to Explore Reviewer Ratings of Conference Proposals.

    Science.gov (United States)

    Bradley, Kelly D; Peabody, Michael R; Mensah, Richard K

    For academic conferences, when proposals are submit they are often judged using a rating scale on identified criterion by reviewers who have a shared interest and expertise in the area under consideration. Given the multiple and varied reviewers, an analysis of psychometric properties like rater severity and consistency are important. However, many of the problems that plague the conference proposal selection process are the same issues that plague survey research: rater bias/severity, misuse of rating scale, and the use of raw scores as measures. We propose the use of the many-facet Rasch measurement model (MFRM) to combat these shortcomings and improve the quality of the conference proposal selection process. A set of American Educational Research Association (AERA) Special Interest Group (SIG) proposals is used as an example. The results identify proposals that were accepted based on calculating the mean of summed raw scores, but when MFRM is applied to adjust for judge severity the rank order of the proposals is substantially altered.

  15. Exploring Variability Sources in Student Evaluation of Teaching via Many-Facet Rasch Model

    Directory of Open Access Journals (Sweden)

    Bengü BÖRKAN

    2017-03-01

    Full Text Available Evaluating quality of teaching is important in nearly every higher education institute. The most common way of assessing teaching effectiveness takes place through students. Student Evaluation of Teaching (SET is used to gather information about students’ experiences with a course and instructor’s performance at some point of semester. SET can be considered as a type of rater mediated performance assessment where students are the raters and instructors are the examinees. When performance assessment becomes a rater mediated assessment process, extra measures need to be taken into consideration in order to create more reliable and fair assessment practices. The study has two main purposes; (a to examine the extent to which the facets (instructor, student, and rating items contribute to instructors’ score variance and (b to examine the students’ judging behavior in order to detect any potential source of bias in student evaluation of teaching by using the Many-Facet Rasch Model. The data set includes one thousand 235 students’ responses from 254 courses. The results show that a students greatly differ in the severity while rating instructors, b students were fairly consistent in their ratings, c students as a group and individual level are tend to display halo effect in their ratings, d students are clustered at the highest two categories of the scale and e the variation in item measures is fairly low. The findings have practical implications for the SET practices by improving the psychometric quality of measurement.

  16. The role of Rasch analysis when conducting science education research utilizing multiple-choice tests

    Science.gov (United States)

    Boone, William J.; Scantlebury, Kathryn

    2006-03-01

    Recent international studies note that countries whose students perform well on international science assessments report the need to change science education. Some countries use assessments for diagnostic purposes to assist teachers in addressing their students' needs. However, in the United States, standards-based reform has focused the national discussion on documenting students' attainment of high educational standards. Students' science achievement is one of those standards, and in many states, high-stakes tests determine the resultant achievement measures. Policymakers and administrators use those tests to rank school performance, to prevent students' graduation, and to evaluate teachers. With science test measures used in different ways, statistical confidence in the measures' validity and reliability is essential. Using a science achievement test from one state's systemic reform project as an example, this paper discusses the strengths of the Rasch model as a psychometric tool and analysis technique, referring to person item maps, anchoring, differential item functioning, and person item fit. Furthermore, the paper proposes that science educators should carefully inspect the tools they use to measure and document changes in educational systems.

  17. Introducing the Geneva emotion recognition test: an example of Rasch-based test development.

    Science.gov (United States)

    Schlegel, Katja; Grandjean, Didier; Scherer, Klaus R

    2014-06-01

    Existing tests to measure the ability to recognize other people's emotional expressions (emotion recognition ability [ERA]) mostly focus on a single modality (usually the face) and include only a small number of emotions, restricting their ecological validity. Further, their reliability is often unsatisfactory. The goal of the present study was to develop a new ERA test (Geneva Emotion Recognition Test [GERT]) that (a) features dynamic and multimodal actor portrayals (short videos with sound), (b) contains a large number of emotions, and (c) is based on modern psychometric principles (item response theory). We asked 295 participants to watch 108 actor portrayals and to choose, for each portrayal, which of 14 emotions had been expressed by the actor. We then applied the Rasch model independently to each of the 14 emotion portrayal subsets to select 83 final items for the GERT. Results showed that the model fits the emotion subtests and the overall GERT and that measurement precision is satisfactory. Consistent with previous findings, we found a decline in ERA with increasing age and an ERA advantage for women. To conclude, the GERT is a promising instrument to measure ERA in a more ecologically valid and comprehensive fashion than previous tests.

  18. Development and psychometric evaluation of a sexual health care knowledge scale for oncology nurses.

    Science.gov (United States)

    Kim, Sue; Park, Eun-young; Kim, Jung-Hee

    2014-10-01

    The purpose of this study was to develop a sexual health care knowledge scale for oncology nurses and to evaluate its psychometric properties using Rasch analysis and the known-groups technique. Although sexual oncology has become a popular topic and sexual health care is now promoted, there has been a lack of instruments supported by psychometric evaluations to measure nurses' knowledge of sexual health issues. The initial 72 items were compiled to form the Sexual Health Care Scale - Knowledge (SHCS-K) for oncology nurses using a literature review and analysis of existing research tools. After a specialist panel verified content validity, the questionnaire was shortened to 58 items. The data were analyzed using a Rasch model to investigate the items with respect to unidimensionality of fit and difficulty and reliability distribution. Discriminant validity was examined using the known-groups technique. Two items did not fit with the Rasch model. Person and item separation-index ratios were 3.33 and 9.45, respectively, which confirmed that the SHCS-K functioned well. The reliability was good, at 0.99. Significant differences in marital status, levels of education, and participation in SHC training were observed between groups. The final version of the questionnaire consisted of 55 items, with a total score range of 0-55. The SHCS-K was found to be a valid and reliable measure for evaluating levels of sexual health care knowledge among this sample of oncology nurses. Copyright © 2014 Elsevier B.V. All rights reserved.

  19. Diagnosis of students' ability in a statistical course based on Rasch probabilistic outcome

    Science.gov (United States)

    Mahmud, Zamalia; Ramli, Wan Syahira Wan; Sapri, Shamsiah; Ahmad, Sanizah

    2017-06-01

    Measuring students' ability and performance are important in assessing how well students have learned and mastered the statistical courses. Any improvement in learning will depend on the student's approaches to learning, which are relevant to some factors of learning, namely assessment methods carrying out tasks consisting of quizzes, tests, assignment and final examination. This study has attempted an alternative approach to measure students' ability in an undergraduate statistical course based on the Rasch probabilistic model. Firstly, this study aims to explore the learning outcome patterns of students in a statistics course (Applied Probability and Statistics) based on an Entrance-Exit survey. This is followed by investigating students' perceived learning ability based on four Course Learning Outcomes (CLOs) and students' actual learning ability based on their final examination scores. Rasch analysis revealed that students perceived themselves as lacking the ability to understand about 95% of the statistics concepts at the beginning of the class but eventually they had a good understanding at the end of the 14 weeks class. In terms of students' performance in their final examination, their ability in understanding the topics varies at different probability values given the ability of the students and difficulty of the questions. Majority found the probability and counting rules topic to be the most difficult to learn.

  20. Psychometric latent response models

    NARCIS (Netherlands)

    Maris, E.

    1995-01-01

    In this paper, some psychometric models will be presented that belong to the larger class oflatent response models (LRMs). First, LRMs are introduced by means of an application in the field ofcomponential item response theory (Embretson, 1980, 1984). Second, a general definition of LRMs (not specifi

  1. A Rasch Analysis of the Academic Self-Concept Questionnaire

    Science.gov (United States)

    Joyce, Tan Bei Yu; Yates, Shirley M.

    2007-01-01

    This study used the Rasch model to assess the unidimensionality and item-person fit of an Academic Self-Concept Questionnaire (ASCQ) that is based on the Confucian Heritage Culture (CHC) perspective. Knowledge of the relationship between academic achievement and academic self-concept is particularly useful because academic achievement is…

  2. Error Variance of Rasch Measurement with Logistic Ability Distributions.

    Science.gov (United States)

    Dimitrov, Dimiter M.

    Exact formulas for classical error variance are provided for Rasch measurement with logistic distributions. An approximation formula with the normal ability distribution is also provided. With the proposed formulas, the additive contribution of individual items to the population error variance can be determined without knowledge of the other test…

  3. Measuring Sophistication of Epistemic Beliefs Using Rasch Analysis

    NARCIS (Netherlands)

    Van Strien, Johan; Bijker, Monique; Brand-Gruwel, Saskia; Boshuizen, Els

    2012-01-01

    Van Strien, J. L. H., Bijker, M., Brand-Gruwel, S., & Boshuizen, H. P. A. (2012, July). Measuring sophistication of epistemic beliefs using Rasch analysis. In J. van Aalst, K. Thompson, M. J. Jacobson, & P. Reimann (Eds.), The future of learning: Proceedings of the 10th international conference of t

  4. Analysis of High School German Textbooks through Rasch Measurement Model

    Science.gov (United States)

    Batdi, Veli; Elaldi, Senel

    2016-01-01

    The purpose of the present study is to analyze German teacher trainers' views on high school German textbooks through the Rasch measurement model. A survey research design was employed and study group consisted of a total of 21 teacher trainers, three from each region and selected randomly from provinces which are located in seven regions and…

  5. Rasch Model Based Analysis of the Force Concept Inventory

    Science.gov (United States)

    Planinic, Maja; Ivanjek, Lana; Susac, Ana

    2010-01-01

    The Force Concept Inventory (FCI) is an important diagnostic instrument which is widely used in the field of physics education research. It is therefore very important to evaluate and monitor its functioning using different tools for statistical analysis. One of such tools is the stochastic Rasch model, which enables construction of linear…

  6. Rasch Analysis of the Geriatric Depression Scale--Short Form

    Science.gov (United States)

    Chiang, Karl S.; Green, Kathy E.; Cox, Enid O.

    2009-01-01

    Purpose: The purpose of this study was to examine scale dimensionality, reliability, invariance, targeting, continuity, cutoff scores, and diagnostic use of the Geriatric Depression Scale-Short Form (GDS-SF) over time with a sample of 177 English-speaking U.S. elders. Design and Methods: An item response theory, Rasch analysis, was conducted with…

  7. Rasch Analysis of Professional Behavior in Medical Education

    Science.gov (United States)

    Lange, R.; Verhulst, S. J.; Roberts, N. K.; Dorsey, J. K.

    2015-01-01

    The use of students' "consumer feedback" to assess faculty behavior and improve the process of medical education is a significant challenge. We used quantitative Rasch measurement to analyze pre-categorized student comments listed by 385 graduating medical students. We found that students differed little with respect to the number of…

  8. Rasch Analysis of the Geriatric Depression Scale--Short Form

    Science.gov (United States)

    Chiang, Karl S.; Green, Kathy E.; Cox, Enid O.

    2009-01-01

    Purpose: The purpose of this study was to examine scale dimensionality, reliability, invariance, targeting, continuity, cutoff scores, and diagnostic use of the Geriatric Depression Scale-Short Form (GDS-SF) over time with a sample of 177 English-speaking U.S. elders. Design and Methods: An item response theory, Rasch analysis, was conducted with…

  9. A Note on the Usefulness of the Behavioural Rasch Selection Model for Causal Inference in the Social Sciences

    Science.gov (United States)

    Rabbitt, Matthew P.

    2016-11-01

    Social scientists are often interested in examining causal relationships where the outcome of interest is represented by an intangible concept, such as an individual's well-being or ability. Estimating causal relationships in this scenario is particularly challenging because the social scientist must rely on measurement models to measure individual's properties or attributes and then address issues related to survey data, such as omitted variables. In this paper, the usefulness of the recently proposed behavioural Rasch selection model is explored using a series of Monte Carlo experiments. The behavioural Rasch selection model is particularly useful for these types of applications because it is capable of estimating the causal effect of a binary treatment effect on an outcome that is represented by an intangible concept using cross-sectional data. Other methodology typically relies of summary measures from measurement models that require additional assumptions, some of which make these approaches less efficient. Recommendations for application of the behavioural Rasch selection model are made based on results from the Monte Carlo experiments.

  10. Escitalopram dose-response revisited: an alternative psychometric approach to evaluate clinical effects of escitalopram compared to citalopram and placebo in patients with major depression.

    Science.gov (United States)

    Bech, Per; Tanghøj, Per; Cialdella, Philippe; Andersen, Henning Friis; Pedersen, Anders Gersel

    2004-09-01

    In continuation of a previous psychometric analysis of dose-response data for citalopram in depression, the corresponding study data for escitalopram is of interest, since escitalopram is the active enantiomer of citalopram and because citalopram was used as the active control. Revisiting those corresponding data, the psychometric properties of the Montgomery-Asberg Depression Scale (MADRS) and the Hamilton Depression Scale (HAMD) were investigated by focusing on the unidimensional HAMD6 and MADRS6. Effect sizes were calculated and compared for two dosages of escitalopram (10 mg and 20 mg daily) and between each of these two dosages and 40 mg citalopram daily. The results showed that the three depression scales MADRS6, MADRS10 and HAMD6 were psychometrically acceptable (coefficient of homogeneity of 0.40 or higher). In the severely depressed patients (MADRS10> or =30) a rather clear dose-response relationship for escitalopram was seen on all three scales after 6 and 8 wk of therapy. Thus, the effect size for 10 mg escitalopram ranged from 0.28 to 0.38 while the effect sizes for 20 mg escitalopram ranged from 0.57 to 0.77. This difference was statistically significant (pescitalopram and 40 mg citalopram was seen after 8 wk of therapy for MADRS10 (effect size 0.71 vs. 0.37). An item analysis identified 'suicidal thoughts' to be the most discriminating item in this respect. These results for the severely depressed patients were confirmed by the patients self-reported quality of life evaluation. When all included patients were analysed, however, no clear dose-response relationship was seen. In conclusion, a dose-response relationship for escitalopram was seen in the severely depressed patients on all outcome scales after 6 and 8 wk of treatment. After 8 wk of treatment 20 mg escitalopram was superior to 40 mg citalopram, but not after 2 wk of treatment.

  11. Building a new Rasch-based self-report inventory of depression

    Directory of Open Access Journals (Sweden)

    Balsamo M

    2014-01-01

    Full Text Available Michela Balsamo,1 Giuseppe Giampaglia,2 Aristide Saggino11DiSPUTer, Department of Psychological Sciences, Humanities and Territory, “G d'Annunzio” University, Chieti-Pescara, Italy; 2Department of Economics and Statistics, “Federico-II” University, Naples, ItalyAbstract: This paper illustrates a sequential item development process to create a new self-report instrument of depression refined with Rasch analysis from a larger pool of potential diagnostic items elicited through a consensus approach by clinical experts according to the latest edition of the Diagnostic and Statistical Manual of Mental Disorders criteria for major depression. A 51-item pool was administered to a sample of 529 subjects (300 healthy community-dwelling adults and 229 psychiatric outpatients. Item selection resulted in a 21-item set, named the Teate Depression Inventory, with an excellent Person Separation Index and no evidence of bias due to an item–trait interaction (χ2=147.71; df =168; P=0.48. Additional support for the unidimensionality, local independence, appropriateness of the response format, and discrimination ability between clinical and nonclinical subjects was provided. No substantial differential item functioning by sex was observed. The Teate Depression Inventory shows considerable promise as a unidimensional tool for the screening of depression. Finally, advantages and disadvantages of this methodology will be discussed in terms of subsequent possible mathematical analyses, statistical tests, and implications for clinical investigations.Keywords: depression, scale development, self-report scales, Rasch analysis

  12. Understanding Rasch Measurement: Understanding Resistance to the Data-model Relationship in Rasch's Paradigm: A Reflection for the Next Generation.

    Science.gov (United States)

    Andrich, David

    2002-01-01

    Reflects on the development of the unidimensional Rasch model for ordered categories and the resistance to some of its initially counterintuitive implications, especially that the thresholds that partition the continuum to form the ordered categories can show an empirical problem with the data. (SLD)

  13. Prejudiced attitude measurement using the Rasch Rating Scale model.

    Science.gov (United States)

    Rojas Tejada, Antonio J; Lozano Rojas, Oscar M; Navas Luque, Marisol; Pérez Moreno, Pedro J

    2011-10-01

    There have been two basic approaches for the study of minority group prejudice against the majority: to adapt instruments from the majority group, and to use qualitative techniques by analyzing the content of the discourse of the groups involved. Neither of these procedures solves the problem of measuring intergroup attitudes of majorities and minorities in interaction. This study shows the result of a prejudice scale which was developed to measure the attitude of both the minority and majority groups. Prejudice is conceived as an attitude which requires the beliefs or opinions about the out-group, the emotions it elicits, and the behavior or intentional behavior toward it to be known for its evaluation. The innovation in this work is that the psychometric development of the scale was based on the item response theory, and more specifically, the rating scale model.

  14. Screening for depressed mood in an adolescent psychiatric context by brief self-assessment scales -- testing psychometric validity of WHO-5 and BDI-6 indices by latent trait analyses

    DEFF Research Database (Denmark)

    Blom, Eva Henje; Bech, Per; Högberg, Göran

    2012-01-01

    but they are time-consuming and often not fully implemented in clinical practice. Screening for depressive symptoms in the child psychiatric context using brief, user-friendly and easily managed self-assessment scales may be of clinical value and utility. The aim of the study is to test the psychometric validity.......52 and for the BDI-6 of 0.46. Rasch analysis also accepted unidimensionality when testing males versus females (p > 0.05). CONCLUSIONS: The WHO-5 is psychometrically valid in an adolescent psychiatric context including both genders to assess the wellness dimension and applicable as a first step in screening for MDD...

  15. Psychometric properties of the adult resilience indicator

    Directory of Open Access Journals (Sweden)

    Martina Kotzé

    2013-03-01

    Full Text Available Orientation: Researchers need to assess the psychometric rigour of resilience measuring scales. Research purpose: The purpose of the study was to assess the psychometric properties of the South African Adult Resilience Indicator (ARI.Motivation for the study: Researchers have not previously published the psychometric properties of the South African Adult Resilience Indicator.Research design, approach and method: The authors used a cross-sectional quantitative research design. A sample of 789 young adults participated in the study. Cross-validation allowed the authors to confirm (using the validation sample the validity of the ARI structure they obtained during initial testing (using the calibration sample. They investigated two measurement models (the original factor structure and a one-dimensional factor structure.Main findings: The original factor structure presented the data and the proposed theory better than did the one-dimensional factor structure. The authors found acceptable goodness of fit for the ARI. More specifically, they found invariance (in terms of equal factor loadings,covariances and error variances in the calibration and validation samples. They also found acceptable reliability estimates for each of the eight sub-scales.Practical/managerial implications: The results can help researchers and practitioners interested in measuring resilience in adults to choose a resilience measure and to select an appropriate measure for their populations and contexts.Contribution/value-add: Previous research has clearly shown that reliable and valid resilience measures are necessary. It is also necessary to assess the psychometric properties of the currently available instruments and to publish the findings. This study has helped by examining the psychometric properties of the South African Adult Resilience Indicator.

  16. Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

    Science.gov (United States)

    Sijtsma, Klaas

    2012-01-01

    I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

  17. Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

    Science.gov (United States)

    Sijtsma, Klaas

    2012-01-01

    I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

  18. Planning a Study for Testing the Rasch Model given Missing Values due to the use of Test-booklets.

    Science.gov (United States)

    Yanagida, Takuya; Kubinger, Klaus D; Rasch, Dieter

    2015-01-01

    Though calibration of an achievement test within a psychological and educational context is very often carried out by the Rasch model, data sampling is hardly designed according to statistical foundations. However, Kubinger, Rasch, and Yanagida (2009, 2011) suggested an approach for the determination of sample size according to a given Type-I and Type-II risk and a certain effect of model contradiction when testing the Rasch model. The approach uses a three-way analysis of variance design with mixed classification. For the while, their simulation studies deal with complete data, meaning every examinee is administered with all of the items of an item pool. The simulation study now presented in this paper deals with the practical relevant case, in particular for large-scale assessments, that item presentation happens to use several test-booklets. As a consequence, there are missing values by design. Therefore, the question to be considered is, whether this approach works in this case as well. Besides the fact, that data are not normally distributed but there is a dichotomous variable (an examinee either solves an item or fails to solve it), only a single entry for each cell exists in the given three-way analysis of variance design, if at all, due to missing values. Hence, the obligatory test-statistic's distribution may not be retained, in contrast to the case of having no missing values. The result of our simulation study, despite applying only to a very special scenario, is that this approach works, indeed: Whether test-booklets were used or every examinee is administered all of the items changes nothing in respect to the actual Type-I risk or to the power of the test, given almost the same amount of information of examinees per item. However, as the results are limited to a special scenario, we currently recommend any interested researcher to simulate the appropriate one in advance by him/herself.

  19. Using Rasch modeling to measure acculturation in youth.

    Science.gov (United States)

    Davis, Melinda F; Adam, Mary; Carvajal, Scott; Sechrest, Lee; Reyna, Valerie F

    2011-01-01

    Ethnic differences in health outcomes are assumed to reflect levels of acculturation, among other factors. Health surveys frequently include language and social interaction items taken from existing acculturation instruments. This study evaluated the dimensionality of responses to typical bilinear items in Latino youth using Rasch modeling. Two seven-item scales measuring Anglo-Hispanic orientation were adapted from Marin and Gamba (1996) and Cuellar, Arnold, and Maldonado (1995). Most of the items fit the Rasch model. However, there were gaps in both the Hispanic and Anglo scales. The Anglo items were not well targeted for the sample because most students reported they always spoke English. The lack of variability found in a heterogeneous sample of Latino youth has negative implications for the common practice of relying on language as a measure of acculturation. Acculturation instruments for youth probably need more sensitive items to discriminate linguistic differences, or to measure other factors.

  20. Validation of VARK learning modalities questionnaire using Rasch analysis

    Science.gov (United States)

    Fitkov-Norris, E. D.; Yeghiazarian, A.

    2015-02-01

    This article discusses the application of Rasch analysis to assess the internal validity of a four sub-scale VARK (Visual, Auditory, Read/Write and Kinaesthetic) learning styles instrument. The results from the analysis show that the Rasch model fits the majority of the VARK questionnaire data and the sample data support the internal validity of the four sub-constructs at 1% level of significance for all but one item. While this suggests that the instrument could potentially be used as a predictor for a person's learning preference orientation, further analysis is necessary to confirm the invariability of the instrument across different user groups across factors such as gender, age, educational and cultural background.

  1. A Rasch Analysis of the Charcot-Marie-Tooth Neuropathy Score (CMTNS) in a Cohort of Charcot-Marie-Tooth Type 1A Patients

    Science.gov (United States)

    Guedj, Mickaël; Bertrand, Viviane; Foucquier, Julie; Jouve, Elisabeth; Commenges, Daniel; Proust-Lima, Cécile; Murphy, Niall P.; Blin, Olivier; Magy, Laurent; Cohen, Daniel; Attarian, Shahram

    2017-01-01

    The Charcot-Marie-Tooth Neuropathy Score (CMTNS) was developed as a main efficacy endpoint for application in clinical trials of Charcot-Marie-Tooth disease type 1A (CMT1A). However, the sensitivity of the CMTNS for measuring disease severity and progression in CMT1A patients has been questioned. Here, we applied a Rasch analysis in a French cohort of patients to evaluate the psychometrical properties of the CMTNS. Overall, our analysis supports the validity of the CMTNS for application to CMT1A patients though with some limitations such as certain items of the CMTNS being more suitable for moderate to severe forms of the disease, and some items being disordered. We suggest that additional items and/or categories be considered to better assess mild-to-moderate patients. PMID:28095456

  2. Measurement of body dissatisfaction in college-enrolled Mexican American Women: A Rasch-based examination of the validity and reliability of the EDI-III.

    Science.gov (United States)

    Stein, Karen Farchaus; Riley, Barth Brian; Hoyland-Domenico, Lisa; Lee, Chia-Kuei

    2015-12-01

    Measures of body dissatisfaction have not been validated for Mexican American (MA) women, who evaluate their bodies differently than Caucasian women. In this study, the psychometric properties of the EDI-III, Body Dissatisfaction Subscale (BDS) were examined in a sample of college-enrolled MA women using the Rasch Rating Scale Model. Criterion validity was also addressed. BDS evidenced good item fit, person and item reliability, once poorly correlated items were removed. Two qualitatively distinct dimensions of body dissatisfaction were identified: (1) overall body shape and stomach, and (2) the lower body. Validity of the scales was supported. Results suggest: MA women's satisfaction with overall body shape is not synonymous with attitudes toward their lower body.

  3. Four Theorems on the Psychometric Function

    Science.gov (United States)

    May, Keith A.; Solomon, Joshua A.

    2013-01-01

    In a 2-alternative forced-choice (2AFC) discrimination task, observers choose which of two stimuli has the higher value. The psychometric function for this task gives the probability of a correct response for a given stimulus difference, . This paper proves four theorems about the psychometric function. Assuming the observer applies a transducer and adds noise, Theorem 1 derives a convenient general expression for the psychometric function. Discrimination data are often fitted with a Weibull function. Theorem 2 proves that the Weibull “slope” parameter, , can be approximated by , where is the of the Weibull function that fits best to the cumulative noise distribution, and depends on the transducer. We derive general expressions for and , from which we derive expressions for specific cases. One case that follows naturally from our general analysis is Pelli's finding that, when , . We also consider two limiting cases. Theorem 3 proves that, as sensitivity improves, 2AFC performance will usually approach that for a linear transducer, whatever the actual transducer; we show that this does not apply at signal levels where the transducer gradient is zero, which explains why it does not apply to contrast detection. Theorem 4 proves that, when the exponent of a power-function transducer approaches zero, 2AFC performance approaches that of a logarithmic transducer. We show that the power-function exponents of 0.4–0.5 fitted to suprathreshold contrast discrimination data are close enough to zero for the fitted psychometric function to be practically indistinguishable from that of a log transducer. Finally, Weibull reflects the shape of the noise distribution, and we used our results to assess the recent claim that internal noise has higher kurtosis than a Gaussian. Our analysis of for contrast discrimination suggests that, if internal noise is stimulus-independent, it has lower kurtosis than a Gaussian. PMID:24124456

  4. Rasch Validation of a Measure of Reform-Oriented Science Teaching Practices

    Science.gov (United States)

    You, Hye Sun

    2016-06-01

    Growing evidence from recent curriculum documents and previous research suggests that reform-oriented science teaching practices promote students' conceptual understanding, levels of achievement, and motivation to learn, especially when students are actively engaged in constructing their ideas through scientific inquiries. However, it is difficult to identify to what extent science teachers engage students in reform-oriented teaching practices (RTPs) in their science classrooms. In order to exactly diagnose the current status of science teachers' implementation of the RTPs, a valid and reliable instrument tool is needed. The principles of validity and reliability are fundamental cornerstones in developing a robust measurement tool. As such, this study was motivated by the desire to point out the limitations of the existing statistical and psychometric analyses and to further examine the validation of the RTP survey instrument. This paper thus aims at calibrating the items of the RTPs for science teachers using the Rasch model. The survey instrument scale was adapted from the 2012 National Survey of Science and Mathematics Education (NSSME) data. A total of 3701 science teachers from 1403 schools from across the USA participated in the NSSME survey. After calibrating the RTP items and persons on the same scale, the RTP instrument well represented the population of US science teachers. Model-data fit determined by Infit and Outfit statistics was within an appropriate range (0.5-1.5), supporting the unidimensional structure of the RTPs. The ordered category thresholds and the probability of the thresholds showed that the five-point rating scale functioned well. The results of this study support the use of the RTP measure from the 2012 NSSME in assessing usage of RTPs.

  5. Factor structure and item level psychometrics of the Social Problem Solving Inventory-Revised: Short Form in traumatic brain injury.

    Science.gov (United States)

    Li, Chih-Ying; Waid-Ebbs, Julia; Velozo, Craig A; Heaton, Shelley C

    2016-01-01

    Social problem-solving deficits characterise individuals with traumatic brain injury (TBI), and poor social problem solving interferes with daily functioning and productive lifestyles. Therefore, it is of vital importance to use the appropriate instrument to identify deficits in social problem solving for individuals with TBI. This study investigates factor structure and item-level psychometrics of the Social Problem Solving Inventory-Revised: Short Form (SPSI-R:S), for adults with moderate and severe TBI. Secondary analysis of 90 adults with moderate and severe TBI who completed the SPSI-R:S was performed. An exploratory factor analysis (EFA), principal components analysis (PCA) and Rasch analysis examined the factor structure and item-level psychometrics of the SPSI-R:S. The EFA showed three dominant factors, with positively worded items represented as the most definite factor. The other two factors are negative problem-solving orientation and skills; and negative problem-solving emotion. Rasch analyses confirmed the three factors are each unidimensional constructs. It was concluded that the total score interpretability of the SPSI-R:S may be challenging due to the multidimensional structure of the total measure. Instead, we propose using three separate SPSI-R:S subscores to measure social problem solving for the TBI population.

  6. On the Existence and Uniqueness of Maximum-Likelihood Estimates in the Rasch Model.

    Science.gov (United States)

    Fischer, Gerhard H.

    1981-01-01

    Necessary and sufficient conditions for the existence and uniqueness of a solution of the so-called "unconditional" and the "conditional" maximum-likelihood estimation equations in the dichotomous Rasch model are given. It is shown how to apply the results in practical uses of the Rasch model. (Author/JKS)

  7. Rasch Analysis of the Developmental Test of Visual-Motor Integration in Children with Intellectual Disabilities

    Science.gov (United States)

    Wuang, Yee-Pay; Su, Chwen-Yng

    2009-01-01

    The purpose of this study was to examine the measurement properties of the Developmental Test of Visual-Motor Integration (VMI) in children with intellectual disabilities (ID) ages 4-12 years using the dichotomous Rasch model. The VMI was administered individually to 454 children with ID. Rasch analysis was applied to investigate…

  8. The Rasch-built Pompe-specific activity (R-PAct) scale.

    NARCIS (Netherlands)

    N.A.M.E. van der Beek (Nadine); M.L.C. Hagemans (Marloes); A.T. van der Ploeg (Ans); P.A. van Doorn (Pieter); I.S.J. Merkies (Ingemar)

    2013-01-01

    textabstractWe constructed a patient-based interval scale using Rasch analysis, specifically suited to quantify the effects of Pompe disease on patient's ability to carry out daily life activities and their social participation: Rasch-built Pompe-specific Activity scale. Between July 2005 and April

  9. Estimating quasi-loglinear models for a Rasch table if the numbers of items is large

    NARCIS (Netherlands)

    Kelderman, Henk

    1987-01-01

    The Rasch Model and various extensions of this model can be formulated as a quasi loglinear model for the incomplete subgroup x score x item response 1 x ... x item response k contingency table. By comparing various loglinear models, specific deviations of the Rasch model can be tested. Parameter es

  10. Rasch Analysis of the Developmental Test of Visual-Motor Integration in Children with Intellectual Disabilities

    Science.gov (United States)

    Wuang, Yee-Pay; Su, Chwen-Yng

    2009-01-01

    The purpose of this study was to examine the measurement properties of the Developmental Test of Visual-Motor Integration (VMI) in children with intellectual disabilities (ID) ages 4-12 years using the dichotomous Rasch model. The VMI was administered individually to 454 children with ID. Rasch analysis was applied to investigate…

  11. On Applications of Rasch Models in International Comparative Large-Scale Assessments: A Historical Review

    Science.gov (United States)

    Wendt, Heike; Bos, Wilfried; Goy, Martin

    2011-01-01

    Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…

  12. Exploring students’ perceived and actual ability in solving statistical problems based on Rasch measurement tools

    Science.gov (United States)

    Azila Che Musa, Nor; Mahmud, Zamalia; Baharun, Norhayati

    2017-09-01

    One of the important skills that is required from any student who are learning statistics is knowing how to solve statistical problems correctly using appropriate statistical methods. This will enable them to arrive at a conclusion and make a significant contribution and decision for the society. In this study, a group of 22 students majoring in statistics at UiTM Shah Alam were given problems relating to topics on testing of hypothesis which require them to solve the problems using confidence interval, traditional and p-value approach. Hypothesis testing is one of the techniques used in solving real problems and it is listed as one of the difficult concepts for students to grasp. The objectives of this study is to explore students’ perceived and actual ability in solving statistical problems and to determine which item in statistical problem solving that students find difficult to grasp. Students’ perceived and actual ability were measured based on the instruments developed from the respective topics. Rasch measurement tools such as Wright map and item measures for fit statistics were used to accomplish the objectives. Data were collected and analysed using Winsteps 3.90 software which is developed based on the Rasch measurement model. The results showed that students’ perceived themselves as moderately competent in solving the statistical problems using confidence interval and p-value approach even though their actual performance showed otherwise. Item measures for fit statistics also showed that the maximum estimated measures were found on two problems. These measures indicate that none of the students have attempted these problems correctly due to reasons which include their lack of understanding in confidence interval and probability values.

  13. Self-rating of daily time management in children: psychometric properties of the Time-S.

    Science.gov (United States)

    Sköld, Annika; Janeslätt, Gunnel Kristina

    2017-05-01

    Impaired ability to manage time has been shown in several diagnoses common in childhood. Impaired ability involves activities and participation domain (daily time management, DTM) and body function and structure domain (time-processing ability, TPA). DTM needs to be evaluated from an individual's own perspective. To date, there has been a lack of self-rating instruments for children that focus on DTM. The aim of this study is to describe psychometric properties of Time-S when used in children aged 10-17 years with a diagnosis of ADHD, Autism, CP or mild ID. Further, to test whether TPA correlates with self-rated DTM. Eighty-three children aged 10-17 years participated in the study. Rasch analysis was used to assess psychometric properties. Correlation analysis was performed between Time-S and a measure of TPA. The 21 items of the Time-S questionnaire fit into a unitary construct measuring self-perceived daily management of an individual's time. A non-significant, small correlation was found between TPA and DTM. The results indicate good psychometric properties for the questionnaire. The questionnaire is potentially useful in intervention planning and evaluation.

  14. Development and psychometric properties of a health knowledge test on six chronic conditions.

    Science.gov (United States)

    Gellert, Paul; Detel, Sibylle; Ernsting, Clemens; Oedekoven, Monika; Kuhlmey, Adelheid

    2016-12-01

    The aim of this study was to develop and test the psychometric properties of a health knowledge test on common chronic conditions in the general population. Operationalization based on a facet design led to 108 knowledge items on six conditions: cardiovascular disease, cancer, respiratory diseases, musculoskeletal system conditions, depression, and chronic pain. We refined the items (qualitative study 1; N=20) and selected the items by applying a mixed Rasch model (study 2; N=861). The psychometric properties (Study 3; N=4144) of the remaining 24 items were tested using exploratory (split sample N=2110) and confirmatory factor analyses (split sample N=2034). 108 items were refined within study 1, 24 of which were selected in study 2. In study 3, a general health knowledge factor was confirmed based on six subscales on specific conditions. Convergent validity was confirmed by the overlap of health knowledge with education and perceived health knowledge. The development and evaluation of the psychometric properties of a health knowledge test on six common conditions will improve future research on health knowledge. Chronic conditions present a challenge; assessing the level of health knowledge is the first step to prevent and to cope with these conditions. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  15. Escala fatorial de socialização: versão reduzida: seleção de itens e propriedades psicométricas Agreeableness scale: short version: item selection and psychometric properties

    Directory of Open Access Journals (Sweden)

    Maiana Farias Oliveira Nunes

    2010-01-01

    Full Text Available O objetivo desse estudo foi selecionar itens da Escala Fatorial de Socialização (EFS para a obtenção de uma versão reduzida, que mantivesse propriedades psicométricas adequadas. Baseou-se em uma amostra de 1.100 sujeitos. Para a seleção de itens, realizou-se análise qualitativa, buscando aqueles sem conteúdo clínico explícito e uma análise quantitativa, pelo modelo de Rasch. Tais critérios permitiram reduzir a EFS de 70 para 28 itens. As características psicométricas da versão reduzida foram verificadas pela comparação entre versões por Rasch e pela reanálise dos dados de estudos de validade realizados com a EFS. A versão reduzida manteve características psicométricas adequadas, o que sugere a possibilidade de utilização dessa versão da EFS em situações de avaliação com tempo restrito.This study aimed at selecting items from the Agreeableness Factor Scale for obtaining a short version of this test that could keep adequate psychometric properties. One thousand one hundred participants composed the sample. Items were selected using a qualitative strategy, which focused on item content that was not related to clinical descriptions and a quantitative analysis based on Rasch's model. The scale was reduced from 70 to 28 items, based on these criteria. In order to check the psychometric properties of the short version, both versions were compared by Rasch indices and by reanalyzing validity studies conducted with the original scale. The short version kept good psychometric properties, which suggests the possibility of using it when there is time restriction.

  16. Rasch Measurement Analysis of a 25-Item Version of the Mueller/McCloskey Nurse Job Satisfaction Scale in a Sample of Nurses in Lebanon and Qatar

    Directory of Open Access Journals (Sweden)

    Michael Clinton

    2015-06-01

    Full Text Available The Mueller/McCloskey Nurse Job Satisfaction Scale (MMSS is widely used, but its psychometric characteristics have not been sufficiently validated for use in Middle Eastern countries. The objective of our methodological study was to determine the psychometric suitability of a 25-item version of the MMSS (MMSS-25 for use in middle-income and high-income Middle Eastern countries. A total of 1,322 registered nurses, 859 in Lebanon and 463 in Qatar, completed the MMSS-25 as part of a cross-sectional multinational investigation of nursing shortages in the region. We used the Rasch rating scale model to investigate the psychometric performance of the MMSS-25. We identified possible item bias among MMSS-25 items. We conducted confirmatory factor analyses (CFA to compare the fit to our data of five factor structures reported in the literature. We concluded that irrespective of administration in English or Arabic, the MMSS-25 is not sufficiently productive of measurement for use in the region. A core set of 13 items (MMSS-13, Cronbach’s α = .82 loading on five dimensions eliminates redundant MMSS items and is suitable for initial screening of nurses’ satisfaction. Of the five factor structures we examined, the MMSS-13 was the only close fit to our data (comparative fit index = 0.951; Tucker–Lewis index = 0.931; root mean square error of approximation = 0.051; p value = .401. The MMSS-13 has psychometric characteristics superior to MMSS-25, but additional items are required to meet the research-specific objectives of future studies of nurses’ job satisfaction in Middle Eastern countries.

  17. Development and psychometric analysis of the student-teacher relationship scale - short form.

    Science.gov (United States)

    Settanni, Michele; Longobardi, Claudio; Sclavo, Erica; Fraire, Michela; Prino, Laura E

    2015-01-01

    The purpose of this study is the construction and validation of an Italian Short Form version of the Student-Teacher Relationship Scale (STRS; Fraire et al., 2013). The analyses were conducted on 1256 students and 210 teachers. The STRS is a self-report measure assessing teachers' perception of the quality of their relationship with students ranging from preschool to third grade. The items were selected from the original Italian adaptation of the regular STRS (Pianta, 2001) through Rasch (1960/1980) analysis, which allowed us to identify a subset of items with proven psychometric properties. The STRS-SF consists of two subscales: Conflict (eight items) and Closeness (six items). Results indicate that the 14-item instrument shows good internal consistency (α>0.80), high correlations with the scales from the regular STRS (r > 0.90) and equivalence across gender.

  18. Development and Psychometric Analysis of the Student-Teacher Relationship Scale - Short Form

    Directory of Open Access Journals (Sweden)

    Michele eSettanni

    2015-06-01

    Full Text Available The purpose of this study is the construction and validation of an Italian Short Form version of the Student-Teacher Relationship Scale (Pianta 2001; STRS-SF in the Italian educational setting for 1256 Students and 210 teachers. The STRS-SF is a self-report measure assessing teacher perceptions of the quality of their relationship with students from grade 3 to grade 8. The items were selected from the original Italian adaptation of the regular STRS through Rasch analysis, which allowed us to identify a subset of items with proven psychometric properties. The STRS-SF consists of two subscales: Conflict (8 items and Closeness (6 items. Results indicate that the 14-item short form can be used as a viable substitute for the regular STRS.

  19. Persian adaptation of Foreign Language Reading Anxiety Scale: a psychometric analysis.

    Science.gov (United States)

    Baghaei, Purya; Hohensinn, Christine; Kubinger, Klaus D

    2014-04-01

    The validity and psychometric properties of a new Persian adaptation of the Foreign Language Reading Anxiety Scale were investigated. The scale was translated into Persian and administered to 160 undergraduate students (131 women, 29 men; M age = 23.4 yr., SD = 4.3). Rasch model analysis on the scale's original 20 items revealed that the data do not fit the partial credit model. Principal components analysis identified three factors: one related to feelings of anxiety about reading, the second reflected the reverse-worded items, and the third related to general ideas about reading in a foreign language. In a re-analysis, the 12 items that loaded on the first factor showed a good fit with the partial credit model.

  20. Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study.

    Science.gov (United States)

    Pinkham, Amy E; Penn, David L; Green, Michael F; Harvey, Philip D

    2016-03-01

    Measurement of social cognition in treatment trials remains problematic due to poor and limited psychometric data for many tasks. As part of the Social Cognition Psychometric Evaluation (SCOPE) study, the psychometric properties of 8 tasks were assessed. One hundred and seventy-nine stable outpatients with schizophrenia and 104 healthy controls completed the battery at baseline and a 2-4-week retest period at 2 sites. Tasks included the Ambiguous Intentions Hostility Questionnaire (AIHQ), Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Relationships Across Domains (RAD), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, and Trustworthiness Task. Tasks were evaluated on: (i) test-retest reliability, (ii) utility as a repeated measure, (iii) relationship to functional outcome, (iv) practicality and tolerability, (v) sensitivity to group differences, and (vi) internal consistency. The BLERT and Hinting task showed the strongest psychometric properties across all evaluation criteria and are recommended for use in clinical trials. The ER-40, Eyes Task, and TASIT showed somewhat weaker psychometric properties and require further study. The AIHQ, RAD, and Trustworthiness Task showed poorer psychometric properties that suggest caution for their use in clinical trials. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

  1. Investigating the application of Rasch theory in measuring change in middle school student performance in physical science

    Science.gov (United States)

    Cunningham, Jessica D.

    Newton's Universe (NU), an innovative teacher training program, strives to obtain measures from rural, middle school science teachers and their students to determine the impact of its distance learning course on understanding of temperature. No consensus exists on the most appropriate and useful method of analysis to measure change in psychological constructs over time. Several item response theory (IRT) models have been deemed useful in measuring change, which makes the choice of an IRT model not obvious. The appropriateness and utility of each model, including a comparison to a traditional analysis of variance approach, was investigated using middle school science student performance on an assessment over an instructional period. Predetermined criteria were outlined to guide model selection based on several factors including research questions, data properties, and meaningful interpretations to determine the most appropriate model for this study. All methods employed in this study reiterated one common interpretation of the data -- specifically, that the students of teachers with any NU course experience had significantly greater gains in performance over the instructional period. However, clear distinctions were made between an analysis of variance and the racked and stacked analysis using the Rasch model. Although limited research exists examining the usefulness of the Rasch model in measuring change in understanding over time, this study applied these methods and detailed plausible implications for data-driven decisions based upon results for NU and others. Being mindful of the advantages and usefulness of each method of analysis may help others make informed decisions about choosing an appropriate model to depict changes to evaluate other programs. Results may encourage other researchers to consider the meaningfulness of using IRT for this purpose. Results have implications for data-driven decisions for future professional development courses, in science

  2. Using the Rasch model to develop a measure of second language learners' willingness to communicate within a language classroom.

    Science.gov (United States)

    Weaver, Christopher

    2005-01-01

    The purpose of this investigation was to use Rasch measurement to study the psychometric properties of a 34 item questionnaire designed to measure second language learners' willingness to communicate (WTC) in English inside their language class. 490 Japanese university students' responses to the questionnaire were subjected to a number of different analyses. The first involved a comparison of the category threshold estimates produced by the Rating Scale and Partial Credit models. The questionnaire's items were then evaluated according to how well they defined the willingness to communicate construct. The potential dimensionality of using items that involved different speaking and writing tasks/situations in order to gain a more comprehensive understanding of students' willingness to communicate was also investigated. Next there was an examination of the questionnaire's four-point scale to ensure that it captured meaningful differences in students' WTC. Finally, the questionnaire items were compared using differential item functioning to determine if second year students were more willing than first year students in any of the different speaking and writing tasks/situations. This investigation closes with some suggestions on how the WTC questionnaire can inform second language instruction and curriculum design.

  3. Rasch model based analysis of the Force Concept Inventory

    Science.gov (United States)

    Planinic, Maja; Ivanjek, Lana; Susac, Ana

    2010-06-01

    The Force Concept Inventory (FCI) is an important diagnostic instrument which is widely used in the field of physics education research. It is therefore very important to evaluate and monitor its functioning using different tools for statistical analysis. One of such tools is the stochastic Rasch model, which enables construction of linear measures for persons and items from raw test scores and which can provide important insight in the structure and functioning of the test (how item difficulties are distributed within the test, how well the items fit the model, and how well the items work together to define the underlying construct). The data for the Rasch analysis come from the large-scale research conducted in 2006-07, which investigated Croatian high school students’ conceptual understanding of mechanics on a representative sample of 1676 students (age 17-18 years). The instrument used in research was the FCI. The average FCI score for the whole sample was found to be (27.7±0.4)% , indicating that most of the students were still non-Newtonians at the end of high school, despite the fact that physics is a compulsory subject in Croatian schools. The large set of obtained data was analyzed with the Rasch measurement computer software WINSTEPS 3.66. Since the FCI is routinely used as pretest and post-test on two very different types of population (non-Newtonian and predominantly Newtonian), an additional predominantly Newtonian sample ( N=141 , average FCI score of 64.5%) of first year students enrolled in introductory physics course at University of Zagreb was also analyzed. The Rasch model based analysis suggests that the FCI has succeeded in defining a sufficiently unidimensional construct for each population. The analysis of fit of data to the model found no grossly misfitting items which would degrade measurement. Some items with larger misfit and items with significantly different difficulties in the two samples of students do require further examination

  4. Measuring heterosexual LGBT ally development: a Rasch analysis.

    Science.gov (United States)

    Ji, Peter; Fujimoto, Ken

    2013-01-01

    An instrument was developed that measured heterosexual persons' level of lesbian, gay, bisexual, and transgender (LGBT) ally identity. Using a Rasch analysis, 2 dimensions were observed: (a) internal and interpersonal and (b) activity. Persons with high levels of LGBT ally identities endorsed items about having LGBT knowledge, attitudes, and skills; having interpersonal experiences with LGBT communities; and including LGBT ally as part of their identities. The instrument met criteria for the content, substantive, structural, generalizability, and responsiveness validity. The instrument can be used to assist persons to develop their abilities to support and advocate for equality for LGBT communities.

  5. Application of the Rasch model in measuring personality disorders

    OpenAIRE

    Lucas de Francisco Carvalho; Ricardo Primi; Gregory J. Meyer

    2012-01-01

    OBJECTIVE: To describe item and person parameters obtained with the Rasch model, one of the item response theory models, in the assessment of personality disorders based on Millon's theory. METHOD: A total of 350 people participated in the study. Age ranged from 18 to 67 years (mean ± standard deviation = 27.02±10.13), and 71.7% of the participants (n = 251) were female. Of the 350 individuals, 21.1% (n = 74) answered affirmatively about being under psychiatric treatment and taking psychiatri...

  6. Rasch model based analysis of the Force Concept Inventory

    Directory of Open Access Journals (Sweden)

    Maja Planinic

    2010-03-01

    Full Text Available The Force Concept Inventory (FCI is an important diagnostic instrument which is widely used in the field of physics education research. It is therefore very important to evaluate and monitor its functioning using different tools for statistical analysis. One of such tools is the stochastic Rasch model, which enables construction of linear measures for persons and items from raw test scores and which can provide important insight in the structure and functioning of the test (how item difficulties are distributed within the test, how well the items fit the model, and how well the items work together to define the underlying construct. The data for the Rasch analysis come from the large-scale research conducted in 2006-07, which investigated Croatian high school students’ conceptual understanding of mechanics on a representative sample of 1676 students (age 17–18 years. The instrument used in research was the FCI. The average FCI score for the whole sample was found to be (27.7±0.4%, indicating that most of the students were still non-Newtonians at the end of high school, despite the fact that physics is a compulsory subject in Croatian schools. The large set of obtained data was analyzed with the Rasch measurement computer software WINSTEPS 3.66. Since the FCI is routinely used as pretest and post-test on two very different types of population (non-Newtonian and predominantly Newtonian, an additional predominantly Newtonian sample (N=141, average FCI score of 64.5% of first year students enrolled in introductory physics course at University of Zagreb was also analyzed. The Rasch model based analysis suggests that the FCI has succeeded in defining a sufficiently unidimensional construct for each population. The analysis of fit of data to the model found no grossly misfitting items which would degrade measurement. Some items with larger misfit and items with significantly different difficulties in the two samples of students do require further

  7. Rasch Analysis of the General Self-Efficacy Scale in Workers with Traumatic Limb Injuries.

    Science.gov (United States)

    Wu, Tzu-Yi; Yu, Wan-Hui; Huang, Chien-Yu; Hou, Wen-Hsuan; Hsieh, Ching-Lin

    2016-09-01

    Purpose The purpose of this study was to apply Rasch analysis to examine the unidimensionality and reliability of the General Self-Efficacy Scale (GSE) in workers with traumatic limb injuries. Furthermore, if the items of the GSE fitted the Rasch model's assumptions, we transformed the raw sum ordinal scores of the GSE into Rasch interval scores. Methods A total of 1076 participants completed the GSE at 1 month post injury. Rasch analysis was used to examine the unidimensionality and person reliability of the GSE. The unidimensionality of the GSE was verified by determining whether the items fit the Rasch model's assumptions: (1) item fit indices: infit and outfit mean square (MNSQ) ranged from 0.6 to 1.4; and (2) the eigenvalue of the first factor extracted from principal component analysis (PCA) for residuals was Rasch scores. Conclusions The results indicated that the items of GSE are unidimensional and have acceptable person reliability in workers with traumatic limb injuries. Additionally, the raw sum scores of the GSE can be transformed into Rasch interval scores for prospective users to quantify workers' levels of self-efficacy and to conduct further statistical analyses.

  8. A log-linear multidimensional Rasch model for capture-recapture.

    Science.gov (United States)

    Pelle, E; Hessen, D J; van der Heijden, P G M

    2016-02-20

    In this paper, a log-linear multidimensional Rasch model is proposed for capture-recapture analysis of registration data. In the model, heterogeneity of capture probabilities is taken into account, and registrations are viewed as dichotomously scored indicators of one or more latent variables that can account for correlations among registrations. It is shown how the probability of a generic capture profile is expressed under the log-linear multidimensional Rasch model and how the parameters of the traditional log-linear model are derived from those of the log-linear multidimensional Rasch model. Finally, an application of the model to neural tube defects data is presented.

  9. CML based estimation of extended Rasch models with the eRm package in R

    Directory of Open Access Journals (Sweden)

    PATRICK MAIR

    2007-03-01

    Full Text Available This paper presents an open source tool for computing extended Rasch models. It is realized in R (R Development Core Team, 2006 and available as package eRm. In addition to ordinary Rasch models extended models such as linear logistic test models, (linear rating scale models and (linear partial credit models can be estimated. A striking feature of this package is the implementation of conditional maximum likelihood estimation techniques which relate directly to Rasch's original concept of specific objectivity. The mathematical and epistemological benefits of this estimation method are discussed. Moreover, the capabilities of the eRm routine with respect to structural item response designs are demonstrated.

  10. Assessing health-related quality of life in hand eczema patients: how to overcome psychometric faults when using the dermatology life quality index.

    Science.gov (United States)

    Ofenloch, Robert F; Diepgen, Thomas L; Weisshaar, Elke; Elsner, Peter; Apfelbacher, Christian J

    2014-11-01

    Health-related quality of life (HRQOL) has become an important patient reported outcome in health service research. The dermatology life quality index (DLQI) is the most commonly used instrument in dermatology. In recent years, the psychometric properties of the DLQI have been a subject of debate as requirements of modern test theory seem not to be fulfilled. The aim of this study was to test whether those violations also occur in patients with hand eczema. We collected data of 602 hand eczema patients who participated in an inpatient dermatology rehabilitation program in Germany. In order to report meaningful scores of the DLQI, data were analysed according to the principles of modern test theory. We calibrated the DLQI using the Rasch model, resulting in a 6 item version with a range between 0-15 points. This version showed no significant misfit to the Rasch model (p>0.14). By using a Rasch analysis the results were evaluated in a second sample of hand eczema patients (n=511). Even if all demographic characteristic of this sample were different, we were able to replicate the results found in this study (p>0.21). In conclusion, we recommend to use an alternative scoring procedure as presented in this article if the DLQI is used in hand eczema patients.

  11. Four theorems on the psychometric function.

    Directory of Open Access Journals (Sweden)

    Keith A May

    Full Text Available In a 2-alternative forced-choice (2AFC discrimination task, observers choose which of two stimuli has the higher value. The psychometric function for this task gives the probability of a correct response for a given stimulus difference, Δx. This paper proves four theorems about the psychometric function. Assuming the observer applies a transducer and adds noise, Theorem 1 derives a convenient general expression for the psychometric function. Discrimination data are often fitted with a Weibull function. Theorem 2 proves that the Weibull "slope" parameter, β, can be approximated by β(Noise x β(Transducer, where β(Noise is the β of the Weibull function that fits best to the cumulative noise distribution, and β(Transducer depends on the transducer. We derive general expressions for β(Noise and β(Transducer, from which we derive expressions for specific cases. One case that follows naturally from our general analysis is Pelli's finding that, when d' ∝ (Δx(b, β ≈ β(Noise x b. We also consider two limiting cases. Theorem 3 proves that, as sensitivity improves, 2AFC performance will usually approach that for a linear transducer, whatever the actual transducer; we show that this does not apply at signal levels where the transducer gradient is zero, which explains why it does not apply to contrast detection. Theorem 4 proves that, when the exponent of a power-function transducer approaches zero, 2AFC performance approaches that of a logarithmic transducer. We show that the power-function exponents of 0.4-0.5 fitted to suprathreshold contrast discrimination data are close enough to zero for the fitted psychometric function to be practically indistinguishable from that of a log transducer. Finally, Weibull β reflects the shape of the noise distribution, and we used our results to assess the recent claim that internal noise has higher kurtosis than a Gaussian. Our analysis of β for contrast discrimination suggests that, if internal noise is

  12. Psychometrics and its discontents: an historical perspective on the discourse of the measurement tradition.

    Science.gov (United States)

    Schoenherr, Jordan Richard; Hamstra, Stanley J

    2016-08-01

    Psychometrics has recently undergone extensive criticism within the medical education literature. The use of quantitative measurement using psychometric instruments such as response scales is thought to emphasize a narrow range of relevant learner skills and competencies. Recent reviews and commentaries suggest that a paradigm shift might be presently underway. We argue for caution, in that the psychometrics approach and the quantitative account of competencies that it reflects is based on a rich discussion regarding measurement and scaling that led to the establishment of this paradigm. Rather than reflecting a homogeneous discipline focused on core competencies devoid of consideration of context, the psychometric community has a history of discourse and debate within the field, with an acknowledgement that the techniques and instruments developed within psychometrics are heuristics that must be used pragmatically.

  13. Psychometric Principles in Measurement for Geoscience Education Research: A Climate Change Example

    Science.gov (United States)

    Libarkin, J. C.; Gold, A. U.; Harris, S. E.; McNeal, K.; Bowles, R.

    2015-12-01

    Understanding learning in geoscience classrooms requires that we use valid and reliable instruments aligned with intended learning outcomes. Nearly one hundred instruments assessing conceptual understanding in undergraduate science and engineering classrooms (often called concept inventories) have been published and are actively being used to investigate learning. The techniques used to develop these instruments vary widely, often with little attention to psychometric principles of measurement. This paper will discuss the importance of using psychometric principles to design, evaluate, and revise research instruments, with particular attention to the validity and reliability steps that must be undertaken to ensure that research instruments are providing meaningful measurement. An example from a climate change inventory developed by the authors will be used to exemplify the importance of validity and reliability, including the value of item response theory for instrument development. A 24-item instrument was developed based on published items, conceptions research, and instructor experience. Rasch analysis of over 1000 responses provided evidence for the removal of 5 items for misfit and one item for potential bias as measured via differential item functioning. The resulting 18-item instrument can be considered a valid and reliable measure based on pre- and post-implementation metrics. Consideration of the relationship between respondent demographics and concept inventory scores provides unique insight into the relationship between gender, religiosity, values and climate change understanding.

  14. Rasch Analysis of the Routines-Based Interview Implementation Checklist

    Science.gov (United States)

    Boavida, Tânia; Akers, Kate; McWilliam, R. A.; Jung, Lee Ann

    2015-01-01

    The Routines-­Based Interview (RBI) is useful for developing functional outcomes/goals, for establishing strong relationships with families, and for assessing the family's true needs. In this study, the authors investigated the psychometric properties of the RBI Implementation Checklist, conducted by 120 early intervention professionals,…

  15. Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

    Directory of Open Access Journals (Sweden)

    Valerija Tadić

    Full Text Available To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL instrument for self-reporting by children with visual impairment (VI.Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV and generic health-related quality of life (HRQoL self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients.Item reduction through piloting (8 items removed for skewness and individual item response pattern and validation (1 item removed for skewness and 3 for misfit in Rasch produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity.Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

  16. Measuring Health-Related Quality of Life in Strabismus: A Modification of the Adult Strabismus-20 (AS-20 Questionnaire Using Rasch Analysis.

    Directory of Open Access Journals (Sweden)

    Vijaya K Gothwal

    Full Text Available To evaluate the psychometric properties of the Adult Strabismus-20 (AS-20- a health-related quality of life (HRQoL questionnaire in adults with strabismus, and if flawed, to revise the AS-20 and its subscales creating valid measurement scales.584 adults (meanage, 27.5 years with strabismus were recruited from an outpatient clinic at a South Indian tertiary eye care centre and were administered the AS-20 questionnaire.The AS-20 was translated and back translated into two Indian languages. The AS-20 and its two 10-item subscales - 'psychosocial' and 'function'were assessed separately for fit to the Rasch model, including an assessment of the rating scale, unidimensionality (by principal components analysis, measurement precision by person separation reliability, PSR, targeting, and differential item functioning (DIF; notable > 1.0 logits.Response categories were not used as intended, thereby, required re-organization and reducing their number from 5 to 3. The AS-20 had adequate measurement precision (PSR = 0.87 but lacked unidimensionality; however, deletion of the six multi-dimensionality causing items and an additional three misfitting items resulted in 11-item unidimensional questionnaire (AS-11. Two items failed to satisfy the model expectations in the 'psychosocial' subscale and were deleted - resulting in an 8-item unidimensional scale with adequate PSR (0.81 and targeting (0.23 logits. One item misfit in the 'function' subscale and was deleted-resulting in a 9 item Rasch-revised unidimensional subscale with acceptable PSR (0.80 and targeting (0.97 logits.None of the items displayed notable DIF by age, gender and level of education.The AS-11 and its two Rasch-revised subscales - 8-item psychosocial and 9-item function subscale may be more appropriate than the original AS-20 and its two 10-item subscales for use as unidimensional measures of HRQoL in adults with strabismus in India. Further work is required to establish the validity of the

  17. Conducting Simulation Studies in Psychometrics

    Science.gov (United States)

    Feinberg, Richard A.; Rubright, Jonathan D.

    2016-01-01

    Simulation studies are fundamental to psychometric discourse and play a crucial role in operational and academic research. Yet, resources for psychometricians interested in conducting simulations are scarce. This Instructional Topics in Educational Measurement Series (ITEMS) module is meant to address this deficiency by providing a comprehensive…

  18. A plea for new psychometric models in educational assessment.

    Science.gov (United States)

    Schuwirth, Lambert W T; van der Vleuten, Cees P M

    2006-04-01

    To describe the weaknesses of the current psychometric approach to assessment as a scientific model. The current psychometric model has played a major role in improving the quality of assessment of medical competence. It is becoming increasingly difficult, however, to apply this model to modern assessment methods. The central assumption in the current model is that medical competence can be subdivided into separate measurable stable and generic traits. This assumption has several far-reaching implications. Perhaps the most important is that it requires a numerical and reductionist approach, and that aspects such as fairness, defensibility and credibility are by necessity mainly translated into reliability and construct validity. These approaches are more and more difficult to align with modern assessment approaches such as mini-CEX, 360-degree feedback and portfolios. This paper describes some of the weaknesses of the psychometric model and aims to open a discussion on a conceptually different statistical approach to quality of assessment. We hope that the discussion opened by this paper will lead to the development of a conceptually different statistical approach to quality of assessment. A probabilistic or Bayesian approach would be worth exploring.

  19. Psychometric analysis of Stöber's social desirability scale (SDS-17): an item response theory perspective.

    Science.gov (United States)

    Tran, Ulrich S; Stieger, Stefan; Voracek, Martin

    2012-12-01

    Stöber's Social Desirability Scale (SDS-17) was examined psychometrically in 5 samples (N=2817) from Austria, Canada, and the U.S.A. Rasch and Mokken scaling analyses attested the SDS-17 is not strictly unidimensional. Age, agreeableness, and conscientiousness were notable positive correlates of SDS-17 scores. There were signs of non-normal score distributions, acquiescence bias, and sex and country differences (higher scores among Austrians than North Americans). Items with higher ratings of social desirability according to previous research were particularly prone to show sex effects. The SDS-17 appears suitable in cross-cultural settings, but may benefit from substituting its true-false response format with a rating-scale format. A formative-indicators view regarding the social desirability construct and the SDS-17 is discussed.

  20. Psychometric Properties of the Multiple Mini-Interview Used for Medical Admissions: Findings from Generalizability and Rasch Analyses

    Science.gov (United States)

    Sebok, Stefanie S.; Luu, King; Klinger, Don A.

    2014-01-01

    The multiple mini-interview (MMI) has become an increasingly popular admissions method for selecting prospective students into professional programs (e.g., medical school). The MMI uses a series of short, labour intensive simulation stations and scenario interviews to more effectively assess applicants' non-cognitive qualities such as…

  1. Exploring the alignment of writing self-efficacy with writing achievement using rasch measurement theory and qualitative methods.

    Science.gov (United States)

    Engelhard, George; Behizadeh, Nadia

    2012-01-01

    Alignment of writing self-efficacy and writing achievement is defined as the congruence between student confidence regarding writing skills (writing self-efficacy) and the actual performance on these writing skills as reflected in teacher grades (achievement). One purpose of this study is to examine the relationship between these two variables. A second purpose is to demonstrate a mixed-methods approach to investigating relationships between affective variables using Rasch measurement and interviews. Participants were eighth grade students (N = 94) from an ethnically and socioeconomically diverse school in the southeastern United States. Our results suggest that students who struggle with the mechanics of writing yet appreciate the expressive capacity of writing, may have higher senses of writing self-efficacy that are not predictive of performance.

  2. Rasch-based high-dimensionality data reduction and class prediction with applications to microarray gene expression data

    CERN Document Server

    Kastrin, Andrej

    2010-01-01

    Class prediction is an important application of microarray gene expression data analysis. The high-dimensionality of microarray data, where number of genes (variables) is very large compared to the number of samples (obser- vations), makes the application of many prediction techniques (e.g., logistic regression, discriminant analysis) difficult. An efficient way to solve this prob- lem is by using dimension reduction statistical techniques. Increasingly used in psychology-related applications, Rasch model (RM) provides an appealing framework for handling high-dimensional microarray data. In this paper, we study the potential of RM-based modeling in dimensionality reduction with binarized microarray gene expression data and investigate its prediction ac- curacy in the context of class prediction using linear discriminant analysis. Two different publicly available microarray data sets are used to illustrate a general framework of the approach. Performance of the proposed method is assessed by re-randomization s...

  3. Obtaining Content Weights for Test Specifications from Job Analysis Task Surveys: An Application of the Many-Facets Rasch Model

    Science.gov (United States)

    Wang, Ning; Stahl, John

    2012-01-01

    This article discusses the use of the Many-Facets Rasch Model, via the FACETS computer program (Linacre, 2006a), to scale job/practice analysis survey data as well as to combine multiple rating scales into single composite weights representing the tasks' relative importance. Results from the Many-Facets Rasch Model are compared with those…

  4. TESTING THE ASSUMPTIONS AND INTERPRETING THE RESULTS OF THE RASCH MODEL USING LOG-LINEAR PROCEDURES IN SPSS

    NARCIS (Netherlands)

    TENVERGERT, E; GILLESPIE, M; KINGMA, J

    This paper shows how to use the log-linear subroutine of SPSS to fit the Rasch model. It also shows how to fit less restrictive models obtained by relaxing specific assumptions of the Rasch model. Conditional maximum likelihood estimation was achieved by including dummy variables for the total

  5. A Cross-Cultural Validation of Stage Development: A Rasch Re-Analysis of Longitudinal Socio-Moral Reasoning Data

    Science.gov (United States)

    Boom, Jan; Wouters, Hans; Keller, Monika

    2007-01-01

    Kohlberg's characterization of moral development as displaying an invariant hierarchical order of structurally consistent stages is losing ground. However, by applying Rasch analysis, Dawson recently gave new interpretation and support to his characterization of stage development. Using Rasch models, we replicated and strengthened her findings in…

  6. An Analysis of Cross Racial Identity Scale Scores Using Classical Test Theory and Rasch Item Response Models

    Science.gov (United States)

    Sussman, Joshua; Beaujean, A. Alexander; Worrell, Frank C.; Watson, Stevie

    2013-01-01

    Item response models (IRMs) were used to analyze Cross Racial Identity Scale (CRIS) scores. Rasch analysis scores were compared with classical test theory (CTT) scores. The partial credit model demonstrated a high goodness of fit and correlations between Rasch and CTT scores ranged from 0.91 to 0.99. CRIS scores are supported by both methods.…

  7. TESTING THE ASSUMPTIONS AND INTERPRETING THE RESULTS OF THE RASCH MODEL USING LOG-LINEAR PROCEDURES IN SPSS

    NARCIS (Netherlands)

    TENVERGERT, E; GILLESPIE, M; KINGMA, J

    1993-01-01

    This paper shows how to use the log-linear subroutine of SPSS to fit the Rasch model. It also shows how to fit less restrictive models obtained by relaxing specific assumptions of the Rasch model. Conditional maximum likelihood estimation was achieved by including dummy variables for the total score

  8. Applying the Many-Facet Rasch Model to Evaluate PowerPoint Presentation Performance in Higher Education

    Science.gov (United States)

    Basturk, Ramazan

    2008-01-01

    This study investigated the usefulness of the many-facet Rasch model (MFRM) in evaluating the quality of performance related to PowerPoint presentations in higher education. The Rasch Model utilizes item response theory stating that the probability of a correct response to a test item/task depends largely on a single parameter, the ability of the…

  9. Using Rasch To Create Measures from Survey Data (or Making a Silk Purse out of a Sow's Ear).

    Science.gov (United States)

    Bode, Rita K.

    This study describes the creation of measures of teachers' use of ability grouping in instruction using Rasch analysis. The dimensionality of the proposed construct was also investigated. Results of the Rasch analysis are compared to the results using composites to illustrate how the description of a construct can vary depending on the method used…

  10. A quantitative confidence signal detection model: 1. Fitting psychometric functions.

    Science.gov (United States)

    Yi, Yongwoo; Merfeld, Daniel M

    2016-04-01

    Perceptual thresholds are commonly assayed in the laboratory and clinic. When precision and accuracy are required, thresholds are quantified by fitting a psychometric function to forced-choice data. The primary shortcoming of this approach is that it typically requires 100 trials or more to yield accurate (i.e., small bias) and precise (i.e., small variance) psychometric parameter estimates. We show that confidence probability judgments combined with a model of confidence can yield psychometric parameter estimates that are markedly more precise and/or markedly more efficient than conventional methods. Specifically, both human data and simulations show that including confidence probability judgments for just 20 trials can yield psychometric parameter estimates that match the precision of those obtained from 100 trials using conventional analyses. Such an efficiency advantage would be especially beneficial for tasks (e.g., taste, smell, and vestibular assays) that require more than a few seconds for each trial, but this potential benefit could accrue for many other tasks. Copyright © 2016 the American Physiological Society.

  11. On the Psychometric Study of Human Life History Strategies.

    Science.gov (United States)

    Richardson, George B; Sanning, Blair K; Lai, Mark H C; Copping, Lee T; Hardesty, Patrick H; Kruger, Daniel J

    2017-01-01

    This article attends to recent discussions of validity in psychometric research on human life history strategy (LHS), provides a constructive critique of the extant literature, and describes strategies for improving construct validity. To place the psychometric study of human LHS on more solid ground, our review indicates that researchers should (a) use approaches to psychometric modeling that are consistent with their philosophies of measurement, (b) confirm the dimensionality of life history indicators, and (c) establish measurement invariance for at least a subset of indicators. Because we see confirming the dimensionality of life history indicators as the next step toward placing the psychometrics of human LHS on more solid ground, we use nationally representative data and structural equation modeling to test the structure of middle adult life history indicators. We found statistically independent mating competition and Super-K dimensions and the effects of parental harshness and childhood unpredictability on Super-K were consistent with past research. However, childhood socioeconomic status had a moderate positive effect on mating competition and no effect on Super-K, while unpredictability did not predict mating competition. We conclude that human LHS is more complex than previously suggested-there does not seem to be a single dimension of human LHS among Western adults and the effects of environmental components seem to vary between mating competition and Super-K.

  12. Rasch analysis of the hospital anxiety and depression scale (hads for use in motor neurone disease

    Directory of Open Access Journals (Sweden)

    Shaw Pamela J

    2011-09-01

    Full Text Available Abstract Background The Hospital Anxiety and Depression Scale (HADS is commonly used to assess symptoms of anxiety and depression in motor neurone disease (MND. The measure has never been specifically validated for use within this population, despite questions raised about the scale's validity. This study seeks to analyse the construct validity of the HADS in MND by fitting its data to the Rasch model. Methods The scale was administered to 298 patients with MND. Scale assessment included model fit, differential item functioning (DIF, unidimensionality, local dependency and category threshold analysis. Results Rasch analyses were carried out on the HADS total score as well as depression and anxiety subscales (HADS-T, D and A respectively. After removing one item from both of the seven item scales, it was possible to produce modified HADS-A and HADS-D scales which fit the Rasch model. An 11-item higher-order HADS-T total scale was found to fit the Rasch model following the removal of one further item. Conclusion Our results suggest that a modified HADS-A and HADS-D are unidimensional, free of DIF and have good fit to the Rasch model in this population. As such they are suitable for use in MND clinics or research. The use of the modified HADS-T as a higher-order measure of psychological distress was supported by our data. Revised cut-off points are given for the modified HADS-A and HADS-D subscales.

  13. The measurement of psychological constructs in people with osteoarthritis of the knee: a psychometric evaluation.

    Science.gov (United States)

    Lincoln, Nadina; Moreton, Bryan; Turner, Katie; Walsh, David

    2017-02-01

    Purpose To examine the measurement properties of measures of psychological constructs in people with knee osteoarthritis. Method Participants with osteoarthritis of the knee completed the beck depression inventory (BDI-II), state-trait anxiety inventory (STAI), arthritis helplessness index (AHI), fatigue severity scale (FSS), coping strategies questionnaire (CSQ), beliefs about pain control questionnaire (BPCQ), illness perceptions questionnaire-revised (IPQ-R), pain self-efficacy questionnaire (PSEQ) at home as part of a set of measures covering different aspects of osteoarthritis pain. The questionnaires were returned by pre-paid envelope. Rasch analysis was used to check the psychometric properties of the scales in people with osteoarthritis. Results The STAI-SF was an acceptable measure of anxiety and the revised FSS an acceptable measure of fatigue, with removal of items 1 and 2. The BDI subscales were acceptable for measuring negative thoughts and behaviours related to depressive symptomatology with some modifications to the scale. The helplessness scale of the AHI was acceptable as a measure of helplessness. The PSEQ was an acceptable measure of self-efficacy and the CSQ as a measure of cognitive coping strategies. The BPCQ and IPQ-R did not fit the Rasch model. Conclusions These findings indicate that questionnaires need to be checked for their ability to measure psychological constructs in the clinical groups to which they will be applied. Implications for Rehabilitation For people with osteoarthritis, the STAI-SF is an acceptable measure of anxiety and the revised FSS an acceptable measure of fatigue with removal of items 1 and 2. The BDI subscales, but not the total score, are acceptable for measuring depressive symptomatology with some modifications to the scoring of the scale. And helplessness can be measured using the Helplessness subscale of the AHI. The PSEQ was an acceptable measure of self-efficacy and cognitive coping strategies can be measured

  14. Early career burnout among Dutch nurses: A process captured in a Rasch model

    Directory of Open Access Journals (Sweden)

    Jan Alexander de Vos

    2016-09-01

    Full Text Available This study investigates burnout among Dutch nursing graduates as a process by testing a sequential-developmental model. A sample of 237 respondents was recruited from a population of Dutch early career nurses. Burnout was measured with the Dutch version of the Maslach Burnout Inventory Human Services Survey (MBI-HSS, Maslach & Jackson, 1981; Schaufeli & van Dierendonck, 2000. First, the dimensionality was tested with confirmatory factor analysis. A resulting one-dimensional model with exhaustion and depersonalisation was then analysed using a Rasch rating scale measurement model. Rasch analysis showed that these data adhered well to a sequential-developmental model. Burnout among early career nurses may be operationalized as a process that starts with fatigue as a result of strain and ends with severe exhaustion and depersonalisation towards patients. Personal accomplishment develops relatively independently. A separate Rasch analysis on the personal accomplishment items revealed a scale with almost similar item locations, resulting in redundant information.

  15. Rasch scaling of the Oswestry Disability Index and the Roland-Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Lauridsen, Henrik Hein; Hartvigsen, Jan

    Title Rasch scaling of the Oswestry Disability Index and the Roland-Morris Disability Index Authors & Affiliations: Henrik Hein Lauridsen1, Jan Hartvigsen1,2 1. Research Unit for Clinical Biomechanics, Institute of Sports Science and Clinical Biomechanics, University of Southern Denmark, Clinical...... on an ordinal scale into interval scaling in addition to optimising the fit of instrument items to the target population. In low back pain research the two most commonly used and well-validated questionnaires to assess functional status in patients with low back pain are the Roland-Morris Disability...... Questionnaire (RMQ) and the Oswestry Disability Index (ODI), however, only few studies have tested these questionnaires using Rasch analysis. This study used Rasch scaling to test the construct validity of the Danish versions of the RMQ (23-item Patrick version) and the ODI (version 2.1a) in a heterogeneous...

  16. Measuring Instrument Constructs of Return Factors for Green Office Building Investments Variables Using Rasch Measurement Model

    Directory of Open Access Journals (Sweden)

    Isa Mona

    2016-01-01

    Full Text Available This paper is a preliminary study on rationalising green office building investments in Malaysia. The aim of this paper is attempt to introduce the application of Rasch measurement model analysis to determine the validity and reliability of each construct in the questionnaire. In achieving this objective, a questionnaire survey was developed consists of 6 sections and a total of 106 responses were received from various investors who own and lease office buildings in Kuala Lumpur. The Rasch Measurement analysis is used to measure the quality control of item constructs in the instrument by measuring the specific objectivity within the same dimension, to reduce ambiguous measures, and a realistic estimation of precision and implicit quality. The Rasch analysis consists of the summary statistics, item unidimensionality and item measures. A result shows the items and respondent (person reliability is at 0.91 and 0.95 respectively.

  17. Measuring Mental Health Recovery: An Application of Rasch Modeling to the Consumer Recovery Measure.

    Science.gov (United States)

    Lusczakoski, Kathryn Kd; Olmos-Gallo, P Antonio; Milnor, William; McKinney, Christopher J

    2016-01-01

    As the need for recovery-oriented outcomes increases, it is critical to understand how numeric recovery scores are developed. In the current article, the modern Rasch modeling techniques were applied to establish numeric scores of consumers' perceptions of recovery. A sample of 1,973 adult consumers at a community-based mental health center (57.5% male; average age of 47 years old) completed the 15-item Consumer Recovery Measure. A confirmatory factor analysis revealed the unidimensional nature of the Consumer Recovery Measure and provided construct validity evidence. The Rasch analysis displayed that the items produced acceptable model fit, reliability, and identified the difficulty of the items. The conclusion emphasizes the value of Rasch modeling regarding the measurement of recovery and its relevance to consumer-derived assessments in the clinical decision-making process.

  18. Psychometric Properties and Structures of Passionate and Companionate Love

    Directory of Open Access Journals (Sweden)

    Victor Karandashev

    2016-06-01

    Full Text Available After many decades of romantic relationship research, there is a new focus on a multidimensional model of love. This empirical study examines the multidimensionality and psychometrics of Passionate and Companionate love, based on an extensive study of 413 participants using Multidimensional Love Scale (MLS. A new statistical approach employed in this study explores the typology and structure of love. The statistical approach included the combination of Two-Step Cluster Analysis of cases and Principle Component Analysis of dimensions while using centered variable scores. The results reveal a typology of love based on its multidimensional structure. Further analysis revealed two main types of love: Passionate and Companionate, both containing several factors allowing for interpretation of their multidimensional structures. The MLS subscales and detailed psychometric analysis measuring specific love dimensions are incorporated to allow further research in other studies.

  19. Is the pain visual analogue scale linear and responsive to change? An exploration using Rasch analysis.

    Directory of Open Access Journals (Sweden)

    Paula Kersten

    Full Text Available OBJECTIVES: Pain visual analogue scales (VAS are commonly used in clinical trials and are often treated as an interval level scale without evidence that this is appropriate. This paper examines the internal construct validity and responsiveness of the pain VAS using Rasch analysis. METHODS: Patients (n = 221, mean age 67, 58% female with chronic stable joint pain (hip 40% or knee 60% of mechanical origin waiting for joint replacement were included. Pain was scored on seven daily VASs. Rasch analysis was used to examine fit to the Rasch model. Responsiveness (Standardized Response Means, SRM was examined on the raw ordinal data and the interval data generated from the Rasch analysis. RESULTS: Baseline pain VAS scores fitted the Rasch model, although 15 aberrant cases impacted on unidimensionality. There was some local dependency between items but this did not significantly affect the person estimates of pain. Daily pain (item difficulty was stable, suggesting that single measures can be used. Overall, the SRMs derived from ordinal data overestimated the true responsiveness by 59%. Changes over time at the lower and higher end of the scale were represented by large jumps in interval equivalent data points; in the middle of the scale the reverse was seen. CONCLUSIONS: The pain VAS is a valid tool for measuring pain at one point in time. However, the pain VAS does not behave linearly and SRMs vary along the trait of pain. Consequently, Minimum Clinically Important Differences using raw data, or change scores in general, are invalid as these will either under- or overestimate true change; raw pain VAS data should not be used as a primary outcome measure or to inform parametric-based Randomised Controlled Trial power calculations in research studies; and Rasch analysis should be used to convert ordinal data to interval data prior to data interpretation.

  20. Developing a Shortened Quality of Life Scale from Persian Version of the WHOQOL-100 Using the Rasch Analysis.

    Directory of Open Access Journals (Sweden)

    Kamran Yazdani

    2015-04-01

    Full Text Available Few studies use modern approaches to develop a quality of life (QOL questionnaire with acceptable construct validity, especially in Iran. Our main objective was to construct a new validated and uni-dimensional questionnaire, based on WHOQOL-100, using the Rasch analysis.In a population-based, cross-sectional study in 2007, 500 Tehran residents aged≥18 were randomly sampled. The Persian version of WHOQOL-100 was used to measure the participants' QOL. After using targeting and person fit analysis, we performed category/threshold ordering, item fit, and differential item functioning analyses, in succession. We used outfit or infit statistics>1.5 and <0.5 for detecting under-fit and overfit items/persons, respectively. We also deleted items with disordered category and/or threshold. Person Separation Index and test reliability were also calculated in the datasets.Male to female ratio was 0.98 and the mean age (SD of participants was 35.1 (12.8 years. Initial analyses showed significant differences in quality of life between age groups (P=0.002, educational levels (P=0.001, and current health status groups (P<0.001. We eliminated 67 persons for under-fitting, 38 items for category and/or threshold disordering, 6 items for under-fitting, and 26 items for item bias. Test reliability for the final 30-item scale was 0.89.We prepared a shortened version of the WHOQOL-100 that is single construct, uni-dimensional and free of item bias or any disordering, according to the Rasch model.

  1. Rasch scaling paranormal belief and experience: structure and semantics of Thalbourne's Australian Sheep-Goat Scale.

    Science.gov (United States)

    Lange, Rense; Thalbourne, Michael A

    2002-12-01

    Research on the relation between demographic variables and paranormal belief remains controversial given the possible semantic distortions introduced by item and test level biases. We illustrate how Rasch scaling can be used to detect such biases and to quantify their effects, using the Australian Sheep-Goal Scale as a substantive example. Based on data from 1.822 respondents, this test was Rasch scalable, reliable, and unbiased at the test level. Consistent with other research in which unbiased measures of paranormal belief were used, extremely weak age and sex effects were found (partial eta2 = .005 and .012, respectively).

  2. %lrasch_mml: A SAS Macro for Marginal Maximum Likelihood Estimation in Longitudinal Polytomous Rasch Models

    Directory of Open Access Journals (Sweden)

    Maja Olsbjerg

    2015-10-01

    Full Text Available Item response theory models are often applied when a number items are used to measure a unidimensional latent variable. Originally proposed and used within educational research, they are also used when focus is on physical functioning or psychological wellbeing. Modern applications often need more general models, typically models for multidimensional latent variables or longitudinal models for repeated measurements. This paper describes a SAS macro that fits two-dimensional polytomous Rasch models using a specification of the model that is sufficiently flexible to accommodate longitudinal Rasch models. The macro estimates item parameters using marginal maximum likelihood estimation. A graphical presentation of item characteristic curves is included.

  3. %lrasch_mml: A SAS Macro for Marginal Maximum Likelihood Estimation in Longitudinal Polytomous Rasch Models

    Directory of Open Access Journals (Sweden)

    Maja Olsbjerg

    2015-10-01

    Full Text Available Item response theory models are often applied when a number items are used to measure a unidimensional latent variable. Originally proposed and used within educational research, they are also used when focus is on physical functioning or psychological wellbeing. Modern applications often need more general models, typically models for multidimensional latent variables or longitudinal models for repeated measurements. This paper describes a SAS macro that fits two-dimensional polytomous Rasch models using a specification of the model that is sufficiently flexible to accommodate longitudinal Rasch models. The macro estimates item parameters using marginal maximum likelihood estimation. A graphical presentation of item characteristic curves is included.

  4. Validating the European Health Literacy Survey Questionnaire in people with type 2 diabetes: Latent trait analyses applying multidimensional Rasch modelling and confirmatory factor analysis.

    Science.gov (United States)

    Finbråten, Hanne Søberg; Pettersen, Kjell Sverre; Wilde-Larsson, Bodil; Nordström, Gun; Trollvik, Anne; Guttersrud, Øystein

    2017-11-01

    To validate the European Health Literacy Survey Questionnaire (HLS-EU-Q47) in people with type 2 diabetes mellitus. The HLS-EU-Q47 latent variable is outlined in a framework with four cognitive domains integrated in three health domains, implying 12 theoretically defined subscales. Valid and reliable health literacy measurers are crucial to effectively adapt health communication and education to individuals and groups of patients. Cross-sectional study applying confirmatory latent trait analyses. Using a paper-and-pencil self-administered approach, 388 adults responded in March 2015. The data were analysed using the Rasch methodology and confirmatory factor analysis. Response violation (response dependency) and trait violation (multidimensionality) of local independence were identified. Fitting the "multidimensional random coefficients multinomial logit" model, 1-, 3- and 12-dimensional Rasch models were applied and compared. Poor model fit and differential item functioning were present in some items, and several subscales suffered from poor targeting and low reliability. Despite multidimensional data, we did not observe any unordered response categories. Interpreting the domains as distinct but related latent dimensions, the data fit a 12-dimensional Rasch model and a 12-factor confirmatory factor model best. Therefore, the analyses did not support the estimation of one overall "health literacy score." To support the plausibility of claims based on the HLS-EU score(s), we suggest: removing the health care aspect to reduce the magnitude of multidimensionality; rejecting redundant items to avoid response dependency; adding "harder" items and applying a six-point rating scale to improve subscale targeting and reliability; and revising items to improve model fit and avoid bias owing to person factors. © 2017 John Wiley & Sons Ltd.

  5. Evaluation of the psychometric properties of the Nighttime Symptoms of COPD Instrument

    Directory of Open Access Journals (Sweden)

    Mocarski M

    2015-03-01

    Full Text Available Michelle Mocarski,1 Erica Zaiser,2 Dylan Trundell,2 Barry J Make,3 Asha Hareendran21Forest Research Institute, Inc., an affiliate of Actavis, Inc., Jersey City, NJ, USA; 2Evidera, London, UK; 3National Jewish Health, Denver, CO, USA Background: Nighttime symptoms can negatively impact the quality of life of patients with chronic obstructive pulmonary disease (COPD. The Nighttime Symptoms of COPD Instrument (NiSCI was designed to measure the occurrence and severity of nighttime symptoms in patients with COPD, the impact of symptoms on nighttime awakenings, and rescue medication use. The objective of this study was to explore item reduction, inform scoring recommendations, and evaluate the psychometric properties of the NiSCI.Methods: COPD patients participating in a Phase III clinical trial completed the NiSCI daily. Item analyses were conducted using weekly mean and single day scores. Descriptive statistics (including percentage of respondents at floor/ceiling and inter-item correlations, factor analyses, and Rasch model analyses were conducted to examine item performance and scoring. Test–retest reliability was assessed for the final instrument using the intraclass correlation coefficient (ICC. Correlations with assessments conducted during study visits were used to evaluate convergent and known-groups validity.Results: Data from 1,663 COPD patients aged 40–93 years were analyzed. Item analyses supported the generation of four scores. A one-factor structure was confirmed with factor analysis and Rasch analysis for the symptom severity score. Test–retest reliability was confirmed for the six-item symptom severity (ICC, 0.85, number of nighttime awakenings (ICC, 0.82, and rescue medication (ICC, 0.68 scores. Convergent validity was supported by significant correlations between the NiSCI, St George’s Respiratory Questionnaire, and Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Respiratory Symptoms scores.Conclusion: The

  6. A psychometric validation analysis of Eysenck’s Neuroticism and Extraversion Scales in a sample of first time depressed patients

    DEFF Research Database (Denmark)

    Møller, Stine Bjerrum; Bech, Per; Kessing, Lars Vedel

    2015-01-01

    Eysenck and Eysenck identified the two-factor structure of personality, namely neuroticism and extraversion which has been widely used in clinical psychiatry, and generated much research on the psychometric properties of the scales. Using a classical psychometric approach the neuroticism...... and extraversion scales have shown robust psychometric properties. The present study used both classical psychometric and item response theory (IRT) analyses to evaluate the neuroticism and extraversion scales and improve scalability of the instrument neuroticism and extraversion. A first time depressed sample...... symptoms related to interpersonal sensitivity were identified. For the extraversion scale a shorter and psychometrically more robust version was identified together with a short introversion scale. Clinically discriminant validity was analysed using correlations. The correlation between depression (Ham...

  7. Loosening Psychometric Constraints on Educational Assessments

    Science.gov (United States)

    Kane, Michael T.

    2017-01-01

    In response to an argument by Baird, Andrich, Hopfenbeck and Stobart (2017), Michael Kane states that there needs to be a better fit between educational assessment and learning theory. In line with this goal, Kane will examine how psychometric constraints might be loosened by relaxing some psychometric "rules" in some assessment…

  8. Psychometric Properties of IRT Proficiency Estimates

    Science.gov (United States)

    Kolen, Michael J.; Tong, Ye

    2010-01-01

    Psychometric properties of item response theory proficiency estimates are considered in this paper. Proficiency estimators based on summed scores and pattern scores include non-Bayes maximum likelihood and test characteristic curve estimators and Bayesian estimators. The psychometric properties investigated include reliability, conditional…

  9. Psychometric Evaluation of the Service-Learning in Nursing Inventory.

    Science.gov (United States)

    Nickitas, Donna M; Fealy, Gerard M; De Natale, Mary L

    The aim was to develop an instrument to assess undergraduate nursing students' experience of service-learning to reveal benefits and identify service-learning as a professional value that leads to civic and social responsibility. Service-learning is a teaching and learning approach that integrates academic learning with experiential community-centered foci. It provides structured opportunities for reflection on broader social and cultural dimensions of health. There is no valid and reliable instrument to measure service-learning experience of nursing students. A psychometric evaluation was conducted through item analysis, validity, and reliability. Face validity agreement was 80 percent; the content validity index was adjusted until 1 was achieved for each item. Two factors explained 58.64 percent of the total variance. Cronbach's α was .940 for the skills subscale and .932 for the personal insight subscale. The inventory demonstrated strong psychometric properties. Future research should focus on replication on diverse populations.

  10. Rasch analysis of the Developmental Test of Visual-Motor Integration in children with intellectual disabilities.

    Science.gov (United States)

    Wuang, Yee-Pay; Su, Chwen-Yng

    2009-01-01

    The purpose of this study was to examine the measurement properties of the Developmental Test of Visual-Motor Integration (VMI) in children with intellectual disabilities (ID) ages 4-12 years using the dichotomous Rasch model. The VMI was administered individually to 454 children with ID. Rasch analysis was applied to investigate unidimensionality, item fit to the model, differential item functioning (DIF), and item targeting. Discriminative validity was obtained by receiver operating characteristic (ROC) curve analysis. Items were eliminated if the task was too easy or too difficult, or showed misfit to the Rasch model. The remaining items fitted the unidimensional construct the test was intended to measure and were free of DIF. The Rasch reduced version of the VMI with 9 items appeared to be suited to measure mild degrees of perceptual-motor impairment and demonstrated excellent reliability (0.91). VMI-9 had a larger area under the ROC curve in its ability to differentiate mild versus moderate to severe ID compared with the original version. Taken together, the VMI-9 provides a quick, reliable and valid measure for screening and identifying perceptual-motor deficits in children with ID.

  11. Using Rasch Analysis to Explore What Students Learn about Probability Concepts

    Science.gov (United States)

    Mahmud, Zamalia; Porter, Anne

    2015-01-01

    Students' understanding of probability concepts have been investigated from various different perspectives. This study was set out to investigate perceived understanding of probability concepts of forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW. Rasch measurement which is…

  12. The Rasch Model and Missing Data, with an Emphasis on Tailoring Test Items.

    Science.gov (United States)

    de Gruijter, Dato N. M.

    Many applications of educational testing have a missing data aspect (MDA). This MDA is perhaps most pronounced in item banking, where each examinee responds to a different subtest of items from a large item pool and where both person and item parameter estimates are needed. The Rasch model is emphasized, and its non-parametric counterpart (the…

  13. Quantifying Local, Response Dependence between Two Polytomous Items Using the Rasch Model

    Science.gov (United States)

    Andrich, David; Humphry, Stephen M.; Marais, Ida

    2012-01-01

    Models of modern test theory imply statistical independence among responses, generally referred to as "local independence." One violation of local independence occurs when the response to one item governs the response to a subsequent item. Expanding on a formulation of this kind of violation as a process in the dichotomous Rasch model,…

  14. Using the Mixture Rasch Model to Explore Knowledge Resources Students Invoke in Mathematic and Science Assessments

    Science.gov (United States)

    Zhang, Danhui; Orrill, Chandra; Campbell, Todd

    2015-01-01

    The purpose of this study was to investigate whether mixture Rasch models followed by qualitative item-by-item analysis of selected Programme for International Student Assessment (PISA) mathematics and science items offered insight into knowledge students invoke in mathematics and science separately and combined. The researchers administered an…

  15. Historical Views of Invariance: Evidence from the Measurement Theories of Thorndike, Thurstone, and Rasch.

    Science.gov (United States)

    Engelhard, George, Jr.

    1992-01-01

    A historical perspective is provided of the concept of invariance in measurement theory, describing sample-invariant item calibration and item-invariant measurement of individuals. Invariance as a key measurement concept is illustrated through the measurement theories of E. L. Thorndike, L. L. Thurstone, and G. Rasch. (SLD)

  16. A Commentary on "Historical Perspectives on Invariant Measurement: Guttman, Rasch, and Mokken"

    Science.gov (United States)

    De Ayala, R. J.

    2008-01-01

    In "Historical perspectives on invariant measurement: Guttman, Rasch, and Mokken," Engelhard (2008) discusses one of the keystones of modern measurement, measurement invariance (cf. Thurstone, 1928), and traces its evolution through the work of three principal measurement theorists. Although these scholars span both parametric and nonparametric…

  17. Dimensionality of an Early Childhood Scale Using Rasch Analysis and Confirmatory Factor Analysis.

    Science.gov (United States)

    Banerji, Madhabi; Smith, Richard M.; Dedrick, Robert F.

    1997-01-01

    This paper explores the use of Rasch analysis and linear confirmatory factor analysis to investigate the dimensionality of an early childhood test, the Gesell School Readiness Screening Test (F. Ilg and others, 1978). Discusses empirical analyses of results from 523 kindergarten students using both methods. (SLD)

  18. An Application of the Rasch Measurement Theory to an Assessment of Geometric Thinking Levels

    Science.gov (United States)

    Stols, Gerrit; Long, Caroline; Dunne, Tim

    2015-01-01

    The purpose of this study is to apply the Rasch model to investigate both the Van Hiele theory for geometric development and an associated test. In terms of the test, the objective is to investigate the functioning of a classic 25-item instrument designed to identify levels of geometric proficiency. The dataset of responses by 244 students (106…

  19. On the lack of comonotonicity between likert scores and Rasch-based measures.

    Science.gov (United States)

    Bertoli-Barsotti, Lucio

    2005-01-01

    The Rating Scale Model (RSM) and the Partial Credit Model (PCM) are fairly well-known examples of Rasch models for polytomously scored items. In addition to a number of threshold parameters, both the models contain two scalar parameters characterizing item and person location on a common interval-level scale. The rank order of items and persons defined by the Likert summative scores (i.e. the raw total scores) is compared with that obtained from the Rasch-based measures (i.e. the maximum likelihood estimates of person and item parameters). It is proved that: 1) the property of comonotonicity between Likert summative scores and Rasch-based measures holds for both the person and item parameters of the RSM; 2) the property of comonotonicity between Likert summative scores and Rasch-based measures holds for the PCM only with reference to the person parameters; 3) violations of comonotonicity are possible, for particular datasets, for the item parameters of the PCM.

  20. A Review of Different Estimation Procedures in the Rasch Model. Research Report 87-6.

    Science.gov (United States)

    Engelen, R. J. H.

    A short review of the different estimation procedures that have been used in association with the Rasch model is provided. These procedures include joint, conditional, and marginal maximum likelihood methods; Bayesian methods; minimum chi-square methods; and paired comparison estimation. A comparison of the marginal maximum likelihood estimation…

  1. Assessment of School Performance through a Multilevel Latent Markov Rasch Model

    Science.gov (United States)

    Bartolucci, Francesco; Pennoni, Fulvia; Vittadini, Giorgio

    2011-01-01

    An extension of the latent Markov Rasch model is described for the analysis of binary longitudinal data with covariates when subjects are collected in clusters, such as students clustered in classes. For each subject, a latent process is used to represent the characteristic of interest (e.g., ability) conditional on the effect of the cluster to…

  2. The Rasch Model for Dichotomous Items: Theory, Applications and a Computer Program. No. 63.

    Science.gov (United States)

    Gustafsson, Jan-Eric

    The Rasch model for test analysis is described and compared with two-parameter and three-parameter latent-trait models. Conditional maximum likelihood equations for estimating item parameters are derived, and estimates of person parameters are described together with their confidence intervals. Goodness of fit tests are discussed, including a…

  3. Latent Trait Standardization of the Benzodiazepine Dependence Self-Report Questionnaire using the Rasch Scaling Model

    NARCIS (Netherlands)

    Kan, C.C.; Ven, A.H.G.S. van der; Breteler, M.H.M.; Zitman, F.G.

    2001-01-01

    The aim of the present study was to obtain standardized scores that correspond with the raw scores on the four Rasch scales of the Benzodiazepine Dependence-Self Report Questionnaire (Bendep-SRQ). The eligible normative group for standardization of the Bendep-SRQ scales consisted of 217 general prac

  4. Latent trait standardization of the benzodiazepine dependence self-report questionnaire using the Rasch scaling model.

    NARCIS (Netherlands)

    Kan, C.C.; Ven, A.H.G.S. van der; Breteler, M.H.M.; Zitman, F.G.

    2001-01-01

    The aim of the present study was to obtain standardized scores that correspond with the raw scores on the four Rasch scales of the Benzodiazepine Dependence-Self Report Questionnaire (Bendep-SRQ). The eligible normative group for standardization of the Bendep-SRQ scales consisted of 217 general prac

  5. Georg Rasch and Benjamin Wright's Struggle with the Unidimensional Polytomous Model with Sufficient Statistics

    Science.gov (United States)

    Andrich, David

    2016-01-01

    This article reproduces correspondence between Georg Rasch of The University of Copenhagen and Benjamin Wright of The University of Chicago in the period from January 1966 to July 1967. This correspondence reveals their struggle to operationalize a unidimensional measurement model with sufficient statistics for responses in a set of ordered…

  6. Developing a Rasch Measurement Physical Fitness Scale for Hong Kong Primary School-Aged Students

    Science.gov (United States)

    Yan, Zi; Bond, Trevor G.

    2011-01-01

    The main purpose of this study was to develop a Rasch Measurement Physical Fitness Scale (RMPFS) based on physical fitness indicators routinely used in Hong Kong primary schools. A total of 9,439 records of students' performances on physical fitness indicators, retrieved from the database of a Hong Kong primary school, were used to develop the…

  7. A Rasch Analysis of the Substance Abuse Subtle Screening Inventory-3

    Science.gov (United States)

    Hill, Tara M.; Laux, John M.; Stone, Gregory; Dupuy, Paula; Scott, Holly

    2013-01-01

    Rasch analysis of the Substance Abuse Subtle Screening Inventory-3 (SASSI-3; F. G. Miller & Lazowski, 1999) indicated that the SASSI-3 meets fundamental measurement properties; however, the authors of the current study recommend the elimination of nonfunctioning items and the improvement of response options for the face valid scales to increase…

  8. The Rasch Model: Its Use by the National Board of Medical Examiners.

    Science.gov (United States)

    Kelley, Paul R.; Schumacher, Charles F.

    1984-01-01

    The National Board of Medical Examiners uses the Rasch model to calibrate test items, maintain item banks, equate scores, and monitor the consistency of examiner item response patterns. The model is also being used in the study of patient management problems examinations, standard-setting, and computer-based examinations. (Author/BS)

  9. Surveying Primary Teachers about Compulsory Numeracy Testing: Combining Factor Analysis with Rasch Analysis

    Science.gov (United States)

    Grimbeek, Peter; Nisbet, Steven

    2006-01-01

    This paper reports the use of several quantitative analytic methods, including Rasch analysis, to re-examine teacher responses to questionnaire items probing opinions related to the compulsory numeracy tests conducted in Years 3, 5, and 7 in Queensland, Australia. Nisbet and Grimbeek (2004) previously reported an interpretable and statistically…

  10. An Evaluation of the Environmental Literacy of Preservice Teachers in Turkey through Rasch Analysis

    Science.gov (United States)

    Teksoz, G. Tuncer; Boone, J. W.; Tuzun, O. Yilmaz; Oztekin, C.

    2014-01-01

    The purpose of this study was to make use of proposed definitions of environmental literacy to (1) guide the application of Rasch analysis and (2) utilize the developed instrumentation to further inform the work of environmental educators. A total of 2311 preservice teachers attending Faculty of Education departments of four public universities…

  11. A Rasch Analysis to Determine the Difficulty of the National Senior Certificate Mathematics Examination

    Science.gov (United States)

    Sewry, Joyce; Mokilane, Paul

    2014-01-01

    The National Senior Certificate (NSC) examinations were written for the second time in 2009 amid much criticism. In this study, scripts of candidates who wrote the NSC Mathematics examinations (papers 1 and 2) in 2009 were used as data to analyse the marks scored and then polytomous Rasch analysis was conducted for all the sub-questions to…

  12. A person-fit index for polytomous Rasch models, latent class models, and their mixture generalizations

    NARCIS (Netherlands)

    von Davier, M; Molenaar, IW

    2003-01-01

    A normally distributed person-fit index is proposed for detecting aberrant response patterns in latent class models and mixture distribution IRT models for dichotomous and polytomous data. This article extends previous work on the null distribution of person-fit indices for the dichotomous Rasch mod

  13. Development of Nonword and Irregular Word Lists for Australian Grade 3 Students Using Rasch Analysis

    Science.gov (United States)

    Callinan, Sarah; Cunningham, Everarda; Theiler, Stephen

    2014-01-01

    Many tests used in educational settings to identify learning difficulties endeavour to pick up only the lowest performers. Yet these tests are generally developed within a Classical Test Theory (CTT) paradigm that assumes that data do not have significant skew. Rasch analysis is more tolerant of skew and was used to validate two newly developed…

  14. The Impact of Various Class-Distinction Features on Model Selection in the Mixture Rasch Model

    Science.gov (United States)

    Choi, In-Hee; Paek, Insu; Cho, Sun-Joo

    2017-01-01

    The purpose of the current study is to examine the performance of four information criteria (Akaike's information criterion [AIC], corrected AIC [AICC] Bayesian information criterion [BIC], sample-size adjusted BIC [SABIC]) for detecting the correct number of latent classes in the mixture Rasch model through simulations. The simulation study…

  15. Fitting the Mixed Rasch Model to a Reading Comprehension Test: Identifying Reader Types

    Science.gov (United States)

    Baghaei, Purya; Carstensen, Claus H.

    2013-01-01

    Standard unidimensional Rasch models assume that persons with the same ability parameters are comparable. That is, the same interpretation applies to persons with identical ability estimates as regards the underlying mental processes triggered by the test. However, research in cognitive psychology shows that persons at the same trait level may…

  16. The Rasch model for speed tests and some extensions with applications to incomplete designs

    NARCIS (Netherlands)

    Jansen, MGH

    1997-01-01

    In psychological measurement a distinction can be made between speed and power tests. Although most tests are partially speeded, the speed element is usually neglected. Here, the focus will be on latent trait models for pure speed tests. A particularly simple model has been developed by Rasch for th

  17. Developing a Rasch Measurement Physical Fitness Scale for Hong Kong Primary School-Aged Students

    Science.gov (United States)

    Yan, Zi; Bond, Trevor G.

    2011-01-01

    The main purpose of this study was to develop a Rasch Measurement Physical Fitness Scale (RMPFS) based on physical fitness indicators routinely used in Hong Kong primary schools. A total of 9,439 records of students' performances on physical fitness indicators, retrieved from the database of a Hong Kong primary school, were used to develop the…

  18. Psychometric properties of the hebrew translation of the patient activation measure (PAM-13.

    Directory of Open Access Journals (Sweden)

    Racheli Magnezi

    Full Text Available "Patient activation" reflects involvement in managing ones health. This cross-sectional study assessed the psychometric properties of the Hebrew translation (PAM-H of the PAM-13.A nationally representative sample of 203 Hebrew-speaking Israeli adults answered the PAM-H, PHQ-9 depression scale, SF-12, and Self-efficacy Scale via telephone.Mean PAM-H scores were 70.7±15.4. Rasch analysis indicated that the PAM-H is a good measure of activation. There were no differences in PAM-H scores based on gender, age or education. Subjects with chronic disease scored lower than those without. Scores correlated with the Self-efficacy Scale (0.47, Total SF-12 (0.39 and PHQ-9 (-0.35, P<0.0001, indicating concurrent validity. Discriminant validity was reflected by a significant difference in the mean PAM-H score of those who scored below 10 (72.1±14.8 on the PHQ-9 (not depressed compared to those scoring ≥10 (i.e. probable depression (59.2±15.8; t 3.75; P = 0.001.The PAM-H psychometric properties indicate its usefulness with the Hebrew-speaking Israeli population.PAM-H can be useful for assessing programs aimed at effecting changes in patient compliance, health behaviors, etc. Researchers in Israel should use a single translation of the PAM-13 so that findings can be compared, increasing understanding of patient activation.

  19. Teater vajab ellujäämiseks värsket dramaturgiat / Jane Rasch ; vahendanud Eva-Liisa Linder

    Index Scriptorium Estoniae

    Rasch, Jane

    2009-01-01

    Taani teatriteadlane Jane Rasch õpetas 10.-14. augustini 2009 Viljandi Kultuuriakadeemias toimunud draamakirjutuskursusel "Ideedest näidendi stsenaariumini". Ka näitekirjanike koolitamisest Taanis jt. Põhjamaades

  20. Teater vajab ellujäämiseks värsket dramaturgiat / Jane Rasch ; vahendanud Eva-Liisa Linder

    Index Scriptorium Estoniae

    Rasch, Jane

    2009-01-01

    Taani teatriteadlane Jane Rasch õpetas 10.-14. augustini 2009 Viljandi Kultuuriakadeemias toimunud draamakirjutuskursusel "Ideedest näidendi stsenaariumini". Ka näitekirjanike koolitamisest Taanis jt. Põhjamaades

  1. Psychometric Properties of a Tool to Measure Nurses' Attitudes to Single Checking Medications: SCAMS-II.

    Science.gov (United States)

    Cross, Rachel; Bennett, Paul N; Ockerby, Cherene; Busija, Lucy; Currey, Judy

    2015-12-01

    Single checking medications has been increasingly adopted over the past decade by nurses in Australian healthcare services. However, attitudes toward the practice of only one nurse checking medications remain unclear. The aim of this article is to report on the development, reliability, and validity of a tool to measure nurses' attitudes to single checking medications in a health service in which single checking has been in place for over a decade. In a cross-sectional survey design, the Single Checking and Administration of Medications Scale (SCAMS-II) was used to measure the attitudes of 299 registered nurses (RNs) who were single checking medications in one metropolitan teaching hospital in Australia. Exploratory factor analysis was used to explore the dimensions that best represented the SCAMS-II. Cronbach's α was used to assess internal consistency of the identified subscales. To test the construct validity of the emergent questionnaire, Confirmatory Factor Analysis and Rasch analyses were performed. The psychometric properties of the SCAMS-II revealed 12 items with three reliable subscales: a five-item accountability model; a four-item efficiency model; and a three-item knowledge model. In settings where single checking is current practice, the SCAMS-II is recommended as a reliable tool to measure nurses' attitudes toward the single checking of medications. The findings from this study may assist healthcare organizations in the development of policy and procedure guidelines for the safe administration of medications. © 2015 Sigma Theta Tau International.

  2. Meeting the requirements of both classroom-based and systemic assessment of mathematics proficiency: The potential of Rasch measurement theory

    Directory of Open Access Journals (Sweden)

    Tim Dunne

    2012-10-01

    Full Text Available The challenges inherent in assessing mathematical proficiency depend on a number of factors, amongst which are an explicit view of what constitutes mathematical proficiency, an understanding of how children learn and the purpose and function of teaching. All of these factors impact on the choice of approach to assessment. In this article we distinguish between two broad types of assessment, classroom-based and systemic assessment. We argue that the process of assessment informed by Rasch measurement theory (RMT can potentially support the demands of both classroom-based and systemic assessment, particularly if a developmental approach to learning is adopted, and an underlying model of developing mathematical proficiency is explicit in the assessment instruments and their supporting material. An example of a mathematics instrument and its analysis which illustrates this approach, is presented. We note that the role of assessment in the 21st century is potentially powerful. This influential role can only be justified if the assessments are of high quality and can be selected to match suitable moments in learning progress and the teaching process. Users of assessment data must have sufficient knowledge and insight to interpret the resulting numbers validly, and have sufficient discernment to make considered educational inferences from the data for teaching and learning responses.

  3. THE MODERN RACISM SCALE: PSYCHOMETRIC

    Directory of Open Access Journals (Sweden)

    MANUEL CÁRDENAS

    2007-08-01

    Full Text Available An adaption of McConahay, Harder and Batts’ (1981 moderm racism scale is presented for Chilean population andits psychometric properties, (reliability and validity are studied, along with its relationship with other relevantpsychosocial variables in studies on prejudice and ethnic discrimination (authoritarianism, religiousness, politicalposition, etc., as well as with other forms of prejudice (gender stereotypes and homophobia. The sample consistedof 120 participants, students of psychology, resident in the city of Antofagasta (a geographical zone with a highnumber of Latin-American inmigrants. Our findings show that the scale seems to be a reliable instrument to measurethe prejudice towards Bolivian immigrants in our social environment. Likewise, important differences among thesubjects are detected with high and low scores in the psychosocial variables used.

  4. Psychometrics behind Computerized Adaptive Testing.

    Science.gov (United States)

    Chang, Hua-Hua

    2015-03-01

    The paper provides a survey of 18 years' progress that my colleagues, students (both former and current) and I made in a prominent research area in Psychometrics-Computerized Adaptive Testing (CAT). We start with a historical review of the establishment of a large sample foundation for CAT. It is worth noting that the asymptotic results were derived under the framework of Martingale Theory, a very theoretical perspective of Probability Theory, which may seem unrelated to educational and psychological testing. In addition, we address a number of issues that emerged from large scale implementation and show that how theoretical works can be helpful to solve the problems. Finally, we propose that CAT technology can be very useful to support individualized instruction on a mass scale. We show that even paper and pencil based tests can be made adaptive to support classroom teaching.

  5. Work Rehabilitation Questionnaire (WORQ): development and preliminary psychometric evidence of an ICF-based questionnaire for vocational rehabilitation.

    Science.gov (United States)

    Finger, Monika E; Escorpizo, Reuben; Bostan, Cristina; De Bie, Rob

    2014-09-01

    The International Classification of Functioning, Disability and Health (ICF) has proven to be a valuable framework for vocational rehabilitation (VR). No reliable and valid ICF-based instruments to capture work functioning is known, hence, the aims of this study were: (1) to outline the process for developing an ICF-based questionnaire, the Work Rehabilitation Questionnaire (WORQ) to assess functioning in VR and (2) to report preliminary psychometric evidence. ICF categories were selected from the ICF Core Sets for VR using explorative Rasch-analysis and VR literature review. Questions were worded to assess identified ICF categories. WORQ was translated from English to German. Psychometrics for the German version of WORQ was examined in one VR centre in Switzerland. 44 ICF categories were selected which resulted in 36 questions related to functioning. The psychometric evaluation of WORQ showed high test-retest reliability (Spearman correlation 0.79) (n = 53) and good internal consistency (Cronbachs Alpha 0.88) (n = 74) WORQ showed moderate correlation with Beck Depression Inventory II (Spearman correlation 0.511) and low correlation (Spearman correlation -0.353) with SF-36. WORQ appears to be a reliable, ICF-based questionnaire to evaluate functioning in VR, easy to administer by health or vocational professionals. The additional information gained when using WORQ would contribute to improving interdisciplinary understanding of the patient's situation and therefore support the integrative planning of the return-to-work process or engagement in gainful employment. However, further studies are needed to further examine its use in clinical practice and research, when validated in other patient populations and settings.

  6. Psychometric properties of self-report concussion scales and checklists.

    Science.gov (United States)

    McLeod, Tamara C Valovich; Leach, Candace

    2012-01-01

    published psychometric properties, and only 1 scale, the Concussion Symptom Inventory, was empirically driven (Rasch analysis), with development of the scale occurring before its clinical use. Internal consistency (Cronbach α) was reported for the Post-Concussion Scale (.87), Post-Concussion Scale: ImPACT 22-item (.88-.94), Head Injury Scale 9-item (.78), and Head Injury Scale 16-item (.84). Test-retest reliability has been reported only for the Post-Concussion Scale (Spearman r = .55) and the Post-Concussion Scale: ImPACT 21-item (Pearson r = .65). With respect to validity, the SCAT postconcussion scale has demonstrated face and content validity, the Post-Concussion Scale: ImPACT 22-item and Head Injury Scale 9-item have reported construct validity, and the Head Injury Scale 9-item and 16-item have published factorial validity. Sensitivity and specificity have been reported only with the GSC (0.89 and 1.0, respectively) and the Post-Concussion Scale: ImPACT 21-item when combined with the neurocognitive component of ImPACT (0.819 and 0.849, respectively). Meaningful change scores were reported for the Post-Concussion Scale (14.8 points), Post-Concussion Scale: ImPACT 22item (6.8 points), and Post-Concussion Scale: ImPACT 21-item (standard error of the difference = 7.17; 80% confidence interval = 9.18). Numerous scales exist for measuring the number and severity of concussion-related symptoms, with most evolving from the neuropsychology literature pertaining to head-injured populations. However, very few of these were created in a systematic manner that follows scale development processes and have published psychometric properties. Clinicians need to understand these limitations when choosing and using a symptom scale for inclusion in a concussion assessment battery. Future authors should assess the underlying constructs and measurement properties of currently available scales and use the ever-increasing prospective data pools of concussed athlete information to develop

  7. The Functional Idiographic Assessment Template-Questionnaire (FIAT-Q): Initial Psychometric Properties.

    Science.gov (United States)

    Darrow, Sabrina M; Callaghan, Glenn C; Bonow, Jordan T; Follette, William C

    2014-04-01

    The evidence based assessment (EBA) movement stresses the importance of psychological measures with strong psychometric properties and clinical utility. The Functional Idiographic Assessment Template system (FIAT; Callaghan, 2006) is a functional analytic behavioral approach to the assessment of interpersonal functioning for use with therapies like Functional Analytic Psychotherapy (FAP; Kohlenberg & Tsai, 1991). While research has begun to demonstrate the clinical utility of the FIAT, its psychometric properties have not been explored. The present study examines the Functional Idiographic Assessment Template-Questionnaire (FIAT-Q), a self-report measure contained in the FIAT. Two different approaches are used to explore the psychometric properties and structure of the FIAT-Q, and test-retest reliability is examined. These methods are discussed along with the use of the FIAT-Q as an alternative to nosological assessment of client behaviors.

  8. Validation of the Korean version of the pediatric quality of life inventory™ 4.0 (PedsQL™ generic core scales in school children and adolescents using the rasch model

    Directory of Open Access Journals (Sweden)

    Varni James W

    2008-06-01

    Full Text Available Abstract Background The Pediatric Quality of Life Inventory™ (PedsQL™ is a child self-report and parent proxy-report instrument designed to assess health-related quality of life (HRQOL in healthy and ill children and adolescents. It has been translated into over 70 international languages and proposed as a valid and reliable pediatric HRQOL measure. This study aimed to assess the psychometric properties of the Korean translation of the PedsQL™ 4.0 Generic Core Scales. Methods Following the guidelines for linguistic validation, the original US English scales were translated into Korean and cognitive interviews were administered. The field testing responses of 1425 school children and adolescents and 1431 parents to the Korean version of PedsQL™ 4.0 Generic Core Scales were analyzed utilizing confirmatory factor analysis and the Rasch model. Results Consistent with studies using the US English instrument and other translation studies, score distributions were skewed toward higher HRQOL in a predominantly healthy population. Confirmatory factor analysis supported a four-factor and a second order-factor model. The analysis using the Rasch model showed that person reliabilities are low, item reliabilities are high, and the majority of items fit the model's expectation. The Rasch rating scale diagnostics showed that PedsQL™ 4.0 Generic Core Scales in general have the optimal number of response categories, but category 4 (almost always a problem is somewhat problematic for the healthy school sample. The agreements between child self-report and parent proxy-report were moderate. Conclusion The results demonstrate the feasibility, validity, item reliability, item fit, and agreement between child self-report and parent proxy-report of the Korean version of PedsQL™ 4.0 Generic Core Scales for school population health research in Korea. However, the utilization of the Korean version of the PedsQL™ 4.0 Generic Core Scales for healthy school

  9. The Psychometric Toolbox: An Excel Package for Use in Measurement and Psychometrics Courses

    Science.gov (United States)

    Ferrando, Pere J.; Masip-Cabrera, Antoni; Navarro-González, David; Lorenzo-Seva, Urbano

    2017-01-01

    The Psychometric Toolbox (PT) is a user-friendly, non-commercial package mainly intended to be used for instructional purposes in introductory courses of educational and psychological measurement, psychometrics and statistics. The PT package is organized in six separate modules or sub-programs: Data preprocessor (descriptive analyses and data…

  10. USING RASCH ANALYSIS TO EXPLORE WHAT STUDENTS LEARN ABOUT PROBABILITY CONCEPTS

    Directory of Open Access Journals (Sweden)

    Zamalia Mahmud

    2015-01-01

    Full Text Available Students’ understanding of probability concepts have been investigated from various different perspectives. This study was set out to investigate perceived understanding of probability concepts of forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW. Rasch measurement which is based on a probabilistic model was used to identify concepts that students find easy, moderate and difficult to understand. Data were captured from the e-learning Moodle platform where students provided their responses through an on-line quiz. As illustrated in the Rasch map, 96% of the students could understand about sample space, simple events, mutually exclusive events and tree diagram while 67% of the students found concepts of conditional and independent events rather easy to understand

  11. Diagnosing a common rater halo effect using the polytomous Rasch model.

    Science.gov (United States)

    Marais, Ida; Andrich, David

    2011-01-01

    The 'halo effect' may be unique to different raters or common to all raters. When common to all raters, halo is not detectable through standard fit indices of the three-facet Rasch model used to account for differences in rater severities. Using a formulation of halo as a violation of local independence, a halo effect common to all raters is simulated and shown to be diagnosable through contrasts between two-facet stack and rack Rasch analyses. In the former, the thresholds are clustered and the distribution of persons is multimodal; in the latter, all thresholds are close together and the distribution of persons is unimodal. In the former, the scale is stretched, and the person separation inflated, relative to the latter.

  12. From whole number to real number: Applying Rasch measurement to investigate threshold concepts

    Directory of Open Access Journals (Sweden)

    Caroline Long

    2009-09-01

    Full Text Available The developments in mathematics that take place in Grades 7 to 9 constitute critical nodes in a learner’s scholing. One of the major transitions to be made is from whole numbers to real numbers, which involves theunderstanding of rational (and irrational numbers, and concepts such as ratio, proportion and percent. I hypothesise that ratio is a threshold concept that provides the conceptual gateway to higher order concepts. The research problem is to describe the learning challenges and provide an array of insightsand strategies that will inform teaching. The theory of conceptual fields provides the framework for this research (Vergnaud, 1988. The Rasch measurement model (Rasch, 1960/1980 articulates the qualitative and quantitative aspects of the research. This paper provides an overview of the broader study and reports on an aspect of the data analysis.

  13. Rasch scaling of the Oswestry Disability Index and the Roland-Morris Disability Questionnaire

    DEFF Research Database (Denmark)

    Lauridsen, Henrik Hein; Hartvigsen, Jan

    population of low back pain patients. Methods A total of 232 patients with low back pain and/or leg pain were recruited from an out-patient spinal clinic and 7 chiropractic practices and assessed using the RMQ and the ODI. The Dichotomous Model was applied to the RMQ and the unrestricted Partial Credit Model...... was used for the ODI. A series of Rasch procedures were carried out including overall fit, the person separation index (PSI), item fit, threshold ordering and differential item functioning (DIF). In addition local independence, unidimensionality and targeting were examined. The Rasch analysis was carried...... out using RUMM2030 and an acceptable overall fit of the data to the model was set as P>0.01 (item-trait interaction, χ2 probability). Items were considered misfitting if fit residuals exceeded ∓ 2.5 or χ2 probability was

  14. Measuring teaching ability with the Rasch model by scaling a series of product and performance tasks.

    Science.gov (United States)

    Wilkerson, Judy R; Lang, William Steve

    2006-01-01

    Rasch measurement can provide a much needed solution to scaling teacher ability. Typically, decisions about teacher ability are based on dichotomously scored certification tests focused on knowledge of content or pedagogy. This paper presents early developmental work of a partial-credit teacher-ability scale of 42 tasks (performances and products) with 348 rated items or criteria. The tasks and criteria are aligned with national and state standards for expected teacher knowledge and skills. These tasks are being used in about two-thirds of Florida school districts and are spreading to colleges of education. Over time there will be many variations in both tasks and criteria, but here we focus on the initial system and the Rasch model as part of the plan for development of the system.

  15. Monte Carlo tests of the Rasch model based on scalability coefficients

    DEFF Research Database (Denmark)

    Christensen, Karl Bang; Kreiner, Svend

    2010-01-01

    that summarizes the number of Guttman errors in the data matrix. These coefficients are shown to yield efficient tests of the Rasch model using p-values computed using Markov chain Monte Carlo methods. The power of the tests of unequal item discrimination, and their ability to distinguish between local dependence...... and unequal item discrimination, are discussed. The methods are illustrated and motivated using a simulation study and a real data example....

  16. Formalizing dimension and response violations of local independence in the unidimensional Rasch model.

    Science.gov (United States)

    Marais, Ida; Andrich, David

    2008-01-01

    Local independence in the Rasch model can be violated in two generic ways that are generally not distinguished clearly in the literature. In this paper we distinguish between a violation of unidimensionality, which we call trait dependence, and a specific violation of statistical independence, which we call response dependence, both of which violate local independence. Distinct algebraic formulations for trait and response dependence are developed as violations of the dichotomous Rasch model, data are simulated with varying degrees of dependence according to these formulations, and then analysed according to the Rasch model assuming no violations. Relative to the case of no violation it is shown that trait and response dependence result in opposite effects on the unit of scale as manifested in the range and standard deviation of the scale and the standard deviation of person locations. In the case of trait dependence the scale is reduced; in the case of response dependence it is increased. Again, relative to the case of no violation, the two violations also have opposite effects on the person separation index (analogous to Cronbach's alpha reliability index of traditional test theory in value and construction): it decreases for data with trait dependence; it increases for data with response dependence. A standard way of accounting for dependence is to combine the dependent items into a higher-order polytomous item. This typically results in a decreased person separation index index and Cronbach's alpha, compared with analysing items as discrete, independent items. This occurs irrespective of the kind of dependence in the data, and so further contributes to the two violations not being distinguished clearly. In an attempt to begin to distinguish between them statistically this paper articulates the opposite effects of these two violations in the dichotomous Rasch model.

  17. Using Rasch model to analyze the ability of pre-university students in vector

    Science.gov (United States)

    Ibrahim, Faridah Mohamed; Shariff, Asma Ahmad; Tahir, Rohayatimah Muhammad

    2015-10-01

    Evaluating students' performance only from overall examination marks does not give accurate evidence of their achievement on a particular subject. For a more detailed analysis, an instrument called Rasch Measurement Model (Rasch Model), widely used in education research, may be applied. Using the analysis map, the level of each student's ability and the level of the questions difficulty can be measured. This paper describes how the Rasch Model is used to evaluate students' achivement and performance in Vector, a subject taken by students enrolled in the Physical Science Program at the Centre for Foundation Studies in Science, University of Malaya. Usually, students' understanding of the subject and performance are assessed and examined at the end of the semester in the final examination, apart from continuous assessment done throughout the course. In order to evaluate the individual achievement and get a better and accurate evidence on the performance, 28 male and 28 female students' marks were taken randomly from the final examination results and analysed using the Rasch Model. Observation made from the map showed that more than half of the questions were categorized as difficult while the two most difficult questions could be answered correctly by 33.9% of the students. Results showed that the students performed very well and their achievement was above expectation. About 27% of the sudents could be considered as having very high ability in answering all the questions, with one student being able to answer well, obtaining perfect score. However, two students were found to be misfits since they were able to answer difficult questions but gave poor response to easy ones.

  18. Study of Bias in 2012-Placement Test through Rasch Model in Terms of Gender Variable

    Science.gov (United States)

    Turkan, Azmi; Cetin, Bayram

    2017-01-01

    Validity and reliability are among the most crucial characteristics of a test. One of the steps to make sure that a test is valid and reliable is to examine the bias in test items. The purpose of this study was to examine the bias in 2012 Placement Test items in terms of gender variable using Rasch Model in Turkey. The sample of this study was…

  19. Rasch Analysis of the Power as Knowing Participation in Change Tool - the Brazilian version Rasch análisis del Power as Knowing Participation in Change Tool - Versión Brasileña Análise Rasch do Power as Knowing Participation in Change Tool - Versão Brasileira

    Directory of Open Access Journals (Sweden)

    Erika de Souza Guedes

    2013-02-01

    Full Text Available OBJECTIVES: the objective of this study was to evaluate the items contained in the Brazilian version of the Power as Knowing Participation in Change Tool (PKPCT. METHOD: investigation of the psychometric properties of the mentioned questionnaire through Rasch analysis. RESULTS: the data from 952 nursing assistants and 627 baccalaureate nurses were analyzed (average age 44.1 (SD=9.5; 13.0% men. The subscales Choices, Awareness, Freedom and Involvement were tested separately and presented unidimensionality; the categories of the responses given to the items were compiled from 7 to 3 levels and the items fit the model well, except for the following/leading item, in which the infit and outfit values were above 1.4; this item has also presented Differential Item Functioning (DIF according to the participant's role. The reliability of the items was of 0.99 and the reliability of the participants ranged from 0.80 to 0.84 in the subscales. Items with extremely high levels of difficulty were not identified. CONCLUSIONS: the PKPCT should not be viewed as unidimensional, items with extremely high levels of difficulty in the scale need to be created and the differential functioning of some items has to be further investigated.OBJETIVOS: Los objetivos del estudio fueron validar la versión brasileña del Power as Knowing Participation in Change Tool. MÉTODO: evaluación del elementos del instrumento a través del análisis Rasch. RESULTADOS: Se analizaron datos de 952 auxiliares de enfermería y 627 enfermeras (edad promedia 44,1 años, DE = 9,5, hombres 13,0%. Cada una de las 4 subescalas (Elección, Conciencia, Libertad y Compromiso mostraron unidimensionalidad. Las 7 categorías iniciales de respuesta debieron colapsarse a 3. Todos los ítems de las sub-escalas mostraron buen ajuste, exceptuando el ítem liderado/líder cuyos valores infit y oufit fueron mayores de 1,4. Este ítem también mostró el DIF para rol del respondiente. La fiabilidad de los

  20. A Rasch and factor analysis of the Functional Assessment of Cancer Therapy-General (FACT-G

    Directory of Open Access Journals (Sweden)

    Selby Peter J

    2007-04-01

    Full Text Available Abstract Background Although the Functional Assessment of Cancer Therapy – General questionnaire (FACT-G has been validated few studies have explored the factor structure of the instrument, in particular using non-sample dependent measurement techniques, such as Rasch Models. Furthermore, few studies have explored the relationship between item fit to the Rasch Model and clinical utility. The aim of this study was to investigate the dimensionality and measurement properties of the FACT-G with Rasch Models and Factor analysis. Methods A factor analysis and Rasch analysis (Partial Credit Model was carried out on the FACT-G completed by a heterogeneous sample of cancer patients (n = 465. For the Rasch analysis item fit (infit mean squares ≥ 1.30, dimensionality and item invariance were assessed. The impact of removing misfitting items on the clinical utility of the subscales and FACT-G total scale was also assessed. Results The factor analysis demonstrated a four factor structure of the FACT-G which broadly corresponded to the four subscales of the instrument. Internal consistency for these four scales was very good (Cronbach's alpha 0.72 – 0.85. The Rasch analysis demonstrated that each of the subscales and the FACT-G total scale had misfitting items (infit means square ≥ 1.30. All these scales with the exception of the Social & Family Well-being Scale (SFWB were unidimensional. When misfitting items were removed, the effect sizes and the clinical utility of the instrument were maintained for the subscales and the total FACT-G scores. Conclusion The results of the traditional factor analysis and Rasch analysis of the FACT-G broadly agreed. Caution should be exercised when utilising the Social & Family Well-being scale and further work is required to determine whether this scale is best represented by two factors. Additionally, removing misfitting items from scales should be performed alongside an assessment of the impact on clinical utility.

  1. Estimation of Models in a Rasch Family for Polytomous Items and Multiple Latent Variables

    Directory of Open Access Journals (Sweden)

    Carolyn J. Anderson

    2007-02-01

    Full Text Available The Rasch family of models considered in this paper includes models for polytomous items and multiple correlated latent traits, as well as for dichotomous items and a single latent variable. An R package is described that computes estimates of parameters and robust standard errors of a class of log-linear-by-linear association (LLLA models, which are derived from a Rasch family of models. The LLLA models are special cases of log-linear models with bivariate interactions. Maximum likelihood estimation of LLLA models in this form is limited to relatively small problems; however, pseudo-likelihood estimation overcomes this limitation. Maximizing the pseudo-likelihood function is achieved by maximizing the likelihood of a single conditional multinomial logistic regression model. The parameter estimates are asymptotically normal and consistent. Based on our simulation studies, the pseudo-likelihood and maximum likelihood estimates of the parameters of LLLA models are nearly identical and the loss of efficiency is negligible. Recovery of parameters of Rasch models fit to simulated data is excellent.

  2. A comparison of three polychotomous Rasch models for super-item analysis

    Directory of Open Access Journals (Sweden)

    Purya Baghaei

    2010-09-01

    Full Text Available Local dependency is a prevalent phenomenon in educational tests where several dichotomous items are based on a single prompt. This is a violation of one of the major assumptions of Rasch and other IRT models and poses restriction on the analysis of such tests with these models. To solve the problem, it has been suggested that the items which belong to a single prompt be bundled together and analysed as independent polychotomous super-items. However, in the last few decades there has been an array of polychotomous models with different properties and assumptions which makes the choice of the right model rather difficult. The purpose of the present study is two-fold: 1 to compare the performance of three psychotomous Rasch models for super-item analysis and 2 to check the consequences of using ‘inappropriate’ models when the assumption of equal distances between steps within and across items is violated. To this end, a reading comprehension test comprising six independent passages each containing six dichotomous items was analysed with three Rasch models, namely, Andrich’s (1978 rating scale model (RSM, Andrich’s (1982 equidistant model and Masters’ (1982 partial credit model (PCM. Results show that there is not much difference in the three models as far as model data fit, standard error of parameter estimates and discrimination are concerned. Nevertheless, noticeable differences were observed in the estimates of the difficulty parameters across the three models.

  3. Psychometric testing of the Italian and French versions of the Care Dependency Scale.

    Science.gov (United States)

    Zürcher, Simeon Joel; Vangelooven, Christa; Borter, Natalie; Schnyder, Daniel; Hahn, Sabine

    2016-12-01

    The aim of this study was to test psychometrically the Italian and French versions of the Care Dependency Scale. The Care Dependency Scale assesses changes in patients' level of care dependency including important functional and mental dimensions. Evaluation of the psychometric properties of the Italian version is still ongoing. The French version has to date not been validated. Nationwide cross-sectional point prevalence study. Data were extracted from the national, annual prevalence survey of hospital-acquired pressure ulcers and inpatient falls in Swiss acute care hospitals in 2011. A total of 799 Italian and 1068 French-speaking patients were included in the analysis. For the evaluation, the psychometric properties were tested for each language both separately and conjointly. The scales revealed high internal consistency. Factor analysis presented a one-factor solution for both versions separately as well as combined. Comparison of internal structure revealed an excellent degree of equivalence between the versions. Highly significant Spearman correlations between the Care Dependency Scale and the Braden Scale sum scores indicated satisfactory criterion validity. Both the Italian and the French versions of the Care Dependency Scale showed satisfactory psychometric properties and a high level of equivalence. Further psychometric testing, using modern test theory approaches, is required. However, the scale is recommended as a valid instrument for further use in Italian and French. © 2016 John Wiley & Sons Ltd.

  4. An independent psychometric evaluation of the PROMS measure of music perception skills

    NARCIS (Netherlands)

    Kunert, R.; Willems, R.M.; Hagoort, P.

    2016-01-01

    The Profile of Music Perception Skills (PROMS) is a recently developed measure of perceptual music skills which has been shown to have promising psychometric properties. In this paper we extend the evaluation of its brief version to three kinds of validity using an individual difference approach. Th

  5. An independent psychometric evaluation of the PROMS measure of music perception skills

    NARCIS (Netherlands)

    Kunert, R.; Willems, R.M.; Hagoort, P.

    2016-01-01

    The Profile of Music Perception Skills (PROMS) is a recently developed measure of perceptual music skills which has been shown to have promising psychometric properties. In this paper we extend the evaluation of its brief version to three kinds of validity using an individual difference approach.

  6. Efficient assessment of social problem-solving abilities in medical and rehabilitation settings: a Rasch analysis of the Social Problem-Solving Inventory-Revised.

    Science.gov (United States)

    Dreer, Laura E; Berry, Jack; Rivera, Patricia; Snow, Marsha; Elliott, Timothy R; Miller, Doreen; Little, Todd D

    2009-07-01

    The Social Problem Solving Inventory-Revised Scale (SPSI-R) has been shown to be a reliable and valid self-report measure of social problem-solving abilities. In busy medical and rehabilitation settings, a brief and efficient screening version with psychometric properties similar to the SPSI-R would have numerous benefits including decreased patient and caregiver assessment burden and administration/scoring time. Thus, the aim of the current study was to identify items from the SPSI-R that would provide for a more efficient assessment of global social problem-solving abilities. This study consisted of three independent samples: 121 persons in low-vision rehabilitation (M age=71 years old, SD=15.53), 301 persons living with diabetes mellitus (M age=58, and SD=14.85), and 131 family caregivers of persons with severe disabilities (M age=56 years old, SD=12.15). All persons completed a version of the SPSI-R, Center for Epidemiological Studies Depression Scale (CES-D), and the Satisfaction with Life Scale (SWLS). Using Rasch scaling of the SPSI-R short-form, we identified a subset of 10 items that reflected the five-component model of social problem solving. The 10 items were separately validated on the sample of persons living with diabetes mellitus and the sample of family caregivers of persons with severe disabilities. Results indicate that the efficient 10-item version, analyzed separately for all three samples, demonstrated good reliability and validity characteristics similar to the established SPSI-R short form. The 10-item version of the SPSI-R represents a brief, effective way in which clinicians and researchers in busy health care settings can quickly assess global problem-solving abilities and identify those persons at-risk for complicated adjustment. Implications for the assessment of social problem-solving abilities are discussed.

  7. The importance of statistical modelling in clinical research : Comparing multidimensional Rasch-, structural equation and linear regression models for analyzing the depression of relatives of psychiatric patients.

    Science.gov (United States)

    Alexandrowicz, Rainer W; Jahn, Rebecca; Friedrich, Fabian; Unger, Anne

    2016-06-01

    Various studies have shown that caregiving relatives of schizophrenic patients are at risk of suffering from depression. These studies differ with respect to the applied statistical methods, which could influence the findings. Therefore, the present study analyzes to which extent different methods may cause differing results. The present study contrasts by means of one data set the results of three different modelling approaches, Rasch Modelling (RM), Structural Equation Modelling (SEM), and Linear Regression Modelling (LRM). The results of the three models varied considerably, reflecting the different assumptions of the respective models. Latent trait models (i. e., RM and SEM) generally provide more convincing results by correcting for measurement error and the RM specifically proves superior for it treats ordered categorical data most adequately.

  8. Review of the Psychometric Evidence of the Perceived Stress Scale

    Directory of Open Access Journals (Sweden)

    Eun-Hyun Lee, RN, PhD

    2012-12-01

    Conclusion: Overall, the PSS is an easy-to-use questionnaire with established acceptable psychometric properties. However, future studies should evaluate these psychometric properties in greater depth, and validate the scale using diverse populations.

  9. Rasch analysis of the Dutch version of the Oxford elbow score

    Directory of Open Access Journals (Sweden)

    de Haan J

    2011-08-01

    Full Text Available Jeroen de Haan1, Niels Schep2, Wim Tuinebreijer2, Peter Patka2, Dennis den Hartog21Department of Surgery and Traumatology, Westfriesgasthuis, Hoorn, the Netherlands; 2Department of Surgery and Traumatology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, the NetherlandsBackground: The Oxford elbow score (OES is a patient-rated, 12-item questionnaire that measures quality of life in relation to elbow disorders. This English questionnaire has been proven to be a reliable and valid instrument. Recently, the OES has been translated into Dutch and examined for its reliability, validity, and responsiveness in a group of Dutch patients with elbow pathology. The aim of this study was to analyze the Dutch version of the OES (OES-DV in combination with Rasch analysis or the one-parameter item response theory to examine the structure of the questionnaire.Methods: The OES-DV was administered to 103 patients (68 female, 35 male. The mean age of the patients was 44.3 ± 14.7 (range 15–75 years. Rasch analysis was performed using the Winsteps® Rasch Measurement Version 3.70.1.1 and a rating scale parameterization.Results: The person separation index, which is a measure of person reliability, was excellent (2.30. All the items of the OES had a reasonable mean square infit or outfit value between 0.6 and 1.7. The threshold of items were ordered, so the categories can function as intended. Principal component analysis of the residuals partly confirmed the multidimensionality of the English version of the OES. The OES distinguished 3.4 strata, which indicates that about three ranges can be differentiated.Conclusion: Rasch analysis of the OES-DV showed that the data fit to the stringent Rasch model. The multidimensionality of the English version of the OES was partly confirmed, and the four items of the function and three items of the pain domain were recognized as separate domains. The category rating scale of the OES-DV works well. The OES can

  10. A Comparison between Robust z and 0.3-Logit Difference Procedures in Assessing Stability of Linking Items for the Rasch Model

    Science.gov (United States)

    Huynh, Huynh; Rawls, Anita

    2011-01-01

    There are at least two procedures to assess item difficulty stability in the Rasch model: robust z procedure and "0.3 Logit Difference" procedure. The robust z procedure is a variation of the z statistic that reduces dependency on outliers. The "0.3 Logit Difference" procedure is based on experiences in Rasch linking for tests…

  11. Confessions, scapegoats and flying pigs: Psychometric testing and the law

    OpenAIRE

    Callie Theron

    2007-01-01

    The use of psychometric tests in personnel selection has been regarded with an extraordinary degree of suspicion and scepticism. This is especially true when selection occurs in respect of a diverse applicant group. Concern is expressed about the seemingly uncritical embracing of specific tenets related to the use of psychometric tests in personnel selection in the absence of any systematic coherent psychometric argument to justify these beliefs. The absence of such a supporting psychometric ...

  12. Emotional Intelligence and Nurse Recruitment: Rasch and confirmatory factor analysis of the trait emotional intelligence questionnaire short form.

    Science.gov (United States)

    Snowden, Austyn; Watson, Roger; Stenhouse, Rosie; Hale, Claire

    2015-12-01

    To examine the construct validity of the Trait Emotional Intelligence Questionnaire Short form. Emotional intelligence involves the identification and regulation of our own emotions and the emotions of others. It is therefore a potentially useful construct in the investigation of recruitment and retention in nursing and many questionnaires have been constructed to measure it. Secondary analysis of existing dataset of responses to Trait Emotional Intelligence Questionnaire Short form using concurrent application of Rasch analysis and confirmatory factor analysis. First year undergraduate nursing and computing students completed Trait Emotional Intelligence Questionnaire-Short Form in September 2013. Responses were analysed by synthesising results of Rasch analysis and confirmatory factor analysis. Participants (N = 938) completed Trait Emotional Intelligence Questionnaire Short form. Rasch analysis showed the majority of the Trait Emotional Intelligence Questionnaire-Short Form items made a unique contribution to the latent trait of emotional intelligence. Five items did not fit the model and differential item functioning (gender) accounted for this misfit. Confirmatory factor analysis revealed a four-factor structure consisting of: self-confidence, empathy, uncertainty and social connection. All five misfitting items from the Rasch analysis belonged to the 'social connection' factor. The concurrent use of Rasch and factor analysis allowed for novel interpretation of Trait Emotional Intelligence Questionnaire Short form. Much of the response variation in Trait Emotional Intelligence Questionnaire Short form can be accounted for by the social connection factor. Implications for practice are discussed. © 2015 John Wiley & Sons Ltd.

  13. The Mental Vulnerability Questionnaire: a psychometric evaluation

    DEFF Research Database (Denmark)

    Eplov, Lene Falgaard; Petersen, Janne; Jørgensen, Torben

    2010-01-01

    The Mental Vulnerability Questionnaire was originally a 22 item scale, later reduced to a 12 item scale. In population studies the 12 item scale has been a significant predictor of health and illness. The scale has not been psychometrically evaluated for more than 30 years, and the aim of the pre......The Mental Vulnerability Questionnaire was originally a 22 item scale, later reduced to a 12 item scale. In population studies the 12 item scale has been a significant predictor of health and illness. The scale has not been psychometrically evaluated for more than 30 years, and the aim...... of the present study was both to evaluate the psychometric properties of the 22 and 12 item scales and of three new scales. The main study sample was a community sample comprising more than 6,000 men and women. In this sample the coefficients of homogeneity were all over 0.30 for the three new scales, but below...

  14. The Psychometric Evaluation of Human Life Histories.

    Science.gov (United States)

    Copping, Lee T; Campbell, Anne; Muncer, Steven; Richardson, George B

    2017-01-01

    A recent critique of Copping, Campbell, and Muncer raised several issues concerning the validity of psychometric assessment techniques in the study of life history (LH) strategies. In this reply, some of our key concerns about relying on aggregated psychometric measures are explained, and we raise questions generally regarding the use of higher order factor structures. Responses to some of the statistical issues raised by Figueredo et al. are also detailed. We stand by our original conclusions and call for more careful consideration of instruments used to evaluate hypotheses derived from LH theory.

  15. Psychometric properties of a new short version of the State-Trait Anxiety Inventory (STAI) for the assessment of anxiety in the elderly.

    Science.gov (United States)

    Fernández-Blázquez, M A; Ávila-Villanueva, M; López-Pina, J A; Zea-Sevilla, M A; Frades-Payo, B

    2015-01-01

    Anxiety has negative effects on the cognitive performance and psychosocial adjustment of elderly people. Given the high prevalence of anxiety symptoms in patients suffering from cognitive impairment, it has been suggested that these symptoms may be an early marker of dementia. The State-Trait Anxiety Inventory (STAI) is one of the most widely-used scales for evaluating anxiety in elderly people. However, inasmuch as the STAI may be difficult to apply to older people, having a short form of it would be desirable. The participants comprised 489 community-dwelling individuals aged 68 years and over. All of them were volunteers in a longitudinal study for early detection of Alzheimer' Disease (Proyecto Vallecas). The full sample was divided in two homogeneous subgroups: Group A, used to reduce the number of items and response options, and Group B, the group used to determine the psychometric properties of the new short form (STAIr). A dichotomous Rasch model was used to obtain the STAIr. No statistically significant differences for STAIr scores were found with respect to sociodemographic variables. Psychometric properties and normative data were obtained for the new short version. The STAIr is composed of 13 items and data fits the model well. Since it is short and easy to apply to elderly people, STAIr will be very useful in clinical and research settings. Copyright © 2013 Sociedad Española de Neurología. Published by Elsevier España, S.L.U. All rights reserved.

  16. Evaluating the Psychometric Properties of 3 Depression Measures in a Sample of Persons With Traumatic Brain Injury and Major Depressive Disorder.

    Science.gov (United States)

    Dyer, Joshua R; Williams, Ryan; Bombardier, Charles H; Vannoy, Steven; Fann, Jesse R

    2016-01-01

    To explore the psychometric properties of 3 widely used measures of depression in a sample of individuals with traumatic brain injury (TBI) and major depressive disorder and refine them to maximize efficiency. Secondary analysis of data from a randomized controlled trial of cognitive-behavioral therapy for depression after TBI. Nationwide recruitment from community and clinical settings. One hundred adults within 10 years of complicated mild to severe TBI. Telephone and in-person cognitive-behavioral therapy. Patient Health Questionnaire-9 (PHQ-9), Symptom Checklist-20, and Hamilton Depression Rating Scale. We used Rasch rating scale analysis and multilevel modeling to investigate the 3 measures. Measurement properties of each of the depression measures were strong. We explored modifications to the rating scales to improve efficiency while retaining strong psychometric characteristics. Correlations among these revised measures were high. Treatment effects of each revised depression measure were compared using a multilevel model, and effect size estimates were comparable among the revised PHQ-9, Symptom Checklist-20, and Hamilton Depression Rating Scale. Although each of the 3 measures demonstrated adequate reliability, the efficiency of all 3 instruments was improved with rating scale analysis. The PHQ-9 required the fewest modifications and functions well as a measure of depression among those with TBI.

  17. Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia.

    Science.gov (United States)

    Timmerman, Angelique A; Speyer, Renée; Heijnen, Bas J; Klijn-Zwijnenberg, Iris R

    2014-04-01

    Dysphagia can have severe consequences for the patient's health, influencing health-related quality of life (HRQoL). Sound psychometric properties of HRQoL questionnaires are a precondition for assessing the impact of dysphagia, the focus of this study, resulting in recommendations for the appropriate use of these questionnaires in both clinical practice and research contexts. We performed a systematic review starting with a search for and retrieval of all full-text articles on the development of HRQoL questionnaires related to oropharyngeal dysphagia and/or their psychometric validation from the electronic databases PubMed and Embase published up to June 2011. Psychometric properties were judged according to quality criteria proposed for health status questionnaires. Eight questionnaires were included in this study. Four are aimed solely at HRQoL in oropharyngeal dysphagia: the deglutition handicap index (DHI), dysphagia handicap index (DHI'), M.D. Anderson Dysphagia Inventory (MDADI), and SWAL-QOL, while the EDGQ, EORTC QLQ-STO 22, EORTC QLQ-OG 25 and EORTC QLQ-H&N35 focus on other primary diseases resulting in dysphagia. The psychometric properties of the DHI, DHI', MDADI, and SWAL-QOL were evaluated. For appropriate applicability of HRQoL questionnaires, strong scores on the psychometric criteria face validity, criterion validity, and interpretability are prerequisites. The SWAL-QOL has the strongest ratings for these criteria, while the DHI' is the most easy to apply given its 25 items and the use of a uniform scoring format. For optimal use of HRQoL questionnaires in diverse settings, it is necessary to combine psychometric and utility approaches.

  18. Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank

    NARCIS (Netherlands)

    Oude Voshaar, Martijn A.H.; Ten Klooster, Peter M.; Vonkeman, Harald E.; van de Laar, Mart A.F.J.

    2017-01-01

    Objective: Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Study

  19. Psychometric Consequences of Subpopulation Item Parameter Drift

    Science.gov (United States)

    Huggins-Manley, Anne Corinne

    2017-01-01

    This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

  20. Psychometric Measurement Models and Artificial Neural Networks

    Science.gov (United States)

    Sese, Albert; Palmer, Alfonso L.; Montano, Juan J.

    2004-01-01

    The study of measurement models in psychometrics by means of dimensionality reduction techniques such as Principal Components Analysis (PCA) is a very common practice. In recent times, an upsurge of interest in the study of artificial neural networks apt to computing a principal component extraction has been observed. Despite this interest, the…

  1. Psychometric Consequences of Subpopulation Item Parameter Drift

    Science.gov (United States)

    Huggins-Manley, Anne Corinne

    2017-01-01

    This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

  2. Psychometric Evaluation of the Chinese Virtues Questionnaire

    Science.gov (United States)

    Duan, Wenjie; Ho, Samuel M. Y.; Bai, Yu; Tang, Xiaoqing

    2013-01-01

    Objectives: The present study examined the psychometric properties of the Chinese Virtues Questionnaire (CVQ). The reliability, factor structure, construct validity, and temporal stability of the inventory were examined. Method: A university student sample ("n" = 878) and a working adult sample ("n" = 153) were recruited.…

  3. Psychometric Characteristics of the Aberrant Behavior Checklist.

    Science.gov (United States)

    Aman, Michael G.; And Others

    1985-01-01

    Information is presented on the psychometric characteristics of the Aberrant Behavior Checklist, a measure of psychotropic drug effects. Internal consistency and test-retest reliability of the checklist appeared very good. Interrater reliability was generally in the moderate range. In general, validity was established for most Aberrant Behavior…

  4. Emotional Considerations in Spasmodic Dysphonia: Psychometric Quantification.

    Science.gov (United States)

    Cannito, Michael P.

    1991-01-01

    This study examined emotional characteristics of 18 female spasmodic dysphonic subjects in comparison to matched normal controls across psychometric measures of depression, anxiety, and somatic complaints. Statistically significant differences were noted between groups for all measures and over half of the dysphonic subjects exhibited clinically…

  5. Propiedades psicométricas del Cuestionario de Apoyo Social Funcional y de la Escala de Soledad en adultos mayores no institucionalizados en España Psychometric properties of the Functional Social Support Questionnaire and the Loneliness Scale in non-institutionalized older adults in Spain

    Directory of Open Access Journals (Sweden)

    Alba Ayala

    2012-08-01

    Full Text Available Objetivos: Este estudio analiza las propiedades psicométricas del Cuestionario de Apoyo Social Funcional Duke-UNC (DUFSS, Duke-UNC Questionnaire of Functional Social Support y de la Escala de Soledad de De Jong-Gierveld en una muestra de adultos mayores no institucionalizados. Métodos: Muestra de 1106 adultos mayores no institucionalizados incluidos en una encuesta nacional sobre calidad de vida. Ambas escalas se analizaron según la teoría clásica de los tests (aceptabilidad, consistencia interna, validez interna, validez convergente, validez discriminativa y precisión y análisis Rasch. Resultados: Las puntuaciones medias ± desviación estándar fueron de 44,95 ± 8,9 para el DUFSS y 1,92 ± 1,83 para la Escala de Soledad. El α de Cronbach fue 0,94 para el DUFSS y 0,77 para la Escala de Soledad. El análisis factorial mostró dos factores en ambas escalas (varianza explicada: 73,8% para el DUFSS y 67,7% para la Escala de Soledad. Ambos instrumentos mostraron un coeficiente de correlación de -0,59 entre sí. El análisis Rasch en el DUFSS identificó dos dimensiones, con un buen ajuste al modelo, mientras que la Escala de Soledad no mostró buen ajuste de los datos al modelo. Conclusiones: El cuestionario DUFSS, con algunas modificaciones, cumple las asunciones del modelo Rasch, y aporta medidas lineales. Sin embargo, hacen falta más estudios de análisis Rasch con la Escala de Soledad. Según la teoría clásica de los tests, el DUFSS tiene buena consistencia interna para comparación de personas y la Escala de Soledad la tiene para comparación de grupos. Ambas escalas presentan una validez de constructo satisfactoria.Objectives: To examine the psychometric properties of the Social Support Questionnaire Duke-UNC (DUFSS and the De Jong-Gierveld Loneliness Scale in a sample of non-institutionalized older adults. Methods: The sample consisted of 1,106 non-institutionalized older adults included in a national survey on quality of life

  6. Validating The ISO 9000 Construct of Measurement Instrument Through Application of RASCH Model

    Directory of Open Access Journals (Sweden)

    Rohaizah Saad

    2012-01-01

    Full Text Available There are numerous researches conducted on the issues related to ISO 9001 quality management system. Among the issue is the impact of the ISO 9001 quality management system implementation on the performance of the organization. However the findings from the research appeared as inconclusive. Few literature suggest that the inconclusive result may due to the level of ISO 9000 implementation therefore further research is required. Generally the data collected for these types of researches are through mailed questionnaires and analyzed it using SPSS and SEM. In line with that this study also developed questionnaires correspond to a 5 point Likert to assess the implementation of ISO 9000 in the organization. As a result 231 items are identified within five dimensions. The five dimensions are derived from ISO 9001 and ISO 9004 quality management standards requirement and guidelines. Among the dimensions are management responsibility, resource management, product realization, measurement improvement and innovation and organizational performance. The questionnaires are sent to 78 automotive based companies located in the Northern region of Peninsular Malaysia. 19 questionnaires were returned and used as pilot test to validate and calibrate the instrument. The responds from the organization are tabulated and run in WinSteps software for the purpose of validating and calibrating the instrument by implementing the Rasch ‘quality control’ and reduction of items. Not all the outfit items are removed from the instruments, Rasch Model did provide room for the researcher to make decision either to remove or not those outfit items. In this study those outfit items need to be corrected in order to ensure that the instrument is reliable and fit to measure the performance of the organization. As a result 68 items are removed from the questionnaires.Keyword: rasch model, ISO 9001, quality control and items reduction.

  7. Organizational Culture Influence On Total Productive Maintenance (TPM and Operational Performance Using RASCH Model Analysis

    Directory of Open Access Journals (Sweden)

    Mohd Norhasni Mohd Asaad

    2014-02-01

    Full Text Available Abstract. Market globalization, competitive product and services, high economic crises are the most critical factors that influence the success of the manufacturing companies in global market. Therefore it is critical to the manufacturing companies to be efficient in production and lean tool may used to achieve that.  The most frequently used is the Total Preventive Maintenance (TPM, even though there are many studies have been conducted in relation to the TPM but there is limited research in investigating the effects of the TPM on operational performance. However, the result of the studies was not consistent, where TPM practice may have positive and negative impact on operational performance. Among the reason is the culture of the organization that influenced the implementation of TPM and operational performance. Due to that this study attempts to investigate the influence of organizational culture on the TPM implementation and operational performance.  Rasch model is used in this study due to its ability in interpreting and analyzing the ability of respondents in performing the difficult items. The online questionnaires were distributed to 63 randomly selected automotive companies located at Northern Region of Malaysia.  Results of the study revealed that the organizational culture has influenced on the successful implementation of TPM and operational performance. Therefore by the implementation of TPM in outstanding organizational culture can improve operational performance.   Keyword: Total Preventive Maintenance (TPM, Lean manufacturing, Operational performance, Organizational culture, Rasch modeldoi:10.12695/ajtm.2013.6.2.2How to cite this article:Mohd Asaad, M.N and Yusoff, R.Z. (2013. Organizational Culture Influence On Total Productive Maintenance (TPM and Operational Performance Using RASCH Model Analysis . The Asian Journal of Technology Management 6 (2: 72-81. Print ISSN: 1978-6956; Online ISSN: 2089-791X.  doi:10.12695/ajtm

  8. A Rasch and confirmatory factor analysis of the General Health Questionnaire (GHQ - 12

    Directory of Open Access Journals (Sweden)

    Velikova Galina

    2010-04-01

    Full Text Available Abstract Background The General Health Questionnaire (GHQ - 12 was designed as a short questionnaire to assess psychiatric morbidity. Despite the fact that studies have suggested a number of competing multidimensional factor structures, it continues to be largely used as a unidimensional instrument. This may have an impact on the identification of psychiatric morbidity in target populations. The aim of this study was to explore the dimensionality of the GHQ-12 and to evaluate a number of alternative models for the instrument. Methods The data were drawn from a large heterogeneous sample of cancer patients. The Partial Credit Model (Rasch was applied to the 12-item GHQ. Item misfit (infit mean square ≥ 1.3 was identified, misfitting items removed and unidimensionality and differential item functioning (age, gender, and treatment aims were assessed. The factor structures of the various alternative models proposed in the literature were explored and optimum model fit evaluated using Confirmatory Factor Analysis. Results The Rasch analysis of the 12-item GHQ identified six misfitting items. Removal of these items produced a six-item instrument which was not unidimensional. The Rasch analysis of an 8-item GHQ demonstrated two unidimensional structures corresponding to Anxiety/Depression and Social Dysfunction. No significant differential item functioning was observed by age, gender and treatment aims for the six- and eight-item GHQ. Two models competed for best fit from the confirmatory factor analysis, namely the GHQ-8 and Hankin's (2008 unidimensional model, however, the GHQ-8 produced the best overall fit statistics. Conclusions The results are consistent with the evidence that the GHQ-12 is a multi-dimensional instrument. Use of the summated scores for the GHQ-12 could potentially lead to an incorrect assessment of patients' psychiatric morbidity. Further evaluation of the GHQ-12 with different target populations is warranted.

  9. A psychometric appraisal of the DREEM

    LENUS (Irish Health Repository)

    Hammond, Sean M

    2012-01-12

    Abstract Background The quality of the Educational environment is a key determinant of a student centred curriculum. Evaluation of the educational environment is an important component of programme appraisal. In order to conduct such evaluation use of a comprehensive, valid and reliable instrument is essential. One of most widely used contemporary tools for evaluation of the learning environment is the Dundee Ready Education Environment Measure (DREEM). Apart from the initial psychometric evaluation of the DREEM, few published studies report its psychometric properties in detail. The aim of this study was to examine the psychometric quality of the DREEM measure in the context of medical education in Ireland and to explore the construct validity of the device. Methods 239 final year medical students were asked to complete the DREEM inventory. Anonymised responses were entered into a database. Data analysis was performed using PASW 18 and confirmatory factor analysis performed. Results Whilst the total DREEM score had an acceptable level of internal consistency (alpha 0.89), subscale analysis shows that two subscales had sub-optimal internal consistency. Multiple group confirmatory factor analysis (using Fleming\\'s indices) shows an overall fit of 0.76, representing a weak but acceptable level of fit. 17 of the 50 items manifest fit indices less than 0.70. We sought the best fitting oblique solution to the 5-subscale structure, which showed large correlations, suggesting that the independence of the separate scales is open to question. Conclusions There has perhaps been an inadequate focus on establishing and maintaining the psychometric credentials of the DREEM. The present study highlights two concerns. Firstly, the internal consistency of the 5 scales is quite variable and, in our sample, appears rather low. Secondly, the construct validity is not well supported. We suggest that users of the DREEM will provide basic psychometric appraisal of the device in future

  10. A psychometric appraisal of the DREEM

    Directory of Open Access Journals (Sweden)

    Hammond Sean M

    2012-01-01

    Full Text Available Abstract Background The quality of the Educational environment is a key determinant of a student centred curriculum. Evaluation of the educational environment is an important component of programme appraisal. In order to conduct such evaluation use of a comprehensive, valid and reliable instrument is essential. One of most widely used contemporary tools for evaluation of the learning environment is the Dundee Ready Education Environment Measure (DREEM. Apart from the initial psychometric evaluation of the DREEM, few published studies report its psychometric properties in detail. The aim of this study was to examine the psychometric quality of the DREEM measure in the context of medical education in Ireland and to explore the construct validity of the device. Methods 239 final year medical students were asked to complete the DREEM inventory. Anonymised responses were entered into a database. Data analysis was performed using PASW 18 and confirmatory factor analysis performed. Results Whilst the total DREEM score had an acceptable level of internal consistency (alpha 0.89, subscale analysis shows that two subscales had sub-optimal internal consistency. Multiple group confirmatory factor analysis (using Fleming's indices shows an overall fit of 0.76, representing a weak but acceptable level of fit. 17 of the 50 items manifest fit indices less than 0.70. We sought the best fitting oblique solution to the 5-subscale structure, which showed large correlations, suggesting that the independence of the separate scales is open to question. Conclusions There has perhaps been an inadequate focus on establishing and maintaining the psychometric credentials of the DREEM. The present study highlights two concerns. Firstly, the internal consistency of the 5 scales is quite variable and, in our sample, appears rather low. Secondly, the construct validity is not well supported. We suggest that users of the DREEM will provide basic psychometric appraisal of the

  11. Construct validation and the Rasch model: functional ability of healthy elderly people

    DEFF Research Database (Denmark)

    Avlund, K; Kreiner, S; Schultz-Larsen, K

    1993-01-01

    The purpose of this study was to test the construct validity of a measure of functional ability, developed with the intention of achieving a high degree of variability and capacity for discriminating among a group of healthy elderly people. Data were collected from 734 70-year-old people in Denmark...... in the county of Copenhagen. Functional ability was measured with the traditional activities of daily living and with a classification system developed specially for healthy elderly people. Construct validity was tested by the Rasch model for item analysis, addressing specifically the internal validity...

  12. Using Rasch Modeling to Re-Evaluate Rapid Malaria Diagnosis Test Analyses

    Directory of Open Access Journals (Sweden)

    Dawit G. Ayele

    2014-06-01

    Full Text Available The objective of this study was to demonstrate the use of the Rasch model by assessing the appropriateness of the demographic, social-economic and geographic factors in providing a total score in malaria RDT in accordance with the model’s expectations. The baseline malaria indicator survey was conducted in Amhara, Oromiya and Southern Nation Nationalities and People (SNNP regions of Ethiopia by The Carter Center in 2007. The result shows high reliability and little disordering of thresholds with no evidence of differential item functioning.

  13. Using the Rasch model as an objective and probabilistic technique to integrate different soil properties

    Science.gov (United States)

    Rebollo, Francisco J.; Jesús Moral García, Francisco

    2016-04-01

    Soil apparent electrical conductivity (ECa) is one of the simplest, least expensive soil measurements that integrates many soil properties affecting crop productivity, including, for instance, soil texture, water content, and cation exchange capacity. The ECa measurements obtained with a 3100 Veris sensor, operating in both shallow (0-30 cm), ECs, and deep (0-90 cm), ECd, mode, can be used as an additional and essential information to be included in a probabilistic model, the Rasch model, with the aim of quantifying the overall soil fertililty potential in an agricultural field. This quantification should integrate the main soil physical and chemical properties, with different units. In this work, the formulation of the Rasch model integrates 11 soil properties (clay, silt and sand content, organic matter -OM-, pH, total nitrogen -TN-, available phosphorus -AP- and potassium -AK-, cation exchange capacity -CEC-, ECd, and ECs) measured at 70 locations in a field. The main outputs of the model include a ranking of all soil samples according to their relative fertility potential and the unexpected behaviours of some soil samples and properties. In the case study, the considered soil variables fit the model reasonably, having an important influence on soil fertility, except pH, probably due to its homogeneity in the field. Moreover, ECd, ECs are the most influential properties on soil fertility and, on the other hand, AP and AK the less influential properties. The use of the Rasch model to estimate soil fertility potential (always in a relative way, taking into account the characteristics of the studied soil) constitutes a new application of great practical importance, enabling to rationally determine locations in a field where high soil fertility potential exists and establishing those soil samples or properties which have any anomaly; this information can be necessary to conduct site-specific treatments, leading to a more cost-effective and sustainable field

  14. Rasch analysis in the development of a rating scale for assessment of mobility after stroke

    DEFF Research Database (Denmark)

    Engberg, A; Garde, B; Kreiner, S

    1995-01-01

    The study describes the development of a rating scale for assessment of mobility after stroke. It was based on 74 first-stroke patients, 40 men and 34 women, each assessed three times during rehabilitation. Their median age was 69 years, and they represented all degrees of severity of paresis. Co...... in the 10-item subscores; 3) the score sum is independent of age, side of hemiparesis, and gender of the patient. Latent trait analysis (Rasch) was found to be an ideal model for statistical investigation of these properties....

  15. The Marke-Nyman temperament scale. Evaluation of transferability using the Rasch item analysis.

    Science.gov (United States)

    Bech, P; Allerup, P; Rosenberg, R

    1978-01-01

    The purpose of this study was to test the transferability of the Marke-Nymann Temperament Scale (MNTS) using the Rasch item analysis. The results showed that the three Sjöbring personality dimensions Validity, Stability, and Solidity measured by the MNTS were without transferability. However, the item analysis demonstrated a subscale for each of the three Sjöbring dimensions having adequate transferability, i.e. the subscales continued to test the same dimension in different groups of patients. These subscales still cover much of the range of the original descriptions by Sjöbring.

  16. Applications of the Linear Logistic Test Model in Psychometric Research

    Science.gov (United States)

    Kubinger, Klaus D.

    2009-01-01

    The linear logistic test model (LLTM) breaks down the item parameter of the Rasch model as a linear combination of some hypothesized elementary parameters. Although the original purpose of applying the LLTM was primarily to generate test items with specified item difficulty, there are still many other potential applications, which may be of use…

  17. Analysis of Rater Agreement by Rasch and IRT Models

    DEFF Research Database (Denmark)

    Petersen, Jørgen Holm

    2013-01-01

    This chapter first discusses the use of item response theory (IRT) model for the analysis of agreement between raters in a situation where all raters have supplied dichotomous ratings of the same cases in a sample. Next, the chapter describes two approaches to the quantification of the rater...

  18. Controlling Guessing Bias in the Dichotomous Rasch Model Applied to a Large-Scale, Vertically Scaled Testing Program

    Science.gov (United States)

    Andrich, David; Marais, Ida; Humphry, Stephen Mark

    2016-01-01

    Recent research has shown how the statistical bias in Rasch model difficulty estimates induced by guessing in multiple-choice items can be eliminated. Using vertical scaling of a high-profile national reading test, it is shown that the dominant effect of removing such bias is a nonlinear change in the unit of scale across the continuum. The…

  19. Making Meaningful Measurement in Survey Research: A Demonstration of the Utility of the Rasch Model. IR Applications. Volume 28

    Science.gov (United States)

    Royal, Kenneth D.

    2010-01-01

    Quality measurement is essential in every form of research, including institutional research and assessment. This paper addresses the erroneous assumptions institutional researchers often make with regard to survey research and provides an alternative method to producing more valid and reliable measures. Rasch measurement models are discussed and…

  20. Construct validity of scores/measures from a developmental assessment in mathematics using classical and many-facet Rasch measurement.

    Science.gov (United States)

    Banerji, M

    2000-01-01

    Data from a developmental assessment comprised of 9 short answer mathematics tasks were validated using classical and three-faceted Rasch measurement methods. Field test data from a mixed age elementary school sample (N=280) were analyzed. Descriptive statistics on scores from the overall scale and two subdomains indicated improved performance with age. The data showed better fit with a two-factor model corresponding with the subdomain structure (Bentler's CFI=.94), than a one factor model (CFI=.87). The inter-factor correlation was.76. Convergent validity coefficients of scores with scaled scores of the Stanford AchievementTest mathematics battery ranged from.28 to.47; internal consistency reliability of the total and subdomain scores ranged from.87 to.89, respectively; and median inter-rater reliability was.75. On average, persons, tasks and raters showed acceptable fit with the three-facet Rasch model. Rasch logit difficulties of tasks suggested an ordered scale structure, although tasks tended to have high difficulty levels. The original and calibrated task ordering was consistent at the extreme ends of the scale. Gaps identified on the Rasch item map suggested a need for additional task construction. Conceptual and procedural differences in each technique are considered in deciding future improvements to the scale.

  1. Using the Rasch Model to Measure Students' Attitudes toward Science in "Low Performing" Secondary Schools in Malaysia

    Science.gov (United States)

    Zain, Ahmad Nurulazam Md; Samsudin, Mohd Ali; Rohandi, Robertus; Jusoh, Azman

    2010-01-01

    The objective of the study was to examine students' attitudes toward learning science in three "low performing" secondary schools in Penang, Malaysia. 214 students from these schools were involved in completing a questionnaire containing items consisting of six constructs. Data collected were analyzed using Rasch modeling. Students in…

  2. Measuring Engagement in Later Life Activities: Rasch-Based Scenario Scales for Work, Caregiving, Informal Helping, and Volunteering

    Science.gov (United States)

    Ludlow, Larry H.; Matz-Costa, Christina; Johnson, Clair; Brown, Melissa; Besen, Elyssa; James, Jacquelyn B.

    2014-01-01

    The development of Rasch-based "comparative engagement scenarios" based on Guttman's facet theory and sentence mapping procedures is described. The scenario scales measuring engagement in work, caregiving, informal helping, and volunteering illuminate the lived experiences of role involvement among older adults and offer multiple…

  3. A comparison of Rasch with Likert scoring to discriminate between patients' evaluations of total hip replacement surgery.

    Science.gov (United States)

    Fitzpatrick, R; Norquist, J M; Jenkinson, C; Reeves, B C; Morris, R W; Murray, D W; Gregg, P J

    2004-03-01

    The purpose of this study was to examine whether there are advantages in terms of outcome assessment of using Rasch methods of scoring the 12-item Oxford Hip Score (OHS) questionnaire over conventionally Likert scores. As part of a prospective cohort study of total hip replacements in five former regions of England the OHS was sent to patients pre-operatively, at 3 months and 1 year post-operatively. Post-operative data was collected on over 5000 cases. Based on the level of satisfaction with surgery, patients were divided into satisfied and dissatisfied. Analyses were performed to test the relative precision (RP) of Rasch scoring vs. conventionally Likert scores in discriminating the groups experiencing different level of satisfaction. Considerable gains in precision were achieved with Rasch scoring methods when groups were compared 3 and 12 months post-operatively. The results from the current study suggest that in some situations there may be substantial gains in measuring health related outcomes using Rasch-based scoring methods.

  4. A Computer Program for Solving a Set of Conditional Maximum Likelihood Equations Arising in the Rasch Model for Questionnaires.

    Science.gov (United States)

    Andersen, Erling B.

    A computer program for solving the conditional likelihood equations arising in the Rasch model for questionnaires is described. The estimation method and the computational problems involved are described in a previous research report by Andersen, but a summary of those results are given in two sections of this paper. A working example is also…

  5. Joint and Conditional Maximum Likelihood Estimation for the Rasch Model for Binary Responses. Research Report. RR-04-20

    Science.gov (United States)

    Haberman, Shelby J.

    2004-01-01

    The usefulness of joint and conditional maximum-likelihood is considered for the Rasch model under realistic testing conditions in which the number of examinees is very large and the number is items is relatively large. Conditions for consistency and asymptotic normality are explored, effects of model error are investigated, measures of prediction…

  6. Rasch analysis reveals comparative analyses of ADL/IADL summary scores from different residential settings is inappropriate

    NARCIS (Netherlands)

    Lutomski, Jennifer E; Krabbe, Paul Fm; den Elzen, Wendy Pj; Olde-Rikkert, Marcel Gm; Steyerberg, Ewout W; Muntinga, Maaike E; Bleijenberg, Nienke; Kempen, Gertrudis Ijm; Melis, René Jf

    2015-01-01

    OBJECTIVE: To internally validate a 15-item dichotomous Activities of Daily Living and Instrumental Activities of Daily Living (ADL/IADL) Index. METHODS: Data were extracted from The Older Persons and Informal Caregivers Survey Minimal DataSet (TOPICS-MDS). Using Rasch modelling, six aspects of the

  7. Multidimensional Rasch Analysis of a Psychological Test with Multiple Subtests: A Statistical Solution for the Bandwidth-Fidelity Dilemma

    Science.gov (United States)

    Cheng, Ying-Yao; Wang, Wen-Chung; Ho, Yi-Hui

    2009-01-01

    Educational and psychological tests are often composed of multiple short subtests, each measuring a distinct latent trait. Unfortunately, short subtests suffer from low measurement precision, which makes the bandwidth-fidelity dilemma inevitable. In this study, the authors demonstrate how a multidimensional Rasch analysis can be employed to take…

  8. [Rasch analysis on stroke-specific quality of life (SS-QOL) scale of acupuncture intervention on stroke].

    Science.gov (United States)

    Hui, Jian-Rong; Pei, Jian; Wang, Yuan-Chun; Hui, Jian-Ping; Fu, Qin-Hui; Song, Yi; Li, Hai-Yan; Liu, Zhi-Dan

    2013-04-01

    To optimize the evaluation level of active motor threshold and the functional domain of upper limbs of stroke-specific quality of life (SS-QOL) scale with Rasch analysis. Sixty patients with acute ischemic stroke that were in accord with research criterid were randomly divided into a test group (30 cases) and a control group (30 cases). Acupuncture treatment and routine western medicine were applied on the test group, and single treatment of routine western medicine was applied on the control group. Selected acupoints were MS 5, Fengchi (GB 20), Hegu (LI 4), etc. Active motor threshold and the functional domain of upper limbs of SS-QOL were self-tested by patients after one treating course. The characteristics of the above mentioned items were tested with Rasch model. The statistical result on fitness of active motor threshold and the functional domain of upper limbs of SS-QOL showed that every reference of samples and items wosin accord with the Rasch model and has well inner reliability and validity. The Infit and Outfit MnSq values of active motor threshold and the functional domain of upper limbs of SS-QOL are basically between 0.5 and 1.5. The application of Rasch analysis on the assessment of patient reported outcome (PRO) has optimized the PRO scale (the activity and upper limb function domain of SS-QOL scale) and enhanced evaluation level of active motor threshold and the functional domain of upper limbs of SS-QOL scale.

  9. Rasch Analysis of the Adult Strabismus Quality of Life Questionnaire (AS-20 among Chinese Adult Patients with Strabismus.

    Directory of Open Access Journals (Sweden)

    Zonghua Wang

    Full Text Available The impact of strabismus on visual function, self-image, self-esteem, and social interactions decrease health-related quality of life (HRQoL.The purpose of this study was to evaluate and refine the adult strabismus quality of life questionnaire (AS-20 by using Rasch analysis among Chinese adult patients with strabismus.We evaluated the fitness of the AS-20 with Rasch model in Chinese population by assessing unidimensionality, infit and outfit, person and item separation index and reliability, response ordering, targeting and differential item functioning (DIF.The overall AS-20 did not demonstrate unidimensional; however, it was achieved separately in the two Rasch-revised subscales: the psychosocial subscale (11 items and the function subscale (9 items. The features of good targeting, optimal item infit and outfit, and no notable local dependence were found for each of the subscales. The rating scale was appropriate for the psychosocial subscale but a reduction to four response categories was required for the function subscale. No significant DIF were revealed for any demographic and clinical factors (e.g., age, gender, and strabismus types.The AS-20 was demonstrated by Rasch analysis to be a rigorous instrument for measuring health-related quality of life in Chinese strabismus patents if some revisions were made regarding the subscale construct and response options.

  10. Using the Rasch measurement model to design a report writing assessment instrument.

    Science.gov (United States)

    Carlson, Wayne R

    2013-01-01

    This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

  11. Blooms' separation of the final exam of Engineering Mathematics II: Item reliability using Rasch measurement model

    Science.gov (United States)

    Fuaad, Norain Farhana Ahmad; Nopiah, Zulkifli Mohd; Tawil, Norgainy Mohd; Othman, Haliza; Asshaari, Izamarlina; Osman, Mohd Hanif; Ismail, Nur Arzilah

    2014-06-01

    In engineering studies and researches, Mathematics is one of the main elements which express physical, chemical and engineering laws. Therefore, it is essential for engineering students to have a strong knowledge in the fundamental of mathematics in order to apply the knowledge to real life issues. However, based on the previous results of Mathematics Pre-Test, it shows that the engineering students lack the fundamental knowledge in certain topics in mathematics. Due to this, apart from making improvements in the methods of teaching and learning, studies on the construction of questions (items) should also be emphasized. The purpose of this study is to assist lecturers in the process of item development and to monitor the separation of items based on Blooms' Taxonomy and to measure the reliability of the items itself usingRasch Measurement Model as a tool. By using Rasch Measurement Model, the final exam questions of Engineering Mathematics II (Linear Algebra) for semester 2 sessions 2012/2013 were analysed and the results will provide the details onthe extent to which the content of the item providesuseful information about students' ability. This study reveals that the items used in Engineering Mathematics II (Linear Algebra) final exam are well constructed but the separation of the items raises concern as it is argued that it needs further attention, as there is abig gap between items at several levels of Blooms' cognitive skill.

  12. Rasch analysis of the orientation log and reconsideration of the latent construct during inpatient rehabilitation.

    Science.gov (United States)

    Kean, Jacob; Abell, Malene; Malec, James F; Trzepacz, Paula T

    2011-01-01

    To investigate the measurement properties of the Orientation Log (O-Log) and a hybrid scale using Rasch analysis techniques and to explore the relations between the items of the 2 scales and the latent linear construct modeled in the Rasch analysis. Calibration of data collected weekly during inpatient rehabilitation. Ninety patients admitted for rehabilitation after traumatic brain injury. Measure reliability/construct validity of the O-Log was too low to justify restructuring of disordered rating scales, but the broader set of items in the hybrid scale demonstrated good measure reliability/construct validity prior to and following rating scale restructuring. Both O-Log and hybrid measures demonstrated statistical fit with the linear latent construct, suggesting that orientation and memory are only a subset of symptoms in a broader syndrome. Posttraumatic amnesia is by definition a proxy measure of a broader syndrome during early recovery and not a measure of the syndrome itself. The results suggest that the O-Log cannot reliably measure progress during early recovery. Furthermore, the analysis suggests that the construct of posttraumatic amnesia is too narrow and should be revisited to improve monitoring of recovery and prognostic estimation after brain injury.

  13. Measuring Validity And Reliability of Perception of Online Collaborative Learning Questionnaire Using Rasch Model

    Directory of Open Access Journals (Sweden)

    Sharifah Nadiyah Razali

    2016-12-01

    Full Text Available This study aims to generate empirical evidence on the validity and reliability of Perception of Online Collaborative Learning Questionnaire (POCLQ using Rasch model. The questionnaire was distributed to 32 (N=32 Diploma Hotel Catering students from Politeknik Ibrahim Sultan, Johor (PIS. Data obtained was analysed using WINSTEP version 3.68 software. The finding showed that POCLQ had high reliability with five categories of difficulties items. So, it can be concluded that POCLQ is reliable and strongly accepted. Meanwhile, analysis of items fit showed there were six items that are not in the specified range and based on standardised residual correlation measurement value; there were five items found to be overlapped that should be dropped. All the items that needed to be dropped based on the analysis of result had been refined and retained for the purpose of the study and based on expert's view. Therefore, all items remained after Rasch analysis. It is hoped that this study will give emphasis to other researchers about the importance of analysing items to ensure the quality of an instrument being developed.

  14. Multi-faceted Rasch measurement and bias patterns in EFL writing performance assessment.

    Science.gov (United States)

    He, Tung-Hsien; Gou, Wen Johnny; Chien, Ya-Chen; Chen, I-Shan Jenny; Chang, Shan-Mao

    2013-04-01

    This study applied multi-faceted Rasch measurement to examine rater bias in the assessment of essays written by college students learning English as a foreign language. Four raters who had received different academic training from four distinctive disciplines applied a six-category rating scale to analytically rate essays on an argumentative topic and on a descriptive topic. FACETS, a Rasch computer program, was utilized to pinpoint bias patterns by analyzing the rater-topic, rater-category, and topic-category interactions. Results showed: argumentative essays were rated more severely than were descriptive essays; the linguistics-major rater was the most lenient rater, while the literature-major rater was the severest one; and the category of language use received the severest ratings, whereas content was given the most lenient ratings. The severity hierarchies for raters, essay topics, and rating categories suggested that raters' academic training and their perceptions of the importance of categories were associated with their bias patterns. Implications for rater training are discussed.

  15. Measuring teacher dispositions using the DAATS battery: a multifaceted Rasch analysis of rater effect.

    Science.gov (United States)

    Lang, W Steve; Wilkerson, Judy R; Rea, Dorothy C; Quinn, David; Batchelder, Heather L; Englehart, Dierdre S; Jennings, Kelly J

    2014-01-01

    The purpose of this study was to examine the extent to which raters' subjectivity impacts measures of teacher dispositions using the Dispositions Assessments Aligned with Teacher Standards (DAATS) battery. This is an important component of the collection of evidence of validity and reliability of inferences made using the scale. It also provides needed support for the use of subjective affective measures in teacher training and other professional preparation programs, since these measures are often feared to be unreliable because of rater effect. It demonstrates the advantages of using the Multi-Faceted Rasch Model as a better alternative to the typical methods used in preparation programs, such as Cohen's Kappa. DAATS instruments require subjective scoring using a six-point rating scale derived from the affective taxonomy as defined by Krathwohl, Bloom, and Masia (1956). Rater effect is a serious challenge and can worsen or drift over time. Errors in rater judgment can impact the accuracy of ratings, and these effects are common, but can be lessened through training of raters and monitoring of their efforts. This effort uses the multifaceted Rasch measurement models (MFRM) to detect and understand the nature of these effects.

  16. Clinical usefulness of the clock drawing test applying rasch analysis in predicting of cognitive impairment.

    Science.gov (United States)

    Yoo, Doo Han; Lee, Jae Shin

    2016-07-01

    [Purpose] This study examined the clinical usefulness of the clock drawing test applying Rasch analysis for predicting the level of cognitive impairment. [Subjects and Methods] A total of 187 stroke patients with cognitive impairment were enrolled in this study. The 187 patients were evaluated by the clock drawing test developed through Rasch analysis along with the mini-mental state examination of cognitive evaluation tool. An analysis of the variance was performed to examine the significance of the mini-mental state examination and the clock drawing test according to the general characteristics of the subjects. Receiver operating characteristic analysis was performed to determine the cutoff point for cognitive impairment and to calculate the sensitivity and specificity values. [Results] The results of comparison of the clock drawing test with the mini-mental state showed significant differences in according to gender, age, education, and affected side. A total CDT of 10.5, which was selected as the cutoff point to identify cognitive impairement, showed a sensitivity, specificity, Youden index, positive predictive, and negative predicive values of 86.4%, 91.5%, 0.8, 95%, and 88.2%. [Conclusion] The clock drawing test is believed to be useful in assessments and interventions based on its excellent ability to identify cognitive disorders.

  17. Construct Validity of Four Frailty Measures in an Older Australian Population: A Rasch Analysis.

    Science.gov (United States)

    Widagdo, I S; Pratt, N; Russell, M; Roughead, E E

    2016-01-01

    Individuals identified as frail have been shown to be at an increased risk of adverse health outcomes. However, there is no gold standard frailty measure and frailty status can vary depending on the measure used, suggesting the measures perform differently. Construct validity can be used to assess a measure's performance. This study aimed to examine the construct validity of four frailty measures in an Australian older population using Rasch analysis. Frailty status among the 2087 participants aged 65 years and above from the Australian Longitudinal Study of Ageing (ALSA) was assessed using: frailty phenotype--FP, simplified frailty phenotype--SFP, frailty index--FI, and prognostic frailty score--PFS. Rasch analysis was used to assess the unidimensionality of the measures, which is the extent to which the underlying characteristic of frailty is assessed. The criteria for unidimensionality from principal component analysis of the residuals was when 50% or more of the raw variance was explained by the measures, and less than 5% was unexplained variance. Only FI meet the unidimensionality criteria with 74% of explained variance and 2.1% of unexplained variance. SFP did not show a unidimensional construct with 13.3% of explained variance and 47.1% of unexplained variance. FP and PFS had 39.6%, 18.1% and 46.5%, 8.7% of explained and unexplained variance, respectively. Our findings showed that FI has better construct validity than the other three measures in assessing frailty among the Australian older population.

  18. Using the Bootstrap Method to Evaluate the Critical Range of Misfit for Polytomous Rasch Fit Statistics.

    Science.gov (United States)

    Seol, Hyunsoo

    2016-06-01

    The purpose of this study was to apply the bootstrap procedure to evaluate how the bootstrapped confidence intervals (CIs) for polytomous Rasch fit statistics might differ according to sample sizes and test lengths in comparison with the rule-of-thumb critical value of misfit. A total of 25 simulated data sets were generated to fit the Rasch measurement and then a total of 1,000 replications were conducted to compute the bootstrapped CIs under each of 25 testing conditions. The results showed that rule-of-thumb critical values for assessing the magnitude of misfit were not applicable because the infit and outfit mean square error statistics showed different magnitudes of variability over testing conditions and the standardized fit statistics did not exactly follow the standard normal distribution. Further, they also do not share the same critical range for the item and person misfit. Based on the results of the study, the bootstrapped CIs can be used to identify misfitting items or persons as they offer a reasonable alternative solution, especially when the distributions of the infit and outfit statistics are not well known and depend on sample size.

  19. A Rasch scaling validation of a 'core' near-death experience.

    Science.gov (United States)

    Lange, Rense; Greyson, Bruce; Houran, James

    2004-05-01

    For those with true near-death experiences (NDEs), Greyson's (1983, 1990) NDE Scale satisfactorily fits the Rasch rating scale model, thus yielding a unidimensional measure with interval-level scaling properties. With increasing intensity, NDEs reflect peace, joy and harmony, followed by insight and mystical or religious experiences, while the most intense NDEs involve an awareness of things occurring in a different place or time. The semantics of this variable are invariant across True-NDErs' gender, current age, age at time of NDE, and latency and intensity of the NDE, thus identifying NDEs as 'core' experiences whose meaning is unaffected by external variables, regardless of variations in NDEs' intensity. Significant qualitative and quantitative differences were observed between True-NDErs and other respondent groups, mostly revolving around the differential emphasis on paranormal/mystical/religious experiences vs. standard reactions to threat. The findings further suggest that False-Positive respondents reinterpret other profound psychological states as NDEs. Accordingly, the Rasch validation of the typology proposed by Greyson (1983) also provides new insights into previous research, including the possibility of embellishment over time (as indicated by the finding of positive, as well as negative, latency effects) and the potential roles of religious affiliation and religiosity (as indicated by the qualitative differences surrounding paranormal/mystical/religious issues).

  20. Identifying potential misfit items in cognitive process of learning engineering mathematics based on Rasch model

    Science.gov (United States)

    Ataei, Sh; Mahmud, Z.; Khalid, M. N.

    2014-04-01

    The students learning outcomes clarify what students should know and be able to demonstrate after completing their course. So, one of the issues on the process of teaching and learning is how to assess students' learning. This paper describes an application of the dichotomous Rasch measurement model in measuring the cognitive process of engineering students' learning of mathematics. This study provides insights into the perspective of 54 engineering students' cognitive ability in learning Calculus III based on Bloom's Taxonomy on 31 items. The results denote that some of the examination questions are either too difficult or too easy for the majority of the students. This analysis yields FIT statistics which are able to identify if there is data departure from the Rasch theoretical model. The study has identified some potential misfit items based on the measurement of ZSTD where the removal misfit item was accomplished based on the MNSQ outfit of above 1.3 or less than 0.7 logit. Therefore, it is recommended that these items be reviewed or revised to better match the range of students' ability in the respective course.

  1. The Multidimensional Testlet-Effect Rasch Model%多维题组效应Rasch模型

    Institute of Scientific and Technical Information of China (English)

    詹沛达; 王文中; 王立君; 李晓敏

    2014-01-01

    Testlet design has been widely adopted in educational and psychological assessment. A testlet is a cluster of items that share a common stimulus (e.g., a reading comprehension passage or a figure), and the possible local dependence among items within a testlet is called testlet-effect. Various models have been developed to take into account such testlet effect. Examples included the Rasch testlet model, two-parameter logistic Bayesian testlet model, and higher-order testlet model. However, these existing models all assume that an item is affected by only one single testlet effect. Therefore, they are essentially unidimensional testlet-effect models. In practice, multiple testlet effects may simultaneously affect item responses in a testlet. For example, in addition to common stimulus, items can be grouped according to their domains, knowledge units, or item format, such that multiple testlet effects are involved. In essence, an item measures multiple latent traits, in addition to the target latent trait(s) that the test was designed to measure. Existing unidimensional testlet-effect models become inapplicable when multiple testlet effects are involved. To account for multiple testlet effect, in this study we develop the so-called (within-item) multidimensional testlet-effect Rasch model. The parameters can be estimated with marginal maximum likelihood estimation methods or Bayesian methods with Markov chain Monte Carlo (MCMC) algorithms. In this study, a popular computer program for Rasch models, ConQuest, was used. A series of simulations were conducted to evaluate parameter recovery of the new model, consequences of model misspecification, and the effectiveness of model-data fit statistics. Results show that the parameters of the new model can be recovered fairly well; and ignoring the multiple testlet effects resulted in a biased estimation of item parameters, and an overestimation of test reliability. Additionally, it did little harm on parameter estimation to

  2. The Relationship Satisfaction scale - psychometric properties

    OpenAIRE

    Espen Røysamb; Joar Vittersø; Kristian Tambs

    2014-01-01

    The aim of this study was to establish the psychometric properties of the new Relationship Satisfaction (RS) scale. Two population based samples were used: The Norwegian Mother and Child Cohort Study (MoBa, N=117,178) and The Quality of Life study (N=347). Convergent and discriminant validity was investigated in relation to the Quality of Marriage Index (QMI), the Satisfaction With Life Scale (SWLS), Relationship Satisfaction of partner, Big Five personality traits (IPIP50) and future relatio...

  3. The Alliance Negotiation Scale: A psychometric investigation.

    Science.gov (United States)

    Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

    2016-08-01

    This study investigates the utility and psychometric properties of a new measure of psychotherapy process, the Alliance Negotiation Scale (ANS; Doran, Safran, Waizmann, Bolger, & Muran, 2012). The ANS was designed to operationalize the theoretical construct of negotiation (Safran & Muran, 2000), and to extend our current understanding of the working alliance concept (Bordin, 1979). The ANS was also intended to improve upon existing measures such as the Working Alliance Inventory (WAI; Horvath & Greenberg, 1986, 1989) and its short form (WAI-S; Tracey & Kokotovic, 1989) by expanding the emphasis on negative therapy process. The present study investigates the psychometric validity of the ANS test scores and interpretation-including confirming its original factor structure and evaluating its internal consistency and construct validity. Construct validity was examined through the ANS' convergence and divergence with several existing scales that measure theoretically related constructs. The results bolster and extend previous findings about the psychometric integrity of the ANS, and begin to illuminate the relationship between negotiation and other important variables in psychotherapy research. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

  4. Psychometric Assessment of Stereoscopic Head-Mounted Displays

    Science.gov (United States)

    2016-06-29

    Journal Article 3. DATES COVERED (From – To) Jan 2015 - Dec 2015 4. TITLE AND SUBTITLE PSYCHOMETRIC ASSESSMENT OF STEREOSCOPIC HEAD- MOUNTED DISPLAYS...disparity. This paper details the psychometric validation of the stereoscopic rendering of a virtual environment using game-based simulation software...mounted display, near eye display, stereo display, stereo HMD, psychometric assessment, stereoscopic performance, eye-limited stereo vision. 16

  5. Development and psychometric validation of the verbal affective memory test

    DEFF Research Database (Denmark)

    Jensen, Christian Gaden; Hjordt, Liv V; Stenbæk, Dea S

    2015-01-01

    -taboo words. Second, we studied the test's psychometric properties in healthy adults. Finally, we investigated whether individuals diagnosed with Seasonal Affective Disorder (SAD) differed from healthy controls on seasonal changes in affective recall. Recall rates were internally consistent and reliable...... psychometric properties. VAMT-24 seems especially sensitive to measuring positive verbal recall bias, perhaps due to the application of common, non-taboo words. Based on the psychometric and clinical results, we recommend VAMT-24 for international translations and studies of affective memory....

  6. Dependence module of the MINI plus adapted for sugar dependence: psychometric properties Módulo de dependência do MINI plus adaptado para dependência de açúcar: propriedades psicométricas

    Directory of Open Access Journals (Sweden)

    Marco Aurélio Camargo da Rosa

    2013-01-01

    Full Text Available This study aimed to analyze the factorial structure and the scale of measurement of the items for dependence of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV adapted for sugar consumption in order to verify if the structural characteristics can be applied to sugar dependence. The questionnaire was applied to a sample of 500 subjects in Brazil (67% female; mean age: 38 y.o.; 43% from weight control clinics; 63% with normal BMI. An exploratory factor analysis was performed to determine the factorial structure and unidimensionality; and, a Rasch model analysis, to verify unidimensionality and items distribution. The model with best fit is unidimensional. All items had good fit to the Rasch model with a reliability of .99, infit between .86 and 1.14 and outfit from .71 to 1.20. The items of MINI Plus adapted for sugar dependence presented good psychometric properties, suggesting that the dependence criteria of DSM-IV support the verification of the construct for sugar addiction.Analisar a estrutura fatorial e a escala de medida dos critérios de dependência do DSM-IV adaptado para açúcar a fim de verificar se as características estruturais são aplicaveis para dependência de açúcar. O questionário foi aplicado numa amostra de 500 pessoas (67% mulheres; média idade: 38 anos; 43% de clínicas obesidade; 63% IMC normal. A análise fatorial exploratória determinou a estrutura fatorial e unidimensionalidade; a análise de Rasch, a unidimensionalidade e distribuição dos itens. O modelo com melhor ajuste era unidimensional. Todos os itens apresentaram ajustes adequados na análise de Rasch com confiabilidade de 0,99, infit entre 0,86 a 1,14 e outfit entre 0,71 e 1,20. Os itens de dependência do MINI Plus adaptados para açúcar apresentaram boas propriedades psicométricas, sugerindo que os critérios do DSM-IV contribuem na verificação do constructo dependência de açúcar.

  7. Factors Associated with Knowledge of Diabetes in Patients with Type 2 Diabetes Using the Diabetes Knowledge Test Validated with Rasch Analysis: e80593

    National Research Council Canada - National Science Library

    Eva K Fenwick; Jing Xie; Gwyn Rees; Robert P Finger; Ecosse L Lamoureux

    2013-01-01

      Objective In patients with Type 2 diabetes, to determine the factors associated with diabetes knowledge, derived from Rasch analysis, and compare results with a traditional raw scoring method. Research Design...

  8. [The methodological assessment and qualitative evaluation of psychometric performance tests based on the example of modern tests that assess reading and spelling skills].

    Science.gov (United States)

    Galuschka, Katharina; Rothe, Josefine; Schulte-Körne, Gerd

    2015-09-01

    This article looks at a means of objectively evaluating the quality of psychometric tests. This approach enables users to evaluate psychometric tests based on their methodological characteristics, in order to decide which instrument should be used. Reading and spelling assessment tools serve as examples. The paper also provides a review of German psychometric tests for the assessment of reading and spelling skills. This method facilitates the identification of psychometric tests.of high methodological quality which can be used for the assessment of reading and spelling skills. Reading performance should ideally be assessed with the following instruments: ELFE 1-6, LGVT 6-12, LESEN 6-7, LESEN 8-9, or WLLP-R. The tests to be used for the evaluation of spelling skills are DERET 1-2+, DERET 3-4+, WRT 1+, WRT 2+, WRT 3+, WRT 4+ or HSP 1-10.

  9. Discordance between Psychometric Testing and Questionnaire-Based Definitions of Executive Function Deficits in Individuals with ADHD

    Science.gov (United States)

    Biederman, Joseph; Petty, Carter R.; Fried, Ronna; Black, Sarah; Faneuil, Alicia; Doyle, Alysa E.; Seidman, Larry J.; Faraone, Stephen V.

    2008-01-01

    Objective: One suspected source of negative outcomes associated with ADHD has been deficits in executive functions. Although both psychometrically defined and self-reported executive function deficits (EFDs) have been shown to be associated with poor academic and occupational outcomes, whether these two approaches define the same individuals…

  10. Assessment of the Measurement Properties of the NHCAHPS Family Survey: A Rasch Scaling Approach

    Science.gov (United States)

    O'Connor, Matthew S.

    2013-01-01

    The introduction of the Consumer Assessment of Healthcare Providers and Systems (CAHPS), a family of survey instruments designed to capture and report people's experiences obtaining health care could soon add satisfaction as a consistent dimension of quality that skilled nursing facilities (SNFs) are required to assess and report. The SNF setting…

  11. A Range-Null Hypothesis Approach for Testing DIF under the Rasch Model

    Science.gov (United States)

    Wells, Craig S.; Cohen, Allan S.; Patton, Jeffrey

    2009-01-01

    A primary concern with testing differential item functioning (DIF) using a traditional point-null hypothesis is that a statistically significant result does not imply that the magnitude of DIF is of practical interest. Similarly, for a given sample size, a non-significant result does not allow the researcher to conclude the item is free of DIF. To…

  12. Developing the Communicative Participation Item Bank: Rasch Analysis Results from a Spasmodic Dysphonia Sample

    Science.gov (United States)

    Baylor, Carolyn R.; Yorkston, Kathryn M.; Eadie, Tanya L.; Miller, Robert M.; Amtmann, Dagmar

    2009-01-01

    Purpose: The purpose of this study was to conduct the initial psychometric analyses of the Communicative Participation Item Bank--a new self-report instrument designed to measure the extent to which communication disorders interfere with communicative participation. This item bank is intended for community-dwelling adults across a range of…

  13. Pilot Study of Industry Perspective on Requirement Engineering Education: Measurement of Rasch Analysis

    Directory of Open Access Journals (Sweden)

    NOR AZLIANA AKMAL JAMALUDIN

    2013-09-01

    Full Text Available Software development industry identifies that human-based give a significant problem in Requirement Engineering. To that reason, education gives a substantial impact in delivering a skill worker and should be a medium to reduce the problem. Survey question was distributed among ICT for this pilot study to the organization of MSC status in Malaysia for pilot study. 15.53% (N = 32 respondent successfully return their respond back. The result shows that only 27 person is analyzed regarding to misfit data provided by Rasch Measurement Model. The unidimensionality, person-item map and misfit data are discussed. Research objective to identify the undergraduate problem in Requirement Engineering education is achieved. Future work will be discussed on further analysis on actual survey to improve employability skill among software engineering undergraduate students.

  14. Evaluating a technical university's placement test using the Rasch measurement model

    Science.gov (United States)

    Salleh, Tuan Salwani; Bakri, Norhayati; Zin, Zalhan Mohd

    2016-10-01

    This study discusses the process of validating a mathematics placement test at a technical university. The main objective is to produce a valid and reliable test to measure students' prerequisite knowledge to learn engineering technology mathematics. It is crucial to have a valid and reliable test as the results will be used in a critical decision making to assign students into different groups of Technical Mathematics 1. The placement test which consists of 50 mathematics questions were tested on 82 new diplomas in engineering technology students at a technical university. This study employed rasch measurement model to analyze the data through the Winsteps software. The results revealed that there are ten test questions lower than less able students' ability. Nevertheless, all the ten questions satisfied infit and outfit standard values. Thus, all the questions can be reused in the future placement test at the technical university.

  15. Rasch Analysis of Scientific Literacy in an Astronomical Citizen Science Project

    Science.gov (United States)

    Price, A.

    2012-06-01

    (Abstract only) We investigate change in attitudes towards science and belief in the nature of science by participants in a citizen science project about astronomy. A pre-test was given to 1,385 participants and a post-test was given six months later to 165 participants. Nine participants were interviewed. Responses were analyzed using the Rasch Rating Scale Model to place Likert data on an interval scale allowing for more sensitive parametric analysis. Results show that overall attitudes did not change, p = .225. However, there was significant change towards attitudes relating to science news (positive) and scientific self efficacy (negative), p = .001 and p = .035, respectively. This change was related to social activity in the project. Beliefs in the nature of science exhibited a small but significant increase, p = .04. Relative positioning of scores on the belief items suggests the increase is mostly due to reinforcement of current beliefs.

  16. El modelo de rasch en dirección de operaciones

    Directory of Open Access Journals (Sweden)

    Lidia Sanchez

    2012-11-01

    Full Text Available Durante décadas, en el área de Dirección de Operaciones, se ha destacado la necesidad de un acercamiento entre el mundo académico y el profesional, reclamando la realización de estudios empíricos que aporten soluciones prácticas a los profesionales. De ahí que durante los últimos años se hayan producido dos fenómenos clave: la convergencia entre los temas objeto de investigación y los temas de interés para las empresas; y un aumento en el  número de estudios empíricos realizados.Ahora bien, otro factor importantísimo a la hora de aportar conocimientos prácticos a la disciplina es la herramienta o metodología aplicada. Por ello, el desarrollo de nuevas herramientas o la aplicación de otras ya existentes en otros campos es un tema interesante. Es en este punto donde adquiere importancia la Metodología de Rasch.Esta técnica ha sido tradicionalmente utilizada en disciplinas tales como la Psicología o la Medicina. Sin embargo, ya hace algunos años, ha comenzado a utilizarse en otras áreas de conocimiento, entre ellas, el área de Administración y Dirección de Empresas. No obstante, su aplicación al área concreta de Operaciones es escasa y, por ello, las posibilidades de desarrollo e investigaciones futuras son numerosas.La Metodología de Rasch, útil para el diseño y la explotación de encuestas, se basa en tres principios, unidimensionalidad, aditividad e invarianza, y permite obtener medidas objetivas a partir del análisis de variables categóricas. Entre sus múltiples aplicaciones destacamos las siguientes: análisis de la viabilidad y fiabilidad globales, análisis de la unidimensionalidad del constructo, análisis de escalas del cuestionario, priorización (ordenación de los ítems y/o de los sujetos, análisis DAFO… Es, por lo tanto, una metodología muy rica con multitud de posibilidades para su aplicación en la disciplina.Dado su incipiente desarrollo en esta área de conocimiento el objetivo de este

  17. Codependency: predictors and psychometric issues.

    Science.gov (United States)

    Lindley, N R; Giordano, P J; Hammer, E D

    1999-01-01

    This study examined the relationships between codependency and age, gender, self-confidence, autonomy, and succorance, which is the quality of soliciting emotional support from others. The study also tested the validity of the Spann-Fischer Codependency Scale (Fischer, Spann, & Crawford, 1991). Ninety-five undergraduates completed a demographic sheet, the Adjective Check List (Gough & Heilbrun, 1983), the Spann-Fischer Codependency Scale, the Co-Dependents Anonymous Checklist (Whitfield, 1991), and a questionnaire developed for this study based on the work of Hemfelt, Minirth, and Meier (1989). As predicted, codependency was negatively related to self-confidence and positively related to succorance. However, contrary to expectation, a negative relationship between codependency and autonomy was not found. In addition, low self-confidence was the strongest predictor of codependency. Finally, all three measures of codependency were strongly related, attesting to the convergent validity of the Spann-Fischer Codependency Scale. Future studies should further investigate the role of emotional autonomy and codependency and should begin to utilize an experimental approach, making predictions regarding the behavior of codependent and noncodependent persons in experimental situations.

  18. Using Rasch models to develop and validate an environmental thinking learning progression

    Science.gov (United States)

    Hashimoto-Martell, Erin A.

    Environmental understanding is highly relevant in today's global society. Social, economic, and political structures are connected to the state of environmental degradation and exploitation, and disproportionately affect those in poor or urban communities (Brulle & Pellow, 2006; Executive Order No. 12898, 1994). Environmental education must challenge the way we live, and our social and ecological quality of life, with the goal of responsible action. The development of a learning progression in environmental thinking, along with a corresponding assessment, could provide a tool that could be used across environmental education programs to help evaluate and guide programmatic decisions. This study sought to determine if a scale could be constructed that allowed individuals to be ordered along a continuum of environmental thinking. First, I developed the Environmental Thinking Learning Progression, a scale of environmental thinking from novice to advanced, based on the current available research and literature. The scale consisted of four subscales, each measuring a different aspect of environmental thinking: place consciousness, human connection, agency, and science concepts. Second, a measurement instrument was developed, so that the data appropriately fit the model using Rasch analysis. A Rasch analysis of the data placed respondents along a continuum, given the range of item difficulty for each subscale. Across three iterations of instrument revision and data collection, findings indicated that the items were ordered in a hierarchical way that corresponded to the construct of environmental thinking. Comparisons between groups showed that the average score of respondents who had participated in environmental education programs was significantly higher than those who had not. A comparison between males and females showed no significant difference in average measure, however, there were varied significant differences between how racial/ethnic groups performed. Overall

  19. Care Dependency Scale - psychometric testing of the Polish version

    NARCIS (Netherlands)

    Dijkstra, Ate; Muszalik, Marta; Kedziora-Kornatowska, Kornelia; Kornatowski, Tomasz

    2010-01-01

    The importance of this study lies in the availability of psychometrically sound assessment instruments, which are of critical importance for the study of patient's care dependency and the provision of care to these patients. The aim of this study was to identify the psychometric properties of the Ca

  20. Psychometric Characteristics of the Gesell School Readiness Screening Test.

    Science.gov (United States)

    Lichtenstein, Robert

    The Gesell School Readiness Screening Test (GSRST) is widely used to identify "developmentally immature" children for placement in extra-year, transition programs in spite of a problematic absence of psychometric evidence and research support. In this study of psychometric characteristics of the GSRST, teacher ratings of classroom performance and…

  1. Psychometric Evaluation and Discussions of English Language Learners' Listening Comprehension

    Science.gov (United States)

    Seo, Daeryong; Taherbhai, Husein; Frantz, Roger

    2016-01-01

    The importance of listening in the context of English language acquisition is gaining acceptance, but its unique attributes in language performance, while substantively and qualitatively justifiable, are generally not psychometrically defined. This article psychometrically supports listening as a distinct domain among the three other domains of…

  2. Psychometric testing and Human Resource Management

    Directory of Open Access Journals (Sweden)

    R. P. van der Merwe

    2002-09-01

    Full Text Available This is a cumulative report on the findings of various exploratory research that were done with regard to the practice of psychometric testing in the Eastern Cape. Recent and ongoing developments in the South African labour legislation, and especially the implications of the Employment Equity Act, highlight once again the importance of the validation of all instruments to be used for human assessment and selection purposes. Information was gathered to establish which psychometric tests are used, and for what purposes, in industry today. Biographical information on each organisation is supplied, including the number of employees. The role of psychometric testing in the selection procedure is discussed. The different tests used, as well as the test users, are also indicated. The findings of other, related research, as well as comments, recommendations and shortcomings, are discussed. Opsomming Hierdie is ‘n kumulatiewe verslag wat die resultate verstrek van verskeie verkennende ondersoeke wat gedoen is na die aanwending van psigometriese toetsing in die Oos-Kaap. Onlangse en voortdurende ontwikkelinge in die Suid-Afrikaanse arbeidswetgewing, en veral die implikasies van die Wet op Gelyke Indiensneming, beklemtoon weer eens die belangrikheid van die validering van enige instrumente wat gebruik word vir evaluerings- en keuringsdoeleindes van individue. Inligting is ingewin om te bepaal watter psigometriese toetse, sowel as vir watter doel, vandag in die bedryf gebruik word. Biografiese inligting oor die onderskeie organisasies, insluitende hul aantal werknemers, word verstrek. Die rol van psigometriese toetsing in die keuringsproses word bespreek. Die verskillende toetse wat deur die organisasies gebruik word, sowel as die toetsge-bruikers, word ook aangedui. Die bevindinge van ander, relevante navorsing, sowel as opmerkings, aanbevelings en tekortkominge word bespreek.

  3. 78th Annual Meeting of the Psychometric Society

    CERN Document Server

    Bolt, Daniel; Ark, L; Wang, Wen-Chung

    2015-01-01

    The 78th Annual Meeting of the Psychometric Society (IMPS) builds on the Psychometric Society's mission to share quantitative methods relevant to psychology. The chapters of this volume present cutting-edge work in the field. Topics include studies of item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Additional psychometric topics relate to structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis, among others. The papers in this volume will be especially useful for researchers in the social sciences who use quantitative methods. Prior knowledge of statistical methods is recommended. The 78th annual meeting took place in Arnhem, The Netherlands between July 22nd and 26th, 2013. The previous volume to showcase work from the Psychometric Society’s Meeting is New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 201...

  4. Confessions, scapegoats and flying pigs: Psychometric testing and the law

    Directory of Open Access Journals (Sweden)

    Callie Theron

    2007-01-01

    Full Text Available The use of psychometric tests in personnel selection has been regarded with an extraordinary degree of suspicion and scepticism. This is especially true when selection occurs in respect of a diverse applicant group. Concern is expressed about the seemingly uncritical embracing of specific tenets related to the use of psychometric tests in personnel selection in the absence of any systematic coherent psychometric argument to justify these beliefs. The absence of such a supporting psychometric rationale seems unfortunate in as far as it probably would inhibit the independent critical evaluation of the psychometric merits of these generally accepted beliefs. Specific beliefs related to selection fairness, measurement bias and adverse impact are critically examined.

  5. Análise de Rasch aplicada a questionário sobre consumo de tabaco em escolares adolescentes = Rasch analysis applied to a questionnaire on tobacco use among adolescent students

    Directory of Open Access Journals (Sweden)

    Santos, Wendel Mombaque dos

    2014-01-01

    Conclusões: O uso do método de Rasch possibilitou verificar a exposição de cada participante às diferentes condições de exposição ao tabaco, assim como demonstrou que o questionário que avalia a exposição ao tabaco deve tratar cada questão com pesos diferentes

  6. A quantitative test of the cultural theory of risk perceptions: comparison with the psychometric paradigm.

    Science.gov (United States)

    Marris, C; Langford, I H; O'Riordan, T

    1998-10-01

    This paper seeks to compare two frameworks which have been proposed to explain risk perceptions, namely, cultural theory and the psychometric paradigm. A structured questionnaire which incorporated elements from both approaches was administered to 129 residents of Norwich, England. The qualitative risk characteristics generated by the psychometric paradigm explained a far greater proportion of the variance in risk perceptions than cultural biases, though it should be borne in mind that the qualitative characteristics refer directly to risks whereas cultural biases are much more distant variables. Correlations between cultural biases and risk perceptions were very low, but the key point was that each cultural bias was associated with concern about distinct types of risks and that the pattern of responses was compatible with that predicted by cultural theory. The cultural approach also provided indicators for underlying beliefs regarding trust and the environment; beliefs which were consistent within each world view but divergent between them. An important drawback, however, was that the psychometric questionnaire could only allocate 32% of the respondents unequivocally to one of the four cultural types. The rest of the sample expressed several cultural biases simultaneously, or none at all. Cultural biases are therefore probably best interpreted as four extreme world views, and a mixture of qualitative and quantitative research methodologies would generate better insights into who might defend these views in what circumstances, whether there are only four mutually exclusive world views or not, and how these views are related to patterns of social solidarity, and judgments on institutional trust.

  7. Trial-dependent psychometric functions accounting for perceptual learning in 2-AFC discrimination tasks.

    Science.gov (United States)

    Kattner, Florian; Cochrane, Aaron; Green, C Shawn

    2017-09-01

    The majority of theoretical models of learning consider learning to be a continuous function of experience. However, most perceptual learning studies use thresholds estimated by fitting psychometric functions to independent blocks, sometimes then fitting a parametric function to these block-wise estimated thresholds. Critically, such approaches tend to violate the basic principle that learning is continuous through time (e.g., by aggregating trials into large "blocks" for analysis that each assume stationarity, then fitting learning functions to these aggregated blocks). To address this discrepancy between base theory and analysis practice, here we instead propose fitting a parametric function to thresholds from each individual trial. In particular, we implemented a dynamic psychometric function whose parameters were allowed to change continuously with each trial, thus parameterizing nonstationarity. We fit the resulting continuous time parametric model to data from two different perceptual learning tasks. In nearly every case, the quality of the fits derived from the continuous time parametric model outperformed the fits derived from a nonparametric approach wherein separate psychometric functions were fit to blocks of trials. Because such a continuous trial-dependent model of perceptual learning also offers a number of additional advantages (e.g., the ability to extrapolate beyond the observed data; the ability to estimate performance on individual critical trials), we suggest that this technique would be a useful addition to each psychophysicist's analysis toolkit.

  8. Current psychometric and methodological issues in the measurement of overgeneral autobiographical memory.

    Science.gov (United States)

    Griffith, James W; Sumner, Jennifer A; Raes, Filip; Barnhofer, Thorsten; Debeer, Elise; Hermans, Dirk

    2012-12-01

    Autobiographical memory is a multifaceted construct that is related to psychopathology and other difficulties in functioning. Across many studies, a variety of methods have been used to study autobiographical memory. The relationship between overgeneral autobiographical memory (OGM) and psychopathology has been of particular interest, and many studies of this cognitive phenomenon rely on the Autobiographical Memory Test (AMT) to assess it. In this paper, we examine several methodological approaches to studying autobiographical memory, and focus primarily on methodological and psychometric considerations in OGM research. We pay particular attention to what is known about the reliability, validity, and methodological variations of the AMT. The AMT has adequate psychometric properties, but there is great variability in methodology across studies that use it. Methodological recommendations and suggestions for future studies are presented.

  9. Inter-regional metric disadvantages when comparing countries’ happiness on a global scale. A Rasch based consequential validity analysis

    Directory of Open Access Journals (Sweden)

    Diego Fernando Rojas-Gualdrón

    2017-07-01

    Full Text Available Measurement confounding due to socioeconomic differences between world regions may bias the estimations of countries’ happiness and global inequality. Potential implications of this bias have not been researched. In this study, the consequential validity of the Happy Planet Index, 2012 as an indicator of global inequality is evaluated from the Rasch measurement perspective. Differential Item Functioning by world region and bias in the estimated magnitude of inequalities were analyzed. The recalculated measure showed a good fit to Rasch model assumptions. The original index underestimated relative inequalities between world regions by 20%. DIF had no effect on relative measures but affected absolute measures by overestimating world average happiness and underestimating its variance. These findings suggest measurement confounding by unmeasured characteristics. Metric disadvantages must be adjusted to make fair comparisons. Public policy decisions based on biased estimations could have relevant negative consequences on people’s health and well-being by not focusing efforts on real vulnerable populations.

  10. Validating a developmental scale for young children using the Rasch model: applicability of the teaching strategies GOLD assessment system.

    Science.gov (United States)

    Kim, Do-Hong; Lambert, Richard G; Burts, Diane C

    2014-01-01

    This article reports the results of an application of the Rasch rating scale model to the Teaching Strategies GOLD assessment system in a norm sample of children aged birth to 71 months. The analyses focused on the examination of dimensionality, rating scale effectiveness, the hierarchy of item difficulties, and the relationship of developmental scale scores to child age. Results show that each subscale satisfies the Rasch model for unidimensionality. Ratings were found to be less reliable at the lowest and highest ends of the scale and less distinct at 'In-between' levels. Items appear to form theoretically expected hierarchies, supporting evidence for construct validity for the measures. Moderately high correlations of developmental scale scores with child age suggest that teachers are able to make valid ratings of the developmental progress of children across the intended age range.

  11. Validation of the knowledge, attitude and perceived practice of asthma instrument among community pharmacists using Rasch analysis.

    Science.gov (United States)

    Akram, Waqas; Hussein, Maryam S E; Ahmad, Sohail; Mamat, Mohd N; Ismail, Nahlah E

    2015-10-01

    There is no instrument which collectively assesses the knowledge, attitude and perceived practice of asthma among community pharmacists. Therefore, this study aimed to validate the instrument which measured the knowledge, attitude and perceived practice of asthma among community pharmacists by producing empirical evidence of validity and reliability of the items using Rasch model (Bond & Fox software®) for dichotomous and polytomous data. This baseline study recruited 33 community pharmacists from Penang, Malaysia. The results showed that all PTMEA Corr were in positive values, where an item was able to distinguish between the ability of respondents. Based on the MNSQ infit and outfit range (0.60-1.40), out of 55 items, 2 items from the instrument were suggested to be removed. The findings indicated that the instrument fitted with Rasch measurement model and showed the acceptable reliability values of 0.88 and 0.83 and 0.79 for knowledge, attitude and perceived practice respectively.

  12. Testing the Multidimensionality in Teacher Interpersonal Behavior: Validating the Questionnaire on Teacher Interaction Using the Rasch Measurement Model.

    Science.gov (United States)

    Fulmer, Gavin W; Lang, Quek Choon

    2015-01-01

    This study investigated the perceptions of 1235 students of their form teachers' interpersonal behaviors across 40 classrooms in 24 Singaporean secondary schools. The 32-item Questionnaire on Teacher Interaction (QTI) survey was administered to obtain the initial quantitative data of teacher behaviors perceived by the students in these classrooms. The eight scales of QTI are: Leadership, Helping/Friendly, Understanding, Student Responsibility/ Freedom, Uncertain, Dissatisfied, Admonishing, and Strict. The Rasch measurement model was used to estimate students' traits with respect to each subscale, and then to examine its proposed multidimensional structure. Findings demonstrate overall good fit of the responses with the Rasch model for each subscale. Findings also support the hypothesized relationships among the eight dimensions proposed for the QTI.

  13. The Psychometrics of the Mini-K.

    Science.gov (United States)

    Richardson, George B; Chen, Ching-Chen; Dai, Chia-Liang; Brubaker, Michael D; Nedelec, Joseph L

    2017-01-01

    Many published studies have employed the Mini-K to measure a single fast-slow life history dimension. However, the internal structure of the Mini-K has not been determined and it is not clear that a single higher order K-factor fits the data. It is also not clear that the Mini-K is measurement invariant across groups such as the sexes. To establish the construct validity of K as well as the broader usefulness of applying life history theory to humans, it is crucial that these psychometric issues are addressed as a part of measure validation efforts. Here we report on three studies that used latent variable modeling and data drawn from two college student samples ( ns = 361 and 300) to elucidate the psychometrics of the Mini-K. We found that (a) the Mini-K had a six dimensional first-order structure, (b) the K-factor provided a parsimonious explanation of the associations among the lower order factors at no significant cost to fit, (c) the Mini-K measured the same K-factor across the sexes, (d) K-factor means did not have the same meaning across the sexes and thus the first-order factors should be used in studies of mean sex differences, and finally, (e) the K-factor was only associated with environment and aspects of mating competition in females. Implications and future directions for life history research are discussed.

  14. Psicometria Psicometría Psychometrics

    Directory of Open Access Journals (Sweden)

    Luiz Pasquali

    2009-12-01

    Full Text Available A psicometria fundamenta-se na teoria da medida em ciências para explicar o sentido que têm as respostas dadas pelos sujeitos a uma série de tarefas e propor técnicas de medida dos processos mentais. Neste artigo são apresentados os conceitos e modelos da psicometria moderna e discutidos os parâmetros de validade e precisão dos testes.La Psicometría se fundamenta en la teoría de la medida en las ciencias buscando explicar el sentido en las respuestas de los que fueron sujetos a una serie de tareas, además de proponerse técnicas de medida de sus procesos mentales. En este artículo son presentados los conceptos y modelos de psicometría moderna, así como son discutidos los parámetros de validez y precisión de los testes.Psychometrics has foundations on the theory of measurement in Sciences and is aimed at explaining the meaning of responses provided by subjects submitted to a series of tasks, and proposing techniques for the measurement of mental processes. This article presents concepts and models of modern psychometrics and discusses the validity and reliability parameters of the applied tests.

  15. Rasch analysis of the Bruininks-Oseretsky Test of Motor Proficiency-Second Edition in intellectual disabilities.

    Science.gov (United States)

    Wuang, Yee-Pay; Lin, Yueh-Hsien; Su, Chwen-Yng

    2009-01-01

    The Bruininks-Oseretsky Test of Motor Proficiency-Second Edition (BOT-2) is widely used to assess motor skills for both clinical and research purposes; however, its validity has not been adequately assessed in intellectual disabilities (ID). This study used partial credit Rasch model to examine the measurement properties of the BOT-2 among 446 children and adolescents with ID aged 4-18 years. Seventeen items were identified as problematic in the Rasch modeling. After removal of these items, the appropriateness of the response categories was examined in the 36 remaining items. Where the item response categories failed to express an increasing level of the trait (disordered thresholds), collapsing adjacent categories was performed to address this issue. After rescoring most items, items in each composite of the revised BOT-2 showed good fit to the Rasch model and demonstrated excellent reliability (range 0.90-0.97). No differential item functioning was detected with respect to age and gender. The ability of the revised composites to differentiate between mild versus moderate to severe ID was better than those of the original BOT-2. Items from the manual coordination and strength and agility composites were well targeted to the sample, whereas items from fine manual control and body coordination composites were mostly targeted at the lower levels of ability in these domains. Items of higher difficulty may be supplemented to increase the range of ability levels of the people to whom these two composites can be applied with precision.

  16. Calibrating perceived understanding and competency in probability concepts: A diagnosis of learning difficulties based on Rasch probabilistic model

    Science.gov (United States)

    Mahmud, Zamalia; Porter, Anne; Salikin, Masniyati; Ghani, Nor Azura Md

    2015-12-01

    Students' understanding of probability concepts have been investigated from various different perspectives. Competency on the other hand is often measured separately in the form of test structure. This study was set out to show that perceived understanding and competency can be calibrated and assessed together using Rasch measurement tools. Forty-four students from the STAT131 Understanding Uncertainty and Variation course at the University of Wollongong, NSW have volunteered to participate in the study. Rasch measurement which is based on a probabilistic model is used to calibrate the responses from two survey instruments and investigate the interactions between them. Data were captured from the e-learning platform Moodle where students provided their responses through an online quiz. The study shows that majority of the students perceived little understanding about conditional and independent events prior to learning about it but tend to demonstrate a slightly higher competency level afterward. Based on the Rasch map, there is indication of some increase in learning and knowledge about some probability concepts at the end of the two weeks lessons on probability concepts.

  17. Linguistic validation of stigmatisation degree, self-esteem and knowledge questionnaire among asthma patients using Rasch analysis.

    Science.gov (United States)

    Ahmad, Sohail; Ismail, Ahmad Izuanuddin; Khan, Tahir Mehmood; Akram, Waqas; Mohd Zim, Mohd Arif; Ismail, Nahlah Elkudssiah

    2017-04-01

    The stigmatisation degree, self-esteem and knowledge either directly or indirectly influence the control and self-management of asthma. To date, there is no valid and reliable instrument that can assess these key issues collectively. The main aim of this study was to test the reliability and validity of the newly devised and translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" among adult asthma patients using the Rasch measurement model. This cross-sectional study recruited thirty adult asthma patients from two respiratory specialist clinics in Selangor, Malaysia. The newly devised self-administered questionnaire was adapted from relevant publications and translated into the Malay language using international standard translation guidelines. Content and face validation was done. The data were extracted and analysed for real item reliability and construct validation using the Rasch model. The translated "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" showed high real item reliability values of 0.90, 0.86 and 0.89 for stigmatisation degree, self-esteem, and knowledge of asthma, respectively. Furthermore, all values of point measure correlation (PTMEA Corr) analysis were within the acceptable specified range of the Rasch model. Infit/outfit mean square values and Z standard (ZSTD) values of each item verified the construct validity and suggested retaining all the items in the questionnaire. The reliability analyses and output tables of item measures for construct validation proved the translated Malaysian version of "Stigmatisation Degree, Self-Esteem and Knowledge Questionnaire" as a valid and highly reliable questionnaire.

  18. Using Guttman's mapping sentences and Many Facet Rasch Measurement Theory to develop an instrument that examines the grading philosophies of teachers.

    Science.gov (United States)

    Randall, Jennifer; Engelhard, George

    2010-01-01

    This study presents an approach to questionnaire design within educational research based on Guttman's mapping sentences (Guttman, 1977) and Many-Facet Rasch Measurement Theory (Linacre, 1994). The primary purpose of this study was to illustrate how Guttman's mapping sentences can be used to develop an instrument that explores the grading philosophies of teachers. A secondary purpose was to clarify teacher grading philosophies (i.e., severity or leniency) as a measurement construct. We designed a 54-item questionnaire in which each item represented a unique combination of student characteristics, i.e., varying levels of classroom achievement, ability, behavior, and effort. The grades assigned by the teachers to the scenarios were analyzed using the FACETS (Linacre, 2007) computer program. The results of the analyses suggest that the grading philosophies of teachers represent a unidimensional construct which is influenced, to varying extents, by the classroom achievement (primarily), behavior, and effort of students; whereas the measurement value added by the inclusion of the ability facet is uncertain.

  19. Enhancing rigour in the validation of patient reported outcome measures (PROMs: bridging linguistic and psychometric testing

    Directory of Open Access Journals (Sweden)

    Roberts Gwerfyl

    2012-06-01

    Full Text Available Abstract Background A strong consensus exists for a systematic approach to linguistic validation of patient reported outcome measures (PROMs and discrete methods for assessing their psychometric properties. Despite the need for robust evidence of the appropriateness of measures, transition from linguistic to psychometric validation is poorly documented or evidenced. This paper demonstrates the importance of linking linguistic and psychometric testing through a purposeful stage which bridges the gap between translation and large-scale validation. Findings Evidence is drawn from a study to develop a Welsh language version of the Beck Depression Inventory-II (BDI-II and investigate its psychometric properties. The BDI-II was translated into Welsh then administered to Welsh-speaking university students (n = 115 and patients with depression (n = 37 concurrent with the English BDI-II, and alongside other established depression and quality of life measures. A Welsh version of the BDI-II was produced that, on administration, showed conceptual equivalence with the original measure; high internal consistency reliability (Cronbach’s alpha = 0.90; 0.96; item homogeneity; adequate correlation with the English BDI-II (r = 0.96; 0.94 and additional measures; and a two-factor structure with one overriding dimension. Nevertheless, in the student sample, the Welsh version showed a significantly lower overall mean than the English (p = 0.002; and significant differences in six mean item scores. This prompted a review and refinement of the translated measure. Conclusions Exploring potential sources of bias in translated measures represents a critical step in the translation-validation process, which until now has been largely underutilised. This paper offers important findings that inform advanced methods of cross-cultural validation of PROMs.

  20. Risk perception and control, an integration of the psychometric research paradigm and social psychology

    Energy Technology Data Exchange (ETDEWEB)

    Haugen, K. [Norwegian University of Science and Technology, Dragvoll (Norway). Dept. of Psychology

    1998-07-01

    Full text of publication follows: this paper argues that perceptual control is an essential component in human risk evaluation. Control is seen as an integrative concept between the psychometric research paradigm and various psychological theories. The psychometric approach to the study of risk has mainly dealt with the intuitive judgements people do when they are asked to evaluate risky activities and technologies. It shows that people judge risk in relation to the possible consequences and probabilities related to an outcome; the former more typical for the public and the latter more often usedby experts. The psychometric research tradition has concentrated on doing human risk evaluations quantifiable and the reactions predictable. This paper also relates to possible practical implications of this strategy, namely that humans react heterogeneously to different kinds of threats due to perceived control. Theoretical ability to explain and elaborate perceptions of risk, as well as individual reactions, were the main criteria for the literature selection, which includes work on e.g. attribution theory, locus of control, and learned helplessness. Thus, the paper addresses available psychological views for a contribution to a developed theoretical framework for human risk evaluation. It seeks to compare and integrate the psychometric research tradition within social psychological theories. The way in which people find their informational basis for their risk judgements, either from others or from their own perceptions is also discussed. Furthermore, the theories are related to the social and psychological reactions of the Chernobyl accident. The paper concludes that psychological theories can contribute to a more comprehensive framework for the understanding of human risk evaluation, leading to a more coherent and integrative knowledge. (author)

  1. Children's separation anxiety scale (CSAS): psychometric properties.

    Science.gov (United States)

    Méndez, Xavier; Espada, José P; Orgilés, Mireia; Llavona, Luis M; García-Fernández, José M

    2014-01-01

    This study describes the psychometric properties of the Children's Separation Anxiety Scale (CSAS), which assesses separation anxiety symptoms in childhood. Participants in Study 1 were 1,908 schoolchildren aged between 8 and 11. Exploratory factor analysis identified four factors: worry about separation, distress from separation, opposition to separation, and calm at separation, which explained 46.91% of the variance. In Study 2, 6,016 children aged 8-11 participated. The factor model in Study 1 was validated by confirmatory factor analysis. The internal consistency (α = 0.82) and temporal stability (r = 0.83) of the instrument were good. The convergent and discriminant validity were evaluated by means of correlations with other measures of separation anxiety, childhood anxiety, depression and anger. Sensitivity of the scale was 85% and its specificity, 95%. The results support the reliability and validity of the CSAS.

  2. Psychometric analysis of common mental disorders

    DEFF Research Database (Denmark)

    Søgaard, Hans Jørgen; Bech, Per

    2009-01-01

    AIMS: Mental disorders often go undetected in primary care, for persons awarded disability pension, and in sick-leave certificates. No validity tests of instruments for detection and measurement of mental disorders have been performed in long-term sickness absence (LSA). This is the aim...... of the present study for Common Mental Disorders - Screening Questionnaire (CMD-SQ). METHODS: It is validity tested in a well-defined Danish population comprising all persons on continuous sickness absence just exceeding eight weeks. CMD-SQ is composed of SCL-SOM (somatization), Whiteley-7 (illness worry...... of SC-ANX4, SCL-DEP6, and SCL-8, called SCL-8AD, showed the best and excellent psychometric and screening statistics. CONCLUSIONS: SCL-8AD, a sub-scale of CMD-SQ, is a promising candidate for screening and measurement of mental disorders in long-term sickness absence....

  3. [Psychometric instruments for the diagnosis of tinnitus].

    Science.gov (United States)

    Seydel, C; Zirke, N; Haupt, H; Szczepek, A; Olze, H; Mazurek, B

    2012-08-01

    Tinnitus is a very complex phenomenon with various mechanisms of origin. Multimodal and interdisciplinary treatment is the most effective form of treatment for patients with chronic tinnitus. In order to assess existing comorbidity in tinnitus patients as well as to treat the patients individually, a comprehensive and differentiated diagnosis is needed. Since standardized guidelines for the use of relevant instruments in the diagnosis of tinnitus have been lacking hitherto, we present here psychometric questionnaires which have already been used effectively in the research, diagnosis and therapy of tinnitus in the present article. The questionnaires measure the severity of tinnitus, depression and anxiety, the perceived stress, personal resources as well as the quality of life of patients.

  4. Children's separation anxiety scale (CSAS: psychometric properties.

    Directory of Open Access Journals (Sweden)

    Xavier Méndez

    Full Text Available This study describes the psychometric properties of the Children's Separation Anxiety Scale (CSAS, which assesses separation anxiety symptoms in childhood. Participants in Study 1 were 1,908 schoolchildren aged between 8 and 11. Exploratory factor analysis identified four factors: worry about separation, distress from separation, opposition to separation, and calm at separation, which explained 46.91% of the variance. In Study 2, 6,016 children aged 8-11 participated. The factor model in Study 1 was validated by confirmatory factor analysis. The internal consistency (α = 0.82 and temporal stability (r = 0.83 of the instrument were good. The convergent and discriminant validity were evaluated by means of correlations with other measures of separation anxiety, childhood anxiety, depression and anger. Sensitivity of the scale was 85% and its specificity, 95%. The results support the reliability and validity of the CSAS.

  5. The claustrophobia scale: a psychometric evaluation.

    Science.gov (United States)

    Ost, Lars-Göran

    2007-05-01

    This article presents a psychometric evaluation of the Claustrophobia Scale (CS), consisting of one subscale for measuring anxiety (20 items, 0-4) and one for avoidance (18 items, 0-2). Participants were 87 claustrophobic patients and 200 normal controls randomly selected from the community. The results show that CS has excellent internal consistency, high test-retest reliability, concurrent and discriminant validity. The patients and controls differ significantly on the total scores of anxiety and avoidance, as well as on each individual item scores. The CS was also found to be sensitive to change after cognitive behavioral treatment. Preliminary factor analyses yielded two factors for each subscale; "Being in small enclosed spaces" and "Other people present", accounting for large proportions of the variance. The CS is useful both as a state, and as an outcome self-report measure of claustrophobia.

  6. The Nature of Science Instrument-Elementary (NOSI-E): Using Rasch principles to develop a theoretically grounded scale to measure elementary student understanding of the nature of science

    Science.gov (United States)

    Peoples, Shelagh

    The purpose of this study was to determine which of three competing models will provide, reliable, interpretable, and responsive measures of elementary students' understanding of the nature of science (NOS). The Nature of Science Instrument-Elementary (NOSI-E), a 28-item Rasch-based instrument, was used to assess students' NOS understanding. The NOS construct was conceptualized using five construct dimensions (Empirical, Inventive, Theory-laden, Certainty and Socially & Culturally Embedded). The competing models represent three internal models for the NOS construct. One postulate is that the NOS construct is unidimensional where one latent construct explains the relationship between the 28 items of the NOSI-E. Alternatively, the NOS construct is composed of five independent unidimensional constructs (the consecutive approach). Lastly, the NOS construct is multidimensional and composed of five inter-related but separate dimensions. A validity argument was developed that hypothesized that the internal structure of the NOS construct is best represented by the multidimensional Rasch model. Four sets of analyses were performed in which the three representations were compared. These analyses addressed five validity aspects (content, substantive, generalizability, structural and external) of construct validity. The vast body of evidence supported the claim that the NOS construct is composed of five separate but inter-related dimensions that is best represented by the multidimensional Rasch model. The results of the multidimensional analyses indicated that the items of the five subscales were of excellent technical quality, exhibited no differential item functioning (based on gender), had an item hierarchy that conformed to theoretical expectations; and together formed subscales of reasonable reliability (> 0.7 on each subscale) that were responsive to change in the construct. Theory-laden scores from the multidimensional model predicted students' science achievement with

  7. Rasch analysis of the Western Ontario Osteoarthritis of the Shoulder index – the Danish version

    Directory of Open Access Journals (Sweden)

    Moeini S

    2016-11-01

    Full Text Available Sahar Moeini,1 Jeppe V Rasmussen,1 Tobias W Klausen,2 Stig Brorson1 1Department of Orthopedic Surgery, 2Department of Hematology, Herlev Hospital, Herlev, Denmark Purpose: The Western Ontario Osteoarthritis of the Shoulder (WOOS index is a disease-specific, patient-reported, 19-question survey that measures the quality of life among patients with osteoarthritis (OA. The purpose of this study was to validate the Danish version of WOOS for OA and fractures (FRs using modern test theory.Patients and methods: The study included 1,987 arthroplasties in 1,943 patients that were reported to the Danish Shoulder Arthroplasty Register between 2006 and 2011. These included 847 OA and 1,140 FR cases.Results: Principal component analysis indicated the unidimensionality of WOOS. The person reliabilities showed a floor-ceiling effect, indicating that a dichotomy was the best fit for the WOOS scale. For OA, WOOS showed good reliability (item and person reliability of 0.98 and 0.76 and good targeting, with a person mean of -0.56 logits. FR also showed good targeting (person mean of -0.08 and good reliability (item and person reliabilities of 1.00 and 0.86, respectively. All WOOS items fit well with the OA sample except items 5 and 6 (pertaining to grinding and the influence of weather. In addition, item 6 showed signs of degrading the scale with an outfit mean square of 2.46. Only item 6 showed a misfit for FR with no sign of scale degradation. The residual principal component analysis confirmed the unidimensionality of FR but not OA. Six items displayed clinically significant differential item functioning between OA and FR.Conclusion: Rasch analysis showed that WOOS had a good fit with the Rasch model when used as a dichotomous scale for OA and FR. However, the results were valid only when WOOS was divided into two categories with a threshold of 950 (50% of the maximum score. For the use of WOOS in future clinical research, we recommend that a dichotomous score

  8. Savant skills in autism: psychometric approaches and parental reports.

    Science.gov (United States)

    Howlin, Patricia; Goode, Susan; Hutton, Jane; Rutter, Michael

    2009-05-27

    Most investigations of savant skills in autism are based on individual case reports. The present study investigated rates and types of savant skills in 137 individuals with autism (mean age 24 years). Intellectual ability ranged from severe intellectual impairment to superior functioning. Savant skills were judged from parental reports and specified as 'an outstanding skill/knowledge clearly above participant's general level of ability and above the population norm'. A comparable definition of exceptional cognitive skills was applied to Wechsler test scores--requiring a subtest score at least 1 standard deviation above general population norms and 2 standard deviations above the participant's own mean subtest score. Thirty-nine participants (28.5%) met criteria for either a savant skill or an exceptional cognitive skill: 15 for an outstanding cognitive skill (most commonly block design); 16 for a savant skill based on parental report (mostly mathematical/calculating abilities); 8 met criteria for both a cognitive and parental rated savant skill. One-third of males showed some form of outstanding ability compared with 19 per cent of females. No individual with a non-verbal IQ below 50 met criteria for a savant skill and, contrary to some earlier hypotheses, there was no indication that individuals with higher rates of stereotyped behaviours/interests were more likely to demonstrate savant skills.

  9. 81st Annual Meeting of the Psychometric Society

    CERN Document Server

    Wiberg, Marie; Culpepper, Steven; Douglas, Jeffrey; Wang, Wen-Chung

    2017-01-01

    This proceedings volume compiles and expands on selected and peer reviewed presentations given at the 81st Annual Meeting of the Psychometric Society (IMPS), organized by the University of North Carolina at Greensboro, and held in Asheville, North Carolina, July 11th to 17th, 2016. IMPS is one of the largest international meetings focusing on quantitative measurement in psychology, education, and the social sciences, both in terms of participants and number of presentations. The meeting built on the Psychometric Society's mission to share quantitative methods relevant to psychology, addressing a diverse set of psychometric topics including item response theory, factor analysis, structural equation modeling, time series analysis, mediation analysis, cognitive diagnostic models, and multi-level models. Selected presenters were invited to revise and expand their contributions and to have them peer reviewed and published in this proceedings volume. Previous volumes to showcase work from the Psychometric Society�...

  10. 79th Annual Meeting of the Psychometric Society

    CERN Document Server

    Bolt, Daniel; Wang, Wen-Chung; Douglas, Jeffrey; Chow, Sy-Miin

    2015-01-01

    These research articles from the 79th Annual Meeting of the Psychometric Society (IMPS) cover timely quantitative psychology topics, including new methods in item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Topics within general quantitative methodology include structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis. These methods will appeal, in particular, to researchers in the social sciences. The 79th annual meeting took place in Madison, WI between July 21nd and 25th, 2014. Previous volumes to showcase work from the Psychometric Society’s Meeting are New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 2013) and Quantitative Psychology Research: The 78th Annual Meeting of the Psychometric Society  (Springer, 2015).

  11. Applied psychometrics in clinical psychiatry: the pharmacopsychometric triangle

    DEFF Research Database (Denmark)

    Bech, P

    2009-01-01

    OBJECTIVE: To consider applied psychometrics in psychiatry as a discipline focusing on pharmacopsychology rather than psychopharmacology as illustrated by the pharmacopsychometric triangle. METHOD: The pharmacopsychological dimensions of clinically valid effects of drugs (antianxiety, antidepress......OBJECTIVE: To consider applied psychometrics in psychiatry as a discipline focusing on pharmacopsychology rather than psychopharmacology as illustrated by the pharmacopsychometric triangle. METHOD: The pharmacopsychological dimensions of clinically valid effects of drugs (antianxiety......, antidepressive, antimanic, and antipsychotic), of clinically unwanted effects of these drugs, and the patients' own subjective perception of the balance between wanted and unwanted effects are analysed using rating scales assessed by modern psychometric tests (item response theory models) RESULTS: Symptom rating...... scales fulfilling the item response theory models have been shown to be psychometrically valid outcome scales as their total scores are sufficient statistics for demonstrating dose-response relationship within the various classes of antianxiety, antidepressive, antimanic or antipsychotic drugs. The total...

  12. 80th Annual Meeting of the Psychometric Society

    CERN Document Server

    Bolt, Daniel; Wang, Wen-Chung; Douglas, Jeffrey; Wiberg, Marie

    2016-01-01

    The research articles in this volume cover timely quantitative psychology topics, including new methods in item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Topics within general quantitative methodology include structural equation modeling, factor analysis, causal modeling, mediation, missing data methods, and longitudinal data analysis. These methods will appeal, in particular, to researchers in the social sciences. The 80th annual meeting took place in Beijing, China, between the 12th and 16th of July, 2014. Previous volumes to showcase work from the Psychometric Society’s Meeting are New Developments in Quantitative Psychology: Presentations from the 77th Annual Psychometric Society Meeting (Springer, 2013), Quantitative Psychology Research: The 78th Annual Meeting of the Psychometric Society (Springer, 2015), and Quantitative Psychology Research: The 79th Annual Meeting of the Psychometric Society, Wisconsin, USA, 2014 (Springer, 2015).

  13. A psychometric validation of the Short Alcohol Withdrawal Scale (SAWS)

    DEFF Research Database (Denmark)

    Elholm, Bjarne; Larsen, Klaus; Hornnes, Nete

    2011-01-01

    The study aimed to evaluate psychometrically a Danish translation of the Short Alcohol Withdrawal Scale (SAWS) in an outpatient setting in patients with Alcohol Dependence (AD) and Alcohol Withdrawal Symptoms/Syndrome (AWS).......The study aimed to evaluate psychometrically a Danish translation of the Short Alcohol Withdrawal Scale (SAWS) in an outpatient setting in patients with Alcohol Dependence (AD) and Alcohol Withdrawal Symptoms/Syndrome (AWS)....

  14. Psychometric Properties of the Brief Autism Mealtime Behaviors Inventory

    OpenAIRE

    2015-01-01

    The purpose of this study was to explore the psychometric properties of the Brief Autism Mealtime Behaviors Inventory (BAMBI). In a sample of 273 well-characterized children with ASD, we explored the factor structure of the BAMBI, determined the internal consistency of a newly derived factor structure and provide an empirically derived cut-off for the BAMBI total score. The new psychometrically identified structure consists of 4 factors: 1) Food Selectivity, 2) Disruptive Mealtime Behaviors, ...

  15. Patient-reported outcome measures in patients with peripheral arterial disease: a systematic review of psychometric properties.

    Science.gov (United States)

    Poku, Edith; Duncan, Rosie; Keetharuth, Anju; Essat, Munira; Phillips, Patrick; Woods, Helen Buckley; Palfreyman, Simon; Jones, Georgina; Kaltenthaler, Eva; Michaels, Jonathan

    2016-11-24

    Peripheral arterial disease (PAD) is generally associated with considerable morbidity and reduced quality of life. Patient-reported outcome measures (PROMs) provide important information about the burden of disease and impact of treatment in affected patients. The objective of the review was to identify and appraise studies reporting the psychometric evaluation of PROMs administered to a specified population of patients with PAD with a view to recommending suitable PROMs. A systematic review of peer-reviewed English language articles was undertaken to identify primary studies reporting psychometric properties of PROMs in English-speaking patients with various stages of PAD. Comprehensive searches were completed up until January 2015. Study selection, data extraction and quality assessment were undertaken independently by at least two researchers. Findings were presented as tabular and narrative summaries based on accepted guidance. Psychometric evaluation of 6 generic and 7 condition-specific PROMs reported in 14 studies contributed data to the review. The frequently reported measure was the SF-36 (n = 11 studies); others included the Walking Impairment Questionnaire (n = 8 studies), EQ-5D (n = 5 studies) and the Vascular Quality of Life Questionnaire (n = 3 studies). Studies included a diverse PAD population and varied in methodology, including approach to validation of PROMs. Various PROMs have been validated in patients with PAD but no study provided evidence of a full psychometric evaluation in the patient population. Careful selection is required to identify reliable and valid PROMs to use in clinical and research settings.

  16. The Effects of a Model-Based Physics Curriculum Program with a Physics First Approach: A Causal-Comparative Study

    Science.gov (United States)

    Liang, Ling L.; Fulmer, Gavin W.; Majerich, David M.; Clevenstine, Richard; Howanski, Raymond

    2012-01-01

    The purpose of this study is to examine the effects of a model-based introductory physics curriculum on conceptual learning in a Physics First (PF) Initiative. This is the first comparative study in physics education that applies the Rasch modeling approach to examine the effects of a model-based curriculum program combined with PF in the United…

  17. A simulation study of person-fit in the Rasch model

    Directory of Open Access Journals (Sweden)

    Richard Artner

    2016-09-01

    Full Text Available The validation of individual test scores in the Rasch model (1-PL model is of primary importance, but the decision which person-fit index to choose is still not sufficiently answered. In this work, a simulation study was conducted in order to compare five well known person-fit indices in terms of specificity and sensitivity, under different testing conditions. Furthermore, this study analyzed the decrease in specificity of Andersen´s Likelihood-Ratio test in case of person-misfit, using the median of the raw score as an internal criterion, as well as the positive effect of removing suspicious respondents with the index C*. The three non-parametric indices Ht, C* and U3 performed slightly better than the parametric indices OUTFIT and INFIT. All indices performed better with a higher number of respondents and a higher number of items. Ht, OUTFIT, and INFIT showed huge deviations between nominal and actual specificity levels. The simulation revealed that person-misfit has a huge negative impact on the specificity of Andersen´s Likelihood-Ratio test. However, the removal of suspicious respondents with C* worked quite well and the nominal specificity can be almost respected if the specificity level of C* is set to 0.95.

  18. Expected linking error resulting from item parameter drift among the common Items on Rasch calibrated tests.

    Science.gov (United States)

    Miller, G Edward; Gesn, Paul Randall; Rotou, Jourania

    2005-01-01

    In state assessment programs that employ Rasch-based common item linking procedures, the linking constant is usually estimated with only those common items not identified as exhibiting item difficulty parameter drift. Since state assessments typically contain a fixed number of items, an item classified as exhibiting parameter drift during the linking process remains on the exam as a scorable item even if it is removed from the common item set. Under the assumption that item parameter drift has occurred for one or more of the common items, the expected effect of including or excluding the "affected" item(s) in the estimation of the linking constant is derived in this article. If the item parameter drift is due solely to factors not associated with a change in examinee achievement, no linking error will (be expected to) occur given that the linking constant is estimated only with the items not identified as "affected"; linking error will (be expected to) occur if the linking constant is estimated with all common items. However, if the item parameter drift is due solely to change in examinee achievement, the opposite is true: no linking error will (be expected to) occur if the linking constant is estimated with all common items; linking error will (be expected to) occur if the linking constant is estimated only with the items not identified as "affected".

  19. Rasch analysis for the evaluation of rank of student response time in multiple choice examinations.

    Science.gov (United States)

    Thompson, James J; Yang, Tong; Chauvin, Sheila W

    2013-01-01

    The availability of computerized testing has broadened the scope of person assessment beyond the usual accuracy-ability domain to include response time analyses. Because there are contexts in which speed is important, e.g. medical practice, it is important to develop tools by which individuals can be evaluated for speed. In this paper, the ability of Rasch measurement to convert ordinal nonparametric rankings of speed to measures is examined and compared to similar measures derived from parametric analysis of response times (pace) and semi-parametric logarithmic time-scaling procedures. Assuming that similar spans of the measures were used, non-parametric methods of raw ranking or percentile-ranking of persons by questions gave statistically acceptable person estimates of speed virtually identical to the parametric or semi-parametric methods. Because no assumptions were made about the underlying time distributions with ranking, generality of conclusions was enhanced. The main drawbacks of the non-parametric ranking procedures were the lack of information on question duration and the overall assignment by the model of variance to the person by question interaction.

  20. Establishing the construct validity of conversational C-Tests using a multidimensional Rasch model

    Directory of Open Access Journals (Sweden)

    Purya Baghaei

    2014-03-01

    Full Text Available C-Test is a variation of cloze test where the second half of every second word is deleted. The number of words correctly reconstructed by the test taker is considered to be a measure of general language proficiency. In this pilot study the componential structure of an English C-Test consisting of two spoken-discourse passages and two written-discourse passages is investigated with the help of both unidimensional and multidimensional Rasch model. In a sample of 99 fairly advanced Iranian students of English the data fitted better the multidimensional partial credit model as defined in multidimensional random coefficients multinomial logit model (Adams, Wilson, & Wang, 1997 than Masters’ (1982 unidimensional partial credit model. This indicates that spoken-discourse and written-discourse C-Test passages form distinct dimensions. We argue that spoken-discourse C-Test texts may tap better into students’ listening/speaking skills than C-Test based solely on written discourse texts and that therefore C-Tests consisting of both conversational and written-discourse passages can more adequately operationalize the construct of general language proficiency than C-Tests containing only written discourse passages. Considering the small sample size of the study the findings should be interpreted cautiously.

  1. The revised transliminality scale: reliability and validity data from a Rasch top-down purification procedure.

    Science.gov (United States)

    Lange, R; Thalbourne, M A; Houran, J; Storm, L

    2000-12-01

    The concept of transliminality ("a hypothesized tendency for psychological material to cross thresholds into or out of consciousness") was anticipated by William James (1902/1982), but it was only recently given an empirical definition by Thalbourne in terms of a 29-item Transliminality Scale. This article presents the 17-item Revised Transliminality Scale (or RTS) that corrects age and gender biases, is unidimensional by a Rasch criterion, and has a reliability of.82. The scale defines a probabilistic hierarchy of items that address magical ideation, mystical experience, absorption, hyperaesthesia, manic experience, dream interpretation, and fantasy proneness. These findings validate the suggestions by James and Thalbourne that some mental phenomena share a common underlying dimension with selected sensory experiences (such being overwhelmed by smells, bright lights, sights, and sounds). Low scores on transliminality remain correlated with "tough mindedness" in on Cattell 16PF test, as well as "self-control" and "rule consciousness," whereas high scores are associated with "abstractedness" and an "openness to change" on that test. An independent validation study confirmed the predictions implied by our definition of transliminality. Implications for test construction are discussed.

  2. Combining partially ranked data in plant breeding and biology: II. Analysis with Rasch model

    Directory of Open Access Journals (Sweden)

    Ivan Simko

    2010-07-01

    Full Text Available Many years of breeding experiments, germplasm screening, and molecular biologic experimentation have generated volumes of sequence, genotype, and phenotype information that have been stored in public data repositories. These resources afford genetic and genomic researchers the opportunity to handle and analyze raw data from multiple laboratories and study groups whose research interests revolve around a common or closely related trait. However, although such data sets are widely available for secondary analysis, their heterogeneous nature often precludes their direct combination and joint exploration. Integration of phenotype information across multiple studies and databases is challenging due to variations in the measurement instruments, endpoint classifications, and biological material employed by each investigator. In the present work, we demonstrate how Rasch measurement model can surmount these problems. The model allows incorporating data sets with partially overlapping variables, large numbers of missing data points and dissimilar ratings of phenotypic endpoints. The model also enables quantifying the extent of heterogeneity between data sets. Biologists can use the model in a data-mining process to obtain combined ratings from various databases and other sources. Subsequently, these ratings can be used for selecting desirable material or (in combination with genotypic information for mapping genes involved in the particular trait. The model is not limited to genetics and breeding and can be applied in many other areas of biology and agriculture.

  3. COMPETENCY ASSESSMENT OF CLOTHING FASHION DESIGN: RASCH MEASUREMENT MODEL FOR CONSTRUCT VALIDITY AND RELIABILITY

    Directory of Open Access Journals (Sweden)

    Arasinah Kamis

    2013-12-01

    Full Text Available The Clothing Fashion Design (CFaD assessment instrument was used to measure the level of competence among instructors in Skills Training Institute (STI. This study was conducted to select items that are valid, fair, and of quality. The CFaD instrument consists of 97 Likert scale items with six constructs of designing, pattern drafting, computer, sewing, creative, and trade/entrepreneurship. The instrument was administered for the first stage of testing to 95 instructors in STI who teach in the field of fashion and clothing. The Rasch measurement model was used to obtain the reliability, validity, relevance of person items and unidimensionality of items. Therefore, Winsteps software version 3.72.3 was used to analyze the data. The findings showed that the items in the six constructs of skill competency have high reliability, from 0.63 to 0.96 for the Likert scale items. Meanwhile, the reliability of the respondents was estimated between 0.93-0.98. The analysis also indicate that 11 out of the 97 items were misfit while 32 items need to be repaired prior to the decision of dropping some of them due to lack of unidimensionality and differing levels of difficulty. Decisions to remove or repair were made so that the instrument is more fair and equitable to all respondents, and reliable.

  4. Rasch-Built Measure of Pleasant Touch through Active Fingertip Exploration

    Science.gov (United States)

    Klöcker, Anne; Arnould, Carlyne; Penta, Massimo; Thonnard, Jean-Louis

    2012-01-01

    Background: Evidence suggests that somatic sensation has a modality for pleasant touch. Objective: To investigate pleasant touch at the fingertip level (i.e., glabrous skin site) through the elaboration of a linear unidimensional scale that measures (i) various materials according to the level of pleasantness they elicit through active fingertip explorations and (ii) subjects according to their pleasantness leniency levels. Subjects: We enrolled 198 healthy subjects without any neurological disease. Methods: Blindfolded subjects actively explored 48 materials with their index fingertips and reported the perceived pleasantness of each on a 4-level scale. The fingertip moisture levels on each subject were measured before the experimental session. Data were analyzed using the Rasch model. Results: We elaborated unidimensional linear scale that included 37 materials according to their pleasantness of touch. The pleasantness level of 21 materials was perceived differently, depending on the fingertip moisture levels of the subjects. Conclusion: Based on our findings, we formulated a Pleasant Touch Scale. Fingertip moisture levels appeared to be a major factor for (un)pleasant feelings during active exploration. PMID:22737122

  5. Realizing a Rasch measurement through instructionally- sequenced domains of test items.

    Science.gov (United States)

    Schulz, E. Matthew

    2016-11-01

    This paper presents results from a project in which instructionally-sequenced domains were defined for purposes of constructing measures that that conform to an ideal in Guttman scaling and Rasch measurement. A fundamental idea in these measurement systems is that every person higher on the measurement scale can do everything that lower-level persons can do, plus at least one more thing. This idea has had limited application in educational measurement due to the stochastic nature of item response data and the sheer number of items needed to obtain reliable measures. However, it has been shown by Schulz, Lee, and Mullen [1] that this ideal can be can be realized at a higher level of abstraction - when items within a content strand are aggregated into a small number of domains that are ordered in instructional timing and difficulty. The present paper shows how this was done, and the results, in an achievement level setting project for the 2007 Grade 12 NAEP Economics Assessment.

  6. Insights into Engineering Education Learning Outcome’s Assessment with Rasch Model

    Directory of Open Access Journals (Sweden)

    Azrilah Abdul Aziz

    2013-10-01

    Full Text Available Education is a process in which people learn. Knowledge, skill or ability is gained during the learning process to better equipped students on career opportunities. Learning process takes place in academic institutions in which programs are developed for the various fields. Accreditation to these programs requires the academic institutions to adopt qualification framework. The Engineering Accreditation Council of Malaysia (EAC adopts the American Accreditation Board of Engineering and Technology 2000 (ABET requirements which promote Outcome Based Education (OBE learning process. OBE calls for the evaluation of the subjects Learning Outcomes (LO as specified in the Program Specification. Evaluation method has been largely dependent on students’ performance carrying out tasks in tests, quizzes o¬r submission of assignments. The evaluation on the students’ performance output gives an indication on the students’ achievement of the subject’s LO. However, measurements of the students’ achievement from the observed outcomes remain vague when raw scores are the only means of assessment. Raw scores may not provide true conception on difficulty of tests and or the true ability of students. This article described the measurement and analysis of the Engineering Mathematics LO’s achievement using Rasch Measurement Model. It gives a more meaningful analysis on the students’ achievement.

  7. Psychometric functions for detection and discrimination with and without flankers

    Science.gov (United States)

    García-Pérez, Miguel A.; Alcalá-Quintana, Rocío; Woods, Russell L.; Peli, Eli

    2010-01-01

    Recent studies reported that flanking stimuli broaden the psychometric function and lower detection thresholds. We measured psychometric functions for detection and discrimination with and without flankers to investigate whether these effects occur throughout the contrast continuum. Our results confirm that lower detection thresholds with flankers are accompanied by broader psychometric functions. Psychometric functions for discrimination reveal that discrimination thresholds with and without flankers are similar across standard levels, and that the broadening of psychometric functions with flankers disappears as standard contrast increases, to the point that psychometric functions at high standard levels are virtually identical with or without flankers. Threshold-versus-contrast (TvC) curves with flankers only differ from TvC curves without flankers in occasional shallower dippers and lower branches on the left of the dipper, but they run virtually superimposed at high standard levels. We discuss differences between our results and other results in the literature, and how they are likely attributed to the differential vulnerability of alternative psychophysical procedures to the effects of presentation order. We show that different models of flanker facilitation can fit the data equally well, which stresses that succeeding at fitting a model does not validate it in any sense. PMID:21264745

  8. Psychometric properties of the Interaction on Supervised Classes Scale (ISCS

    Directory of Open Access Journals (Sweden)

    Adrián Pastor-Barceló

    2016-06-01

    Full Text Available Purpose: This research focuses on the construction and validation of a scale designed to assess the quality of the supervised classes: Interaction on Supervised Classes Scale (ISCS. Design/methodology/approach: This is a descriptive correlational study. For the construction of the scale three phases were performed in which different experts assessed the adequacy of the items. Finally, the psychometric properties of the final version were studied in a sample of 314 consumers (69.1% women aged between 18 and 77 with an average of 39.33 years (SD=12.25. Findings: The scale presents adequate validity and reliability, being a useful tool for measuring the interaction in Supervised Classes. Research limitations/implications: The sampling, non-probabilistic or convenience, have taken the sample of a unique sports facility and the small sample size. Practical implications: The ISCS allows managers to receive better feedback, allowing them to obtain deeper insight into the quality and satisfaction of the service. According to its results, the managers may implement different strategies to improve quality in a key service within sports centers. Originality/value: For the first time the interaction between customers and between customers and employees is evaluated both inside and outside the center, a topic that had not yet been studied in the scientific literature. The scale can be applied to any type of directed activity, and will allow a greater understanding of the quality of service.

  9. Psycho-informatics: Big Data shaping modern psychometrics.

    Science.gov (United States)

    Markowetz, Alexander; Błaszkiewicz, Konrad; Montag, Christian; Switala, Christina; Schlaepfer, Thomas E

    2014-04-01

    For the first time in history, it is possible to study human behavior on great scale and in fine detail simultaneously. Online services and ubiquitous computational devices, such as smartphones and modern cars, record our everyday activity. The resulting Big Data offers unprecedented opportunities for tracking and analyzing behavior. This paper hypothesizes the applicability and impact of Big Data technologies in the context of psychometrics both for research and clinical applications. It first outlines the state of the art, including the severe shortcomings with respect to quality and quantity of the resulting data. It then presents a technological vision, comprised of (i) numerous data sources such as mobile devices and sensors, (ii) a central data store, and (iii) an analytical platform, employing techniques from data mining and machine learning. To further illustrate the dramatic benefits of the proposed methodologies, the paper then outlines two current projects, logging and analyzing smartphone usage. One such study attempts to thereby quantify severity of major depression dynamically; the other investigates (mobile) Internet Addiction. Finally, the paper addresses some of the ethical issues inherent to Big Data technologies. In summary, the proposed approach is about to induce the single biggest methodological shift since the beginning of psychology or psychiatry. The resulting range of applications will dramatically shape the daily routines of researches and medical practitioners alike. Indeed, transferring techniques from computer science to psychiatry and psychology is about to establish Psycho-Informatics, an entire research direction of its own.

  10. Validity of the Brazilian version of WHOQOL-BREF in depressed patients using Rasch modelling Validez de la versión brasilera de WHOQOL-BREF en pacientes deprimidos usando el modelo del Rasch Validade da versão brasileira do WHOQOL-BREF em pacientes deprimidos usando o modelo de Rasch

    Directory of Open Access Journals (Sweden)

    Neusa Sica da Rocha

    2009-02-01

    Full Text Available OBJECTIVE: To assess the validity of the Brazilian version of the World Health Organization Quality of Life Instrument - Abbreviated version (WHOQOL-BREF in adults with major depression, using Rasch modelling. METHODS: Study analyzing data from the baseline sample of the Longitudinal Investigation of Depression Outcomes in Brazil, including a total of 208 patients with major depression recruited in a primary care service in Porto Alegre (Southern Brazil, in 1999. The Center for Epidemiological Studies Depression Scale was used to assess intensity of depression; the WHOQOL-BREF to assess generic quality of life; and the Composite International Diagnostic Interview version 2.1 for the diagnosis of depression. RESULTS: In the Rasch analysis, the four domains of WHOQOL-BREF showed appropriate fit to this model. Some items needed adjustments: four items were rescored (pain, finances, services, and transport; two items (work and activity were identified as having dependency of responses, and one item was deleted (sleep due to multidimensionality. CONCLUSIONS: The validation of the WHOQOL-BREF Brazilian version using Rasch analysis complements previous validation studies, evidencing the robustness of this instrument as a generic cross-cultural quality of life measure.OBJETIVO: Evaluar la validez de la version brasilera del Instrumento de Calidad de Vida de la Organización Mundial de la Salud, abreviado en inglés WHOQOL-BREF, en adultos con depression, usando el modelo de Rasch. MÉTODOS: Se analizaron datos de la base de Investigación Longitudinal de Resultados de Depresión en Brasil, incluyendo un total de 208 pacientes con derpesión mayor recluidos en servicio de ciudado primario en Porto Alegre (Sur de Brasil, en 1999. El Centro de Estudios Epidemiológicos de Depresión fue usado para evaluar la intensidad de la depresión; el WHOQOLBREF para evaluar la calidad genérica de vida; y la Entrevista Internacional Compuesta para el Diagnostico

  11. Sample Size Determination Within the Scope of Conditional Maximum Likelihood Estimation with Special Focus on Testing the Rasch Model.

    Science.gov (United States)

    Draxler, Clemens; Alexandrowicz, Rainer W

    2015-12-01

    This paper refers to the exponential family of probability distributions and the conditional maximum likelihood (CML) theory. It is concerned with the determination of the sample size for three groups of tests of linear hypotheses, known as the fundamental trinity of Wald, score, and likelihood ratio tests. The main practical purpose refers to the special case of tests of the class of Rasch models. The theoretical background is discussed and the formal framework for sample size calculations is provided, given a predetermined deviation from the model to be tested and the probabilities of the errors of the first and second kinds.

  12. Theory of Mind and psychometric schizotypy.

    Science.gov (United States)

    Gooding, Diane Carol; Pflum, Madeline Johnson

    2011-07-30

    The extent to which Theory of Mind impairments are a trait associated with schizotypy is unclear. To date, findings have been mixed. We compared two groups of psychometrically identified schizotypes, namely, those characterized by positive schizotypy (perceptual aberrations and magical ideation; n=36) and those characterized by negative schizotypy (social anhedonia; n=30) to a low schizotypy comparison group (n=68) in terms of their Theory of Mind performance. Theory of Mind was assessed in two ways: a composite Hinting Task and the Reading the Mind in the Eyes Test. The groups were also compared in terms of their self-reported levels of referential thinking. Our results indicate that individuals characterized by positive schizotypy show Theory of Mind deficits, as measured by the Hinting Task. The three groups did not differ in terms of the Eyes Test. Referential thinking was significantly associated with the Eyes Test but not the Hinting Task. Overall these findings suggest that different aspects of schizotypy are associated differentially with Theory of Mind deficits. The results also provide further rationale for the inclusion of multiple tasks when attempting to study multifaceted constructs such as Theory of Mind. Copyright © 2011 Elsevier Ltd. All rights reserved.

  13. Psychometric properties of the Cognitive Failures Questionnaire.

    Science.gov (United States)

    Bridger, Robert S; Johnsen, Svein Åge Kjøs; Brasher, Kate

    2013-01-01

    The Cognitive Failures Questionnaire (CFQ) is used in ergonomics research to measure behavioural problems associated with attentiveness and memory in everyday life. CFQ scores have been related to constructs such as accident proneness and outcomes such as human error and psychological strain. The two-year test-retest reliability of the CFQ is reported together with the findings of factor analyses of CFQ data from 535 respondents. Evidence for the predictive and criterion validity and internal reliability of the CFQ is provided. Psychological strain was measured concurrently with CFQ on both testing occasions, two years apart. The test-retest reliability of the summated CFQ score was found to be 0.71, while for the General Health Questionnaire (GHQ-12) strain measure it was 0.32.The relative variance stability was five times greater for the CFQ than the GHQ, indicating that scores on these questionnaires are not covariates. The use of the CFQ as a measure of cognitive control capacity is also discussed. Ergonomists have long been interested in human error and the role of high work demands due to poor equipment design and excessive workload. The CFQ measures attentiveness in daily life and is shown to have excellent psychometric properties that make it suitable for use in both laboratory and field studies as a trait measure of attentiveness in daily life.

  14. The pornography craving questionnaire: psychometric properties.

    Science.gov (United States)

    Kraus, Shane; Rosenberg, Harold

    2014-04-01

    Despite the prevalence of pornography use, and recent conceptualization of problematic use as an addiction, we could find no published scale to measure craving for pornography. Therefore, we conducted three studies employing young male pornography users to develop and evaluate such a questionnaire. In Study 1, we had participants rate their agreement with 20 potential craving items after reading a control script or a script designed to induce craving to watch pornography. We dropped eight items because of low endorsement. In Study 2, we revised both the questionnaire and cue exposure stimuli and then evaluated several psychometric properties of the modified questionnaire. Item loadings from a principal components analysis, a high internal consistency reliability coefficient, and a moderate mean inter-item correlation supported interpreting the 12 revised items as a single scale. Correlations of craving scores with preoccupation with pornography, sexual history, compulsive internet use, and sensation seeking provided support for convergent validity, criterion validity, and discriminant validity, respectively. The enhanced imagery script did not impact reported craving; however, more frequent users of pornography reported higher craving than less frequent users regardless of script condition. In Study 3, craving scores demonstrated good one-week test-retest reliability and predicted the number of times participants used pornography during the following week. This questionnaire could be applied in clinical settings to plan and evaluate therapy for problematic users of pornography and as a research tool to assess the prevalence and contextual triggers of craving among different types of pornography users.

  15. A nurses' alarm fatigue questionnaire: development and psychometric properties.

    Science.gov (United States)

    Torabizadeh, Camellia; Yousefinya, Amirhossein; Zand, Farid; Rakhshan, Mahnaz; Fararooei, Mohammad

    2016-11-15

    Alarm fatigue can adversely affect nurses' efficiency and concentration on their tasks, which is a threat to patients' safety. The purpose of the present study was to develop and test the psychometric accuracy of an alarm fatigue questionnaire for nurses. This study was conducted in two stages: in stage one, in order to establish the different aspects of the concept of alarm fatigue, the researchers reviewed the available literature-articles and books-on alarm fatigue, and then consulted several experts in a meeting to define alarm fatigue and develop statements for the questionnaire. In stage two, after the final draft had been approved, the validity of the instrument was measured using the two methods of face validity (the quantitative and qualitative approaches) and content validity (the qualitative and quantitative approaches). Test-retest, Cronbach's alpha, and Principal Component Analysis were used for item reduction and reliability analysis. Based on the results of stage one, the researchers extracted 30 statements based on a 5-point Likert scale. In stage two, after the face and content validity of the questionnaire had been established, 19 statements were left in the instrument. Based on factor loadings of the items and "alpha if item deleted" and after the second round of consultation with the expert panel, six items were removed from the scale. The test of the reliability of nurses' alarm fatigue questionnaire based on the internal homogeneity and retest methods yielded the following results: test-retest correlation coefficient = 0.99; Guttman split-half correlation coefficient = 0.79; Cronbach's alpha = 0.91. Regarding the importance of recognizing alarm fatigue in nurses, there is need for an instrument to measure the phenomenon. The results of the study show that the developed questionnaire is valid and reliable enough for measuring alarm fatigue in nurses.

  16. Propriedades psicométricas do conjunto de testes da habilidade visuo espacial Psychometric proprieties of visual-spatial ability tests kit

    Directory of Open Access Journals (Sweden)

    Cristiano Mauro Assis Gomes

    2009-04-01

    Full Text Available Este artigo analisa as propriedades psicométricas de um conjunto de testes elaborados para mensurar a habilidade visuo espacial (Gv, quanto a sua estrutura fatorial, unidimensionalidade, validade convergente e discriminante. Fizeram parte da pesquisa 558 participantes que cursavam ou concluíram o ensino médio. Utilizou-se o Teste de Visualização (Vz, Teste de Flexibilidade de Fechamento (CF, Teste de Memória Visual (MV, Teste de Fluência Figural (FF, Teste de Fluência Ideacional 1 (FI1 e Teste de Fluência Ideacional 2 (FI2. Foram usados procedimentos de análise fatorial exploratória, análise fatorial confirmatória e o ajuste ao modelo Rasch. Os índices de ajuste dos modelos aos dados estão adequados às recomendações da literatura. Os testes possuem uma estrutura fatorial de dois níveis, porém unidimensional. Convergem para mensurar a habilidade visuo espacial (Gv e divergem na mensuração da fluência, utilizada neste estudo como habilidade contrastante.This article analyses the psychometrical properties of a test kit developed to measure visual-spatial ability in terms of its factorial structure, unidimensionality, convergent validity and divergent validity. A sample of 558 students that were either attending High School or had just concluded it participated of this research. The Visualization Test (Vz, Flexibility of Closure Test (CF, Visual Memory Test (MV, Figural Fluency Test (FF, Ideational Fluency Test 1 (FI1 and Ideational Fluency Test 2 (FI2 were used. The data analysis used the exploratory factorial analysis, the confirmatory factorial analysis and the fit to the Rasch model procedures. The model fit indexes are in accordance with the cutoff values suggested by the literature. The tests showed a two-level factorial structure, although it can be taken as an unidimensional structure. The tests converge to measure the visual-spatial ability and diverge to measure the fluency ability which was used in this study as

  17. A Rasch measure of teachers' views of teacher-student relationships in the primary school.

    Science.gov (United States)

    Leitao, Natalie; Waugh, Russell F

    2012-01-01

    This study investigated teacher-student relationships from the teachers' point of view at Perth metropolitan schools in Western Australia. The study identified three key social and emotional aspects that affect teacher-student relationships, namely, Connectedness, Availability and Communication. Data were collected by questionnaire (N = 139) with stem-items answered in three perspectives: (1) Idealistic: this is what I would like to happen; (2) Capability: this is what I am capable of; and (3) Behaviour: this is what actually happens, using four ordered response categories: not at all (score 1), some of the time (score 2), most of the time (score 3), and almost always (score 4). Data were analysed with a Rasch measurement model and a uni-dimensional, linear scale with 24 items, ordered from easy to hard, was created. The data were shown to be highly reliable, so that valid inferences could be made from the scale. The Person Separation Index (akin to a reliability index) was 0.93; there was good global teacher and item fit to the measurement model; there was good item fit; the targeting of the item difficulties against the teacher measures was good, and the response categories were answered consistently and logically. Teachers said that the ideal items were all easier than their corresponding capability items which were in turn easier than the behaviour items (where the items fitted the model), as conceptualized. The easiest ideal items were: I like this child and This child and I get along well together. The hardest ideal item (but still easy) was: I am available for this child. The easiest behaviour item (but still hard) was: This child and I get along well together. The hardest behaviour item (and very hard) was: I am interested to learn about this child's personal thoughts, feelings and experiences. The difficulties of the items supported the conceptual structure of the variable.

  18. Applying computerized adaptive testing to the Negative Acts Questionnaire-Revised: Rasch analysis of workplace bullying.

    Science.gov (United States)

    Ma, Shu-Ching; Chien, Tsair-Wei; Wang, Hsiu-Hung; Li, Yu-Chi; Yui, Mei-Shu

    2014-02-17

    Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory-based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than -4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. With CAT-based administration of the NAQ-R for nurses, their burden was substantially reduced without compromising measurement precision.

  19. Establishing score equivalence of the Functional Independence Measure motor scale and the Barthel Index, utilising the International Classification of Functioning, Disability and Health and Rasch measurement theory.

    Science.gov (United States)

    Prodinger, Birgit; O'Connor, Rory J; Stucki, Gerold; Tennant, Alan

    2017-05-16

    Two widely used outcome measures to assess functioning in neurological rehabilitation are the Functional Independence Measure (FIM™) and the Barthel Index. The current study aims to establish the equivalence of the total score of the FIM™ motor scale and the Barthel Index through the application of the International Classification of Functioning, Disability and Health, and Rasch measurement theory. Secondary analysis of a large sample of patients with stroke, spinal cord injury, and multiple sclerosis, undergoing rehabilitation was conducted. All patients were assessed at the same time on both the FIM™ and the Barthel Index. The International Classification of Functioning, Disability and Health Linking Rules were used to establish conceptual coherency between the 2 scales, and the Rasch measurement model to establish an exchange of the total scores. Using the FIM™ motor scale, items from both scales linked to the International Classification of Functioning, Disability and Health d4 Mobility or d5 Self-care chapters. Their co-calibration satisfied the assumptions of the Rasch model for each of 3 diagnostic groups. A ceiling effect was observed for the Barthel Index when contrasted against the FIM™ motor scale. Having a Rasch interval metric to transform scores between the FIM™ motor scale and Barthel Index is valuable for monitoring functioning, meta-analysis, quality audits and hospital benchmarking.

  20. A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D in a Rheumatoid Arthritis Population using Rasch Analysis

    Directory of Open Access Journals (Sweden)

    Tennant Alan

    2007-07-01

    Full Text Available Abstract Background The aim of this study was to test the internal validity of the total Center for Epidemiologic Studies-Depression (CES-D scale using Rasch analysis in a rheumatoid arthritis (RA population. Methods CES-D was administered to 157 patients with RA over three time points within a 12 month period. Rasch analysis was applied using RUMM2020 software to assess the overall fit of the model, the response scale used, individual item fit, differential item functioning (DIF and person separation. Results Pooled data across three time points was shown to fit the Rasch model with removal of seven items from the original 20-item CES-D scale. It was necessary to rescore the response format from four to three categories in order to improve the scale's fit. Two items demonstrated some DIF for age and gender but were retained within the 13-item CES-D scale. A new cut point for depression score of 9 was found to correspond to the original cut point score of 16 in the full CES-D scale. Conclusion This Rasch analysis of the CES-D in a longstanding RA cohort resulted in the construction of a modified 13-item scale with good internal validity. Further validation of the modified scale is recommended particularly in relation to the new cut point for depression.

  1. Using the Many-Facet Rasch Model to Evaluate Standard-Setting Judgments: Setting Performance Standards for Advanced Placement® Examinations

    Science.gov (United States)

    Kaliski, Pamela; Wind, Stefanie A.; Engelhard, George, Jr.; Morgan, Deanna; Plake, Barbara; Reshetar, Rosemary

    2012-01-01

    The Many-Facet Rasch (MFR) Model is traditionally used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR Model by examining the quality of ratings obtained from a…

  2. Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments: An Illustration with the Advanced Placement Environmental Science Exam

    Science.gov (United States)

    Kaliski, Pamela K.; Wind, Stefanie A.; Engelhard, George, Jr.; Morgan, Deanna L.; Plake, Barbara S.; Reshetar, Rosemary A.

    2013-01-01

    The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

  3. 以PETS为例谈Rasch拟合统计量的使用%Study on the Application of Rasch Fit Statistics:Using PETS as an Example

    Institute of Scientific and Technical Information of China (English)

    陈康

    2013-01-01

    Rasch模型已经被广泛的应用于教育测量领域,在考试相关的各个方面都产生了重大的影响。拟合统计量分析是应用Rasch模型的一个重要环节,在Rasch分析中起着关键的作用。本文以PETS为例,介绍了Rasch拟合统计量的特点和类别、实际使用方法及其局限性。%The Rasch model has been widely applied in the field of educational assessment. It has exerted substantial influences on many aspects of testing. Fit statistics analysis is an essential part of the application of the Rasch model. It plays a key role in Rasch analysis. The paper uses PETS as an example to introduce the features, types, actual use, and limitations of the Rasch fit statistics.

  4. Rasch Analysis of Word Identification and Magnitude Estimation Scaling Responses in Measuring Naive Listeners' Judgments of Speech Intelligibility of Children with Severe-to-Profound Hearing Impairments

    Science.gov (United States)

    Beltyukova, Svetlana A.; Stone, Gregory M.; Ellis, Lee W.

    2008-01-01

    Purpose: Speech intelligibility research typically relies on traditional evidence of reliability and validity. This investigation used Rasch analysis to enhance understanding of the functioning and meaning of scores obtained with 2 commonly used procedures: word identification (WI) and magnitude estimation scaling (MES). Method: Narrative samples…

  5. Validación de la escala para manía de la Universidad Nacional de Colombia usando el análisis de Rasch

    Directory of Open Access Journals (Sweden)

    Ricardo Sánchez

    2011-03-01

    Conclusiones. En este primer estudio de la escala para manías usando el análisis de Rasch, se detectó mal ajuste y redundancia de algunos ítems. El síndrome maníaco no queda completamente evaluado por la escala. El instrumento podría mejorarse agregando síntomas depresivos.

  6. Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments: An Illustration with the Advanced Placement Environmental Science Exam

    Science.gov (United States)

    Kaliski, Pamela K.; Wind, Stefanie A.; Engelhard, George, Jr.; Morgan, Deanna L.; Plake, Barbara S.; Reshetar, Rosemary A.

    2013-01-01

    The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

  7. Psychometric properties of the Oswestry Disability Index.

    Science.gov (United States)

    Saltychev, Mikhail; Mattie, Ryan; McCormick, Zachary; Bärlund, Esa; Laimi, Katri

    2017-09-01

    The aim of this study was to investigate the psychometric properties of the Oswestry Disability Index (ODI) in a large cross-sectional cohort of individuals with chronic low back pain by defining its internal consistency, construct structure and validity, and its ability to differentiate between different degrees of functional limitation. A total of 837 consecutive outpatient patients with low back pain were studied. The internal consistency of ODI was assessed by Cronbach's α, construct structure by exploratory factor analysis, construct validity by confirmatory factor analysis, and discrimination was determined by item response theory analysis. The ODI showed good internal consistency (α=0.85). Explanatory factor analysis showed that ODI is a unidimensional test measuring functional level and nothing else. The confirmatory factor analysis showed that the standardized regression weights of all ODI items were relatively high, varying from 0.5 to 0.7. The item response theory analysis suggested that eight out of 10 ODI items have a close to perfect ability to measure functional limitations in accordance with the actual severity of disability experienced by the respondents. Discrimination of all the items was high to perfect (1.08-2.01). The test characteristic and test information curves showed that the discriminative ability of the ODI is superior at higher levels of disability. The present data showed that the ODI is an internally consistent, unidimensional scale with overall excellent construct validity and ability to discriminate the severity of functional disability. The analysis suggests that the ODI may better distinguish between the relative degrees of function at above-average disability levels.

  8. Use of Rasch analysis to refine a patient-reported questionnaire on satisfaction with communication of the multiple sclerosis diagnosis.

    Science.gov (United States)

    Solari, A; Grzeda, M; Giordano, A; Mattarozzi, K; D'Alessandro, R; Simone, A; Tesio, L

    2014-08-01

    The Comunicazione medico-paziente nella Sclerosi Multipla - Revised (COSM-R) is a patient self-assessed questionnaire probing the moment of multiple sclerosis (MS) diagnosis disclosure (section 1, five items) and following period (section 2, 15 items). This study examined COSM-R dimensionality and measurement properties through Rasch analysis (partial-credit model) and proposed a revised questionnaire. Cross-sectional COSM-R data were obtained from 1068 people with MS (PwMS, 1065 questionnaires) participating in four studies (102 centres). Mean age was 40 years (range 17-73); 70% were women; 53% were from Northern, 25% from Central, and 21% from Southern Italy. Unidimensionality was not confirmed for COSM-R section 1, but was for section 2 after removal of three items. The revised instrument (COSM-S, Shortened) consisted of the original five-item checklist (section 1), modified by removing the table grouping of three items, and 12 of the original 15 section 2 items, which could now be summed and transformed into an interval scale. Scores were higher for items assessing emotional satisfaction than for those assessing informational satisfaction. The proposed COSM-S is a composite measure of satisfaction with MS diagnosis communication with improved metric properties over the original COSM-R, and whose section 2 satisfies Rasch model expectations. © The Author(s) 2014.

  9. Does Law Enforcement Influence Compliance Behaviour of Business Zakat among SMEs?: An Evidence via Rasch Measurement Model

    Directory of Open Access Journals (Sweden)

    Mohd Rahim Khamis

    2015-06-01

    Full Text Available Law enforcement is one of the factors determining compliance behaviour of zakat as revealed by a number of studies. However, there is lack of study focused on law enforcement and compliance behaviour of zakat especially in the business zakat scenario. Hence, the main objective of this study is to identify whether law enforcement influence compliance behaviour of business owners towards business zakat. A total of 276 questionnaires managed to be collected from SMEs entrepreneurs in Selangor. Rasch Measurement Model was employed to analyze the data. The construct was found reliable with Cronbach Alpha of 0.84. The statistical indicators such as mean square (MNSQ, Z-standardized (ZSTD, point measure correlation (PtMea Corr and Person Item Distribution Map (PIDM revealed that among 276 respondents, 92 respondents comply with business zakat payment influenced by law enforcement, 87 respondents did not comply with business zakat payment and probably not influenced by law enforcement and 97 respondents were identified as misfits situation. The implication of this paper provides evidence of the usefulness of Rasch Measurement Model in identifying the compliance behaviour of zakat payment among businesses. It is also able to explain that law enforcement really influenced Muslim business community to comply with business zakat payment.

  10. ACTIVLIM-CP a new Rasch-built measure of global activity performance for children with cerebral palsy.

    Science.gov (United States)

    Bleyenheuft, Yannick; Paradis, Julie; Renders, Anne; Thonnard, Jean-Louis; Arnould, Carlyne

    2017-01-01

    Children with cerebral palsy (CP) often have upper extremity (UE) and lower extremity (LE) impairments. While tools measuring separately UE and LE abilities are currently used, activities in which UE and LE are used in combination - numerous in everyday life - cannot be assessed because no instrument allows capturing global activity performance in children with CP. This study aimed to develop a clinical tool for measuring their global activity performance using the Rasch model. The caregivers of 226 children with CP (2-18 years old) answered a 154-item experimental questionnaire. Within 4-6 weeks, 129 of them filled in the questionnaire a second time. Responses were analyzed using the Rasch RUMM2020 software. The final 43 item scale presented a high reliability (R=0.98) and reproducibility (R=0.97). The item difficulty hierarchy was consistent over time and did not vary according to age, gender, or clinical form, allowing the follow-up of children from 2 to 18 years old. ACTIVLIM-CP is a unidimensional scale specifically developed to measure global activity performance in children with CP providing a reliable tool to follow children's evolution and document changes related to neurorehabilitation, especially where a combination of UE and LE is targeted. Its responsiveness is still to be tested. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  11. Applying the Rasch Model to Measure Mobility of Women: A Comparative Analysis of Mobility of Informal Workers in Fisheries in Kerala, India.

    Science.gov (United States)

    Menon, Nikhila

    2016-01-01

    Mobility or freedom and ability to move is gendered in many cultural contexts. In this paper I analyse mobility associated with work from the capability approach perspective of Sen. This is an empirical paper which uses the Rasch Rating Scale Model (RSM) to construct the measure of mobility of women for the first time in the development studies discourse. I construct a measure of mobility (latent trait) of women workers engaged in two types of informal work, namely, peeling work and fish vending, in fisheries in the cultural context of India. The scale measure enables first, to test the unidimensionality of my construct of mobility of women and second, to analyse the domains of mobility of women workers. The comparative analysis of the scale of permissibility of mobility constructed using the RSM for the informal women workers shows that women face constraints on mobility in social and personal spaces in the socially advanced state of Kerala in India. Work mobility does not expand the real freedoms, hence work mobility can be termed as bounded capability which is a capability limited or bounded by either the social, cultural and gender norms or a combination of all of these. Therefore at the macro level, growth in informal employment in sectors like fisheries which improve mobility of women through work mobility does not necessarily expand the capability sets by contributing to greater freedoms and transformational mobility. This paper has a significant methodological contribution in that it uses an innovative method for the measurement of mobility of women in the development studies discipline.

  12. QUEST+: A general multidimensional Bayesian adaptive psychometric method.

    Science.gov (United States)

    Watson, Andrew B

    2017-03-01

    QUEST+ is a Bayesian adaptive psychometric testing method that allows an arbitrary number of stimulus dimensions, psychometric function parameters, and trial outcomes. It is a generalization and extension of the original QUEST procedure and incorporates many subsequent developments in the area of parametric adaptive testing. With a single procedure, it is possible to implement a wide variety of experimental designs, including conventional threshold measurement; measurement of psychometric function parameters, such as slope and lapse; estimation of the contrast sensitivity function; measurement of increment threshold functions; measurement of noise-masking functions; Thurstone scale estimation using pair comparisons; and categorical ratings on linear and circular stimulus dimensions. QUEST+ provides a general method to accelerate data collection in many areas of cognitive and perceptual science.

  13. The Body Appreciation Scale-2: item refinement and psychometric evaluation.

    Science.gov (United States)

    Tylka, Tracy L; Wood-Barcalow, Nichole L

    2015-01-01

    Considered a positive body image measure, the 13-item Body Appreciation Scale (BAS; Avalos, Tylka, & Wood-Barcalow, 2005) assesses individuals' acceptance of, favorable opinions toward, and respect for their bodies. While the BAS has accrued psychometric support, we improved it by rewording certain BAS items (to eliminate sex-specific versions and body dissatisfaction-based language) and developing additional items based on positive body image research. In three studies, we examined the reworded, newly developed, and retained items to determine their psychometric properties among college and online community (Amazon Mechanical Turk) samples of 820 women and 767 men. After exploratory factor analysis, we retained 10 items (five original BAS items). Confirmatory factor analysis upheld the BAS-2's unidimensionality and invariance across sex and sample type. Its internal consistency, test-retest reliability, and construct (convergent, incremental, and discriminant) validity were supported. The BAS-2 is a psychometrically sound positive body image measure applicable for research and clinical settings.

  14. Development and Psychometric Evaluation of the Military Suicide Attitudes Questionnaire (MSAQ)

    Science.gov (United States)

    2015-05-12

    Development and Psychometric Evaluation of the Military Suicide Attitudes Questionnaire (MSAQ) by Marcus VanSickle...MEDICAL AND CLINICAL PSYCHOLOGY GRADUATE PROGRAM Title of Dissertation: "Development and Psychometric Evaluation of the Military Suicide Attitudes...hereby certifies that the use of any copyrighted material in the thesis manuscript entitled: "Development and Psychometric Evaluation of the Military

  15. Psychometric properties of the Spanish Burnout Inventory among staff nurses.

    Science.gov (United States)

    Gil-Monte, P R; Manzano-García, G

    2015-12-01

    The burnout syndrome contributes to the deterioration in the quality of personal life as well as lower quality practice in healthcare personnel. Researchers have been concerned about the psychometric limitations of some previous questionnaires designed to evaluate burnout. The Spanish Burnout Inventory was developed to address the problems associated with other instruments, but it has not yet been validated in staff nurses. This study provides evidence that the Spanish Burnout Inventory has adequate psychometric properties to estimate burnout in staff nurses. The Spanish Burnout Inventory offers a theoretical proposal to explain the different components of burnout. The Spanish Burnout Inventory provides researchers and practitioners with an expanded conceptualization of the burnout syndrome, which can facilitate the diagnosis and treatment of nursing professionals. Researchers have been concerned about the psychometric limitations of the some previous questionnaires designed to evaluate burnout. To address these problems associated with previous instruments, the Spanish Burnout Inventory (SBI) was developed. The instrument has not yet been validated in staff nurses. The purpose of this paper was to evaluate the psychometric properties of the SBI. The sample consisted of 720 staff nurses from two Spanish general hospitals. The instrument is composed of 20 items distributed in four dimensions: Enthusiasm towards the job (five items), Psychological exhaustion (four items), Indolence (six items) and Guilt (five items). Data were subjected to confirmatory factor analysis. To assess the factorial validity of the SBI, four alternative models were tested. Results show that the four-factor model of the SBI has adequate psychometric properties for the study of burnout in staff nurses. This model fitted the data better than the alternative models. The study provides evidence of the adequate psychometric properties of a measure to evaluate burnout in nursing professionals. The

  16. Psychometric properties of the Questionnaire for Secondary Traumatization

    Directory of Open Access Journals (Sweden)

    Katharina Weitkamp

    2014-01-01

    Full Text Available Background: During the past several years, there has been a growing interest in the negative effects that providing therapy may have on therapists. Of special interest is a phenomenon called secondary traumatization, which can arise while working with traumatized clients. To develop a simple screening tool for secondary traumatization, a quantitative assessment instrument was constructed using a data-driven approach based on qualitative interviews with affected trauma therapists as well as experienced supervisors in trauma therapy. Objective: The aim of the current study was to analyze the psychometric properties of the newly developed Questionnaire for Secondary Traumatization (FST acute and lifetime version and to determine the most appropriate scoring procedure. Method: To this end, three independent samples of psychotherapists (n=371, trauma therapists in training (n=80, and refugee counselors (n=197 filled out an online questionnaire battery. Data structure was analyzed using factor analyses, cluster analyses, and reliability analyses. Results: Factor analyses yielded a six-factor structure for both the acute and the lifetime version with only a small number of items loading on differing factors. Cluster analyses suggested a single scale structure of the questionnaire. The FST total score showed good internal consistencies across all three samples, while internal consistency of the six extracted factors was mixed. Conclusion: With the FST, a reliable screening instrument for acute and lifetime secondary traumatization is now available which is free of charge and yields a sum score for quick evaluation. The six-factor structure needs to be verified with confirmatory factor analyses.

  17. Assessing Collectivism in Latino, Asian/Pacific Islander, and African American Men Who Have Sex With Men: A Psychometric Evaluation.

    Science.gov (United States)

    Sauceda, John A; Paul, Jay P; Gregorich, Steven E; Choi, Kyung-Hee

    2016-02-01

    The study of collectivism has implications for HIV prevention research, especially in studies that use a social networking or community mobilization approach. However, research on collectivism in race/ethnicity and sexual minority groups is limited. We psychometrically evaluated a brief version of the Individualism-Collectivism Interpersonal Assessment Inventory (ICIAI) in a chain-referral sample of 400 Latino, 393 Asian/Pacific Islander, and 403 African American men who have sex with men (MSM). Data were collected via a one-time survey on demographics, the ICIAI, acculturation, and ethnicity identity. We conducted a multiple groups confirmatory factor analysis to assess for measurement invariance across the three groups of MSM, as well as tested its reliability and validity. The ICIAI evidenced good psychometric properties and was invariant across all groups. We highlight implications for how this measure of collectivism can be applied toward the study of HIV prevention and in lesbian, gay, bisexual and transgender communities.

  18. Work-nonwork interference: Preliminary results on the psychometric properties of a new instrument

    Directory of Open Access Journals (Sweden)

    Eileen Koekemoer

    2010-03-01

    Full Text Available Orientation: Recently, a new work-nonwork interference instrument was developed to measure the interference between work and nonwork roles in the South African context (Koekemoer, Mostert & Rothmann, 2010. However, no information is available on the psychometric properties of this instrument.Research purpose: The objectives of this study were to investigate the internal validity (construct, discriminant and convergent validity, reliability and external validity (relationship with theoretically relevant variables, including job characteristics, home characteristics, burnout, ill health and life satisfaction of the instrument.Motivation for the study: Work-family interaction is a key topic receiving significant research attention. In order to facilitate comparison across work-family studies, the use of psychometrically sound instruments is of great importance.Research design, approach and method: A cross-sectional survey design was used for the target population of married employees with children working at a tertiary institution in the North West province (n = 366. In addition to the new instrument, job characteristics, home characteristics, burnout, ill health and life satisfaction were measured.Main findings: The results provided evidence for construct, discriminant and convergent validity, reliability and significant relations with external variables.Practical/managerial implications: The new instrument can be used by researchers and managers as a test under development to investigate the interference between work and different nonwork roles (i.e. parental role, spousal role, work role, domestic role and specific relations with antecedents (e.g. job/home characteristics and well-being (e.g. burnout, ill health and life satisfaction.Contribution/value-add: This study provides preliminary information on the psychometric properties of a new instrument that measures the interference between work and nonwork.

  19. Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying

    Science.gov (United States)

    Ma, Shu-Ching; Li, Yu-Chi; Yui, Mei-Shu

    2014-01-01

    Background Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory–based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. Objective The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. Methods A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). Results The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than –4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. Conclusions With CAT-based administration of the NAQ-R for nurses, their burden was substantially

  20. A call for policy guidance on psychometric testing in doping control in sport.

    Science.gov (United States)

    Petróczi, Andrea; Backhouse, Susan H; Barkoukis, Vassilis; Brand, Ralf; Elbe, Anne-Marie; Lazuras, Lambros; Lucidi, Fabio

    2015-11-01

    One of the fundamental challenges in anti-doping is identifying athletes who use, or are at risk of using, prohibited performance enhancing substances. The growing trend to employ a forensic approach to doping control aims to integrate information from social sciences (e.g., psychology of doping) into organised intelligence to protect clean sport. Beyond the foreseeable consequences of a positive identification as a doping user, this task is further complicated by the discrepancy between what constitutes a doping offence in the World Anti-Doping Code and operationalized in doping research. Whilst psychology plays an important role in developing our understanding of doping behaviour in order to inform intervention and prevention, its contribution to the array of doping diagnostic tools is still in its infancy. In both research and forensic settings, we must acknowledge that (1) socially desirable responding confounds self-reported psychometric test results and (2) that the cognitive complexity surrounding test performance means that the response-time based measures and the lie detector tests for revealing concealed life-events (e.g., doping use) are prone to produce false or non-interpretable outcomes in field settings. Differences in social-cognitive characteristics of doping behaviour that are tested at group level (doping users vs. non-users) cannot be extrapolated to individuals; nor these psychometric measures used for individual diagnostics. In this paper, we present a position statement calling for policy guidance on appropriate use of psychometric assessments in the pursuit of clean sport. We argue that, to date, both self-reported and response-time based psychometric tests for doping have been designed, tested and validated to explore how athletes feel and think about doping in order to develop a better understanding of doping behaviour, not to establish evidence for doping. A false 'positive' psychological profile for doping affects not only the individual

  1. Psychometric Properties of a Translated Korean Adult Attachment Measure

    Science.gov (United States)

    Kim, Seong-Hyeon; Sherry, Alissa R.; Lee, Young-Sun; Kim, Chang-Dai

    2011-01-01

    In this study, psychometric properties of a Korean-adapted version of the Experiences in Close Relationships--Revised scale were investigated using confirmatory factor analysis (CFA) in conjunction with item response theory. In CFA, neither the supposed two-factor model of Anxiety and Avoidance nor two single-factor models for each factor showed a…

  2. A Psychometric Evaluation of the Cultural Receptivity in Fostering Scale

    Science.gov (United States)

    Coakley, Tanya M.; Orme, John G.

    2006-01-01

    Objective: The psychometric properties of a new measure of foster parents' openness toward participating in activities that promote children's cultural development are evaluated. The measure is titled the Cultural Receptivity in Fostering Scale (CRFS). Method: Data from 304 foster mothers who completed the CRFS and a battery of measures on…

  3. The Negative Stereotyping of Single Persons Scale: Initial Psychometric Development

    Science.gov (United States)

    Pignotti, Monica; Abell, Neil

    2009-01-01

    Objectives: The current study presents an initial psychometric analysis of a three-dimensional scale designed to measure stereotyping of people who are single, defined as not currently legally married. Methods: Following expert review, proposed scale items are administered to 178 graduate and undergraduate students. Reliability analysis and…

  4. Development and Psychometric Properties of the Homophobic Bullying Scale

    Science.gov (United States)

    Prati, Gabriele

    2012-01-01

    The study aimed to develop the Homophobic Bullying Scale and to investigate its psychometric properties. The items of the Homophobic Bullying Scale were created to measure high school students' bullying behaviors motivated by homophobia, including verbal bullying, relational bullying, physical bullying, property bullying, sexual harassment, and…

  5. Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

    Science.gov (United States)

    Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

    2014-01-01

    Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

  6. An international psychometric testing of the Care Dependency Scale

    NARCIS (Netherlands)

    Dijkstra, A.; Brown, L.; Havens, B.; Romeren, T.I.; Zanotti, R.; Dassen, T.; van den Heuvel, W.

    2000-01-01

    In an international study, psychometric properties of the Care Dependency Scale (CDS) were examined by analysing data gathered in Dutch, Canadian, Italian and Norwegian nursing homes. For that purpose, from these countries a convenience sample was developed consisting of 525 patients with dementia.

  7. Psychometric Testing of the Gordon Facial Muscle Weakness Assessment Tool

    Science.gov (United States)

    Gordon, Shirley C.; Blum, Cynthia Ann; Parcells, Dax Andrew

    2010-01-01

    School nurses may be the first health professionals to assess the onset of facial paralysis/muscle weakness in school-age children. The purpose of this study was to test the psychometric properties of the Gordon Facial Muscle Weakness Assessment Tool (GFMWT) developed by Gordon. Data were collected in two phases. In Phase 1, 4 content experts…

  8. Necessity for a comprehensive psychometric policy within an organization

    Directory of Open Access Journals (Sweden)

    T. H. Veldsman

    1990-06-01

    Full Text Available Psychometric testing is an important, valuable, widespread and legally protected activity in South Africa. Within the ambit of the organizational context a psychometric policy is required to guide and direct this activity. The purpose of this article is to show how the need for such a policy within an organization can be fulfilled. The article proceeds as follows: firstly, the positioning of a psychometric policy within the overall human resource management of an organization is discussed; secondly, a definition of the term 'psychometric policy' and the aims thereof are given; thirdly, a suggested content for such a policy is outlined; fourthly a method of generating this policy is proposed; and lastly, the role of the psychologist in this regard is indicated.  Opsomming Psigometriese toetsing is 'n belangrike, waardevolle, algemene en wetlik beskermde aktiwiteit in Suid-Afrika. Binne organisatoriese verband word 'n psigometriese beleid benodig om hierdie aktiwiteit te lei en rig. Die doel van hierdie artikel is om aan te toon hoe die behoefte aan sodanige beleid in 'n organisasie vervul kan word. Die artikel verloop soos volg: eerstens, word die plasing van 'n psigometriese beleid binne die algemene menslike hulpbronbestuur van die organisasie bespreek; tweedens, word 'n definisie van die begrip "psigometriese beleid" en die doelwitte daarvan gegee; derdens, word 'n voorgestelde inhoud vir sodanige beleid aan die orde gestel; uierdens, word 'n metode aangedui waarvolgens hierdie beleid daargestel kan word; en laastens, word die rol van die sielkundige in hierdie area aangedui.

  9. Psychometric Properties of the Revised Teachers' Attitude toward Inclusion Scale

    Science.gov (United States)

    Monsen, Jeremy J.; Ewing, Donna L.; Boyle, James

    2015-01-01

    This paper presents the psychometric properties of a questionnaire measure that updates and extends Larrivee and Cook's (1979) Opinions Relative to Mainstreaming Scale in terms of structure, terminology, and language. The revised scale was tested using a sample of 106 teachers based in inclusive mainstream schools. Using Principal Component…

  10. The Dysfunctional Attitudes Scale: Psychometric Properties in Depressed Adolescents

    Science.gov (United States)

    Rogers, Gregory M.; Park, Jong-Hyo; Essex, Marilyn J.; Klein, Marjorie H.; Silva, Susan G.; Hoyle, Rick H.; Curry, John F.; Feeny, Norah C.; Kennard, Betsy; Kratochvil, Christopher J.; Pathak, Sanjeev; Reinecke, Mark A.; Rosenberg, David R.; Weller, Elizabeth B.; March, John S.

    2009-01-01

    The psychometric properties and factor structure of the Dysfunctional Attitudes Scale were examined in a sample of 422 male and female adolescents (ages 12-17) with current major depressive disorder. The scale demonstrated high internal consistency ([alpha] = 0.93) and correlated significantly with self-report and interview-based measures of…

  11. PSYCHOMETRIC PROPERTIES OF BRADBURN AFFECT BALANCE SCALE AMONG ELDERLY PERSONS

    NARCIS (Netherlands)

    KEMPEN, GIJM

    Some psychometric properties of the Affect Balance Scale have been tested on a random sample of 354 elderly people in the Netherlands. Internal reliability estimates were comparable with prior ones, and the 8-wk. test-retest reliability is reasonable for these 5-item measures.

  12. Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

    Science.gov (United States)

    Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

    2014-01-01

    Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

  13. Psychometric properties of the Danish Strength and Difficulties Questionnaire

    DEFF Research Database (Denmark)

    Niclasen, Janni; Teasdale, Thomas William; Andersen, Anne-Marie Nybo

    2012-01-01

    The Strength and Difficulties Questionnaire (SDQ) is a brief behavioural five factor instrument developed to assess emotional and behavioural problems in children and adolescents. The aim of the current study was to evaluate the psychometric properties for parent and teacher ratings in the Danish...

  14. Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

    Science.gov (United States)

    Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

    2016-01-01

    This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

  15. Psychometric Properties of the Chinese Cultural Beliefs about Adversity Scale

    Science.gov (United States)

    Leung, Janet T. Y.; Shek, Daniel T. L.

    2013-01-01

    Objective: The purpose of the study was to examine the psychometric properties of the Chinese Cultural Beliefs about Adversity scale (CBA). Methods: The CBA was administered in a sample of 275 Chinese parents experiencing economic disadvantage. Results: The CBA was found to be internally consistent. Consistent with the conceptual framework, factor…

  16. Psychometric Properties of the Brief Autism Mealtime Behaviors Inventory

    Science.gov (United States)

    DeMand, Alexandra; Johnson, Cynthia; Foldes, Emily

    2015-01-01

    The purpose of this study was to explore the psychometric properties of the Brief Autism Mealtime Behaviors Inventory (BAMBI). In a sample of 273 well-characterized children with ASD, we explored the factor structure of the BAMBI, determined the internal consistency of a newly derived factor structure and provide an empirically derived cut-off for…

  17. The Compulsive Internet Use Scale (CIUS): Some Psychometric Properties

    NARCIS (Netherlands)

    Meerkerk, G.J.; Eijnden, R.J.J.M. van den; Vermulst, A.A.; Garretsen, H.F.L.

    2009-01-01

    The present study aimed to develop a short, easily administered, psychometrically sound, and valid instrument to assess the severity of compulsive Internet use. A set of criteria was determined based on the addiction literature. Next, the internal consistency and convergent validity were determined,

  18. The Schizotypic Syndrome Questionnaire (SSQ): Psychometrics, validation and norms.

    NARCIS (Netherlands)

    Kampen, van D.

    2006-01-01

    Abstract This paper examines the psychometric properties (reliability and factor structure) and validity (relationship with various self-report measures and SPEM dysfunction) of the SSQ or Schizotypic Syndrome Questionnaire, a 108-item inventory for the measurement of 12 prodromal or schizotypic

  19. Psychometric Analysis of Role Conflict and Ambiguity Scales in Academia

    Science.gov (United States)

    Khan, Anwar; Yusoff, Rosman Bin Md.; Khan, Muhammad Muddassar; Yasir, Muhammad; Khan, Faisal

    2014-01-01

    A comprehensive Psychometric Analysis of Rizzo et al.'s (1970) Role Conflict & Ambiguity (RCA) scales were performed after its distribution among 600 academic staff working in six universities of Pakistan. The reliability analysis includes calculation of Cronbach Alpha Coefficients and Inter-Items statistics, whereas validity was determined by…

  20. Psychometrics and Assessment of an Empathy Distance Gradient

    Science.gov (United States)

    Hollar, David W.

    2017-01-01

    Research has indicated declining empathy within specific professions and social structures. Few psychometric instruments have addressed empathy within the context of psychological distance/relatedness to other individuals and even to other species, relationships that can be important contributors to psychological well-being and health. We…