'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

Science.gov (United States)

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Validation of the tool assessment of clinical education (AssCE): A study using Delphi method and clinical experts.

Science.gov (United States)

Löfmark, Anna; Mårtensson, Gunilla

2017-03-01

The aim of the present study was to establish the validity of the tool Assessment of Clinical Education (AssCE). The tool is widely used in Sweden and some Nordic countries for assessing nursing students' performance in clinical education. It is important that the tools in use be subjected to regular audit and critical reviews. The validation process, performed in two stages, was concluded with a high level of congruence. In the first stage, Delphi technique was used to elaborate the AssCE tool using a group of 35 clinical nurse lecturers. After three rounds, we reached consensus. In the second stage, a group of 46 clinical nurse lecturers representing 12 universities in Sweden and Norway audited the revised version of the AssCE in relation to learning outcomes from the last clinical course at their respective institutions. Validation of the revised AssCE was established with high congruence between the factors in the AssCE and examined learning outcomes. The revised AssCE tool seems to meet its objective to be a validated assessment tool for use in clinical nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Performance Validity Testing in Neuropsychology: Scientific Basis and Clinical Application-A Brief Review.

Science.gov (United States)

Greher, Michael R; Wodushek, Thomas R

2017-03-01

Performance validity testing refers to neuropsychologists' methodology for determining whether neuropsychological test performances completed in the course of an evaluation are valid (ie, the results of true neurocognitive function) or invalid (ie, overly impacted by the patient's effort/engagement in testing). This determination relies upon the use of either standalone tests designed for this sole purpose, or specific scores/indicators embedded within traditional neuropsychological measures that have demonstrated this utility. In response to a greater appreciation for the critical role that performance validity issues play in neuropsychological testing and the need to measure this variable to the best of our ability, the scientific base for performance validity testing has expanded greatly over the last 20 to 30 years. As such, the majority of current day neuropsychologists in the United States use a variety of measures for the purpose of performance validity testing as part of everyday forensic and clinical practice and address this issue directly in their evaluations. The following is the first article of a 2-part series that will address the evolution of performance validity testing in the field of neuropsychology, both in terms of the science as well as the clinical application of this measurement technique. The second article of this series will review performance validity tests in terms of methods for development of these measures, and maximizing of diagnostic accuracy.

Refining and validating a conceptual model of Clinical Nurse Leader integrated care delivery.

Science.gov (United States)

Bender, Miriam; Williams, Marjory; Su, Wei; Hites, Lisle

2017-02-01

To empirically validate a conceptual model of Clinical Nurse Leader integrated care delivery. There is limited evidence of frontline care delivery models that consistently achieve quality patient outcomes. Clinical Nurse Leader integrated care delivery is a promising nursing model with a growing record of success. However, theoretical clarity is necessary to generate causal evidence of effectiveness. Sequential mixed methods. A preliminary Clinical Nurse Leader practice model was refined and survey items developed to correspond with model domains, using focus groups and a Delphi process with a multi-professional expert panel. The survey was administered in 2015 to clinicians and administrators involved in Clinical Nurse Leader initiatives. Confirmatory factor analysis and structural equation modelling were used to validate the measurement and model structure. Final sample n = 518. The model incorporates 13 components organized into five conceptual domains: 'Readiness for Clinical Nurse Leader integrated care delivery'; 'Structuring Clinical Nurse Leader integrated care delivery'; 'Clinical Nurse Leader Practice: Continuous Clinical Leadership'; 'Outcomes of Clinical Nurse Leader integrated care delivery'; and 'Value'. Sample data had good fit with specified model and two-level measurement structure. All hypothesized pathways were significant, with strong coefficients suggesting good fit between theorized and observed path relationships. The validated model articulates an explanatory pathway of Clinical Nurse Leader integrated care delivery, including Clinical Nurse Leader practices that result in improved care dynamics and patient outcomes. The validated model provides a basis for testing in practice to generate evidence that can be deployed across the healthcare spectrum. © 2016 John Wiley & Sons Ltd.

Clinical Validation of Point-Source Corneal Topography in Keratoplasty

NARCIS (Netherlands)

Vrijling, A C L; Braaf, B.; Snellenburg, J.J.; de Lange, F.; Zaal, M.J.W.; van der Heijde, G.L.; Sicam, V.A.D.P.

2011-01-01

Purpose. To validate the clinical performance of point-source corneal topography (PCT) in postpenetrating keratoplasty (PKP) eyes and to compare it with conventional Placido-based topography. Methods. Corneal elevation maps of the anterior corneal surface were obtained from 20 post-PKP corneas using

Evidence for the Criterion Validity and Clinical Utility of the Pathological Narcissism Inventory

Science.gov (United States)

Thomas, Katherine M.; Wright, Aidan G. C.; Lukowitsky, Mark R.; Donnellan, M. Brent; Hopwood, Christopher J.

2012-01-01

In this study, the authors evaluated aspects of criterion validity and clinical utility of the grandiosity and vulnerability components of the Pathological Narcissism Inventory (PNI) using two undergraduate samples (N = 299 and 500). Criterion validity was assessed by evaluating the correlations of narcissistic grandiosity and narcissistic…

The Maastricht Clinical Teaching Questionnaire (MCTQ) as a valid and reliable instrument for the evaluation of clinical teachers.

Science.gov (United States)

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2010-11-01

Clinical teaching's importance in the medical curriculum has led to increased interest in its evaluation. Instruments for evaluating clinical teaching must be theory based, reliable, and valid. The Maastricht Clinical Teaching Questionnaire (MCTQ), based on the theoretical constructs of cognitive apprenticeship, elicits evaluations of individual clinical teachers' performance at the workplace. The authors investigated its construct validity and reliability, and they used the underlying factors to test a causal model representing effective clinical teaching. Between March 2007 and December 2008, the authors asked students who had completed clerkship rotations in different departments of two teaching hospitals to use the MCTQ to evaluate their clinical teachers. To establish construct validity, the authors performed a confirmatory factor analysis of the evaluation data, and they estimated reliability by calculating the generalizability coefficient and standard error measurement. Finally, to test a model of the factors, they fitted a structural linear model to the data. Confirmatory factor analysis yielded a five-factor model which fit the data well. Generalizability studies indicated that 7 to 10 student ratings can produce reliable ratings of individual teachers. The hypothesized structural linear model underlined the central roles played by modeling and coaching (mediated by articulation). The MCTQ is a valid and reliable evaluation instrument, thereby demonstrating the usefulness of the cognitive apprenticeship concept for clinical teaching during clerkships. Furthermore, a valuable model of clinical teaching emerged, highlighting modeling, coaching, and stimulating students' articulation and exploration as crucial to effective teaching at the clinical workplace.

Content Validation of Athletic Therapy Clinical Presentations in Canada

Science.gov (United States)

Lafave, Mark R.; Yeo, Michelle; Westbrook, Khatija; Valdez, Dennis; Eubank, Breda; McAllister, Jenelle

2016-01-01

Context: Competency-based education requires strong planning and a vehicle to deliver and track students' progress across their undergraduate programs. Clinical presentations (CPs) are proposed as 1 method to deliver a competency-based curriculum in a Canadian undergraduate athletic therapy program. Objective: Validation of 253 CPs. Setting:…

Validation of Clinical Observations of Mastication in Persons with ALS.

Science.gov (United States)

Simione, Meg; Wilson, Erin M; Yunusova, Yana; Green, Jordan R

2016-06-01

Amyotrophic lateral sclerosis (ALS) is a progressive neurological disease that can result in difficulties with mastication leading to malnutrition, choking or aspiration, and reduced quality of life. When evaluating mastication, clinicians primarily observe spatial and temporal aspects of jaw motion. The reliability and validity of clinical observations for detecting jaw movement abnormalities is unknown. The purpose of this study is to determine the reliability and validity of clinician-based ratings of chewing performance in neuro-typical controls and persons with varying degrees of chewing impairments due to ALS. Adults chewed a solid food consistency while full-face video were recorded along with jaw kinematic data using a 3D optical motion capture system. Five experienced speech-language pathologists watched the videos and rated the spatial and temporal aspects of chewing performance. The jaw kinematic data served as the gold-standard for validating the clinicians' ratings. Results showed that the clinician-based rating of temporal aspects of chewing performance had strong inter-rater reliability and correlated well with comparable kinematic measures. In contrast, the reliability of rating the spatial and spatiotemporal aspects of chewing (i.e., range of motion of the jaw, consistency of the chewing pattern) was mixed. Specifically, ratings of range of motion were at best only moderately reliable. Ratings of chewing movement consistency were reliable but only weakly correlated with comparable measures of jaw kinematics. These findings suggest that clinician ratings of temporal aspects of chewing are appropriate for clinical use, whereas ratings of the spatial and spatiotemporal aspects of chewing may not be reliable or valid.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

Science.gov (United States)

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

Validation of the Portuguese version of the Brief Multidimensional Measure of Religiousness/Spirituality (BMMRS-P) in clinical and non-clinical samples.

Science.gov (United States)

Curcio, Cristiane Schumann Silva; Lucchetti, Giancarlo; Moreira-Almeida, Alexander

2015-04-01

Despite Brazil's high levels of religious involvement, there is a scarcity of validated religiousness/spirituality (R/S) measures in Portuguese, particularly multidimensional ones. This study presents the validation of the Portuguese version of the "Brief Multidimensional Measure in Religiousness and Spirituality" (BMMRS) within the Brazilian context. Inpatients (262) and caregivers (389) at two hospitals of Brazil answered the BMMRS, the DUREL-p, and a sociodemographic questionnaire. The internal and convergent validity and test-retest reliability for major dimensions were good. Discriminant validity was high (except for the Forgiveness dimension). The Portuguese version of the BMMRS is a reliable and valid instrument to assess multiple R/S dimensions in clinical and non-clinical samples.

Validation of a next-generation sequencing assay for clinical molecular oncology.

Science.gov (United States)

Cottrell, Catherine E; Al-Kateb, Hussam; Bredemeyer, Andrew J; Duncavage, Eric J; Spencer, David H; Abel, Haley J; Lockwood, Christina M; Hagemann, Ian S; O'Guin, Stephanie M; Burcea, Lauren C; Sawyer, Christopher S; Oschwald, Dayna M; Stratman, Jennifer L; Sher, Dorie A; Johnson, Mark R; Brown, Justin T; Cliften, Paul F; George, Bijoy; McIntosh, Leslie D; Shrivastava, Savita; Nguyen, Tudung T; Payton, Jacqueline E; Watson, Mark A; Crosby, Seth D; Head, Richard D; Mitra, Robi D; Nagarajan, Rakesh; Kulkarni, Shashikant; Seibert, Karen; Virgin, Herbert W; Milbrandt, Jeffrey; Pfeifer, John D

2014-01-01

Currently, oncology testing includes molecular studies and cytogenetic analysis to detect genetic aberrations of clinical significance. Next-generation sequencing (NGS) allows rapid analysis of multiple genes for clinically actionable somatic variants. The WUCaMP assay uses targeted capture for NGS analysis of 25 cancer-associated genes to detect mutations at actionable loci. We present clinical validation of the assay and a detailed framework for design and validation of similar clinical assays. Deep sequencing of 78 tumor specimens (≥ 1000× average unique coverage across the capture region) achieved high sensitivity for detecting somatic variants at low allele fraction (AF). Validation revealed sensitivities and specificities of 100% for detection of single-nucleotide variants (SNVs) within coding regions, compared with SNP array sequence data (95% CI = 83.4-100.0 for sensitivity and 94.2-100.0 for specificity) or whole-genome sequencing (95% CI = 89.1-100.0 for sensitivity and 99.9-100.0 for specificity) of HapMap samples. Sensitivity for detecting variants at an observed 10% AF was 100% (95% CI = 93.2-100.0) in HapMap mixes. Analysis of 15 masked specimens harboring clinically reported variants yielded concordant calls for 13/13 variants at AF of ≥ 15%. The WUCaMP assay is a robust and sensitive method to detect somatic variants of clinical significance in molecular oncology laboratories, with reduced time and cost of genetic analysis allowing for strategic patient management. Copyright © 2014 American Society for Investigative Pathology and the Association for Molecular Pathology. Published by Elsevier Inc. All rights reserved.

Validation of a clinical critical thinking skills test in nursing.

Science.gov (United States)

Shin, Sujin; Jung, Dukyoo; Kim, Sungeun

2015-01-27

The purpose of this study was to develop a revised version of the clinical critical thinking skills test (CCTS) and to subsequently validate its performance. This study is a secondary analysis of the CCTS. Data were obtained from a convenience sample of 284 college students in June 2011. Thirty items were analyzed using item response theory and test reliability was assessed. Test-retest reliability was measured using the results of 20 nursing college and graduate school students in July 2013. The content validity of the revised items was analyzed by calculating the degree of agreement between instrument developer intention in item development and the judgments of six experts. To analyze response process validity, qualitative data related to the response processes of nine nursing college students obtained through cognitive interviews were analyzed. Out of initial 30 items, 11 items were excluded after the analysis of difficulty and discrimination parameter. When the 19 items of the revised version of the CCTS were analyzed, levels of item difficulty were found to be relatively low and levels of discrimination were found to be appropriate or high. The degree of agreement between item developer intention and expert judgments equaled or exceeded 50%. From above results, evidence of the response process validity was demonstrated, indicating that subjects respondeds as intended by the test developer. The revised 19-item CCTS was found to have sufficient reliability and validity and will therefore represents a more convenient measurement of critical thinking ability.

Patient Experiences with the Preoperative Assessment Clinic (PEPAC): validation of an instrument to measure patient experiences

NARCIS (Netherlands)

Edward, G. M.; Lemaire, L. C.; Preckel, B.; Oort, F. J.; Bucx, M. J. L.; Hollmann, M. W.; de Haes, J. C. J. M.

2007-01-01

Background. Presently, no comprehensive and validated questionnaire to measure patient experiences of the preoperative assessment clinic (PAC) is available. We developed and validated the Patient Experiences with the Preoperative Assessment Clinic (PEPAC) questionnaire, which can be used for

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

Science.gov (United States)

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

The reliability and validity of the Everyday Feelings Questionnaire in a clinical population.

Science.gov (United States)

Mann, Joanna; Henley, William; O'Mahen, Heather; Ford, Tamsin

2013-06-01

Depression could be considered to be on a continuum with well-being and some have argued that it is important to measure well-being as well as distress. The Everyday Feelings Questionnaire was designed to measure both these aspects. Its validity has been assessed in a nonclinical population. This project aims to assess the validity and reliability of the EFQ in a clinical population. The EFQ was completed by 105 clients within a mental health clinical setting. The following aspects of the EFQ were explored: its internal structure, concurrent validity, re-test reliability and internal consistency. The EFQ had good internal consistency and correlated highly with other measures of anxiety and depression. The correlation between total EFQ scores on the two occasions was reasonable and there was no effect of time during completion. A Bland-Altman plot showed no obvious pattern between the difference between EFQ scores and the mean score. A one factor model showed a moderate fit to the data. This study does not explore the acceptability or sensitivity to change of the EFQ, and a larger sample size would be needed to extend the analysis conducted. The EFQ is a valid and reliable measure when used in this clinical population. Copyright © 2012 Elsevier B.V. All rights reserved.

Validation of a clinical critical thinking skills test in nursing

Directory of Open Access Journals (Sweden)

Sujin Shin

2015-01-01

Full Text Available Purpose: The purpose of this study was to develop a revised version of the clinical critical thinking skills test (CCTS and to subsequently validate its performance. Methods: This study is a secondary analysis of the CCTS. Data were obtained from a convenience sample of 284 college students in June 2011. Thirty items were analyzed using item response theory and test reliability was assessed. Test-retest reliability was measured using the results of 20 nursing college and graduate school students in July 2013. The content validity of the revised items was analyzed by calculating the degree of agreement between instrument developer intention in item development and the judgments of six experts. To analyze response process validity, qualitative data related to the response processes of nine nursing college students obtained through cognitive interviews were analyzed. Results: Out of initial 30 items, 11 items were excluded after the analysis of difficulty and discrimination parameter. When the 19 items of the revised version of the CCTS were analyzed, levels of item difficulty were found to be relatively low and levels of discrimination were found to be appropriate or high. The degree of agreement between item developer intention and expert judgments equaled or exceeded 50%. Conclusion: From above results, evidence of the response process validity was demonstrated, indicating that subjects respondeds as intended by the test developer. The revised 19-item CCTS was found to have sufficient reliability and validity and will therefore represents a more convenient measurement of critical thinking ability.

Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity

Directory of Open Access Journals (Sweden)

Mohammad Al-Amri

2018-02-01

Full Text Available The aim of this study was to investigate the reliability and concurrent validity of a commercially available Xsens MVN BIOMECH inertial-sensor-based motion capture system during clinically relevant functional activities. A clinician with no prior experience of motion capture technologies and an experienced clinical movement scientist each assessed 26 healthy participants within each of two sessions using a camera-based motion capture system and the MVN BIOMECH system. Participants performed overground walking, squatting, and jumping. Sessions were separated by 4 ± 3 days. Reliability was evaluated using intraclass correlation coefficient and standard error of measurement, and validity was evaluated using the coefficient of multiple correlation and the linear fit method. Day-to-day reliability was generally fair-to-excellent in all three planes for hip, knee, and ankle joint angles in all three tasks. Within-day (between-rater reliability was fair-to-excellent in all three planes during walking and squatting, and poor-to-high during jumping. Validity was excellent in the sagittal plane for hip, knee, and ankle joint angles in all three tasks and acceptable in frontal and transverse planes in squat and jump activity across joints. Our results suggest that the MVN BIOMECH system can be used by a clinician to quantify lower-limb joint angles in clinically relevant movements.

External validation of a biomarker and clinical prediction model for hospital mortality in acute respiratory distress syndrome.

Science.gov (United States)

Zhao, Zhiguo; Wickersham, Nancy; Kangelaris, Kirsten N; May, Addison K; Bernard, Gordon R; Matthay, Michael A; Calfee, Carolyn S; Koyama, Tatsuki; Ware, Lorraine B

2017-08-01

Mortality prediction in ARDS is important for prognostication and risk stratification. However, no prediction models have been independently validated. A combination of two biomarkers with age and APACHE III was superior in predicting mortality in the NHLBI ARDSNet ALVEOLI trial. We validated this prediction tool in two clinical trials and an observational cohort. The validation cohorts included 849 patients from the NHLBI ARDSNet Fluid and Catheter Treatment Trial (FACTT), 144 patients from a clinical trial of sivelestat for ARDS (STRIVE), and 545 ARDS patients from the VALID observational cohort study. To evaluate the performance of the prediction model, the area under the receiver operating characteristic curve (AUC), model discrimination, and calibration were assessed, and recalibration methods were applied. The biomarker/clinical prediction model performed well in all cohorts. Performance was better in the clinical trials with an AUC of 0.74 (95% CI 0.70-0.79) in FACTT, compared to 0.72 (95% CI 0.67-0.77) in VALID, a more heterogeneous observational cohort. The AUC was 0.73 (95% CI 0.70-0.76) when FACTT and VALID were combined. We validated a mortality prediction model for ARDS that includes age, APACHE III, surfactant protein D, and interleukin-8 in a variety of clinical settings. Although the model performance as measured by AUC was lower than in the original model derivation cohort, the biomarker/clinical model still performed well and may be useful for risk assessment for clinical trial enrollment, an issue of increasing importance as ARDS mortality declines, and better methods are needed for selection of the most severely ill patients for inclusion.

Applying Kane's Validity Framework to a Simulation Based Assessment of Clinical Competence

Science.gov (United States)

Tavares, Walter; Brydges, Ryan; Myre, Paul; Prpic, Jason; Turner, Linda; Yelle, Richard; Huiskamp, Maud

2018-01-01

Assessment of clinical competence is complex and inference based. Trustworthy and defensible assessment processes must have favourable evidence of validity, particularly where decisions are considered high stakes. We aimed to organize, collect and interpret validity evidence for a high stakes simulation based assessment strategy for certifying…

A critical evaluation of the validity of episodic future thinking: A clinical neuropsychology perspective.

Science.gov (United States)

Ward, Amanda M

2016-11-01

Episodic future thinking is defined as the ability to mentally simulate a future event. Although episodic future thinking has been studied extensively in neuroscience, this construct has not been explored in depth from the perspective of clinical neuropsychology. The aim of this critical narrative review is to assess the validity and clinical implications of episodic future thinking. A systematic review of episodic future thinking literature was conducted. PubMed and PsycInfo were searched through July 2015 for review and empirical articles with the following search terms: "episodic future thinking," "future mental simulation," "imagining the future," "imagining new experiences," "future mental time travel," "future autobiographical experience," and "prospection." The review discusses evidence that episodic future thinking is important for adaptive functioning, which has implications for neurological populations. To determine the validity of episodic future thinking, the construct is evaluated with respect to related constructs, such as imagination, episodic memory, autobiographical memory, prospective memory, narrative construction, and working memory. Although it has been minimally investigated, there is evidence of convergent and discriminant validity for episodic future thinking. Research has not addressed the incremental validity of episodic future thinking. Practical considerations of episodic future thinking tasks and related constructs in a clinical neuropsychological setting are considered. The utility of episodic future thinking is currently unknown due to the lack of research investigating the validity of episodic future thinking. Future work is discussed, which could determine whether episodic future thinking is an important missing piece in standard clinical neuropsychological assessment. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Clinical Validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): Further Evaluation and Clinical Applications

Science.gov (United States)

McAleavey, Andrew A.; Nordberg, Samuel S.; Hayes, Jeffrey A.; Castonguay, Louis G.; Locke, Benjamin D.; Lockard, Allison J.

2012-01-01

Self-report instruments of psychological symptoms are increasingly used in counseling centers but rely on rigorous evaluation of their clinical validity. Three studies reported here (total N = 26,886) investigated the validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62; Locke et al., 2011) as an assessment and…

External validation of a clinical scoring system for the risk of gestational diabetes mellitus

NARCIS (Netherlands)

van Leeuwen, M.; Opmeer, B. C.; Zweers, E. J. K.; van Ballegooie, E.; ter Brugge, H. G.; de Valk, H. W.; Visser, G. H. A.; Mol, B. W. J.

Aim: A prediction rule for gestational diabetes mellitus (GDM) could be helpful in early detection and increased efficiency of screening. A prediction rule by means of a clinical scoring system is available, but has never been validated externally. The aim of this study was to validate the scoring

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study.

Science.gov (United States)

Vreugdenhil, Jettie; Spek, Bea

2018-03-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a nurse" has been tested, mainly in academic simulation settings. The aim is to develop a Dutch version of the LCJR (D-LCJR) and to test its psychometric properties when used in a hospital traineeship context. A mixed-model approach was used to develop and to validate the instrument. Ten dedicated educational units in a university hospital. A well-mixed group of 52 nursing students, nurse coaches and nurse educators. A Delphi panel developed the D-LCJR. Students' clinical reasoning skills were assessed "live" by nurse coaches, nurse educators and students who rated themselves. The psychometric properties tested during the assessment process are reliability, reproducibility, content validity and construct validity by testing two hypothesis: 1) a positive correlation between assessed and self-reported sum scores (convergent validity) and 2) a linear relation between experience and sum score (clinical validity). The obtained D-LCJR was found to be internally consistent, Cronbach's alpha 0.93. The rubric is also reproducible with intraclass correlations between 0.69 and 0.78. Experts judged it to be content valid. The two hypothesis were both tested significant, supporting evidence for construct validity. The translated and modified LCJR, is a promising tool for the evaluation of nursing students' development in clinical reasoning in hospital traineeships, by students, nurse coaches and nurse educators. More evidence on construct validity is necessary, in particular for students at the end of their hospital traineeship. Based on our research, the D-LCJR applied in hospital traineeships is a usable and reliable tool. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development, Validation, and Implementation of a Clinic Nurse Staffing Guideline.

Science.gov (United States)

Deeken, Debra Jean; Wakefield, Douglas; Kite, Cora; Linebaugh, Jeanette; Mitchell, Blair; Parkinson, Deidre; Misra, Madhukar

2017-10-01

Ensuring that the level of nurse staffing used to care for patients is appropriate to the setting and service intensity is essential for high-quality and cost-effective care. This article describes the development, validation, and implementation of the clinic technical skills permission list developed specifically to guide nurse staffing decisions in physician clinics of an academic medical center. Results and lessons learned in using this staffing guideline are presented.

Adapting social neuroscience measures for schizophrenia clinical trials, part 3: fathoming external validity.

Science.gov (United States)

Olbert, Charles M; Penn, David L; Kern, Robert S; Lee, Junghee; Horan, William P; Reise, Steven P; Ochsner, Kevin N; Marder, Stephen R; Green, Michael F

2013-11-01

It is unknown whether measures adapted from social neuroscience linked to specific neural systems will demonstrate relationships to external variables. Four paradigms adapted from social neuroscience were administered to 173 clinically stable outpatients with schizophrenia to determine their relationships to functionally meaningful variables and to investigate their incremental validity beyond standard measures of social and nonsocial cognition. The 4 paradigms included 2 that assess perception of nonverbal social and action cues (basic biological motion and emotion in biological motion) and 2 that involve higher level inferences about self and others' mental states (self-referential memory and empathic accuracy). Overall, social neuroscience paradigms showed significant relationships to functional capacity but weak relationships to community functioning; the paradigms also showed weak correlations to clinical symptoms. Evidence for incremental validity beyond standard measures of social and nonsocial cognition was mixed with additional predictive power shown for functional capacity but not community functioning. Of the newly adapted paradigms, the empathic accuracy task had the broadest external validity. These results underscore the difficulty of translating developments from neuroscience into clinically useful tasks with functional significance.

Validity of a short clinical interview for psychiatric diagnosis : the mini-SCAN

NARCIS (Netherlands)

Nienhuis, F. J.; van de Willige, G.; Rijnders, C. A. Th.; de Jonge, P.; Wiersma, D.

Background To promote clinical application of the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) system a shorter version (the mini-SCAN) was devised. Its psychometric properties were unknown. Aims To establish the validity and practical properties of the mini-SCAN. Method One hundred

Construction and validation of clinical contents for development of learning objects.

Science.gov (United States)

Hortense, Flávia Tatiana Pedrolo; Bergerot, Cristiane Decat; Domenico, Edvane Birelo Lopes de

2018-01-01

to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Health status in routine clinical practice: validity of the clinical COPD questionnaire at the individual patient level

Directory of Open Access Journals (Sweden)

de Vos Barbara

2010-11-01

Full Text Available Abstract Background There is a growing interest to use health status or disease control questionnaires in routine clinical practice. However, the validity of most questionnaires is established using techniques developed for group level validation. This study examines a new method, using patient interviews, to validate a short health status questionnaire, the Clinical COPD Questionnaire (CCQ, at the individual patient level. Methods Patients with COPD who visited an outpatient clinic completed the CCQ before the consultation, and the specialist physician completed it after the consultation. After the consultation all patients had a semi-structured in-depth interview. The patients' CCQ scores were compared with those of the treating clinician, and with mean scores from 5 clinicians from a pool of 20 who scored the CCQ after reading the transcript of the in-depth interviews only. Agreement was assessed using Lin's concordance correlation coefficient (CCC, and Blant and Altman plots. Interviews with patients with low agreement were reviewed for possible explanations. Results A total of 44 COPD patients (32 male, mean age 66 years, FEV1 45% of predicted participated. Agreement between the patients' CCQ scores and those of the treating clinicians (CCC = 0.87 and the mean score of the reviewing clinicians (CCC = 0.86 was very high. No systematic error was detected. No explanation for individuals with low agreement was found. Conclusion The validity of the CCQ on the individual patient level, as assessed by these methods, is good. Individual health status assessment with the CCQ is therefore sufficiently accurate to be used in routine clinical practice.

Clinical reliability and validity of elbow functional assessment in rheumatoid arthritis.

NARCIS (Netherlands)

Boer, Y.A. de; Ende, C.H.M. van den; Eygendaal, D.; Jolie, I.M.M.; Hazes, J.M.W.; Rozing, P.M.

1999-01-01

OBJECTIVES: (1) To investigate the measurement characteristics of the Hospital for Special Surgery (HSS) and Mayo Clinic elbow assessment instruments, utilizing methodological criteria including feasibility, reliability, validity, and discriminative ability; and (2) to develop an efficient and

Evolution of Quality Assurance for Clinical Immunohistochemistry in the Era of Precision Medicine. Part 3: Technical Validation of Immunohistochemistry (IHC) Assays in Clinical IHC Laboratories.

Science.gov (United States)

Torlakovic, Emina E; Cheung, Carol C; D'Arrigo, Corrado; Dietel, Manfred; Francis, Glenn D; Gilks, C Blake; Hall, Jacqueline A; Hornick, Jason L; Ibrahim, Merdol; Marchetti, Antonio; Miller, Keith; van Krieken, J Han; Nielsen, Soren; Swanson, Paul E; Vyberg, Mogens; Zhou, Xiaoge; Taylor, Clive R

2017-03-01

Validation of immunohistochemistry (IHC) assays is a subject that is of great importance to clinical practice as well as basic research and clinical trials. When applied to clinical practice and focused on patient safety, validation of IHC assays creates objective evidence that IHC assays used for patient care are "fit-for-purpose." Validation of IHC assays needs to be properly informed by and modeled to assess the purpose of the IHC assay, which will further determine what sphere of validation is required, as well as the scope, type, and tier of technical validation. These concepts will be defined in this review, part 3 of the 4-part series "Evolution of Quality Assurance for Clinical Immunohistochemistry in the Era of Precision Medicine."

Reliability and validity in a nutshell.

Science.gov (United States)

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Development and validation of a survey to measure features of clinical networks.

Science.gov (United States)

Brown, Bernadette Bea; Haines, Mary; Middleton, Sandy; Paul, Christine; D'Este, Catherine; Klineberg, Emily; Elliott, Elizabeth

2016-09-30

Networks of clinical experts are increasingly being implemented as a strategy to improve health care processes and outcomes and achieve change in the health system. Few are ever formally evaluated and, when this is done, not all networks are equally successful in their efforts. There is a need to formatively assess the strategic and operational management and leadership of networks to identify where functioning could be improved to maximise impact. This paper outlines the development and psychometric evaluation of an Internet survey to measure features of clinical networks and provides descriptive results from a sample of members of 19 diverse clinical networks responsible for evidence-based quality improvement across a large geographical region. Instrument development was based on: a review of published and grey literature; a qualitative study of clinical network members; a program logic framework; and consultation with stakeholders. The resulting domain structure was validated for a sample of 592 clinical network members using confirmatory factor analysis. Scale reliability was assessed using Cronbach's alpha. A summary score was calculated for each domain and aggregate level means and ranges are reported. The instrument was shown to have good construct validity across seven domains as demonstrated by a high level of internal consistency, and all Cronbach's α coefficients were equal to or above 0.75. In the survey sample of network members there was strong reported commitment and belief in network-led quality improvement initiatives, which were perceived to have improved quality of care (72.8 %) and patient outcomes (63.2 %). Network managers were perceived to be effective leaders and clinical co-chairs were perceived as champions for change. Perceived external support had the lowest summary score across the seven domains. This survey, which has good construct validity and internal reliability, provides a valid instrument to use in future research related to

Construction and validation of clinical contents for development of learning objects

Directory of Open Access Journals (Sweden)

Flávia Tatiana Pedrolo Hortense

Full Text Available ABSTRACT Objective: to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. Method: descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. Results: The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. Conclusion: The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Validity of a short clinical interview for psychiatric diagnosis: the mini-SCAN.

Science.gov (United States)

Nienhuis, F J; van de Willige, G; Rijnders, C A Th; de Jonge, P; Wiersma, D

2010-01-01

To promote clinical application of the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) system a shorter version (the mini-SCAN) was devised. Its psychometric properties were unknown. To establish the validity and practical properties of the mini-SCAN. One hundred and six participants were interviewed twice, once with the SCAN and once with the mini-SCAN. The level of agreement was established for the categories: no disorder, affective disorders, anxiety disorders, non-affective psychotic disorders, affective psychotic disorders. The mini-SCAN is a valid instrument. Most kappa values were around 0.90. Only for the class of affective psychotic disorders was the agreement moderate. Mean duration of the mini-SCAN interviews was 25 min shorter than the SCAN interviews. Participants and interviewers were generally satisfied with the interview format and questions. The mini-SCAN can be used as a diagnostic instrument for clinical purposes and for clinical studies when the present episode is the focus of attention.

Validation of the Novaco Anger Scale-Provocation Inventory (Danish) With Nonclinical, Clinical, and Offender Samples

DEFF Research Database (Denmark)

Moeller, Stine Bjerrum; Novaco, Raymond; Heinola-Nielsen, Vivian

2015-01-01

Anger has high prevalence in clinical and forensic settings, and it is associated with aggressive behavior and ward atmosphere on psychiatric units. Dysregulated anger is a clinical problem in Danish mental health care systems, but no anger assessment instruments have been validated in Danish...... investigated with samples of 477 nonclinical, 250 clinical, 167 male prisoner, and 64 male forensic participants. Anger prevalence and its relationship with other anger measures, anxiety/depression, and aggression were examined. NAS-PI was found to have high reliability, concurrent validity, and discriminant...

The validity and clinical utility of structured diagnoses of antisocial personality disorder with forensic patients.

Science.gov (United States)

Marin-Avellan, Luisa E; McGauley, Gillian A; Campbell, Colin D; Fonagy, Peter

2014-08-01

Current DSM-based instruments for personality disorders (PDs) limit the investigation of the course and outcome of treatment of these disorders. This study examined the validity of the Shedler-Westen Assessment Procedure-200 (SWAP-200) and the Structured Clinical Interview for DSM-IV Axis II PD (SCID-II) in a sample of forensic PD patients. Results based on 66 participants indicated that the SWAP-200 Q-factors reduced the frequency of diagnostic comorbidity of PD categories by half compared with the SCID-II. Only the SWAP-200's Antisocial PD category showed good convergent and discriminant validity with respect to other instruments describing aspects of PD. The validity of the cutoff score for severe antisocial PD was confirmed, and this category predicted severe incidents in the hospital at 1 year of follow-up. A violence risk scale was constructed, which differentiated violent and nonviolent offenders. The results support the validity of the SWAP-200 and its potential clinical utility with forensic PD patients.

ClinicalCodes: an online clinical codes repository to improve the validity and reproducibility of research using electronic medical records.

Science.gov (United States)

Springate, David A; Kontopantelis, Evangelos; Ashcroft, Darren M; Olier, Ivan; Parisi, Rosa; Chamapiwa, Edmore; Reeves, David

2014-01-01

Lists of clinical codes are the foundation for research undertaken using electronic medical records (EMRs). If clinical code lists are not available, reviewers are unable to determine the validity of research, full study replication is impossible, researchers are unable to make effective comparisons between studies, and the construction of new code lists is subject to much duplication of effort. Despite this, the publication of clinical codes is rarely if ever a requirement for obtaining grants, validating protocols, or publishing research. In a representative sample of 450 EMR primary research articles indexed on PubMed, we found that only 19 (5.1%) were accompanied by a full set of published clinical codes and 32 (8.6%) stated that code lists were available on request. To help address these problems, we have built an online repository where researchers using EMRs can upload and download lists of clinical codes. The repository will enable clinical researchers to better validate EMR studies, build on previous code lists and compare disease definitions across studies. It will also assist health informaticians in replicating database studies, tracking changes in disease definitions or clinical coding practice through time and sharing clinical code information across platforms and data sources as research objects.

Quality Control Assays for Clinical-Grade Human Mesenchymal Stromal Cells: Validation Strategy.

Science.gov (United States)

Radrizzani, Marina; Soncin, Sabrina; Bolis, Sara; Lo Cicero, Viviana; Andriolo, Gabriella; Turchetto, Lucia

2016-01-01

The present chapter focuses on the validation of the following analytical methods for the control of mesenchymal stromal cells (MSC) for cell therapy clinical trials: Microbiological control for cellular product Endotoxin assay Mycoplasma assay Cell count and viability Immunophenotype Clonogenic potential (CFU-F assay) In our lab, these methods are in use for product release, process control or control of the biological starting materials. They are described in detail in the accompanying Chapter 19.For each method, validation goals and strategy are presented, and a detailed experimental scheme is proposed.

[Validation of a questionnaire to evaluate patient safety in clinical laboratories].

Science.gov (United States)

Giménez Marín, Ángeles; Rivas-Ruiz, Francisco

2012-01-01

The aim of this study was to prepare, pilot and validate a questionnaire to evaluate patient safety in the specific context of clinical laboratories. A specific questionnaire on patient safety in the laboratory, with 62 items grouped into six areas, was developed, taking into consideration the diverse human and laboratory contextual factors which may contribute to producing errors. A pilot study of 30 interviews was carried out, including validity and reliability analyses using principal components factor analysis and Cronbach's alpha. Subsequently, 240 questionnaires were sent to 21 hospitals, followed by a test-retest of 41 questionnaires with the definitive version. The sample analyzed was composed of 225 questionnaires (an overall response rate of 80%). Of the 62 items initially assessed, 17 were eliminated due to non-compliance with the criteria established before the principal components factor analysis was performed. For the 45 remaining items, 12 components were identified, with an cumulative variance of 69.5%. In seven of the 10 components with two or more items, Cronbach's alpha was higher than 0.7. The questionnaire items assessed in the test-retest were found to be stable. We present the first questionnaire with sufficiently proven validity and reliability for evaluating patient safety in the specific context of clinical laboratories. This questionnaire provides a useful instrument to perform a subsequent macrostudy of hospital clinical laboratories in Spain. The questionnaire can also be used to monitor and promote commitment to patient safety within the search for continuous quality improvement. Copyright © 2011 SESPAS. Published by Elsevier Espana. All rights reserved.

A Serious Game for Clinical Assessment of Cognitive Status: Validation Study.

Science.gov (United States)

Tong, Tiffany; Chignell, Mark; Tierney, Mary C; Lee, Jacques

2016-05-27

We propose the use of serious games to screen for abnormal cognitive status in situations where it may be too costly or impractical to use standard cognitive assessments (eg, emergency departments). If validated, serious games in health care could enable broader availability of efficient and engaging cognitive screening. The objective of this work is to demonstrate the feasibility of a game-based cognitive assessment delivered on tablet technology to a clinical sample and to conduct preliminary validation against standard mental status tools commonly used in elderly populations. We carried out a feasibility study in a hospital emergency department to evaluate the use of a serious game by elderly adults (N=146; age: mean 80.59, SD 6.00, range 70-94 years). We correlated game performance against a number of standard assessments, including the Mini-Mental State Examination (MMSE), Montreal Cognitive Assessment (MoCA), and the Confusion Assessment Method (CAM). After a series of modifications, the game could be used by a wide range of elderly patients in the emergency department demonstrating its feasibility for use with these users. Of 146 patients, 141 (96.6%) consented to participate and played our serious game. Refusals to play the game were typically due to concerns of family members rather than unwillingness of the patient to play the game. Performance on the serious game correlated significantly with the MoCA (r=-.339, P games in a clinical setting. Further research is required to demonstrate the validity and reliability of game-based assessments for clinical decision making.

A Serious Game for Clinical Assessment of Cognitive Status: Validation Study

Science.gov (United States)

Chignell, Mark; Tierney, Mary C.; Lee, Jacques

2016-01-01

Background We propose the use of serious games to screen for abnormal cognitive status in situations where it may be too costly or impractical to use standard cognitive assessments (eg, emergency departments). If validated, serious games in health care could enable broader availability of efficient and engaging cognitive screening. Objective The objective of this work is to demonstrate the feasibility of a game-based cognitive assessment delivered on tablet technology to a clinical sample and to conduct preliminary validation against standard mental status tools commonly used in elderly populations. Methods We carried out a feasibility study in a hospital emergency department to evaluate the use of a serious game by elderly adults (N=146; age: mean 80.59, SD 6.00, range 70-94 years). We correlated game performance against a number of standard assessments, including the Mini-Mental State Examination (MMSE), Montreal Cognitive Assessment (MoCA), and the Confusion Assessment Method (CAM). Results After a series of modifications, the game could be used by a wide range of elderly patients in the emergency department demonstrating its feasibility for use with these users. Of 146 patients, 141 (96.6%) consented to participate and played our serious game. Refusals to play the game were typically due to concerns of family members rather than unwillingness of the patient to play the game. Performance on the serious game correlated significantly with the MoCA (r=–.339, P games in a clinical setting. Further research is required to demonstrate the validity and reliability of game-based assessments for clinical decision making. PMID:27234145

Validation of dengue infection severity score

Directory of Open Access Journals (Sweden)

Pongpan S

2014-03-01

Full Text Available Surangrat Pongpan,1,2 Jayanton Patumanond,3 Apichart Wisitwong,4 Chamaiporn Tawichasri,5 Sirianong Namwongprom1,6 1Clinical Epidemiology Program, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand; 2Department of Occupational Medicine, Phrae Hospital, Phrae, Thailand; 3Clinical Epidemiology Program, Faculty of Medicine, Thammasat University, Bangkok, Thailand; 4Department of Social Medicine, Sawanpracharak Hospital, Nakorn Sawan, Thailand; 5Clinical Epidemiology Society at Chiang Mai, Chiang Mai, Thailand; 6Department of Radiology, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand Objective: To validate a simple scoring system to classify dengue viral infection severity to patients in different settings. Methods: The developed scoring system derived from 777 patients from three tertiary-care hospitals was applied to 400 patients in the validation data obtained from another three tertiary-care hospitals. Percentage of correct classification, underestimation, and overestimation was compared. The score discriminative performance in the two datasets was compared by analysis of areas under the receiver operating characteristic curves. Results: Patients in the validation data were different from those in the development data in some aspects. In the validation data, classifying patients into three severity levels (dengue fever, dengue hemorrhagic fever, and dengue shock syndrome yielded 50.8% correct prediction (versus 60.7% in the development data, with clinically acceptable underestimation (18.6% versus 25.7% and overestimation (30.8% versus 13.5%. Despite the difference in predictive performances between the validation and the development data, the overall prediction of the scoring system is considered high. Conclusion: The developed severity score may be applied to classify patients with dengue viral infection into three severity levels with clinically acceptable under- or overestimation. Its impact when used in routine

Validity and Reliability of Clinical Dementia Rating Scale among the Elderly in Iran

Directory of Open Access Journals (Sweden)

Nahid Sadeghi

2012-10-01

Full Text Available Background: The most common cause of dementia among the elderly is Alzheimer’s disease. Given the increasing population of the elderly, achieving a screening tool with high reliability and validity is an essential need for all communities. The main objective of the project was to determine the Persian version of Clinical Dementia Rating Scale (P-CDR1. Materials and Methods: Twenty subjects were randomly selected from among 150, 50-70 year old people, who were illiterate and not mentally retarded, residing in the nursing home; and they were given the Persian version of CDR scale (test. After three months, the group was given the test again. Results: The findings showed that from the specialists’ standpoint CDR scale had acceptable validity, and the test validity was achieved 0.05 at the significant level with Cronbach’s alpha and reliability coefficients 73% and 89%, respectively. Conclusion: CDR scale is a reliable instrument for evaluation of clinical dementia rating among the elderly in Iran. It can be used in screening dementia, Alzheimer, and diagnosis of the severity and stages of Alzheimer.

How valid are commercially available medical simulators?

Science.gov (United States)

Stunt, JJ; Wulms, PH; Kerkhoffs, GM; Dankelman, J; van Dijk, CN; Tuijthof, GJM

2014-01-01

Background Since simulators offer important advantages, they are increasingly used in medical education and medical skills training that require physical actions. A wide variety of simulators have become commercially available. It is of high importance that evidence is provided that training on these simulators can actually improve clinical performance on live patients. Therefore, the aim of this review is to determine the availability of different types of simulators and the evidence of their validation, to offer insight regarding which simulators are suitable to use in the clinical setting as a training modality. Summary Four hundred and thirty-three commercially available simulators were found, from which 405 (94%) were physical models. One hundred and thirty validation studies evaluated 35 (8%) commercially available medical simulators for levels of validity ranging from face to predictive validity. Solely simulators that are used for surgical skills training were validated for the highest validity level (predictive validity). Twenty-four (37%) simulators that give objective feedback had been validated. Studies that tested more powerful levels of validity (concurrent and predictive validity) were methodologically stronger than studies that tested more elementary levels of validity (face, content, and construct validity). Conclusion Ninety-three point five percent of the commercially available simulators are not known to be tested for validity. Although the importance of (a high level of) validation depends on the difficulty level of skills training and possible consequences when skills are insufficient, it is advisable for medical professionals, trainees, medical educators, and companies who manufacture medical simulators to critically judge the available medical simulators for proper validation. This way adequate, safe, and affordable medical psychomotor skills training can be achieved. PMID:25342926

Assessing Discriminative Performance at External Validation of Clinical Prediction Models.

Directory of Open Access Journals (Sweden)

Daan Nieboer

Full Text Available External validation studies are essential to study the generalizability of prediction models. Recently a permutation test, focusing on discrimination as quantified by the c-statistic, was proposed to judge whether a prediction model is transportable to a new setting. We aimed to evaluate this test and compare it to previously proposed procedures to judge any changes in c-statistic from development to external validation setting.We compared the use of the permutation test to the use of benchmark values of the c-statistic following from a previously proposed framework to judge transportability of a prediction model. In a simulation study we developed a prediction model with logistic regression on a development set and validated them in the validation set. We concentrated on two scenarios: 1 the case-mix was more heterogeneous and predictor effects were weaker in the validation set compared to the development set, and 2 the case-mix was less heterogeneous in the validation set and predictor effects were identical in the validation and development set. Furthermore we illustrated the methods in a case study using 15 datasets of patients suffering from traumatic brain injury.The permutation test indicated that the validation and development set were homogenous in scenario 1 (in almost all simulated samples and heterogeneous in scenario 2 (in 17%-39% of simulated samples. Previously proposed benchmark values of the c-statistic and the standard deviation of the linear predictors correctly pointed at the more heterogeneous case-mix in scenario 1 and the less heterogeneous case-mix in scenario 2.The recently proposed permutation test may provide misleading results when externally validating prediction models in the presence of case-mix differences between the development and validation population. To correctly interpret the c-statistic found at external validation it is crucial to disentangle case-mix differences from incorrect regression coefficients.

A Multi-Center Prospective Derivation and Validation of a Clinical Prediction Tool for Severe Clostridium difficile Infection.

LENUS (Irish Health Repository)

Na, Xi

2015-04-23

Prediction of severe clinical outcomes in Clostridium difficile infection (CDI) is important to inform management decisions for optimum patient care. Currently, treatment recommendations for CDI vary based on disease severity but validated methods to predict severe disease are lacking. The aim of the study was to derive and validate a clinical prediction tool for severe outcomes in CDI.

New clinical validation method for automated sphygmomanometer: a proposal by Japan ISO-WG for sphygmomanometer standard.

Science.gov (United States)

Shirasaki, Osamu; Asou, Yosuke; Takahashi, Yukio

2007-12-01

Owing to fast or stepwise cuff deflation, or measuring at places other than the upper arm, the clinical accuracy of most recent automated sphygmomanometers (auto-BPMs) cannot be validated by one-arm simultaneous comparison, which would be the only accurate validation method based on auscultation. Two main alternative methods are provided by current standards, that is, two-arm simultaneous comparison (method 1) and one-arm sequential comparison (method 2); however, the accuracy of these validation methods might not be sufficient to compensate for the suspicious accuracy in lateral blood pressure (BP) differences (LD) and/or BP variations (BPV) between the device and reference readings. Thus, the Japan ISO-WG for sphygmomanometer standards has been studying a new method that might improve validation accuracy (method 3). The purpose of this study is to determine the appropriateness of method 3 by comparing immunity to LD and BPV with those of the current validation methods (methods 1 and 2). The validation accuracy of the above three methods was assessed in human participants [N=120, 45+/-15.3 years (mean+/-SD)]. An oscillometric automated monitor, Omron HEM-762, was used as the tested device. When compared with the others, methods 1 and 3 showed a smaller intra-individual standard deviation of device error (SD1), suggesting their higher reproducibility of validation. The SD1 by method 2 (P=0.004) significantly correlated with the participant's BP, supporting our hypothesis that the increased SD of device error by method 2 is at least partially caused by essential BPV. Method 3 showed a significantly (P=0.0044) smaller interparticipant SD of device error (SD2), suggesting its higher interparticipant consistency of validation. Among the methods of validation of the clinical accuracy of auto-BPMs, method 3, which showed the highest reproducibility and highest interparticipant consistency, can be proposed as being the most appropriate.

Construct Validity: Advances in Theory and Methodology

OpenAIRE

Strauss, Milton E.; Smith, Gregory T.

2009-01-01

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this chapter, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review f...

Construct Validity of Medical Clinical Competence Measures: A Multitrait-Multimethod Matrix Study Using Confirmatory Factor Analysis.

Science.gov (United States)

Forsythe, George B.; And Others

1986-01-01

Construct validity was investigated for three tests of clinical competence in medicine: National Board of Medical Examiners examination (NBME), California Psychological Inventory (CPI), and Resident Evaluation Form (REF). Scores from 166 residents were analyzed. Results suggested low construct validity for CPI and REF scales, and moderate…

Design for validation: An approach to systems validation

Science.gov (United States)

Carter, William C.; Dunham, Janet R.; Laprie, Jean-Claude; Williams, Thomas; Howden, William; Smith, Brian; Lewis, Carl M. (Editor)

1989-01-01

Every complex system built is validated in some manner. Computer validation begins with review of the system design. As systems became too complicated for one person to review, validation began to rely on the application of adhoc methods by many individuals. As the cost of the changes mounted and the expense of failure increased, more organized procedures became essential. Attempts at devising and carrying out those procedures showed that validation is indeed a difficult technical problem. The successful transformation of the validation process into a systematic series of formally sound, integrated steps is necessary if the liability inherent in the future digita-system-based avionic and space systems is to be minimized. A suggested framework and timetable for the transformtion are presented. Basic working definitions of two pivotal ideas (validation and system life-cyle) are provided and show how the two concepts interact. Many examples are given of past and present validation activities by NASA and others. A conceptual framework is presented for the validation process. Finally, important areas are listed for ongoing development of the validation process at NASA Langley Research Center.

The Clinical Validation of the Athlete Sleep Screening Questionnaire: an Instrument to Identify Athletes that Need Further Sleep Assessment.

Science.gov (United States)

Bender, Amy M; Lawson, Doug; Werthner, Penny; Samuels, Charles H

2018-06-04

Previous research has established that general sleep screening questionnaires are not valid and reliable in an athlete population. The Athlete Sleep Screening Questionnaire (ASSQ) was developed to address this need. While the initial validation of the ASSQ has been established, the clinical validity of the ASSQ has yet to be determined. The main objective of the current study was to evaluate the clinical validity of the ASSQ. Canadian National Team athletes (N = 199; mean age 24.0 ± 4.2 years, 62% females; from 23 sports) completed the ASSQ. A subset of athletes (N = 46) were randomized to the clinical validation sub-study which required subjects to complete an ASSQ at times 2 and 3 and to have a clinical sleep interview by a sleep medicine physician (SMP) who rated each subjects' category of clinical sleep problem and provided recommendations to improve sleep. To assess clinical validity, the SMP category of clinical sleep problem was compared to the ASSQ. The internal consistency (Cronbach's alpha = 0.74) and test-retest reliability (r = 0.86) of the ASSQ were acceptable. The ASSQ demonstrated good agreement with the SMP (Cohen's kappa = 0.84) which yielded a diagnostic sensitivity of 81%, specificity of 93%, positive predictive value of 87%, and negative predictive value of 90%. There were 25.1% of athletes identified to have clinically relevant sleep disturbances that required further clinical sleep assessment. Sleep improved from time 1 at baseline to after the recommendations at time 3. Sleep screening athletes with the ASSQ provides a method of accurately determining which athletes would benefit from preventative measures and which athletes suffer from clinically significant sleep problems. The process of sleep screening athletes and providing recommendations improves sleep and offers a clinical intervention output that is simple and efficient for teams and athletes to implement.

How valid are commercially available medical simulators?

Directory of Open Access Journals (Sweden)

Stunt JJ

2014-10-01

Full Text Available JJ Stunt,1 PH Wulms,2 GM Kerkhoffs,1 J Dankelman,2 CN van Dijk,1 GJM Tuijthof1,2 1Orthopedic Research Center Amsterdam, Department of Orthopedic Surgery, Academic Medical Centre, Amsterdam, the Netherlands; 2Department of Biomechanical Engineering, Faculty of Mechanical, Materials and Maritime Engineering, Delft University of Technology, Delft, the Netherlands Background: Since simulators offer important advantages, they are increasingly used in medical education and medical skills training that require physical actions. A wide variety of simulators have become commercially available. It is of high importance that evidence is provided that training on these simulators can actually improve clinical performance on live patients. Therefore, the aim of this review is to determine the availability of different types of simulators and the evidence of their validation, to offer insight regarding which simulators are suitable to use in the clinical setting as a training modality. Summary: Four hundred and thirty-three commercially available simulators were found, from which 405 (94% were physical models. One hundred and thirty validation studies evaluated 35 (8% commercially available medical simulators for levels of validity ranging from face to predictive validity. Solely simulators that are used for surgical skills training were validated for the highest validity level (predictive validity. Twenty-four (37% simulators that give objective feedback had been validated. Studies that tested more powerful levels of validity (concurrent and predictive validity were methodologically stronger than studies that tested more elementary levels of validity (face, content, and construct validity. Conclusion: Ninety-three point five percent of the commercially available simulators are not known to be tested for validity. Although the importance of (a high level of validation depends on the difficulty level of skills training and possible consequences when skills are

Validation of the clinical dehydration scale for children with acute gastroenteritis.

Science.gov (United States)

Goldman, Ran D; Friedman, Jeremy N; Parkin, Patricia C

2008-09-01

We previously created a clinical dehydration scale. Our objective was to validate the clinical dehydration scale with a new cohort of patients with acute gastroenteritis who were assessed in a tertiary emergency department in a developed country. A prospective observational study was performed in an emergency department at a large pediatric tertiary center in Canada. Children 1 month to 5 years of age with symptoms of acute gastroenteritis who were assessed in the emergency department were enrolled consecutively during a 4-month period. The main outcome measures were length of stay, proportion of children receiving intravenous fluid rehydration, and proportions of children with abnormal serum pH values or bicarbonate levels. A total of 205 children were enrolled, with a mean age of 22.4 +/- 14.9 months; 103 (50%) were male. The distribution of severity categories was as follows: no dehydration (score of 0), n = 117 (57%); some dehydration (score of 1-4), n = 83 (41%); moderate/severe dehydration (score of 5-8), n = 5 (2%). The 3 dehydration categories were significantly different with respect to the validation hypotheses (length of stay, mean +/- SD: none, 245 +/- 181 minutes; some, 397 +/- 302 minutes; moderate/severe, 501 +/- 389 minutes; treatment with intravenous fluids: none, n =17, 15%; some, n = 41, 49%; moderate/severe, n = 4, 80%; number of vomiting episodes in the 7 days before the emergency department visit: none, 8.4 +/- 7.7 episodes; some, 13 +/- 10.7 episodes; moderate/severe, 30.2 +/- 14.8 episodes). The clinical dehydration scale and the 3 severity categories were valid for a prospectively enrolled cohort of patients who were assessed in our tertiary emergency department. The scoring system was valuable in predicting a longer length of stay and the need for intravenous fluid rehydration for children with symptoms of acute gastroenteritis.

Screening for postdeployment conditions: development and cross-validation of an embedded validity scale in the neurobehavioral symptom inventory.

Science.gov (United States)

Vanderploeg, Rodney D; Cooper, Douglas B; Belanger, Heather G; Donnell, Alison J; Kennedy, Jan E; Hopewell, Clifford A; Scott, Steven G

2014-01-01

To develop and cross-validate internal validity scales for the Neurobehavioral Symptom Inventory (NSI). Four existing data sets were used: (1) outpatient clinical traumatic brain injury (TBI)/neurorehabilitation database from a military site (n = 403), (2) National Department of Veterans Affairs TBI evaluation database (n = 48 175), (3) Florida National Guard nonclinical TBI survey database (n = 3098), and (4) a cross-validation outpatient clinical TBI/neurorehabilitation database combined across 2 military medical centers (n = 206). Secondary analysis of existing cohort data to develop (study 1) and cross-validate (study 2) internal validity scales for the NSI. The NSI, Mild Brain Injury Atypical Symptoms, and Personality Assessment Inventory scores. Study 1: Three NSI validity scales were developed, composed of 5 unusual items (Negative Impression Management [NIM5]), 6 low-frequency items (LOW6), and the combination of 10 nonoverlapping items (Validity-10). Cut scores maximizing sensitivity and specificity on these measures were determined, using a Mild Brain Injury Atypical Symptoms score of 8 or more as the criterion for invalidity. Study 2: The same validity scale cut scores again resulted in the highest classification accuracy and optimal balance between sensitivity and specificity in the cross-validation sample, using a Personality Assessment Inventory Negative Impression Management scale with a T score of 75 or higher as the criterion for invalidity. The NSI is widely used in the Department of Defense and Veterans Affairs as a symptom-severity assessment following TBI, but is subject to symptom overreporting or exaggeration. This study developed embedded NSI validity scales to facilitate the detection of invalid response styles. The NSI Validity-10 scale appears to hold considerable promise for validity assessment when the NSI is used as a population-screening tool.

World Workshop on Oral Medicine VI: an international validation study of clinical competencies for advanced training in oral medicine.

Science.gov (United States)

Steele, John C; Clark, Hadleigh J; Hong, Catherine H L; Jurge, Sabine; Muthukrishnan, Arvind; Kerr, A Ross; Wray, David; Prescott-Clements, Linda; Felix, David H; Sollecito, Thomas P

2015-08-01

To explore international consensus for the validation of clinical competencies for advanced training in Oral Medicine. An electronic survey of clinical competencies was designed. The survey was sent to and completed by identified international stakeholders during a 10-week period. To be validated, an individual competency had to achieve 90% or greater consensus to keep it in its current format. Stakeholders from 31 countries responded. High consensus agreement was achieved with 93 of 101 (92%) competencies exceeding the benchmark for agreement. Only 8 warranted further attention and were reviewed by a focus group. No additional competencies were suggested. This is the first international validated study of clinical competencies for advanced training in Oral Medicine. These validated clinical competencies could provide a model for countries developing an advanced training curriculum for Oral Medicine and also inform review of existing curricula. Copyright © 2015 Elsevier Inc. All rights reserved.

Clinical Validation of the "Sedentary Lifestyle" Nursing Diagnosis in Secondary School Students

Science.gov (United States)

de Oliveira, Marcos Renato; da Silva, Viviane Martins; Guedes, Nirla Gomes; de Oliveira Lopes, Marcos Venícios

2016-01-01

This study clinically validated the nursing diagnosis of "sedentary lifestyle" (SL) among 564 Brazilian adolescents. Measures of diagnostic accuracy were calculated for defining characteristics, and Mantel--Haenszel analysis was used to identify related factors. The measures of diagnostic accuracy showed that the following defining…

Adaptation and validation of the instrument Clinical Learning Environment and Supervision for medical students in primary health care

Directory of Open Access Journals (Sweden)

Eva Öhman

2016-12-01

Full Text Available Abstract Background Clinical learning takes place in complex socio-cultural environments that are workplaces for the staff and learning places for the students. In the clinical context, the students learn by active participation and in interaction with the rest of the community at the workplace. Clinical learning occurs outside the university, therefore is it important for both the university and the student that the student is given opportunities to evaluate the clinical placements with an instrument that allows evaluation from many perspectives. The instrument Clinical Learning Environment and Supervision (CLES was originally developed for evaluation of nursing students’ clinical learning environment. The aim of this study was to adapt and validate the CLES instrument to measure medical students’ perceptions of their learning environment in primary health care. Methods In the adaptation process the face validity was tested by an expert panel of primary care physicians, who were also active clinical supervisors. The adapted CLES instrument with 25 items and six background questions was sent electronically to 1,256 medical students from one university. Answers from 394 students were eligible for inclusion. Exploratory factor analysis based on principal component methods followed by oblique rotation was used to confirm the adequate number of factors in the data. Construct validity was assessed by factor analysis. Confirmatory factor analysis was used to confirm the dimensions of CLES instrument. Results The construct validity showed a clearly indicated four-factor model. The cumulative variance explanation was 0.65, and the overall Cronbach’s alpha was 0.95. All items loaded similarly with the dimensions in the non-adapted CLES except for one item that loaded to another dimension. The CLES instrument in its adapted form had high construct validity and high reliability and internal consistency. Conclusion CLES, in its adapted form, appears

A Structured Clinical Interview for Kleptomania (SCI-K): preliminary validity and reliability testing.

Science.gov (United States)

Grant, Jon E; Kim, Suck Won; McCabe, James S

2006-06-01

Kleptomania presents difficulties in diagnosis for clinicians. This study aimed to develop and test a DSM-IV-based diagnostic instrument for kleptomania. To assess for current kleptomania the Structured Clinical Interview for Kleptomania (SCI-K) was administered to 112 consecutive subjects requesting psychiatric outpatient treatment for a variety of disorders. Reliability and validity were determined. Classification accuracy was examined using the longitudinal course of illness. The SCI-K demonstrated excellent test-retest (Phi coefficient = 0.956 (95% CI = 0.937, 0.970)) and inter-rater reliability (phi coefficient = 0.718 (95% CI = 0.506, 0.848)) in the diagnosis of kleptomania. Concurrent validity was observed with a self-report measure using DSM-IV kleptomania criteria (phi coefficient = 0.769 (95% CI = 0.653, 0.850)). Discriminant validity was observed with a measure of depression (point biserial coefficient = -0.020 (95% CI = -0.205, 0.166)). The SCI-K demonstrated both high sensitivity and specificity based on longitudinal assessment. The SCI-K demonstrated excellent reliability and validity in diagnosing kleptomania in subjects presenting with various psychiatric problems. These findings require replication in larger groups, including non-psychiatric populations, to examine their generalizability. Copyright (c) 2006 John Wiley & Sons, Ltd.

Validation by simulation of a clinical trial model using the standardized mean and variance criteria.

Science.gov (United States)

Abbas, Ismail; Rovira, Joan; Casanovas, Josep

2006-12-01

To develop and validate a model of a clinical trial that evaluates the changes in cholesterol level as a surrogate marker for lipodystrophy in HIV subjects under alternative antiretroviral regimes, i.e., treatment with Protease Inhibitors vs. a combination of nevirapine and other antiretroviral drugs. Five simulation models were developed based on different assumptions, on treatment variability and pattern of cholesterol reduction over time. The last recorded cholesterol level, the difference from the baseline, the average difference from the baseline and level evolution, are the considered endpoints. Specific validation criteria based on a 10% minus or plus standardized distance in means and variances were used to compare the real and the simulated data. The validity criterion was met by all models for considered endpoints. However, only two models met the validity criterion when all endpoints were considered. The model based on the assumption that within-subjects variability of cholesterol levels changes over time is the one that minimizes the validity criterion, standardized distance equal to or less than 1% minus or plus. Simulation is a useful technique for calibration, estimation, and evaluation of models, which allows us to relax the often overly restrictive assumptions regarding parameters required by analytical approaches. The validity criterion can also be used to select the preferred model for design optimization, until additional data are obtained allowing an external validation of the model.

Validation of New Cancer Biomarkers

DEFF Research Database (Denmark)

Duffy, Michael J; Sturgeon, Catherine M; Söletormos, Georg

2015-01-01

BACKGROUND: Biomarkers are playing increasingly important roles in the detection and management of patients with cancer. Despite an enormous number of publications on cancer biomarkers, few of these biomarkers are in widespread clinical use. CONTENT: In this review, we discuss the key steps...... in advancing a newly discovered cancer candidate biomarker from pilot studies to clinical application. Four main steps are necessary for a biomarker to reach the clinic: analytical validation of the biomarker assay, clinical validation of the biomarker test, demonstration of clinical value from performance...... of the biomarker test, and regulatory approval. In addition to these 4 steps, all biomarker studies should be reported in a detailed and transparent manner, using previously published checklists and guidelines. Finally, all biomarker studies relating to demonstration of clinical value should be registered before...

Validity, reliability, and feasibility of clinical staging scales in dementia: a systematic review

DEFF Research Database (Denmark)

Rikkert, Marcel G M Olde; Tona, Klodiana Daphne; Janssen, Lieneke

2011-01-01

New staging systems of dementia require adaptation of disease management programs and adequate staging instruments. Therefore, we systematically reviewed the literature on validity and reliability of clinically applicable, multidomain, and dementia staging instruments. A total of 23 articles...

Behavioral Indicators on a Mobile Sensing Platform Predict Clinically Validated Psychiatric Symptoms of Mood and Anxiety Disorders.

Science.gov (United States)

Place, Skyler; Blanch-Hartigan, Danielle; Rubin, Channah; Gorrostieta, Cristina; Mead, Caroline; Kane, John; Marx, Brian P; Feast, Joshua; Deckersbach, Thilo; Pentland, Alex Sandy; Nierenberg, Andrew; Azarbayejani, Ali

2017-03-16

There is a critical need for real-time tracking of behavioral indicators of mental disorders. Mobile sensing platforms that objectively and noninvasively collect, store, and analyze behavioral indicators have not yet been clinically validated or scalable. The aim of our study was to report on models of clinical symptoms for post-traumatic stress disorder (PTSD) and depression derived from a scalable mobile sensing platform. A total of 73 participants (67% [49/73] male, 48% [35/73] non-Hispanic white, 33% [24/73] veteran status) who reported at least one symptom of PTSD or depression completed a 12-week field trial. Behavioral indicators were collected through the noninvasive mobile sensing platform on participants' mobile phones. Clinical symptoms were measured through validated clinical interviews with a licensed clinical social worker. A combination hypothesis and data-driven approach was used to derive key features for modeling symptoms, including the sum of outgoing calls, count of unique numbers texted, absolute distance traveled, dynamic variation of the voice, speaking rate, and voice quality. Participants also reported ease of use and data sharing concerns. Behavioral indicators predicted clinically assessed symptoms of depression and PTSD (cross-validated area under the curve [AUC] for depressed mood=.74, fatigue=.56, interest in activities=.75, and social connectedness=.83). Participants reported comfort sharing individual data with physicians (Mean 3.08, SD 1.22), mental health providers (Mean 3.25, SD 1.39), and medical researchers (Mean 3.03, SD 1.36). Behavioral indicators passively collected through a mobile sensing platform predicted symptoms of depression and PTSD. The use of mobile sensing platforms can provide clinically validated behavioral indicators in real time; however, further validation of these models and this platform in large clinical samples is needed. ©Skyler Place, Danielle Blanch-Hartigan, Channah Rubin, Cristina Gorrostieta

Validation of a clinical critical thinking skills test in nursing

OpenAIRE

Shin, Sujin; Jung, Dukyoo; Kim, Sungeun

2015-01-01

Purpose: The purpose of this study was to develop a revised version of the clinical critical thinking skills test (CCTS) and to subsequently validate its performance. Methods: This study is a secondary analysis of the CCTS. Data were obtained from a convenience sample of 284 college students in June 2011. Thirty items were analyzed using item response theory and test reliability was assessed. Test-retest reliability was measured using the results of 20 nursing college and graduate school stud...

Validity of Quinpirole Sensitization Rat Model of OCD: Linking Evidence from Animal and Clinical Studies.

Science.gov (United States)

Stuchlik, Ales; Radostová, Dominika; Hatalova, Hana; Vales, Karel; Nekovarova, Tereza; Koprivova, Jana; Svoboda, Jan; Horacek, Jiri

2016-01-01

Obsessive-compulsive disorder (OCD) is a neuropsychiatric disorder with 1-3% prevalence. OCD is characterized by recurrent thoughts (obsessions) and repetitive behaviors (compulsions). The pathophysiology of OCD remains unclear, stressing the importance of pre-clinical studies. The aim of this article is to critically review a proposed animal model of OCD that is characterized by the induction of compulsive checking and behavioral sensitization to the D2/D3 dopamine agonist quinpirole. Changes in this model have been reported at the level of brain structures, neurotransmitter systems and other neurophysiological aspects. In this review, we consider these alterations in relation to the clinical manifestations in OCD, with the aim to discuss and evaluate axes of validity of this model. Our analysis shows that some axes of validity of quinpirole sensitization model (QSM) are strongly supported by clinical findings, such as behavioral phenomenology or roles of brain structures. Evidence on predictive validity is contradictory and ambiguous. It is concluded that this model is useful in the context of searching for the underlying pathophysiological basis of the disorder because of the relatively strong biological similarities with OCD.

Validation of a new strength measurement device for amyotrophic lateral sclerosis clinical trials.

Science.gov (United States)

Andres, Patricia L; Skerry, Linda M; Munsat, Theodore L; Thornell, Brenda J; Szymonifka, Jackie; Schoenfeld, David A; Cudkowicz, Merit E

2012-01-01

Strength measures with reduced variability and higher sensitivity could improve efficiency in clinical trials of amyotrophic lateral sclerosis (ALS). The Accurate Test of Limb Isometric Strength (ATLIS) was developed to precisely and conveniently measure force in 12 muscle groups. In this study we evaluate the reliability and validity of the ATLIS testing protocol. Twenty healthy adults and 10 patients with ALS were tested twice by the same or by different evaluators to determine test-retest and interrater reliability. Twenty healthy adults were examined using ATLIS and a well-validated strength testing protocol (TQNE) to assess criterion-based validity. Mean absolute variation between tests was 8.6%, and intraclass correlation coefficients for each muscle group were high (range 0.82-0.99). The Pearson correlation coefficient of mean ATLIS and TQNE scores was 0.90. A subject survey demonstrated high user acceptance of ATLIS. ATLIS is convenient for patients and evaluators, produces precise strength measurements, and is easily moved between examining rooms. Copyright © 2011 Wiley Periodicals, Inc.

The predictive validity of the BioMedical Admissions Test for pre-clinical examination performance.

Science.gov (United States)

Emery, Joanne L; Bell, John F

2009-06-01

Some medical courses in the UK have many more applicants than places and almost all applicants have the highest possible previous and predicted examination grades. The BioMedical Admissions Test (BMAT) was designed to assist in the student selection process specifically for a number of 'traditional' medical courses with clear pre-clinical and clinical phases and a strong focus on science teaching in the early years. It is intended to supplement the information provided by examination results, interviews and personal statements. This paper reports on the predictive validity of the BMAT and its predecessor, the Medical and Veterinary Admissions Test. Results from the earliest 4 years of the test (2000-2003) were matched to the pre-clinical examination results of those accepted onto the medical course at the University of Cambridge. Correlation and logistic regression analyses were performed for each cohort. Section 2 of the test ('Scientific Knowledge') correlated more strongly with examination marks than did Section 1 ('Aptitude and Skills'). It also had a stronger relationship with the probability of achieving the highest examination class. The BMAT and its predecessor demonstrate predictive validity for the pre-clinical years of the medical course at the University of Cambridge. The test identifies important differences in skills and knowledge between candidates, not shown by their previous attainment, which predict their examination performance. It is thus a valid source of additional admissions information for medical courses with a strong scientific emphasis when previous attainment is very high.

Explicating Validity

Science.gov (United States)

Kane, Michael T.

2016-01-01

How we choose to use a term depends on what we want to do with it. If "validity" is to be used to support a score interpretation, validation would require an analysis of the plausibility of that interpretation. If validity is to be used to support score uses, validation would require an analysis of the appropriateness of the proposed…

Assessment of validity with polytrauma Veteran populations.

Science.gov (United States)

Bush, Shane S; Bass, Carmela

2015-01-01

Veterans with polytrauma have suffered injuries to multiple body parts and organs systems, including the brain. The injuries can generate a triad of physical, neurologic/cognitive, and emotional symptoms. Accurate diagnosis is essential for the treatment of these conditions and for fair allocation of benefits. To accurately diagnose polytrauma disorders and their related problems, clinicians take into account the validity of reported history and symptoms, as well as clinical presentations. The purpose of this article is to describe the assessment of validity with polytrauma Veteran populations. Review of scholarly and other relevant literature and clinical experience are utilized. A multimethod approach to validity assessment that includes objective, standardized measures increases the confidence that can be placed in the accuracy of self-reported symptoms and physical, cognitive, and emotional test results. Due to the multivariate nature of polytrauma and the multiple disciplines that play a role in diagnosis and treatment, an ideal model of validity assessment with polytrauma Veteran populations utilizes neurocognitive, neurological, neuropsychiatric, and behavioral measures of validity. An overview of these validity assessment approaches as applied to polytrauma Veteran populations is presented. Veterans, the VA, and society are best served when accurate diagnoses are made.

The Reliability, Validity, and Evaluation of the Objective Structured Clinical Examination in Podiatry (Chiropody).

Science.gov (United States)

Woodburn, Jim; Sutcliffe, Nick

1996-01-01

The Objective Structured Clinical Examination (OSCE), initially developed for undergraduate medical education, has been adapted for assessment of clinical skills in podiatry students. A 12-month pilot study found the test had relatively low levels of reliability, high construct and criterion validity, and good stability of performance over time.…

The validity of a professional competence tool for physiotherapy students in simulation-based clinical education: a Rasch analysis.

Science.gov (United States)

Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J

2016-08-05

Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.

Validation of the Mayo Clinic Staging System in Determining Prognoses of Patients With Perihilar Cholangiocarcinoma

NARCIS (Netherlands)

Coelen, Robert J. S.; Gaspersz, Marcia P.; Labeur, Tim A.; van Vugt, Jeroen L. A.; van Dieren, Susan; Willemssen, François E. J. A.; Nio, Chung Y.; Ijzermans, Jan N. M.; Klümpen, Heinz-Josef; Groot Koerkamp, Bas; van Gulik, Thomas M.

2017-01-01

BACKGROUND & AIMS: Most systems for staging perihilar cholangiocarcinoma (PHC) have been developed for the minority of patients with resectable disease. The recently developed Mayo Clinic system for staging PHC requires only clinical and radiologic variables, but has not yet been validated. We

Validating the extract, transform, load process used to populate a large clinical research database.

Science.gov (United States)

Denney, Michael J; Long, Dustin M; Armistead, Matthew G; Anderson, Jamie L; Conway, Baqiyyah N

2016-10-01

Informaticians at any institution that are developing clinical research support infrastructure are tasked with populating research databases with data extracted and transformed from their institution's operational databases, such as electronic health records (EHRs). These data must be properly extracted from these source systems, transformed into a standard data structure, and then loaded into the data warehouse while maintaining the integrity of these data. We validated the correctness of the extract, load, and transform (ETL) process of the extracted data of West Virginia Clinical and Translational Science Institute's Integrated Data Repository, a clinical data warehouse that includes data extracted from two EHR systems. Four hundred ninety-eight observations were randomly selected from the integrated data repository and compared with the two source EHR systems. Of the 498 observations, there were 479 concordant and 19 discordant observations. The discordant observations fell into three general categories: a) design decision differences between the IDR and source EHRs, b) timing differences, and c) user interface settings. After resolving apparent discordances, our integrated data repository was found to be 100% accurate relative to its source EHR systems. Any institution that uses a clinical data warehouse that is developed based on extraction processes from operational databases, such as EHRs, employs some form of an ETL process. As secondary use of EHR data begins to transform the research landscape, the importance of the basic validation of the extracted EHR data cannot be underestimated and should start with the validation of the extraction process itself. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Concurrent Validation of the Clinical Opiate Withdrawal Scale (COWS) and Single-Item Indices against the Clinical Institute Narcotic Assessment (CINA) Opioid Withdrawal Instrument

Science.gov (United States)

Tompkins, D. Andrew; Bigelow, George E.; Harrison, Joseph A.; Johnson, Rolley E.; Fudala, Paul J.; Strain, Eric C.

2009-01-01

Introduction The Clinical Opiate Withdrawal Scale (COWS) is an 11-item clinician-administered scale assessing opioid withdrawal. Though commonly used in clinical practice, it has not been systematically validated. The present study validated the COWS in comparison to the validated Clinical Institute Narcotic Assessment (CINA) scale. Method Opioid-dependent volunteers were enrolled in a residential trial and stabilized on morphine 30 mg given subcutaneously four times daily. Subjects then underwent double-blind, randomized challenges of intramuscularly administered placebo and naloxone (0.4 mg) on separate days, during which the COWS, CINA, and visual analog scale (VAS) assessments were concurrently obtained. Subjects completing both challenges were included (N=46). Correlations between mean peak COWS and CINA scores as well as self-report VAS questions were calculated. Results Mean peak COWS and CINA scores of 7.6 and 24.4, respectively, occurred on average 30 minutes post-injection of naloxone. Mean COWS and CINA scores 30 minutes after placebo injection were 1.3 and 18.9, respectively. The Pearson correlation coefficient for peak COWS and CINA scores during the naloxone challenge session was 0.85 (p<0.001). Peak COWS scores also correlated well with peak VAS self-report scores of bad drug effect (r=0.57, p<0.001) and feeling sick (r=0.57, p<0.001), providing additional evidence of concurrent validity. Placebo was not associated with any significant elevation of COWS, CINA, or VAS scores, indicating discriminant validity. Cronbach’s alpha for the COWS was 0.78, indicating good internal consistency (reliability). Discussion COWS, CINA, and certain VAS items are all valid measurement tools for acute opiate withdrawal. PMID:19647958

Validation of the 4P's Plus screen for substance use in pregnancy validation of the 4P's Plus.

Science.gov (United States)

Chasnoff, I J; Wells, A M; McGourty, R F; Bailey, L K

2007-12-01

The purpose of this study is to validate the 4P's Plus screen for substance use in pregnancy. A total of 228 pregnant women enrolled in prenatal care underwent screening with the 4P's Plus and received a follow-up clinical assessment for substance use. Statistical analyses regarding reliability, sensitivity, specificity, and positive and negative predictive validity of the 4Ps Plus were conducted. The overall reliability for the five-item measure was 0.62. Seventy-four (32.5%) of the women had a positive screen. Sensitivity and specificity were very good, at 87 and 76%, respectively. Positive predictive validity was low (36%), but negative predictive validity was quite high (97%). Of the 31 women who had a positive clinical assessment, 45% were using less than 1 day per week. The 4P's Plus reliably and effectively screens pregnant women for risk of substance use, including those women typically missed by other perinatal screening methodologies.

Clinical Validation of Non-Invasive Cardiac Output Monitoring in Healthy Pregnant Women.

Science.gov (United States)

McLaughlin, Kelsey; Wright, Stephen P; Kingdom, John C P; Parker, John D

2017-11-01

Non-invasive hemodynamic monitoring has the potential to be a valuable clinical tool for the screening and management of hypertensive disorders of pregnancy. The objective of this study was to validate the clinical utility of the non-invasive cardiac output monitoring (NICOM) system in pregnant women. Twenty healthy pregnant women with a singleton pregnancy at 22 to 26 weeks' gestation were enrolled in this study. Measures of heart rate, stroke volume, and cardiac output were obtained through NICOM and compared with Doppler echocardiography. NICOM significantly overestimated measures of both stroke volume and cardiac output compared with Doppler echocardiography (95 ± 4 vs. 73 ± 4 mL, P gold standard for the measurement of cardiac output in the setting of pregnancy. However, once normal values have been established, NICOM has the potential to be a useful clinical tool for monitoring maternal hemodynamics in pregnant women. Further investigation regarding the validity of NICOM is required in larger populations of healthy and hypertensive pregnant women to determine whether this device is appropriate for maternal hemodynamic assessment during pregnancy. Copyright © 2017 The Society of Obstetricians and Gynaecologists of Canada/La Société des obstétriciens et gynécologues du Canada. Published by Elsevier Inc. All rights reserved.

Translation, adaptation, and validation of the Stanford Hypnotic Clinical Scale in Puerto Rico.

Science.gov (United States)

Deynes-Exclusa, Yazmin; Sayers-Montalvo, Sean K; Martinez-Taboas, Alfonso

2011-04-01

The only hypnotizability scale that has been translated and validated for the Puerto Rican population is the Barber Suggestibility Scale (BSS). In this article, the Stanford Hypnotic Clinical Scale (SHCS) was translated and validated for this population. The translated SHCS ("Escala Stanford de Hipnosis Clinica" [ESHC]) was administered individually to 100 Puerto Rican college students. There were no significant differences found between the norms of the original SHCS samples and the Spanish version of the SHCS. Both samples showed similar distributions. The Spanish version's internal reliability as well as the item discrimination index were adequate. The authors conclude that the ESHC is an adequate instrument to measure hypnotizability in the Puerto Rican population.

SU-E-T-50: Automatic Validation of Megavoltage Beams Modeled for Clinical Use in Radiation Therapy

International Nuclear Information System (INIS)

Melchior, M; Salinas Aranda, F; Sciutto, S; Dodat, D; Larragueta, N

2014-01-01

Purpose: To automatically validate megavoltage beams modeled in XiO™ 4.50 (Elekta, Stockholm, Sweden) and Varian Eclipse™ Treatment Planning Systems (TPS) (Varian Associates, Palo Alto, CA, USA), reducing validation time before beam-on for clinical use. Methods: A software application that can automatically read and analyze DICOM RT Dose and W2CAD files was developed using MatLab integrated development environment.TPS calculated dose distributions, in DICOM RT Dose format, and dose values measured in different Varian Clinac beams, in W2CAD format, were compared. Experimental beam data used were those acquired for beam commissioning, collected on a water phantom with a 2D automatic beam scanning system.Two methods were chosen to evaluate dose distributions fitting: gamma analysis and point tests described in Appendix E of IAEA TECDOC-1583. Depth dose curves and beam profiles were evaluated for both open and wedged beams. Tolerance parameters chosen for gamma analysis are 3% and 3 mm dose and distance, respectively.Absolute dose was measured independently at points proposed in Appendix E of TECDOC-1583 to validate software results. Results: TPS calculated depth dose distributions agree with measured beam data under fixed precision values at all depths analyzed. Measured beam dose profiles match TPS calculated doses with high accuracy in both open and wedged beams. Depth and profile dose distributions fitting analysis show gamma values < 1. Relative errors at points proposed in Appendix E of TECDOC-1583 meet therein recommended tolerances.Independent absolute dose measurements at points proposed in Appendix E of TECDOC-1583 confirm software results. Conclusion: Automatic validation of megavoltage beams modeled for their use in the clinic was accomplished. The software tool developed proved efficient, giving users a convenient and reliable environment to decide whether to accept or not a beam model for clinical use. Validation time before beam-on for clinical use

Convergent validity test, construct validity test and external validity test of the David Liberman algorithm

Directory of Open Access Journals (Sweden)

David Maldavsky

2013-08-01

Full Text Available The author first exposes a complement of a previous test about convergent validity, then a construct validity test and finally an external validity test of the David Liberman algorithm.  The first part of the paper focused on a complementary aspect, the differential sensitivity of the DLA 1 in an external comparison (to other methods, and 2 in an internal comparison (between two ways of using the same method, the DLA.  The construct validity test exposes the concepts underlined to DLA, their operationalization and some corrections emerging from several empirical studies we carried out.  The external validity test examines the possibility of using the investigation of a single case and its relation with the investigation of a more extended sample.

Utilisation, Reliability and Validity of Clinical Evaluation Exercise in Otolaryngology Training.

Science.gov (United States)

Awad, Z; Hayden, L; Muthuswamy, K; Tolley, N S

2015-10-01

To investigate the utilisation, reliability and validity of clinical evaluation exercise (CEX) in otolaryngology training. Retrospective database analysis. Online assessment database. We analysed all CEXs submitted by north London core (CT) and speciality trainees (ST) in otolaryngology from 2010 to 2013. Internal consistency of the 7 CEX items rated as either O: outstanding, S: satisfactory or D: development required. Overall performance rating (pS) of 1-4 assessed against completion of training level. Receiver operating characteristic was used to describe CEX sensitivity and specificity. Overall score (cS), pS and the number of 'D'-rated items were used to investigate construct validity. One thousand one hundred and sixty CEXs from 45 trainees were included. CEX showed good internal consistency (Cronbach's alpha= 0.85). CEX was highly sensitive (99%), yet not specific (6%). cS and pS for ST was higher than CT (99.1% ± 0.4 versus 96.6% ± 0.8 and 3.06 ± 0.05 versus 1.92 ± 0.04, respectively P reliable in assessing early years otolaryngology trainees in clinical examination, but not at higher level. It has the potential to be used in a summative capacity in selecting trainees for ST positions. This would also encourage trainees to master all domains of otolaryngology clinical examination by end of CT. © 2015 John Wiley & Sons Ltd.

Derivation and validation of the Systemic Lupus International Collaborating Clinics classification criteria for systemic lupus erythematosus

DEFF Research Database (Denmark)

Petri, Michelle; Orbai, Ana-Maria; Alarcón, Graciela S

2012-01-01

The Systemic Lupus International Collaborating Clinics (SLICC) group revised and validated the American College of Rheumatology (ACR) systemic lupus erythematosus (SLE) classification criteria in order to improve clinical relevance, meet stringent methodology requirements, and incorporate new...

Validity and reliability of the NAB Naming Test.

Science.gov (United States)

Sachs, Bonnie C; Rush, Beth K; Pedraza, Otto

2016-05-01

Confrontation naming is commonly assessed in neuropsychological practice, but few standardized measures of naming exist and those that do are susceptible to the effects of education and culture. The Neuropsychological Assessment Battery (NAB) Naming Test is a 31-item measure used to assess confrontation naming. Despite adequate psychometric information provided by the test publisher, there has been limited independent validation of the test. In this study, we investigated the convergent and discriminant validity, internal consistency, and alternate forms reliability of the NAB Naming Test in a sample of adults (Form 1: n = 247, Form 2: n = 151) clinically referred for neuropsychological evaluation. Results indicate adequate-to-good internal consistency and alternate forms reliability. We also found strong convergent validity as demonstrated by relationships with other neurocognitive measures. We found preliminary evidence that the NAB Naming Test demonstrates a more pronounced ceiling effect than other commonly used measures of naming. To our knowledge, this represents the largest published independent validation study of the NAB Naming Test in a clinical sample. Our findings suggest that the NAB Naming Test demonstrates adequate validity and reliability and merits consideration in the test arsenal of clinical neuropsychologists.

Symptom validity testing in memory clinics: Hippocampal-memory associations and relevance for diagnosing mild cognitive impairment.

Science.gov (United States)

Rienstra, Anne; Groot, Paul F C; Spaan, Pauline E J; Majoie, Charles B L M; Nederveen, Aart J; Walstra, Gerard J M; de Jonghe, Jos F M; van Gool, Willem A; Olabarriaga, Silvia D; Korkhov, Vladimir V; Schmand, Ben

2013-01-01

Patients with mild cognitive impairment (MCI) do not always convert to dementia. In such cases, abnormal neuropsychological test results may not validly reflect cognitive symptoms due to brain disease, and the usual brain-behavior relationships may be absent. This study examined symptom validity in a memory clinic sample and its effect on the associations between hippocampal volume and memory performance. Eleven of 170 consecutive patients (6.5%; 13% of patients younger than 65 years) referred to memory clinics showed noncredible performance on symptom validity tests (SVTs, viz. Word Memory Test and Test of Memory Malingering). They were compared to a demographically matched group (n = 57) selected from the remaining patients. Hippocampal volume, measured by an automated volumetric method (Freesurfer), was correlated with scores on six verbal memory tests. The median correlation was r = .49 in the matched group. However, the relation was absent (median r = -.11) in patients who failed SVTs. Memory clinic samples may include patients who show noncredible performance, which invalidates their MCI diagnosis. This underscores the importance of applying SVTs in evaluating patients with cognitive complaints that may signify a predementia stage, especially when these patients are relatively young.

The Growing Need for Validated Biomarkers and Endpoints for Dry Eye Clinical Research.

Science.gov (United States)

Roy, Neeta S; Wei, Yi; Kuklinski, Eric; Asbell, Penny A

2017-05-01

Biomarkers with minimally invasive and reproducible objective metrics provide the key to future paradigm shifts in understanding of the underlying causes of dry eye disease (DED) and approaches to treatment of DED. We review biomarkers and their validity in providing objective metrics for DED clinical research and patient care. The English-language literature in PubMed primarily over the last decade was surveyed for studies related to identification of biomarkers of DED: (1) inflammation, (2) point-of-care, (3) ocular imaging, and (4) genetics. Relevant studies in each group were individually evaluated for (1) methodological and analytical details, (2) data and concordance with other similar studies, and (3) potential to serve as validated biomarkers with objective metrics. Significant work has been done to identify biomarkers for DED clinical trials and for patient care. Interstudy variation among studies dealing with the same biomarker type was high. This could be attributed to biologic variations and/or differences in processing, and data analysis. Correlation with other signs and symptoms of DED was not always clear or present. Many of the biomarkers reviewed show the potential to serve as validated and objective metrics for clinical research and patient care in DED. Interstudy variation for a given biomarker emphasizes the need for detailed reporting of study methodology, including information on subject characteristics, quality control, processing, and analysis methods to optimize development of nonsubjective metrics. Biomarker development offers a rich opportunity to significantly move forward clinical research and patient care in DED. DED is an unmet medical need - a chronic pain syndrome associated with variable vision that affects quality of life, is common with advancing age, interferes with the comfortable use of contact lenses, and can diminish results of eye surgeries, such as cataract extraction, LASIK, and glaucoma procedures. It is a worldwide

Clinical Validity, Understandability, and Actionability of Online Cardiovascular Disease Risk Calculators: Systematic Review.

Science.gov (United States)

Bonner, Carissa; Fajardo, Michael Anthony; Hui, Samuel; Stubbs, Renee; Trevena, Lyndal

2018-02-01

Online health information is particularly important for cardiovascular disease (CVD) prevention, where lifestyle changes are recommended until risk becomes high enough to warrant pharmacological intervention. Online information is abundant, but the quality is often poor and many people do not have adequate health literacy to access, understand, and use it effectively. This project aimed to review and evaluate the suitability of online CVD risk calculators for use by low health literate consumers in terms of clinical validity, understandability, and actionability. This systematic review of public websites from August to November 2016 used evaluation of clinical validity based on a high-risk patient profile and assessment of understandability and actionability using Patient Education Material Evaluation Tool for Print Materials. A total of 67 unique webpages and 73 unique CVD risk calculators were identified. The same high-risk patient profile produced widely variable CVD risk estimates, ranging from as little as 3% to as high as a 43% risk of a CVD event over the next 10 years. One-quarter (25%) of risk calculators did not specify what model these estimates were based on. The most common clinical model was Framingham (44%), and most calculators (77%) provided a 10-year CVD risk estimate. The calculators scored moderately on understandability (mean score 64%) and poorly on actionability (mean score 19%). The absolute percentage risk was stated in most (but not all) calculators (79%), and only 18% included graphical formats consistent with recommended risk communication guidelines. There is a plethora of online CVD risk calculators available, but they are not readily understandable and their actionability is poor. Entering the same clinical information produces widely varying results with little explanation. Developers need to address actionability as well as clinical validity and understandability to improve usefulness to consumers with low health literacy. �

The Metacognitive Anger Processing (MAP) Scale - Validation in a Mixed Clinical and a Forensic In-Patient Sample

DEFF Research Database (Denmark)

Moeller, Stine Bjerrum; Bech, Per

2018-01-01

BACKGROUND: The metacognitive approach by Wells and colleagues has gained empirical support with a broad range of symptoms. The Metacognitive Anger Processing (MAP) scale was developed to provide a metacognitive measure on anger (Moeller, 2016). In the preliminary validation, three components were...... identified (positive beliefs, negative beliefs and rumination) to be positively correlated with the anger. AIMS: To validate the MAP in a sample of mixed clinical patients (n = 88) and a sample of male forensic patients (n = 54). METHOD: The MAP was administered together with measures of metacognition, anger......, rumination, anxiety and depressive symptoms. RESULTS: The MAP showed acceptable scalability and excellent reliability. Convergent validity was evidenced using the general metacognitive measure (MCQ-30), and concurrent validity was supported using two different anger measures (STAXI-2 and NAS). CONCLUSIONS...

Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project.

NARCIS (Netherlands)

Cluzeau, F.A.; Burgers, J.S.; Brouwers, M.M.; Grol, R.P.T.M.; et al.,

2003-01-01

BACKGROUND: International interest in clinical practice guidelines has never been greater but many published guidelines do not meet the basic quality requirements. There have been renewed calls for validated criteria to assess the quality of guidelines. OBJECTIVE: To develop and validate an

Validity of a new assessment rubric for a short-answer test of clinical reasoning.

Science.gov (United States)

Yeung, Euson; Kulasagarem, Kulamakan; Woods, Nicole; Dubrowski, Adam; Hodges, Brian; Carnahan, Heather

2016-07-26

The validity of high-stakes decisions derived from assessment results is of primary concern to candidates and certifying institutions in the health professions. In the field of orthopaedic manual physical therapy (OMPT), there is a dearth of documented validity evidence to support the certification process particularly for short-answer tests. To address this need, we examined the internal structure of the Case History Assessment Tool (CHAT); this is a new assessment rubric developed to appraise written responses to a short-answer test of clinical reasoning in post-graduate OMPT certification in Canada. Fourteen physical therapy students (novices) and 16 physical therapists (PT) with minimal and substantial OMPT training respectively completed a mock examination. Four pairs of examiners (n = 8) participated in appraising written responses using the CHAT. We conducted separate generalizability studies (G studies) for all participants and also by level of OMPT training. Internal consistency was calculated for test questions with more than 2 assessment items. Decision studies were also conducted to determine optimal application of the CHAT for OMPT certification. The overall reliability of CHAT scores was found to be moderate; however, reliability estimates for the novice group suggest that the scale was incapable of accommodating for scores of novices. Internal consistency estimates indicate item redundancies for several test questions which will require further investigation. Future validity studies should consider discriminating the clinical reasoning competence of OMPT trainees strictly at the post-graduate level. Although rater variance was low, the large variance attributed to error sources not incorporated in our G studies warrant further investigations into other threats to validity. Future examination of examiner stringency is also warranted.

Genomic Biomarkers for Personalized Medicine: Development and Validation in Clinical Studies

Directory of Open Access Journals (Sweden)

Shigeyuki Matsui

2013-01-01

Full Text Available The establishment of high-throughput technologies has brought substantial advances to our understanding of the biology of many diseases at the molecular level and increasing expectations on the development of innovative molecularly targeted treatments and molecular biomarkers or diagnostic tests in the context of clinical studies. In this review article, we position the two critical statistical analyses of high-dimensional genomic data, gene screening and prediction, in the framework of development and validation of genomic biomarkers or signatures, through taking into consideration the possible different strategies for developing genomic signatures. A wide variety of biomarker-based clinical trial designs to assess clinical utility of a biomarker or a new treatment with a companion biomarker are also discussed.

Validating archetypes for the Multiple Sclerosis Functional Composite.

Science.gov (United States)

Braun, Michael; Brandt, Alexander Ulrich; Schulz, Stefan; Boeker, Martin

2014-08-03

Numerous information models for electronic health records, such as openEHR archetypes are available. The quality of such clinical models is important to guarantee standardised semantics and to facilitate their interoperability. However, validation aspects are not regarded sufficiently yet. The objective of this report is to investigate the feasibility of archetype development and its community-based validation process, presuming that this review process is a practical way to ensure high-quality information models amending the formal reference model definitions. A standard archetype development approach was applied on a case set of three clinical tests for multiple sclerosis assessment: After an analysis of the tests, the obtained data elements were organised and structured. The appropriate archetype class was selected and the data elements were implemented in an iterative refinement process. Clinical and information modelling experts validated the models in a structured review process. Four new archetypes were developed and publicly deployed in the openEHR Clinical Knowledge Manager, an online platform provided by the openEHR Foundation. Afterwards, these four archetypes were validated by domain experts in a team review. The review was a formalised process, organised in the Clinical Knowledge Manager. Both, development and review process turned out to be time-consuming tasks, mostly due to difficult selection processes between alternative modelling approaches. The archetype review was a straightforward team process with the goal to validate archetypes pragmatically. The quality of medical information models is crucial to guarantee standardised semantic representation in order to improve interoperability. The validation process is a practical way to better harmonise models that diverge due to necessary flexibility left open by the underlying formal reference model definitions.This case study provides evidence that both community- and tool-enabled review processes

Commentary: moving toward cost-effectiveness in using psychophysiological measures in clinical assessment: validity, decision making, and adding value.

Science.gov (United States)

Youngstrom, Eric A; De Los Reyes, Andres

2015-01-01

Psychophysiological measures offer a variety of potential advantages, including more direct assessment of certain processes, as well as provision of information that may contrast with other sources. The role of psychophysiological measures in clinical practice will be best defined when researchers (a) switch to research designs and statistical models that better approximate how clinicians administer assessments and make clinical decisions in practice, (b) systematically compare the validity of psychophysiological measures to incumbent methods for assessing similar criteria, (c) test whether psychophysiological measures show either greater validity or clinically meaningful incremental validity, and (d) factor in fiscal costs as well as the utilities that the client attaches to different assessment outcomes. The statistical methods are now readily available, along with the interpretive models for integrating assessment results into client-centered decision making. These, combined with technology reducing the cost of psychophysiological measurement and improving ease of interpretation, poise the field for a rapid transformation of assessment practice, but only if we let go of old habits of research.

Measuring the statistical validity of summary meta‐analysis and meta‐regression results for use in clinical practice

Science.gov (United States)

Riley, Richard D.

2017-01-01

An important question for clinicians appraising a meta‐analysis is: are the findings likely to be valid in their own practice—does the reported effect accurately represent the effect that would occur in their own clinical population? To this end we advance the concept of statistical validity—where the parameter being estimated equals the corresponding parameter for a new independent study. Using a simple (‘leave‐one‐out’) cross‐validation technique, we demonstrate how we may test meta‐analysis estimates for statistical validity using a new validation statistic, Vn, and derive its distribution. We compare this with the usual approach of investigating heterogeneity in meta‐analyses and demonstrate the link between statistical validity and homogeneity. Using a simulation study, the properties of Vn and the Q statistic are compared for univariate random effects meta‐analysis and a tailored meta‐regression model, where information from the setting (included as model covariates) is used to calibrate the summary estimate to the setting of application. Their properties are found to be similar when there are 50 studies or more, but for fewer studies Vn has greater power but a higher type 1 error rate than Q. The power and type 1 error rate of Vn are also shown to depend on the within‐study variance, between‐study variance, study sample size, and the number of studies in the meta‐analysis. Finally, we apply Vn to two published meta‐analyses and conclude that it usefully augments standard methods when deciding upon the likely validity of summary meta‐analysis estimates in clinical practice. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd. PMID:28620945

Cost-effective master cell bank validation of multiple clinical-grade human pluripotent stem cell lines from a single donor.

Science.gov (United States)

Devito, Liani; Petrova, Anastasia; Miere, Cristian; Codognotto, Stefano; Blakely, Nicola; Lovatt, Archie; Ogilvie, Caroline; Khalaf, Yacoub; Ilic, Dusko

2014-10-01

Standardization guidelines for human pluripotent stem cells are still very broadly defined, despite ongoing clinical trials in the U.S., U.K., and Japan. The requirements for validation of human embryonic (hESCs) and induced pluripotent stem cells (iPSCs) in general follow the regulations for other clinically compliant biologics already in place but without addressing key differences between cell types or final products. In order to realize the full potential of stem cell therapy, validation criteria, methodology, and, most importantly, strategy, should address the shortfalls and efficiency of current approaches; without this, hESC- and, especially, iPSC-based therapy will not be able to compete with other technologies in a cost-efficient way. We addressed the protocols for testing cell lines for human viral pathogens and propose a novel strategy that would significantly reduce costs. It is highly unlikely that the multiple cell lines derived in parallel from a tissue sample taken from one donor would have different profiles of endogenous viral pathogens; we therefore argue that samples from the Master Cell Banks of sibling lines could be safely pooled for validation. We illustrate this approach with tiered validation of two sibling clinical-grade hESC lines, KCL033 and KCL034 (stage 1, sterility; stage 2, specific human pathogens; and stage 3, nonspecific human pathogens). The results of all tests were negative. This cost-effective strategy could also be applied for validation of Master Cell Banks of multiple clinical-grade iPSC lines derived from a single donor. ©AlphaMed Press.

Clinical utility of the Neurobehavioral Symptom Inventory validity scales to screen for symptom exaggeration following traumatic brain injury.

Science.gov (United States)

Lange, Rael T; Brickell, Tracey A; Lippa, Sara M; French, Louis M

2015-01-01

The purpose of this study was to examine the clinical utility of three recently developed validity scales (Validity-10, NIM5, and LOW6) designed to screen for symptom exaggeration using the Neurobehavioral Symptom Inventory (NSI). Participants were 272 U.S. military service members who sustained a mild, moderate, severe, or penetrating traumatic brain injury (TBI) and who were evaluated by the neuropsychology service at Walter Reed Army Medical Center within 199 weeks post injury. Participants were divided into two groups based on the Negative Impression Management scale of the Personality Assessment Inventory: (a) those who failed symptom validity testing (SVT-fail; n = 27) and (b) those who passed symptom validity testing (SVT-pass; n = 245). Participants in the SVT-fail group had significantly higher scores (pscales (range: d = 0.76 to 2.34). Similarly high sensitivity, specificity, positive predictive power (PPP), and negative predictive (NPP) values were found when using all three validity scales to differentiate SVT-fail versus SVT-pass groups. However, the Validity-10 scale consistently had the highest overall values. The optimal cutoff score for the Validity-10 scale to identify possible symptom exaggeration was ≥19 (sensitivity = .59, specificity = .89, PPP = .74, NPP = .80). For the majority of people, these findings provide support for the use of the Validity-10 scale as a screening tool for possible symptom exaggeration. When scores on the Validity-10 exceed the cutoff score, it is recommended that (a) researchers and clinicians do not interpret responses on the NSI, and (b) clinicians follow up with a more detailed evaluation, using well-validated symptom validity measures (e.g., Minnesota Multiphasic Personality Inventory-2 Restructured Form, MMPI-2-RF, validity scales), to seek confirmatory evidence to support an hypothesis of symptom exaggeration.

Clinical utility and validity of minoxidil response testing in androgenetic alopecia.

Science.gov (United States)

Goren, Andy; Shapiro, Jerry; Roberts, Janet; McCoy, John; Desai, Nisha; Zarrab, Zoulikha; Pietrzak, Aldona; Lotti, Torello

2015-01-01

Clinical response to 5% topical minoxidil for the treatment of androgenetic alopecia (AGA) is typically observed after 3-6 months. Approximately 40% of patients will regrow hair. Given the prolonged treatment time required to elicit a response, a diagnostic test for ruling out nonresponders would have significant clinical utility. Two studies have previously reported that sulfotransferase enzyme activity in plucked hair follicles predicts a patient's response to topical minoxidil therapy. The aim of this study was to assess the clinical utility and validity of minoxidil response testing. In this communication, the present authors conducted an analysis of completed and ongoing studies of minoxidil response testing. The analysis confirmed the clinical utility of a sulfotransferase enzyme test in successfully ruling out 95.9% of nonresponders to topical minoxidil for the treatment of AGA. © 2014 Wiley Periodicals, Inc.

Measuring clinical management by physicians and nurses in European hospitals: development and validation of two scales.

Science.gov (United States)

Plochg, Thomas; Arah, Onyebuchi A; Botje, Daan; Thompson, Caroline A; Klazinga, Niek S; Wagner, Cordula; Mannion, Russell; Lombarts, Kiki

2014-04-01

Clinical management is hypothesized to be critical for hospital management and hospital performance. The aims of this study were to develop and validate professional involvement scales for measuring the level of clinical management by physicians and nurses in European hospitals. Testing of validity and reliability of scales derived from a questionnaire of 21 items was developed on the basis of a previous study and expert opinion and administered in a cross-sectional seven-country research project 'Deepening our Understanding of Quality improvement in Europe' (DUQuE). A sample of 3386 leading physicians and nurses working in 188 hospitals located in Czech Republic, France, Germany, Poland, Portugal, Spain and Turkey. Validity and reliability of professional involvement scales and subscales. Psychometric analysis yielded four subscales for leading physicians: (i) Administration and budgeting, (ii) Managing medical practice, (iii) Strategic management and (iv) Managing nursing practice. Only the first three factors applied well to the nurses. Cronbach's alpha for internal consistency ranged from 0.74 to 0.86 for the physicians, and from 0.61 to 0.81 for the nurses. Except for the 0.74 correlation between 'Administration and budgeting' and 'Managing medical practice' among physicians, all inter-scale correlations were measurement instrument can be used for international research on clinical management.

[Validity and Reliability of the Korean Version Scale of the Clinical Learning Environment, Supervision and Nurse Teacher Evaluation Scale (CLES+T)].

Science.gov (United States)

Kim, Sun Hee; Yoo, So Yeon; Kim, Yae Young

2018-02-01

This study was conducted to evaluate the validity and reliability of the Korean version of the clinical learning environment, supervision and nurse teacher evaluation scale (CLES+T) that measures the clinical learning environment and the conditions associated with supervision and nurse teachers. The English CLES+T was translated into Korean with forward and back translation. Survey data were collected from 434 nursing students who had more than four days of clinical practice in Korean hospitals. Internal consistency reliability and construct validity using confirmatory and exploratory factor analysis were conducted. SPSS 20.0 and AMOS 22.0 programs were used for data analysis. The exploratory factor analysis revealed seven factors for the thirty three-item scale. Confirmatory factor analysis supported good convergent and discriminant validities. The Cronbach's alpha for the overall scale was .94 and for the seven subscales ranged from .78 to .94. The findings suggest that the 33-items Korean CLES+T is an appropriate instrument to measure Korean nursing students'clinical learning environment with good validity and reliability. © 2018 Korean Society of Nursing Science.

Temporomandibular disorders – validity of clinical diagnostics compared to magnetic resonance imaging

OpenAIRE

BADEL, TOMISLAV; MAROTTI, MILJENKO; SAVIĆ PAVIČIN, IVANA; DULČIĆ, NIKŠA; ZADRAVEC, DIJANA; KERN, JOSIPA

2011-01-01

Background and Purpose: Orthopedic examination techniques of the musculoskeletal system contribute to the successful diagnostics of temporomandibular disorders (TMD). The purpose of this study is to determine the validity of TMD clinical diagnostics by comparing the findings of manual functional analysis (MFA) and the results of MRI of temporomandibular joint (TMJ). The diagnostic significance of limited mouth opening and pain upon passive mouth opening were taken into consideration. M...

Are You "Tilting at Windmills" or Undertaking a Valid Clinical Trial?

Science.gov (United States)

Zariffa, Jose; Kramer, John L.K.

2011-01-01

In this review, several aspects surrounding the choice of a therapeutic intervention and the conduct of clinical trials are discussed. Some of the background for why human studies have evolved to their current state is also included. Specifically, the following questions have been addressed: 1) What criteria should be used to determine whether a scientific discovery or invention is worthy of translation to human application? 2) What recent scientific advance warrants a deeper understanding of clinical trials by everyone? 3) What are the different types and phases of a clinical trial? 4) What characteristics of a human disorder should be noted, tracked, or stratified for a clinical trial and what inclusion /exclusion criteria are important to enrolling appropriate trial subjects? 5) What are the different study designs that can be used in a clinical trial program? 6) What confounding factors can alter the accurate interpretation of clinical trial outcomes? 7) What are the success rates of clinical trials and what can we learn from previous clinical trials? 8) What are the essential principles for the conduct of valid clinical trials? PMID:21786433

Validity and clinical feasibility of the ADHD rating scale (ADHD-RS) A Danish Nationwide Multicenter Study

DEFF Research Database (Denmark)

Szomlaiski, N; Dyrborg, J; Rasmussen, H

2008-01-01

Aim: To establish the validity of a Danish version of the Attention Deficit Hyperactivity Disorder Rating Scale (ADHD-RS), secondly to present national norm scores compared to that of United States and other European data and thirdly to evaluate ADHD-RS when used for monitoring treatment...... effectiveness. Methods: A Danish translation of the ADHD-RS was used on a normative sample of 837 children. Two clinical samples, 138 hyperkinetic disorder (HKD) cases and 110 clinical controls were recruited from eleven Danish Child and Adolescent Mental Health (CAMH) centres and assessed according to usual...... clinical standards. The HKD children were rated by parents and teachers at baseline and at follow-up 3 months later. Results: Internal validity of ADHD-RS was high and the factor structure supported the diagnostic classification system ICD-10. The questionnaire discriminated HKD patients in a mixed...

FACTAR validation

International Nuclear Information System (INIS)

Middleton, P.B.; Wadsworth, S.L.; Rock, R.C.; Sills, H.E.; Langman, V.J.

1995-01-01

A detailed strategy to validate fuel channel thermal mechanical behaviour codes for use of current power reactor safety analysis is presented. The strategy is derived from a validation process that has been recently adopted industry wide. Focus of the discussion is on the validation plan for a code, FACTAR, for application in assessing fuel channel integrity safety concerns during a large break loss of coolant accident (LOCA). (author)

MO-B-BRB-03: 3D Dosimetry in the Clinic: Validating Special Techniques

Energy Technology Data Exchange (ETDEWEB)

Juang, T. [Stanford Cancer Center (United States)

2016-06-15

Full three-dimensional (3D) dosimetry using volumetric chemical dosimeters probed by 3D imaging systems has long been a promising technique for the radiation therapy clinic, since it provides a unique methodology for dose measurements in the volume irradiated using complex conformal delivery techniques such as IMRT and VMAT. To date true 3D dosimetry is still not widely practiced in the community; it has been confined to centres of specialized expertise especially for quality assurance or commissioning roles where other dosimetry techniques are difficult to implement. The potential for improved clinical applicability has been advanced considerably in the last decade by the development of improved 3D dosimeters (e.g., radiochromic plastics, radiochromic gel dosimeters and normoxic polymer gel systems) and by improved readout protocols using optical computed tomography or magnetic resonance imaging. In this session, established users of some current 3D chemical dosimeters will briefly review the current status of 3D dosimetry, describe several dosimeters and their appropriate imaging for dose readout, present workflow procedures required for good dosimetry, and analyze some limitations for applications in select settings. We will review the application of 3D dosimetry to various clinical situations describing how 3D approaches can complement other dose delivery validation approaches already available in the clinic. The applications presented will be selected to inform attendees of the unique features provided by full 3D techniques. Learning Objectives: L. John Schreiner: Background and Motivation Understand recent developments enabling clinically practical 3D dosimetry, Appreciate 3D dosimetry workflow and dosimetry procedures, and Observe select examples from the clinic. Sofie Ceberg: Application to dynamic radiotherapy Observe full dosimetry under dynamic radiotherapy during respiratory motion, and Understand how the measurement of high resolution dose data in an

MO-B-BRB-03: 3D Dosimetry in the Clinic: Validating Special Techniques

International Nuclear Information System (INIS)

Juang, T.

2016-01-01

Full three-dimensional (3D) dosimetry using volumetric chemical dosimeters probed by 3D imaging systems has long been a promising technique for the radiation therapy clinic, since it provides a unique methodology for dose measurements in the volume irradiated using complex conformal delivery techniques such as IMRT and VMAT. To date true 3D dosimetry is still not widely practiced in the community; it has been confined to centres of specialized expertise especially for quality assurance or commissioning roles where other dosimetry techniques are difficult to implement. The potential for improved clinical applicability has been advanced considerably in the last decade by the development of improved 3D dosimeters (e.g., radiochromic plastics, radiochromic gel dosimeters and normoxic polymer gel systems) and by improved readout protocols using optical computed tomography or magnetic resonance imaging. In this session, established users of some current 3D chemical dosimeters will briefly review the current status of 3D dosimetry, describe several dosimeters and their appropriate imaging for dose readout, present workflow procedures required for good dosimetry, and analyze some limitations for applications in select settings. We will review the application of 3D dosimetry to various clinical situations describing how 3D approaches can complement other dose delivery validation approaches already available in the clinic. The applications presented will be selected to inform attendees of the unique features provided by full 3D techniques. Learning Objectives: L. John Schreiner: Background and Motivation Understand recent developments enabling clinically practical 3D dosimetry, Appreciate 3D dosimetry workflow and dosimetry procedures, and Observe select examples from the clinic. Sofie Ceberg: Application to dynamic radiotherapy Observe full dosimetry under dynamic radiotherapy during respiratory motion, and Understand how the measurement of high resolution dose data in an

Predictive validity of measurements of clinical competence using the team objective structured bedside assessment (TOSBA): assessing the clinical competence of final year medical students.

LENUS (Irish Health Repository)

Meagher, Frances M

2009-11-01

The importance of valid and reliable assessment of student competence and performance is gaining increased recognition. Provision of valid patient-based formative assessment is an increasing challenge for clinical teachers in a busy hospital setting. A formative assessment tool that reliably predicts performance in the summative setting would be of value to both students and teachers.

Validity and validation of expert (Q)SAR systems.

Science.gov (United States)

Hulzebos, E; Sijm, D; Traas, T; Posthumus, R; Maslankiewicz, L

2005-08-01

At a recent workshop in Setubal (Portugal) principles were drafted to assess the suitability of (quantitative) structure-activity relationships ((Q)SARs) for assessing the hazards and risks of chemicals. In the present study we applied some of the Setubal principles to test the validity of three (Q)SAR expert systems and validate the results. These principles include a mechanistic basis, the availability of a training set and validation. ECOSAR, BIOWIN and DEREK for Windows have a mechanistic or empirical basis. ECOSAR has a training set for each QSAR. For half of the structural fragments the number of chemicals in the training set is >4. Based on structural fragments and log Kow, ECOSAR uses linear regression to predict ecotoxicity. Validating ECOSAR for three 'valid' classes results in predictivity of > or = 64%. BIOWIN uses (non-)linear regressions to predict the probability of biodegradability based on fragments and molecular weight. It has a large training set and predicts non-ready biodegradability well. DEREK for Windows predictions are supported by a mechanistic rationale and literature references. The structural alerts in this program have been developed with a training set of positive and negative toxicity data. However, to support the prediction only a limited number of chemicals in the training set is presented to the user. DEREK for Windows predicts effects by 'if-then' reasoning. The program predicts best for mutagenicity and carcinogenicity. Each structural fragment in ECOSAR and DEREK for Windows needs to be evaluated and validated separately.

Clinical validation of nursing outcome mobility in patients with cerebrovascular accidents.

Science.gov (United States)

Moreira, Rafaella Pessoa; Araujo, Thelma Leite de; Lopes, Marcos Venicios de Oliveira; Cavalcante, Tahissa Frota; Guedes, Nirla Gomes; Chaves, Emília Soares; Portela, Regiane Campos; Holanda, Rose-Eloise

2016-12-15

To clinically validate the nursing outcome Mobility in patients with cerebrovascular accidents. Descriptive study, conducted in July 2011, with 38 outpatients, in northeastern Brazil. Data collection took place by evaluating two pairs of specialist nurses, where one pair used the instrument containing the constitutive and operational definitions of the indicators and magnitudes of the Mobility Outcome and the other pair without such definitions. When analyzing the evaluations among nurses, all indicators showed significant differences by the Friedman test (p cerebrovascular accident patient's mobility state.

Statistical validation of normal tissue complication probability models.

Science.gov (United States)

Xu, Cheng-Jian; van der Schaaf, Arjen; Van't Veld, Aart A; Langendijk, Johannes A; Schilstra, Cornelis

2012-09-01

To investigate the applicability and value of double cross-validation and permutation tests as established statistical approaches in the validation of normal tissue complication probability (NTCP) models. A penalized regression method, LASSO (least absolute shrinkage and selection operator), was used to build NTCP models for xerostomia after radiation therapy treatment of head-and-neck cancer. Model assessment was based on the likelihood function and the area under the receiver operating characteristic curve. Repeated double cross-validation showed the uncertainty and instability of the NTCP models and indicated that the statistical significance of model performance can be obtained by permutation testing. Repeated double cross-validation and permutation tests are recommended to validate NTCP models before clinical use. Copyright © 2012 Elsevier Inc. All rights reserved.

Statistical Validation of Normal Tissue Complication Probability Models

Energy Technology Data Exchange (ETDEWEB)

Xu Chengjian, E-mail: c.j.xu@umcg.nl [Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen (Netherlands); Schaaf, Arjen van der; Veld, Aart A. van' t; Langendijk, Johannes A. [Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen (Netherlands); Schilstra, Cornelis [Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen (Netherlands); Radiotherapy Institute Friesland, Leeuwarden (Netherlands)

2012-09-01

Purpose: To investigate the applicability and value of double cross-validation and permutation tests as established statistical approaches in the validation of normal tissue complication probability (NTCP) models. Methods and Materials: A penalized regression method, LASSO (least absolute shrinkage and selection operator), was used to build NTCP models for xerostomia after radiation therapy treatment of head-and-neck cancer. Model assessment was based on the likelihood function and the area under the receiver operating characteristic curve. Results: Repeated double cross-validation showed the uncertainty and instability of the NTCP models and indicated that the statistical significance of model performance can be obtained by permutation testing. Conclusion: Repeated double cross-validation and permutation tests are recommended to validate NTCP models before clinical use.

Clinical validation of the CHRONIOUS wearable system in patients with chronic disease.

Science.gov (United States)

Bellos, Christos; Papadopoulos, Athanassios; Rosso, Roberto; Fotiadis, Dimitrios I

2013-01-01

The CHRONIOUS system defines a powerful and easy to use framework which has been designed to provide services to clinicians and their patients suffering from chronic diseases. The system is composed of a wearable shirt that integrate several body sensors, a portable smart device and a central sub-system that is responsible for the long term storage of the collected patient's data. A multi-parametric expert system is developed for the analysis of the collected data using intelligent algorithms and complex techniques. Apart for the vital signals, dietary habits, drug intake, activity data, environmental and biochemical parameters are recorded. The CHRONIOUS platform is validated through clinical trials in several medical centers and patient's home environments recruiting patients suffering from Chronic Obstructive pulmonary disease (COPD) and Chronic Kidney Disease (CKD) diseases. The clinical trials contribute in improving the system's accuracy, while Pulmonologists and Nephrologists experts utilized the CHRONIOUS platform to evaluate its efficiency and performance. The results of the utilization of the system were very encouraging. The CHRONIOUS system has been proven to be a well-validated real-time patient monitoring and supervision platform, providing a useful tool for the clinician and the patient that would contribute to the more effective management of chronic diseases.

Validation of the prosthetic esthetic index

DEFF Research Database (Denmark)

Özhayat, Esben B; Dannemand, Katrine

2014-01-01

OBJECTIVES: In order to diagnose impaired esthetics and evaluate treatments for these, it is crucial to evaluate all aspects of oral and prosthetic esthetics. No professionally administered index currently exists that sufficiently encompasses comprehensive prosthetic esthetics. This study aimed...... to validate a new comprehensive index, the Prosthetic Esthetic Index (PEI), for professional evaluation of esthetics in prosthodontic patients. MATERIAL AND METHODS: The content, criterion, and construct validity; the test-retest, inter-rater, and internal consistency reliability; and the sensitivity...... furthermore distinguish between participants and controls, indicating sufficient sensitivity. CONCLUSION: The PEI is considered a valid and reliable instrument involving sufficient aspects for assessment of the professionally evaluated esthetics in prosthodontic patients. CLINICAL RELEVANCE...

Reliability and Validity of Objective Structured Clinical Examination for Residents of Obstetrics and Gynecology at Kermanshah University of Medical Sciences

Directory of Open Access Journals (Sweden)

Nasrin Jalilian

2012-11-01

Full Text Available Introduction: Objective structured clinical examination (OSCE is used for the evaluation of the clinical competence in medicine for which it is essential to measure validity and reliability. This study aimed to investigate the validity and reliability of OSCE for residents of obstetrics and gynecology at Kermanshah University of Medical Sciences in 2011.Methods: A descriptive-correlation study was designed and the data of OSCE for obstetrics and gynecology were collected via learning behavior checklists in method stations and multiple choice questions in question stations. The data were analyzed through Pearson correlation coefficient and Cronbach's alpha, using SPSS software (version 16. To determine the criterion validity, correlation of OSCE scores with scores of resident promotion test, direct observation of procedural skills, and theoretical knowledge was determined; for reliability, however, Cronbach's alpha was used. Total sample consisted of 25 participants taking part in 14 stations. P value of less than 0.05 was considered as significant.Results: The mean OSCE scores was 22.66 (±6.85. Criterion validity of the stations with resident promotion theoretical test, first theoretical knowledge test, second theoretical knowledge, and direct observation of procedural skills (DOPS was 0.97, 0.74, 0.49, and 0.79, respectively. In question stations, criterion validity was 0.15, and total validity of OSCE was 0.77.Conclusion: Findings of the present study indicated acceptable validity and reliability of OSCE for residents of obstetrics and gynecology.

Reexamining the validity and reliability of the clinical version of the Iowa gambling task: Evidence from a normal subject group

Directory of Open Access Journals (Sweden)

Ching-Hung eLin

2013-05-01

Full Text Available Over past decade, the Iowa gambling task (IGT has been utilized to test various decision deficits induced by neurological damage or psychiatric disorders. The IGT has recently been standardized for identifying 13 different neuropsychological disorders. Neuropsychological patients choose bad decks frequently, and normal subjects prefer good EV decks. However, the IGT has several validity and reliability problems. Some research groups have pointed out that the validity of IGT is influenced by the personality and emotional state of subjects. Additionally, several other studies have proposed that the prominent deck B phenomenon (PDB phenomenon – that is, normal subjects preferring bad deck B – may be the most serious problem confronting IGT validity. Specifically, deck B offers a high frequency of gains but negative EV. In the standard IGT administration, choice behavior can be understood with reference to gain-loss frequency (GLF rather than inferred future consequences (EV, the basic assumption of IGT. Furthermore, using two different criteria (basic assumption vs. professional norm results in significantly different classification results. Therefore, we recruited 72 normal subjects to test the validity and reliability of IGT. Each subject performed three runs of the computer-based clinical IGT version. The PDB phenomenon has been observed to a significant degree in the first and second stages of the clinical IGT version. Obviously, validity, reliability and the practice effect were unstable between two given stages. The present form of the clinical IGT version has only one stage, so its use should be reconsidered for examining normal decision makers; results from patient groups must also be interpreted with great care. GLF could be the main factor to be considered in establishing the constructional validity and reliability of the clinical IGT version.

Development and preliminary validation of a screen for ...

African Journals Online (AJOL)

Development and preliminary validation of a screen for interpersonal childhood trauma experiences among school-going youth in Durban, South Africa. ... validity in the sense that all scales were significantly correlated with scores on clinical measures of post-traumatic stress disorder (PTSD) and/or complex PTSD.

Review of the Reported Measures of Clinical Validity and Clinical Utility as Arguments for the Implementation of Pharmacogenetic Testing: A Case Study of Statin-Induced Muscle Toxicity

Directory of Open Access Journals (Sweden)

Marleen E. Jansen

2017-08-01

Full Text Available Advances from pharmacogenetics (PGx have not been implemented into health care to the expected extent. One gap that will be addressed in this study is a lack of reporting on clinical validity and clinical utility of PGx-tests. A systematic review of current reporting in scientific literature was conducted on publications addressing PGx in the context of statins and muscle toxicity. Eighty-nine publications were included and information was selected on reported measures of effect, arguments, and accompanying conclusions. Most authors report associations to quantify the relationship between a genetic variation an outcome, such as adverse drug responses. Conclusions on the implementation of a PGx-test are generally based on these associations, without explicit mention of other measures relevant to evaluate the test's clinical validity and clinical utility. To gain insight in the clinical impact and select useful tests, additional outcomes are needed to estimate the clinical validity and utility, such as cost-effectiveness.

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

Science.gov (United States)

2018-01-01

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do.

Science.gov (United States)

Park, Seong Ho; Kressel, Herbert Y

2018-05-28

Artificial intelligence (AI) is projected to substantially influence clinical practice in the foreseeable future. However, despite the excitement around the technologies, it is yet rare to see examples of robust clinical validation of the technologies and, as a result, very few are currently in clinical use. A thorough, systematic validation of AI technologies using adequately designed clinical research studies before their integration into clinical practice is critical to ensure patient benefit and safety while avoiding any inadvertent harms. We would like to suggest several specific points regarding the role that peer-reviewed medical journals can play, in terms of study design, registration, and reporting, to help achieve proper and meaningful clinical validation of AI technologies designed to make medical diagnosis and prediction, focusing on the evaluation of diagnostic accuracy efficacy. Peer-reviewed medical journals can encourage investigators who wish to validate the performance of AI systems for medical diagnosis and prediction to pay closer attention to the factors listed in this article by emphasizing their importance. Thereby, peer-reviewed medical journals can ultimately facilitate translating the technological innovations into real-world practice while securing patient safety and benefit.

Clinical validity of a relocation stress scale for the families of patients transferred from intensive care units.

Science.gov (United States)

Oh, HyunSoo; Lee, Seul; Kim, JiSun; Lee, EunJu; Min, HyoNam; Cho, OkJa; Seo, WhaSook

2015-07-01

This study was conducted to develop a family relocation stress scale by modifying the Son's Relocation Stress Syndrome Scale, to examine its clinical validity and reliability and to confirm its suitability for measuring family relocation stress. The transfer of ICU patients to general wards is a significant anxiety-producing event for family members. However, no relocation stress scale has been developed specifically for families. A nonexperimental, correlation design was adopted. The study subjects were 95 family members of 95 ICU patients at a university hospital located in Incheon, South Korea. Face and construct validities of the devised family relocation stress scale were examined. Construct validity was examined using factor analysis and by using a nomological validity test. Reliability was also examined. Face and content validity of the scale were verified by confirming that its items adequately measured family relocation stress. Factor analysis yielded four components, and the total variance explained by these four components was 63·0%, which is acceptable. Nomological validity was well supported by significant relationships between relocation stress and degree of preparation for relocation, patient self-care ability, family burden and satisfaction with the relocation process. The devised scale was also found to have good reliability. The family relocation stress scale devised in this study was found to have good validity and reliability, and thus, is believed to offer a means of assessing family relocation stress. The findings of this study provide a reliable and valid assessment tool when nurses prepare families for patient transfer from an ICU to a ward setting, and may also provide useful information to those developing an intervention programme for family relocation stress management. © 2015 John Wiley & Sons Ltd.

Clinical Validity of the ADI-R in a US-Based Latino Population

Science.gov (United States)

Vanegas, Sandra B.; Magaña, Sandra; Morales, Miguel; McNamara, Ellyn

2016-01-01

The Autism Diagnostic Interview-Revised (ADI-R) has been validated as a tool to aid in the diagnosis of Autism; however, given the growing diversity in the United States, the ADI-R must be validated for different languages and cultures. This study evaluates the validity of the ADI-R in a US-based Latino, Spanish-speaking population of 50 children…

Reconceptualising the external validity of discrete choice experiments.

Science.gov (United States)

Lancsar, Emily; Swait, Joffre

2014-10-01

External validity is a crucial but under-researched topic when considering using discrete choice experiment (DCE) results to inform decision making in clinical, commercial or policy contexts. We present the theory and tests traditionally used to explore external validity that focus on a comparison of final outcomes and review how this traditional definition has been empirically tested in health economics and other sectors (such as transport, environment and marketing) in which DCE methods are applied. While an important component, we argue that the investigation of external validity should be much broader than a comparison of final outcomes. In doing so, we introduce a new and more comprehensive conceptualisation of external validity, closely linked to process validity, that moves us from the simple characterisation of a model as being or not being externally valid on the basis of predictive performance, to the concept that external validity should be an objective pursued from the initial conceptualisation and design of any DCE. We discuss how such a broader definition of external validity can be fruitfully used and suggest innovative ways in which it can be explored in practice.

Statistical Validation for Clinical Measures: Repeatability and Agreement of Kinect™-Based Software.

Science.gov (United States)

Lopez, Natalia; Perez, Elisa; Tello, Emanuel; Rodrigo, Alejandro; Valentinuzzi, Max E

2018-01-01

The rehabilitation process is a fundamental stage for recovery of people's capabilities. However, the evaluation of the process is performed by physiatrists and medical doctors, mostly based on their observations, that is, a subjective appreciation of the patient's evolution. This paper proposes a tracking platform of the movement made by an individual's upper limb using Kinect sensor(s) to be applied for the patient during the rehabilitation process. The main contribution is the development of quantifying software and the statistical validation of its performance, repeatability, and clinical use in the rehabilitation process. The software determines joint angles and upper limb trajectories for the construction of a specific rehabilitation protocol and quantifies the treatment evolution. In turn, the information is presented via a graphical interface that allows the recording, storage, and report of the patient's data. For clinical purposes, the software information is statistically validated with three different methodologies, comparing the measures with a goniometer in terms of agreement and repeatability. The agreement of joint angles measured with the proposed software and goniometer is evaluated with Bland-Altman plots; all measurements fell well within the limits of agreement, meaning interchangeability of both techniques. Additionally, the results of Bland-Altman analysis of repeatability show 95% confidence. Finally, the physiotherapists' qualitative assessment shows encouraging results for the clinical use. The main conclusion is that the software is capable of offering a clinical history of the patient and is useful for quantification of the rehabilitation success. The simplicity, low cost, and visualization possibilities enhance the use of the software Kinect for rehabilitation and other applications, and the expert's opinion endorses the choice of our approach for clinical practice. Comparison of the new measurement technique with established

Diagnostic Validity of Clinical Signs Associated with a Large Exophoria at Near

Directory of Open Access Journals (Sweden)

Pilar Cacho-Martínez

2013-01-01

Full Text Available Purpose. To analyze the diagnostic validity of accommodative and binocular tests in a sample of patients with a large near exophoria with moderate to severe symptoms. Methods. Two groups of patients between 19 and 35 years were recruited from a university clinic: 33 subjects with large exophoria at near vision and moderate or high visual discomfort and 33 patients with normal heterophoria and low visual discomfort. Visual discomfort was defined using the Conlon survey. A refractive exam and an exhaustive evaluation of accommodation and vergence were assessed. Diagnostic validity by means of receiver operator characteristic (ROC curves, sensitivity (S, specificity (Sp, and positive and negative likelihood ratios (LR+, LR− were assessed. This analysis was also carried out considering multiple tests as serial testing strategy. Results. ROC analysis showed the best diagnostic accuracy for receded near point of convergence (NPC recovery (area = 0.929 and binocular accommodative facility (BAF (area = 0.886. Using the cut-offs obtained with ROC analysis, the best diagnostic validity was obtained for the combination of NPC recovery and BAF (S  =  0.77, Sp = 1, LR+ = value tending to infinity, LR− = 0.23 and the combination of NPC break and recovery with BAF (S  =  0.73, Sp = 1, LR+ = tending to infinity, LR− = 0.27. Conclusions. NPC and BAF tests were the tests with the best diagnostic accuracy for subjects with large near exophoria and moderate to severe symptoms.

The FORGE AHEAD clinical readiness consultation tool: a validated tool to assess clinical readiness for chronic disease care mobilization in Canada's First Nations.

Science.gov (United States)

Hayward, Mariam Naqshbandi; Mequanint, Selam; Paquette-Warren, Jann; Bailie, Ross; Chirila, Alexandra; Dyck, Roland; Green, Michael; Hanley, Anthony; Tompkins, Jordan; Harris, Stewart

2017-03-23

Given the astounding rates of diabetes and related complications, and the barriers to providing care present in Indigenous communities in Canada, intervention strategies that take into account contextual factors such as readiness to mobilize are needed to maximize improvements and increase the likelihood of success and sustainment. As part of the national FORGE AHEAD Program, we sought to develop, test and validate a clinical readiness consultation tool aimed at assessing the readiness of clinical teams working on-reserve in First Nations communities to participate in quality improvement (QI) to enhance diabetes care in Canada. A literature review was conducted to identify existing readiness tools. The ABCD - SAT was adapted using a consensus approach that emphasized a community-based participatory approach and prioritized the knowledge and wisdom held by community members. The tool was piloted with a group of 16 people from 7 provinces and 11 partnering communities to assess language use, clarity, relevance, format, and ease of completion using examples. Internal reliability analysis and convergence validity were conducted with data from 53 clinical team members from 11 First Nations communities (3-5 per community) who have participated in the FORGE AHEAD program. The 27-page Clinical Readiness Consultation Tool (CRCT) consists of five main components, 21 sub-components, and 74 items that are aligned with the Expanded Chronic Care Model. Five-point Likert scale feedback from the pilot ranged from 3.25 to 4.5. Length of the tool was reported as a drawback but respondents noted that all the items were needed to provide a comprehensive picture of the healthcare system. Results for internal consistency showed that all sub-components except for two were within acceptable ranges (0.77-0.93). The Team Structure and Function sub-component scale had a moderately significant positive correlation with the validated Team Climate Inventory, r = 0.45, p < 0.05. The

The development of a self-administered dementia checklist: the examination of concurrent validity and discriminant validity.

Science.gov (United States)

Miyamae, Fumiko; Ura, Chiaki; Sakuma, Naoko; Niikawa, Hirotoshi; Inagaki, Hiroki; Ijuin, Mutsuo; Okamura, Tsuyoshi; Sugiyama, Mika; Awata, Shuichi

2016-01-01

The present study aims to develop a self-administered dementia checklist to enable community-residing older adults to realize their declining functions and start using necessary services. A previous study confirmed the factorial validity and internal reliability of the checklist. The present study examined its concurrent validity and discriminant validity. The authors conducted a 3-step study (a self-administered survey including the checklist, interviews by nurses, and interviews by doctors and psychologists) of 7,682 community-residing individuals who were over 65 years of age. The authors calculated Spearman's correlation coefficients between the scores of the checklist and the results of a psychological test to examine the concurrent validity. They also compared the average total scores of the checklist between groups with different Clinical Dementia Rating (CDR) scores to examine discriminant validity and conducted a receiver operating characteristic analysis to examine the discriminative power for dementia. The authors analyzed the data of 131 respondents who completed all 3 steps. The checklist scores were significantly correlated with the respondents' Mini-Mental State Examination and Frontal Assessment Battery scores. The checklist also significantly discriminated the patients with dementia (CDR = 1+) from those without dementia (CDR = 0 or 0.5). The optimal cut-off point for the two groups was 17/18 (sensitivity, 72.0%; specificity, 69.2%; positive predictive value, 69.2%; negative predictive value, 72.0%). This study confirmed the concurrent validity and discriminant validity of the self-administered dementia checklist. However, due to its insufficient discriminative power as a screening tool for older people with declining cognitive functions, the checklist is only recommended as an educational and public awareness tool.

Clinical examinations to validate self-completion questionnaires: dermatitis in the UK printing industry.

Science.gov (United States)

Livesley, E J; Rushton, L; English, J S C; Williams, H C

2002-07-01

A self-completion questionnaire sent to 2600 Nottinghamshire members of the Graphical Paper and Media Union elicited a 62% response. Forty one per cent of respondents reported suffering a skin complaint at some time and 11% had a current skin problem on the hand. This paper reports the validation stage of the study. Samples of 45 'cases' of self-reported dermatitis and 60 'controls', who reported they had never suffered a skin complaint, were clinically examined. All 45 self-reported cases were clinically confirmed as dermatitis. Occupationally related irritant contact dermatitis (ICD) was diagnosed in 20 (44%); 26 (58%) complaints were thought to be induced or exacerbated by occupation. Of the controls, 21 (35%) were also diagnosed with a skin complaint, the majority being mild, with an occupational association in 17, the majority (15) being ICD. Sixteen ICD cases were patch tested resulting in positive reactions to colophony, neomycin, nickel and potassium dichromate (2 of each). Two cases of basal cell carcinoma on the face were also identified, of which the participants were unaware. Although there was no false positive self-reporting there was a considerable number of false negatives, demonstrating the importance of clinical validation of questionnaires relating to industrial skin disease. This study has highlighted the need for improvement in skin care provision in the printing industry.

Hospitalization for community-acquired febrile urinary tract infection: validation and impact assessment of a clinical prediction rule.

Science.gov (United States)

Stalenhoef, Janneke E; van der Starre, Willize E; Vollaard, Albert M; Steyerberg, Ewout W; Delfos, Nathalie M; Leyten, Eliane M S; Koster, Ted; Ablij, Hans C; Van't Wout, Jan W; van Dissel, Jaap T; van Nieuwkoop, Cees

2017-06-06

There is a lack of severity assessment tools to identify adults presenting with febrile urinary tract infection (FUTI) at risk for complicated outcome and guide admission policy. We aimed to validate the Prediction Rule for Admission policy in Complicated urinary Tract InfeCtion LEiden (PRACTICE), a modified form of the pneumonia severity index, and to subsequentially assess its use in clinical practice. A prospective observational multicenter study for model validation (2004-2009), followed by a multicenter controlled clinical trial with stepped wedge cluster-randomization for impact assessment (2010-2014), with a follow up of 3 months. Paricipants were 1157 consecutive patients with a presumptive diagnosis of acute febrile UTI (787 in validation cohort and 370 in the randomized trial), enrolled at emergency departments of 7 hospitals and 35 primary care centers in the Netherlands. The clinical prediction rule contained 12 predictors of complicated course. In the randomized trial the PRACTICE included guidance on hospitalization for high risk (>100 points) and home discharge for low risk patients (urinary tract infection, futher improvement is necessary to reduce the occurrence of secondary hospital admissions. NTR4480 http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4480 , registered retrospectively 25 mrt 2014 (during enrollment of subjects).

Development and validation of a premature ejaculation diagnostic tool.

Science.gov (United States)

Symonds, Tara; Perelman, Michael A; Althof, Stanley; Giuliano, François; Martin, Mona; May, Kathryn; Abraham, Lucy; Crossland, Anna; Morris, Mark

2007-08-01

Diagnosis of premature ejaculation (PE) for clinical trial purposes has typically relied on intravaginal ejaculation latency time (IELT) for entry, but this parameter does not capture the multidimensional nature of PE. Therefore, the aim was to develop a brief, multidimensional, psychometrically validated instrument for diagnosing PE status. The questionnaire development involved three stages: (1) Five focus groups and six individual interviews were conducted to develop the content; (2) psychometric validation using three different groups of men; and (3) generation of a scoring system. For psychometric validation/scoring system development, data was collected from (1) men with PE based on clinician diagnosis, using DSM-IV-TR, who also had IELTs or =11 PE. The development and validation of this new PE diagnostic tool has resulted in a new, user-friendly, and brief self-report questionnaire for use in clinical trials to diagnose PE.

A clinical reasoning model focused on clients' behaviour change with reference to physiotherapists: its multiphase development and validation.

Science.gov (United States)

Elvén, Maria; Hochwälder, Jacek; Dean, Elizabeth; Söderlund, Anne

2015-05-01

A biopsychosocial approach and behaviour change strategies have long been proposed to serve as a basis for addressing current multifaceted health problems. This emphasis has implications for clinical reasoning of health professionals. This study's aim was to develop and validate a conceptual model to guide physiotherapists' clinical reasoning focused on clients' behaviour change. Phase 1 consisted of the exploration of existing research and the research team's experiences and knowledge. Phases 2a and 2b consisted of validation and refinement of the model based on input from physiotherapy students in two focus groups (n = 5 per group) and from experts in behavioural medicine (n = 9). Phase 1 generated theoretical and evidence bases for the first version of a model. Phases 2a and 2b established the validity and value of the model. The final model described clinical reasoning focused on clients' behaviour change as a cognitive, reflective, collaborative and iterative process with multiple interrelated levels that included input from the client and physiotherapist, a functional behavioural analysis of the activity-related target behaviour and the selection of strategies for behaviour change. This unique model, theory- and evidence-informed, has been developed to help physiotherapists to apply clinical reasoning systematically in the process of behaviour change with their clients.

Design and validation of a comprehensive fecal incontinence questionnaire.

Science.gov (United States)

Macmillan, Alexandra K; Merrie, Arend E H; Marshall, Roger J; Parry, Bryan R

2008-10-01

Fecal incontinence can have a profound effect on quality of life. Its prevalence remains uncertain because of stigma, lack of consistent definition, and dearth of validated measures. This study was designed to develop a valid clinical and epidemiologic questionnaire, building on current literature and expertise. Patients and experts undertook face validity testing. Construct validity, criterion validity, and test-retest reliability was undertaken. Construct validity comprised factor analysis and internal consistency of the quality of life scale. The validity of known groups was tested against 77 control subjects by using regression models. Questionnaire results were compared with a stool diary for criterion validity. Test-retest reliability was calculated from repeated questionnaire completion. The questionnaire achieved good face validity. It was completed by 104 patients. The quality of life scale had four underlying traits (factor analysis) and high internal consistency (overall Cronbach alpha = 0.97). Patients and control subjects answered the questionnaire significantly differently (P validity testing. Criterion validity assessment found mean differences close to zero. Median reliability for the whole questionnaire was 0.79 (range, 0.35-1). This questionnaire compares favorably with other available instruments, although the interpretation of stool consistency requires further research. Its sensitivity to treatment still needs to be investigated.

Validity and reliability of balance assessment software using the Nintendo Wii balance board: usability and validation.

Science.gov (United States)

Park, Dae-Sung; Lee, GyuChang

2014-06-10

A balance test provides important information such as the standard to judge an individual's functional recovery or make the prediction of falls. The development of a tool for a balance test that is inexpensive and widely available is needed, especially in clinical settings. The Wii Balance Board (WBB) is designed to test balance, but there is little software used in balance tests, and there are few studies on reliability and validity. Thus, we developed a balance assessment software using the Nintendo Wii Balance Board, investigated its reliability and validity, and compared it with a laboratory-grade force platform. Twenty healthy adults participated in our study. The participants participated in the test for inter-rater reliability, intra-rater reliability, and concurrent validity. The tests were performed with balance assessment software using the Nintendo Wii balance board and a laboratory-grade force platform. Data such as Center of Pressure (COP) path length and COP velocity were acquired from the assessment systems. The inter-rater reliability, the intra-rater reliability, and concurrent validity were analyzed by an intraclass correlation coefficient (ICC) value and a standard error of measurement (SEM). The inter-rater reliability (ICC: 0.89-0.79, SEM in path length: 7.14-1.90, SEM in velocity: 0.74-0.07), intra-rater reliability (ICC: 0.92-0.70, SEM in path length: 7.59-2.04, SEM in velocity: 0.80-0.07), and concurrent validity (ICC: 0.87-0.73, SEM in path length: 5.94-0.32, SEM in velocity: 0.62-0.08) were high in terms of COP path length and COP velocity. The balance assessment software incorporating the Nintendo Wii balance board was used in our study and was found to be a reliable assessment device. In clinical settings, the device can be remarkably inexpensive, portable, and convenient for the balance assessment.

Development and validation of Dutch version of Lasater Clinical Judgment Rubric in hospital practice: An instrument design study

NARCIS (Netherlands)

Vreugdenhil, Jettie; Spek, Bea

2017-01-01

Clinical reasoning in patient care is a skill that cannot be observed directly. So far, no reliable, valid instrument exists for the assessment of nursing students' clinical reasoning skills in hospital practice. Lasater's clinical judgment rubric (LCJR), based on Tanner's model "Thinking like a

Validation of the Boston Carpal Tunnel Questionnaire in Russia

Directory of Open Access Journals (Sweden)

D. G. Yusupova

2018-01-01

Full Text Available International scales and questionnaires have become widespread in Russian neurology. Validation is a procedure of top priority necessary before applying this kind of diagnostic instrument in Russian-speaking population. In this article, validation of the Boston Carpal Tunnel Questionnaire (BCTQ intended for patients with this disease is described. Use of validated Russian version would allow to objectively evaluate severity of clinical manifestations of carpal tunnel syndrome and follow patient dynamics. We present the official BCTQ version recommended for use in Russia, as well as data that showed high sensitivity and reliability of this instrument for clinical evaluation of carpal tunnel syndrome.

The Depressive Experiences Questionnaire: validity and psychological correlates in a clinical sample.

Science.gov (United States)

Riley, W T; McCranie, E W

1990-01-01

This study sought to compare the original and revised scoring systems of the Depressive Experiences Questionnaire (DEQ) and to assess the construct validity of the Dependent and Self-Critical subscales of the DEQ in a clinically depressed sample. Subjects were 103 depressed inpatients who completed the DEQ, the Beck Depression Inventory (BDI), the Hopelessness Scale, the Automatic Thoughts Questionnaire (ATQ), the Rathus Assertiveness Schedule (RAS), and the Minnesota Multiphasic Personality Inventory (MMPI). The original and revised scoring systems of the DEQ evidenced good concurrent validity for each factor scale, but the revised system did not sufficiently discriminate dependent and self-critical dimensions. Using the original scoring system, self-criticism was significantly and positively related to severity of depression, whereas dependency was not, particularly for males. Factor analysis of the DEQ scales and the other scales used in this study supported the dependent and self-critical dimensions. For men, the correlation of the DEQ with the MMPI scales indicated that self-criticism was associated with psychotic symptoms, hostility/conflict, and a distress/exaggerated response set, whereas dependency did not correlate significantly with any MMPI scales. Females, however, did not exhibit a differential pattern of correlations between either the Dependency or the Self-Criticism scales and the MMPI. These findings suggest possible gender differences in the clinical characteristics of male and female dependent and self-critical depressive subtypes.

Clinical validation of a quality of life questionnaire in angina pectoris patients.

Science.gov (United States)

Marquis, P; Fayol, C; Joire, J E

1995-11-01

Angina pectoris impairs patients' quality of life. In order to assess its impact on quality of life, a questionnaire was developed using a literature review and interviews with patients and clinicians. It consisted of a general profile (SF-36) which measured functional status, well-being, perceived health, and a specific index, the Angina Pectoris Quality of Life Questionnaire, supplemented by new items. The acceptability, internal consistency reliability and clinical validity of this 70-item questionnaire were analysed in a cross-sectional study. Of 197 coronary patients approached, 93% (n = 184) agreed to participate and 86% (n = 170) returned the mailed questionnaire. Mean age of patients was 67 years (+/- 10); 79% were male and 70% were retired. Sixty patients were asymptomatic and 110 reported anginal crises (Canadian Cardiovascular Society Classification: class I: 48; II: 37; III: 13; IV: 0; V: 12). Globally, angina pectoris was found to affect each quality of life concept measured: physical functioning, well-being, and perceived health. Quality of life profiles worsened in accordance with increasing severity of the condition, as stratified by angina pectoris class. Asymptomatic patients reported better general and specific profiles. These results support the feasibility and usefulness of evaluating quality of life using the questionnaire. The validation of the data is very encouraging and enables the questionnaire to be used in clinical trials.

Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study.

Science.gov (United States)

Jeon, Yun-Hee; Conway, Jane; Chenoweth, Lynn; Weise, Janelle; Thomas, Tamsin Ht; Williams, Anna

2015-04-01

To establish validity of a clinical leadership framework for aged care middle managers (The Aged care Clinical Leadership Qualities Framework). Middle managers in aged care have responsibility not only for organisational governance also and operational management but also quality service delivery. There is a need to better define clinical leadership abilities in aged care middle managers, in order to optimise their positional authority to lead others to achieve quality outcomes. A Delphi method. Sixty-nine experts in aged care were recruited, representing rural, remote and metropolitan community and residential aged care settings. Panellists were asked to rate the proposed framework in terms of the relevance and importance of each leadership quality using four-point Likert scales, and to provide comments. Three rounds of consultation were conducted. The number and corresponding percentage of the relevance and importance rating for each quality was calculated for each consultation round, as well as mean scores. Consensus was determined to be reached when a percentage score reached 70% or greater. Twenty-three panellists completed all three rounds of consultation. Following the three rounds of consultation, the acceptability and face validity of the framework was confirmed. The study confirmed the framework as useful in identifying leadership requirements for middle managers in Australian aged care settings. The framework is the first validated framework of clinical leadership attributes for middle managers in aged care and offers an initial step forward in clarifying the aged care middle manager role. The framework provides clarity in the breadth of role expectations for the middle managers and can be used to inform an aged care specific leadership program development, individuals' and organisations' performance and development processes; and policy and guidelines about the types of activities required of middle managers in aged care. © 2014 John Wiley & Sons Ltd.

Using wound care algorithms: a content validation study.

Science.gov (United States)

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Development and validation of receptor occupancy pharmacodynamic assays used in the clinical development of the monoclonal antibody vedolizumab.

Science.gov (United States)

Wyant, Tim; Estevam, Jose; Yang, Lili; Rosario, Maria

2016-03-01

Vedolizumab is a monoclonal antibody approved for use in ulcerative colitis and Crohn's disease. By specifically binding to α4 β7 integrin, vedolizumab prevents trafficking of lymphocytes to the gut, thereby interfering with disease pathology. During the clinical development program, the pharmacodynamic effect of vedolizumab was evaluated by 2 flow cytometry receptor occupancy assays: act-1 (ACT-1) and mucosal addressin cell adhesion molecule-1 (MAdCAM-1). Here we describe the development and validation of these assays. The ACT-1 assay is a receptor occupancy free-site assay that uses a monoclonal antibody with the same binding epitope as vedolizumab to detect free (unbound) sites on α4 β7 integrin. The MAdCAM-1 assay used a soluble version of the natural ligand for α4 β7 integrin to detect free sites. The assays were validated using a fit-for-purpose approach throughout the clinical development of vedolizumab. Both the ACT-1 assay and the MAdCAM-1 assay demonstrated acceptable reproducibility and repeatability. The assays were sufficiently stable to allow for clinical use. During clinical testing the assays demonstrated that vedolizumab was able to saturate peripheral cells at all doses tested. Two pharmacodynamic receptor occupancy assays were developed and validated to assess the effect of vedolizumab on peripheral blood cells. The results of these assays demonstrated the practical use of flow cytometry to examine pharmacodynamic response in clinical trials. © 2015 International Clinical Cytometry Society.

Clinical validity of a disease-specific health status questionnaire: the peripheral artery questionnaire.

Science.gov (United States)

Hoeks, Sanne E; Smolderen, Kim G; Scholte Op Reimer, Wilma J M; Verhagen, Hence J M; Spertus, John A; Poldermans, Don

2009-02-01

Measuring patient-centered outcomes is becoming increasingly important in patients with peripheral arterial disease (PAD), both as a means of determining the benefits of treatment and as an aid for disease management. In order to monitor health status in a reliable and sensitive way, the disease-specific measure Peripheral Artery Questionnaire (PAQ) was developed. However, to date, its correlation with traditional clinical indices is unknown. The primary aim of this study was to better establish the clinical validity of the PAQ by examining its association with functional indices related to PAD. Furthermore, we hypothesized that the clinical validity of this disease-specific measure is better as compared with the EuroQol-5-dimensional (EQ-5D), a standardized generic instrument. Data on 711 consecutive PAD patients undergoing surgery were collected from 11 Dutch hospitals in 2004. At 3-year follow-up, questionnaires including the PAQ, EQ-5D, and EuroQol-Visual Analogue Scale (EQ VAS) were completed in 84% of survivors. The PAQ was analyzed according to three domains, as established by a factor analyses in the Dutch population, and the summary score. Baseline clinical indices included the presence and severity of claudication intermittent (CI) and the Lee Cardiac Risk Index. All three PAQ domains (Physical Function, Perceived Disability, and Treatment Satisfaction) were significantly associated with CI symptoms (P values PAQ summary scores as compared with asymptomatic patients (58.6 +/- 27.8 vs 68.6 +/- 27.8, P = PAQ summary score and the subscale scores for Physical Functioning and Perceived Disability demonstrated a clear dose-response relation for walking distance and the Lee Risk Index (P values PAQ proved to be good as the PAQ subscales discriminated well between patients with or without symptomatic PAD and its severity as defined by walking distance. Furthermore, the PAQ subscales were directly proportional to the presence and number of risk factors relevant

Validity of the Danish Prostate Symptom Score questionnaire in stroke

DEFF Research Database (Denmark)

Tibaek, S.; Dehlendorff, Christian

2009-01-01

Objective – To determine the content and face validity of the Danish Prostate Symptom Score (DAN-PSS-1) questionnaire in stroke patients. Materials and methods – Content validity was judged among an expert panel in neuro-urology. The judgement was measured by the content validity index (CVI). Face...... validity was indicated in a clinical sample of 482 stroke patients in a hospital-based, cross-sectional survey. Results – I-CVI was rated >0.78 (range 0.94–1.00) for 75% of symptom and bother items corresponding to adequate content validity. The expert panel rated the entire DAN-PSS-1 questionnaire highly...... questionnaire appears to be content and face valid for measuring lower urinary tract symptoms after stroke....

Italian Validation of Homophobia Scale (HS

Directory of Open Access Journals (Sweden)

Giacomo Ciocca, PsyD, PhD

2015-09-01

Conclusions: The Italian validation of the HS revealed the use of this self‐report test to have good psychometric properties. This study offers a new tool to assess homophobia. In this regard, the HS can be introduced into the clinical praxis and into programs for the prevention of homophobic behavior. Ciocca G, Capuano N, Tuziak B, Mollaioli D, Limoncin E, Valsecchi D, Carosa E, Gravina GL, Gianfrilli D, Lenzi A, and Jannini EA. Italian validation of Homophobia Scale (HS. Sex Med 2015;3:213–218.

Cross-cultural validation of Lupus Impact Tracker in five European clinical practice settings.

Science.gov (United States)

Schneider, Matthias; Mosca, Marta; Pego-Reigosa, José-Maria; Gunnarsson, Iva; Maurel, Frédérique; Garofano, Anna; Perna, Alessandra; Porcasi, Rolando; Devilliers, Hervé

2017-05-01

The aim was to evaluate the cross-cultural validity of the Lupus Impact Tracker (LIT) in five European countries and to assess its acceptability and feasibility from the patient and physician perspectives. A prospective, observational, cross-sectional and multicentre validation study was conducted in clinical settings. Before the visit, patients completed LIT, Short Form 36 (SF-36) and care satisfaction questionnaires. During the visit, physicians assessed disease activity [Safety of Estrogens in Lupus Erythematosus National Assessment (SELENA)-SLEDAI], organ damage [SLICC/ACR damage index (SDI)] and flare occurrence. Cross-cultural validity was assessed using the Differential Item Functioning method. Five hundred and sixty-nine SLE patients were included by 25 specialists; 91.7% were outpatients and 89.9% female, with mean age 43.5 (13.0) years. Disease profile was as follows: 18.3% experienced flares; mean SELENA-SLEDAI score 3.4 (4.5); mean SDI score 0.8 (1.4); and SF-36 mean physical and mental component summary scores: physical component summary 42.8 (10.8) and mental component summary 43.0 (12.3). Mean LIT score was 34.2 (22.3) (median: 32.5), indicating that lupus moderately impacted patients' daily life. A cultural Differential Item Functioning of negligible magnitude was detected across countries (pseudo- R 2 difference of 0.01-0.04). Differences were observed between LIT scores and Physician Global Assessment, SELENA-SLEDAI, SDI scores = 0 (P cultural invariability across countries. They suggest that LIT can be used in routine clinical practice to evaluate and follow patient-reported outcomes in order to improve patient-physician interaction. © The Author 2017. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Spanish translation and cross-language validation of a sleep habits questionnaire for use in clinical and research settings.

Science.gov (United States)

Baldwin, Carol M; Choi, Myunghan; McClain, Darya Bonds; Celaya, Alma; Quan, Stuart F

2012-04-15

To translate, back-translate and cross-language validate (English/Spanish) the Sleep Heart Health Study Sleep Habits Questionnaire for use with Spanish-speakers in clinical and research settings. Following rigorous translation and back-translation, this cross-sectional cross-language validation study recruited bilingual participants from academic, clinic, and community-based settings (N = 50; 52% women; mean age 38.8 ± 12 years; 90% of Mexican heritage). Participants completed English and Spanish versions of the Sleep Habits Questionnaire, the Epworth Sleepiness Scale, and the Acculturation Rating Scale for Mexican Americans II one week apart in randomized order. Psychometric properties were assessed, including internal consistency, convergent validity, scale equivalence, language version intercorrelations, and exploratory factor analysis using PASW (Version18) software. Grade level readability of the sleep measure was evaluated. All sleep categories (duration, snoring, apnea, insomnia symptoms, other sleep symptoms, sleep disruptors, restless legs syndrome) showed Cronbach α, Spearman-Brown coefficients and intercorrelations ≥ 0.700, suggesting robust internal consistency, correlation, and agreement between language versions. The Epworth correlated significantly with snoring, apnea, sleep symptoms, restless legs, and sleep disruptors) on both versions, supporting convergent validity. Items loaded on 4 factors accounted for 68% and 67% of the variance on the English and Spanish versions, respectively. The Spanish-language Sleep Habits Questionnaire demonstrates conceptual and content equivalency. It has appropriate measurement properties and should be useful for assessing sleep health in community-based clinics and intervention studies among Spanish-speaking Mexican Americans. Both language versions showed readability at the fifth grade level. Further testing is needed with larger samples.

Clinical validation of a body-fixed 3D accelerometer and algorithm for activity monitoring in orthopaedic patients

Directory of Open Access Journals (Sweden)

Matthijs Lipperts

2017-10-01

Conclusion: Activity monitoring of orthopaedic patients by counting and timing a large set of relevant daily life events is feasible in a user- and patient-friendly way and at high clinical validity using a generic three-dimensional accelerometer and algorithms based on empirical and physical methods. The algorithms performed well for healthy individuals as well as patients recovering after total joint replacement in a challenging validation set-up. With such a simple and transparent method real-life activity parameters can be collected in orthopaedic practice for diagnostics, treatments, outcome assessment, or biofeedback.

Validation of assessment of intraoral digital photography for evaluation of dental restorations in clinical research.

Science.gov (United States)

Signori, Cácia; Collares, Kauê; Cumerlato, Catarina B F; Correa, Marcos B; Opdam, Niek J M; Cenci, Maximiliano S

2018-04-01

The aim of this study was to investigate the validity of assessment of intraoral digital photography in the evaluation of dental restorations. Intraoral photographs of anterior and posterior restorations were classified based on FDI criteria according to the need for intervention: no intervention, repair and replacement. Evaluations were performed by an experienced expert in restorative dentistry (gold standard evaluator) and 3 trained dentists (consensus). The clinical inspection was the reference standard method. The prevalence of failures was explored. Cohen's kappa statistic was used. Validity was accessed by sensitivity, specificity, likelihood ratio and predictives values. Higher prevalence of failed restorations intervention was identified by the intraoral photography (17.7%) in comparison to the clinical evaluation (14.1%). Moderate agreement in the diagnosis of total failures was shown between the methods for the gold standard evaluator (kappa = 0.51) and consensus of evaluators (kappa = 0.53). Gold standard evaluator and consensus showed substantial and moderate agreement for posterior restorations (kappa = 0.61; 0.59), and fair and moderate agreement for anterior restorations (kappa = 0.36; 0.43), respectively. The accuracy was 84.8% in the assessment by intraoral photographs. Sensitivity and specificity values of 87.5% and 89.3% were found. Under the limits of this study, the assessment of digital photography performed by intraoral camera is an indirect diagnostic method valid for the evaluation of dental restorations, mainly in posterior teeth. This method should be employed taking into account the higher detection of defects provided by the images, which are not always clinically relevant. Copyright © 2018 Elsevier Ltd. All rights reserved.

[Multicenter validation of an evaluation tool for clinical training activities (SVAT) of the nursing students].

Science.gov (United States)

Finotto, Sergio; Gradellini, Cinzia; Bandini, Stefania; Burrai, Francesco; Lucchi Casadei, Sandra; Villani, Carolina; Vincenzi, Simone; Mecugni, Daniela

2017-01-01

To evaluate the psychometric characteristics of the Scheda di Valutazione delle Attività di Tirocinio (SVAT). The degree courses in Nursing of the University of Modena and Reggio Emilia, site of Reggio Emilia, the University of Bologna Formative Section BO1, Imola and training center of Cesena, the University of Ferrara training centers of Ferrara and Codigoro were all enrolled in the research. For the content validation the reactive Delphi method was chosen. The panel of experts expressed a qualitative-intuitive judgment on the adequacy of language and on the stimulus material (SVAT). For internal consistency Cronbach's alpha was calculated the. The test-retest method was used for the reliability of stability. all indicators of the SVAT have achieved a degree of consensus not less than 80% demonstrating its content validity. The face validity is demonstrated by an average score equal to or greater than 7 obtained by all indicators. The reliability of internal consistency of the SVAT was appraised by Cronbach's alpha that was 0.987 for the entire instrument. The reliability of the stability has been calculated through the correlation's coefficient expressed by Pearson's r that was 0.983 (p = 1.3E-198). in Italy there is no a "gold standard" tool to evaluate the clinical performance of nursing students during and at the end of their clinical training. The SVAT proves to be a valuable and reliable tool it furthermore could stimulate the discussion and the debate among educators and nurses, so that also in our country, it may be possible develop and refine tools that support the evaluation of clinical skills of nursing students.

Validation of the presence of comorbidities in a Danish clinical cohort of children with tourette syndrome

DEFF Research Database (Denmark)

Debes, N.M.M.M.; Hjalgrim, H.; Skov, L.

2008-01-01

attacks, Sleeping disturbances, and depressive Symptoms in a Danish clinical cohort of 314 children with TS using Validated diagnostic instruments. For the assessment of symptoms of seasonal affective disorder and Stuttering, WC Used a nonvalidated systematic interview. In total, only 10...

Using digital photography in a clinical setting: a valid, accurate, and applicable method to assess food intake.

Science.gov (United States)

Winzer, Eva; Luger, Maria; Schindler, Karin

2018-06-01

Regular monitoring of food intake is hardly integrated in clinical routine. Therefore, the aim was to examine the validity, accuracy, and applicability of an appropriate and also quick and easy-to-use tool for recording food intake in a clinical setting. Two digital photography methods, the postMeal method with a picture after the meal, the pre-postMeal method with a picture before and after the meal, and the visual estimation method (plate diagram; PD) were compared against the reference method (weighed food records; WFR). A total of 420 dishes from lunch (7 weeks) were estimated with both photography methods and the visual method. Validity, applicability, accuracy, and precision of the estimation methods, and additionally food waste, macronutrient composition, and energy content were examined. Tests of validity revealed stronger correlations for photography methods (postMeal: r = 0.971, p < 0.001; pre-postMeal: r = 0.995, p < 0.001) compared to the visual estimation method (r = 0.810; p < 0.001). The pre-postMeal method showed smaller variability (bias < 1 g) and also smaller overestimation and underestimation. This method accurately and precisely estimated portion sizes in all food items. Furthermore, the total food waste was 22% for lunch over the study period. The highest food waste was observed in salads and the lowest in desserts. The pre-postMeal digital photography method is valid, accurate, and applicable in monitoring food intake in clinical setting, which enables a quantitative and qualitative dietary assessment. Thus, nutritional care might be initiated earlier. This method might be also advantageous for quantitative and qualitative evaluation of food waste, with a resultantly reduction in costs.

Validity of clinical outcome measures to evaluate ankle range of motion during the weight-bearing lunge test.

Science.gov (United States)

Hall, Emily A; Docherty, Carrie L

2017-07-01

To determine the concurrent validity of standard clinical outcome measures compared to laboratory outcome measure while performing the weight-bearing lunge test (WBLT). Cross-sectional study. Fifty participants performed the WBLT to determine dorsiflexion ROM using four different measurement techniques: dorsiflexion angle with digital inclinometer at 15cm distal to the tibial tuberosity (°), dorsiflexion angle with inclinometer at tibial tuberosity (°), maximum lunge distance (cm), and dorsiflexion angle using a 2D motion capture system (°). Outcome measures were recorded concurrently during each trial. To establish concurrent validity, Pearson product-moment correlation coefficients (r) were conducted, comparing each dependent variable to the 2D motion capture analysis (identified as the reference standard). A higher correlation indicates strong concurrent validity. There was a high correlation between each measurement technique and the reference standard. Specifically the correlation between the inclinometer placement at 15cm below the tibial tuberosity (44.9°±5.5°) and the motion capture angle (27.0°±6.0°) was r=0.76 (p=0.001), between the inclinometer placement at the tibial tuberosity angle (39.0°±4.6°) and the motion capture angle was r=0.71 (p=0.001), and between the distance from the wall clinical measure (10.3±3.0cm) to the motion capture angle was r=0.74 (p=0.001). This study determined that the clinical measures used during the WBLT have a high correlation with the reference standard for assessing dorsiflexion range of motion. Therefore, obtaining maximum lunge distance and inclinometer angles are both valid assessments during the weight-bearing lunge test. Copyright © 2016 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

The Air Force Mobile Forward Surgical Team (MFST): Using the Estimating Supplies Program to Validate Clinical Requirement

National Research Council Canada - National Science Library

Nix, Ralph E; Onofrio, Kathleen; Konoske, Paula J; Galarneau, Mike R; Hill, Martin

2004-01-01

.... The primary objective of the study was to provide the Air Force with the ability to validate clinical requirements of the MFST assemblage, with the goal of using NHRC's Estimating Supplies Program (ESP...

The Reliability and Validity of the Outcome Rating Scale: A Replication Study of a Brief Clinical Measure

National Research Council Canada - National Science Library

Bringhurst, David L; Watson, Curtis W; Miller, Scott D; Duncan, Barry L

2004-01-01

... (Miller, Duncan, Brown, Sparks, AND Claud, 2003). This article reports the findings of an independent replication study evaluating the reliability and concurrent validity of the ORS as studied in a non-clinical sample...

Anxiety measures validated in perinatal populations: a systematic review.

Science.gov (United States)

Meades, Rose; Ayers, Susan

2011-09-01

Research and screening of anxiety in the perinatal period is hampered by a lack of psychometric data on self-report anxiety measures used in perinatal populations. This paper aimed to review self-report measures that have been validated with perinatal women. A systematic search was carried out of four electronic databases. Additional papers were obtained through searching identified articles. Thirty studies were identified that reported validation of an anxiety measure with perinatal women. Most commonly validated self-report measures were the General Health Questionnaire (GHQ), State-Trait Anxiety Inventory (STAI), and Hospital Anxiety and Depression Scales (HADS). Of the 30 studies included, 11 used a clinical interview to provide criterion validity. Remaining studies reported one or more other forms of validity (factorial, discriminant, concurrent and predictive) or reliability. The STAI shows criterion, discriminant and predictive validity and may be most useful for research purposes as a specific measure of anxiety. The Kessler 10 (K-10) may be the best short screening measure due to its ability to differentiate anxiety disorders. The Depression Anxiety Stress Scales 21 (DASS-21) measures multiple types of distress, shows appropriate content, and remains to be validated against clinical interview in perinatal populations. Nineteen studies did not report sensitivity or specificity data. The early stages of research into perinatal anxiety, the multitude of measures in use, and methodological differences restrict comparison of measures across studies. There is a need for further validation of self-report measures of anxiety in the perinatal period to enable accurate screening and detection of anxiety symptoms and disorders. Copyright © 2010 Elsevier B.V. All rights reserved.

Validation of the "United Registries for Clinical Assessment and Research" (UR-CARE), a European online registry for clinical care and research in Inflammatory Bowel Disease

DEFF Research Database (Denmark)

Burisch, Johan; Gisbert, Javier P; Siegmund, Britta

2018-01-01

Background: The "United Registries for Clinical Assessment and Research" (UR-CARE) database is an initiative of the European Crohn's and Colitis Organisation (ECCO) to facilitate daily patient care and research studies in inflammatory bowel disease (IBD). Herein, we sought to validate the database......-99%); Case 5: 91% (87-93%)]. These numbers did not differ significantly from those found 6 weeks later (NcNemar's test p>0.05). Conclusion: The UR-CARE database appears to be feasible, valid and reliable as a tool and easy to use regardless of prior user experience and level of clinical IBD experience. UR......-CARE has the potential to enhance future European collaborations regarding clinical research in IBD....

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations

NARCIS (Netherlands)

Boerboom, T. B. B.; Dolmans, D. H. J. M.; Jaarsma, Debbie; Muijtjens, A. M. M.; Van Beukelen, P.; Scherpbier, A. J. J. A.; Jaarsma, Debbie

2011-01-01

Background: Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. Aim: We examined the validity and reliability of the

Diagnosis of TIA (DOT) score--design and validation of a new clinical diagnostic tool for transient ischaemic attack.

Science.gov (United States)

Dutta, Dipankar

2016-02-09

The diagnosis of Transient Ischaemic Attack (TIA) can be difficult and 50-60% of patients seen in TIA clinics turn out to be mimics. Many of these mimics have high ABCD2 scores and fill urgent TIA clinic slots inappropriately. A TIA diagnostic tool may help non-specialists make the diagnosis with greater accuracy and improve TIA clinic triage. The only available diagnostic score (Dawson et al) is limited in scope and not widely used. The Diagnosis of TIA (DOT) Score is a new and internally validated web and mobile app based diagnostic tool which encompasses both brain and retinal TIA. The score was derived retrospectively from a single centre TIA clinic database using stepwise logistic regression by backwards elimination to find the best model. An optimum cutpoint was obtained for the score. The derivation and validation cohorts were separate samples drawn from the years 2010/12 and 2013 respectively. Receiver Operating Characteristic (ROC) curves and area under the curve (AUC) were calculated and the diagnostic accuracy of DOT was compared to the Dawson score. A web and smartphone calculator were designed subsequently. The derivation cohort had 879 patients and the validation cohort 525. The final model had seventeen predictors and had an AUC of 0.91 (95% CI: 0.89-0.93). When tested on the validation cohort, the AUC for DOTS was 0.89 (0.86-0.92) while that of the Dawson score was 0.77 (0.73-0.81). The sensitivity and specificity of the DOT score were 89% (CI: 84%-93%) and 76% (70%-81%) respectively while those of the Dawson score were 83% (78%-88%) and 51% (45%-57%). Other diagnostic accuracy measures (DOT vs. Dawson) include positive predictive values (75% vs. 58%), negative predictive values (89% vs. 79%), positive likelihood ratios (3.67 vs. 1.70) and negative likelihood ratios (0.15 vs. 0.32). The DOT score shows promise as a diagnostic tool for TIA and requires independent external validation before it can be widely used. It could potentially improve the

Principles of Proper Validation

DEFF Research Database (Denmark)

Esbensen, Kim; Geladi, Paul

2010-01-01

to suffer from the same deficiencies. The PPV are universal and can be applied to all situations in which the assessment of performance is desired: prediction-, classification-, time series forecasting-, modeling validation. The key element of PPV is the Theory of Sampling (TOS), which allow insight......) is critically necessary for the inclusion of the sampling errors incurred in all 'future' situations in which the validated model must perform. Logically, therefore, all one data set re-sampling approaches for validation, especially cross-validation and leverage-corrected validation, should be terminated...

Validation and Clinical Evaluation of a Novel Method To Measure Miltefosine in Leishmaniasis Patients Using Dried Blood Spot Sample Collection

Science.gov (United States)

Rosing, H.; Hillebrand, M. J. X.; Blesson, S.; Mengesha, B.; Diro, E.; Hailu, A.; Schellens, J. H. M.; Beijnen, J. H.

2016-01-01

To facilitate future pharmacokinetic studies of combination treatments against leishmaniasis in remote regions in which the disease is endemic, a simple cheap sampling method is required for miltefosine quantification. The aims of this study were to validate a liquid chromatography-tandem mass spectrometry method to quantify miltefosine in dried blood spot (DBS) samples and to validate its use with Ethiopian patients with visceral leishmaniasis (VL). Since hematocrit (Ht) levels are typically severely decreased in VL patients, returning to normal during treatment, the method was evaluated over a range of clinically relevant Ht values. Miltefosine was extracted from DBS samples using a simple method of pretreatment with methanol, resulting in >97% recovery. The method was validated over a calibration range of 10 to 2,000 ng/ml, and accuracy and precision were within ±11.2% and ≤7.0% (≤19.1% at the lower limit of quantification), respectively. The method was accurate and precise for blood spot volumes between 10 and 30 μl and for Ht levels of 20 to 35%, although a linear effect of Ht levels on miltefosine quantification was observed in the bioanalytical validation. DBS samples were stable for at least 162 days at 37°C. Clinical validation of the method using paired DBS and plasma samples from 16 VL patients showed a median observed DBS/plasma miltefosine concentration ratio of 0.99, with good correlation (Pearson's r = 0.946). Correcting for patient-specific Ht levels did not further improve the concordance between the sampling methods. This successfully validated method to quantify miltefosine in DBS samples was demonstrated to be a valid and practical alternative to venous blood sampling that can be applied in future miltefosine pharmacokinetic studies with leishmaniasis patients, without Ht correction. PMID:26787691

The Danish anal sphincter rupture questionnaire: Validity and reliability

DEFF Research Database (Denmark)

Due, Ulla; Ottesen, Marianne

2008-01-01

Objective. To revise, validate and test for reliability an anal sphincter rupture questionnaire in relation to construct, content and face validity. Setting and background. Since 1996 women with anal sphincter rupture (ASR) at one of the public university hospitals in Copenhagen, Denmark have been...... main questions but one. Two questions needed further explanation. Seven women made minor errors. Conclusion. The validated Danish questionnaire has a good construct, content and face validity. It is a well accepted, reliable, simple and clinically relevant screening tool. It reveals physical problems...... offered pelvic floor muscle examination and instruction by a specialist physiotherapist. In relation to that, a non-validated questionnaire about anal and urinary incontinence was to be answered six months after childbirth. Method. The original questionnaire was revised and a pilot test was performed...

A simplified approach to the pooled analysis of calibration of clinical prediction rules for systematic reviews of validation studies

Directory of Open Access Journals (Sweden)

Dimitrov BD

2015-04-01

Full Text Available Borislav D Dimitrov,1,2 Nicola Motterlini,2,† Tom Fahey2 1Academic Unit of Primary Care and Population Sciences, University of Southampton, Southampton, United Kingdom; 2HRB Centre for Primary Care Research, Department of General Medicine, Division of Population Health Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland †Nicola Motterlini passed away on November 11, 2012 Objective: Estimating calibration performance of clinical prediction rules (CPRs in systematic reviews of validation studies is not possible when predicted values are neither published nor accessible or sufficient or no individual participant or patient data are available. Our aims were to describe a simplified approach for outcomes prediction and calibration assessment and evaluate its functionality and validity. Study design and methods: Methodological study of systematic reviews of validation studies of CPRs: a ABCD2 rule for prediction of 7 day stroke; and b CRB-65 rule for prediction of 30 day mortality. Predicted outcomes in a sample validation study were computed by CPR distribution patterns (“derivation model”. As confirmation, a logistic regression model (with derivation study coefficients was applied to CPR-based dummy variables in the validation study. Meta-analysis of validation studies provided pooled estimates of “predicted:observed” risk ratios (RRs, 95% confidence intervals (CIs, and indexes of heterogeneity (I2 on forest plots (fixed and random effects models, with and without adjustment of intercepts. The above approach was also applied to the CRB-65 rule. Results: Our simplified method, applied to ABCD2 rule in three risk strata (low, 0–3; intermediate, 4–5; high, 6–7 points, indicated that predictions are identical to those computed by univariate, CPR-based logistic regression model. Discrimination was good (c-statistics =0.61–0.82, however, calibration in some studies was low. In such cases with miscalibration, the under

Assessing decentering: validation, psychometric properties, and clinical usefulness of the Experiences Questionnaire in a Spanish sample.

Science.gov (United States)

Soler, Joaquim; Franquesa, Alba; Feliu-Soler, Albert; Cebolla, Ausias; García-Campayo, Javier; Tejedor, Rosa; Demarzo, Marcelo; Baños, Rosa; Pascual, Juan Carlos; Portella, Maria J

2014-11-01

Decentering is defined as the ability to observe one's thoughts and feelings in a detached manner. The Experiences Questionnaire (EQ) is a self-report instrument that originally assessed decentering and rumination. The purpose of this study was to evaluate the psychometric properties of the Spanish version of EQ-Decentering and to explore its clinical usefulness. The 11-item EQ-Decentering subscale was translated into Spanish and psychometric properties were examined in a sample of 921 adult individuals, 231 with psychiatric disorders and 690 without. The subsample of nonpsychiatric participants was also split according to their previous meditative experience (meditative participants, n=341; and nonmeditative participants, n=349). Additionally, differences among these three subgroups were explored to determine clinical validity of the scale. Finally, EQ-Decentering was administered twice in a group of borderline personality disorder, before and after a 10-week mindfulness intervention. Confirmatory factor analysis indicated acceptable model fit, sbχ(2)=243.8836 (p.46; and divergent validity: r<-.35). The scale detected changes in decentering after a 10-session intervention in mindfulness (t=-4.692, p<.00001). Differences among groups were significant (F=134.8, p<.000001), where psychiatric participants showed the lowest scores compared to nonpsychiatric meditative and nonmeditative participants. The Spanish version of the EQ-Decentering is a valid and reliable instrument to assess decentering either in clinical and nonclinical samples. In addition, the findings show that EQ-Decentering seems an adequate outcome instrument to detect changes after mindfulness-based interventions. Copyright © 2014. Published by Elsevier Ltd.

Further examination of embedded performance validity indicators for the Conners' Continuous Performance Test and Brief Test of Attention in a large outpatient clinical sample.

Science.gov (United States)

Sharland, Michael J; Waring, Stephen C; Johnson, Brian P; Taran, Allise M; Rusin, Travis A; Pattock, Andrew M; Palcher, Jeanette A

2018-01-01

Assessing test performance validity is a standard clinical practice and although studies have examined the utility of cognitive/memory measures, few have examined attention measures as indicators of performance validity beyond the Reliable Digit Span. The current study further investigates the classification probability of embedded Performance Validity Tests (PVTs) within the Brief Test of Attention (BTA) and the Conners' Continuous Performance Test (CPT-II), in a large clinical sample. This was a retrospective study of 615 patients consecutively referred for comprehensive outpatient neuropsychological evaluation. Non-credible performance was defined two ways: failure on one or more PVTs and failure on two or more PVTs. Classification probability of the BTA and CPT-II into non-credible groups was assessed. Sensitivity, specificity, positive predictive value, and negative predictive value were derived to identify clinically relevant cut-off scores. When using failure on two or more PVTs as the indicator for non-credible responding compared to failure on one or more PVTs, highest classification probability, or area under the curve (AUC), was achieved by the BTA (AUC = .87 vs. .79). CPT-II Omission, Commission, and Total Errors exhibited higher classification probability as well. Overall, these findings corroborate previous findings, extending them to a large clinical sample. BTA and CPT-II are useful embedded performance validity indicators within a clinical battery but should not be used in isolation without other performance validity indicators.

Measurement of glomerular filtration rate by impulse synthesis: Clinical validation and optimization

International Nuclear Information System (INIS)

Palagi, B.; Verga, P.; Broggi, A.; Picozzi, R.; Villa, F.; Guzzini, F.; Cozzi, C.; Tomasi, A.

1988-01-01

Impulse synthesis is a technique which relies upon the logic of continuous infusion but extracts the clearance value from single-injection data by shifting and adding them until an asymptotic value is attained. This study has been aimed at validating and optimizing clinically the measurement of glomerular filtration rate by impulse synthesis. A single intravenous injection of 51 Cr-EDTA has been made in 32 patients and plasma activity monitored over the next 6 h. Glomerular filtration rate computed by a single-exponential fit method (GFR-SEF) has been shown to be significantly (p [de

Official Position of the American Academy of Clinical Neuropsychology Social Security Administration Policy on Validity Testing: Guidance and Recommendations for Change.

Science.gov (United States)

Chafetz, M D; Williams, M A; Ben-Porath, Y S; Bianchini, K J; Boone, K B; Kirkwood, M W; Larrabee, G J; Ord, J S

2015-01-01

The milestone publication by Slick, Sherman, and Iverson (1999) of criteria for determining malingered neurocognitive dysfunction led to extensive research on validity testing. Position statements by the National Academy of Neuropsychology and the American Academy of Clinical Neuropsychology (AACN) recommended routine validity testing in neuropsychological evaluations. Despite this widespread scientific and professional support, the Social Security Administration (SSA) continued to discourage validity testing, a stance that led to a congressional initiative for SSA to reevaluate their position. In response, SSA commissioned the Institute of Medicine (IOM) to evaluate the science concerning the validation of psychological testing. The IOM concluded that validity assessment was necessary in psychological and neuropsychological examinations (IOM, 2015 ). The AACN sought to provide independent expert guidance and recommendations concerning the use of validity testing in disability determinations. A panel of contributors to the science of validity testing and its application to the disability process was charged with describing why the disability process for SSA needs improvement, and indicating the necessity for validity testing in disability exams. This work showed how the determination of malingering is a probability proposition, described how different types of validity tests are appropriate, provided evidence concerning non-credible findings in children and low-functioning individuals, and discussed the appropriate evaluation of pain disorders typically seen outside of mental consultations. A scientific plan for validity assessment that additionally protects test security is needed in disability determinations and in research on classification accuracy of disability decisions.

Content validity and its estimation

Directory of Open Access Journals (Sweden)

Yaghmale F

2003-04-01

Full Text Available Background: Measuring content validity of instruments are important. This type of validity can help to ensure construct validity and give confidence to the readers and researchers about instruments. content validity refers to the degree that the instrument covers the content that it is supposed to measure. For content validity two judgments are necessary: the measurable extent of each item for defining the traits and the set of items that represents all aspects of the traits. Purpose: To develop a content valid scale for assessing experience with computer usage. Methods: First a review of 2 volumes of International Journal of Nursing Studies, was conducted with onlyI article out of 13 which documented content validity did so by a 4-point content validity index (CV! and the judgment of 3 experts. Then a scale with 38 items was developed. The experts were asked to rate each item based on relevance, clarity, simplicity and ambiguity on the four-point scale. Content Validity Index (CVI for each item was determined. Result: Of 38 items, those with CVIover 0.75 remained and the rest were discarded reSulting to 25-item scale. Conclusion: Although documenting content validity of an instrument may seem expensive in terms of time and human resources, its importance warrants greater attention when a valid assessment instrument is to be developed. Keywords: Content Validity, Measuring Content Validity

[Validation of interaction databases in psychopharmacotherapy].

Science.gov (United States)

Hahn, M; Roll, S C

2018-03-01

Drug-drug interaction databases are an important tool to increase drug safety in polypharmacy. There are several drug interaction databases available but it is unclear which one shows the best results and therefore increases safety for the user of the databases and the patients. So far, there has been no validation of German drug interaction databases. Validation of German drug interaction databases regarding the number of hits, mechanisms of drug interaction, references, clinical advice, and severity of the interaction. A total of 36 drug interactions which were published in the last 3-5 years were checked in 5 different databases. Besides the number of hits, it was also documented if the mechanism was correct, clinical advice was given, primary literature was cited, and the severity level of the drug-drug interaction was given. All databases showed weaknesses regarding the hit rate of the tested drug interactions, with a maximum of 67.7% hits. The highest score in this validation was achieved by MediQ with 104 out of 180 points. PsiacOnline achieved 83 points, arznei-telegramm® 58, ifap index® 54 and the ABDA-database 49 points. Based on this validation MediQ seems to be the most suitable databank for the field of psychopharmacotherapy. The best results in this comparison were achieved by MediQ but this database also needs improvement with respect to the hit rate so that the users can rely on the results and therefore increase drug therapy safety.

Validity and reliability of the Structured Clinical Interview for Depersonalization–Derealization Spectrum (SCI-DER

Directory of Open Access Journals (Sweden)

Marco Mula

2008-08-01

Full Text Available Marco Mula, Stefano Pini, Simona Calugi, Matteo Preve, Matteo Masini, Ilaria Giovannini, Ciro Conversano, Paola Rucci, Giovanni B CassanoDepartment of Psychiatry, Neurobiology, Pharmacology and Biotechnologies, University of Pisa, ItalyAbstract: This study evaluates the validity and reliability of a new instrument developed to assess symptoms of depersonalization: the Structured Clinical Interview for the Depersonalization-Derealization Spectrum (SCI-DER. The instrument is based on a spectrum model that emphasizes soft-signs, sub-threshold syndromes as well as clinical and subsyndromal manifestations. Items of the interview include, in addition to DSM-IV criteria for depersonalization, a number of features derived from clinical experience and from a review of phenomenological descriptions. Study participants included 258 consecutive patients with mood and anxiety disorders, 16.7% bipolar I disorder, 18.6% bipolar II disorder, 32.9% major depression, 22.1% panic disorder, 4.7% obsessive compulsive disorder, and 1.5% generalized anxiety disorder; 2.7% patients were also diagnosed with depersonalization disorder. A comparison group of 42 unselected controls was enrolled at the same site. The SCI-DER showed excellent reliability and good concurrent validity with the Dissociative Experiences Scale. It significantly discriminated subjects with any diagnosis of mood and anxiety disorders from controls and subjects with depersonalization disorder from controls. The hypothesized structure of the instrument was confirmed empirically.Keywords: depersonalization, derealization, mood disorders, anxiety disorders

A validated risk score to estimate mortality risk in patients with dementia and pneumonia: barriers to clinical impact

NARCIS (Netherlands)

van der Steen, J.T.; Albers, G.; Strunk, E.; Muller, M.T.; Ribbe, M.W.

2011-01-01

Background: The clinical impact of risk score use in end-of-life settings is unknown, with reports limited to technical properties. Methods: We conducted a mixed-methods study to evaluate clinical impact of a validated mortality risk score aimed at informing prognosis and supporting clinicians in

Groundwater Model Validation

Energy Technology Data Exchange (ETDEWEB)

Ahmed E. Hassan

2006-01-24

Models have an inherent uncertainty. The difficulty in fully characterizing the subsurface environment makes uncertainty an integral component of groundwater flow and transport models, which dictates the need for continuous monitoring and improvement. Building and sustaining confidence in closure decisions and monitoring networks based on models of subsurface conditions require developing confidence in the models through an iterative process. The definition of model validation is postulated as a confidence building and long-term iterative process (Hassan, 2004a). Model validation should be viewed as a process not an end result. Following Hassan (2004b), an approach is proposed for the validation process of stochastic groundwater models. The approach is briefly summarized herein and detailed analyses of acceptance criteria for stochastic realizations and of using validation data to reduce input parameter uncertainty are presented and applied to two case studies. During the validation process for stochastic models, a question arises as to the sufficiency of the number of acceptable model realizations (in terms of conformity with validation data). Using a hierarchical approach to make this determination is proposed. This approach is based on computing five measures or metrics and following a decision tree to determine if a sufficient number of realizations attain satisfactory scores regarding how they represent the field data used for calibration (old) and used for validation (new). The first two of these measures are applied to hypothetical scenarios using the first case study and assuming field data consistent with the model or significantly different from the model results. In both cases it is shown how the two measures would lead to the appropriate decision about the model performance. Standard statistical tests are used to evaluate these measures with the results indicating they are appropriate measures for evaluating model realizations. The use of validation

Clinical assessment of dysphagia in neurodegeneration (CADN): development, validity and reliability of a bedside tool for dysphagia assessment.

Science.gov (United States)

Vogel, Adam P; Rommel, Natalie; Sauer, Carina; Horger, Marius; Krumm, Patrick; Himmelbach, Marc; Synofzik, Matthis

2017-06-01

Screening assessments for dysphagia are essential in neurodegenerative disease. Yet there are no purpose-built tools to quantify swallowing deficits at bedside or in clinical trials. A quantifiable, brief, easy to administer assessment that measures the impact of dysphagia and predicts the presence or absence of aspiration is needed. The Clinical Assessment of Dysphagia in Neurodegeneration (CADN) was designed by a multidisciplinary team (neurology, neuropsychology, speech pathology) validated against strict methodological criteria in two neurodegenerative diseases, Parkinson's disease (PD) and degenerative ataxia (DA). CADN comprises two parts, an anamnesis (part one) and consumption (part two). Two-thirds of patients were assessed using reference tests, the SWAL-QOL symptoms subscale (part one) and videofluoroscopic assessment of swallowing (part two). CADN has 11 items and can be administered and scored in an average of 7 min. Test-retest reliability was established using correlation and Bland-Altman plots. 125 patients with a neurodegenerative disease were recruited; 60 PD and 65 DA. Validity was established using ROC graphs and correlations. CADN has sensitivity of 79 and 84% and specificity 71 and 69% for parts one and two, respectively. Significant correlations with disease severity were also observed (p dysphagia symptomatology and risk of aspiration. The CADN is a reliable, valid, brief, quantifiable, and easily deployed assessment of swallowing in neurodegenerative disease. It is thus ideally suited for both clinical bedside assessment and future multicentre clinical trials in neurodegenerative disease.

Preliminary Validation of a Screening Tool for Adolescent Panic Disorder in Pediatric Primary Care Clinics

Science.gov (United States)

Queen, Alexander H.; Ehrenreich-May, Jill; Hershorin, Eugene R.

2012-01-01

This study examines the validity of a brief screening tool for adolescent panic disorder (PD) in a primary care setting. A total of 165 participants (ages 12-17 years) seen in two pediatric primary care clinics completed the Autonomic Nervous System Questionnaire (ANS; Stein et al. in Psychosomatic Med 61:359-364, 40). A subset of those screening…

The Abbott RealTime High Risk HPV test is a clinically validated human papillomavirus assay for triage in the referral population and use in primary cervical cancer screening in women 30 years and older: a review of validation studies.

Science.gov (United States)

Poljak, Mario; Oštrbenk, Anja

2013-01-01

Human papillomavirus (HPV) testing has become an essential part of current clinical practice in the management of cervical cancer and precancerous lesions. We reviewed the most important validation studies of a next-generation real-time polymerase chain reaction-based assay, the RealTime High Risk HPV test (RealTime)(Abbott Molecular, Des Plaines, IL, USA), for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older published in peer-reviewed journals from 2009 to 2013. RealTime is designed to detect 14 high-risk HPV genotypes with concurrent distinction of HPV-16 and HPV-18 from 12 other HPV genotypes. The test was launched on the European market in January 2009 and is currently used in many laboratories worldwide for routine detection of HPV. We concisely reviewed validation studies of a next-generation real-time polymerase chain reaction (PCR)-based assay: the Abbott RealTime High Risk HPV test. Eight validation studies of RealTime in referral settings showed its consistently high absolute clinical sensitivity for both CIN2+ (range 88.3-100%) and CIN3+ (range 93.0-100%), as well as comparative clinical sensitivity relative to the currently most widely used HPV test: the Qiagen/Digene Hybrid Capture 2 HPV DNA Test (HC2). Due to the significantly different composition of the referral populations, RealTime absolute clinical specificity for CIN2+ and CIN3+ varied greatly across studies, but was comparable relative to HC2. Four validation studies of RealTime performance in cervical cancer screening settings showed its consistently high absolute clinical sensitivity for both CIN2+ and CIN3+, as well as comparative clinical sensitivity and specificity relative to HC2 and GP5+/6+ PCR. RealTime has been extensively evaluated in the last 4 years. RealTime can be considered clinically validated for triage in referral population settings and for use in primary cervical cancer screening in women 30 years and older.

Development, validation and clinical assessment of a short questionnaire to assess disease-related knowledge in inflammatory bowel disease patients.

LENUS (Irish Health Repository)

Keegan, Denise

2013-02-01

Only two inflammatory bowel disease (IBD) knowledge scales are available, both primarily aimed at evaluating the effectiveness of clinical education programs. The aim of this study was to develop and validate a short knowledge questionnaire for clinical and academic research purposes.

Translation and validation of ICIQ-FLUTS for Tamil-speaking women.

Science.gov (United States)

Ekanayake, Chanil D; Pathmeswaran, Arunasalam; Nishad, A A Nilanga; Samaranayake, Kanishka U; Wijesinghe, Prasantha S

2017-12-01

Research in to lower urinary tract symptoms (LUTS) in women in South Asia is hampered by lack of validated tools. Our aim was to validate the International Consultation on Incontinence Modular Questionnaire on Female Lower Urinary Tract Symptoms (ICIQ-FLUTS) from English to Tamil. After translation to Tamil, a validation study was carried out among women attending the gynecology clinic at District General Hospital-Mannar. Content validity assessed by the level of missing data was Tamil translation of ICIQ-FLUTS retained the psychometric properties of the original English questionnaire and will be an invaluable tool to detect LUTS among Tamil-speaking women.

Validation of the Inventory of Depressive Symptomatology (IDS) in Cocaine Dependent Inmates.

Science.gov (United States)

Suris, Alina; Kashner, T. Michael; Gillaspy, James A., Jr.; Biggs, Melanie; Rush, A. John

2001-01-01

While the reliability and validity of Inventory of Depressive Symptomatology (IDS) scores have been established with outpatient adults being treated in community psychiatric clinics, it has not been used in special or dually diagnosed populations. Establishes internal consistency, concurrent validity, and construct validity for both the clinical…

An Italian multicentre validation study of the coma recovery scale-revised.

Science.gov (United States)

Estraneo, A; Moretta, P; De Tanti, A; Gatta, G; Giacino, J T; Trojano, L

2015-10-01

Rate of misdiagnosis of disorders of consciousness (DoC) can be reduced by employing validated clinical diagnostic tools, such as the Coma Recovery Scale-Revised (CRS-R). An Italian version of the CRS-R has been recently developed, but its applicability across different clinical settings, and its concurrent validity and diagnostic sensitivity have not been estimated yet. To perform a multicentre validation study of the Italian version of the Coma Recovery Scale-Revised (CRS-R). Analysis of inter-rater reliability, concurrent validity and diagnostic sensitivity of the scale. One Intensive Care Unit, 8 Post-acute rehabilitation centres and 2 Long-term facilities Twenty-seven professionals (physicians, N.=11; psychologists, N.=5; physiotherapists, N.=3; speech therapists, N.=6; nurses, N.=2) from 11 Italian Centres. CRS-R and Disability Rating Scale (DRS) applied to 122 patients with clinical diagnosis of Vegetative State (VS) or Minimally Conscious State (MCS). CRS-R has good-to-excellent inter-rater reliability for all subscales, particularly for the communication subscale. The Italian version of the CRS-R showed a high sensitivity and specificity in detecting MCS with reference to clinical consensus diagnosis. The CRS-R showed good concurrent validity with the Disability Rating Scale, which had very low specificity with reference to clinical consensus diagnosis. The Italian version of the CRS-R is a valid scale for use from the sub-acute to chronic stages of DoC. It can be administered reliably by all members of the rehabilitation team with different specialties, levels of experience and settings. The present study promote use of the Italian version of the CRS-R to improve diagnosis of DoC patients, and plan tailored rehabilitation treatment.

CosmoQuest:Using Data Validation for More Than Just Data Validation

Science.gov (United States)

Lehan, C.; Gay, P.

2016-12-01

It is often taken for granted that different scientists completing the same task (e.g. mapping geologic features) will get the same results, and data validation is often skipped or under-utilized due to time and funding constraints. Robbins et. al (2014), however, demonstrated that this is a needed step, as large variation can exist even among collaborating team members completing straight-forward tasks like marking craters. Data Validation should be much more than a simple post-project verification of results. The CosmoQuest virtual research facility employs regular data-validation for a variety of benefits, including real-time user feedback, real-time tracking to observe user activity while it's happening, and using pre-solved data to analyze users' progress and to help them retain skills. Some creativity in this area can drastically improve project results. We discuss methods of validating data in citizen science projects and outline the variety of uses for validation, which, when used properly, improves the scientific output of the project and the user experience for the citizens doing the work. More than just a tool for scientists, validation can assist users in both learning and retaining important information and skills, improving the quality and quantity of data gathered. Real-time analysis of user data can give key information in the effectiveness of the project that a broad glance would miss, and properly presenting that analysis is vital. Training users to validate their own data, or the data of others, can significantly improve the accuracy of misinformed or novice users.

Validation of the Paranoid Thoughts Scale in Iranian Population

Directory of Open Access Journals (Sweden)

Karim Abdolmohammadi

2016-11-01

Full Text Available Abstract Background and Objectives: Considering that paranoid thought has one-dimensional approach, use of long questionnaires has no clinical and research application, therefore use of short questionnaires seems necessary. The Green et al. paranoid thought scale is a short self-assessment tool for assessing paranoid thought in non-clinical and clinical group. This research was conducted to validate this questionnaire in Iranian population. Methods: In this cross-sectional survey, 356 students were selected using stratified sampling method and assessed by GPTS and Minnesota multiphasic paranoid inventory (MMPI in 2015. Validity was assessed simultaneously with MMPI testing. Results: The correlation coefficient of GPTS and MMPI scores was α=0.71 and significant (p<0.001. Internal consistency value was estimated to be 0.81 according to Cronbach's alpha coefficient. Conclusion: GPTS is an appropriate and short tool for screening in paranoid thought-related researches. Keywords: Paranoid disorders; Personality tests; Validation studies.

MO-B-BRB-02: 3D Dosimetry in the Clinic: IMRT Technique Validation in Sweden

Energy Technology Data Exchange (ETDEWEB)

Ceberg, S. [Lund University (Sweden)

2016-06-15

Full three-dimensional (3D) dosimetry using volumetric chemical dosimeters probed by 3D imaging systems has long been a promising technique for the radiation therapy clinic, since it provides a unique methodology for dose measurements in the volume irradiated using complex conformal delivery techniques such as IMRT and VMAT. To date true 3D dosimetry is still not widely practiced in the community; it has been confined to centres of specialized expertise especially for quality assurance or commissioning roles where other dosimetry techniques are difficult to implement. The potential for improved clinical applicability has been advanced considerably in the last decade by the development of improved 3D dosimeters (e.g., radiochromic plastics, radiochromic gel dosimeters and normoxic polymer gel systems) and by improved readout protocols using optical computed tomography or magnetic resonance imaging. In this session, established users of some current 3D chemical dosimeters will briefly review the current status of 3D dosimetry, describe several dosimeters and their appropriate imaging for dose readout, present workflow procedures required for good dosimetry, and analyze some limitations for applications in select settings. We will review the application of 3D dosimetry to various clinical situations describing how 3D approaches can complement other dose delivery validation approaches already available in the clinic. The applications presented will be selected to inform attendees of the unique features provided by full 3D techniques. Learning Objectives: L. John Schreiner: Background and Motivation Understand recent developments enabling clinically practical 3D dosimetry, Appreciate 3D dosimetry workflow and dosimetry procedures, and Observe select examples from the clinic. Sofie Ceberg: Application to dynamic radiotherapy Observe full dosimetry under dynamic radiotherapy during respiratory motion, and Understand how the measurement of high resolution dose data in an

MO-B-BRB-02: 3D Dosimetry in the Clinic: IMRT Technique Validation in Sweden

International Nuclear Information System (INIS)

Ceberg, S.

2016-01-01

Full three-dimensional (3D) dosimetry using volumetric chemical dosimeters probed by 3D imaging systems has long been a promising technique for the radiation therapy clinic, since it provides a unique methodology for dose measurements in the volume irradiated using complex conformal delivery techniques such as IMRT and VMAT. To date true 3D dosimetry is still not widely practiced in the community; it has been confined to centres of specialized expertise especially for quality assurance or commissioning roles where other dosimetry techniques are difficult to implement. The potential for improved clinical applicability has been advanced considerably in the last decade by the development of improved 3D dosimeters (e.g., radiochromic plastics, radiochromic gel dosimeters and normoxic polymer gel systems) and by improved readout protocols using optical computed tomography or magnetic resonance imaging. In this session, established users of some current 3D chemical dosimeters will briefly review the current status of 3D dosimetry, describe several dosimeters and their appropriate imaging for dose readout, present workflow procedures required for good dosimetry, and analyze some limitations for applications in select settings. We will review the application of 3D dosimetry to various clinical situations describing how 3D approaches can complement other dose delivery validation approaches already available in the clinic. The applications presented will be selected to inform attendees of the unique features provided by full 3D techniques. Learning Objectives: L. John Schreiner: Background and Motivation Understand recent developments enabling clinically practical 3D dosimetry, Appreciate 3D dosimetry workflow and dosimetry procedures, and Observe select examples from the clinic. Sofie Ceberg: Application to dynamic radiotherapy Observe full dosimetry under dynamic radiotherapy during respiratory motion, and Understand how the measurement of high resolution dose data in an

The measurement of instrumental ADL: content validity and construct validity

DEFF Research Database (Denmark)

Avlund, K; Schultz-Larsen, K; Kreiner, S

1993-01-01

do not depend on help. It is also possible to add the items in a valid way. However, to obtain valid IADL-scales, we omitted items that were highly relevant to especially elderly women, such as house-work items. We conclude that the criteria employed for this IADL-measure are somewhat contradictory....... showed that 14 items could be combined into two qualitatively different additive scales. The IADL-measure complies with demands for content validity, distinguishes between what the elderly actually do, and what they are capable of doing, and is a good discriminator among the group of elderly persons who...

Central Pressure Appraisal: Clinical Validation of a Subject-Specific Mathematical Model.

Directory of Open Access Journals (Sweden)

Francesco Tosello

Full Text Available Current evidence suggests that aortic blood pressure has a superior prognostic value with respect to brachial pressure for cardiovascular events, but direct measurement is not feasible in daily clinical practice.The aim of the present study is the clinical validation of a multiscale mathematical model for non-invasive appraisal of central blood pressure from subject-specific characteristics.A total of 51 young male were selected for the present study. Aortic systolic and diastolic pressure were estimated with a mathematical model and were compared to the most-used non-invasive validated technique (SphygmoCor device, AtCor Medical, Australia. SphygmoCor was calibrated through diastolic and systolic brachial pressure obtained with a sphygmomanometer, while model inputs consist of brachial pressure, height, weight, age, left-ventricular end-systolic and end-diastolic volumes, and data from a pulse wave velocity study.Model-estimated systolic and diastolic central blood pressures resulted to be significantly related to SphygmoCor-assessed central systolic (r = 0.65 p <0.0001 and diastolic (r = 0.84 p<0.0001 blood pressures. The model showed a significant overestimation of systolic pressure (+7.8 (-2.2;14 mmHg, p = 0.0003 and a significant underestimation of diastolic values (-3.2 (-7.5;1.6, p = 0.004, which imply a significant overestimation of central pulse pressure. Interestingly, model prediction errors mirror the mean errors reported in large meta-analysis characterizing the use of the SphygmoCor when non-invasive calibration is performed.In conclusion, multi-scale mathematical model predictions result to be significantly related to SphygmoCor ones. Model-predicted systolic and diastolic aortic pressure resulted in difference of less than 10 mmHg in the 51% and 84% of the subjects, respectively, when compared with SphygmoCor-obtained pressures.

Assessment of teacher competence using video portfolios: reliability, construct validity and consequential validity

NARCIS (Netherlands)

Admiraal, W.; Hoeksma, M.; van de Kamp, M.-T.; van Duin, G.

2011-01-01

The richness and complexity of video portfolios endanger both the reliability and validity of the assessment of teacher competencies. In a post-graduate teacher education program, the assessment of video portfolios was evaluated for its reliability, construct validity, and consequential validity.

Italian version of Dyspnoea-12: cultural-linguistic validation, quantitative and qualitative content validity study.

Science.gov (United States)

Caruso, Rosario; Arrigoni, Cristina; Groppelli, Katia; Magon, Arianna; Dellafiore, Federica; Pittella, Francesco; Grugnetti, Anna Maria; Chessa, Massimo; Yorke, Janelle

2018-01-16

Dyspnoea-12 is a valid and reliable scale to assess dyspneic symptom, considering its severity, physical and emotional components. However, it is not available in Italian version due to it was not yet translated and validated. For this reason, the aim of this study was to develop an Italian version Dyspnoea-12, providing a cultural and linguistic validation, supported by the quantitative and qualitative content validity. This was a methodological study, divided into two phases: phase one is related to the cultural and linguistic validation, phase two is related to test the quantitative and qualitative content validity. Linguistic validation followed a standardized translation process. Quantitative content validity was assessed computing content validity ratio (CVR) and index (I-CVIs and S-CVI) from expert panellists response. Qualitative content validity was assessed by the narrative analysis on the answers of three open-ended questions to the expert panellists, aimed to investigate the clarity and the pertinence of the Italian items. The translation process found a good agreement in considering clear the items in both the six involved bilingual expert translators and among the ten voluntary involved patients. CVR, I-CVIs and S-CVI were satisfactory for all the translated items. This study has represented a pivotal step to use Dyspnoea-12 amongst Italian patients. Future researches are needed to deeply investigate the Italian version of  Dyspnoea-12 construct validity and its reliability, and to describe how dyspnoea components (i.e. physical and emotional) impact the life of patients with cardiorespiratory diseases.

Quality data validation: Comprehensive approach to environmental data validation

International Nuclear Information System (INIS)

Matejka, L.A. Jr.

1993-01-01

Environmental data validation consists of an assessment of three major areas: analytical method validation; field procedures and documentation review; evaluation of the level of achievement of data quality objectives based in part on PARCC parameters analysis and expected applications of data. A program utilizing matrix association of required levels of validation effort and analytical levels versus applications of this environmental data was developed in conjunction with DOE-ID guidance documents to implement actions under the Federal Facilities Agreement and Consent Order in effect at the Idaho National Engineering Laboratory. This was an effort to bring consistent quality to the INEL-wide Environmental Restoration Program and database in an efficient and cost-effective manner. This program, documenting all phases of the review process, is described here

Development and validation of the Child Oral Health Impact Profile - Preschool version.

Science.gov (United States)

Ruff, R R; Sischo, L; Chinn, C H; Broder, H L

2017-09-01

The Child Oral Health Impact Profile (COHIP) is a validated instrument created to measure the oral health-related quality of life of school-aged children. The purpose of this study was to develop and validate a preschool version of the COHIP (COHIP-PS) for children aged 2-5. The COHIP-PS was developed and validated using a multi-stage process consisting of item selection, face validity testing, item impact testing, reliability and validity testing, and factor analysis. A cross-sectional convenience sample of caregivers having children 2-5 years old from four groups completed item clarity and impact forms. Groups were recruited from pediatric health clinics or preschools/daycare centers, speech clinics, dental clinics, or cleft/craniofacial centers. Participants had a variety of oral health-related conditions, including caries, congenital orofacial anomalies, and speech/language deficiencies such as articulation and language disorders. COHIP-PS. The COHIP-PS was found to have acceptable internal validity (a = 0.71) and high test-retest reliability (0.87), though internal validity was below the accepted threshold for the community sample. While discriminant validity results indicated significant differences across study groups, the overall magnitude of differences was modest. Results from confirmatory factor analyses support the use of a four-factor model consisting of 11 items across oral health, functional well-being, social-emotional well-being, and self-image domains. Quality of life is an integral factor in understanding and assessing children's well-being. The COHIP-PS is a validated oral health-related quality of life measure for preschool children with cleft or other oral conditions. Copyright© 2017 Dennis Barber Ltd.

Construct validity of the Iowa Gambling Task.

Science.gov (United States)

Buelow, Melissa T; Suhr, Julie A

2009-03-01

The Iowa Gambling Task (IGT) was created to assess real-world decision making in a laboratory setting and has been applied to various clinical populations (i.e., substance abuse, schizophrenia, pathological gamblers) outside those with orbitofrontal cortex damage, for whom it was originally developed. The current review provides a critical examination of lesion, functional neuroimaging, developmental, and clinical studies in order to examine the construct validity of the IGT. The preponderance of evidence provides support for the use of the IGT to detect decision making deficits in clinical populations, in the context of a more comprehensive evaluation. The review includes a discussion of three critical issues affecting the validity of the IGT, as it has recently become available as a clinical instrument: the lack of a concise definition as to what aspect of decision making the IGT measures, the lack of data regarding reliability of the IGT, and the influence of personality and state mood on IGT performance.

The development and validation of the Clinical Teaching Behavior Inventory (CTBI-23): Nurse preceptors' and new graduate nurses' perceptions of precepting.

Science.gov (United States)

Lee-Hsieh, Jane; O'Brien, Anthony; Liu, Chieh-Yu; Cheng, Su-Fen; Lee, Yea-Wen; Kao, Yu-Hsiu

2016-03-01

Few studies have examined the perceptions of clinical teaching behaviors among both nurse preceptors and preceptees. To develop a Clinical Teaching Behavior Inventory (CTBI) for nurse preceptors' self-evaluation, and for new graduate nurse preceptee evaluation of preceptor clinical teaching behaviors and to test the validity and reliability of the CTBI. This study used mixed research techniques in five phases. Phase I: based on a literature review, the researchers developed an instrument to measure clinical teaching behaviors. Phase II: 17 focus group interviews were conducted with 63 preceptors and 24 new graduate nurses from five hospitals across Taiwan. Clinical teaching behavior themes were extracted from the focus group data and integrated into the domains and items of the CTBI. Phase III: two rounds of an expert Delphi study were conducted to determine the content validity of the instrument. Phase IV: a total of 290 nurse preceptors and 260 new graduate nurses were recruited voluntarily in the same five hospitals in Taiwan. Of these, 521 completed questionnaires to test the construct validity of CTBI by using confirmatory factory analysis. Phase V: the internal consistency and reliability of the instrument were tested. CTBI consists of 23 items in six domains: (1) 'Committing to Teaching'; (2) 'Building a Learning Atmosphere'; (3) 'Using Appropriate Teaching Strategies'; (4) 'Guiding Inter-professional Communication'; (5) 'Providing Feedback and Evaluation'; and (6) 'Showing Concern and Support'. The confirmatory factor analysis yielded a good fit and reliable scores for the CTBI-23 model. The CTBI-23 is a valid and reliable instrument for identifying the clinical teaching behaviors of a preceptor as perceived by preceptors and new graduate preceptees. The CTBI-23 depicts clinical teaching behaviors of nurse preceptors in Taiwan. Copyright © 2015 Elsevier Ltd. All rights reserved.

Validation of Symptom Validity Tests Using a "Child-model" of Adult Cognitive Impairments

NARCIS (Netherlands)

Rienstra, A.; Spaan, P. E. J.; Schmand, B.

2010-01-01

Validation studies of symptom validity tests (SVTs) in children are uncommon. However, since children's cognitive abilities are not yet fully developed, their performance may provide additional support for the validity of these measures in adult populations. Four SVTs, the Test of Memory Malingering

Assessing the reliability, predictive and construct validity of historical, clinical and risk management-20 (HCR-20) in Mexican psychiatric inpatients.

Science.gov (United States)

Sada, Andrea; Robles-García, Rebeca; Martínez-López, Nicolás; Hernández-Ramírez, Rafael; Tovilla-Zarate, Carlos-Alfonso; López-Munguía, Fernando; Suárez-Alvarez, Enrique; Ayala, Xochitl; Fresán, Ana

2016-08-01

Assessing dangerousness to gauge the likelihood of future violent behaviour has become an integral part of clinical mental health practice in forensic and non-forensic psychiatric settings, one of the most effective instruments for this being the Historical, Clinical and Risk Management-20 (HCR-20). To examine the HCR-20 factor structure in Mexican psychiatric inpatients and to obtain its predictive validity and reliability for use in this population. In total, 225 patients diagnosed with psychotic, affective or personality disorders were included. The HCR-20 was applied at hospital admission and violent behaviours were assessed during psychiatric hospitalization using the Overt Aggression Scale (OAS). Construct validity, predictive validity and internal consistency were determined. Violent behaviour remains more severe in patients classified in the high-risk group during hospitalization. Fifteen items displayed adequate communalities in the original designated domains of the HCR-20 and internal consistency of the instruments was high. The HCR-20 is a suitable instrument for predicting violence risk in Mexican psychiatric inpatients.

Italian Validation of Homophobia Scale (HS).

Science.gov (United States)

Ciocca, Giacomo; Capuano, Nicolina; Tuziak, Bogdan; Mollaioli, Daniele; Limoncin, Erika; Valsecchi, Diana; Carosa, Eleonora; Gravina, Giovanni L; Gianfrilli, Daniele; Lenzi, Andrea; Jannini, Emmanuele A

2015-09-01

The Homophobia Scale (HS) is a valid tool to assess homophobia. This test is self-reporting, composed of 25 items, which assesses a total score and three factors linked to homophobia: behavior/negative affect, affect/behavioral aggression, and negative cognition. The aim of this study was to validate the HS in the Italian context. An Italian translation of the HS was carried out by two bilingual people, after which an English native translated the test back into the English language. A psychologist and sexologist checked the translated items from a clinical point of view. We recruited 100 subjects aged18-65 for the Italian validation of the HS. The Pearson coefficient and Cronbach's α coefficient were performed to test the test-retest reliability and internal consistency. A sociodemographic questionnaire including the main information as age, geographic distribution, partnership status, education, religious orientation, and sex orientation was administrated together with the translated version of HS. The analysis of the internal consistency showed an overall Cronbach's α coefficient of 0.92. In the four domains, the Cronbach's α coefficient was 0.90 in behavior/negative affect, 0.94 in affect/behavioral aggression, and 0.92 in negative cognition, whereas in the total score was 0.86. The test-retest reliability showed the following results: the HS total score was r = 0.93 (P cognition was r = 0.75 (P validation of the HS revealed the use of this self-report test to have good psychometric properties. This study offers a new tool to assess homophobia. In this regard, the HS can be introduced into the clinical praxis and into programs for the prevention of homophobic behavior.

French validation of the Foot Function Index (FFI).

Science.gov (United States)

Pourtier-Piotte, C; Pereira, B; Soubrier, M; Thomas, E; Gerbaud, L; Coudeyre, E

2015-10-01

French validation of the Foot Function Index (FFI), self-questionnaire designed to evaluate rheumatoid foot according to 3 domains: pain, disability and activity restriction. The first step consisted of translation/back translation and cultural adaptation according to the validated methodology. The second stage was a prospective validation on 53 patients with rheumatoid arthritis who filled out the FFI. The following data were collected: pain (Visual Analog Scale), disability (Health Assessment Questionnaire) and activity restrictions (McMaster Toronto Arthritis questionnaire). A test/retest procedure was performed 15 days later. The statistical analyses focused on acceptability, internal consistency (Cronbach's alpha and Principal Component Analysis), test-retest reproducibility (concordance coefficients), external validity (correlation coefficients) and responsiveness to change. The FFI-F is a culturally acceptable version for French patients with rheumatoid arthritis. The Cronbach's alpha ranged from 0.85 to 0.97. Reproducibility was correct (correlation coefficients>0.56). External validity and responsiveness to change were good. The use of a rigorous methodology allowed the validation of the FFI in the French language (FFI-F). This tool can be used in routine practice and clinical research for evaluating the rheumatoid foot. The FFI-F could be used in other pathologies with foot-related functional impairments. Copyright © 2015 Elsevier Masson SAS. All rights reserved.

Validity and reliability of the novel thyroid-specific quality of life questionnaire, ThyPRO

DEFF Research Database (Denmark)

Watt, Torquil; Hegedüs, Laszlo; Groenvold, Mogens

2010-01-01

Background Appropriate scale validity and internal consistency reliability have recently been documented for the new thyroid-specific quality of life (QoL) patient-reported outcome (PRO) measure for benign thyroid disorders, the ThyPRO. However, before clinical use, clinical validity and test......-retest reliability should be evaluated. Aim To investigate clinical ('known-groups') validity and test-retest reliability of the Danish version of the ThyPRO. Methods For each of the 13 ThyPRO scales, we defined groups expected to have high versus low scores ('known-groups'). The clinical validity (known......-groups validity) was evaluated by whether the ThyPRO scales could detect expected differences in a cross-sectional study of 907 thyroid patients. Test-retest reliability was evaluated by intra-class correlations of two responses to the ThyPRO 2 weeks apart in a subsample of 87 stable patients. Results On all 13...

Noninvasive assessment of mitral inertness [correction of inertance]: clinical results with numerical model validation.

Science.gov (United States)

Firstenberg, M S; Greenberg, N L; Smedira, N G; McCarthy, P M; Garcia, M J; Thomas, J D

2001-01-01

Inertial forces (Mdv/dt) are a significant component of transmitral flow, but cannot be measured with Doppler echo. We validated a method of estimating Mdv/dt. Ten patients had a dual sensor transmitral (TM) catheter placed during cardiac surgery. Doppler and 2D echo was performed while acquiring LA and LV pressures. Mdv/dt was determined from the Bernoulli equation using Doppler velocities and TM gradients. Results were compared with numerical modeling. TM gradients (range: 1.04-14.24 mmHg) consisted of 74.0 +/- 11.0% inertial forcers (range: 0.6-12.9 mmHg). Multivariate analysis predicted Mdv/dt = -4.171(S/D (RATIO)) + 0.063(LAvolume-max) + 5. Using this equation, a strong relationship was obtained for the clinical dataset (y=0.98x - 0.045, r=0.90) and the results of numerical modeling (y=0.96x - 0.16, r=0.84). TM gradients are mainly inertial and, as validated by modeling, can be estimated with echocardiography.

Validation of symptom validity tests using a "child-model" of adult cognitive impairments

NARCIS (Netherlands)

Rienstra, A.; Spaan, P.E.J.; Schmand, B.

2010-01-01

Validation studies of symptom validity tests (SVTs) in children are uncommon. However, since children’s cognitive abilities are not yet fully developed, their performance may provide additional support for the validity of these measures in adult populations. Four SVTs, the Test of Memory Malingering

Quality assurance of the clinical learning environment in Austria: Construct validity of the Clinical Learning Environment, Supervision and Nurse Teacher Scale (CLES+T scale).

Science.gov (United States)

Mueller, Gerhard; Mylonas, Demetrius; Schumacher, Petra

2018-04-21

Within nursing education, the clinical learning environment is of a high importance in regards to the development of competencies and abilities. The organization, atmosphere, and supervision in the clinical learning environment are only a few factors that influence this development. In Austria there is currently no valid instrument available for the evaluation of influencing factors. The aim of the study was to test the construct validity with principal component analysis as well as the internal consistency of the German Clinical Learning Environment, Supervision and Teacher Scale (CLES+T scale) in Austria. The present validation study has a descriptive-quantitative cross-sectional design. The sample consisted of 385 nursing students from thirteen training institutions in Austria. The data collection was carried out online between March and April 2016. Starting with a polychoric correlation matrix, a parallel analysis with principal component extraction and promax rotation was carried out due to the ordinal data. The exploratory ordinal factor analysis supported a four-component solution and explained 73% of the total variance. The internal consistency of all 25 items reached a Cronbach's α of 0.95 and the four components ranged between 0.83 and 0.95. The German version of the CLES+T scale seems to be a useful instrument for identifying potential areas of improvement in clinical practice in order to derive specific quality measures for the practical learning environment. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Nursing Diagnosis of risk for pressure ulcer: content validation

Directory of Open Access Journals (Sweden)

Cássia Teixeira dos Santos

2016-01-01

Full Text Available Abstract Objective: to validate the content of the new nursing diagnosis, termed risk for pressure ulcer. Method: the content validation with a sample made up of 24 nurses who were specialists in skin care from six different hospitals in the South and Southeast of Brazil. Data collection took place electronically, through an instrument constructed using the SurveyMonkey program, containing a title, definition, and 19 risk factors for the nursing diagnosis. The data were analyzed using Fehring's method and descriptive statistics. The project was approved by a Research Ethics Committee. Results: title, definition and seven risk factors were validated as "very important": physical immobilization, pressure, surface friction, shearing forces, skin moisture, alteration in sensation and malnutrition. Among the other risk factors, 11 were validated as "important": dehydration, obesity, anemia, decrease in serum albumin level, prematurity, aging, smoking, edema, impaired circulation, and decrease in oxygenation and in tissue perfusion. The risk factor of hyperthermia was discarded. Conclusion: the content validation of these components of the nursing diagnosis corroborated the importance of the same, being able to facilitate the nurse's clinical reasoning and guiding clinical practice in the preventive care for pressure ulcers.

Model Validation Status Review

International Nuclear Information System (INIS)

E.L. Hardin

2001-01-01

The primary objective for the Model Validation Status Review was to perform a one-time evaluation of model validation associated with the analysis/model reports (AMRs) containing model input to total-system performance assessment (TSPA) for the Yucca Mountain site recommendation (SR). This review was performed in response to Corrective Action Request BSC-01-C-01 (Clark 2001, Krisha 2001) pursuant to Quality Assurance review findings of an adverse trend in model validation deficiency. The review findings in this report provide the following information which defines the extent of model validation deficiency and the corrective action needed: (1) AMRs that contain or support models are identified, and conversely, for each model the supporting documentation is identified. (2) The use for each model is determined based on whether the output is used directly for TSPA-SR, or for screening (exclusion) of features, events, and processes (FEPs), and the nature of the model output. (3) Two approaches are used to evaluate the extent to which the validation for each model is compliant with AP-3.10Q (Analyses and Models). The approaches differ in regard to whether model validation is achieved within individual AMRs as originally intended, or whether model validation could be readily achieved by incorporating information from other sources. (4) Recommendations are presented for changes to the AMRs, and additional model development activities or data collection, that will remedy model validation review findings, in support of licensing activities. The Model Validation Status Review emphasized those AMRs that support TSPA-SR (CRWMS M and O 2000bl and 2000bm). A series of workshops and teleconferences was held to discuss and integrate the review findings. The review encompassed 125 AMRs (Table 1) plus certain other supporting documents and data needed to assess model validity. The AMRs were grouped in 21 model areas representing the modeling of processes affecting the natural and

Model Validation Status Review

Energy Technology Data Exchange (ETDEWEB)

E.L. Hardin

2001-11-28

The primary objective for the Model Validation Status Review was to perform a one-time evaluation of model validation associated with the analysis/model reports (AMRs) containing model input to total-system performance assessment (TSPA) for the Yucca Mountain site recommendation (SR). This review was performed in response to Corrective Action Request BSC-01-C-01 (Clark 2001, Krisha 2001) pursuant to Quality Assurance review findings of an adverse trend in model validation deficiency. The review findings in this report provide the following information which defines the extent of model validation deficiency and the corrective action needed: (1) AMRs that contain or support models are identified, and conversely, for each model the supporting documentation is identified. (2) The use for each model is determined based on whether the output is used directly for TSPA-SR, or for screening (exclusion) of features, events, and processes (FEPs), and the nature of the model output. (3) Two approaches are used to evaluate the extent to which the validation for each model is compliant with AP-3.10Q (Analyses and Models). The approaches differ in regard to whether model validation is achieved within individual AMRs as originally intended, or whether model validation could be readily achieved by incorporating information from other sources. (4) Recommendations are presented for changes to the AMRs, and additional model development activities or data collection, that will remedy model validation review findings, in support of licensing activities. The Model Validation Status Review emphasized those AMRs that support TSPA-SR (CRWMS M&O 2000bl and 2000bm). A series of workshops and teleconferences was held to discuss and integrate the review findings. The review encompassed 125 AMRs (Table 1) plus certain other supporting documents and data needed to assess model validity. The AMRs were grouped in 21 model areas representing the modeling of processes affecting the natural and

Visualizing and Validating Metadata Traceability within the CDISC Standards.

Science.gov (United States)

Hume, Sam; Sarnikar, Surendra; Becnel, Lauren; Bennett, Dorine

2017-01-01

The Food & Drug Administration has begun requiring that electronic submissions of regulated clinical studies utilize the Clinical Data Information Standards Consortium data standards. Within regulated clinical research, traceability is a requirement and indicates that the analysis results can be traced back to the original source data. Current solutions for clinical research data traceability are limited in terms of querying, validation and visualization capabilities. This paper describes (1) the development of metadata models to support computable traceability and traceability visualizations that are compatible with industry data standards for the regulated clinical research domain, (2) adaptation of graph traversal algorithms to make them capable of identifying traceability gaps and validating traceability across the clinical research data lifecycle, and (3) development of a traceability query capability for retrieval and visualization of traceability information.

The validation index: a new metric for validation of segmentation algorithms using two or more expert outlines with application to radiotherapy planning.

Science.gov (United States)

Juneja, Prabhjot; Evans, Philp M; Harris, Emma J

2013-08-01

Validation is required to ensure automated segmentation algorithms are suitable for radiotherapy target definition. In the absence of true segmentation, algorithmic segmentation is validated against expert outlining of the region of interest. Multiple experts are used to overcome inter-expert variability. Several approaches have been studied in the literature, but the most appropriate approach to combine the information from multiple expert outlines, to give a single metric for validation, is unclear. None consider a metric that can be tailored to case-specific requirements in radiotherapy planning. Validation index (VI), a new validation metric which uses experts' level of agreement was developed. A control parameter was introduced for the validation of segmentations required for different radiotherapy scenarios: for targets close to organs-at-risk and for difficult to discern targets, where large variation between experts is expected. VI was evaluated using two simulated idealized cases and data from two clinical studies. VI was compared with the commonly used Dice similarity coefficient (DSCpair - wise) and found to be more sensitive than the DSCpair - wise to the changes in agreement between experts. VI was shown to be adaptable to specific radiotherapy planning scenarios.

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

Science.gov (United States)

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Validity of an Interactive Functional Reach Test.

Science.gov (United States)

Galen, Sujay S; Pardo, Vicky; Wyatt, Douglas; Diamond, Andrew; Brodith, Victor; Pavlov, Alex

2015-08-01

Videogaming platforms such as the Microsoft (Redmond, WA) Kinect(®) are increasingly being used in rehabilitation to improve balance performance and mobility. These gaming platforms do not have built-in clinical measures that offer clinically meaningful data. We have now developed software that will enable the Kinect sensor to assess a patient's balance using an interactive functional reach test (I-FRT). The aim of the study was to test the concurrent validity of the I-FRT and to establish the feasibility of implementing the I-FRT in a clinical setting. The concurrent validity of the I-FRT was tested among 20 healthy adults (mean age, 25.8±3.4 years; 14 women). The Functional Reach Test (FRT) was measured simultaneously by both the Kinect sensor using the I-FRT software and the Optotrak Certus(®) 3D motion-capture system (Northern Digital Inc., Waterloo, ON, Canada). The feasibility of implementing the I-FRT in a clinical setting was assessed by performing the I-FRT in 10 participants with mild balance impairments recruited from the outpatient physical therapy clinic (mean age, 55.8±13.5 years; four women) and obtaining their feedback using a NASA Task Load Index (NASA-TLX) questionnaire. There was moderate to good agreement between FRT measures made by the two measurement systems. The greatest agreement between the two measurement system was found with the Kinect sensor placed at a distance of 2.5 m [intraclass correlation coefficient (2,k)=0.786; PNASA/TLX questionnaire. FRT measures made using the Kinect sensor I-FRT software provides a valid clinical measure that can be used with the gaming platforms.

FastaValidator: an open-source Java library to parse and validate FASTA formatted sequences.

Science.gov (United States)

Waldmann, Jost; Gerken, Jan; Hankeln, Wolfgang; Schweer, Timmy; Glöckner, Frank Oliver

2014-06-14

Advances in sequencing technologies challenge the efficient importing and validation of FASTA formatted sequence data which is still a prerequisite for most bioinformatic tools and pipelines. Comparative analysis of commonly used Bio*-frameworks (BioPerl, BioJava and Biopython) shows that their scalability and accuracy is hampered. FastaValidator represents a platform-independent, standardized, light-weight software library written in the Java programming language. It targets computer scientists and bioinformaticians writing software which needs to parse quickly and accurately large amounts of sequence data. For end-users FastaValidator includes an interactive out-of-the-box validation of FASTA formatted files, as well as a non-interactive mode designed for high-throughput validation in software pipelines. The accuracy and performance of the FastaValidator library qualifies it for large data sets such as those commonly produced by massive parallel (NGS) technologies. It offers scientists a fast, accurate and standardized method for parsing and validating FASTA formatted sequence data.

Design of a Competency Evaluation Model for Clinical Nursing Practicum, Based on Standardized Language Systems: Psychometric Validation Study.

Science.gov (United States)

Iglesias-Parra, Maria Rosa; García-Guerrero, Alfonso; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; León-Campos, Álvaro; Morales-Asencio, José Miguel

2015-07-01

To develop an evaluation system of clinical competencies for the practicum of nursing students based on the Nursing Interventions Classification (NIC). Psychometric validation study: the first two phases addressed definition and content validation, and the third phase consisted of a cross-sectional study for analyzing reliability. The study population was undergraduate nursing students and clinical tutors. Through the Delphi technique, 26 competencies and 91 interventions were isolated. Cronbach's α was 0.96. Factor analysis yielded 18 factors that explained 68.82% of the variance. Overall inter-item correlation was 0.26, and total-item correlation ranged between 0.66 and 0.19. A competency system for the nursing practicum, structured on the NIC, is a reliable method for assessing and evaluating clinical competencies. Further evaluations in other contexts are needed. The availability of standardized language systems in the nursing discipline supposes an ideal framework to develop the nursing curricula. © 2015 Sigma Theta Tau International.

Doubtful outcome of the validation of the Rome II questionnaire: validation of a symptom based diagnostic tool

Directory of Open Access Journals (Sweden)

Nylin Henry BO

2009-12-01

Full Text Available Abstract Background Questionnaires are used in research and clinical practice. For gastrointestinal complaints the Rome II questionnaire is internationally known but not validated. The aim of this study was to validate a printed and a computerized version of Rome II, translated into Swedish. Results from various analyses are reported. Methods Volunteers from a population based colonoscopy study were included (n = 1011, together with patients seeking general practice (n = 45 and patients visiting a gastrointestinal specialists' clinic (n = 67. The questionnaire consists of 38 questions concerning gastrointestinal symptoms and complaints. Diagnoses are made after a special code. Our validation included analyses of the translation, feasibility, predictability, reproducibility and reliability. Kappa values and overall agreement were measured. The factor structures were confirmed using a principal component analysis and Cronbach's alpha was used to test the internal consistency. Results and Discussion Translation and back translation showed good agreement. The questionnaire was easy to understand and use. The reproducibility test showed kappa values of 0.60 for GERS, 0.52 for FD, and 0.47 for IBS. Kappa values and overall agreement for the predictability when the diagnoses by the questionnaire were compared to the diagnoses by the clinician were 0.26 and 90% for GERS, 0.18 and 85% for FD, and 0.49 and 86% for IBS. Corresponding figures for the agreement between the printed and the digital version were 0.50 and 92% for GERS, 0.64 and 95% for FD, and 0.76 and 95% for IBS. Cronbach's alpha coefficient for GERS was 0.75 with a span per item of 0.71 to 0.76. For FD the figures were 0.68 and 0.54 to 0.70 and for IBS 0.61 and 0.56 to 0.66. The Rome II questionnaire has never been thoroughly validated before even if diagnoses made by the Rome criteria have been compared to diagnoses made in clinical practice. Conclusion The accuracy of the Swedish version of

Assessment of postprandial triglycerides in clinical practice: validation in a general population and coronary heart disease patients

Science.gov (United States)

BACKGROUND: Previous studies have suggested that for clinical purposes, subjects with fasting triglycerides (TGs) between 89-180 mg/dl (1-2 mmol/l) would benefit from postprandial TGs testing. OBJECTIVE: To determine the postprandial TG response in 2 independent studies and validate who should benef...

Expanding the Nomological Net of the Pathological Narcissism Inventory: German Validation and Extension in a Clinical Inpatient Sample.

Science.gov (United States)

Morf, Carolyn C; Schürch, Eva; Küfner, Albrecht; Siegrist, Philip; Vater, Aline; Back, Mitja; Mestel, Robert; Schröder-Abé, Michela

2017-06-01

The Pathological Narcissism Inventory (PNI) is a multidimensional measure for assessing grandiose and vulnerable features in narcissistic pathology. The aim of the present research was to construct and validate a German translation of the PNI and to provide further information on the PNI's nomological net. Findings from a first study confirm the psychometric soundness of the PNI and replicate its seven-factor first-order structure. A second-order structure was also supported but with several equivalent models. A second study investigating associations with a broad range of measures ( DSM Axis I and II constructs, emotions, personality traits, interpersonal and dysfunctional behaviors, and well-being) supported the concurrent validity of the PNI. Discriminant validity with the Narcissistic Personality Inventory was also shown. Finally, in a third study an extension in a clinical inpatient sample provided further evidence that the PNI is a useful tool to assess the more pathological end of narcissism.

Clinical validation of robot simulation of toothbrushing - comparative plaque removal efficacy

Science.gov (United States)

2014-01-01

Background Clinical validation of laboratory toothbrushing tests has important advantages. It was, therefore, the aim to demonstrate correlation of tooth cleaning efficiency of a new robot brushing simulation technique with clinical plaque removal. Methods Clinical programme: 27 subjects received dental cleaning prior to 3-day-plaque-regrowth-interval. Plaque was stained, photographically documented and scored using planimetrical index. Subjects brushed teeth 33–47 with three techniques (horizontal, rotating, vertical), each for 20s buccally and for 20s orally in 3 consecutive intervals. The force was calibrated, the brushing technique was video supported. Two different brushes were randomly assigned to the subject. Robot programme: Clinical brushing programmes were transfered to a 6-axis-robot. Artificial teeth 33–47 were covered with plaque-simulating substrate. All brushing techniques were repeated 7 times, results were scored according to clinical planimetry. All data underwent statistical analysis by t-test, U-test and multivariate analysis. Results The individual clinical cleaning patterns are well reproduced by the robot programmes. Differences in plaque removal are statistically significant for the two brushes, reproduced in clinical and robot data. Multivariate analysis confirms the higher cleaning efficiency for anterior teeth and for the buccal sites. Conclusions The robot tooth brushing simulation programme showed good correlation with clinically standardized tooth brushing. This new robot brushing simulation programme can be used for rapid, reproducible laboratory testing of tooth cleaning. PMID:24996973

The Adequacy of the Q Methodology for Clinical Validation of Nursing Diagnoses Related to Subjective Foci.

Science.gov (United States)

Miguel, Susana; Caldeira, Sílvia; Vieira, Margarida

2018-04-01

This article describes the adequacy of the Q methodology as a new option for the validation of nursing diagnoses related to subjective foci. Discussion paper about the characteristics of the Q methodology. This method has been used in nursing research particularly related to subjective concepts and includes both a quantitative and qualitative dimension. The Q methodology seems to be an adequate and innovative method for the clinical validation of nursing diagnoses. The validation of nursing diagnoses related to subjective foci using the Q methodology could improve the level of evidence and provide nurses with clinical indicators for clinical reasoning and for the planning of effective interventions. Descrever a adequação da metodologia Q como uma nova opção para a validação clínica de diagnósticos de enfermagem relacionados com focos subjetivos. MÉTODOS: Artigo de discussão sobre as características da metodologia Q. Este método tem sido utilizado na pesquisa em enfermagem relacionada com conceitos subjetivos e inclui em simultâneo uma vertente qualitativa e quantitativa. CONCLUSÕES: A metodologia Q parece ser uma opção metodológica adequada para a validação clínica de diagnósticos de enfermagem. IMPLICAÇÕES PARA A PRÁTICA: A utilização da metodologia Q na validação clínica de diagnósticos de enfermagem relacionados com focos subjetivos pode melhorar o nível e evidência e facilitar o raciocínio clínico dos enfermeiros, ao providenciar indicadores clínicos também necessários ao desenvolvimento de intervenções efetivas. © 2016 NANDA International, Inc.

Methodology for Computational Fluid Dynamic Validation for Medical Use: Application to Intracranial Aneurysm.

Science.gov (United States)

Paliwal, Nikhil; Damiano, Robert J; Varble, Nicole A; Tutino, Vincent M; Dou, Zhongwang; Siddiqui, Adnan H; Meng, Hui

2017-12-01

Computational fluid dynamics (CFD) is a promising tool to aid in clinical diagnoses of cardiovascular diseases. However, it uses assumptions that simplify the complexities of the real cardiovascular flow. Due to high-stakes in the clinical setting, it is critical to calculate the effect of these assumptions in the CFD simulation results. However, existing CFD validation approaches do not quantify error in the simulation results due to the CFD solver's modeling assumptions. Instead, they directly compare CFD simulation results against validation data. Thus, to quantify the accuracy of a CFD solver, we developed a validation methodology that calculates the CFD model error (arising from modeling assumptions). Our methodology identifies independent error sources in CFD and validation experiments, and calculates the model error by parsing out other sources of error inherent in simulation and experiments. To demonstrate the method, we simulated the flow field of a patient-specific intracranial aneurysm (IA) in the commercial CFD software star-ccm+. Particle image velocimetry (PIV) provided validation datasets for the flow field on two orthogonal planes. The average model error in the star-ccm+ solver was 5.63 ± 5.49% along the intersecting validation line of the orthogonal planes. Furthermore, we demonstrated that our validation method is superior to existing validation approaches by applying three representative existing validation techniques to our CFD and experimental dataset, and comparing the validation results. Our validation methodology offers a streamlined workflow to extract the "true" accuracy of a CFD solver.

Clinical assessment of the physical activity pattern of chronic fatigue syndrome patients: a validation of three methods

Directory of Open Access Journals (Sweden)

Meer van der Jos

2009-04-01

Full Text Available Abstract Background Effective treatment of chronic fatigue syndrome (CFS with cognitive behavioural therapy (CBT relies on a correct classification of so called 'fluctuating active' versus 'passive' patients. For successful treatment with CBT is it especially important to recognise the passive patients and give them a tailored treatment protocol. In the present study it was evaluated whether CFS patient's physical activity pattern can be assessed most accurately with the 'Activity Pattern Interview' (API, the International Physical Activity Questionnaire (IPAQ or the CFS-Activity Questionnaire (CFS-AQ. Methods The three instruments were validated compared to actometers. Actometers are until now the best and most objective instrument to measure physical activity, but they are too expensive and time consuming for most clinical practice settings. In total 226 CFS patients enrolled for CBT therapy answered the API at intake and filled in the two questionnaires. Directly after intake they wore the actometer for two weeks. Based on receiver operating characteristic (ROC curves the validity of the three methods were assessed and compared. Results Both the API and the two questionnaires had an acceptable validity (0.64 to 0.71. None of the three instruments was significantly better than the others. The proportion of false predictions was rather high for all three instrument. The IPAQ had the highest proportion of correct passive predictions (sensitivity 70.1%. Conclusion The validity of all three instruments appeared to be fair, and all showed rather high proportions of false classifications. Hence in fact none of the tested instruments could really be called satisfactory. Because the IPAQ showed to be the best in correctly predicting 'passive' CFS patients, which is most essentially related to treatment results, it was concluded that the IPAQ is the preferable alternative for an actometer when treating CFS patients in clinical practice.

Validation of HEDR models

International Nuclear Information System (INIS)

Napier, B.A.; Simpson, J.C.; Eslinger, P.W.; Ramsdell, J.V. Jr.; Thiede, M.E.; Walters, W.H.

1994-05-01

The Hanford Environmental Dose Reconstruction (HEDR) Project has developed a set of computer models for estimating the possible radiation doses that individuals may have received from past Hanford Site operations. This document describes the validation of these models. In the HEDR Project, the model validation exercise consisted of comparing computational model estimates with limited historical field measurements and experimental measurements that are independent of those used to develop the models. The results of any one test do not mean that a model is valid. Rather, the collection of tests together provide a level of confidence that the HEDR models are valid

Validation studies of nursing diagnoses in neonatology

Directory of Open Access Journals (Sweden)

Pavlína Rabasová

2016-03-01

Full Text Available Aim: The objective of the review was the analysis of Czech and foreign literature sources and professional periodicals to obtain a relevant comprehensive overview of validation studies of nursing diagnoses in neonatology. Design: Review. Methods: The selection criterion was studies concerning the validation of nursing diagnoses in neonatology. To obtain data from relevant sources, the licensed professional databases EBSCO, Web of Science and Scopus were utilized. The search criteria were: date of publication - unlimited; academic periodicals - full text; peer-reviewed periodicals; search language - English, Czech and Slovak. Results: A total of 788 studies were found. Only 5 studies were eligible for content analysis, dealing specifically with validation of nursing diagnoses in neonatology. The analysis of the retrieved studies suggests that authors are most often concerned with identifying the defining characteristics of nursing diagnoses applicable to both the mother (parents and the newborn. The diagnoses were validated in the domains Role Relationship; Coping/Stress tolerance; Activity/Rest, and Elimination and Exchange. Diagnoses represented were from the field of dysfunctional physical needs as well as the field of psychosocial and spiritual needs. The diagnoses were as follows: Parental role conflict (00064; Impaired parenting (00056; Grieving (00136; Ineffective breathing pattern (00032; Impaired gas exchange (00030; and Impaired spontaneous ventilation (00033. Conclusion: Validation studies enable effective planning of interventions with measurable results and support clinical nursing practice.

Validity of Newborn Clinical Assessment to Determine Gestational Age in Bangladesh.

Science.gov (United States)

Lee, Anne Cc; Mullany, Luke C; Ladhani, Karima; Uddin, Jamal; Mitra, Dipak; Ahmed, Parvez; Christian, Parul; Labrique, Alain; DasGupta, Sushil K; Lokken, R Peter; Quaiyum, Mohammed; Baqui, Abdullah H

2016-07-01

Gestational age (GA) is frequently unknown or inaccurate in pregnancies in low-income countries. Early identification of preterm infants may help link them to potentially life-saving interventions. We conducted a validation study in a community-based birth cohort in rural Bangladesh. GA was determined by pregnancy ultrasound (distribution, agreement, and diagnostic accuracy of different clinical methods of GA assessment were determined compared with early ultrasound dating. In the live-born cohort (n = 1066), the mean ultrasound GA was 39.1 weeks (SD 2.0) and prevalence of preterm birth (births (community health worker prematurity scorecard [sensitivity/specificity: 70%/27%]; Capurro [5%/96%]; Eregie [75%/58%]; Bhagwat [18%/87%], foot length birth weight rates of fetal growth restriction. Copyright © 2016 by the American Academy of Pediatrics.

Reliability and validity of the Bowel Function Index for evaluating opioid-induced constipation: translation, cultural adaptation and validation of the Portuguese version (BFI-P).

Science.gov (United States)

Dueñas, María; Mendonça, Liliane; Sampaio, Rute; Gouvinhas, Cláudia; Oliveira, Daniela; Castro-Lopes, José Manuel; Azevedo, Luís Filipe

2017-03-01

The Bowel Function Index (BFI) is a simple and sound bowel function and opioid-induced constipation (OIC) screening tool. We aimed to develop the translation and cultural adaptation of this measure (BFI-P) and to assess its reliability and validity for the Portuguese language and a chronic pain population. The BFI-P was created after a process including translation, back translation and cultural adaptation. Participants (n = 226) were recruited in a chronic pain clinic and were assessed at baseline and after one week. Internal consistency, test-retest reliability, responsiveness, construct (convergent and known groups) and factorial validity were assessed. Test-retest reliability had an intra-class correlation of 0.605 for BFI mean score. Internal consistency of BFI had Cronbach's alpha of 0.865. The construct validity of BFI-P was shown to be excellent and the exploratory factor analysis confirmed its unidimensional structure. The responsiveness of BFI-P was excellent, with a suggested 17-19 point and 8-12 point change in score constituting a clinically relevant change in constipation for patients with and without previous constipation, respectively. This study had some limitations, namely, the criterion validity of BFI-P was not directly assessed; and the absence of a direct criterion for OIC precluded the assessment of the criterion based responsiveness of BFI-P. Nevertheless, BFI may importantly contribute to better OIC screening and its Portuguese version (BFI-P) has been shown to have excellent reliability, internal consistency, validity and responsiveness. Further suggestions regarding statistically and clinically important change cut-offs for this instrument are presented.

Validation of the Prague C&M classification of Barrett's esophagus in clinical practice

NARCIS (Netherlands)

Alvarez Herrero, Lorenza; Curvers, Wouter L.; van Vilsteren, Frederike G. I.; Wolfsen, Herbert; Ragunath, Krish; Wong Kee Song, Louis-Michel; Mallant-Hent, Rosalie C.; van Oijen, Arnoud; Scholten, Pieter; Schoon, Erik J.; Schenk, Ed B. E.; Weusten, Bas L. A. M.; Bergman, Jacques G. H. M.

2013-01-01

Background and study aims: The Prague C&M classification for Barrett's esophagus has found widespread acceptance but has only been validated by Barrett's experts scoring video sequences. To date, validation has been lacking for its application in routine practice during real-time endoscopy. The aim

Clinical endpoint adjudication in a contemporary all-comers coronary stent investigation: methodology and external validation.

Science.gov (United States)

Vranckx, Pascal; McFadden, Eugene; Cutlip, Donald E; Mehran, Roxana; Swart, Michael; Kint, P P; Zijlstra, Felix; Silber, Sigmund; Windecker, Stephan; Serruys, Patrick W C J

2013-01-01

Globalisation in coronary stent research calls for harmonization of clinical endpoint definitions and event adjudication. Little has been published about the various processes used for event adjudication or their impact on outcome reporting. We performed a validation of the clinical event committee (CEC) adjudication process on 100 suspected events in the RESOLUTE All-comers trial (Resolute-AC). Two experienced Clinical Research Organisations (CRO) that had already extensive internal validation processes in place, participated in the study. After initial adjudication by the primary-CEC, events were cross-adjudicated by an external-CEC using the same definitions. Major discrepancies affecting the primary end point of target-lesion failure (TLF), a composite of cardiac death, target vessel myocardial infarction (TV-MI), or clinically-indicated target-lesion revascularization (CI-TLR), were analysed by an independent oversight committee who provided recommendations for harmonization. Discordant adjudications were reconsidered by the primary CEC. Subsequently, the RAC database was interrogated for cases that based on these recommendations merited re-adjudication and these cases were also re-adjudicated by the primary CEC. Final discrepancies in adjudication of individual components of TLF occurred in 7 out of 100 events in 5 patients. Discrepancies for the (hierarchical) primary endpoint occurred in 5 events (2 cardiac deaths and 3 TV-MI). After application of harmonization recommendations to the overall RAC population (n=2292), the primary CEC adjudicated 3 additional clinical-TLRs and considered 1 TV-MI as no event. A harmonization process provided a high level of concordance for event adjudication and improved accuracy for final event reporting. These findings suggest it is feasible to pool clinical event outcome data across clinical trials even when different CECs are responsible for event adjudication. Copyright © 2012 Elsevier Inc. All rights reserved.

Translation and cultural validation of clinical observational scales - the Fugl-Meyer assessment for post stroke sensorimotor function in Colombian Spanish.

Science.gov (United States)

Barbosa, Nubia E; Forero, Sandra M; Galeano, Claudia P; Hernández, Edgar D; Landinez, Nancy S; Sunnerhagen, Katharina S; Alt Murphy, Margit

2018-04-24

Fugl-Meyer Assessment (FMA) is the most widely used and recommended clinical scale for evaluation of sensorimotor impairment post stroke, but an official Spanish version is not available today. This study aimed to establish methodological structure for translation and cultural adaptation process and perform a transcultural validation of the upper and lower extremity FMA to Colombian Spanish. Procedures included forward and backward translation, step-wise reviewing by bilingual and professional experts to ensure conceptual and semantic equivalence. Validation included a pilot evaluation of item-level agreement on 10 individuals with stroke at the Central Military Hospital of Colombia. Comprehensive step-wise procedure for transcultural validation was established. Low agreement (less than 70%) was detected for items assessing arm movements within synergies and for coordination/speed subscale. All points of disagreement were systematically reviewed and agreed upon when drafting the final version of the Spanish FMA. Use of FMA will allow unified description of stroke severity and motor recovery in Spanish speaking countries. This will open up possibility to compare stroke and rehabilitation outcomes with other countries and regions world-wide. Comprehensive methodological procedures provided can facilitate introduction of well-established clinical scales in other languages. Implications for Rehabilitation The Fugl-Meyer Assessment (FMA) of upper and lower extremity is the most used and recommended clinical scale for evaluation of sensorimotor impairment after stroke. The Spanish version of FMA, validated in this study, is now first time available for use in research and clinical practice. Use of FMA will allow unified description of stroke severity and motor recovery in Spanish speaking countries, which in turn opens up possibility to compare stroke and rehabilitation outcomes with other countries and regions world-wide.

Validation suite for MCNP

International Nuclear Information System (INIS)

Mosteller, Russell D.

2002-01-01

Two validation suites, one for criticality and another for radiation shielding, have been defined and tested for the MCNP Monte Carlo code. All of the cases in the validation suites are based on experiments so that calculated and measured results can be compared in a meaningful way. The cases in the validation suites are described, and results from those cases are discussed. For several years, the distribution package for the MCNP Monte Carlo code1 has included an installation test suite to verify that MCNP has been installed correctly. However, the cases in that suite have been constructed primarily to test options within the code and to execute quickly. Consequently, they do not produce well-converged answers, and many of them are physically unrealistic. To remedy these deficiencies, sets of validation suites are being defined and tested for specific types of applications. All of the cases in the validation suites are based on benchmark experiments. Consequently, the results from the measurements are reliable and quantifiable, and calculated results can be compared with them in a meaningful way. Currently, validation suites exist for criticality and radiation-shielding applications.

Evaluation of construct and criterion validity for the 'Liverpool Osteoarthritis in Dogs' (LOAD clinical metrology instrument and comparison to two other instruments.

Directory of Open Access Journals (Sweden)

Myles Benjamin Walton

Full Text Available To test the 'Liverpool Osteoarthritis in Dogs' (LOAD questionnaire for construct and criterion validity, and to similarly test the Helsinki Chronic Pain Index (HCPI and the Canine Brief Pain Inventory (CBPI.Prospective Study.222 dogs with osteoarthritis.Osteoarthritis was diagnosed in a cohort of dogs on the basis of clinical history and orthopedic examination. Force-platform analysis was performed and a "symmetry index" for peak vertical force (PVF was calculated. Owners completed LOAD, CBPI and HCPI instruments. As a test of construct validity, inter-instrument correlations were calculated. As a test of criterion validity, the correlations between instrument scores and PVF symmetry scores were calculated. Additionally, internal consistency of all instruments was calculated and compared to those previously reported. Factor analysis is reported for the first time for LOAD, and is compared to that previously reported for CBPI and HCPI.Significant moderate correlations were found between all instruments, implying construct validity for all instruments. Significant weak correlations were found between LOAD scores and PVF symmetry index, and between CBPI scores and PVF symmetry index.LOAD is an owner-completed clinical metrology instrument that can be recommended for the measurement of canine osteoarthritis. It is convenient to use, validated and, as demonstrated here for the first time, has a correlation with force-platform data.

Psychometric Properties and Validation of the Positive and Negative Suicide Ideation (PANSI) Inventory in an Outpatient Clinical Population in Malaysia.

Science.gov (United States)

Sinniah, Aishvarya; Oei, Tian P S; Chinna, Karuthan; Shah, Shamsul A; Maniam, T; Subramaniam, Ponnusamy

2015-01-01

The PANSI is a measure designed to assess the risk and protective factors related to suicidal behaviors. The present study evaluated the psychometric properties and factor structure of the Positive and Negative Suicide Ideation (PANSI) Inventory in a sample of clinical outpatients at a major hospital in Malaysia. In this study, 283 psychiatric patients and 200 medical (non-psychiatric) patients participated. All the patients completed the PANSI and seven other self-report instruments. Confirmative factor analysis supported the 2-factor oblique model. The internal consistency of the two subscales of PANSI-Negative and the PANSI-Positive were 0.93 and 0.84, respectively. In testing construct validity, PANSI showed sizable correlation with the other seven scales. Criterion validity was supported by scores on PANSI which differentiated psychiatric patients from medical patients. Logistic regression analyses showed PANSI can be used to classify the patients into suicidal or non-suicidal. The PANSI is a reliable and valid instrument to measure the severity of suicidal ideation among clinical outpatients in Malaysia.

PSYCHOMETRIC PROPERTIES AND VALIDATION OF THE POSITIVE AND NEGATIVE SUICIDE IDEATION (PANSI INVENTORY IN AN OUTPATIENT CLINICAL POPULATION IN MALAYSIA

Directory of Open Access Journals (Sweden)

Aishvarya eSinniah

2015-12-01

Full Text Available The PANSI is a measure designed to assess the risk and protective factors related to suicidal behaviors. The present study evaluated the psychometric properties and factor structure of the Positive and Negative Suicide Ideation (PANSI Inventory in a sample of clinical outpatients at a major hospital in Malaysia. In this study, 283 psychiatric patients and 200 medical (non- psychiatric patients participated. All the patients completed the PANSI and seven other self-report instruments. Confirmative factor analysis supported the 2-factor oblique model. The internal consistency of the two subscales of PANSI-Negative and the PANSI-Positive were 0.93 and 0.84, respectively. In testing construct validity, PANSI showed sizable correlation with the other seven scales. Criterion validity was supported by scores on PANSI which differentiated psychiatric patients from medical patients. Logistic regression analyses showed PANSI can be used to classify the patients into suicidal or non-suicidal. The PANSI is a reliable and valid instrument to measure the severity of suicidal ideation among clinical outpatients in Malaysia.

Development and initial validity of the in-hand manipulation assessment.

Science.gov (United States)

Klymenko, Gabrielle; Liu, Karen P Y; Bissett, Michelle; Fong, Kenneth N K; Welage, Nandana; Wong, Rebecca S M

2018-04-01

A review of the literature related to in-hand manipulation (IHM) revealed that there is no assessment which specifically measures this construct in the adult population. This study reports the face and content validity of an IHM assessment for adults with impaired hand function based on expert opinion. The definition of IHM skills, assessment tasks and scoring methods identified from literature was discussed in a focus group (n = 4) to establish face validity. An expert panel (n = 16) reviewed the content validity of the proposed assessment; evaluating the representativeness and relevance of encompassing the IHM skills in the proposed assessment tasks, the clarity and importance to daily life of the task and the clarity and applicability to clinical environment of the scoring method. The content validity was calculated using the content validity index for both the individual task and all tasks together (I-CVI and S-CVI). Feedback was incorporated to create the assessment. The focus group members agreed to include 10 assessment tasks that covered all IHM skills. In the expert panel review, all tasks received an I-CVI above 0.78 and S-CVI above 0.80 in representativeness and relevance ratings, representing good content validity. With the comments from the expert panel, tasks were modified to improve the clarity and importance to daily life. A four-point Likert scale was identified for assessing both the completion of the assessment tasks and the quality of IHM skills within the task performance. Face and content validity were established in this new IHM assessment. Further studies to examine psychometric properties and use within clinical practice are recommended. © 2018 Occupational Therapy Australia.

Clinical validation of immunoglobulin A nephropathy diagnosis in Swedish biopsy registers

Directory of Open Access Journals (Sweden)

Jarrick S

2017-01-01

Full Text Available Simon Jarrick,1,2 Sigrid Lundberg,3,4 Adina Welander,5,6 C Michael Fored,6 Jonas F Ludvigsson2,7,8 1Department of Pediatrics, Faculty of Health and Medicine, Örebro University, 2Department of Pediatrics, Örebro University Hospital, Örebro, 3Department of Nephrology, Karolinska University Hospital, 4Department of Clinical Science, Intervention and Technology, Karolinska Institutet, 5Boston Consulting Group, 6Clinical Epidemiology Unit, Department of Medicine, 7Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden; 8Division of Epidemiology and Public Health, School of Medicine, University of Nottingham, Nottingham, UK Aims: The aims of this study were to validate the diagnosis of IgA nephropathy (IgAN in Swedish biopsy registers against patient charts and to describe the clinical characteristics of patients with a biopsy indicating IgAN. Methods: This is a population-based cohort study. Out of 4,069 individuals with a renal biopsy consistent with IgAN (biopsies performed in 1974–2011, this study reviewed patient charts of a random subset of 127 individuals. Clinical and biopsy characteristics at the time of biopsy were evaluated, and positive predictive values (PPV were calculated with 95% confidence intervals (CI. Results: Out of 127 individuals with a renal biopsy consistent with IgAN, 121 had a likely or confirmed clinical diagnosis of IgAN, primary or secondary to Henoch–Schönlein purpura, yielding a PPV of 95% (95% CI =92%–99%. The median age at biopsy was 39 years (range: 4–79 years; seven patients (6% were <16 years. The male to female ratio was 2.8:1. The most common causes for consultation were macroscopic hematuria (n=37; 29%, screening (n=33; 26%, and purpura (n=14, 11%. In patients with available data, the median creatinine level was 104 µmol/L (range 26–986 µmol/L, n=110 and glomerular filtration rate 75 mL/min/1.73m² (range 5–173 mL/min/1.73m², n=114. Hypertension was

Development and validation of clinical prediction models for mortality, functional outcome and cognitive impairment after stroke: a study protocol.

Science.gov (United States)

Fahey, Marion; Rudd, Anthony; Béjot, Yannick; Wolfe, Charles; Douiri, Abdel

2017-08-18

Stroke is a leading cause of adult disability and death worldwide. The neurological impairments associated with stroke prevent patients from performing basic daily activities and have enormous impact on families and caregivers. Practical and accurate tools to assist in predicting outcome after stroke at patient level can provide significant aid for patient management. Furthermore, prediction models of this kind can be useful for clinical research, health economics, policymaking and clinical decision support. 2869 patients with first-ever stroke from South London Stroke Register (SLSR) (1995-2004) will be included in the development cohort. We will use information captured after baseline to construct multilevel models and a Cox proportional hazard model to predict cognitive impairment, functional outcome and mortality up to 5 years after stroke. Repeated random subsampling validation (Monte Carlo cross-validation) will be evaluated in model development. Data from participants recruited to the stroke register (2005-2014) will be used for temporal validation of the models. Data from participants recruited to the Dijon Stroke Register (1985-2015) will be used for external validation. Discrimination, calibration and clinical utility of the models will be presented. Patients, or for patients who cannot consent their relatives, gave written informed consent to participate in stroke-related studies within the SLSR. The SLSR design was approved by the ethics committees of Guy's and St Thomas' NHS Foundation Trust, Kings College Hospital, Queens Square and Westminster Hospitals (London). The Dijon Stroke Registry was approved by the Comité National des Registres and the InVS and has authorisation of the Commission Nationale de l'Informatique et des Libertés. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and validation of Burkholderia pseudomallei-specific real-time PCR assays for clinical, environmental or forensic detection applications.

Directory of Open Access Journals (Sweden)

Erin P Price

Full Text Available The bacterium Burkholderia pseudomallei causes melioidosis, a rare but serious illness that can be fatal if untreated or misdiagnosed. Species-specific PCR assays provide a technically simple method for differentiating B. pseudomallei from near-neighbor species. However, substantial genetic diversity and high levels of recombination within this species reduce the likelihood that molecular signatures will differentiate all B. pseudomallei from other Burkholderiaceae. Currently available molecular assays for B. pseudomallei detection lack rigorous validation across large in silico datasets and isolate collections to test for specificity, and none have been subjected to stringent quality control criteria (accuracy, precision, selectivity, limit of quantitation (LoQ, limit of detection (LoD, linearity, ruggedness and robustness to determine their suitability for environmental, clinical or forensic investigations. In this study, we developed two novel B. pseudomallei specific assays, 122018 and 266152, using a dual-probe approach to differentiate B. pseudomallei from B. thailandensis, B. oklahomensis and B. thailandensis-like species; other species failed to amplify. Species specificity was validated across a large DNA panel (>2,300 samples comprising Burkholderia spp. and non-Burkholderia bacterial and fungal species of clinical and environmental relevance. Comparison of assay specificity to two previously published B. pseudomallei-specific assays, BurkDiff and TTS1, demonstrated comparable performance of all assays, providing between 99.7 and 100% specificity against our isolate panel. Last, we subjected 122018 and 266152 to rigorous quality control analyses, thus providing quantitative limits of assay performance. Using B. pseudomallei as a model, our study provides a framework for comprehensive quantitative validation of molecular assays and provides additional, highly validated B. pseudomallei assays for the scientific research community.

External validation and comparison of three pediatric clinical dehydration scales.

Science.gov (United States)

Jauregui, Joshua; Nelson, Daniel; Choo, Esther; Stearns, Branden; Levine, Adam C; Liebmann, Otto; Shah, Sachita P

2014-01-01

To prospectively validate three popular clinical dehydration scales and overall physician gestalt in children with vomiting or diarrhea relative to the criterion standard of percent weight change with rehydration. We prospectively enrolled a non-consecutive cohort of children ≤ 18 years of age with an acute episode of diarrhea or vomiting. Patient weight, clinical scale variables and physician clinical impression, or gestalt, were recorded before and after fluid resuscitation in the emergency department and upon hospital discharge. The percent weight change from presentation to discharge was used to calculate the degree of dehydration, with a weight change of ≥ 5% considered significant dehydration. Receiver operating characteristics (ROC) curves were constructed for each of the three clinical scales and physician gestalt. Sensitivity and specificity were calculated based on the best cut-points of the ROC curve. We approached 209 patients, and of those, 148 were enrolled and 113 patients had complete data for analysis. Of these, 10.6% had significant dehydration based on our criterion standard. The Clinical Dehydration Scale (CDS) and Gorelick scales both had an area under the ROC curve (AUC) statistically different from the reference line with AUCs of 0.72 (95% CI 0.60, 0.84) and 0.71 (95% CI 0.57, 0.85) respectively. The World Health Organization (WHO) scale and physician gestalt had AUCs of 0.61 (95% CI 0.45, 0.77) and 0.61 (0.44, 0.78) respectively, which were not statistically significant. The Gorelick scale and Clinical Dehydration Scale were fair predictors of dehydration in children with diarrhea or vomiting. The World Health Organization scale and physician gestalt were not helpful predictors of dehydration in our cohort.

Development and validation of the brief esophageal dysphagia questionnaire.

Science.gov (United States)

Taft, T H; Riehl, M; Sodikoff, J B; Kahrilas, P J; Keefer, L; Doerfler, B; Pandolfino, J E

2016-12-01

Esophageal dysphagia is common in gastroenterology practice and has multiple etiologies. A complication for some patients with dysphagia is food impaction. A valid and reliable questionnaire to rapidly evaluate esophageal dysphagia and impaction symptoms can aid the gastroenterologist in gathering information to inform treatment approach and further evaluation, including endoscopy. 1638 patients participated over two study phases. 744 participants completed the Brief Esophageal Dysphagia Questionnaire (BEDQ) for phase 1; 869 completed the BEDQ, Visceral Sensitivity Index, Gastroesophageal Reflux Disease Questionnaire, and Hospital Anxiety and Depression Scale for phase 2. Demographic and clinical data were obtained via the electronic medical record. The BEDQ was evaluated for internal consistency, split-half reliability, ceiling and floor effects, and construct validity. The BEDQ demonstrated excellent internal consistency, reliability, and construct validity. The symptom frequency and severity scales scored above the standard acceptable cutoffs for reliability while the impaction subscale yielded poor internal consistency and split-half reliability; thus the impaction items were deemed qualifiers only and removed from the total score. No significant ceiling or floor effects were found with the exception of 1 item, and inter-item correlations fell within accepted ranges. Construct validity was supported by moderate yet significant correlations with other measures. The predictive ability of the BEDQ was small but significant. The BEDQ represents a rapid, reliable, and valid assessment tool for esophageal dysphagia with food impaction for clinical practice that differentiates between patients with major motor dysfunction and mechanical obstruction. © 2016 John Wiley & Sons Ltd.

External validation of a clinical prediction rule to predict full recovery and ongoing moderate/severe disability following acute whiplash injury.

Science.gov (United States)

Ritchie, Carrie; Hendrikz, Joan; Jull, Gwendolen; Elliott, James; Sterling, Michele

2015-04-01

Retrospective secondary analysis of data. To investigate the external validity of the whiplash clinical prediction rule (CPR). We recently derived a whiplash CPR to consolidate previously established prognostic factors for poor recovery from a whiplash injury and predicted 2 recovery pathways. Prognostic factors for full recovery were being less than 35 years of age and having an initial Neck Disability Index (NDI) score of 32% or less. Prognostic factors for ongoing moderate/severe pain and disability were being 35 years of age or older, having an initial NDI score of 40% or more, and the presence of hyperarousal symptoms. Validation is required to confirm the reproducibility and accuracy of this CPR. Clinician feedback on the usefulness of the CPR is also important to gauge acceptability. A secondary analysis of data from 101 individuals with acute whiplash-associated disorder who had previously participated in either a randomized controlled clinical trial or prospective cohort study was performed using accuracy statistics. Full recovery was defined as NDI score at 6 months of 10% or less, and ongoing moderate/severe pain and disability were defined as an NDI score at 6 months of 30% or greater. In addition, a small sample of physical therapists completed an anonymous survey on the clinical acceptability and usability of the tool. Results The positive predictive value of ongoing moderate/severe pain and disability was 90.9% in the validation cohort, and the positive predictive value of full recovery was 80.0%. Surveyed physical therapists reported that the whiplash CPR was simple, understandable, would be easy to use, and was an acceptable prognostic tool. External validation of the whiplash CPR confirmed the reproducibility and accuracy of this dual-pathway tool for individuals with acute whiplash-associated disorder. Further research is needed to assess prospective validation, the impact of inclusion on practice, and to examine the efficacy of linking treatment

Descriptive analysis of the verbal behavior of a therapist: a known-group validity analysis of the putative behavioral functions involved in clinical interaction.

Science.gov (United States)

Virues-Ortega, Javier; Montaño-Fidalgo, Montserrat; Froján-Parga, María Xesús; Calero-Elvira, Ana

2011-12-01

This study analyzes the interobserver agreement and hypothesis-based known-group validity of the Therapist's Verbal Behavior Category System (SISC-INTER). The SISC-INTER is a behavioral observation protocol comprised of a set of verbal categories representing putative behavioral functions of the in-session verbal behavior of a therapist (e.g., discriminative, reinforcing, punishing, and motivational operations). The complete therapeutic process of a clinical case of an individual with marital problems was recorded (10 sessions, 8 hours), and data were arranged in a temporal sequence using 10-min periods. Hypotheses based on the expected performance of the putative behavioral functions portrayed by the SISC-INTER codes across prevalent clinical activities (i.e., assessing, explaining, Socratic method, providing clinical guidance) were tested using autoregressive integrated moving average (ARIMA) models. Known-group validity analyses provided support to all hypotheses. The SISC-INTER may be a useful tool to describe therapist-client interaction in operant terms. The utility of reliable and valid protocols for the descriptive analysis of clinical practice in terms of verbal behavior is discussed. Copyright © 2011. Published by Elsevier Ltd.

Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation.

Science.gov (United States)

Chen, Poyu; Lin, Keh-Chung; Liing, Rong-Jiuan; Wu, Ching-Yi; Chen, Chia-Ling; Chang, Ku-Chou

2016-06-01

To examine the criterion validity, responsiveness, and minimal clinically important difference (MCID) of the EuroQoL 5-Dimensions Questionnaire (EQ-5D-5L) and visual analog scale (EQ-VAS) in people receiving rehabilitation after stroke. The EQ-5D-5L, along with four criterion measures-the Medical Research Council scales for muscle strength, the Fugl-Meyer assessment, the functional independence measure, and the Stroke Impact Scale-was administered to 65 patients with stroke before and after 3- to 4-week therapy. Criterion validity was estimated using the Spearman correlation coefficient. Responsiveness was analyzed by the effect size, standardized response mean (SRM), and criterion responsiveness. The MCID was determined by anchor-based and distribution-based approaches. The percentage of patients exceeding the MCID was also reported. Concurrent validity of the EQ-Index was better compared with the EQ-VAS. The EQ-Index has better power for predicting the rehabilitation outcome in the activities of daily living than other motor-related outcome measures. The EQ-Index was moderately responsive to change (SRM = 0.63), whereas the EQ-VAS was only mildly responsive to change. The MCID estimation of the EQ-Index (the percentage of patients exceeding the MCID) was 0.10 (33.8 %) and 0.10 (33.8 %) based on the anchor-based and distribution-based approaches, respectively, and the estimation of EQ-VAS was 8.61 (41.5 %) and 10.82 (32.3 %). The EQ-Index has shown reasonable concurrent validity, limited predictive validity, and acceptable responsiveness for detecting the health-related quality of life in stroke patients undergoing rehabilitation, but not for EQ-VAS. Future research considering different recovery stages after stroke is warranted to validate these estimations.

Validity in Qualitative Evaluation

OpenAIRE

Vasco Lub

2015-01-01

This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate), the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of con...

Verification and validation benchmarks.

Energy Technology Data Exchange (ETDEWEB)

Oberkampf, William Louis; Trucano, Timothy Guy

2007-02-01

Verification and validation (V&V) are the primary means to assess the accuracy and reliability of computational simulations. V&V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V&V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the level of

Measurement-based Treatment of Residual Symptoms Using Clinically Useful Depression Outcome Scale: Korean Validation Study

Science.gov (United States)

Jeon, Sang Won; Han, Changsu; Ko, Young-Hoon; Yoon, Seo Young; Pae, Chi-Un; Choi, Joonho; Park, Yong Chon; Kim, Jong-Woo; Yoon, Ho-Kyoung; Ko, Seung-Duk; Patkar, Ashwin A.; Zimmerman, Mark

2017-01-01

Objective This study was aimed at evaluating the diagnostic validity of the Korean version of the Clinically Useful Depression Outcome Scale (CUDOS) with varying follow-up in a typical clinical setting in multiple centers. Methods In total, 891 psychiatric outpatients were enrolled at the time of their intake appointment. Current diagnostic characteristics were examined using the Structured Clinical Interview for DSM-IV (41% major depressive disorder). The CUDOS was measured and compared with three clinician rating scales and four self-report scales. Results The CUDOS showed excellent results for internal consistency (Cronbach’s α, 0.91), test-retest reliability (patients at intake, r=0.81; depressed patients in ongoing treatment, r=0.89), and convergent and discriminant validity (measures of depression, r=0.80; measures of anxiety and somatization, r=0.42). The CUDOS had a high ability to discriminate between different levels of depression severity based on the rating of Clinical Global Impression for depression severity and the diagnostic classification of major depression, minor depression, and non-depression. The ability of the CUDOS to identify patients with major depression was high (area under the receiver operating characteristic curve=0.867). A score of 20 as the optimal cutoff point was suggested when screening for major depression using the CUDOS (sensitivity=89.9%, specificity=69.5%). The CUDOS was sensitive to change after antidepressant treatment: patients with greater improvement showed a greater decrease in CUDOS scores (p<0.001). Conclusion The results of this multi-site outpatient study found that the Korean version of the CUDOS is a very useful measurement for research and for clinical practice. PMID:28138107

Site characterization and validation - validation drift fracture data, stage 4

International Nuclear Information System (INIS)

Bursey, G.; Gale, J.; MacLeod, R.; Straahle, A.; Tiren, S.

1991-08-01

This report describes the mapping procedures and the data collected during fracture mapping in the validation drift. Fracture characteristics examined include orientation, trace length, termination mode, and fracture minerals. These data have been compared and analysed together with fracture data from the D-boreholes to determine the adequacy of the borehole mapping procedures and to assess the nature and degree of orientation bias in the borehole data. The analysis of the validation drift data also includes a series of corrections to account for orientation, truncation, and censoring biases. This analysis has identified at least 4 geologically significant fracture sets in the rock mass defined by the validation drift. An analysis of the fracture orientations in both the good rock and the H-zone has defined groups of 7 clusters and 4 clusters, respectively. Subsequent analysis of the fracture patterns in five consecutive sections along the validation drift further identified heterogeneity through the rock mass, with respect to fracture orientations. These results are in stark contrast to the results form the D-borehole analysis, where a strong orientation bias resulted in a consistent pattern of measured fracture orientations through the rock. In the validation drift, fractures in the good rock also display a greater mean variance in length than those in the H-zone. These results provide strong support for a distinction being made between fractures in the good rock and the H-zone, and possibly between different areas of the good rock itself, for discrete modelling purposes. (au) (20 refs.)

Criterion Validation Testing of Clinical Metrology Instruments for Measuring Degenerative Joint Disease Associated Mobility Impairment in Cats.

Science.gov (United States)

Gruen, Margaret E; Griffith, Emily H; Thomson, Andrea E; Simpson, Wendy; Lascelles, B Duncan X

2015-01-01

Degenerative joint disease and associated pain are common in cats, particularly in older cats. There is a need for treatment options, however evaluation of putative therapies is limited by a lack of suitable, validated outcome measures that can be used in the target population of client owned cats. The objectives of this study were to evaluate low-dose daily meloxicam for the treatment of pain associated with degenerative joint disease in cats, and further validate two clinical metrology instruments, the Feline Musculoskeletal Pain Index (FMPI) and the Client Specific Outcome Measures (CSOM). Sixty-six client owned cats with degenerative joint disease and owner-reported impairments in mobility were screened and enrolled into a double-masked, placebo-controlled, randomized clinical trial. Following a run-in baseline period, cats were given either placebo or meloxicam for 21 days, then in a masked washout, cats were all given placebo for 21 days. Subsequently, cats were given the opposite treatment, placebo or meloxicam, for 21 days. Cats wore activity monitors throughout the study, owners completed clinical metrology instruments following each period. Activity counts were increased in cats during treatment with daily meloxicam (pdegenerative joint disease.

Validity evidence and reliability of a simulated patient feedback instrument.

Science.gov (United States)

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Outcomes validity and reliability of the modified Rankin scale: implications for stroke clinical trials: a literature review and synthesis.

Science.gov (United States)

Banks, Jamie L; Marotta, Charles A

2007-03-01

The modified Rankin scale (mRS), a clinician-reported measure of global disability, is widely applied for evaluating stroke patient outcomes and as an end point in randomized clinical trials. Extensive evidence on the validity of the mRS exists across a large but fragmented literature. As new treatments for acute ischemic stroke are submitted for agency approval, an appreciation of the mRS's attributes, specifically its relationship to other stroke evaluation scales, would be valuable for decision-makers to properly assess the impact of a new drug on treatment paradigms. The purpose of this report is to assemble and systematically assess the properties of the mRS to provide decision-makers with pertinent evaluative information. A Medline search was conducted to identify reports in the peer-reviewed medical literature (1957-2006) that provide information on the structure, validation, scoring, and psychometric properties of the mRS and its use in clinical trials. The selection of articles was based on defined criteria that included relevance, study design and use of appropriate statistical methods. Of 224 articles identified by the literature search, 50 were selected for detailed assessment. Inter-rater reliability with the mRS is moderate and improves with structured interviews (kappa 0.56 versus 0.78); strong test-re-test reliability (kappa=0.81 to 0.95) has been reported. Numerous studies demonstrate the construct validity of the mRS by its relationships to physiological indicators such as stroke type, lesion size, perfusion and neurological impairment. Convergent validity between the mRS and other disability scales is well documented. Patient comorbidities and socioeconomic factors should be considered in properly applying and interpreting the mRS. Recent analyses suggest that randomized clinical trials of acute stroke treatments may require a smaller sample size if the mRS is used as a primary end point rather than the Barthel Index. Multiple types of evidence

External validation and clinical utility of a prediction model for 6-month mortality in patients undergoing hemodialysis for end-stage kidney disease.

Science.gov (United States)

Forzley, Brian; Er, Lee; Chiu, Helen Hl; Djurdjev, Ognjenka; Martinusen, Dan; Carson, Rachel C; Hargrove, Gaylene; Levin, Adeera; Karim, Mohamud

2018-02-01

End-stage kidney disease is associated with poor prognosis. Health care professionals must be prepared to address end-of-life issues and identify those at high risk for dying. A 6-month mortality prediction model for patients on dialysis derived in the United States is used but has not been externally validated. We aimed to assess the external validity and clinical utility in an independent cohort in Canada. We examined the performance of the published 6-month mortality prediction model, using discrimination, calibration, and decision curve analyses. Data were derived from a cohort of 374 prevalent dialysis patients in two regions of British Columbia, Canada, which included serum albumin, age, peripheral vascular disease, dementia, and answers to the "the surprise question" ("Would I be surprised if this patient died within the next year?"). The observed mortality in the validation cohort was 11.5% at 6 months. The prediction model had reasonable discrimination (c-stat = 0.70) but poor calibration (calibration-in-the-large = -0.53 (95% confidence interval: -0.88, -0.18); calibration slope = 0.57 (95% confidence interval: 0.31, 0.83)) in our data. Decision curve analysis showed the model only has added value in guiding clinical decision in a small range of threshold probabilities: 8%-20%. Despite reasonable discrimination, the prediction model has poor calibration in this external study cohort; thus, it may have limited clinical utility in settings outside of where it was derived. Decision curve analysis clarifies limitations in clinical utility not apparent by receiver operating characteristic curve analysis. This study highlights the importance of external validation of prediction models prior to routine use in clinical practice.

Validation of the Communication Skills Questionnaire (CSQ) in people with schizophrenia.

Science.gov (United States)

Prat, Gemma; Casas-Anguera, Emma; Garcia-Franco, Mar; Escandell, Maria José; Martin, José Ramón; Vilamala, Sonia; Villalta-Gil, Victoria; Gimenez-Salinas, Jordi; Hernández-Rambla, Carla; Ochoa, Susana

2014-12-15

This present study describes the validation of the Communication Skills Questionnaire (CSQ) in people with schizophrenia. A total of 125 clinically stable people in rehabilitation treatment who were diagnosed with schizophrenia were included. For convergent and discriminant validity the following tests were administered; the Gambrill and Richie (GR) Assertiveness Inventory, the Social Functioning Scale (SFS), Life Skills Profile (LSP), Clinical Global Impression scale for schizophrenia (CGI-S) and the Global Assessment of Functioning (GAF) scale. Internal consistency of the CSQ had a Cronbach׳s alpha of 0.96. Test-retest reliability showed coefficients between 0.60 and 0.70. Convergent validity showed significant relations at p<0.0001 for all instruments assessed. None of the subscales used for assessing discriminant validity showed a significant correlation with the CSQ except for the CGI-S depression subscale. The instrument shows good psychometric properties and demonstrates that it is a useful instrument for evaluating communication skills in people with schizophrenia. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Validation of the Rotation Ratios Method

International Nuclear Information System (INIS)

Foss, O.A.; Klaksvik, J.; Benum, P.; Anda, S.

2007-01-01

Background: The rotation ratios method describes rotations between pairs of sequential pelvic radiographs. The method seems promising but has not been validated. Purpose: To validate the accuracy of the rotation ratios method. Material and Methods: Known pelvic rotations between 165 radiographs obtained from five skeletal pelvises in an experimental material were compared with the corresponding calculated rotations to describe the accuracy of the method. The results from a clinical material of 262 pelvic radiographs from 46 patients defined the ranges of rotational differences compared. Repeated analyses, both on the experimental and the clinical material, were performed using the selected reference points to describe the robustness and the repeatability of the method. Results: The reference points were easy to identify and barely influenced by pelvic rotations. The mean differences between calculated and real pelvic rotations were 0.0 deg (SD 0.6) for vertical rotations and 0.1 deg (SD 0.7) for transversal rotations in the experimental material. The intra- and interobserver repeatability of the method was good. Conclusion: The accuracy of the method was reasonably high, and the method may prove to be clinically useful

Validity and reliability of the novel thyroid-specific quality of life questionnaire, ThyPRO

DEFF Research Database (Denmark)

Watt, Torquil; Hegedus, Laszlo; Grønvold, Mogens

2010-01-01

Appropriate scale validity and internal consistency reliability have recently been documented for the new thyroid-specific quality of life (QoL) patient-reported outcome (PRO) measure for benign thyroid disorders, the ThyPRO. However, before clinical use, clinical validity and test...

The Predictive Validity of Projective Measures.

Science.gov (United States)

Suinn, Richard M.; Oskamp, Stuart

Written for use by clinical practitioners as well as psychological researchers, this book surveys recent literature (1950-1965) on projective test validity by reviewing and critically evaluating studies which shed light on what may reliably be predicted from projective test results. Two major instruments are covered: the Rorschach and the Thematic…

NCI-FDA Interagency Oncology Task Force Workshop Provides Guidance for Analytical Validation of Protein-based Multiplex Assays | Office of Cancer Clinical Proteomics Research

Science.gov (United States)

An NCI-FDA Interagency Oncology Task Force (IOTF) Molecular Diagnostics Workshop was held on October 30, 2008 in Cambridge, MA, to discuss requirements for analytical validation of protein-based multiplex technologies in the context of its intended use. This workshop developed through NCI's Clinical Proteomic Technologies for Cancer initiative and the FDA focused on technology-specific analytical validation processes to be addressed prior to use in clinical settings. In making this workshop unique, a case study approach was used to discuss issues related to

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

Science.gov (United States)

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Identification and Validation of Clinically Relevant Clusters of Severe Fatigue in Rheumatoid Arthritis.

Science.gov (United States)

Basu, Neil; Jones, Gareth T; Macfarlane, Gary J; Druce, Katie L

The considerable heterogeneity of rheumatoid arthritis (RA)-related fatigue is the greatest challenge to determining pathogenesis. The identification of homogenous subtypes of severe fatigue would inform the design and analysis of experiments seeking to characterize the likely numerous causal pathways that underpin the symptom. This study aimed to identify and validate such fatigue subtypes in patients with RA. Data were obtained from patients recruited to the British Society for Rheumatology Biologics register for RA, as either receiving traditional disease-modifying antirheumatic drugs (DMARD cohort, n = 522) or commencing anti-tumor necrosis factor therapy (anti-TNF cohort, n = 3909). In those reporting severe fatigue (Short-Form 36 vitality ≤ 12.5), this cross-sectional analysis applied hierarchical clustering with weighted-average linkage identified clusters of pain, fatigue, mental health (all Short-Form 36), disability (Health Assessment Questionnaire), and inflammation (erythrocyte sedimentation rate) in the DMARD cohort. K-means clustering sought to validate the solution in the anti-TNF cohort. Clusters were characterized using a priori generated symptom definitions and between-cluster comparisons. Four severe fatigue clusters, labeled as basic (46%), affective (40%), inflammatory (4.5%), and global (8.9%) were identified in the DMARD cohort. All clusters had severe levels of pain and disability and were distinguished by the presence/absence of poor mental health and high inflammation. The same symptom clusters were present in the anti-TNF cohort, although the proportion of participants in each cluster differed (basic = 28.7%; affective = 30.2%; global = 24.1%; inflammatory = 16.9%). Among RA patients with severe fatigue, recruited to two diverse RA cohorts, clinically relevant clusters were identified and validated. These may provide the basis for future mechanistic studies and ultimately support a stratified approach to fatigue management.

Incremental Criterion Validity of the WJ-III COG Clinical Clusters: Marginal Predictive Effects beyond the General Factor

Science.gov (United States)

McGill, Ryan J.

2015-01-01

The current study examined the incremental validity of the clinical clusters from the Woodcock-Johnson III Tests of Cognitive Abilities (WJ-III COG) for predicting scores on the Woodcock-Johnson III Tests of Achievement (WJ-III ACH). All participants were children and adolescents (N = 4,722) drawn from the nationally representative WJ-III…

Validity in Qualitative Evaluation

Directory of Open Access Journals (Sweden)

Vasco Lub

2015-12-01

Full Text Available This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate, the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of connecting them with aspects of evaluation in social policy. It argues that different purposes of qualitative evaluations can be linked with different scientific paradigms and perspectives, thus transcending unproductive paradigmatic divisions as well as providing a flexible yet rigorous validity framework for researchers and reviewers of qualitative evaluations.

Validation of a Predictive Model for Survival in Metastatic Cancer Patients Attending an Outpatient Palliative Radiotherapy Clinic

International Nuclear Information System (INIS)

Chow, Edward; Abdolell, Mohamed; Panzarella, Tony; Harris, Kristin; Bezjak, Andrea; Warde, Padraig; Tannock, Ian

2009-01-01

Purpose: To validate a predictive model for survival of patients attending a palliative radiotherapy clinic. Methods and Materials: We described previously a model that had good predictive value for survival of patients referred during 1999 (1). The six prognostic factors (primary cancer site, site of metastases, Karnofsky performance score, and the fatigue, appetite and shortness-of-breath items from the Edmonton Symptom Assessment Scale) identified in this training set were extracted from the prospective database for the year 2000. We generated a partial score whereby each prognostic factor was assigned a value proportional to its prognostic weight. The sum of the partial scores for each patient was used to construct a survival prediction score (SPS). Patients were also grouped according to the number of these risk factors (NRF) that they possessed. The probability of survival at 3, 6, and 12 months was generated. The models were evaluated for their ability to predict survival in this validation set with appropriate statistical tests. Results: The median survival and survival probabilities of the training and validation sets were similar when separated into three groups using both SPS and NRF methods. There was no statistical difference in the performance of the SPS and NRF methods in survival prediction. Conclusion: Both the SPS and NRF models for predicting survival in patients referred for palliative radiotherapy have been validated. The NRF model is preferred because it is simpler and avoids the need to remember the weightings among the prognostic factors

The Myotonometer: Not a Valid Measurement Tool for Active Hamstring Musculotendinous Stiffness.

Science.gov (United States)

Pamukoff, Derek N; Bell, Sarah E; Ryan, Eric D; Blackburn, J Troy

2016-05-01

Hamstring musculotendinous stiffness (MTS) is associated with lower-extremity injury risk (ie, hamstring strain, anterior cruciate ligament injury) and is commonly assessed using the damped oscillatory technique. However, despite a preponderance of studies that measure MTS reliably in laboratory settings, there are no valid clinical measurement tools. A valid clinical measurement technique is needed to assess MTS and permit identification of individuals at heightened risk of injury and track rehabilitation progress. To determine the validity and reliability of the Myotonometer for measuring active hamstring MTS. Descriptive laboratory study. Laboratory. 33 healthy participants (15 men, age 21.33 ± 2.94 y, height 172.03 ± 16.36 cm, mass 74.21 ± 16.36 kg). Hamstring MTS was assessed using the damped oscillatory technique and the Myotonometer. Intraclass correlations were used to determine the intrasession, intersession, and interrater reliability of the Myotonometer. Criterion validity was assessed via Pearson product-moment correlation between MTS measures obtained from the Myotonometer and from the damped oscillatory technique. The Myotonometer demonstrated good intrasession (ICC3,1 = .807) and interrater reliability (ICC2,k = .830) and moderate intersession reliability (ICC2,k = .693). However, it did not provide a valid measurement of MTS compared with the damped oscillatory technique (r = .346, P = .061). The Myotonometer does not provide a valid measure of active hamstring MTS. Although the Myotonometer does not measure active MTS, it possesses good reliability and portability and could be used clinically to measure tissue compliance, muscle tone, or spasticity associated with multiple musculoskeletal disorders. Future research should focus on portable and clinically applicable tools to measure active hamstring MTS in efforts to prevent and monitor injuries.

An information architecture for validating courseware

OpenAIRE

Melia, Mark; Pahl, Claus

2007-01-01

Courseware validation should locate Learning Objects inconsistent with the courseware instructional design being used. In order for validation to take place it is necessary to identify the implicit and explicit information needed for validation. In this paper, we identify this information and formally define an information architecture to model courseware validation information explicitly. This promotes tool-support for courseware validation and its interoperability with the courseware specif...

Lesson 6: Signature Validation

Science.gov (United States)

Checklist items 13 through 17 are grouped under the Signature Validation Process, and represent CROMERR requirements that the system must satisfy as part of ensuring that electronic signatures it receives are valid.

Establishing construct validity for the thyroid-specific patient reported outcome measure (ThyPRO)

DEFF Research Database (Denmark)

Watt, Torquil; Bjorner, Jakob Bue; Groenvold, Mogens

2009-01-01

, evaluating lack of convergent validity (item-own scale polyserial correlation correlation higher than item-own scale correlation) of the hypothesized scale structure. Analyses were repeated in clinical and sociodemographic subgroups and with Pearson...... complete convergent validity and only two instances of lack of discriminant validity. Pearson correlations yielded similar results. Across all subgroups, convergent validity was complete, and discriminant validity was found in 99.2% of tests. Lack of discriminant validity was mainly between physical...... correlations. Reliability was estimated by Cronbach's alpha, both conventionally and with polychoric correlations. RESULTS: In total, 904 patients (69%) responded. Initial multitrait scaling analysis identified 25 scaling errors. Twelve items were omitted from the scale structure, and a re-analysis showed...

External validation and comparison of three pediatric clinical dehydration scales.

Directory of Open Access Journals (Sweden)

Joshua Jauregui

Full Text Available OBJECTIVE: To prospectively validate three popular clinical dehydration scales and overall physician gestalt in children with vomiting or diarrhea relative to the criterion standard of percent weight change with rehydration. METHODS: We prospectively enrolled a non-consecutive cohort of children ≤ 18 years of age with an acute episode of diarrhea or vomiting. Patient weight, clinical scale variables and physician clinical impression, or gestalt, were recorded before and after fluid resuscitation in the emergency department and upon hospital discharge. The percent weight change from presentation to discharge was used to calculate the degree of dehydration, with a weight change of ≥ 5% considered significant dehydration. Receiver operating characteristics (ROC curves were constructed for each of the three clinical scales and physician gestalt. Sensitivity and specificity were calculated based on the best cut-points of the ROC curve. RESULTS: We approached 209 patients, and of those, 148 were enrolled and 113 patients had complete data for analysis. Of these, 10.6% had significant dehydration based on our criterion standard. The Clinical Dehydration Scale (CDS and Gorelick scales both had an area under the ROC curve (AUC statistically different from the reference line with AUCs of 0.72 (95% CI 0.60, 0.84 and 0.71 (95% CI 0.57, 0.85 respectively. The World Health Organization (WHO scale and physician gestalt had AUCs of 0.61 (95% CI 0.45, 0.77 and 0.61 (0.44, 0.78 respectively, which were not statistically significant. CONCLUSION: The Gorelick scale and Clinical Dehydration Scale were fair predictors of dehydration in children with diarrhea or vomiting. The World Health Organization scale and physician gestalt were not helpful predictors of dehydration in our cohort.

Validity and Reliability of Psychosocial Factors Related to Breast Cancer Screening.

Science.gov (United States)

Zapka, Jane G.; And Others

1991-01-01

The construct validity of hypothesized survey items and data reduction procedures for selected psychosocial constructs frequently used in breast cancer screening research were investigated in telephone interviews with randomly selected samples of 1,184 and 903 women and a sample of 169 Hispanic clinic clients. Validity of the constructs is…

Development and validation of a theoretical test in basic laparoscopy

DEFF Research Database (Denmark)

Strandbygaard, Jeanett; Maagaard, Mathilde; Larsen, Christian Rifbjerg

2013-01-01

for first-year residents in obstetrics and gynecology. This study therefore aimed to develop and validate a framework for a theoretical knowledge test, a multiple-choice test, in basic theory related to laparoscopy. METHODS: The content of the multiple-choice test was determined by conducting informal...... conversational interviews with experts in laparoscopy. The subsequent relevance of the test questions was evaluated using the Delphi method involving regional chief physicians. Construct validity was tested by comparing test results from three groups with expected different clinical competence and knowledge.......001). Internal consistency (Cronbach's alpha) was 0.82. There was no evidence of differential item functioning between the three groups tested. CONCLUSIONS: A newly developed knowledge test in basic laparoscopy proved to have content and construct validity. The formula for the development and validation...

The Childbirth Experience Questionnaire (CEQ) - validation of its use in a Danish population

DEFF Research Database (Denmark)

Boie, Sidsel; Glavind, Julie; Uldbjerg, Niels

experience is lacking. The Childbirth Experience Questionnaire (CEQ) was developed in Sweden in 2010 and validated in Swedish women, but never validated in a Danish setting, and population. The purpose of our study was to validate the CEQ as a reliable tool for measuring the childbirth experience in Danish......Title The Childbirth Experience Questionnaire (CEQ) - validation the use in a Danish population Introduction Childbirth experience is arguably as important as measuring birth outcomes such as mode of delivery or perinatal morbidity. A robust, validated, Danish tool for evaluating childbirth...... index of agreement between the two scores. Case description (mandatory for Clinical Report) Results (mandatory for Original Research) Face validity: All respondents stated that it was easy to understand and complete the questionnaire. Construct validity: Statistically significant higher CEQ scores were...

Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity.

Science.gov (United States)

Hawkins, Melanie; Elsworth, Gerald R; Osborne, Richard H

2018-07-01

Data from subjective patient-reported outcome measures (PROMs) are now being used in the health sector to make or support decisions about individuals, groups and populations. Contemporary validity theorists define validity not as a statistical property of the test but as the extent to which empirical evidence supports the interpretation of test scores for an intended use. However, validity testing theory and methodology are rarely evident in the PROM validation literature. Application of this theory and methodology would provide structure for comprehensive validation planning to support improved PROM development and sound arguments for the validity of PROM score interpretation and use in each new context. This paper proposes the application of contemporary validity theory and methodology to PROM validity testing. The validity testing principles will be applied to a hypothetical case study with a focus on the interpretation and use of scores from a translated PROM that measures health literacy (the Health Literacy Questionnaire or HLQ). Although robust psychometric properties of a PROM are a pre-condition to its use, a PROM's validity lies in the sound argument that a network of empirical evidence supports the intended interpretation and use of PROM scores for decision making in a particular context. The health sector is yet to apply contemporary theory and methodology to PROM development and validation. The theoretical and methodological processes in this paper are offered as an advancement of the theory and practice of PROM validity testing in the health sector.

Verification and validation benchmarks

International Nuclear Information System (INIS)

Oberkampf, William Louis; Trucano, Timothy Guy

2007-01-01

Verification and validation (V and V) are the primary means to assess the accuracy and reliability of computational simulations. V and V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V and V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the

Verification and validation benchmarks

International Nuclear Information System (INIS)

Oberkampf, William L.; Trucano, Timothy G.

2008-01-01

Verification and validation (V and V) are the primary means to assess the accuracy and reliability of computational simulations. V and V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V and V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the

Validity of a hospital-based obstetric register using medical records as reference

DEFF Research Database (Denmark)

Brixval, Carina Sjöberg; Thygesen, Lau Caspar; Johansen, Nanna Roed

2015-01-01

BACKGROUND: Data from hospital-based registers and medical records offer valuable sources of information for clinical and epidemiological research purposes. However, conducting high-quality epidemiological research requires valid and complete data sources. OBJECTIVE: To assess completeness...... and validity of a hospital-based clinical register - the Obstetric Database - using a national register and medical records as references. METHODS: We assessed completeness of a hospital-based clinical register - the Obstetric Database - by linking data from all women registered in the Obstetric Database...... Database therefore offers a valuable source for examining clinical, administrative, and research questions....

Validation: an overview of definitions

International Nuclear Information System (INIS)

Pescatore, C.

1995-01-01

The term validation is featured prominently in the literature on radioactive high-level waste disposal and is generally understood to be related to model testing using experiments. In a first class, validation is linked to the goal of predicting the physical world as faithfully as possible but is unattainable and unsuitable for setting goals for the safety analyses. In a second class, validation is associated to split-sampling or to blind-tests predictions. In the third class of definition, validation focuses on the quality of the decision-making process. Most prominent in the present review is the observed lack of use of the term validation in the field of low-level radioactive waste disposal. The continued informal use of the term validation in the field of high level wastes disposals can become cause for misperceptions and endless speculations. The paper proposes either abandoning the use of this term or agreeing to a definition which would be common to all. (J.S.). 29 refs

Validity and Reliability of Clinical Examination in the Diagnosis of Myofascial Pain Syndrome and Myofascial Trigger Points in Upper Quarter Muscles.

Science.gov (United States)

Mayoral Del Moral, Orlando; Torres Lacomba, María; Russell, I Jon; Sánchez Méndez, Óscar; Sánchez Sánchez, Beatriz

2017-12-15

To determine whether two independent examiners can agree on a diagnosis of myofascial pain syndrome (MPS). To evaluate interexaminer reliability in identifying myofascial trigger points in upper quarter muscles. To evaluate the reliability of clinical diagnostic criteria for the diagnosis of MPS. To evaluate the validity of clinical diagnostic criteria for the diagnosis of MPS. Validity and reliability study. Provincial Hospital. Toledo, Spain. Twenty myofascial pain syndrome patients and 20 healthy, normal control subjects, enrolled by a trained and experienced examiner. Ten bilateral muscles from the upper quarter were evaluated by two experienced examiners. The second examiner was blinded to the diagnosis group. The MPS diagnosis required at least one muscle to have an active myofascial trigger point. Three to four days separated the two examinations. The primary outcome measure was the frequency with which the two examiners agreed on the classification of the subjects as patients or as healthy controls. The kappa statistic (K) was used to determine the level of agreement between both examinations, interpreted as very good (0.81-1.00), good (0.61-0.80), moderate (0.41-0.60), fair (0.21-0.40), or poor (≤0.20). Interexaminer reliability for identifying subjects with MPS was very good (K = 1.0). Interexaminer reliability for identifying muscles leading to a diagnosis of MPS was also very good (K = 0.81). Sensitivity and specificity showed high values for most examination tests in all muscles, which confirms the validity of clinical diagnostic criteria in the diagnosis of MPS. Interrater reliability between two expert examiners identifying subjects with MPS involving upper quarter muscles exhibited substantial agreement. These results suggest that clinical criteria can be valid and reliable in the diagnosis of this condition. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Chinese adaptation and validation of the patellofemoral pain severity scale.

Science.gov (United States)

Cheung, Roy T H; Ngai, Shirley P C; Lam, Priscillia L; Chiu, Joseph K W; Fung, Eric Y H

2013-05-01

This study validated the Patellofemoral Pain Severity Scale translated into Chinese. The Chinese Patellofemoral Pain Severity Scale was translated from the original English version following standard forward and backward translation procedures recommended by the International Society for Pharmacoeconomics and Outcomes Research. The survey was then conducted in clinical settings by a questionnaire comprising the Chinese Patellofemoral Pain Severity Scale, Kujala Scale and Western Ontario and McMaster Universities (WOMAC) Osteoarthritis Index. Eighty-four Chinese reading patients with patellofemoral pain were recruited from physical therapy clinics. Internal consistency of the translated instrument was measured by Cronbach alpha. Convergent validity was examined by Spearman rank correlation coefficient (rho) tests by comparing its score with the validated Chinese version of the Kujala Scale and the WOMAC Osteoarthritis Index while the test-retest reliability was evaluated by administering the questionnaires twice. Cronbach alpha values of individual questions and their overall value were above 0.85. Strong association was found between the Chinese Patellofemoral Pain Severity Scale and the Kujala Scale (rho = -0.72, p coefficient = 0.98) was demonstrated. The Chinese translated version of the Patellofemoral Pain Severity Scale is a reliable and valid instrument for patients with patellofemoral pain.

Design and validation of standardized clinical and functional remission criteria in schizophrenia

Science.gov (United States)

Mosolov, Sergey N; Potapov, Andrey V; Ushakov, Uriy V; Shafarenko, Aleksey A; Kostyukova, Anastasiya B

2014-01-01

Background International Remission Criteria (IRC) for schizophrenia were developed recently by a group of internationally known experts. The IRC detect only 10%–30% of cases and do not cover the diversity of forms and social functioning. Our aim was to design a more applicable tool and validate its use – the Standardized Clinical and Functional Remission Criteria (SCFRC). Methods We used a 6-month follow-up study of 203 outpatients from two Moscow centers and another further sample of stable patients from a 1-year controlled trial of atypical versus typical medication. Diagnosis was confirmed by International Classification of Diseases Version 10 (ICD10) criteria and the Mini-International Neuropsychiatric Interview (MINI). Patients were assessed by the Positive and Negative Syndrome Scale, including intensity threshold, and further classified using the Russian domestic remission criteria and the level of social and personal functioning, according to the Personal and Social Performance Scale (PSP). The SCFRC were formulated and were validated by a data reanalysis on the first population sample and on a second independent sample (104 patients) and in an open-label prospective randomized 12-month comparative study of risperidone long-acting injectable (RLAI) versus olanzapine. Results Only 64 of the 203 outpatients (31.5%) initially met the IRC, and 53 patients (26.1%) met the IRC after 6 months, without a change in treatment. Patients who were in remission had episodic and progressive deficit (39.6%), or remittent (15%) paranoid schizophrenia, or schizoaffective disorder (17%). In addition, 105 patients of 139 (51.7%), who did not meet symptomatic IRC, remained stable within the period. Reanalysis of data revealed that 65.5% of the patients met the SCFRC. In the controlled trial, 70% of patients in the RLAI group met the SCFRC and only 19% the IRC. In the routine treatment group, 55.9% met the SCFRC and only 5.7% the IRC. Results of the further independent

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

Science.gov (United States)

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

Development and Validation of Personality Disorder Spectra Scales for the MMPI-2-RF.

Science.gov (United States)

Sellbom, Martin; Waugh, Mark H; Hopwood, Christopher J

2018-01-01

The purpose of this study was to develop and validate a set of MMPI-2-RF (Ben-Porath & Tellegen, 2008/2011) personality disorder (PD) spectra scales. These scales could serve the purpose of assisting with DSM-5 PD diagnosis and help link categorical and dimensional conceptions of personality pathology within the MMPI-2-RF. We developed and provided initial validity results for scales corresponding to the 10 PD constructs listed in the DSM-5 using data from student, community, clinical, and correctional samples. Initial validation efforts indicated good support for criterion validity with an external PD measure as well as with dimensional personality traits included in the DSM-5 alternative model for PDs. Construct validity results using psychosocial history and therapists' ratings in a large clinical sample were generally supportive as well. Overall, these brief scales provide clinicians using MMPI-2-RF data with estimates of DSM-5 PD constructs that can support cross-model connections between categorical and dimensional assessment approaches.

Validation philosophy

International Nuclear Information System (INIS)

Vornehm, D.

1994-01-01

To determine when a set of calculations falls within an umbrella of an existing validation documentation, it is necessary to generate a quantitative definition of range of applicability (our definition is only qualitative) for two reasons: (1) the current trend in our regulatory environment will soon make it impossible to support the legitimacy of a validation without quantitative guidelines; and (2) in my opinion, the lack of support by DOE for further critical experiment work is directly tied to our inability to draw a quantitative open-quotes line-in-the-sandclose quotes beyond which we will not use computer-generated values

Validation of liquid biopsy: plasma cell-free DNA testing in clinical management of advanced non-small cell lung cancer

Directory of Open Access Journals (Sweden)

Veldore VH

2018-01-01

Full Text Available Vidya H Veldore,1,* Anuradha Choughule,2,* Tejaswi Routhu,1 Nitin Mandloi,1 Vanita Noronha,2 Amit Joshi,2 Amit Dutt,3 Ravi Gupta,1 Ramprasad Vedam,1 Kumar Prabhash2 1MedGenome Labs Private Ltd,, Bangalore, India; 2Tata Memorial Centre, Parel, Mumbai, India; 3The Advanced Centre for Treatment, Research and Education in Cancer, Tata Memorial Center, Kharghar, Navi Mumbai, Maharashtra, India *These authors contributed equally to this work Abstract: Plasma cell-free tumor DNA, or circulating tumor DNA (ctDNA, from liquid biopsy is a potential source of tumor genetic material, in the absence of tissue biopsy, for EGFR testing. Our validation study reiterates the clinical utility of ctDNA next generation sequencing (NGS for EGFR mutation testing in non-small cell lung cancer (NSCLC. A total of 163 NSCLC cases were included in the validation, of which 132 patients had paired tissue biopsy and ctDNA. We chose to validate ctDNA using deep sequencing with custom designed bioinformatics methods that could detect somatic mutations at allele frequencies as low as 0.01%. Benchmarking allele specific real time PCR as one of the standard methods for tissue-based EGFR mutation testing, the ctDNA NGS test was validated on all the plasma derived cell-free DNA samples. We observed a high concordance (96.96% between tissue biopsy and ctDNA for oncogenic driver mutations in Exon 19 and Exon 21 of the EGFR gene. The sensitivity, specificity, positive predictive value, negative predictive value, and diagnostic accuracy of the assay were 91.1%, 100% 100%, 95.6%, and 97%, respectively. A false negative rate of 3% was observed. A subset of mutations was also verified on droplet digital PCR. Sixteen percent EGFR mutation positivity was observed in patients where only liquid biopsy was available, thus creating options for targeted therapy. This is the first and largest study from India, demonstrating successful validation of circulating cell-free DNA as a clinically

Construct validity and internal consistency reliability of the Malay version of the 21-item depression anxiety stress scale (Malay-DASS-21) among male outpatient clinic attendees in Johor.

Science.gov (United States)

Rusli, B N; Amrina, K; Trived, S; Loh, K P; Shashi, M

2017-10-01

The 21-item English version of the Depression Anxiety Stress Scale (DASS-21) has been proposed as a method for assessing self-perceived depression, anxiety and stress over the past week in various clinical and nonclinical populations. Several Malay versions of the DASS-21 have been validated in various populations with varying success. One particular Malay version has been validated in various occupational groups (such as nurses and automotive workers) but not among male clinic outpatient attendees in Malaysia. To validate the Malay version of the DASS-21 (Malay-DASS-21) among male outpatient clinic attendees in Johor. A validation study with a random sample of 402 male respondents attending the outpatient clinic of a major public outpatient clinic in Johor Bahru and Segamat was carried out from January to March 2016. Construct validity of the Malay-DASS-21 was examined using Exploratory Factor Analysis (KMO = 0.947; Bartlett's test of sphericity is significant, pDASS- 21 and the internal consistency reliability using Cronbach's alpha. Construct validity of the Malay-DASS-21 based on eigenvalues and factor loadings to confirm the three factor structure (depression, anxiety, and stress) was acceptable. The internal consistency reliability of the factor construct was very impressive with Cronbach's alpha values in the range of 0.837 to 0.863. The present study showed that the Malay- DASS-21 has acceptable psychometric construct and high internal consistency reliability to measure self-perceived depression, anxiety and stress over the past week in male outpatient clinic attendees in Johor. Further studies are necessary to revalidate the Malay-DASS-21 across different populations and cultures, and using confirmatory factor analyses.

Reliability and validity of teacher-rated symptoms of oppositional defiant disorder and conduct disorder in a clinical sample.

Science.gov (United States)

Ise, Elena; Görtz-Dorten, Anja; Döpfner, Manfred

2014-01-01

It is recommended to use information from multiple informants when making diagnostic decisions concerning oppositional defiant disorder (ODD) and conduct disorder (CD). The purpose of this study was to investigate the reliability and validity of teacher-rated symptoms of ODD and CD in a clinical sample. The sample comprised 421 children (84% boys; 6-17 years) diagnosed with ODD, CD, and/or attention deficit hyperactivity disorder (ADHD). Teachers completed a standardized ODD/CD symptom rating scale and the Teacher Report Form (TRF). The reliability (internal consistency) of the symptom rating scale was high (α = 0.90). Convergent and divergent validity were demonstrated by substantial correlations with similar TRF syndrome scales and low-to-moderate correlations with dissimilar TRF scales. Discriminant validity was shown by the ability of the symptom rating scale to differentiate between children with ODD/CD and those with ADHD. Factorial validity was demonstrated by principal component analysis, which produced a two-factor solution that is largely consistent with the two-dimensional model of ODD and CD proposed by the Diagnostic and Statistical Manual of Mental Disorders (DSM)-IV-TR, although some CD symptoms representing aggressive behavior loaded on the ODD dimension. These findings suggest that DSM-IV-TR-based teacher rating scales are useful instruments for assessing disruptive behavior problems in children and adolescents.

Proteomic signatures of infertile men with clinical varicocele and their validation studies reveal mitochondrial dysfunction leading to infertility

Directory of Open Access Journals (Sweden)

Ashok Agarwal

2016-01-01

Full Text Available To study the major differences in the distribution of spermatozoa proteins in infertile men with varicocele by comparative proteomics and validation of their level of expression. The study-specific estimates for each varicocele outcome were combined to identify the proteins involved in varicocele-associated infertility in men irrespective of stage and laterality of their clinical varicocele. Expression levels of 5 key proteins (PKAR1A, AK7, CCT6B, HSPA2, and ODF2 involved in stress response and sperm function including molecular chaperones were validated by Western blotting. Ninety-nine proteins were differentially expressed in the varicocele group. Over 87% of the DEP involved in major energy metabolism and key sperm functions were underexpressed in the varicocele group. Key protein functions affected in the varicocele group were spermatogenesis, sperm motility, and mitochondrial dysfunction, which were further validated by Western blotting, corroborating the proteomics analysis. Varicocele is essentially a state of energy deprivation, hypoxia, and hyperthermia due to impaired blood supply, which is corroborated by down-regulation of lipid metabolism, mitochondrial electron transport chain, and Krebs cycle enzymes. To corroborate the proteomic analysis, expression of the 5 identified proteins of interest was validated by Western blotting. This study contributes toward establishing a biomarker "fingerprint" to assess sperm quality on the basis of molecular parameters.

The criterion validity of the web-based Major Depression Inventory when used on clinical suspicion of depression in primary care

DEFF Research Database (Denmark)

Nielsen, Marie Germund; Ørnbøl, Eva; Bech, Per

2017-01-01

the web-based MDI in a primary care setting. The validation was based on the Munich-Composite International Diagnostic Interview (M-CIDI) by phone. GPs in the 22 practices in our study included 132 persons suspected of depression. Depression was rated as yes/no according to the MDI and M-CIDI. Sensitivity......BACKGROUND: The Major Depression Inventory (MDI) is widely used in Danish general practice as a screening tool to assess depression in symptomatic patients. Nevertheless, no validation studies of the MDI have been performed. The aim of this study was to validate the web-based version of the MDI...... against a fully structured telephone interview in a population selected on clinical suspicion of depression (ie, presence of two or three core symptoms of depression) in general practice. MATERIALS AND METHODS: General practitioners (GPs) invited consecutive persons suspected of depression to complete...

NVN 5694 intra laboratory validation. Feasibility study for interlaboratory- validation

International Nuclear Information System (INIS)

Voors, P.I.; Baard, J.H.

1998-11-01

Within the project NORMSTAR 2 a number of Dutch prenormative protocols have been defined for radioactivity measurements. Some of these protocols, e.g. the Dutch prenormative protocol NVN 5694, titled Methods for radiochemical determination of polonium-210 and lead-210, have not been validated, neither by intralaboratory nor interlaboratory studies. Validation studies are conducted within the framework of the programme 'Normalisatie and Validatie van Milieumethoden 1993-1997' (Standardization and Validation of test methods for environmental parameters) of the Dutch Ministry of Housing, Physical Planning and the Environment (VROM). The aims of this study were (a) a critical evaluation of the protocol, (b) investigation on the feasibility of an interlaboratory study, and (c) the interlaboratory validation of NVN 5694. The evaluation of the protocol resulted in a list of deficiencies varying from missing references to incorrect formulae. From the survey by interview it appeared that for each type of material, there are 4 to 7 laboratories willing to participate in a interlaboratory validation study. This reflects the situation in 1997. Consequently, if 4 or 6 (the minimal number) laboratories are participating and each laboratory analyses 3 subsamples, the uncertainty in the repeatability standard deviation is 49 or 40 %, respectively. If the ratio of reproducibility standard deviation to the repeatability standard deviation is equal to 1 or 2, then the uncertainty in the reproducibility standard deviation increases from 42 to 67 % and from 34 to 52 % for 4 or 6 laboratories, respectively. The intralaboratory validation was established on four different types of materials. Three types of materials (milkpowder condensate and filter) were prepared in the laboratory using the raw material and certified Pb-210 solutions, and one (sediment) was obtained from the IAEA. The ECN-prepared reference materials were used after testing on homogeneity. The pre-normative protocol can

Structural and incremental validity of the Wechsler Adult Intelligence Scale-Fourth Edition with a clinical sample.

Science.gov (United States)

Nelson, Jason M; Canivez, Gary L; Watkins, Marley W

2013-06-01

Structural and incremental validity of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV; Wechsler, 2008a) was examined with a sample of 300 individuals referred for evaluation at a university-based clinic. Confirmatory factor analysis indicated that the WAIS-IV structure was best represented by 4 first-order factors as well as a general intelligence factor in a direct hierarchical model. The general intelligence factor accounted for the most common and total variance among the subtests. Incremental validity analyses indicated that the Full Scale IQ (FSIQ) generally accounted for medium to large portions of academic achievement variance. For all measures of academic achievement, the first-order factors combined accounted for significant achievement variance beyond that accounted for by the FSIQ, but individual factor index scores contributed trivial amounts of achievement variance. Implications for interpreting WAIS-IV results are discussed. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

Validation of new prognostic and predictive scores by sequential testing approach

International Nuclear Information System (INIS)

Nieder, Carsten; Haukland, Ellinor; Pawinski, Adam; Dalhaug, Astrid

2010-01-01

Background and Purpose: For practitioners, the question arises how their own patient population differs from that used in large-scale analyses resulting in new scores and nomograms and whether such tools actually are valid at a local level and thus can be implemented. A recent article proposed an easy-to-use method for the in-clinic validation of new prediction tools with a limited number of patients, a so-called sequential testing approach. The present study evaluates this approach in scores related to radiation oncology. Material and Methods: Three different scores were used, each predicting short overall survival after palliative radiotherapy (bone metastases, brain metastases, metastatic spinal cord compression). For each scenario, a limited number of consecutive patients entered the sequential testing approach. The positive predictive value (PPV) was used for validation of the respective score and it was required that the PPV exceeded 80%. Results: For two scores, validity in the own local patient population could be confirmed after entering 13 and 17 patients, respectively. For the third score, no decision could be reached even after increasing the sample size to 30. Conclusion: In-clinic validation of new predictive tools with sequential testing approach should be preferred over uncritical adoption of tools which provide no significant benefit to local patient populations. Often the necessary number of patients can be reached within reasonable time frames even in small oncology practices. In addition, validation is performed continuously as the data are collected. (orig.)

Validation of new prognostic and predictive scores by sequential testing approach

Energy Technology Data Exchange (ETDEWEB)

Nieder, Carsten [Radiation Oncology Unit, Nordland Hospital, Bodo (Norway); Inst. of Clinical Medicine, Univ. of Tromso (Norway); Haukland, Ellinor; Pawinski, Adam; Dalhaug, Astrid [Radiation Oncology Unit, Nordland Hospital, Bodo (Norway)

2010-03-15

Background and Purpose: For practitioners, the question arises how their own patient population differs from that used in large-scale analyses resulting in new scores and nomograms and whether such tools actually are valid at a local level and thus can be implemented. A recent article proposed an easy-to-use method for the in-clinic validation of new prediction tools with a limited number of patients, a so-called sequential testing approach. The present study evaluates this approach in scores related to radiation oncology. Material and Methods: Three different scores were used, each predicting short overall survival after palliative radiotherapy (bone metastases, brain metastases, metastatic spinal cord compression). For each scenario, a limited number of consecutive patients entered the sequential testing approach. The positive predictive value (PPV) was used for validation of the respective score and it was required that the PPV exceeded 80%. Results: For two scores, validity in the own local patient population could be confirmed after entering 13 and 17 patients, respectively. For the third score, no decision could be reached even after increasing the sample size to 30. Conclusion: In-clinic validation of new predictive tools with sequential testing approach should be preferred over uncritical adoption of tools which provide no significant benefit to local patient populations. Often the necessary number of patients can be reached within reasonable time frames even in small oncology practices. In addition, validation is performed continuously as the data are collected. (orig.)

SHIELD verification and validation report

International Nuclear Information System (INIS)

Boman, C.

1992-02-01

This document outlines the verification and validation effort for the SHIELD, SHLDED, GEDIT, GENPRT, FIPROD, FPCALC, and PROCES modules of the SHIELD system code. Along with its predecessors, SHIELD has been in use at the Savannah River Site (SRS) for more than ten years. During this time the code has been extensively tested and a variety of validation documents have been issued. The primary function of this report is to specify the features and capabilities for which SHIELD is to be considered validated, and to reference the documents that establish the validation

Validating and Determining the Weight of Items Used for Evaluating Clinical Governance Implementation Based on Analytic Hierarchy Process Model

Directory of Open Access Journals (Sweden)

Elaheh Hooshmand

2015-10-01

Full Text Available Background The purpose of implementing a system such as Clinical Governance (CG is to integrate, establish and globalize distinct policies in order to improve quality through increasing professional knowledge and the accountability of healthcare professional toward providing clinical excellence. Since CG is related to change, and change requires money and time, CG implementation has to be focused on priority areas that are in more dire need of change. The purpose of the present study was to validate and determine the significance of items used for evaluating CG implementation. Methods The present study was descriptive-quantitative in method and design. Items used for evaluating CG implementation were first validated by the Delphi method and then compared with one another and ranked based on the Analytical Hierarchy Process (AHP model. Results The items that were validated for evaluating CG implementation in Iran include performance evaluation, training and development, personnel motivation, clinical audit, clinical effectiveness, risk management, resource allocation, policies and strategies, external audit, information system management, research and development, CG structure, implementation prerequisites, the management of patients’ non-medical needs, complaints and patients’ participation in the treatment process. The most important items based on their degree of significance were training and development, performance evaluation, and risk management. The least important items included the management of patients’ non-medical needs, patients’ participation in the treatment process and research and development. Conclusion The fundamental requirements of CG implementation included having an effective policy at national level, avoiding perfectionism, using the expertise and potentials of the entire country and the coordination of this model with other models of quality improvement such as accreditation and patient safety.

Development, external validation and clinical usefulness of a practical prediction model for radiation-induced dysphagia in lung cancer patients

International Nuclear Information System (INIS)

Dehing-Oberije, Cary; De Ruysscher, Dirk; Petit, Steven; Van Meerbeeck, Jan; Vandecasteele, Katrien; De Neve, Wilfried; Dingemans, Anne Marie C.; El Naqa, Issam; Deasy, Joseph; Bradley, Jeff; Huang, Ellen; Lambin, Philippe

2010-01-01

Introduction: Acute dysphagia is a distressing dose-limiting toxicity occurring frequently during concurrent chemo-radiation or high-dose radiotherapy for lung cancer. It can lead to treatment interruptions and thus jeopardize survival. Although a number of predictive factors have been identified, it is still not clear how these could offer assistance for treatment decision making in daily clinical practice. Therefore, we have developed and validated a nomogram to predict this side-effect. In addition, clinical usefulness was assessed by comparing model predictions to physicians' predictions. Materials and methods: Clinical data from 469 inoperable lung cancer patients, treated with curative intent, were collected prospectively. A prediction model for acute radiation-induced dysphagia was developed. Model performance was evaluated by the c-statistic and assessed using bootstrapping as well as two external datasets. In addition, a prospective study was conducted comparing model to physicians' predictions in 138 patients. Results: The final multivariate model consisted of age, gender, WHO performance status, mean esophageal dose (MED), maximum esophageal dose (MAXED) and overall treatment time (OTT). The c-statistic, assessed by bootstrapping, was 0.77. External validation yielded an AUC of 0.94 on the Ghent data and 0.77 on the Washington University St. Louis data for dysphagia ≥ grade 3. Comparing model predictions to the physicians' predictions resulted in an AUC of 0.75 versus 0.53, respectively. Conclusions: The proposed model performed well was successfully validated and demonstrated the ability to predict acute severe dysphagia remarkably better than the physicians. Therefore, this model could be used in clinical practice to identify patients at high or low risk.

Validating and determining the weight of items used for evaluating clinical governance implementation based on analytic hierarchy process model.

Science.gov (United States)

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Vafaee Najar, Ali; Meraji, Marziye; Ebrahimipour, Hossein

2015-04-08

The purpose of implementing a system such as Clinical Governance (CG) is to integrate, establish and globalize distinct policies in order to improve quality through increasing professional knowledge and the accountability of healthcare professional toward providing clinical excellence. Since CG is related to change, and change requires money and time, CG implementation has to be focused on priority areas that are in more dire need of change. The purpose of the present study was to validate and determine the significance of items used for evaluating CG implementation. The present study was descriptive-quantitative in method and design. Items used for evaluating CG implementation were first validated by the Delphi method and then compared with one another and ranked based on the Analytical Hierarchy Process (AHP) model. The items that were validated for evaluating CG implementation in Iran include performance evaluation, training and development, personnel motivation, clinical audit, clinical effectiveness, risk management, resource allocation, policies and strategies, external audit, information system management, research and development, CG structure, implementation prerequisites, the management of patients' non-medical needs, complaints and patients' participation in the treatment process. The most important items based on their degree of significance were training and development, performance evaluation, and risk management. The least important items included the management of patients' non-medical needs, patients' participation in the treatment process and research and development. The fundamental requirements of CG implementation included having an effective policy at national level, avoiding perfectionism, using the expertise and potentials of the entire country and the coordination of this model with other models of quality improvement such as accreditation and patient safety. © 2015 by Kerman University of Medical Sciences.

Validation of Multilevel Constructs: Validation Methods and Empirical Findings for the EDI

Science.gov (United States)

Forer, Barry; Zumbo, Bruno D.

2011-01-01

The purposes of this paper are to highlight the foundations of multilevel construct validation, describe two methodological approaches and associated analytic techniques, and then apply these approaches and techniques to the multilevel construct validation of a widely-used school readiness measure called the Early Development Instrument (EDI;…

Construction and validation of nursing diagnoses for people in palliative care

Directory of Open Access Journals (Sweden)

Rudval Souza da Silva

Full Text Available ABSTRACT Objective: to construct and validate nursing diagnoses for people in palliative care based on the Dignity-Conserving Care Model and the International Classification for Nursing Practice. Method: a two-stage methodological study: 1 construction of the database of clinically and culturally relevant terms for the nursing care for people in palliative care and 2 construction of nursing diagnoses from the database of terms, based on the guidelines of the International Council of Nurses. Results: the 262 terms validated constituted a database of terms from which 56 nursing diagnoses were developed. Of these, 33 were validated by a group of 26 experts, and classified in the three categories of the Dignity-Conserving Care Model: illness-related concerns (21; dignity-conserving repertoire (9; and social dignity inventory (3. Conclusion: of the 33 validated diagnoses, 18 of them could be included in the update of the Catalog of the International Classification for Nursing Practice - palliative care for a dignified death. The study contributes to support the clinical reasoning and decision making of the nurse.

Comparative Validation of Building Simulation Software

DEFF Research Database (Denmark)

Kalyanova, Olena; Heiselberg, Per

The scope of this subtask is to perform a comparative validation of the building simulation software for the buildings with the double skin façade. The outline of the results in the comparative validation identifies the areas where is no correspondence achieved, i.e. calculation of the air flow r...... is that the comparative validation can be regarded as the main argument to continue the validation of the building simulation software for the buildings with the double skin façade with the empirical validation test cases.......The scope of this subtask is to perform a comparative validation of the building simulation software for the buildings with the double skin façade. The outline of the results in the comparative validation identifies the areas where is no correspondence achieved, i.e. calculation of the air flow...

Sleep quality, the neglected outcome variable in clinical studies focusing on locomotor system; a construct validation study

Directory of Open Access Journals (Sweden)

Röder Christoph

2010-09-01

Full Text Available Abstract Background In addition to general health and pain, sleep is highly relevant to judging the well-being of an individual. Of these three important outcome variables, however, sleep is neglected in most outcome studies. Sleep is a very important resource for recovery from daily stresses and strains, and any alteration of sleep will likely affect mental and physical health, especially during disease. Sleep assessment therefore should be standard in all population-based or clinical studies focusing on the locomotor system. Yet current sleep assessment tools are either too long or too specific for general use. Methods Based on a literature review and subsequent patient-based rating of items, an expert panel designed a four-item questionnaire about sleep. Construct validation of the questionnaire in a random sample of the German-speaking Swiss population was performed in 2003. Reliability, correlation, and tests for internal consistency and validity were analyzed. Results Overall, 16,634 (70% out of 23,763 eligible individuals participated in the study. Test-retest reliability coefficients ranged from 0.72 to 0.87, and a Cronbach's alpha of 0.83 indicates good internal consistency. Results show a moderate to good correlation between sleep disturbances and health perception, and between sleep disturbances and overall pain. Conclusions The Sleep Standard Evaluation Questionnaire (SEQ-Sleep is a reliable and short tool with confirmed construct validity for sleep assessment in population-based observational studies. It is easy to administer and therefore suitable for postal surveys of the general population. Criterion validity remains to be determined.

Assessment of performance validity in the Stroop Color and Word Test in mild traumatic brain injury patients: a criterion-groups validation design.

Science.gov (United States)

Guise, Brian J; Thompson, Matthew D; Greve, Kevin W; Bianchini, Kevin J; West, Laura

2014-03-01

The current study assessed performance validity on the Stroop Color and Word Test (Stroop) in mild traumatic brain injury (TBI) using criterion-groups validation. The sample consisted of 77 patients with a reported history of mild TBI. Data from 42 moderate-severe TBI and 75 non-head-injured patients with other clinical diagnoses were also examined. TBI patients were categorized on the basis of Slick, Sherman, and Iverson (1999) criteria for malingered neurocognitive dysfunction (MND). Classification accuracy is reported for three indicators (Word, Color, and Color-Word residual raw scores) from the Stroop across a range of injury severities. With false-positive rates set at approximately 5%, sensitivity was as high as 29%. The clinical implications of these findings are discussed. © 2012 The British Psychological Society.

Identification and content validation of wound therapy clinical endpoints relevant to clinical practice and patient values for FDA approval. Part 1. Survey of the wound care community.

Science.gov (United States)

Driver, Vickie R; Gould, Lisa J; Dotson, Peggy; Gibbons, Gary W; Li, William W; Ennis, William J; Kirsner, Robert S; Eaglstein, William H; Bolton, Laura L; Carter, Marissa J

2017-05-01

Wounds that exhibit delayed healing add extraordinary clinical, economic, and personal burdens to patients, as well as to increasing financial costs to health systems. New interventions designed to ease such burdens for patients with cancer, renal, or ophthalmologic conditions are often cleared for approval by the U.S. Food and Drug Administration (FDA) using multiple endpoints but the requirement of complete healing as a primary endpoint for wound products impedes FDA clearance of interventions that can provide other clinical or patient-centered benefits for persons with wounds. A multidisciplinary group of wound experts undertook an initiative, in collaboration with the FDA, to identify and content validate supporting FDA criteria for qualifying wound endpoints relevant to clinical practice (CP) and patient-centered outcomes (PCO) as primary outcomes in clinical trials. As part of the initiative, a research study was conducted involving 628 multidisciplinary expert wound clinicians and researchers from 4 different groups: the interdisciplinary core advisory team; attendees of the Spring 2015 Symposium on Advanced Wound Care (SAWC); clinicians employed by a national network of specialty clinics focused on comprehensive wound care; and Association for the Advancement of Wound Care (AAWC) and Wound Healing Society (WHS) members who had not previously completed the survey. The online survey assessed 28 literature-based wound care endpoints for their relevance and importance to clinical practice and clinical research. Fifteen of the endpoints were evaluated for their relevance to improving quality of life. Twenty-two endpoints had content validity indexes (CVI) ≥ 0.75, and 15 were selected as meriting potential inclusion as additional endpoints for FDA approval of future wound care interventions. This study represents an important first step in identifying and validating new measurable wound care endpoints for clinical research and practice and for regulatory

Validation of simulation models

DEFF Research Database (Denmark)

Rehman, Muniza; Pedersen, Stig Andur

2012-01-01

In philosophy of science, the interest for computational models and simulations has increased heavily during the past decades. Different positions regarding the validity of models have emerged but the views have not succeeded in capturing the diversity of validation methods. The wide variety...

Validation of a scenario-based assessment of critical thinking using an externally validated tool.

Science.gov (United States)

Buur, Jennifer L; Schmidt, Peggy; Smylie, Dean; Irizarry, Kris; Crocker, Carlos; Tyler, John; Barr, Margaret

2012-01-01

With medical education transitioning from knowledge-based curricula to competency-based curricula, critical thinking skills have emerged as a major competency. While there are validated external instruments for assessing critical thinking, many educators have created their own custom assessments of critical thinking. However, the face validity of these assessments has not been challenged. The purpose of this study was to compare results from a custom assessment of critical thinking with the results from a validated external instrument of critical thinking. Students from the College of Veterinary Medicine at Western University of Health Sciences were administered a custom assessment of critical thinking (ACT) examination and the externally validated instrument, California Critical Thinking Skills Test (CCTST), in the spring of 2011. Total scores and sub-scores from each exam were analyzed for significant correlations using Pearson correlation coefficients. Significant correlations between ACT Blooms 2 and deductive reasoning and total ACT score and deductive reasoning were demonstrated with correlation coefficients of 0.24 and 0.22, respectively. No other statistically significant correlations were found. The lack of significant correlation between the two examinations illustrates the need in medical education to externally validate internal custom assessments. Ultimately, the development and validation of custom assessments of non-knowledge-based competencies will produce higher quality medical professionals.

Brazilian Portuguese version of the Revised Fibromyalgia Impact Questionnaire (FIQR-Br): cross-cultural validation, reliability, and construct and structural validation.

Science.gov (United States)

Lupi, Jaqueline Basilio; Carvalho de Abreu, Daniela Cristina; Ferreira, Mariana Candido; Oliveira, Renê Donizeti Ribeiro de; Chaves, Thais Cristina

2017-08-01

This study aimed to culturally adapt and validate the Revised Fibromyalgia Impact Questionnaire (FIQR) to Brazilian Portuguese, by the use of analysis of internal consistency, reliability, and construct and structural validity. A total of 100 female patients with fibromyalgia participated in the validation process of the Brazilian Portuguese version of the FIQR (FIQR-Br).The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Pearson's rank correlation for construct validity, and confirmatory factor analysis (CFA) for structural validity. It was verified excellent levels of reliability, with ICC greater than 0.75 for all questions and domains of the FIQR-Br. For internal consistency, alpha values greater than 0.70 for the items and domains of the questionnaire were observed. Moderate (0.40  0.70) correlations were observed for the scores of domains and total score between the FIQR-Br and FIQ-Br. The structure of the three domains of the FIQR-Br was confirmed by CFA. The results of this study suggest that that the FIQR-Br is a reliable and valid instrument for assessing fibromyalgia-related impact, and supports its use in clinical settings and research. The structure of the three domains of the FIQR-Br was also confirmed. Implications for Rehabilitation Fibromyalgia is a chronic musculoskeletal disorder characterized by widespread and diffuse pain, fatigue, sleep disturbances, and depression. The disease significantly impairs patients' quality of life and can be highly disabling. To be used in multicenter research efforts, the Revised Fibromyalgia Impact Questionnaire (FIQR) must be cross-culturally validated and psychometrically tested. This paper will make available a new version of the FIQR-Br since another version already exists, but there are concerns about its measurement properties. The availability of an instrument adapted to and validated for Brazilian

Cross-cultural adaptation and validation of the Italian version of the Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow score.

Science.gov (United States)

Merolla, Giovanni; Corona, Katia; Zanoli, Gustavo; Cerciello, Simone; Giannotti, Stefano; Porcellini, Giuseppe

2017-12-01

The Kerlan-Jobe Orthopaedic Clinic (KJOC) Shoulder and Elbow score is a reliable and sensitive tool to measure the performance of overhead athletes. The purpose of this study was to carry out a cross-cultural adaptation and validation of the KJOC questionnaire in Italian and to assess its reliability, validity, and responsiveness. Ninety professional athletes with a painful shoulder were included in this study and were assigned to the "injury group" (n = 32) or the "overuse group" (n = 58); 65 were managed conservatively and 25 were treated by arthroscopic surgery. To assess the reliability of the KJOC score, patients were asked to fill in the questionnaire at baseline and after 2 weeks. To test the construct validity, KJOC scores were compared to those obtained with the Italian version of the Disabilities of the Arm, Shoulder, and Hand (DASH) scale, and with the DASH sports/performing arts module. To test KJOC score responsiveness, the follow-up KJOC scores of the participants treated conservatively were compared to those of the patients treated by arthroscopic surgery. Statistical analysis demonstrated that the KJOC questionnaire is reliable in terms of the single items and the overall score (ICC 0.95-0.99); that it has high construct validity (r s  = -0.697; p differences in shoulder function (p < 0.0001). The Italian version of the KJOC Shoulder and Elbow score performed in a similar way to the English version and demonstrated good validity, reliability, and responsiveness after conservative and surgical treatment. II.

Validation of a 4-item Negative Symptom Assessment (NSA-4): a short, practical clinical tool for the assessment of negative symptoms in schizophrenia.

Science.gov (United States)

Alphs, Larry; Morlock, Robert; Coon, Cheryl; Cazorla, Pilar; Szegedi, Armin; Panagides, John

2011-06-01

The 16-item Negative Symptom Assessment (NSA-16) scale is a validated tool for evaluating negative symptoms of schizophrenia. The psychometric properties and predictive power of a four-item version (NSA-4) were compared with the NSA-16. Baseline data from 561 patients with predominant negative symptoms of schizophrenia who participated in two identically designed clinical trials were evaluated. Ordered logistic regression analysis of ratings using NSA-4 and NSA-16 were compared with ratings using several other standard tools to determine predictive validity and construct validity. Internal consistency and test--retest reliability were also analyzed. NSA-16 and NSA-4 scores were both predictive of scores on the NSA global rating (odds ratio = 0.83-0.86) and the Clinical Global Impressions--Severity scale (odds ratio = 0.91-0.93). NSA-16 and NSA-4 showed high correlation with each other (Pearson r = 0.85), similar high correlation with other measures of negative symptoms (demonstrating convergent validity), and lesser correlations with measures of other forms of psychopathology (demonstrating divergent validity). NSA-16 and NSA-4 both showed acceptable internal consistency (Cronbach α, 0.85 and 0.64, respectively) and test--retest reliability (intraclass correlation coefficient, 0.87 and 0.82). This study demonstrates that NSA-4 offers accuracy comparable to the NSA-16 in rating negative symptoms in patients with schizophrenia. Copyright © 2011 John Wiley & Sons, Ltd.

Validation of the Physician-Pharmacist Collaborative Index for physicians in Malaysia.

Science.gov (United States)

Sellappans, Renukha; Ng, Chirk Jenn; Lai, Pauline Siew Mei

2015-12-01

Establishing a collaborative working relationship between doctors and pharmacists is essential for the effective provision of pharmaceutical care. The Physician-Pharmacist Collaborative Index (PPCI) was developed to assess the professional exchanges between doctors and pharmacists. Two versions of the PPCI was developed: one for physicians and one for pharmacists. However, these instruments have not been validated in Malaysia. To determine the validity and reliability of the PPCI for physicians in Malaysia. An urban tertiary hospital in Malaysia. This prospective study was conducted from June to August 2014. Doctors were grouped as either a "collaborator" or a "non-collaborator". Collaborators were doctors who regularly worked with one particular clinical pharmacist in their ward, while non-collaborators were doctors who interacted with any random pharmacist who answered the general pharmacy telephone line whenever they required assistance on medication-related enquiries, as they did not have a clinical pharmacist in their ward. Collaborators were firstly identified by the clinical pharmacist he/she worked with, then invited to participate in this study through email, as it was difficult to locate and approach them personally. Non-collaborators were sampled conveniently by approaching them in person as these doctors could be easily sampled from any wards without a clinical pharmacist. The PPCI for physicians was administered at baseline and 2 weeks later. Validity (face validity, factor analysis and discriminative validity) and reliability (internal consistency and test-retest) of the PPCI for physicians. A total of 116 doctors (18 collaborators and 98 non-collaborators) were recruited. Confirmatory factor analysis confirmed that the PPCI for physicians was a 3-factor model. The correlation of the mean domain scores ranged from 0.711 to 0.787. "Collaborators" had significantly higher scores compared to "non-collaborators" (81.4 ± 10.1 vs. 69.3 ± 12.1, p Malaysia.

Clinical and psychometric validation of the psychotic depression assessment scale

DEFF Research Database (Denmark)

Østergaard, Søren D; Pedersen, Christina H; Uggerby, Peter

2015-01-01

BACKGROUND: Recent studies have indicated that the 11-item Psychotic Depression Assessment Scale (PDAS), consisting of the 6-item melancholia subscale (HAM-D6) of the Hamilton Depression Rating Scale and 5 psychosis items from the Brief Psychiatric Rating Scale (BPRS), is a valid measure for the ...

Reliability and Validity of the Korean Version of the Cancer Stigma Scale.

Science.gov (United States)

So, Hyang Sook; Chae, Myeong Jeong; Kim, Hye Young

2017-02-01

In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (χ²/df)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients. © 2017 Korean Society of Nursing Science

Performance Validity Testing in Neuropsychology: Methods for Measurement Development and Maximizing Diagnostic Accuracy.

Science.gov (United States)

Wodushek, Thomas R; Greher, Michael R

2017-05-01

In the first column in this 2-part series, Performance Validity Testing in Neuropsychology: Scientific Basis and Clinical Application-A Brief Review, the authors introduced performance validity tests (PVTs) and their function, provided a justification for why they are necessary, traced their ongoing endorsement by neuropsychological organizations, and described how they are used and interpreted by ever increasing numbers of clinical neuropsychologists. To enhance readers' understanding of these measures, this second column briefly describes common detection strategies used in PVTs as well as the typical methods used to validate new PVTs and determine cut scores for valid/invalid determinations. We provide a discussion of the latest research demonstrating how neuropsychologists can combine multiple PVTs in a single battery to improve sensitivity/specificity to invalid responding. Finally, we discuss future directions for the research and application of PVTs.

Development and Initial Validation of the Caregiver Perceptions About Communication With Clinical Team Members (CAPACITY) Measure.

Science.gov (United States)

Van Houtven, Courtney Harold; Miller, Katherine E M; O'Brien, Emily C; Wolff, Jennifer L; Lindquist, Jennifer; Kabat, Margaret; Campbell-Kotler, Margaret; Henius, Jennifer; Voils, Corrine I

2017-12-01

Despite the important role that family caregivers play managing the care of persons with complex health needs, little is known about how caregivers perceive themselves to be recognized and valued by health care professionals. Our objective was to develop and validate a novel measure, the CAregiver Perceptions About Commun Ication with Clinical Team members (CAPACITY) instrument. Questions focus on perceived quality of communication with the health care team and the extent to which caregivers believe that the health care team considers their capacity and preferences in decision making. A confirmatory factor analysis supported a two-factor solution addressing communication and capacity. Internal consistency reliability was .90 for the communication domain and .93 for the capacity domain. Correlations between these two subscales and individual difference measures provided evidence of convergent and discriminant validity. The CAPACITY instrument may be a useful performance measure that quantifies the extent to which caregivers' experience person- and family-centered health care.

Validation of Serious Games

Directory of Open Access Journals (Sweden)

Katinka van der Kooij

2015-09-01

Full Text Available The application of games for behavioral change has seen a surge in popularity but evidence on the efficacy of these games is contradictory. Anecdotal findings seem to confirm their motivational value whereas most quantitative findings from randomized controlled trials (RCT are negative or difficult to interpret. One cause for the contradictory evidence could be that the standard RCT validation methods are not sensitive to serious games’ effects. To be able to adapt validation methods to the properties of serious games we need a framework that can connect properties of serious game design to the factors that influence the quality of quantitative research outcomes. The Persuasive Game Design model [1] is particularly suitable for this aim as it encompasses the full circle from game design to behavioral change effects on the user. We therefore use this model to connect game design features, such as the gamification method and the intended transfer effect, to factors that determine the conclusion validity of an RCT. In this paper we will apply this model to develop guidelines for setting up validation methods for serious games. This way, we offer game designers and researchers handles on how to develop tailor-made validation methods.

Containment Code Validation Matrix

International Nuclear Information System (INIS)

Chin, Yu-Shan; Mathew, P.M.; Glowa, Glenn; Dickson, Ray; Liang, Zhe; Leitch, Brian; Barber, Duncan; Vasic, Aleks; Bentaib, Ahmed; Journeau, Christophe; Malet, Jeanne; Studer, Etienne; Meynet, Nicolas; Piluso, Pascal; Gelain, Thomas; Michielsen, Nathalie; Peillon, Samuel; Porcheron, Emmanuel; Albiol, Thierry; Clement, Bernard; Sonnenkalb, Martin; Klein-Hessling, Walter; Arndt, Siegfried; Weber, Gunter; Yanez, Jorge; Kotchourko, Alexei; Kuznetsov, Mike; Sangiorgi, Marco; Fontanet, Joan; Herranz, Luis; Garcia De La Rua, Carmen; Santiago, Aleza Enciso; Andreani, Michele; Paladino, Domenico; Dreier, Joerg; Lee, Richard; Amri, Abdallah

2014-01-01

The Committee on the Safety of Nuclear Installations (CSNI) formed the CCVM (Containment Code Validation Matrix) task group in 2002. The objective of this group was to define a basic set of available experiments for code validation, covering the range of containment (ex-vessel) phenomena expected in the course of light and heavy water reactor design basis accidents and beyond design basis accidents/severe accidents. It was to consider phenomena relevant to pressurised heavy water reactor (PHWR), pressurised water reactor (PWR) and boiling water reactor (BWR) designs of Western origin as well as of Eastern European VVER types. This work would complement the two existing CSNI validation matrices for thermal hydraulic code validation (NEA/CSNI/R(1993)14) and In-vessel core degradation (NEA/CSNI/R(2001)21). The report initially provides a brief overview of the main features of a PWR, BWR, CANDU and VVER reactors. It also provides an overview of the ex-vessel corium retention (core catcher). It then provides a general overview of the accident progression for light water and heavy water reactors. The main focus is to capture most of the phenomena and safety systems employed in these reactor types and to highlight the differences. This CCVM contains a description of 127 phenomena, broken down into 6 categories: - Containment Thermal-hydraulics Phenomena; - Hydrogen Behaviour (Combustion, Mitigation and Generation) Phenomena; - Aerosol and Fission Product Behaviour Phenomena; - Iodine Chemistry Phenomena; - Core Melt Distribution and Behaviour in Containment Phenomena; - Systems Phenomena. A synopsis is provided for each phenomenon, including a description, references for further information, significance for DBA and SA/BDBA and a list of experiments that may be used for code validation. The report identified 213 experiments, broken down into the same six categories (as done for the phenomena). An experiment synopsis is provided for each test. Along with a test description

Validation in the cytopathology laboratory: its time has come.

Science.gov (United States)

Haack, Lori A; Shalkham, John

2007-08-01

The cytology laboratory has traditionally performed a relatively small variety of tests. The testing processes employed were generally manually performed and included preparation of glass slide materials, staining of these slides, coverslipping, and microscopic evaluation of the cellular material. Instrumentation in the cytology laboratory was very limited and included a centrifuge, membrane filtration system, and possibly an automated staining machine. If instruments were added, for example, a liquid based preparation device or an automated coverslipping device; the instruments were rarely checked to assure they were operating properly before implementation into clinical practice. In addition, little documentation was maintained with regards to the instrument performance evaluation process. Increasing automation and expansion of testing options have changed how cytopathology is practiced. There are many new devices employed for the preparation of specimens, staining and coverslipping of slides, and evaluation of cellular material. The increasing use of molecular testing methods in cytopathology further adds to the changing landscape of cytopathology. New instrumentation and testing methods are routinely being introduced and the cytopathology laboratory must assure that the testing performed is accurate and consistent. Cytopathology laboratory professionals need to appreciate the value of validation of the tests we perform and the instruments we use in order to best serve the patient. Our clinical laboratory colleagues have traditionally performed validation on both instruments and test methods before using them for clinical testing. If cytopathology wants to perform the complex testing being introduced and effectively utilize new instrumentation, we need to understand the value of validation and how we apply validation to our laboratory practice. Copyright 2007 Wiley-Liss, Inc.

Clinical Functional Capacity Testing in Patients With Facioscapulohumeral Muscular Dystrophy: Construct Validity and Interrater Reliability of Antigravity Tests.

Science.gov (United States)

Rijken, Noortje H; van Engelen, Baziel G; Weerdesteyn, Vivian; Geurts, Alexander C

2015-12-01

To evaluate the construct validity and interrater reliability of 4 simple antigravity tests in a small group of patients with facioscapulohumeral muscular dystrophy (FSHD). Case-control study. University medical center. Patients with various severity levels of FSHD (n=9) and healthy control subjects (n=10) were included (N=19). Not applicable. A 4-point ordinal scale was designed to grade performance on the following 4 antigravity tests: sit to stance, stance to sit, step up, and step down. In addition, the 6-minute walk test, 10-m walking test, Berg Balance Scale, and timed Up and Go test were administered as conventional tests. Construct validity was determined by linear regression analysis using the Clinical Severity Score (CSS) as the dependent variable. Interrater agreement was tested using a κ analysis. Patients with FSHD performed worse on all 4 antigravity tests compared with the controls. Stronger correlations were found within than between test categories (antigravity vs conventional). The antigravity tests revealed the highest explained variance with regard to the CSS (R(2)=.86, P=.014). Interrater agreement was generally good. The results of this exploratory study support the construct validity and interrater reliability of the proposed antigravity tests for the assessment of functional capacity in patients with FSHD taking into account the use of compensatory strategies. Future research should further validate these results in a larger sample of patients with FSHD. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The validity of the 4-Skills Scan: A double validation study.

Science.gov (United States)

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

[Multicenter validation of the clinical dehydration scale for children].

Science.gov (United States)

Gravel, J; Manzano, S; Guimont, C; Lacroix, L; Gervaix, A; Bailey, B

2010-12-01

Dehydration is an important complication for sick children. The Clinical Dehydration Scale for children (CDS) measures dehydration based on 4 clinical signs: general appearance, eyes, saliva, and tears. To validate the association between the CDS and markers of dehydration in children aged 1 month to 5 years visiting emergency departments (EDs) for vomiting and/or diarrhea. An international prospective cohort study conducted in 3 university-affiliated EDs in 2009. Participants were a convenience sample of children aged 1-60 months presenting to the ED for acute vomiting and/or diarrhea. Following triage, a research nurse obtained informed consent and evaluated dehydration using the CDS. A few days after recovery, another research assistant weighed participants at home. The primary outcome was the percentage of dehydration calculated by the difference in weight at first evaluation and after recovery. Secondary outcomes included proportion of blood test measurements, intravenous use, hospitalization, and inter-rater agreement. During the study period, 264 children were recruited and data regarding weight and dehydration scores were complete for 219 (83%). According to the CDS, 88 had no dehydration, 159 some dehydration, and 15 moderate or severe dehydration. A Chi-square test showed a statistical association between CDS and weight gain, the occurrence of blood tests, intravenous rehydration, hospitalization, and abnormal plasmatic bicarbonate. Good inter-rater correlation was found among participants (linear weighted Kappa score of 0.65; (95% CI, 0.43-0.87). CDS categories correlate with markers of dehydration for young children complaining of vomiting and/or diarrhea in the ED. Copyright © 2010 Elsevier Masson SAS. All rights reserved.

Effort, symptom validity testing, performance validity testing and traumatic brain injury.

Science.gov (United States)

Bigler, Erin D

2014-01-01

To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount. This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed. Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.

Construction and Initial Validation of the Multiracial Experiences Measure (MEM)

Science.gov (United States)

Yoo, Hyung Chol; Jackson, Kelly; Guevarra, Rudy P.; Miller, Matthew J.; Harrington, Blair

2015-01-01

This article describes the development and validation of the Multiracial Experiences Measure (MEM): a new measure that assesses uniquely racialized risks and resiliencies experienced by individuals of mixed racial heritage. Across two studies, there was evidence for the validation of the 25-item MEM with 5 subscales including Shifting Expressions, Perceived Racial Ambiguity, Creating Third Space, Multicultural Engagement, and Multiracial Discrimination. The 5-subscale structure of the MEM was supported by a combination of exploratory and confirmatory factor analyses. Evidence of criterion-related validity was partially supported with MEM subscales correlating with measures of racial diversity in one’s social network, color-blind racial attitude, psychological distress, and identity conflict. Evidence of discriminant validity was supported with MEM subscales not correlating with impression management. Implications for future research and suggestions for utilization of the MEM in clinical practice with multiracial adults are discussed. PMID:26460977

Validity and reliability testing of the Prenatal Psychosocial Profile.

Science.gov (United States)

Curry, M A; Campbell, R A; Christian, M

1994-04-01

Two studies of low-income pregnant women (N = 179) were done to examine the validity and reliability of the Prenatal Psychosocial Profile (PPP). The PPP, a composite of the Rosenberg Self-Esteem Scale, the Support Behaviors Inventory, and a newly developed measure of stress, is a brief, comprehensive clinical assessment of psychosocial risk during pregnancy. Construct validity of the stress scale was supported by theoretically predicted negative correlations with self-esteem, partner support, and support from others (N = 91). Convergent validity of the stress scale was demonstrated by a correlation of .71 with the Difficult Life Circumstances Scale. Adequate levels of internal consistency were found. Interrelationships between the four subscales were consistent with the underlying conceptualization, and there was beginning evidence of the factorial independence of the subscales.

Internal and external validation of an ESTRO delineation guideline

DEFF Research Database (Denmark)

Eldesoky, Ahmed R.; Yates, Esben Svitzer; Nyeng, Tine B

2016-01-01

Background and purpose To internally and externally validate an atlas based automated segmentation (ABAS) in loco-regional radiation therapy of breast cancer. Materials and methods Structures of 60 patients delineated according to the ESTRO consensus guideline were included in four categorized...... and axillary nodal levels and poor agreement for interpectoral, internal mammary nodal regions and LADCA. Correcting ABAS significantly improved all the results. External validation of ABAS showed comparable results. Conclusions ABAS is a clinically useful tool for segmenting structures in breast cancer loco...

Validity of Two WPPSI Short Forms in Outpatient Clinic Settings.

Science.gov (United States)

Haynes, Jack P.; Atkinson, David

1983-01-01

Investigated the validity of subtest short forms for the Wechsler Preschool and Primary Scale of Intelligence in an outpatient population of 116 children. Data showed that the short forms underestimated actual level of intelligence and supported use of a short form only as a brief screening device. (LLL)

Estimating uncertainty of inference for validation

Energy Technology Data Exchange (ETDEWEB)

Booker, Jane M [Los Alamos National Laboratory; Langenbrunner, James R [Los Alamos National Laboratory; Hemez, Francois M [Los Alamos National Laboratory; Ross, Timothy J [UNM

2010-09-30

We present a validation process based upon the concept that validation is an inference-making activity. This has always been true, but the association has not been as important before as it is now. Previously, theory had been confirmed by more data, and predictions were possible based on data. The process today is to infer from theory to code and from code to prediction, making the role of prediction somewhat automatic, and a machine function. Validation is defined as determining the degree to which a model and code is an accurate representation of experimental test data. Imbedded in validation is the intention to use the computer code to predict. To predict is to accept the conclusion that an observable final state will manifest; therefore, prediction is an inference whose goodness relies on the validity of the code. Quantifying the uncertainty of a prediction amounts to quantifying the uncertainty of validation, and this involves the characterization of uncertainties inherent in theory/models/codes and the corresponding data. An introduction to inference making and its associated uncertainty is provided as a foundation for the validation problem. A mathematical construction for estimating the uncertainty in the validation inference is then presented, including a possibility distribution constructed to represent the inference uncertainty for validation under uncertainty. The estimation of inference uncertainty for validation is illustrated using data and calculations from Inertial Confinement Fusion (ICF). The ICF measurements of neutron yield and ion temperature were obtained for direct-drive inertial fusion capsules at the Omega laser facility. The glass capsules, containing the fusion gas, were systematically selected with the intent of establishing a reproducible baseline of high-yield 10{sup 13}-10{sup 14} neutron output. The deuterium-tritium ratio in these experiments was varied to study its influence upon yield. This paper on validation inference is the

Validation of the 'United Registries for Clinical Assessment and Research' [UR-CARE], a European Online Registry for Clinical Care and Research in Inflammatory Bowel Disease.

Science.gov (United States)

Burisch, Johan; Gisbert, Javier P; Siegmund, Britta; Bettenworth, Dominik; Thomsen, Sandra Bohn; Cleynen, Isabelle; Cremer, Anneline; Ding, Nik John Sheng; Furfaro, Federica; Galanopoulos, Michail; Grunert, Philip Christian; Hanzel, Jurij; Ivanovski, Tamara Knezevic; Krustins, Eduards; Noor, Nurulamin; O'Morain, Neil; Rodríguez-Lago, Iago; Scharl, Michael; Tua, Julia; Uzzan, Mathieu; Ali Yassin, Nuha; Baert, Filip; Langholz, Ebbe

2018-04-27

The 'United Registries for Clinical Assessment and Research' [UR-CARE] database is an initiative of the European Crohn's and Colitis Organisation [ECCO] to facilitate daily patient care and research studies in inflammatory bowel disease [IBD]. Herein, we sought to validate the database by using fictional case histories of patients with IBD that were to be entered by observers of varying experience in IBD. Nineteen observers entered five patient case histories into the database. After 6 weeks, all observers entered the same case histories again. For each case history, 20 key variables were selected to calculate the accuracy for each observer. We assumed that the database was such that ≥ 90% of the entered data would be correct. The overall proportion of correctly entered data was calculated using a beta-binomial regression model to account for inter-observer variation and compared to the expected level of validity. Re-test reliability was assessed using McNemar's test. For all case histories, the overall proportion of correctly entered items and their confidence intervals included the target of 90% (Case 1: 92% [88-94%]; Case 2: 87% [83-91%]; Case 3: 93% [90-95%]; Case 4: 97% [94-99%]; Case 5: 91% [87-93%]). These numbers did not differ significantly from those found 6 weeks later [NcNemar's test p > 0.05]. The UR-CARE database appears to be feasible, valid and reliable as a tool and easy to use regardless of prior user experience and level of clinical IBD experience. UR-CARE has the potential to enhance future European collaborations regarding clinical research in IBD.

Validation of a Russian Language Oswestry Disability Index Questionnaire.

Science.gov (United States)

Yu, Elizabeth M; Nosova, Emily V; Falkenstein, Yuri; Prasad, Priya; Leasure, Jeremi M; Kondrashov, Dimitriy G

2016-11-01

Study Design  Retrospective reliability and validity study. Objective  To validate a recently translated Russian language version of the Oswestry Disability Index (R-ODI) using standardized methods detailed from previous validations in other languages. Methods  We included all subjects who were seen in our spine surgery clinic, over the age of 18, and fluent in the Russian language. R-ODI was translated by six bilingual people and combined into a consensus version. R-ODI and visual analog scale (VAS) questionnaires for leg and back pain were distributed to subjects during both their initial and follow-up visits. Test validity, stability, and internal consistency were measured using standardized psychometric methods. Results Ninety-seven subjects participated in the study. No change in the meaning of the questions on R-ODI was noted with translation from English to Russian. There was a significant positive correlation between R-ODI and VAS scores for both the leg and back during both the initial and follow-up visits ( p  Russian-speaking population in the United States.

Cross-cultural adaptation of Kerlan-Jobe Orthopaedic Clinic shoulder and elbow score: Reliability and validity in Turkish-speaking overhead athletes.

Science.gov (United States)

Turgut, Elif; Tunay, Volga Bayrakci

2018-03-09

Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow Score (KJOC-SES) is a subjective assessment tool to measure functional status of the upper extremities in overhead athletes. The aim was to translate and culturally adapt the KJOC-SES and to evaluate the psychometric properties of the Turkish version (KJOC-SES-Tr) in overhead athletes. The forward and back-translation method was followed. One hundred and twenty-three overhead athletes completed the KJOC-SES-Tr, the Disabilities of the Arm, Shoulder, and Hand (DASH), and the American Shoulder and Elbow Surgeons Evaluation Form (ASES). Participants were assigned to one of the following subgroups: asymptomatic (playing without pain) or symptomatic (playing with pain, or not playing due to pain). Internal consistency, reliability, construct validity, discriminant validity, and content validity of the KJOC-SES-Tr were tested. The test-retest reliability of the KJOC-SES-Tr was excellent with an interclass coefficient of 0.93. There was a strong correlation between the KJOC-SES-Tr and the DASH and the ASES, indicating that the construct validity was good for all participants. Results of the KJOC-SES-Tr significantly differed between different subgroups and categories of athletes. The floor and ceiling effects were acceptable for symptomatic athletes. The KJOC-SES-Tr was shown to be valid, reliable tool to monitor the return to sports following injuries in athletes. Copyright © 2018 Turkish Association of Orthopaedics and Traumatology. Production and hosting by Elsevier B.V. All rights reserved.

Defining surgical criteria for empty nose syndrome: Validation of the office-based cotton test and clinical interpretability of the validated Empty Nose Syndrome 6-Item Questionnaire.

Science.gov (United States)

Thamboo, Andrew; Velasquez, Nathalia; Habib, Al-Rahim R; Zarabanda, David; Paknezhad, Hassan; Nayak, Jayakar V

2017-08-01

The validated Empty Nose Syndrome 6-Item Questionnaire (ENS6Q) identifies empty nose syndrome (ENS) patients. The unvalidated cotton test assesses improvement in ENS-related symptoms. By first validating the cotton test using the ENS6Q, we define the minimal clinically important difference (MCID) score for the ENS6Q. Individual case-control study. Fifteen patients diagnosed with ENS and 18 controls with non-ENS sinonasal conditions underwent office cotton placement. Both groups completed ENS6Q testing in three conditions-precotton, cotton in situ, and postcotton-to measure the reproducibility of ENS6Q scoring. Participants also completed a five-item transition scale ranging from "much better" to "much worse" to rate subjective changes in nasal breathing with and without cotton placement. Mean changes for each transition point, and the ENS6Q MCID, were then calculated. In the precotton condition, significant differences (P < .001) in all ENS6Q questions between ENS and controls were noted. With cotton in situ, nearly all prior ENS6Q differences normalized between ENS and control patients. For ENS patients, the changes in the mean differences between the precotton and cotton in situ conditions compared to postcotton versus cotton in situ conditions were insignificant among individuals. Including all 33 participants, the mean change in the ENS6Q between the parameters "a little better" and "about the same" was 4.25 (standard deviation [SD] = 5.79) and -2.00 (SD = 3.70), giving an MCID of 6.25. Cotton testing is a validated office test to assess for ENS patients. Cotton testing also helped to determine the MCID of the ENS6Q, which is a 7-point change from the baseline ENS6Q score. 3b. Laryngoscope, 127:1746-1752, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Nursing diagnosis of grieving: content validity in perinatal loss situations.

Science.gov (United States)

Paloma-Castro, Olga; Romero-Sánchez, José Manuel; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; Castro-Yuste, Cristina; Frandsen, Anna J; Albar-Marín, María Jesús; Bas-Sarmiento, Pilar; Moreno-Corral, Luis Javier

2014-06-01

To validate the content of the NANDA-I nursing diagnosis of grieving in situations of perinatal loss. Using the Fehring's model, 208 Spanish experts were asked to assess the adequacy of the defining characteristics and other manifestations identified in the literature for cases of perinatal loss. The content validity index was 0.867. Twelve of the 18 defining characteristics were validated, seven as major and five as minor. From the manifestations proposed, "empty inside" was considered as major. The nursing diagnosis of grieving fits in content to the cases of perinatal loss according to experts. The results have provided evidence to support the use of the diagnosis in care plans for said clinical situation. © 2013 NANDA International.

External validation of the clinical dehydration scale for children with acute gastroenteritis.

Science.gov (United States)

Bailey, Benoit; Gravel, Jocelyn; Goldman, Ran D; Friedman, Jeremy N; Parkin, Patricia C

2010-06-01

The objective was to validate the clinical dehydration scale (CDS) for children with gastroenteritis in a different pediatric emergency department (ED) from where it was initially derived and validated. A prospective cohort study was performed in a tertiary care pediatric ED over a 1-year period. A sample of triage nurses were trained in applying the CDS. The CDS consists of four clinical characteristics (general appearance, eyes, mucous membranes, and tears), each of which are scored 0, 1, or 2 for a total score of 0 to 8, with 0 representing no dehydration; 1 to 4, some dehydration; and 5 to 8, moderate/severe dehydration. Children 1 month to 5 years of age with vomiting and/or diarrhea who had the CDS documented at triage and a final diagnosis of gastroenteritis, gastritis, or enteritis were enrolled. Exclusion criteria included a chronic disease, treatment with intravenous (IV) rehydration within the previous 24 hours, visit to the ED for the same illness in the 7 days prior to arrival, and diarrhea of more than 10 days' duration. The primary outcome was the length of stay (LOS) in the ED from the time of seeing a physician to discharge, analyzed with a Kruskal-Wallis test. From April 2008 to March 2009, 150 patients with a mean (+/-SD) age of 22 (+/-14) months (range = 4 months to 4 years) were enrolled. Fifty-six patients had no dehydration, 74 had some dehydration, and 20 had moderate/severe dehydration. The median LOS in the ED after being seen by a physician was significantly longer as children appeared more dehydrated according to the CDS: 54 minutes (interquartile range [IQR] = 26-175 minutes), 128 minutes (IQR = 25-334 minutes), and 425 minutes (IQR = 218-673 minutes) for the no, some, and moderate/severe dehydration groups, respectively (p children with gastroenteritis in a different pediatric center than the original one where it was developed. It is a good predictor of LOS in the ED after being seen by a physician. (c) 2010 by the Society for

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance.

Science.gov (United States)

Holloway, Laura; Humphrey, Louise; Heron, Louise; Pilling, Claire; Kitchen, Helen; Højbjerre, Lise; Strandberg-Larsen, Martin; Hansen, Brian Bekker

2014-07-22

Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and Activity Impairment Questionnaire: Lupus (WPAI

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance

Science.gov (United States)

2014-01-01

Background Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. Methods A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. Results The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and

Lumbar segmental instability: a criterion-related validity study of manual therapy assessment

Directory of Open Access Journals (Sweden)

Chapple Cathy

2005-11-01

Full Text Available Abstract Background Musculoskeletal physiotherapists routinely assess lumbar segmental motion during the clinical examination of a patient with low back pain. The validity of manual assessment of segmental motion has not, however, been adequately investigated. Methods In this prospective, multi-centre, pragmatic, diagnostic validity study, 138 consecutive patients with recurrent or chronic low back pain (R/CLBP were recruited. Physiotherapists with post-graduate training in manual therapy performed passive accessory intervertebral motion tests (PAIVMs and passive physiological intervertebral motion tests (PPIVMs. Consenting patients were referred for flexion-extension radiographs. Sagittal angular rotation and sagittal translation of each lumbar spinal motion segment was measured from these radiographs, and compared to a reference range derived from a study of 30 asymptomatic volunteers. Motion beyond two standard deviations from the reference mean was considered diagnostic of rotational lumbar segmental instability (LSI and translational LSI. Accuracy and validity of the clinical assessments were expressed using sensitivity, specificity, and likelihood ratio statistics with 95% confidence intervals (CI. Results Only translation LSI was found to be significantly associated with R/CLBP (p Conclusion This study provides the first evidence reporting the concurrent validity of manual tests for the detection of abnormal sagittal planar motion. PAIVMs and PPIVMs are highly specific, but not sensitive, for the detection of translation LSI. Likelihood ratios resulting from positive test results were only moderate. This research indicates that manual clinical examination procedures have moderate validity for detecting segmental motion abnormality.

Do clinical and translational science graduate students understand linear regression? Development and early validation of the REGRESS quiz.

Science.gov (United States)

Enders, Felicity

2013-12-01

Although regression is widely used for reading and publishing in the medical literature, no instruments were previously available to assess students' understanding. The goal of this study was to design and assess such an instrument for graduate students in Clinical and Translational Science and Public Health. A 27-item REsearch on Global Regression Expectations in StatisticS (REGRESS) quiz was developed through an iterative process. Consenting students taking a course on linear regression in a Clinical and Translational Science program completed the quiz pre- and postcourse. Student results were compared to practicing statisticians with a master's or doctoral degree in statistics or a closely related field. Fifty-two students responded precourse, 59 postcourse , and 22 practicing statisticians completed the quiz. The mean (SD) score was 9.3 (4.3) for students precourse and 19.0 (3.5) postcourse (P REGRESS quiz was internally reliable (Cronbach's alpha 0.89). The initial validation is quite promising with statistically significant and meaningful differences across time and study populations. Further work is needed to validate the quiz across multiple institutions. © 2013 Wiley Periodicals, Inc.

Process validation for radiation processing

International Nuclear Information System (INIS)

Miller, A.

1999-01-01

Process validation concerns the establishment of the irradiation conditions that will lead to the desired changes of the irradiated product. Process validation therefore establishes the link between absorbed dose and the characteristics of the product, such as degree of crosslinking in a polyethylene tube, prolongation of shelf life of a food product, or degree of sterility of the medical device. Detailed international standards are written for the documentation of radiation sterilization, such as EN 552 and ISO 11137, and the steps of process validation that are described in these standards are discussed in this paper. They include material testing for the documentation of the correct functioning of the product, microbiological testing for selection of the minimum required dose and dose mapping for documentation of attainment of the required dose in all parts of the product. The process validation must be maintained by reviews and repeated measurements as necessary. This paper presents recommendations and guidance for the execution of these components of process validation. (author)

Development and validation of electronic surveillance tool for acute kidney injury: A retrospective analysis.

Science.gov (United States)

Ahmed, Adil; Vairavan, Srinivasan; Akhoundi, Abbasali; Wilson, Gregory; Chiofolo, Caitlyn; Chbat, Nicolas; Cartin-Ceba, Rodrigo; Li, Guangxi; Kashani, Kianoush

2015-10-01

Timely detection of acute kidney injury (AKI) facilitates prevention of its progress and potentially therapeutic interventions. The study objective is to develop and validate an electronic surveillance tool (AKI sniffer) to detect AKI in 2 independent retrospective cohorts of intensive care unit (ICU) patients. The primary aim is to compare the sensitivity, specificity, and positive and negative predictive values of AKI sniffer performance against a reference standard. This study is conducted in the ICUs of a tertiary care center. The derivation cohort study subjects were Olmsted County, MN, residents admitted to all Mayo Clinic ICUs from July 1, 2010, through December 31, 2010, and the validation cohort study subjects were all patients admitted to a Mayo Clinic, Rochester, campus medical/surgical ICU on January 12, 2010, through March 23, 2010. All included records were reviewed by 2 independent investigators who adjudicated AKI using the Acute Kidney Injury Network criteria; disagreements were resolved by a third reviewer. This constituted the reference standard. An electronic algorithm was developed; its precision and reliability were assessed in comparison with the reference standard in 2 separate cohorts, derivation and validation. Of 1466 screened patients, a total of 944 patients were included in the study: 482 for derivation and 462 for validation. Compared with the reference standard in the validation cohort, the sensitivity and specificity of the AKI sniffer were 88% and 96%, respectively. The Cohen κ (95% confidence interval) agreement between the electronic and the reference standard was 0.84 (0.78-0.89) and 0.85 (0.80-0.90) in the derivation and validation cohorts. Acute kidney injury can reliably and accurately be detected electronically in ICU patients. The presented method is applicable for both clinical (decision support) and research (enrollment for clinical trials) settings. Prospective validation is required. Copyright © 2015 Elsevier Inc. All

Simplification and Validation of Leicester Cough Questionnaire in Mandarin-Chinese

Directory of Open Access Journals (Sweden)

Rongjia LIN

2017-06-01

Full Text Available Background and objective Patients often have cough after lung surgery, and there is a lack of tools to specifically assess postoperative coughs. LCQ-MC (Leicester Cough Questionnaire in Mandarin-Chinese was revised and validated to explore its value on clinical application. Methods A total of 250 patients undergone the lung operation of single medical team, from September 2015 to December 2016 in the Department ofThoracic Surgery, West China Hospital, Sichuan University, were investigated. Among them, 121 patients completed LCQ-MC and 129 patients completed simplified LCQ-MC, we verified the reliability and validity. Results The new questionnaire was not changed in terms of content layout and the scoring method of LCQ-MC, consisting of 12 items and three domains (physical, psychological and social. There was good content validity (S-CVI/UA=0.83. Concurrent validity was high when the simplified LCQ-MC was compared with daytime cough symptom score (r=-0.578, P<0.001. There was a moderate relationship with response to night-time cough symptom score (r=-0.358, P=-0.004 and SF36 total score (r=0.346, P=0.030, and weak relationship with the Hospital Anxiety and Depression Scale total score (r=-0.241, P=0.046. Cronbach’s alpha coefficients of simplified LCQ-CM total and three domains varied between 0.79 and 0.89. One week apart test-retest reliability (n=30 was high (r=0.88-0.96. Conclusion Simplified LCQ-MC has good reliability and validity that can be used for clinical applications.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population.

Directory of Open Access Journals (Sweden)

Erica Gobbi

Full Text Available The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It. Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170 examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA and construct validity with enjoyment perception during physical activity. Study 2 (n = 59 reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry over the span of seven consecutive days. Study 3 (n = 58 examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD. In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83. Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36, with BMI (r = -.30 and -.79 for CHD simple form, and with the VO2max (r = .55 for CHD simple form. Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05. Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.

Psychometric Properties of the Physical Activity Questionnaire for Older Children in Italy: Testing the Validity among a General and Clinical Pediatric Population.

Science.gov (United States)

Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio

2016-01-01

The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.

Contextual Validity in Hybrid Logic

DEFF Research Database (Denmark)

Blackburn, Patrick Rowan; Jørgensen, Klaus Frovin

2013-01-01

interpretations. Moreover, such indexicals give rise to a special kind of validity—contextual validity—that interacts with ordinary logi- cal validity in interesting and often unexpected ways. In this paper we model these interactions by combining standard techniques from hybrid logic with insights from the work...... of Hans Kamp and David Kaplan. We introduce a simple proof rule, which we call the Kamp Rule, and first we show that it is all we need to take us from logical validities involving now to contextual validities involving now too. We then go on to show that this deductive bridge is strong enough to carry us...... to contextual validities involving yesterday, today and tomorrow as well....

Validation of Metagenomic Next-Generation Sequencing Tests for Universal Pathogen Detection.

Science.gov (United States)

Schlaberg, Robert; Chiu, Charles Y; Miller, Steve; Procop, Gary W; Weinstock, George

2017-06-01

- Metagenomic sequencing can be used for detection of any pathogens using unbiased, shotgun next-generation sequencing (NGS), without the need for sequence-specific amplification. Proof-of-concept has been demonstrated in infectious disease outbreaks of unknown causes and in patients with suspected infections but negative results for conventional tests. Metagenomic NGS tests hold great promise to improve infectious disease diagnostics, especially in immunocompromised and critically ill patients. - To discuss challenges and provide example solutions for validating metagenomic pathogen detection tests in clinical laboratories. A summary of current regulatory requirements, largely based on prior guidance for NGS testing in constitutional genetics and oncology, is provided. - Examples from 2 separate validation studies are provided for steps from assay design, and validation of wet bench and bioinformatics protocols, to quality control and assurance. - Although laboratory and data analysis workflows are still complex, metagenomic NGS tests for infectious diseases are increasingly being validated in clinical laboratories. Many parallels exist to NGS tests in other fields. Nevertheless, specimen preparation, rapidly evolving data analysis algorithms, and incomplete reference sequence databases are idiosyncratic to the field of microbiology and often overlooked.

Validation Process Methods

Energy Technology Data Exchange (ETDEWEB)

Lewis, John E. [National Renewable Energy Lab. (NREL), Golden, CO (United States); English, Christine M. [National Renewable Energy Lab. (NREL), Golden, CO (United States); Gesick, Joshua C. [National Renewable Energy Lab. (NREL), Golden, CO (United States); Mukkamala, Saikrishna [National Renewable Energy Lab. (NREL), Golden, CO (United States)

2018-01-04

This report documents the validation process as applied to projects awarded through Funding Opportunity Announcements (FOAs) within the U.S. Department of Energy Bioenergy Technologies Office (DOE-BETO). It describes the procedures used to protect and verify project data, as well as the systematic framework used to evaluate and track performance metrics throughout the life of the project. This report also describes the procedures used to validate the proposed process design, cost data, analysis methodologies, and supporting documentation provided by the recipients.

CFD validation experiments for hypersonic flows

Science.gov (United States)

Marvin, Joseph G.

1992-01-01

A roadmap for CFD code validation is introduced. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments could provide new validation data.

Human Factors methods concerning integrated validation of nuclear power plant control rooms; Metodutveckling foer integrerad validering

Energy Technology Data Exchange (ETDEWEB)

Oskarsson, Per-Anders; Johansson, Bjoern J.E.; Gonzalez, Natalia (Swedish Defence Research Agency, Information Systems, Linkoeping (Sweden))

2010-02-15

The frame of reference for this work was existing recommendations and instructions from the NPP area, experiences from the review of the Turbic Validation and experiences from system validations performed at the Swedish Armed Forces, e.g. concerning military control rooms and fighter pilots. These enterprises are characterized by complex systems in extreme environments, often with high risks, where human error can lead to serious consequences. A focus group has been performed with representatives responsible for Human Factors issues from all Swedish NPP:s. The questions that were discussed were, among other things, for whom an integrated validation (IV) is performed and its purpose, what should be included in an IV, the comparison with baseline measures, the design process, the role of SSM, which methods of measurement should be used, and how the methods are affected of changes in the control room. The report brings different questions to discussion concerning the validation process. Supplementary methods of measurement for integrated validation are discussed, e.g. dynamic, psychophysiological, and qualitative methods for identification of problems. Supplementary methods for statistical analysis are presented. The study points out a number of deficiencies in the validation process, e.g. the need of common guidelines for validation and design, criteria for different types of measurements, clarification of the role of SSM, and recommendations for the responsibility of external participants in the validation process. The authors propose 12 measures for taking care of the identified problems

MARS Validation Plan and Status

International Nuclear Information System (INIS)

Ahn, Seung-hoon; Cho, Yong-jin

2008-01-01

The KINS Reactor Thermal-hydraulic Analysis System (KINS-RETAS) under development is directed toward a realistic analysis approach of best-estimate (BE) codes and realistic assumptions. In this system, MARS is pivoted to provide the BE Thermal-Hydraulic (T-H) response in core and reactor coolant system to various operational transients and accidental conditions. As required for other BE codes, the qualification is essential to ensure reliable and reasonable accuracy for a targeted MARS application. Validation is a key element of the code qualification, and determines the capability of a computer code in predicting the major phenomena expected to occur. The MARS validation was made by its developer KAERI, on basic premise that its backbone code RELAP5/MOD3.2 is well qualified against analytical solutions, test or operational data. A screening was made to select the test data for MARS validation; some models transplanted from RELAP5, if already validated and found to be acceptable, were screened out from assessment. It seems to be reasonable, but does not demonstrate whether code adequacy complies with the software QA guidelines. Especially there may be much difficulty in validating the life-cycle products such as code updates or modifications. This paper presents the plan for MARS validation, and the current implementation status

Content and Construct Validity, Reliability, and Responsiveness of the Rheumatoid Arthritis Flare Questionnaire

DEFF Research Database (Denmark)

Bartlett, Susan J; Barbic, Skye P; Bykerk, Vivian P

2017-01-01

-FQ), and the voting results at OMERACT 2016. METHODS: Classic and modern psychometric methods were used to assess reliability, validity, sensitivity, factor structure, scoring, and thresholds. Interviews with patients and clinicians also assessed content validity, utility, and meaningfulness of RA-FQ scores. RESULTS......: People with RA in observational trials in Canada (n = 896) and France (n = 138), and an RCT in the Netherlands (n = 178) completed 5 items (11-point numerical rating scale) representing RA Flare core domains. There was moderate to high evidence of reliability, content and construct validity...... to identify and measure RA flares. Its review through OMERACT Filter 2.0 shows evidence of reliability, content and construct validity, and responsiveness. These properties merit its further validation as an outcome for clinical trials....

Clinical validation of a non-heteronormative version of the Social Interaction Anxiety Scale (SIAS).

Science.gov (United States)

Lindner, Philip; Martell, Christopher; Bergström, Jan; Andersson, Gerhard; Carlbring, Per

2013-12-19

Despite welcomed changes in societal attitudes and practices towards sexual minorities, instances of heteronormativity can still be found within healthcare and research. The Social Interaction Anxiety Scale (SIAS) is a valid and reliable self-rating scale of social anxiety, which includes one item (number 14) with an explicit heteronormative assumption about the respondent's sexual orientation. This heteronormative phrasing may confuse, insult or alienate sexual minority respondents. A clinically validated version of the SIAS featuring a non-heteronormative phrasing of item 14 is thus needed. 129 participants with diagnosed social anxiety disorder, enrolled in an Internet-based intervention trial, were randomly assigned to responding to the SIAS featuring either the original or a novel non-heteronormative phrasing of item 14, and then answered the other item version. Within-subject, correlation between item versions was calculated and the two scores were statistically compared. The two items' correlations with the other SIAS items and other psychiatric rating scales were also statistically compared. Item versions were highly correlated and scores did not differ statistically. The two items' correlations with other measures did not differ statistically either. The SIAS can be revised with a non-heteronormative formulation of item 14 with psychometric equivalence on item and scale level. Implications for other psychiatric instruments with heteronormative phrasings are discussed.

Psychometric validation of the Italian Rehabilitation Complexity Scale-Extended version 13

Science.gov (United States)

Agosti, Maurizio; Merlo, Andrea; Maini, Maurizio; Lombardi, Francesco; Tedeschi, Claudio; Benedetti, Maria Grazia; Basaglia, Nino; Contini, Mara; Nicolotti, Domenico; Brianti, Rodolfo

2017-01-01

In Italy, at present, a well-known problem is inhomogeneous provision of rehabilitative services, as stressed by MoH, requiring appropriate criteria and parameters to plan rehabilitation actions. According to the Italian National Rehabilitation Plan, Comorbidity, Disability and Clinical Complexity should be assessed to define the patient’s real needs. However, to date, clinical complexity is still difficult to measure with shared and validated tools. The study aims to psychometrically validate the Italian Rehabilitation Complexity Scale-Extended v13 (RCS-E v13), in order to meet the guidelines requirements. An observational multicentre prospective cohort study, involving 8 intensive rehabilitation facilities of the Emilia-Romagna Region and 1712 in-patients, [823 male (48%) and 889 female (52%), mean age 68.34 years (95% CI 67.69–69.00 years)] showing neurological, orthopaedic and cardiological problems, was carried out. The construct and concurrent validity of the RCS-E v13 was confirmed through its correlation to Barthel Index (disability) and Cumulative Illness Rating Scale (comorbidity) and appropriate admission criteria (not yet published), respectively. Furthermore, the factor analysis indicated two different components (“Basic Care or Risk—Equipment” and “Medical—Nursing Needs and Therapy Disciplines”) of the RCS-E v13. In conclusion, the Italian RCS-E v13 appears to be a useful tool to assess clinical complexity in the Italian rehab scenario case-mix and its psychometric validation may have an important clinical rehabilitation impact allowing the assessment of the rehabilitation needs considering all three dimensions (disability, comorbidity and clinical complexity) as required by the Guidelines and the inhomogeneity could be reduced. PMID:29045409

Construct Validity and Reliability of Structured Assessment of endoVascular Expertise in a Simulated Setting

DEFF Research Database (Denmark)

Bech, B; Lönn, L; Falkenberg, M

2011-01-01

Objectives To study the construct validity and reliability of a novel endovascular global rating scale, Structured Assessment of endoVascular Expertise (SAVE). Design A Clinical, experimental study. Materials Twenty physicians with endovascular experiences ranging from complete novices to highly....... Validity was analysed by correlating experience with performance results. Reliability was analysed according to generalisability theory. Results The mean score on the 29 items of the SAVE scale correlated well with clinical experience (R = 0.84, P ... with clinical experience (R = -0.53, P validity and reliability of assessment with the SAVE scale was high when applied to performances in a simulation setting with advanced realism. No ceiling effect...

Validation of the diagnosis 'prosthetic joint infection' in the Danish Hip Arthroplasty Register

DEFF Research Database (Denmark)

Gundtoft, P H; Pedersen, Alma Becic; Schønheyder, H C

2016-01-01

and followed them until first-time revision, death, emigration or until 31 December 2012. Revision for PJI, as registered in the DHR, was validated against a benchmark which included information from microbiology databases, prescription registers, clinical biochemistry registers and clinical records. We......AIMS: The purpose of this study was to validate the diagnosis of periprosthetic joint infection (PJI) in the Danish Hip Arthroplasty Register (DHR). PATIENTS AND METHODS: We identified a cohort of patients from the DHR who had undergone primary total hip arthroplasty (THA) since 1 January 2005...... the validity of the diagnosis of PJI and should enable future register-based studies. Cite this article: Bone Joint J 2016;98-B:320-5....

Rater reliability and construct validity of a mobile application for posture analysis.

Science.gov (United States)

Szucs, Kimberly A; Brown, Elena V Donoso

2018-01-01

[Purpose] Measurement of posture is important for those with a clinical diagnosis as well as researchers aiming to understand the impact of faulty postures on the development of musculoskeletal disorders. A reliable, cost-effective and low tech posture measure may be beneficial for research and clinical applications. The purpose of this study was to determine rater reliability and construct validity of a posture screening mobile application in healthy young adults. [Subjects and Methods] Pictures of subjects were taken in three standing positions. Two raters independently digitized the static standing posture image twice. The app calculated posture variables, including sagittal and coronal plane translations and angulations. Intra- and inter-rater reliability were calculated using the appropriate ICC models for complete agreement. Construct validity was determined through comparison of known groups using repeated measures ANOVA. [Results] Intra-rater reliability ranged from 0.71 to 0.99. Inter-rater reliability was good to excellent for all translations. ICCs were stronger for translations versus angulations. The construct validity analysis found that the app was able to detect the change in the four variables selected. [Conclusion] The posture mobile application has demonstrated strong rater reliability and preliminary evidence of construct validity. This application may have utility in clinical and research settings.

Clinical validation of cutoff target ranges in newborn screening of metabolic disorders by tandem mass spectrometry : A worldwide collaborative project

NARCIS (Netherlands)

McHugh, David M. S.; Cameron, Cynthia A.; Abdenur, Jose E.; Abdulrahman, Mahera; Adair, Ona; Al Nuaimi, Shahira Ahmed; Ahlman, Henrik; Allen, Jennifer J.; Antonozzi, Italo; Archer, Shaina; Au, Sylvia; Auray-Blais, Christiane; Baker, Mei; Bamforth, Fiona; Beckmann, Kinga; Pino, Gessi Bentz; Berberich, Stanton L.; Binard, Robert; Boemer, Francois; Bonham, Jim; Breen, Nancy N.; Bryant, Sandra C.; Caggana, Michele; Caldwell, S. Graham; Camilot, Marta; Campbell, Carlene; Carducci, Claudia; Cariappa, Rohit; Carlisle, Clover; Caruso, Ubaldo; Cassanello, Michela; Miren Castilla, Ane; Castineiras Ramos, Daisy E.; Chakraborty, Pranesh; Chandrasekar, Ram; Ramos, Alfredo Chardon; Cheillan, David; Chien, Yin-Hsiu; Childs, Thomas A.; Chrastina, Petr; Sica, Yuri Cleverthon; Cocho de Juan, Jose Angel; Elena Colandre, Maria; Cornejo Espinoza, Veronica; Corso, Gaetano; Currier, Robert; Cyr, Denis; Czuczy, Noemi; D'Apolito, Oceania; Davis, Tim; de Sain-Van der Velden, Monique G.; Delgado Pecellin, Carmen; Di Gangi, Iole Maria; Di Stefano, Cristina Maria; Dotsikas, Yannis; Downing, Melanie; Downs, Stephen M.; Dy, Bonifacio; Dymerski, Mark; Rueda, Inmaculada; Elvers, Bert; Eaton, Roger; Eckerd, Barbara M.; El Mougy, Fatma; Eroh, Sarah; Espada, Mercedes; Evans, Catherine; Fawbush, Sandy; Fijolek, Kristel F.; Fisher, Lawrence; Franzson, Leifur; Frazier, Dianne M.; Garcia, Luciana R. C.; Garcia-Valdecasas Bermejo, Maria Sierra; Gavrilov, Dimitar; Gerace, Rosemarie; Giordano, Giuseppe; Irazabal, Yolanda Gonzalez; Greed, Lawrence C.; Grier, Robert; Grycki, Elyse; Gu, Xuefan; Gulamali-Majid, Fizza; Hagar, Arthur F.; Han, Lianshu; Hannon, W. Harry; Haslip, Christa; Hassan, Fayza Abdelhamid; He, Miao; Hietala, Amy; Himstedt, Leslie; Hoffman, Gary L.; Hoffman, William; Hoggatt, Philis; Hopkins, Patrick V.; Hougaard, David M.; Hughes, Kerie; Hunt, Patricia R.; Hwu, Wuh-Liang; Hynes, June; Ibarra-Gonzalez, Isabel; Ingham, Cindy A.; Ivanova, Maria; Jacox, Ward B.; John, Catharine; Johnson, John P.; Jonsson, Jon J.; Karg, Eszter; Kasper, David; Klopper, Brenda; Katakouzinos, Dimitris; Khneisser, Issam; Knoll, Detlef; Kobayashi, Hirinori; Koneski, Ronald; Kozich, Viktor; Kouapei, Rasoul; Kohlmueller, Dirk; Kremensky, Ivo; la Marca, Giancarlo; Lavochkin, Marcia; Lee, Soo-Youn; Lehotay, Denis C.; Lemes, Aida; Lepage, Joyce; Lesko, Barbara; Lewis, Barry; Lim, Carol; Linard, Sharon; Lindner, Martin; Lloyd-Puryear, Michele A.; Lorey, Fred; Loukas, Yannis L.; Luedtke, Julie; Maffitt, Neil; Magee, J. Fergall; Manning, Adrienne; Manos, Shawn; Marie, Sandrine; Hadachi, Sonia Marchezi; Marquardt, Gregg; Martin, Stephen J.; Matern, Dietrich; Gibson, Stephanie K. Mayfield; Mayne, Philip; McCallister, Tonya D.; McCann, Mark; McClure, Julie; McGill, James J.; McKeever, Christine D.; McNeilly, Barbara; Morrissey, Mark A.; Moutsatsou, Paraskevi; Mulcahy, Eleanor A.; Nikoloudis, Dimitris; Norgaard-Pedersen, Bent; Oglesbee, Devin; Oltarzewski, Mariusz; Ombrone, Daniela; Ojodu, Jelili; Papakonstantinou, Vagelis; Reoyo, Sherly Pardo; Park, Hyung-Doo; Pasquali, Marzia; Pasquini, Elisabetta; Patel, Pallavi; Pass, Kenneth A.; Peterson, Colleen; Pettersen, Rolf D.; Pitt, James J.; Poh, Sherry; Pollak, Arnold; Porter, Cory; Poston, Philip A.; Price, Ricky W.; Queijo, Cecilia; Quesada, Jonessy; Randell, Edward; Ranieri, Enzo; Raymond, Kimiyo; Reddic, John E.; Reuben, Alejandra; Ricciardi, Charla; Rinaldo, Piero; Rivera, Jeff D.; Roberts, Alicia; Rocha, Hugo; Roche, Geraldine; Greenberg, Cheryl Rochman; Egea Mellado, Jose Maria; Jess Juan-Fita, Maria; Ruiz, Consuelo; Ruoppolo, Margherita; Rutledge, S. Lane; Ryu, Euijung; Saban, Christine; Sahai, Inderneel; Salazar Garcia-Blanco, Maria Isabel; Santiago-Borrero, Pedro; Schenone, Andrea; Schoos, Roland; Schweitzer, Barb; Scott, Patricia; Seashore, Margretta R.; Seeterlin, Mary A.; Sesser, David E.; Sevier, Darrin W.; Shone, Scott M.; Sinclair, Graham; Skrinska, Victor A.; Stanley, Eleanor L.; Strovel, Erin T.; Jones, April L. Studinski; Sunny, Sherlykutty; Takats, Zoltan; Tanyalcin, Tijen; Teofoli, Francesca; Thompson, J. Robert; Tomashitis, Kathy; Domingos, Mouseline Torquado; Torres, Jasmin; Torres, Rosario; Tortorelli, Silvia; Turi, Sandor; Turner, Kimberley; Tzanakos, Nick; Valiente, Alf G.; Vallance, Hillary; Vela-Amieva, Marcela; Vilarinho, Laura; von Doebeln, Ulrika; Vincent, Marie-Francoise; Vorster, B. Chris; Watson, Michael S.; Webster, Dianne; Weiss, Sheila; Wilcken, Bridget; Wiley, Veronica; Williams, Sharon K.; Willis, Sharon A.; Woontner, Michael; Wright, Katherine; Yahyaoui, Raquel; Yamaguchi, Seiji; Yssel, Melissa; Zakowicz, Wendy M.

Purpose: To achieve clinical validation of cutoff values for newborn screening by tandem mass spectrometry through a worldwide collaborative effort. Methods: Cumulative percentiles of amino acids and acylcarnitines in dried blood spots of approximately 25-30 million normal newborns and 10,742

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents.

Directory of Open Access Journals (Sweden)

LuisJoaquín Garcia-Lopez

Full Text Available Social Anxiety Disorder (SAD is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain.The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1 and clinical sample (study 2.Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls. Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency.Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided.

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents.

Science.gov (United States)

Garcia-Lopez, LuisJoaquín; Moore, Harry T A

2015-01-01

Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided.

Methodology for Validating Building Energy Analysis Simulations

Energy Technology Data Exchange (ETDEWEB)

Judkoff, R.; Wortman, D.; O' Doherty, B.; Burch, J.

2008-04-01

The objective of this report was to develop a validation methodology for building energy analysis simulations, collect high-quality, unambiguous empirical data for validation, and apply the validation methodology to the DOE-2.1, BLAST-2MRT, BLAST-3.0, DEROB-3, DEROB-4, and SUNCAT 2.4 computer programs. This report covers background information, literature survey, validation methodology, comparative studies, analytical verification, empirical validation, comparative evaluation of codes, and conclusions.

The Berlin Inventory of Gambling behavior - Screening (BIG-S): Validation using a clinical sample.

Science.gov (United States)

Wejbera, Martin; Müller, Kai W; Becker, Jan; Beutel, Manfred E

2017-05-18

Published diagnostic questionnaires for gambling disorder in German are either based on DSM-III criteria or focus on aspects other than life time prevalence. This study was designed to assess the usability of the DSM-IV criteria based Berlin Inventory of Gambling Behavior Screening tool in a clinical sample and adapt it to DSM-5 criteria. In a sample of 432 patients presenting for behavioral addiction assessment at the University Medical Center Mainz, we checked the screening tool's results against clinical diagnosis and compared a subsample of n=300 clinically diagnosed gambling disorder patients with a comparison group of n=132. The BIG-S produced a sensitivity of 99.7% and a specificity of 96.2%. The instrument's unidimensionality and the diagnostic improvements of DSM-5 criteria were verified by exploratory and confirmatory factor analysis as well as receiver operating characteristic analysis. The BIG-S is a reliable and valid screening tool for gambling disorder and demonstrated its concise and comprehensible operationalization of current DSM-5 criteria in a clinical setting.

Verification, validation, and reliability of predictions

International Nuclear Information System (INIS)

Pigford, T.H.; Chambre, P.L.

1987-04-01

The objective of predicting long-term performance should be to make reliable determinations of whether the prediction falls within the criteria for acceptable performance. Establishing reliable predictions of long-term performance of a waste repository requires emphasis on valid theories to predict performance. The validation process must establish the validity of the theory, the parameters used in applying the theory, the arithmetic of calculations, and the interpretation of results; but validation of such performance predictions is not possible unless there are clear criteria for acceptable performance. Validation programs should emphasize identification of the substantive issues of prediction that need to be resolved. Examples relevant to waste package performance are predicting the life of waste containers and the time distribution of container failures, establishing the criteria for defining container failure, validating theories for time-dependent waste dissolution that depend on details of the repository environment, and determining the extent of congruent dissolution of radionuclides in the UO 2 matrix of spent fuel. Prediction and validation should go hand in hand and should be done and reviewed frequently, as essential tools for the programs to design and develop repositories. 29 refs

Reliability and validity of the Incontinence Quiz-Turkish version.

Science.gov (United States)

Kara, Kerime C; Çıtak Karakaya, İlkim; Tunalı, Nur; Karakaya, Mehmet G

2018-01-01

The aim of this study was to investigate the reliability and validity of the Turkish version of the Incontinence Quiz, which was developed by Branch et al. (1994), to assess women's knowledge of and attitudes toward urinary incontinence. Comprehensibility of the Turkish version of the 14-item Incontinence Quiz, which was prepared following translation-back translation procedures, was tested on a pilot group of eight women, and its internal reliability, test-retest reliability and construct validity were assessed in 150 women who attended the gynecology clinics of three hospitals in İçel, Turkey. Physical and sociodemographic characteristics and presence of incontinence complaints were also recorded. Data were analyzed at the 0.05 alpha level, using SPSS version 22. The scale had good reliability and validity. The internal reliability coefficient (Cronbach α) was 0.80, test-retest correlation coefficients were 0.83-0.94; and with regard to construct validity, Kaiser-Meyer-Olkin coefficient was 0.76 and Barlett sphericity test was 562.777 (P = 0.000). Turkish version of the Incontinence Quiz had a four-factor structure, with Eigenvalues ranging from 1.17 to 4.08. The Incontinence Quiz-Turkish version is a highly comprehensible, reliable and valid scale, which may be used to assess Turkish-speaking women's knowledge of and attitudes toward urinary incontinence. © 2017 Japan Society of Obstetrics and Gynecology.

Validation of an online replanning technique for prostate adaptive radiotherapy

Energy Technology Data Exchange (ETDEWEB)

Peng Cheng; Chen Guangpei; Ahunbay, Ergun; Wang Dian; Lawton, Colleen; Li, X Allen, E-mail: ali@mcw.edu [Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI (United States)

2011-06-21

We have previously developed an online adaptive replanning technique to rapidly adapt the original plan according to daily CT. This paper reports the quality assurance (QA) developments in its clinical implementation for prostate cancer patients. A series of pre-clinical validation tests were carried out to verify the overall accuracy and consistency of the online replanning procedure. These tests include (a) phantom measurements of 22 individual patient adaptive plans to verify their accuracy and deliverability and (b) efficiency and applicability of the online replanning process. A four-step QA procedure was established to ensure the safe and accurate delivery of an adaptive plan, including (1) offline phantom measurement of the original plan, (2) online independent monitor unit (MU) calculation for a redundancy check, (3) online verification of plan-data transfer using an in-house software and (4) offline validation of actually delivered beam parameters. The pre-clinical validations demonstrate that the newly implemented online replanning technique is dosimetrically accurate and practically efficient. The four-step QA procedure is capable of identifying possible errors in the process of online adaptive radiotherapy and to ensure the safe and accurate delivery of the adaptive plans. Based on the success of this work, the online replanning technique has been used in the clinic to correct for interfractional changes during the prostate radiation therapy.

Validation of an online replanning technique for prostate adaptive radiotherapy

International Nuclear Information System (INIS)

Peng Cheng; Chen Guangpei; Ahunbay, Ergun; Wang Dian; Lawton, Colleen; Li, X Allen

2011-01-01

We have previously developed an online adaptive replanning technique to rapidly adapt the original plan according to daily CT. This paper reports the quality assurance (QA) developments in its clinical implementation for prostate cancer patients. A series of pre-clinical validation tests were carried out to verify the overall accuracy and consistency of the online replanning procedure. These tests include (a) phantom measurements of 22 individual patient adaptive plans to verify their accuracy and deliverability and (b) efficiency and applicability of the online replanning process. A four-step QA procedure was established to ensure the safe and accurate delivery of an adaptive plan, including (1) offline phantom measurement of the original plan, (2) online independent monitor unit (MU) calculation for a redundancy check, (3) online verification of plan-data transfer using an in-house software and (4) offline validation of actually delivered beam parameters. The pre-clinical validations demonstrate that the newly implemented online replanning technique is dosimetrically accurate and practically efficient. The four-step QA procedure is capable of identifying possible errors in the process of online adaptive radiotherapy and to ensure the safe and accurate delivery of the adaptive plans. Based on the success of this work, the online replanning technique has been used in the clinic to correct for interfractional changes during the prostate radiation therapy.

Further validation and definition of the psychometric properties of the Asthma Impact Survey.

Science.gov (United States)

Schatz, Michael; Zeiger, Robert S; Yang, Su-Jau; Chen, Wansu; Kosinski, Mark

2011-07-01

The Asthma Impact Survey (AIS-6) is a brief disease-specific quality-of-life instrument with limited published validation data. To obtain additional validation data and psychometric properties of the AIS-6. In November, 2007, patients with persistent asthma were mailed a survey that included the AIS-6, the mini-Asthma Quality of Life Questionnaire (mAQLQ), and the Asthma Control Test (ACT). Follow-up surveys were sent in April, July, and October 2008. Year 2008 exacerbations and short-acting β-agonist (SABA) dispensings were captured from administrative data. A total of 2680 patients had complete baseline survey data. Criterion validity was demonstrated by the strong correlations of the AIS-6 with the mAQLQ (r = -0.84 to -0.86); construct validity by significant relationships (P validity by significant relationships (P reliability (intraclass correlation coefficient = 0.86-0.91) were also demonstrated. The AIS-6 demonstrated good psychometric properties in a large independent sample and could be used to assess asthma-specific quality of life in clinical practice and clinical research. Copyright © 2011 American Academy of Allergy, Asthma & Immunology. Published by Mosby, Inc. All rights reserved.

Ground-water models: Validate or invalidate

Science.gov (United States)

Bredehoeft, J.D.; Konikow, Leonard F.

1993-01-01

The word validation has a clear meaning to both the scientific community and the general public. Within the scientific community the validation of scientific theory has been the subject of philosophical debate. The philosopher of science, Karl Popper, argued that scientific theory cannot be validated, only invalidated. Popper’s view is not the only opinion in this debate; however, many scientists today agree with Popper (including the authors). To the general public, proclaiming that a ground-water model is validated carries with it an aura of correctness that we do not believe many of us who model would claim. We can place all the caveats we wish, but the public has its own understanding of what the word implies. Using the word valid with respect to models misleads the public; verification carries with it similar connotations as far as the public is concerned. Our point is this: using the terms validation and verification are misleading, at best. These terms should be abandoned by the ground-water community.

Test-driven verification/validation of model transformations

Institute of Scientific and Technical Information of China (English)

László LENGYEL; Hassan CHARAF

2015-01-01

Why is it important to verify/validate model transformations? The motivation is to improve the quality of the trans-formations, and therefore the quality of the generated software artifacts. Verified/validated model transformations make it possible to ensure certain properties of the generated software artifacts. In this way, verification/validation methods can guarantee different requirements stated by the actual domain against the generated/modified/optimized software products. For example, a verified/ validated model transformation can ensure the preservation of certain properties during the model-to-model transformation. This paper emphasizes the necessity of methods that make model transformation verified/validated, discusses the different scenarios of model transformation verification and validation, and introduces the principles of a novel test-driven method for verifying/ validating model transformations. We provide a solution that makes it possible to automatically generate test input models for model transformations. Furthermore, we collect and discuss the actual open issues in the field of verification/validation of model transformations.

Validation of a Spanish version of the Test Your Memory.

Science.gov (United States)

Ferrero-Arias, J; Turrión-Rojo, M Á

2016-01-01

To validate a Spanish version of the TYM, a self-administered cognitive screening test designed for the detection of Alzheimer's disease and mild cognitive defect. A cross-sectional study was conducted in a neurology outpatient clinic. The TYM was administered to individuals of 50 years o more who came to the clinic for whatever the symptom. Their cognitive state was evaluated regardless of the outcome of TYM. They were categorized into 3 groups: 1) Cognitively normal (739), 2) with mild cognitive impairment (183), 3) with dementia (127). An analysis of items was made and the psychometric properties of the TYM were defined. There was a cross-validation, and the predictive validity of the TYM score, adjusted to the demographic variables, was determined by evaluating their performance in ROC curves. The internal consistency, interobserver reliability, short term and long-term test-retest reliability were adequate. The TYM correlated with the MMSE (r=0.779, Pde Neurología. Published by Elsevier España, S.L.U. All rights reserved.

[Validation of the IBS-SSS].

Science.gov (United States)

Betz, C; Mannsdörfer, K; Bischoff, S C

2013-10-01

Irritable bowel syndrome (IBS) is a functional gastrointestinal disorder characterised by abdominal pain, associated with stool abnormalities and changes in stool consistency. Diagnosis of IBS is based on characteristic symptoms and exclusion of other gastrointestinal diseases. A number of questionnaires exist to assist diagnosis and assessment of severity of the disease. One of these is the irritable bowel syndrome - severity scoring system (IBS-SSS). The IBS-SSS was validated 1997 in its English version. In the present study, the IBS-SSS has been validated in German language. To do this, a cohort of 60 patients with IBS according to the Rome III criteria, was compared with a control group of healthy individuals (n = 38). We studied sensitivity and reproducibility of the score, as well as the sensitivity to detect changes of symptom severity. The results of the German validation largely reflect the results of the English validation. The German version of the IBS-SSS is also a valid, meaningful and reproducible questionnaire with a high sensitivity to assess changes in symptom severity, especially in IBS patients with moderate symptoms. It is unclear if the IBS-SSS is also a valid questionnaire in IBS patients with severe symptoms because this group of patients was not studied. © Georg Thieme Verlag KG Stuttgart · New York.

HPLC determination of plasma dimethylarginines: method validation and preliminary clinical application.

Science.gov (United States)

Ivanova, Mariela; Artusi, Carlo; Boffa, Giovanni Maria; Zaninotto, Martina; Plebani, Mario

2010-11-11

Asymmetric dimethylarginine (ADMA) has been suggested as a possible marker of endothelial dysfunction, and interest in its use in clinical practice is increasing. However, the potential role of symmetric dimethylarginine (SDMA) as an endogenous marker of renal function, has been less widely investigated. The aims of the present study were therefore to determine reference values for dimethylarginines in plasma after method validation, and to ascertain ADMA plasma concentrations in patients with disorders characterized by endothelial dysfunction; a further end-point was to investigate the relationship between SDMA plasma concentrations and estimated GFR (eGFR) as well as plasmatic creatinine in patients with chronic kidney disease (CKD). HPLC with fluorescence detection was used for the determination of plasma dimethylarginines. To verify the clinical usefulness of ADMA and SDMA, values from 4 groups of patients at a high risk of cardiovascular complications as well renal dysfunction (chronic heart failure n=126; type II diabetes n=43; pulmonary arterial hypertension n=17; chronic kidney disease n=42) were evaluated, and compared with the reference values, obtained from 225 blood donors. The intra- and inter-assay CVs (peadiatric populations, for which the use of eGFR is not recommended. 2010 Elsevier B.V. All rights reserved.

[Autism Spectrum Disorder in DSM-5 - concept, validity, and reliability, impact on clinical care and future research].

Science.gov (United States)

Freitag, Christine M

2014-05-01

Autism Spectrum Disorder (ASD) in DSM-5 comprises the former DSM-IV-TR diagnoses of Autistic Disorder, Asperger's Disorder and PDD-nos. The criteria for ASD in DSM-5 were considerably revised from those of ICD-10 and DSM-IV-TR. The present article compares the diagnostic criteria, presents studies on the validity and reliability of ASD, and discusses open questions. It ends with a clinical and research perspective.

Further Validation of the IDAS: Evidence of Convergent, Discriminant, Criterion, and Incremental Validity

Science.gov (United States)

Watson, David; O'Hara, Michael W.; Chmielewski, Michael; McDade-Montez, Elizabeth A.; Koffel, Erin; Naragon, Kristin; Stuart, Scott

2008-01-01

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent…

Development and validation of a self-efficacy questionnaire (SE-12) measuring the clinical communication skills of health care professionals

DEFF Research Database (Denmark)

Axboe, Mette K; Christensen, Kaj S; Kofoed, Poul-Erik

2016-01-01

of the theoretical approach applied in the communication course, statements from former course participants, teachers, and experts in the field. The questionnaire was initially validated through face-to-face interviews with 9 staff members following a test-retest including 195 participants. Results After minor......Background The outcome of communication training is widely measured by self-efficacy ratings, and different questionnaires have been used. Nevertheless, none of these questionnaires have been formally validated through systematic measurement of assessment properties. Consequently, we decided....... We consider the questionnaire useful for self-evaluation of clinical communication skills; the SE-12 is user-friendly and can be administered as an electronic questionnaire. However, future research should explore potential needs for adjustments to reduce the identified ceiling effect. Keyword...

Empirical Derivation and Validation of a Clinical Case Definition for Neuropsychological Impairment in Children and Adolescents.

Science.gov (United States)

Beauchamp, Miriam H; Brooks, Brian L; Barrowman, Nick; Aglipay, Mary; Keightley, Michelle; Anderson, Peter; Yeates, Keith O; Osmond, Martin H; Zemek, Roger

2015-09-01

Neuropsychological assessment aims to identify individual performance profiles in multiple domains of cognitive functioning; however, substantial variation exists in how deficits are defined and what cutoffs are used, and there is no universally accepted definition of neuropsychological impairment. The aim of this study was to derive and validate a clinical case definition rule to identify neuropsychological impairment in children and adolescents. An existing normative pediatric sample was used to calculate base rates of abnormal functioning on eight measures covering six domains of neuropsychological functioning. The dataset was analyzed by varying the range of cutoff levels [1, 1.5, and 2 standard deviations (SDs) below the mean] and number of indicators of impairment. The derived rule was evaluated by bootstrap, internal and external clinical validation (orthopedic and traumatic brain injury). Our neuropsychological impairment (NPI) rule was defined as "two or more test scores that fall 1.5 SDs below the mean." The rule identifies 5.1% of the total sample as impaired in the assessment battery and consistently targets between 3 and 7% of the population as impaired even when age, domains, and number of tests are varied. The NPI rate increases in groups known to exhibit cognitive deficits. The NPI rule provides a psychometrically derived method for interpreting performance across multiple tests and may be used in children 6-18 years. The rule may be useful to clinicians and scientists who wish to establish whether specific individuals or clinical populations present within expected norms versus impaired function across a battery of neuropsychological tests.

The Role of Generalizability in Validity.

Science.gov (United States)

Kane, Michael

The relationship between generalizability and validity is explained, making four important points. The first is that generalizability coefficients provide upper bounds on validity. The second point is that generalization is one step in most interpretive arguments, and therefore, generalizability is a necessary condition for the validity of these…

Validation of limited sampling models (LSM) for estimating AUC in therapeutic drug monitoring - is a separate validation group required?

NARCIS (Netherlands)

Proost, J. H.

Objective: Limited sampling models (LSM) for estimating AUC in therapeutic drug monitoring are usually validated in a separate group of patients, according to published guidelines. The aim of this study is to evaluate the validation of LSM by comparing independent validation with cross-validation

Severity score system for progressive myelopathy: development and validation of a new clinical scale

Directory of Open Access Journals (Sweden)

R.M. Castilhos

2012-07-01

Full Text Available Progressive myelopathies can be secondary to inborn errors of metabolism (IEM such as mucopolysaccharidosis, mucolipidosis, and adrenomyeloneuropathy. The available scale, Japanese Orthopaedic Association (JOA score, was validated only for degenerative vertebral diseases. Our objective is to propose and validate a new scale addressing progressive myelopathies and to present validating data for JOA in these diseases. A new scale, Severity Score System for Progressive Myelopathy (SSPROM, covering motor disability, sphincter dysfunction, spasticity, and sensory losses. Inter- and intra-rater reliabilities were measured. External validation was tested by applying JOA, the Expanded Disability Status Scale (EDSS, the Barthel index, and the Osame Motor Disability Score. Thirty-eight patients, 17 with adrenomyeloneuropathy, 3 with mucopolysaccharidosis I, 3 with mucopolysaccharidosis IV, 2 with mucopolysaccharidosis VI, 2 with mucolipidosis, and 11 with human T-cell lymphotropic virus type-1 (HTLV-1-associated myelopathy participated in the study. The mean ± SD SSPROM and JOA scores were 74.6 ± 11.4 and 12.4 ± 2.3, respectively. Construct validity for SSPROM (JOA: r = 0.84, P < 0.0001; EDSS: r = -0.83, P < 0.0001; Barthel: r = 0.56, P < 0.002; Osame: r = -0.94, P < 0.0001 and reliability (intra-rater: r = 0.83, P < 0.0001; inter-rater: r = 0.94, P < 0.0001 were demonstrated. The metric properties of JOA were similar to those found in SSPROM. Several clinimetric requirements were met for both SSPROM and JOA scales. Since SSPROM has a wider range, it should be useful for follow-up studies on IEM myelopathies.

Swallowing sparing intensity modulated radiotherapy (SW-IMRT) in head and neck cancer : Clinical validation according to the model-based approach

NARCIS (Netherlands)

Christianen, Miranda E. M. C.; van der Schaaf, Arjen; van der Laan, Hans Paul; Verdonck-de Leeuw, Irma M.; Doornaert, Patricia; Chouvalova, Olga; Steenbakkers, Roel J. H. M.; Leemans, Charles Rene; Oosting, Sjoukje F.; van der Laan, Bernard F. A. M.; Roodenburg, Jan L. N.; Slotman, Ben J.; Bijl, Hendrik P.; Langendijk, Johannes A.

Purpose: The aim of this study was to clinically validate a multivariable normal tissue complication probability (NTCP) model for grade 2-4 swallowing dysfunction at 6 months after radiotherapy or chemoradiation (SWAL(M6)) in head and neck cancer patients treated with swallowing sparing intensity

Validation of the Asthma Illness Representation Scale-Spanish (AIRS-S).

Science.gov (United States)

Sidora-Arcoleo, Kimberly Joan; Feldman, Jonathan; Serebrisky, Denise; Spray, Amanda

2010-05-01

To expand knowledge surrounding parental illness representations (IRs) of their children's asthma, it is imperative that culturally appropriate survey instruments are developed and validated for use in clinical and research settings. The Asthma Illness Representation Scale (AIRS) provides a structured assessment of the key components of asthma IRs, allowing the health care provider (HCP) to quickly identify areas of discordance with the professional model of asthma management. The English AIRS was developed and validated among a geographically and ethnically diverse sample. The authors present the validation results of the AIRS-S (Spanish) from a sample of Mexican and Puerto Rican parents. The AIRS was translated and back translated per approved methodologies. Factor analysis, internal reliability, external validity, and 2-week test-retest reliability (on a subsample) were carried out and results compared with the validated English version. Data were obtained from 80 Spanish-speaking Mexican and Puerto Rican parents of children with asthma. The sample was recruited from two school-based health centers and a free medical clinic in Phoenix, Arizona, and a hospital-based asthma clinic in Bronx, New York. The original Nature of Asthma Symptoms, Facts About Asthma, and Attitudes Towards Medication Use subscales emerged. Remaining factors were a mixture of items with no coherent or theoretical distinction between them. Interpretation of results is limited due to not meeting the minimum requirement of 5 observations/item. Cronbach's alpha coefficients for the total score (alpha = .77) and majority of subscales (alpha range = .53-.77) were acceptable and consistent with the English version. Parental reports of a positive relationship with the HCP significantly predicted AIRS scores congruent with the professional model; longer asthma duration was associated with beliefs aligned with the lay model; and AIRS scores congruent with the professional model were related to lower

Criterion validity and clinical usefulness of Attention Deficit Hyperactivity Disorder Rating Scale IV in attention deficit hyperactivity disorder (ADHD) as a function of method and age.

Science.gov (United States)

López-Villalobos, José A; Andrés-De Llano, Jesús; López-Sánchez, María V; Rodríguez-Molinero, Luis; Garrido-Redondo, Mercedes; Sacristán-Martín, Ana M; Martínez-Rivera, María T; Alberola-López, Susana

2017-02-01

The aim of this research is to analyze Attention Deficit Hyperactivity Disorder Rating Scales IV (ADHD RS-IV) criteria validity and its clinical usefulness for the assessment of Attention Deficit Hyperactivity Disorder (ADHD) as a function of assessment method and age. A sample was obtained from an epidemiological study (n = 1095, 6-16 years). Clinical cases of ADHD  (ADHD-CL) were selected by dimensional ADHD RS-IV and later by clinical interview (DSM-IV). ADHD-CL cases were compared with four categorical results of ADHD RS-IV provided by parents (CATPA), teachers (CATPR), either parents or teachers (CATPAOPR) and both parents and teachers (CATPA&PR). Criterion validity and clinical usefulness of the answer modalities to ADHD RS-IV were studied. ADHD-CL rate was 6.9% in childhood, 6.2% in preadolescence and 6.9% in adolescence. Alternative methods to the clinical interview led to increased numbers of ADHD cases in all age groups analyzed, in the following sequence: CATPAOPR> CATPRO> CATPA> CATPA&PR> ADHD-CL. CATPA&PR was the procedure with the greatest validity, specificity and clinical usefulness in all three age groups, particularly in the childhood. Isolated use of ADHD RS-IV leads to an increase in ADHD cases compared to clinical interview, and varies depending on the procedure used.

Simulation Validation for Societal Systems

National Research Council Canada - National Science Library

Yahja, Alex

2006-01-01

.... There are however, substantial obstacles to validation. The nature of modeling means that there are implicit model assumptions, a complex model space and interactions, emergent behaviors, and uncodified and inoperable simulation and validation knowledge...

Clinical validation of targeted next-generation sequencing for inherited disorders.

Science.gov (United States)

Yohe, Sophia; Hauge, Adam; Bunjer, Kari; Kemmer, Teresa; Bower, Matthew; Schomaker, Matthew; Onsongo, Getiria; Wilson, Jon; Erdmann, Jesse; Zhou, Yi; Deshpande, Archana; Spears, Michael D; Beckman, Kenneth; Silverstein, Kevin A T; Thyagarajan, Bharat

2015-02-01

Although next-generation sequencing (NGS) can revolutionize molecular diagnostics, several hurdles remain in the implementation of this technology in clinical laboratories. To validate and implement an NGS panel for genetic diagnosis of more than 100 inherited diseases, such as neurologic conditions, congenital hearing loss and eye disorders, developmental disorders, nonmalignant diseases treated by hematopoietic cell transplantation, familial cancers, connective tissue disorders, metabolic disorders, disorders of sexual development, and cardiac disorders. The diagnostic gene panels ranged from 1 to 54 genes with most of panels containing 10 genes or fewer. We used a liquid hybridization-based, target-enrichment strategy to enrich 10 067 exons in 568 genes, followed by NGS with a HiSeq 2000 sequencing system (Illumina, San Diego, California). We successfully sequenced 97.6% (9825 of 10 067) of the targeted exons to obtain a minimum coverage of 20× at all bases. We demonstrated 100% concordance in detecting 19 pathogenic single-nucleotide variations and 11 pathogenic insertion-deletion mutations ranging in size from 1 to 18 base pairs across 18 samples that were previously characterized by Sanger sequencing. Using 4 pairs of blinded, duplicate samples, we demonstrated a high degree of concordance (>99%) among the blinded, duplicate pairs. We have successfully demonstrated the feasibility of using the NGS platform to multiplex genetic tests for several rare diseases and the use of cloud computing for bioinformatics analysis as a relatively low-cost solution for implementing NGS in clinical laboratories.

A Measure of Perceived Chronic Social Adversity: Development and Validation

Directory of Open Access Journals (Sweden)

Jingqiu Zhang

2017-12-01

Full Text Available The goal of this study was to develop a measure that assesses negative daily social encounters. Specifically, we examined the concept of perceived chronic social adversity and its assessment, the Perceived Chronic Social Adversity Questionnaire (PCSAQ. The PCSAQ focused on the subjective processing of daily social experiences. Psychometric properties were examined within two non-clinical samples (N = 331 and N = 390 and one clinical sample (N = 86. Exploratory and confirmatory factor analyses supported a three-factor model of the PCSAQ, which corresponds to three types of daily social stressors. The final 28-item PCSAQ was shown to be internally consistent, and to have good construct validity in terms of factor structure and group differences. It was also shown to have good concurrent validity in terms of association with outcome variables (sense of control, happiness, and mood and anxiety symptoms. Perceived chronic social adversity was also shown to be correlated with PTSD severity. Taken together, these findings suggest that the PCSAQ is a reliable, valid, and useful measure that can be used to assess negative social and clinical aspects of personal experiences. This study is an important exploratory step in improving our understanding of the relationship between the cumulative effect of negative social encounters and psychological difficulty.

Validation of the theoretical domains framework for use in behaviour change and implementation research

OpenAIRE

Cane, James E.; O'Connor, Denise; Michie, Susan

2012-01-01

Abstract Background An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Methods Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. Results The...

Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences

Science.gov (United States)

Parsons, Thomas D.

2015-01-01

An essential tension can be found between researchers interested in ecological validity and those concerned with maintaining experimental control. Research in the human neurosciences often involves the use of simple and static stimuli lacking many of the potentially important aspects of real world activities and interactions. While this research is valuable, there is a growing interest in the human neurosciences to use cues about target states in the real world via multimodal scenarios that involve visual, semantic, and prosodic information. These scenarios should include dynamic stimuli presented concurrently or serially in a manner that allows researchers to assess the integrative processes carried out by perceivers over time. Furthermore, there is growing interest in contextually embedded stimuli that can constrain participant interpretations of cues about a target’s internal states. Virtual reality environments proffer assessment paradigms that combine the experimental control of laboratory measures with emotionally engaging background narratives to enhance affective experience and social interactions. The present review highlights the potential of virtual reality environments for enhanced ecological validity in the clinical, affective, and social neurosciences. PMID:26696869

Shift Verification and Validation

Energy Technology Data Exchange (ETDEWEB)

Pandya, Tara M. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Evans, Thomas M. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Davidson, Gregory G [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Johnson, Seth R. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Godfrey, Andrew T. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2016-09-07

This documentation outlines the verification and validation of Shift for the Consortium for Advanced Simulation of Light Water Reactors (CASL). Five main types of problems were used for validation: small criticality benchmark problems; full-core reactor benchmarks for light water reactors; fixed-source coupled neutron-photon dosimetry benchmarks; depletion/burnup benchmarks; and full-core reactor performance benchmarks. We compared Shift results to measured data and other simulated Monte Carlo radiation transport code results, and found very good agreement in a variety of comparison measures. These include prediction of critical eigenvalue, radial and axial pin power distributions, rod worth, leakage spectra, and nuclide inventories over a burn cycle. Based on this validation of Shift, we are confident in Shift to provide reference results for CASL benchmarking.

Scoring and psychometric validation of the Perception of Anticoagulant Treatment Questionnaire (PACT-Q©

Directory of Open Access Journals (Sweden)

Essers B

2009-04-01

Full Text Available Abstract Background The 'Perception of Anti-Coagulant Treatment Questionnaire' (PACT-Q was developed to assess patients' expectations of, and satisfaction with their anticoagulant treatment. This questionnaire needs to be finalised and psychometrically validated. Methods The PACT-Q was included in the United States, the Netherlands and France into three phase III multinational clinical trials conducted to evaluate efficacy and safety of a new long-acting anticoagulant drug (idraparinux compared to vitamin K antagonist (VKA. PACT-Q was administered to patients with deep venous thrombosis (DVT, atrial fibrillation (AF or pulmonary embolism (PE at Day 1, to assess patients' expectations, and at 3 and 6 months to assess patients' satisfaction and treatment convenience and burden. The final structure of the PACT-Q (Principal Component Analysis – PCA – with Varimax Rotation was first determined and its psychometric properties were then measured with validity of the structure (Multitrait analysis, internal consistency reliability (Cronbach's alpha coefficients and known-group validity. Results PCA and multitrait analyses showed the multidimensionality of the "Treatment Expectations" dimension, comprising 7 items that had to be scored independently. The "Convenience" and "Burden of Disease and Treatment" dimensions of the hypothesised original structure of the questionnaire were combined, thus resulting in 13 items grouped into the single dimension "Convenience". The "Anticoagulant Treatment Satisfaction" dimension remained unchanged and included 7 items. All items of the "Convenience" and "Anticoagulant Treatment Satisfaction" dimensions displayed good convergent and discriminant validity. The internal consistency reliability was good, with a Cronbach's alpha of 0.84 for the "Convenience" dimension, and 0.76 for the "Anticoagulant Treatment Satisfaction" dimension. Known-group validity was good, especially with regard to occurrence of

The Brief Fear of Negative Evaluation Scale (BFNE: translation and validation study of the Iranian version

Directory of Open Access Journals (Sweden)

Ghaedi Gholam

2009-07-01

Full Text Available Abstract Background The Brief Fear of Negative Evaluation Scale (BFNE is a commonly used instrument to measure social anxiety. This study aimed to translate and to test the reliability and validity of the BFNE in Iran. Methods The English language version of the BFNE was translated into Persian (Iranian language and was used in this study. The questionnaire was administered to a consecutive sample of 235 students with (n = 33, clinical group and without social phobia (n = 202, non-clinical group. In addition to the BFNE, two standard instruments were used to measure social phobia severity: the Social Phobia Inventory (SPIN, and the Social Interaction Anxiety Scale (SIAS. All participants completed a brief background information questionnaire, the SPIN, the SIAS and the BFNE scales. Statistical analysis was performed to test the reliability and validity of the BFNE. Results In all 235 students were studied (111 male and 124 female. The mean age for non-clinical group was 22.2 (SD = 2.1 years and for clinical sample it was 22.4 (SD = 1.8 years. Cronbach's alpha coefficient (to test reliability was acceptable for both non-clinical and clinical samples (α = 0.90 and 0.82 respectively. In addition, 3-week test-retest reliability was performed in non-clinical sample and the intraclass correlation coefficient (ICC was quite high (ICC = 0.71. Validity as performed using convergent and discriminant validity showed satisfactory results. The questionnaire correlated well with established measures of social phobia such as the SPIN (r = 0.43, p Conclusion This validation study of the Iranian version of BFNE proved that it is an acceptable, reliable and valid measure of social phobia. However, since the scale showed a two-factor structure and this does not confirm to the theoretical basis for the BFNE, thus we suggest the use of the BFNE-II when it becomes available in Iran. The validation study of the BFNE-II is in progress.

Model-based PSF and MTF estimation and validation from skeletal clinical CT images.

Science.gov (United States)

Pakdel, Amirreza; Mainprize, James G; Robert, Normand; Fialkov, Jeffery; Whyne, Cari M

2014-01-01

A method was developed to correct for systematic errors in estimating the thickness of thin bones due to image blurring in CT images using bone interfaces to estimate the point-spread-function (PSF). This study validates the accuracy of the PSFs estimated using said method from various clinical CT images featuring cortical bones. Gaussian PSFs, characterized by a different extent in the z (scan) direction than in the x and y directions were obtained using our method from 11 clinical CT scans of a cadaveric craniofacial skeleton. These PSFs were estimated for multiple combinations of scanning parameters and reconstruction methods. The actual PSF for each scan setting was measured using the slanted-slit technique within the image slice plane and the longitudinal axis. The Gaussian PSF and the corresponding modulation transfer function (MTF) are compared against the actual PSF and MTF for validation. The differences (errors) between the actual and estimated full-width half-max (FWHM) of the PSFs were 0.09 ± 0.05 and 0.14 ± 0.11 mm for the xy and z axes, respectively. The overall errors in the predicted frequencies measured at 75%, 50%, 25%, 10%, and 5% MTF levels were 0.06 ± 0.07 and 0.06 ± 0.04 cycles/mm for the xy and z axes, respectively. The accuracy of the estimates was dependent on whether they were reconstructed with a standard kernel (Toshiba's FC68, mean error of 0.06 ± 0.05 mm, MTF mean error 0.02 ± 0.02 cycles/mm) or a high resolution bone kernel (Toshiba's FC81, PSF FWHM error 0.12 ± 0.03 mm, MTF mean error 0.09 ± 0.08 cycles/mm). The method is accurate in 3D for an image reconstructed using a standard reconstruction kernel, which conforms to the Gaussian PSF assumption but less accurate when using a high resolution bone kernel. The method is a practical and self-contained means of estimating the PSF in clinical CT images featuring cortical bones, without the need phantoms or any prior knowledge about the scanner-specific parameters.

Model-based PSF and MTF estimation and validation from skeletal clinical CT images

International Nuclear Information System (INIS)

Pakdel, Amirreza; Mainprize, James G.; Robert, Normand; Fialkov, Jeffery; Whyne, Cari M.

2014-01-01

Purpose: A method was developed to correct for systematic errors in estimating the thickness of thin bones due to image blurring in CT images using bone interfaces to estimate the point-spread-function (PSF). This study validates the accuracy of the PSFs estimated using said method from various clinical CT images featuring cortical bones. Methods: Gaussian PSFs, characterized by a different extent in the z (scan) direction than in the x and y directions were obtained using our method from 11 clinical CT scans of a cadaveric craniofacial skeleton. These PSFs were estimated for multiple combinations of scanning parameters and reconstruction methods. The actual PSF for each scan setting was measured using the slanted-slit technique within the image slice plane and the longitudinal axis. The Gaussian PSF and the corresponding modulation transfer function (MTF) are compared against the actual PSF and MTF for validation. Results: The differences (errors) between the actual and estimated full-width half-max (FWHM) of the PSFs were 0.09 ± 0.05 and 0.14 ± 0.11 mm for the xy and z axes, respectively. The overall errors in the predicted frequencies measured at 75%, 50%, 25%, 10%, and 5% MTF levels were 0.06 ± 0.07 and 0.06 ± 0.04 cycles/mm for the xy and z axes, respectively. The accuracy of the estimates was dependent on whether they were reconstructed with a standard kernel (Toshiba's FC68, mean error of 0.06 ± 0.05 mm, MTF mean error 0.02 ± 0.02 cycles/mm) or a high resolution bone kernel (Toshiba's FC81, PSF FWHM error 0.12 ± 0.03 mm, MTF mean error 0.09 ± 0.08 cycles/mm). Conclusions: The method is accurate in 3D for an image reconstructed using a standard reconstruction kernel, which conforms to the Gaussian PSF assumption but less accurate when using a high resolution bone kernel. The method is a practical and self-contained means of estimating the PSF in clinical CT images featuring cortical bones, without the need phantoms or any prior knowledge about the

Model-based PSF and MTF estimation and validation from skeletal clinical CT images

Energy Technology Data Exchange (ETDEWEB)

Pakdel, Amirreza [Sunnybrook Research Institute, Toronto, Ontario M4N 3M5, Canada and Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario M5S 3M2 (Canada); Mainprize, James G.; Robert, Normand [Sunnybrook Research Institute, Toronto, Ontario M4N 3M5 (Canada); Fialkov, Jeffery [Division of Plastic Surgery, Sunnybrook Health Sciences Center, Toronto, Ontario M4N 3M5, Canada and Department of Surgery, University of Toronto, Toronto, Ontario M5S 3M2 (Canada); Whyne, Cari M., E-mail: cari.whyne@sunnybrook.ca [Sunnybrook Research Institute, Toronto, Ontario M4N 3M5, Canada and Department of Surgery, Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario M5S 3M2 (Canada)

2014-01-15

Purpose: A method was developed to correct for systematic errors in estimating the thickness of thin bones due to image blurring in CT images using bone interfaces to estimate the point-spread-function (PSF). This study validates the accuracy of the PSFs estimated using said method from various clinical CT images featuring cortical bones. Methods: Gaussian PSFs, characterized by a different extent in the z (scan) direction than in the x and y directions were obtained using our method from 11 clinical CT scans of a cadaveric craniofacial skeleton. These PSFs were estimated for multiple combinations of scanning parameters and reconstruction methods. The actual PSF for each scan setting was measured using the slanted-slit technique within the image slice plane and the longitudinal axis. The Gaussian PSF and the corresponding modulation transfer function (MTF) are compared against the actual PSF and MTF for validation. Results: The differences (errors) between the actual and estimated full-width half-max (FWHM) of the PSFs were 0.09 ± 0.05 and 0.14 ± 0.11 mm for the xy and z axes, respectively. The overall errors in the predicted frequencies measured at 75%, 50%, 25%, 10%, and 5% MTF levels were 0.06 ± 0.07 and 0.06 ± 0.04 cycles/mm for the xy and z axes, respectively. The accuracy of the estimates was dependent on whether they were reconstructed with a standard kernel (Toshiba's FC68, mean error of 0.06 ± 0.05 mm, MTF mean error 0.02 ± 0.02 cycles/mm) or a high resolution bone kernel (Toshiba's FC81, PSF FWHM error 0.12 ± 0.03 mm, MTF mean error 0.09 ± 0.08 cycles/mm). Conclusions: The method is accurate in 3D for an image reconstructed using a standard reconstruction kernel, which conforms to the Gaussian PSF assumption but less accurate when using a high resolution bone kernel. The method is a practical and self-contained means of estimating the PSF in clinical CT images featuring cortical bones, without the need phantoms or any prior knowledge

Validation of models with multivariate output

International Nuclear Information System (INIS)

Rebba, Ramesh; Mahadevan, Sankaran

2006-01-01

This paper develops metrics for validating computational models with experimental data, considering uncertainties in both. A computational model may generate multiple response quantities and the validation experiment might yield corresponding measured values. Alternatively, a single response quantity may be predicted and observed at different spatial and temporal points. Model validation in such cases involves comparison of multiple correlated quantities. Multiple univariate comparisons may give conflicting inferences. Therefore, aggregate validation metrics are developed in this paper. Both classical and Bayesian hypothesis testing are investigated for this purpose, using multivariate analysis. Since, commonly used statistical significance tests are based on normality assumptions, appropriate transformations are investigated in the case of non-normal data. The methodology is implemented to validate an empirical model for energy dissipation in lap joints under dynamic loading

The improved Clinical Global Impression Scale (iCGI: development and validation in depression

Directory of Open Access Journals (Sweden)

Kadouri Alane

2007-02-01

Full Text Available Abstract Background The Clinical Global Impression scale (CGI is frequently used in medical care and clinical research because of its face validity and practicability. This study proposes to improve the reliability of the Clinical Global Impression (CGI scale in depressive disorders by the use of a semi-standardized interview, a new response format, and a Delphi procedure. Methods Thirty patients hospitalised for a major depressive episode were filmed at T1 (first week in hospital and at T2 (2 weeks later during a 5' specific interview. The Hamilton Depressive Rating Scale and the Symptom Check List were also rated. Eleven psychiatrists rated these videos using either the usual CGI response format or an improved response format, with or without a Delphi procedure. Results The new response format slightly improved (but not significantly the interrater agreement, the Delphi procedure did not. The best results were obtained when ratings by 4 independent raters were averaged. In this situation, intraclass correlation coefficients were about 0.9. Conclusion The Clinical Global Impression is a useful approach in psychiatry since it apprehends patients in their entirety. This study shows that it is possible to quantify such impressions with a high level of interrater agreement.

Design and validation of standardized clinical and functional remission criteria in schizophrenia

Directory of Open Access Journals (Sweden)

Mosolov SN

2014-01-01

Full Text Available Sergey N Mosolov,1 Andrey V Potapov,1 Uriy V Ushakov,2 Aleksey A Shafarenko,1 Anastasiya B Kostyukova11Department of Mental Disorders Therapy, Moscow Research Institute of Psychiatry, Moscow, Russia; 2Moscow Psychiatric Outpatient Services #21, Moscow, RussiaBackground: International Remission Criteria (IRC for schizophrenia were developed recently by a group of internationally known experts. The IRC detect only 10%–30% of cases and do not cover the diversity of forms and social functioning. Our aim was to design a more applicable tool and validate its use – the Standardized Clinical and Functional Remission Criteria (SCFRC.Methods: We used a 6-month follow-up study of 203 outpatients from two Moscow centers and another further sample of stable patients from a 1-year controlled trial of atypical versus typical medication. Diagnosis was confirmed by International Classification of Diseases Version 10 (ICD10 criteria and the Mini-International Neuropsychiatric Interview (MINI. Patients were assessed by the Positive and Negative Syndrome Scale, including intensity threshold, and further classified using the Russian domestic remission criteria and the level of social and personal functioning, according to the Personal and Social Performance Scale (PSP. The SCFRC were formulated and were validated by a data reanalysis on the first population sample and on a second independent sample (104 patients and in an open-label prospective randomized 12-month comparative study of risperidone long-acting injectable (RLAI versus olanzapine.Results: Only 64 of the 203 outpatients (31.5% initially met the IRC, and 53 patients (26.1% met the IRC after 6 months, without a change in treatment. Patients who were in remission had episodic and progressive deficit (39.6%, or remittent (15% paranoid schizophrenia, or schizoaffective disorder (17%. In addition, 105 patients of 139 (51.7%, who did not meet symptomatic IRC, remained stable within the period. Reanalysis of

Initial development and preliminary validation of a new negative symptom measure: the Clinical Assessment Interview for Negative Symptoms (CAINS).

Science.gov (United States)

Forbes, Courtney; Blanchard, Jack J; Bennett, Melanie; Horan, William P; Kring, Ann; Gur, Raquel

2010-12-01

As part of an ongoing scale development process, this study provides an initial examination of the psychometric properties and validity of a new interview-based negative symptom instrument, the Clinical Assessment Interview for Negative Symptoms (CAINS), in outpatients with schizophrenia or schizoaffective disorder (N = 37). The scale was designed to address limitations of existing measures and to comprehensively assess five consensus-based negative symptoms: asociality, avolition, anhedonia (consummatory and anticipatory), affective flattening, and alogia. Results indicated satisfactory internal consistency reliability for the total CAINS scale score and promising inter-rater agreement, with clear areas identified in need of improvement. Convergent validity was evident in general agreement between the CAINS and alternative negative symptom measures. Further, CAINS subscales significantly correlated with relevant self-report emotional experience measures as well as with social functioning. Discriminant validity of the CAINS was strongly supported by its small, non-significant relations with positive symptoms, general psychiatric symptoms, and depression. These preliminary data on an early beta-version of the CAINS provide initial support for this new assessment approach to negative symptoms and suggest directions for further scale development. Copyright © 2010 Elsevier B.V. All rights reserved.

Development and psychometric validation of the verbal affective memory test

DEFF Research Database (Denmark)

Jensen, Christian Gaden; Hjordt, Liv V; Stenbæk, Dea S

2015-01-01

. Furthermore, larger seasonal decreases in positive recall significantly predicted larger increases in depressive symptoms. Retest reliability was satisfactory, rs ≥ .77. In conclusion, VAMT-24 is more thoroughly developed and validated than existing verbal affective memory tests and showed satisfactory...... psychometric properties. VAMT-24 seems especially sensitive to measuring positive verbal recall bias, perhaps due to the application of common, non-taboo words. Based on the psychometric and clinical results, we recommend VAMT-24 for international translations and studies of affective memory.......We here present the development and validation of the Verbal Affective Memory Test-24 (VAMT-24). First, we ensured face validity by selecting 24 words reliably perceived as positive, negative or neutral, respectively, according to healthy Danish adults' valence ratings of 210 common and non...

The Added Value of the Combined Use of the Autism Diagnostic Interview-Revised and the Autism Diagnostic Observation Schedule: Diagnostic Validity in a Clinical Swedish Sample of Toddlers and Young Preschoolers

Science.gov (United States)

Zander, Eric; Sturm, Harald; Bölte, Sven

2015-01-01

The diagnostic validity of the new research algorithms of the Autism Diagnostic Interview-Revised and the revised algorithms of the Autism Diagnostic Observation Schedule was examined in a clinical sample of children aged 18-47 months. Validity was determined for each instrument separately and their combination against a clinical consensus…

CARVEDILOL POPULATION PHARMACOKINETIC ANALYSIS – APPLIED VALIDATION PROCEDURE

Directory of Open Access Journals (Sweden)

Aleksandra Catić-Đorđević

2013-09-01

Full Text Available Carvedilol is a nonselective beta blocker/alpha-1 blocker, which is used for treatment of essential hypertension, chronic stable angina, unstable angina and ischemic left ventricular dysfunction. The aim of this study was to describe carvedilol population pharmacokinetic (PK analysis as well as the validation of analytical procedure, which is an important step regarding this approach. In contemporary clinical practice, population PK analysis is often more important than standard PK approach in setting a mathematical model that describes the PK parameters. Also, it includes the variables that have particular importance in the drugs pharmacokinetics such as sex, body mass, dosage, pharmaceutical form, pathophysiological state, disease associated with the organism or the presence of a specific polymorphism in the isoenzyme important for biotransformation of the drug. One of the most frequently used approach in population PK analysis is the Nonlinear Modeling of Mixed Effects - NONMEM modeling. Analytical methods used in the data collection period is of great importance for the implementation of a population PK analysis of carvedilol in order to obtain reliable data that can be useful in clinical practice. High performance liquid chromatography (HPLC analysis of carvedilol is used to confirm the identity of a drug and provide quantitative results and also to monitor the efficacy of the therapy. Analytical procedures used in other studies could not be fully implemented in our research as it was necessary to perform certain modification and validation of the method with the aim of using the obtained results for the purpose of a population pharmacokinetic analysis. Validation process is a logical terminal phase of analytical procedure development that provides applicability of the procedure itself. The goal of validation is to ensure consistency of the method and accuracy of results or to confirm the selection of analytical method for a given sample

Validating Animal Models

Directory of Open Access Journals (Sweden)

Nina Atanasova

2015-06-01

Full Text Available In this paper, I respond to the challenge raised against contemporary experimental neurobiology according to which the field is in a state of crisis because of the multiple experimental protocols employed in different laboratories and strengthening their reliability that presumably preclude the validity of neurobiological knowledge. I provide an alternative account of experimentation in neurobiology which makes sense of its experimental practices. I argue that maintaining a multiplicity of experimental protocols and strengthening their reliability are well justified and they foster rather than preclude the validity of neurobiological knowledge. Thus, their presence indicates thriving rather than crisis of experimental neurobiology.

Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©).

Science.gov (United States)

Davies, Kylie; Bulsara, Max K; Ramelet, Anne-Sylvie; Monterosso, Leanne

2018-05-01

To establish criterion-related construct validity and test-retest reliability for the Endotracheal Suction Assessment Tool© (ESAT©). Endotracheal tube suction performed in children can significantly affect clinical stability. Previously identified clinical indicators for endotracheal tube suction were used as criteria when designing the ESAT©. Content validity was reported previously. The final stages of psychometric testing are presented. Observational testing was used to measure construct validity and determine whether the ESAT© could guide "inexperienced" paediatric intensive care nurses' decision-making regarding endotracheal tube suction. Test-retest reliability of the ESAT© was performed at two time points. The researchers and paediatric intensive care nurse "experts" developed 10 hypothetical clinical scenarios with predetermined endotracheal tube suction outcomes. "Experienced" (n = 12) and "inexperienced" (n = 14) paediatric intensive care nurses were presented with the scenarios and the ESAT© guiding decision-making about whether to perform endotracheal tube suction for each scenario. Outcomes were compared with those predetermined by the "experts" (n = 9). Test-retest reliability of the ESAT© was measured at two consecutive time points (4 weeks apart) with "experienced" and "inexperienced" paediatric intensive care nurses using the same scenarios and tool to guide decision-making. No differences were observed between endotracheal tube suction decisions made by "experts" (n = 9), "inexperienced" (n = 14) and "experienced" (n = 12) nurses confirming the tool's construct validity. No differences were observed between groups for endotracheal tube suction decisions at T1 and T2. Criterion-related construct validity and test-retest reliability of the ESAT© were demonstrated. Further testing is recommended to confirm reliability in the clinical setting with the "inexperienced" nurse to guide decision-making related to endotracheal tube

Validation of the Beck Hopelessness Scale in patients with suicide risk.

Science.gov (United States)

Rueda-Jaimes, German Eduardo; Castro-Rueda, Vanessa Alexandra; Rangel-Martínez-Villalba, Andrés Mauricio; Moreno-Quijano, Catalina; Martinez-Salazar, Gustavo Adolfo; Camacho, Paul Anthony

Only a few scales have been validated in Spanish for the assessment of suicide risk, and none of them have achieved predictive validity. To determine the validity and reliability of the Beck Hopelessness Scale in patients with suicide risk attending the specialist clinic. The Beck Hopelessness Scale, reasons for living inventory, and the suicide behaviour questionnaire were applied in patients with suicide risk attending the psychiatric clinic and the emergency department. A new assessment was made 30 days later to determine the predictive validity of suicide or suicide attempt. The evaluation included a total of 244 patients, with a mean age of 30.7±13.2 years, and the majority were women. The internal consistency was .9 (Kuder-Richardson formula 20). Four dimensions were found which accounted for 50% of the variance. It was positively correlated with the suicidal behaviour questionnaire (Spearman .48, P<.001), number of suicide attempts (Spearman .25, P<.001), severity of suicide risk (Spearman .23, P<.001). The correlation with the reasons for living inventory was negative (Spearman -.52, P<.001). With a cut-off ≥12, the negative predictive value was 98.4% (95% CI: 94.2-99.8), and the positive predictive value was 14.8% (95% CI: 6.6-27.1). The Beck Hopelessness Scale in Colombian patients with suicidality shows results similar to the original version, with adequate reliability and moderate concurrent and predictive validity. Copyright © 2016 SEP y SEPB. Publicado por Elsevier España, S.L.U. All rights reserved.

Validation and Diagnostic Efficiency of the Mini-SPIN in Spanish-Speaking Adolescents

Science.gov (United States)

Garcia-Lopez, LuisJoaquín; Moore, Harry T. A.

2015-01-01

Objectives Social Anxiety Disorder (SAD) is one of the most common mental disorders in adolescence. Many validated psychometric tools are available to diagnose individuals with SAD efficaciously. However, there is a demand for shortened self-report instruments that identify adolescents at risk of developing SAD. We validate the Mini-SPIN and its diagnostic efficiency in overcoming this problem in Spanish-speaking adolescents in Spain. Methods The psychometric properties of the 3-item Mini-SPIN scale for adolescents were assessed in a community (study 1) and clinical sample (study 2). Results Study 1 consisted of 573 adolescents, and found the Mini-SPIN to have appropriate internal consistency and high construct validity. Study 2 consisted of 354 adolescents (147 participants diagnosed with SAD and 207 healthy controls). Data revealed that the Mini-SPIN has good internal consistency, high construct validity and adequate diagnostic efficiency. Conclusions Our findings suggest that the Mini-SPIN has good psychometric properties on clinical and healthy control adolescents and general population, which indicates that it can be used as a screening tool in Spanish-speaking adolescents. Cut-off scores are provided. PMID:26317695

ValidatorDB: database of up-to-date validation results for ligands and non-standard residues from the Protein Data Bank.

Science.gov (United States)

Sehnal, David; Svobodová Vařeková, Radka; Pravda, Lukáš; Ionescu, Crina-Maria; Geidl, Stanislav; Horský, Vladimír; Jaiswal, Deepti; Wimmerová, Michaela; Koča, Jaroslav

2015-01-01

Following the discovery of serious errors in the structure of biomacromolecules, structure validation has become a key topic of research, especially for ligands and non-standard residues. ValidatorDB (freely available at http://ncbr.muni.cz/ValidatorDB) offers a new step in this direction, in the form of a database of validation results for all ligands and non-standard residues from the Protein Data Bank (all molecules with seven or more heavy atoms). Model molecules from the wwPDB Chemical Component Dictionary are used as reference during validation. ValidatorDB covers the main aspects of validation of annotation, and additionally introduces several useful validation analyses. The most significant is the classification of chirality errors, allowing the user to distinguish between serious issues and minor inconsistencies. Other such analyses are able to report, for example, completely erroneous ligands, alternate conformations or complete identity with the model molecules. All results are systematically classified into categories, and statistical evaluations are performed. In addition to detailed validation reports for each molecule, ValidatorDB provides summaries of the validation results for the entire PDB, for sets of molecules sharing the same annotation (three-letter code) or the same PDB entry, and for user-defined selections of annotations or PDB entries. © The Author(s) 2014. Published by Oxford University Press on behalf of Nucleic Acids Research.

Validation of the walking index for spinal cord injury in a US and European clinical population

DEFF Research Database (Denmark)

Ditunno, J.F.; Scivoletto, G.; Patrick, M.

2008-01-01

OBJECTIVE: To demonstrate the prospective construct validity of the walking index for spinal cord injury (WISCI) in US/European clinical population. DESIGN: Prospective Cohort in Denmark, Germany, Italy and the USA. PARTICIPANTS/METHOD: Participants with acute complete/incomplete (ASIA Impairment...... Scale (AIS) A, B, C and D) traumatic spinal cord injuries were enrolled from four centers. Lower extremity motor scores (LEMS), WISCI level and Locomotor Functional Independence Measure (LFIM) levels were assessed with change in ambulatory status. WISCI progression was assessed for monotonic direction...

The City of Hope-Quality of Life-Ostomy Questionnaire: Persian Translation and Validation

Science.gov (United States)

Anaraki, F; Vafaie, M; Behboo, R; Esmaeilpour, S; Maghsoodi, N; Safaee, A; Grant, M

2014-01-01

Background: Since there is no disease-specific instrument for measuring quality-of-life (QOL) in Ostomy patients in Persian language. Aim: This study was designed to translate and evaluate the validity and reliability of City of Hope-quality of life-Ostomy questionnaire (COH-QOL-Ostomy questionnaire). Subjects and Methods: This study was designed as cross-sectional study. Reliability of the subscales and the summary scores were demonstrated by intra-class correlation coefficients. Pearson's correlations of an item with its own scale and other scales were calculated to evaluated convergent and discriminant validity. Clinical validity was also evaluated by known-group comparisons. Results: Cronbach's alpha coefficient for all subscales was about 0.70 or higher. Results of interscale correlation were satisfactory and each subscale only measured a single and specified trait. All subscales met the standards of convergent and discriminant validity. Known group comparison analysis showed significant differences in social and spiritual well-being. Conclusion: The findings confirmed the reliability and validity of Persian version of COH-QOL-Ostomy questionnaire. The instrument was also well received by the Iranian patients. It can be considered as a valuable instrument to assess the different aspects of health related quality-of-life in Ostomy patients and used in clinical research in the future. PMID:25221719

The city of hope-quality of life-ostomy questionnaire: persian translation and validation.

Science.gov (United States)

Anaraki, F; Vafaie, M; Behboo, R; Esmaeilpour, S; Maghsoodi, N; Safaee, A; Grant, M

2014-07-01

Since there is no disease-specific instrument for measuring quality-of-life (QOL) in Ostomy patients in Persian language. This study was designed to translate and evaluate the validity and reliability of City of Hope-quality of life-Ostomy questionnaire (COH-QOL-Ostomy questionnaire). This study was designed as cross-sectional study. Reliability of the subscales and the summary scores were demonstrated by intra-class correlation coefficients. Pearson's correlations of an item with its own scale and other scales were calculated to evaluated convergent and discriminant validity. Clinical validity was also evaluated by known-group comparisons. Cronbach's alpha coefficient for all subscales was about 0.70 or higher. Results of interscale correlation were satisfactory and each subscale only measured a single and specified trait. All subscales met the standards of convergent and discriminant validity. Known group comparison analysis showed significant differences in social and spiritual well-being. The findings confirmed the reliability and validity of Persian version of COH-QOL-Ostomy questionnaire. The instrument was also well received by the Iranian patients. It can be considered as a valuable instrument to assess the different aspects of health related quality-of-life in Ostomy patients and used in clinical research in the future.

Validation of Biomarkers for Prostate Cancer Prognosis

Science.gov (United States)

2017-06-01

been calibrated and already validated precisely for this purpose. In addition, multiparametric MRI shows good correlation with grade in that only the...StanfordUniversity, Stanford,California 2Departmentof ExperimentalandClinical Pharmacology ,UniversityofMinnesota,Minneapolis,Minnesota BACKGROUND. Protein...repeat biopsies, and more recently, MRI examinations [9–11]. This follow-up is necessitated by the inability to characterize the biological potential of

Validation and clinical significance of the Childhood Myositis Assessment Scale for assessment of muscle function in the juvenile idiopathic inflammatory myopathies.

Science.gov (United States)

Huber, Adam M; Feldman, Brian M; Rennebohm, Robert M; Hicks, Jeanne E; Lindsley, Carol B; Perez, Maria D; Zemel, Lawrence S; Wallace, Carol A; Ballinger, Susan H; Passo, Murray H; Reed, Ann M; Summers, Ronald M; White, Patience H; Katona, Ildy M; Miller, Frederick W; Lachenbruch, Peter A; Rider, Lisa G

2004-05-01

To examine the measurement characteristics of the Childhood Myositis Assessment Scale (CMAS) in children with juvenile idiopathic inflammatory myopathy (juvenile IIM), and to obtain preliminary data on the clinical significance of CMAS scores. One hundred eight children with juvenile IIM were evaluated on 2 occasions, 7-9 months apart, using various measures of physical function, strength, and disease activity. Interrater reliability, construct validity, and responsiveness of the CMAS were examined. The minimum clinically important difference (MID) and CMAS scores corresponding to various degrees of physical disability were estimated. The intraclass correlation coefficient for 26 patients assessed by 2 examiners was 0.89, indicating very good interrater reliability. The CMAS score correlated highly with the Childhood Health Assessment Questionnaire (C-HAQ) score and with findings on manual muscle testing (MMT) (r(s) = -0.73 and 0.73, respectively) and moderately with physician-assessed global disease activity and skin activity, parent-assessed global disease severity, and muscle magnetic resonance imaging (r(s) = -0.44 to -0.61), thereby demonstrating good construct validity. The standardized response mean was 0.81 (95% confidence interval 0.53, 1.09) in patients with at least 0.8 cm improvement on a 10-cm visual analog scale for physician-assessed global disease activity, indicating strong responsiveness. In bivariate regression models predicting physician-assessed global disease activity, MMT remained significant in models containing the CMAS (P = 0.03) while the C-HAQ did not (P = 0.4). Estimates of the MID ranged from 1.5 to 3.0 points on a 0-52-point scale. CMAS scores corresponding to no, mild, mild-to-moderate, and moderate physical disability, respectively, were 48, 45, 39, and 30. The CMAS exhibits good reliability, construct validity, and responsiveness, and is therefore a valid instrument for the assessment of physical function, muscle strength, and

Cross validation in LULOO

DEFF Research Database (Denmark)

Sørensen, Paul Haase; Nørgård, Peter Magnus; Hansen, Lars Kai

1996-01-01

The leave-one-out cross-validation scheme for generalization assessment of neural network models is computationally expensive due to replicated training sessions. Linear unlearning of examples has recently been suggested as an approach to approximative cross-validation. Here we briefly review...... the linear unlearning scheme, dubbed LULOO, and we illustrate it on a systemidentification example. Further, we address the possibility of extracting confidence information (error bars) from the LULOO ensemble....

The Discriminative validity of "nociceptive," "peripheral neuropathic," and "central sensitization" as mechanisms-based classifications of musculoskeletal pain.

LENUS (Irish Health Repository)

Smart, Keith M

2012-02-01

OBJECTIVES: Empirical evidence of discriminative validity is required to justify the use of mechanisms-based classifications of musculoskeletal pain in clinical practice. The purpose of this study was to evaluate the discriminative validity of mechanisms-based classifications of pain by identifying discriminatory clusters of clinical criteria predictive of "nociceptive," "peripheral neuropathic," and "central sensitization" pain in patients with low back (+\\/- leg) pain disorders. METHODS: This study was a cross-sectional, between-patients design using the extreme-groups method. Four hundred sixty-four patients with low back (+\\/- leg) pain were assessed using a standardized assessment protocol. After each assessment, patients\\' pain was assigned a mechanisms-based classification. Clinicians then completed a clinical criteria checklist indicating the presence\\/absence of various clinical criteria. RESULTS: Multivariate analyses using binary logistic regression with Bayesian model averaging identified a discriminative cluster of 7, 3, and 4 symptoms and signs predictive of a dominance of "nociceptive," "peripheral neuropathic," and "central sensitization" pain, respectively. Each cluster was found to have high levels of classification accuracy (sensitivity, specificity, positive\\/negative predictive values, positive\\/negative likelihood ratios). DISCUSSION: By identifying a discriminatory cluster of symptoms and signs predictive of "nociceptive," "peripheral neuropathic," and "central" pain, this study provides some preliminary discriminative validity evidence for mechanisms-based classifications of musculoskeletal pain. Classification system validation requires the accumulation of validity evidence before their use in clinical practice can be recommended. Further studies are required to evaluate the construct and criterion validity of mechanisms-based classifications of musculoskeletal pain.

Validation of a radiosensitivity molecular signature in breast cancer

NARCIS (Netherlands)

S.A. Eschrich (Steven); C. Fulp (Carl); Y. Pawitan (Yudi); J.A. Foekens (John); M. Smid (Marcel); J.W.M. Martens (John); M. Echevarria (Michelle); P.S. Kamath (Patrick); J.-H. Lee (Ji-Hyun); E.E. Harris (Eleanor); J. Bergh (Jonas); J.F. Torres-Roca (Javier)

2012-01-01

textabstractPurpose: Previously, we developed a radiosensitivity molecular signature [radiosensitivity index (RSI)] that was clinically validated in 3 independent datasets (rectal, esophageal, and head and neck) in 118 patients. Here, we test RSI in radiotherapy (RT)-treated breast cancer patients.

Validation of the Danish PAROLE lexicon (upubliceret)

DEFF Research Database (Denmark)

Møller, Margrethe; Christoffersen, Ellen

2000-01-01

This validation is based on the Danish PAROLE lexicon dated June 20, 1998, downloaded on March 16, 1999. Subsequently, the developers of the lexicon have informed us that they have been revising the lexicon, in particular the morphological level. Morphological entries were originally generated...... automatically from a machine-readable version of the Official Danish Spelling Dictionary (Retskrivningsordbogen 1986, in the following RO86), and this resulted in some overgeneration, which the developers started eliminating after submitting the Danish PAROLE lexicon for validation. The present validation is......, however, based on the January 1997 version of the lexicon. The validation as such complies with the specifications described in ELRA validation manuals for lexical data, i.e. Underwood and Navaretta: "A Draft Manual for the Validation of Lexica, Final Report" [Underwood & Navaretta1997] and Braasch: "A...

Validating presupposed versus focused text information.

Science.gov (United States)

Singer, Murray; Solar, Kevin G; Spear, Jackie

2017-04-01

There is extensive evidence that readers continually validate discourse accuracy and congruence, but that they may also overlook conspicuous text contradictions. Validation may be thwarted when the inaccurate ideas are embedded sentence presuppositions. In four experiments, we examined readers' validation of presupposed ("given") versus new text information. Throughout, a critical concept, such as a truck versus a bus, was introduced early in a narrative. Later, a character stated or thought something about the truck, which therefore matched or mismatched its antecedent. Furthermore, truck was presented as either given or new information. Mismatch target reading times uniformly exceeded the matching ones by similar magnitudes for given and new concepts. We obtained this outcome using different grammatical constructions and with different antecedent-target distances. In Experiment 4, we examined only given critical ideas, but varied both their matching and the main verb's factivity (e.g., factive know vs. nonfactive think). The Match × Factivity interaction closely resembled that previously observed for new target information (Singer, 2006). Thus, readers can successfully validate given target information. Although contemporary theories tend to emphasize either deficient or successful validation, both types of theory can accommodate the discourse and reader variables that may regulate validation.

Development and Validation of a Test for Bulimia.

Science.gov (United States)

Smith, Marcia C.; Thelen, Mark H.

1984-01-01

Developed the Bulimia Test (BULIT) based on responses of clinically identified females (N=18) and normal female college students (N=119) to preliminary test items. Results showed that the BULIT provided an objective, reliable, and valid measure by which to identify individuals with symptoms of bulimia. (Instrument is appended.) (LLL)

Minnesota Impulse Disorders Interview (MIDI): Validation of a structured diagnostic clinical interview for impulse control disorders in an enriched community sample.

Science.gov (United States)

Chamberlain, Samuel R; Grant, Jon E

2018-05-08

Disorders of impulsivity are common, functionally impairing, and highly relevant across different clinical and research settings. Few structured clinical interviews for the identification and diagnosis of impulse control disorders exist, and none have been validated in a community sample in terms of psychometric properties. The Minnesota Impulse control disorders Interview (MIDI v2.0) was administered to an enriched sample of 293 non-treatment seeking adults aged 18-35 years, recruited using media advertisements in two large US cities. In addition to the MIDI, participants undertook extended clinical interview for other mental disorders, the Barratt impulsiveness questionnaire, and the Padua obsessive-compulsive inventory. The psychometric properties of the MIDI were characterized. In logistic regression, the MIDI showed good concurrent validity against the reference measures (versus gambling disorder interview, p  0.05). Test re-test reliability was excellent (0.95). The MIDI has good psychometric properties and thus may be a valuable interview tool for clinical and research studies involving impulse control disorders. Further research is needed to better understanding the optimal diagnostic classification and neurobiology of these neglected disorders. Crown Copyright © 2018. Published by Elsevier B.V. All rights reserved.

Validated questionnaires heighten detection of difficult asthma comorbidities.

Science.gov (United States)

Radhakrishna, Naghmeh; Tay, Tunn Ren; Hore-Lacy, Fiona; Stirling, Robert; Hoy, Ryan; Dabscheck, Eli; Hew, Mark

2017-04-01

Multiple extra-pulmonary comorbidities contribute to difficult asthma, but their diagnosis can be challenging and time consuming. Previous data on comorbidity detection have focused on clinical assessment, which may miss certain conditions. We aimed to locate relevant validated screening questionnaires to identify extra-pulmonary comorbidities that contribute to difficult asthma, and evaluate their performance during a difficult asthma evaluation. MEDLINE was searched to identify key extra-pulmonary comorbidities that contribute to difficult asthma. Screening questionnaires were chosen based on ease of use, presence of a cut-off score, and adequate validation to help systematically identify comorbidities. In a consecutive series of 86 patients referred for systematic evaluation of difficult asthma, questionnaires were administered prior to clinical consultation. Six difficult asthma comorbidities and corresponding screening questionnaires were found: sinonasal disease (allergic rhinitis and chronic rhinosinusitis), vocal cord dysfunction, dysfunctional breathing, obstructive sleep apnea, anxiety and depression, and gastro-oesophageal reflux disease. When the questionnaires were added to the referring clinician's impression, the detection of all six comorbidities was significantly enhanced. The average time for questionnaire administration was approximately 40 minutes. The use of validated screening questionnaires heightens detection of comorbidities in difficult asthma. The availability of data from a battery of questionnaires prior to consultation can save time and allow clinicians to systematically assess difficult asthma patients and to focus on areas of particular concern. Such an approach would ensure that all contributing comorbidities have been addressed before significant treatment escalation is considered.

Validity evidence based on test content.

Science.gov (United States)

Sireci, Stephen; Faulkner-Bond, Molly

2014-01-01

Validity evidence based on test content is one of the five forms of validity evidence stipulated in the Standards for Educational and Psychological Testing developed by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. In this paper, we describe the logic and theory underlying such evidence and describe traditional and modern methods for gathering and analyzing content validity data. A comprehensive review of the literature and of the aforementioned Standards is presented. For educational tests and other assessments targeting knowledge and skill possessed by examinees, validity evidence based on test content is necessary for building a validity argument to support the use of a test for a particular purpose. By following the methods described in this article, practitioners have a wide arsenal of tools available for determining how well the content of an assessment is congruent with and appropriate for the specific testing purposes.

The validation of an infrared simulation system

CSIR Research Space (South Africa)

De Waal, A

2013-08-01

Full Text Available theoretical validation framework. This paper briefly describes the procedure used to validate software models in an infrared system simulation, and provides application examples of this process. The discussion includes practical validation techniques...

Validity and repeatability of inertial measurement units for measuring gait parameters.

Science.gov (United States)

Washabaugh, Edward P; Kalyanaraman, Tarun; Adamczyk, Peter G; Claflin, Edward S; Krishnan, Chandramouli

2017-06-01

Inertial measurement units (IMUs) are small wearable sensors that have tremendous potential to be applied to clinical gait analysis. They allow objective evaluation of gait and movement disorders outside the clinic and research laboratory, and permit evaluation on large numbers of steps. However, repeatability and validity data of these systems are sparse for gait metrics. The purpose of this study was to determine the validity and between-day repeatability of spatiotemporal metrics (gait speed, stance percent, swing percent, gait cycle time, stride length, cadence, and step duration) as measured with the APDM Opal IMUs and Mobility Lab system. We collected data on 39 healthy subjects. Subjects were tested over two days while walking on a standard treadmill, split-belt treadmill, or overground, with IMUs placed in two locations: both feet and both ankles. The spatiotemporal measurements taken with the IMU system were validated against data from an instrumented treadmill, or using standard clinical procedures. Repeatability and minimally detectable change (MDC) of the system was calculated between days. IMUs displayed high to moderate validity when measuring most of the gait metrics tested. Additionally, these measurements appear to be repeatable when used on the treadmill and overground. The foot configuration of the IMUs appeared to better measure gait parameters; however, both the foot and ankle configurations demonstrated good repeatability. In conclusion, the IMU system in this study appears to be both accurate and repeatable for measuring spatiotemporal gait parameters in healthy young adults. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of the Narrowing Beam Walking Test in Lower Limb Prosthesis Users.

Science.gov (United States)

Sawers, Andrew; Hafner, Brian

2018-04-11

To evaluate the content, construct, and discriminant validity of the Narrowing Beam Walking Test (NBWT), a performance-based balance test for lower limb prosthesis users. Cross-sectional study. Research laboratory and prosthetics clinic. Unilateral transtibial and transfemoral prosthesis users (N=40). Not applicable. Content validity was examined by quantifying the percentage of participants receiving maximum or minimum scores (ie, ceiling and floor effects). Convergent construct validity was examined using correlations between participants' NBWT scores and scores or times on existing clinical balance tests regularly administered to lower limb prosthesis users. Known-groups construct validity was examined by comparing NBWT scores between groups of participants with different fall histories, amputation levels, amputation etiologies, and functional levels. Discriminant validity was evaluated by analyzing the area under each test's receiver operating characteristic (ROC) curve. No minimum or maximum scores were recorded on the NBWT. NBWT scores demonstrated strong correlations (ρ=.70‒.85) with scores/times on performance-based balance tests (timed Up and Go test, Four Square Step Test, and Berg Balance Scale) and a moderate correlation (ρ=.49) with the self-report Activities-specific Balance Confidence scale. NBWT performance was significantly lower among participants with a history of falls (P=.003), transfemoral amputation (P=.011), and a lower mobility level (P.50 (ie, chance). The results provide strong evidence of content, construct, and discriminant validity for the NBWT as a performance-based test of balance ability. The evidence supports its use to assess balance impairments and fall risk in unilateral transtibial and transfemoral prosthesis users. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Reliability and Validity of the Clinical Dementia Rating for Community-Living Elderly Subjects without an Informant

Directory of Open Access Journals (Sweden)

Ma Shwe Zin Nyunt

2013-10-01

Full Text Available Background: The Clinical Dementia Rating (CDR scale is widely used to assess cognitive impairment in Alzheimer's disease. It requires collateral information from a reliable informant who is not available in many instances. We adapted the original CDR scale for use with elderly subjects without an informant (CDR-NI and evaluated its reliability and validity for assessing mild cognitive impairment (MCI and dementia among community-dwelling elderly subjects. Method: At two consecutive visits 1 week apart, nurses trained in CDR assessment interviewed, observed and rated cognitive and functional performance according to a protocol in 90 elderly subjects with suboptimal cognitive performance [Mini-Mental State Examination (MMSE Results: The CDR-NI scores (0, 0.5, 1 showed good internal consistency (Crohnbach's a 0.83-0.84, inter-rater reliability (κ 0.77-1.00 for six domains and 0.95 for global rating and test-retest reliability (κ 0.75-1.00 for six domains and 0.80 for global rating, good agreement (κ 0.79 with the clinical assessment status of MCI (n = 37 and dementia (n = 4 and significant differences in the mean scores for MMSE, MOCA and Instrumental Activities of Daily Living (ANOVA global p Conclusion: Owing to the protocol of the interviews, assessments and structured observations gathered during the two visits, CDR-NI provides valid and reliable assessment of MCI and dementia in community-living elderly subjects without an informant.

Checklists for external validity

DEFF Research Database (Denmark)

Dyrvig, Anne-Kirstine; Kidholm, Kristian; Gerke, Oke

2014-01-01

to an implementation setting. In this paper, currently available checklists on external validity are identified, assessed and used as a basis for proposing a new improved instrument. METHOD: A systematic literature review was carried out in Pubmed, Embase and Cinahl on English-language papers without time restrictions....... The retrieved checklist items were assessed for (i) the methodology used in primary literature, justifying inclusion of each item; and (ii) the number of times each item appeared in checklists. RESULTS: Fifteen papers were identified, presenting a total of 21 checklists for external validity, yielding a total...... of 38 checklist items. Empirical support was considered the most valid methodology for item inclusion. Assessment of methodological justification showed that none of the items were supported empirically. Other kinds of literature justified the inclusion of 22 of the items, and 17 items were included...

Development and validation of a self-efficacy questionnaire (SE-12) measuring the clinical communication skills of health care professionals.

Science.gov (United States)

Axboe, Mette K; Christensen, Kaj S; Kofoed, Poul-Erik; Ammentorp, Jette

2016-10-18

The outcome of communication training is widely measured by self-efficacy ratings, and different questionnaires have been used. Nevertheless, none of these questionnaires have been formally validated through systematic measurement of assessment properties. Consequently, we decided to further develop a self-efficacy questionnaire which has been used in previous studies. This study aims to examine the content, internal structure, and relations with other variables of the new version of the self-efficacy questionnaire (SE-12). The questionnaire was developed on the basis of the theoretical approach applied in the communication course, statements from former course participants, teachers, and experts in the field. The questionnaire was initially validated through face-to-face interviews with 9 staff members following a test-retest including 195 participants. After minor adjustments, the SE-12 questionnaire demonstrated evidence of content validity. An explorative factor analysis indicated unidimensionality with highly correlated items. A Cronbach's α of 0.95 and a Loevinger's H coefficient of 0.71 provided evidence of statistical reliability and scalability. The test-retest reliability had a value of 0.71 when evaluated using intra-class correlation. Expected relations with other variables were partially confirmed in two of three hypotheses, but a ceiling effect was present in 9 of 12 items. The SE-12 scale should be regarded a reliable and partially valid instrument. We consider the questionnaire useful for self-evaluation of clinical communication skills; the SE-12 is user-friendly and can be administered as an electronic questionnaire. However, future research should explore potential needs for adjustments to reduce the identified ceiling effect.

Proposal and validation of a clinical trunk control test in individuals with spinal cord injury.

Science.gov (United States)

Quinzaños, J; Villa, A R; Flores, A A; Pérez, R

2014-06-01

One of the problems that arise in spinal cord injury (SCI) is alteration in trunk control. Despite the need for standardized scales, these do not exist for evaluating trunk control in SCI. To propose and validate a trunk control test in individuals with SCI. National Institute of Rehabilitation, Mexico. The test was developed and later evaluated for reliability and criteria, content, and construct validity. We carried out 531 tests on 177 patients and found high inter- and intra-rater reliability. In terms of criterion validity, analysis of variance demonstrated a statistically significant difference in the test score of patients with adequate or inadequate trunk control according to the assessment of a group of experts. A receiver operating characteristic curve was plotted for optimizing the instrument's cutoff point, which was determined at 13 points, with a sensitivity of 98% and a specificity of 92.2%. With regard to construct validity, the correlation between the proposed test and the spinal cord independence measure (SCIM) was 0.873 (P=0.001) and that with the evolution time was 0.437 (P=0.001). For testing the hypothesis with qualitative variables, the Kruskal-Wallis test was performed, which resulted in a statistically significant difference between the scores in the proposed scale of each group defined by these variables. It was proven experimentally that the proposed trunk control test is valid and reliable. Furthermore, the test can be used for all patients with SCI despite the type and level of injury.

Multivariable prediction model for suspected giant cell arteritis: development and validation

Directory of Open Access Journals (Sweden)

Ing EB

2017-11-01

Full Text Available Edsel B Ing,1 Gabriela Lahaie Luna,2 Andrew Toren,3 Royce Ing,4 John J Chen,5 Nitika Arora,6 Nurhan Torun,7 Otana A Jakpor,8 J Alexander Fraser,9 Felix J Tyndel,10 Arun NE Sundaram,10 Xinyang Liu,11 Cindy TY Lam,1 Vivek Patel,12 Ezekiel Weis,13 David Jordan,14 Steven Gilberg,14 Christian Pagnoux,15 Martin ten Hove21Department of Ophthalmology and Vision Sciences, University of Toronto Medical School, Toronto, 2Department of Ophthalmology, Queen’s University, Kingston, ON, 3Department of Ophthalmology, University of Laval, Quebec, QC, 4Toronto Eyelid, Strabismus and Orbit Surgery Clinic, Toronto, ON, Canada; 5Mayo Clinic, Department of Ophthalmology and Neurology, 6Mayo Clinic, Department of Ophthalmology, Rochester, MN, 7Department of Surgery, Division of Ophthalmology, Harvard Medical School, Boston, MA, 8Harvard Medical School, Boston, MA, USA; 9Department of Clinical Neurological Sciences and Ophthalmology, Western University, London, 10Department of Medicine, University of Toronto Medical School, Toronto, ON, Canada; 11Department of Medicine, Fudan University Shanghai Medical College, Shanghai, People’s Republic of China; 12Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA; 13Departments of Ophthalmology, Universities of Alberta and Calgary, Edmonton and Calgary, AB, 14Department of Ophthalmology, University of Ottawa, Ottawa, ON, 15Vasculitis Clinic, Mount Sinai Hospital, Toronto, ON, CanadaPurpose: To develop and validate a diagnostic prediction model for patients with suspected giant cell arteritis (GCA.Methods: A retrospective review of records of consecutive adult patients undergoing temporal artery biopsy (TABx for suspected GCA was conducted at seven university centers. The pathologic diagnosis was considered the final diagnosis. The predictor variables were age, gender, new onset headache, clinical temporal artery abnormality, jaw claudication, ischemic vision loss (VL, diplopia

Validation of a French language version of the Early Childhood Oral Health Impact Scale (ECOHIS