Scale indicators of social exchange relationships: a comparison of relative content validity.

Science.gov (United States)

Colquitt, Jason A; Baer, Michael D; Long, David M; Halvorsen-Ganepola, Marie D K

2014-07-01

Although social exchange theory has become one of the most oft-evoked theories in industrial and organizational psychology, there remains no consensus about how to measure its key mechanism: social exchange relationships (Blau, 1964). Drawing on Cropanzano and Byrne's (2000) review of contemporary social exchange theorizing, we examined the content validity of perceived support, exchange quality, affective commitment, trust, and psychological contract fulfillment as indicators of social exchange relationships. We used Hinkin and Tracey's (1999) quantitative approach to content validation, which asks participants to rate the correspondence between scale items and definitions of intended (and unintended) constructs. Our results revealed that some of the most frequently utilized indicators of social exchange relationships--perceived support and exchange quality--were significantly less content valid than rarely used options like affect-based trust. Our results also revealed that 2 direct measures--Bernerth, Armenakis, Feild, Giles, and Walker's (2007) scale and a scale created for this study--were content valid. We discuss the implications of these results for future applications of social exchange theory.

Content validity of methods to assess malnutrition in cancer patients: a systematic review

NARCIS (Netherlands)

Sealy, Martine; Nijholt, Willemke; Stuiver, M.M.; van der Berg, M.M.; Ottery, Faith D.; van der Schans, Cees; Roodenburg, Jan L N; Jager-Wittenaar, Harriët

Content validity of methods to assess malnutrition in cancer patients: A systematic review Rationale: Inadequate operationalisation of the multidimensial concept of malnutrition may result in inadequate evaluation of nutritional status. In this review we aimed to assess content validity of methods

Content validity and reliability of test of gross motor development in Chilean children

Directory of Open Access Journals (Sweden)

Marcelo Cano-Cappellacci

2015-01-01

Full Text Available ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2 for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Validation of the Intestinal Part of the Prostate Cancer Questionnaire 'QUFW94': Psychometric Properties, Responsiveness, and Content Validity

International Nuclear Information System (INIS)

Reidunsdatter, Randi J.; Lund, Jo-Asmund; Fransson, Per; Widmark, Anders

2010-01-01

Purpose: Several treatment options are available for patients with prostate cancer. Applicable and valid self-assessment instruments for assessing health-related quality of life (HRQOL) are of paramount importance. The aim of this study was to explore the validity and responsiveness of the intestinal part of the prostate cancer-specific questionnaire QUFW94. Methods and Materials: The content of the intestinal part of QUFW94 was examined by evaluation of experienced clinicians and reviewing the literature. The psychometric properties and responsiveness were assessed by analyzing HRQOL data from the randomized study Scandinavian Prostate Cancer Group 7 (SPCG)/Swedish Association for Urological Oncology 3 (SFUO). Subscales were constructed by means of exploratory factor analyses. Internal consistency was assessed by Cronbach's alpha. Responsiveness was investigated by comparing baseline scores with the 4-year posttreatment follow-up. Results: The content validity was found acceptable, but some amendments were proposed. The factor analyses revealed two symptom scales. The first scale comprised five items regarding general stool problems, frequency, incontinence, need to plan toilet visits, and daily activity. Cronbach's alpha at 0.83 indicated acceptable homogeneity. The second scale was less consistent with a Cronbach's alpha at 0.55. The overall responsiveness was found to be very satisfactory. Conclusion: Two scales were identified in the bowel dimension of the QUFW94; the first one had good internal consistency. The responsiveness was excellent, and some modifications are suggested to strengthen the content validity.

Construction and validation of clinical contents for development of learning objects.

Science.gov (United States)

Hortense, Flávia Tatiana Pedrolo; Bergerot, Cristiane Decat; Domenico, Edvane Birelo Lopes de

2018-01-01

to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Construction and validation of clinical contents for development of learning objects

Directory of Open Access Journals (Sweden)

Flávia Tatiana Pedrolo Hortense

Full Text Available ABSTRACT Objective: to describe the process of construction and validation of clinical contents for health learning objects, aimed at patients in the treatment of head and neck cancer. Method: descriptive, methodological study. The development of the script and the storyboard were based on scientific evidence and submitted to the appreciation of specialists for validation of content. The agreement index was checked quantitatively and the suggestions were qualitatively evaluated. Results: The items described in the roadmap were approved by 99% of expert experts. The suggestions for adjustments were inserted in their entirety in the final version. The free-marginal kappa statistical test, for multiple evaluators, presented value equal to 0.68%, granting a substantial agreement. Conclusion: The steps taken in the construction and validation of the content for the production of educational material for patients with head and neck cancer were adequate, relevant and suitable for use in other subjects.

Cultural adaptation and content validation of the Single-Question for screening alcohol abuse

Directory of Open Access Journals (Sweden)

Marjorie Ester Dias Maciel

2018-03-01

Full Text Available ABSTRACT Objective Describing the stages of translation, cultural adaptation and content validation of the Single-Question into Brazilian Portuguese, which will be named Questão Chave. Method This study is a cultural adaptation. The instrument was translated into Portuguese as two independent versions which led to a synthesis of translations (S1, and later to the synthesis S2, which was then submitted to evaluation by a Committee of Expert Judges in the area of alcohol use and instrument validation. The Content Validity Index and Kappa agreement coefficient were calculated from this evaluation. Results The judges evaluated the Questão Chave regarding the clarity of the sentence and aspects related to the quality of the translation (cultural adaptation, preservation of original meaning and correct use of technical terms. The Content Validity Index was 1 for clarity of sentence and correct use of technical terms, and 0.8 for adaptation and preservation of the original meaning. The Kappa index for concordance among the judges was 0.83. After an adjustment proposed by the judges, the S3 version was originated. Conclusion The Questão Chave had its content validity confirmed, which supports future studies that aim for its application in the target population to verify their psychometric properties.

Content Validity and Reliability of Multiple Intelligences Developmental Assessment Scales (MIDAS Translated into Persian

Directory of Open Access Journals (Sweden)

Mahnaz Saeidi

2012-11-01

Full Text Available This study aimed to translate MIDAS questionnaire from English into Persian and determine its content validity and reliability. MIDAS was translated and validated on a sample (N = 110 of Iranian adult population. The participants were both male and female with the age range of 17-57. They were at different educational levels and from different ethnic groups in Iran. A translating team, consisting of five members, bilingual in English and Persian and familiar with multiple intelligences (MI theory and practice, were involved in translating and determining content validity, which included the processes of forward translation, back-translation, review, final proof-reading, and testing. The statistical analyses of inter-scale correlation were performed using the Cronbach's alpha coefficient. In an intra-class correlation, the Cronbach's alpha was high for all of the questions. Translation and content validity of MIDAS questionnaire was completed by a proper process leading to high reliability and validity. The results suggest that Persian MIDAS (P-MIDAS could serve as a valid and reliable instrument for measuring Iranian adults MIs.

Content validation of the nursing diagnosis Nausea

Directory of Open Access Journals (Sweden)

Daniele Alcalá Pompeo

2014-02-01

Full Text Available This study aimed to evaluate the content validity of the nursing diagnosis of nausea in the immediate post-operative period, considering Fehring’s model. Descriptive study with 52 nurses experts who responded an instrument containing identification and validation of nausea diagnosis data. Most experts considered the domain 12 (Comfort, Class 1 (Physical Comfort and the statement (Nausea adequate to the diagnosis. Modifications were suggested in the current definition of this nursing diagnosis. Four defining characteristics were considered primary (reported nausea, increased salivation, aversion to food and vomiting sensation and eight secondary (increased swallowing, sour taste in the mouth, pallor, tachycardia, diaphoresis, sensation of hot and cold, changes in blood pressure and pupil dilation. The total score for the diagnosis of nausea was 0.79. Reports of nausea, vomiting sensation, increased salivation and aversion to food are strong predictors of nursing diagnosis of nausea.

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

Science.gov (United States)

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational

Validity of contents of a paediatric critical comfort scale using mixed methodology.

Science.gov (United States)

Bosch-Alcaraz, A; Jordan-Garcia, I; Alcolea-Monge, S; Fernández-Lorenzo, R; Carrasquer-Feixa, E; Ferrer-Orona, M; Falcó-Pegueroles, A

Critical illness in paediatric patients includes acute conditions in a healthy child as well as exacerbations of chronic disease, and therefore these situations must be clinically managed in Critical Care Units. The role of the paediatric nurse is to ensure the comfort of these critically ill patients. To that end, instruments are required that correctly assess critical comfort. To describe the process for validating the content of a paediatric critical comfort scale using mixed-method research. Initially, a cross-cultural adaptation of the Comfort Behavior Scale from English to Spanish using the translation and back-translation method was made. After that, its content was evaluated using mixed method research. This second step was divided into a quantitative stage in which an ad hoc questionnaire was used in order to assess each scale's item relevance and wording and a qualitative stage with two meetings with health professionals, patients and a family member following the Delphi Method recommendations. All scale items obtained a content validity index >0.80, except physical movement in its relevance, which obtained 0.76. Global content scale validity was 0.87 (high). During the qualitative stage, items from each of the scale domains were reformulated or eliminated in order to make the scale more comprehensible and applicable. The use of a mixed-method research methodology during the scale content validity phase allows the design of a richer and more assessment-sensitive instrument. Copyright © 2017 Sociedad Española de Enfermería Intensiva y Unidades Coronarias (SEEIUC). Publicado por Elsevier España, S.L.U. All rights reserved.

Content Validity and Acceptability of a Developed Worktext in Basic Mathematics 2

Directory of Open Access Journals (Sweden)

Mae Joy F. Tan-Espinar

2017-02-01

Full Text Available Teaching tertiary mathematics entails the use of instructional materials which lead to independent learning. The study evaluated the content validity and level of acceptability of a developed worktext in Basic Mathematics 2. It also found the significant difference between the respondents’ evaluation. Likewise, the study found the significant difference in the pretest and posttest performance between experimental and the control group and the difference between the posttest of the experimental and control groups. The study utilized the descriptive comparative method in determining the validity and acceptability of the developed worktext and the difference between the evaluation of experts/teachers and the student respondents. Quasi-experimental design was also used to find out if the worktext is effective in teaching the course employing t-test for correlated samples and t-test for independent samples. The result showed that the content validity and acceptability is very much valid and very much acceptable. The difference in the post-test between the experimental and the control groups was significant. It is concluded that the worktext is effective to be used in teaching the course.

Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale.

Science.gov (United States)

Nair, Girija Gopinathan; Hellsten, Laurie-Ann M; Stamler, Lynnette Leeseberg

2017-04-01

Critical thinking skills (CTS) are essential for nurses; assessing students' acquisition of these skills is a mandate of nursing curricula. This study aimed to develop a self-assessment instrument of critical thinking skills (Critical Thinking Self-Assessment Scale [CTSAS]) for students' self-monitoring. An initial pool of 196 items across 6 core cognitive skills and 16 subskills were generated using the American Philosophical Association definition of CTS. Experts' content review of the items and their ratings provided evidence of content relevance using the item-level content validity index (I-CVI) and Aiken's content validity coefficient (VIk). 115 items were retained (range of I-CVI values = .70 to .94 and range of VIk values = .69-.95; significant at pself-assessment purposes.

Face and content validity of the virtual reality simulator 'ScanTrainer®'.

Science.gov (United States)

Alsalamah, Amal; Campo, Rudi; Tanos, Vasilios; Grimbizis, Gregoris; Van Belle, Yves; Hood, Kerenza; Pugh, Neil; Amso, Nazar

2017-01-01

Ultrasonography is a first-line imaging in the investigation of women's irregular bleeding and other gynaecological pathologies, e.g. ovarian cysts and early pregnancy problems. However, teaching ultrasound, especially transvaginal scanning, remains a challenge for health professionals. New technology such as simulation may potentially facilitate and expedite the process of learning ultrasound. Simulation may prove to be realistic, very close to real patient scanning experience for the sonographer and objectively able to assist the development of basic skills such as image manipulation, hand-eye coordination and examination technique. The aim of this study was to determine the face and content validity of a virtual reality simulator (ScanTrainer®, MedaPhor plc, Cardiff, Wales, UK) as reflective of real transvaginal ultrasound (TVUS) scanning. A questionnaire with 14 simulator-related statements was distributed to a number of participants with differing levels of sonography experience in order to determine the level of agreement between the use of the simulator in training and real practice. There were 36 participants: novices ( n  = 25) and experts ( n  = 11) who rated the simulator. Median scores of face validity statements between experts and non-experts using a 10-point visual analogue scale (VAS) ratings ranged between 7.5 and 9.0 ( p  > 0.05) indicated a high level of agreement. Experts' median scores of content validity statements ranged from 8.4 to 9.0. The findings confirm that the simulator has the feel and look of real-time scanning with high face validity. Similarly, its tutorial structures and learning steps confirm the content validity.

Valid and Reliable Science Content Assessments for Science Teachers

Science.gov (United States)

Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

2013-01-01

Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

Critical Values for Lawshe's Content Validity Ratio: Revisiting the Original Methods of Calculation

Science.gov (United States)

Ayre, Colin; Scally, Andrew John

2014-01-01

The content validity ratio originally proposed by Lawshe is widely used to quantify content validity and yet methods used to calculate the original critical values were never reported. Methods for original calculation of critical values are suggested along with tables of exact binomial probabilities.

The Content Validity of Juvenile Psychopathy: An Empirical Examination

Science.gov (United States)

Lynam, Donald R.; Derefinko, Karen J.; Caspi, Avshalom; Loeber, Rolf; Stouthamer-Loeber, Magda

2007-01-01

This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived…

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

Science.gov (United States)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Content validity and nursing sensitivity of community-level outcomes from the Nursing Outcomes Classification (NOC).

Science.gov (United States)

Head, Barbara J; Aquilino, Mary Lober; Johnson, Marion; Reed, David; Maas, Meridean; Moorhead, Sue

2004-01-01

To evaluate the content validity and nursing sensitivity of six community-level outcomes from the Nursing Outcomes Classification (NOC; Johnson, Maas, & Moorhead, 2000). A survey research design was used. Questionnaires were mailed to 300 public health nursing experts; 102 nurses responded. Experts evaluated between 11 and 30 indicators for each of the six outcomes for: (a) importance of the indicators for measuring the outcome, and (b) influence of nursing on the indicators. Content validity and nursing sensitivity of the outcomes were estimated with a modified Fehring technique. All outcomes were deemed important; only Community Competence had an outcome content validity score < .80. The outcome sensitivity score for Community Health: Immunity was .80; other outcome scores ranged from .62-.70. Indicator ratios for all 102 indicators met the study criterion for importance, with 87% designated as critical and 13% as supplemental. Sensitivity ratios reflected judgments that 45% of the indicators were sensitive to nursing intervention. The study provided evidence of outcome content validity and nursing sensitivity of the study outcomes; further validation research is recommended, followed by testing of the study outcomes in clinical practice. Community-level nursing-sensitive outcomes will potentially enable study of the efficacy and effectiveness of public health interventions focused on improving health of populations and communities.

Educational booklet on diabetes construction and content validation

Directory of Open Access Journals (Sweden)

Jéssica Azevedo de Aquino

2016-11-01

Full Text Available Abstract: Patients with Diabetes Mellitus (DM require support for self-management education and care. This study aimed to present the results of the construction and content validation of the educational booklet to be used in an educational program for empowerment of patients with DM. The educational booklet was developed containing the standards needed for self-care in diabetes proposed by the American Association of Diabetes Educators and subjected to evaluation by specialists using the Delphi Technique. The specialists valuation was performed in three stages, an online questionnaire with eight questions was used to get a consensus higher than 80% of all the items that makes up the final material. Later, the educational booklet was subjected to assessment of patients in a pilot study. Twelve specialists in DM participated in the first stage and three items initially did not reach 80% consensus. The booklet was reformulated and six specialists attended the second stage, in which he consensus higher than 80% was obtained. In a third stage, five patients contributed to the assessment of the final version. The educational booklet presents good characteristics of content validate to be used in educational program to empower DM patients in self-management and health care.

Development and content validation of the power mobility training tool.

Science.gov (United States)

Kenyon, Lisa K; Farris, John P; Cain, Brett; King, Emily; VandenBerg, Ashley

2018-01-01

This paper outlines the development and content validation of the power mobility training tool (PMTT), an observational tool designed to assist therapists in developing power mobility training programs for children who have multiple, severe impairments. Initial items on the PMTT were developed based on a literature review and in consultation with therapists experienced in the use of power mobility. Items were trialled in clinical settings, reviewed, and refined. Items were then operationalized and an administration manual detailing scoring for each item was created. Qualitative and quantitative methods were used to establish content validity via a 15 member, international expert panel. The content validity ratio (CVR) was determined for each possible item. Of the 19 original items, 10 achieved minimum required CVR values and were included in the final version of the PMTT. Items related to manoeuvring a power mobility device were merged and an item related to the number of switches used concurrently to operate a power mobility device were added to the PMTT. The PMTT may assist therapists in developing training programs that facilitate the acquisition of beginning power mobility skills in children who have multiple, severe impairments. Implications for Rehabilitation The Power Mobility Training Tool (PMTT) was developed to help guide the development of power mobility intervention programs for children who have multiple, severe impairments. The PMTT can be used with children who access a power mobility device using either a joystick or a switch. Therapists who have limited experience with power mobility may find the PMTT to be helpful in setting up and conducting power mobility training interventions as a feasible aspect of a plan of care for children who have multiple, severe impairments.

Content validity of critical success factors for e-Government implementation in Indonesia

Science.gov (United States)

Napitupulu, D.; Syafrullah, M.; Rahim, R.; Amar, A.; Sucahyo, YG

2018-05-01

The purpose of this research is to validate the Critical Success Factors (CSFs) of e-Government implementation in Indonesia. The e-Government initiative conducted only to obey the regulation but ignoring the quality. Defining CSFs will help government agencies to avoid failure of e-Government projects. A survey with the questionnaire was used to validate the item of CSF based on expert judgment through two round of Delphi. The result showed from 67 subjects in instrument tested; there are 11 invalid items deleted and remain only 56 items that had good content validity and internal reliability. Therefore, all 56 CSFs should be adopted by government agencies in Indonesia to support e-Government implementation.

Development and content validation of performance assessments for endoscopic third ventriculostomy

NARCIS (Netherlands)

Breimer, Gerben E.; Haji, Faizal A.; Hoving, Eelco W; Drake, James M.

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through

Face and content validity of a virtual-reality simulator for myringotomy with tube placement.

Science.gov (United States)

Huang, Caiwen; Cheng, Horace; Bureau, Yves; Agrawal, Sumit K; Ladak, Hanif M

2015-10-20

Myringotomy with tube insertion can be challenging for junior Otolaryngology residents as it is one of the first microscopic procedures they encounter. The Western myringotomy simulator was developed to allow trainees to practice microscope positioning, myringotomy, and tube placement. This virtual-reality simulator is viewed in stereoscopic 3D, and a haptic device is used to manipulate the digital ear model and surgical tools. To assess the face and content validity of the Western myringotomy simulator. The myringotomy simulator was integrated with new modules to allow speculum placement, manipulation of an operative microscope, and insertion of the ventilation tube through a deformable tympanic membrane. A questionnaire was developed in consultation with instructing surgeons. Fourteen face validity questions focused on the anatomy of the ear, simulation of the operative microscope, appearance and movement of the surgical instruments, deformation and cutting of the eardrum, and myringotomy tube insertion. Six content validity questions focused on training potential on surgical tasks such as speculum placement, microscope positioning, tool navigation, ear anatomy, myringotomy creation and tube insertion. A total of 12 participants from the Department of Otolaryngology-Head and Neck Surgery were recruited for the study. Prior to completing the questionnaire, participants were oriented to the simulator and given unlimited time to practice until they were comfortable with all of its aspects. Responses to 12 of the 14 questions on face validity were predominantly positive. One issue of concern was with contact modeling related to tube insertion into the eardrum, and the second was with the movement of the blade and forceps. The former could be resolved by using a higher resolution digital model for the eardrum to improve contact localization. The latter could be resolved by using a higher fidelity haptic device. With regard to content validity, 64% of the responses

Content Validation of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC)

Science.gov (United States)

Nishimura, Trisha Sugita; Busse, R. T.

2016-01-01

The purpose of this study was to examine the content validity of the Scale of Teachers' Attitudes towards Inclusive Classrooms (STATIC). An expert panel of 20 special education teachers and five university faculty members provided individual item ratings on a five-point scale regarding wording and content, along with comments. Item and comment…

Content validation of the nursing diagnosis acute pain in the Czech Republic and Slovakia.

Science.gov (United States)

Zeleníková, Renáta; Žiaková, Katarína; Čáp, Juraj; Jarošová, Darja

2014-10-01

The main purpose of the study was to validate the defining characteristics of the nursing diagnosis acute pain in the Czech Republic and Slovakia. This is a descriptive study. The validation process involved was based on Fehring's diagnostic content validity model. Four defining characteristics were classified as major by Slovak nurses and eight defining characteristics were classified as major by Czech nurses. Validation of the nursing diagnosis acute pain in the Czech and Slovak sociocultural context has shown that nurses prioritize characteristics that are behavioral in nature as well as patients' verbal reports of pain. Verbal reports of pain and behavioral indicators are important for arriving at the nursing diagnosis acute pain. © 2014 NANDA International, Inc.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method.

Science.gov (United States)

Badran, Hani; Pluye, Pierre; Grad, Roland

2017-03-14

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n

MR-based water content estimation in cartilage: design and validation of a method

DEFF Research Database (Denmark)

Shiguetomi Medina, Juan Manuel; Kristiansen, Maja Sophie; Ringgaard, Steffen

Purpose: Design and validation of an MR-based method that allows the calculation of the water content in cartilage tissue. Methods and Materials: Cartilage tissue T1 map based water content MR sequences were used on a 37 Celsius degree stable system. The T1 map intensity signal was analyzed on 6...... cartilage samples from living animals (pig) and on 8 gelatin samples which water content was already known. For the data analysis a T1 intensity signal map software analyzer used. Finally, the method was validated after measuring and comparing 3 more cartilage samples in a living animal (pig). The obtained...... map based water content sequences can provide information that, after being analyzed using a T1-map analysis software, can be interpreted as the water contained inside a cartilage tissue. The amount of water estimated using this method was similar to the one obtained at the dry-freeze procedure...

Face and content validity of Xperience™ Team Trainer: bed-side assistant training simulator for robotic surgery.

Science.gov (United States)

Sessa, Luca; Perrenot, Cyril; Xu, Song; Hubert, Jacques; Bresler, Laurent; Brunaud, Laurent; Perez, Manuela

2018-03-01

In robotic surgery, the coordination between the console-side surgeon and bed-side assistant is crucial, more than in standard surgery or laparoscopy where the surgical team works in close contact. Xperience™ Team Trainer (XTT) is a new optional component for the dv-Trainer ® platform and simulates the patient-side working environment. We present preliminary results for face, content, and the workload imposed regarding the use of the XTT virtual reality platform for the psychomotor and communication skills training of the bed-side assistant in robot-assisted surgery. Participants were categorized into "Beginners" and "Experts". They tested a series of exercises (Pick & Place Laparoscopic Demo, Pick & Place 2 and Team Match Board 1) and completed face validity questionnaires. "Experts" assessed content validity on another questionnaire. All the participants completed a NASA Task Load Index questionnaire to assess the workload imposed by XTT. Twenty-one consenting participants were included (12 "Beginners" and 9 "Experts"). XTT was shown to possess face and content validity, as evidenced by the rankings given on the simulator's ease of use and realism parameters and on the simulator's usefulness for training. Eight out of nine "Experts" judged the visualization of metrics after the exercises useful. However, face validity has shown some weaknesses regarding interactions and instruments. Reasonable workload parameters were registered. XTT demonstrated excellent face and content validity with acceptable workload parameters. XTT could become a useful tool for robotic surgery team training.

MR-based Water Content Estimation in Cartilage: Design and Validation of a Method

DEFF Research Database (Denmark)

Shiguetomi Medina, Juan Manuel; Kristiansen, Maja Sofie; Ringgaard, Steffen

2012-01-01

Objective Design and validation of an MR-based method that allows the calculation of the water content in cartilage tissue. Material and Methods We modified and adapted to cartilage tissue T1 map based water content MR sequences commonly used in the neurology field. Using a 37 Celsius degree stable...... was costumed and programmed. Finally, we validated the method after measuring and comparing 3 more cartilage samples in a living animal (pig). The obtained data was analyzed and the water content calculated. Then, the same samples were freeze-dried (this technique allows to take out all the water that a tissue...... contains) and we measured the water they contained. Results We could reproduce twice the 37 Celsius degree system and could perform the measurements in a similar way. We found that the MR T1 map based water content sequences can provide information that, after being analyzed with a special software, can...

Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology.

Science.gov (United States)

Dulan, Genevieve; Rege, Robert V; Hogg, Deborah C; Gilberg-Fisher, Kristine K; Tesfay, Seifu T; Scott, Daniel J

2012-04-01

The authors previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to determine the content and face validity of this curriculum. Expert robotic surgeons (n = 12) rated each deconstructed skill regarding relevance to robotic operations, were oriented to the curricular components, performed 3 to 5 repetitions on the 9 exercises, and rated each exercise. In terms of content validity, experts rated all 23 deconstructed skills as highly relevant (4.5 on a 5-point scale). Ratings for the 9 inanimate exercises indicated moderate to thorough measurement of designated skills. For face validity, experts indicated that each exercise effectively measured relevant skills (100% agreement) and was highly effective for training and assessment (4.5 on a 5-point scale). These data indicate that the 23 deconstructed skills accurately represent the appropriate content for robotic skills training and strongly support content and face validity for this curriculum. Copyright © 2012. Published by Elsevier Inc.

Qualitative Development and Content Validation of the PROMIS Pediatric Sleep Health Items.

Science.gov (United States)

Bevans, Katherine B; Meltzer, Lisa J; De La Motte, Anna; Kratchman, Amy; Viél, Dominique; Forrest, Christopher B

2018-04-25

To develop the Patient Reported Outcome Measurement Information System (PROMIS) Pediatric Sleep Health item pool and evaluate its content validity. Participants included 8 expert sleep clinician-researchers, 64 children ages 8-17 years, and 54 parents of children ages 5-17 years. We started with item concepts and expressions from the PROMIS Sleep Disturbance and Sleep Related Impairment adult measures. Additional pediatric sleep health concepts were generated by expert (n = 8), child (n = 28), and parent (n = 33) concept elicitation interviews and a systematic review of existing pediatric sleep health questionnaires. Content validity of the item pool was evaluated with item translatability review, readability analysis, and child (n = 36) and parent (n = 21) cognitive interviews. The final pediatric Sleep Health item pool includes 43 items that assess sleep disturbance (children's capacity to fall and stay asleep, sleep quality, dreams, and parasomnias) and sleep-related impairments (daytime sleepiness, low energy, difficulty waking up, and the impact of sleep and sleepiness on cognition, affect, behavior, and daily activities). Items are translatable and relevant and well understood by children ages 8-17 and parents of children ages 5-17. Rigorous qualitative procedures were used to develop and evaluate the content validity of the PROMIS Pediatric Sleep Health item pool. Once the item pool's psychometric properties are established, the scales will be useful for measuring children's subjective experiences of sleep.

Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery.

Science.gov (United States)

Ribeiro de Oliveira, Marcelo Magaldi; Nicolato, Arthur; Santos, Marcilea; Godinho, Joao Victor; Brito, Rafael; Alvarenga, Alexandre; Martins, Ana Luiza Valle; Prosdocimi, André; Trivelato, Felipe Padovani; Sabbagh, Abdulrahman J; Reis, Augusto Barbosa; Maestro, Rolando Del

2016-05-01

OBJECT The development of neurointerventional treatments of central nervous system disorders has resulted in the need for adequate training environments for novice interventionalists. Virtual simulators offer anatomical definition but lack adequate tactile feedback. Animal models, which provide more lifelike training, require an appropriate infrastructure base. The authors describe a training model for neurointerventional procedures using the human placenta (HP), which affords haptic training with significantly fewer resource requirements, and discuss its validation. METHODS Twelve HPs were prepared for simulated endovascular procedures. Training exercises performed by interventional neuroradiologists and novice fellows were placental angiography, stent placement, aneurysm coiling, and intravascular liquid embolic agent injection. RESULTS The endovascular training exercises proposed can be easily reproduced in the HP. Face, content, and construct validity were assessed by 6 neurointerventional radiologists and 6 novice fellows in interventional radiology. CONCLUSIONS The use of HP provides an inexpensive training model for the training of neurointerventionalists. Preliminary validation results show that this simulation model has face and content validity and has demonstrated construct validity for the interventions assessed in this study.

A new method for assessing content validity in model-based creation and iteration of eHealth interventions.

Science.gov (United States)

Kassam-Adams, Nancy; Marsac, Meghan L; Kohser, Kristen L; Kenardy, Justin A; March, Sonja; Winston, Flaura K

2015-04-15

The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of "content validity" as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. In the evaluation of Coping Coach content validity, 15 experts from five countries

Content validation of a Danish version of "The McGill Ingestive Skills Assessment" for dysphagia management.

Science.gov (United States)

Hansen, Tina; Lambert, Heather C; Faber, Jens

2011-12-01

This study addresses the first steps in the cross-cultural adaptation of a Danish version of the McGill Ingestive Skills Assessment (MISA), which quantifies eating and drinking abilities by scoring a meal observation. The original Canadian MISA was translated and adapted into Danish (MISA-DK). For content validation of the MISA-DK, a judgemental quantification process was applied using 13 experts. Thereafter, the MISA-DK was pilot tested by 16 occupational therapists. Finally, the MISA-DK was linked to the International Classification of Functioning, Disability and Health (ICF). Content validity of 43 items was found for 93% in terms of adequacy, 67% in terms of clarity of item description, 86% in terms of clarity of score descriptions, and 93% in terms of relevance. Thirteen of 14 sections of the instruction manual and score sheet were content valid. In light of these results, a revised MISA-DK was produced for the pilot test, which then found content validity for all sections and 98% of the items. The ICF linking resulted in 41 ICF-categories, which may reflect the complexity of eating and drinking as well as a multidimensional structure of the MISA-DK. In conclusion, the MISA-DK is prepared for psychometric testing using classical as well as modern test theory.

Development and content validity testing of a comprehensive classification of diagnoses for pediatric nurse practitioners.

Science.gov (United States)

Burns, C

1991-01-01

Pediatric nurse practitioners (PNPs) need an integrated, comprehensive classification that includes nursing, disease, and developmental diagnoses to effectively describe their practice. No such classification exists. Further, methodologic studies to help evaluate the content validity of any nursing taxonomy are unavailable. A conceptual framework was derived. Then 178 diagnoses from the North American Nursing Diagnosis Association (NANDA) 1986 list, selected diagnoses from the International Classification of Diseases, the Diagnostic and Statistical Manual, Third Revision, and others were selected. This framework identified and listed, with definitions, three domains of diagnoses: Developmental Problems, Diseases, and Daily Living Problems. The diagnoses were ranked using a 4-point scale (4 = highly related to 1 = not related) and were placed into the three domains. The rating scale was assigned by a panel of eight expert pediatric nurses. Diagnoses that were assigned to the Daily Living Problems domain were then sorted into the 11 Functional Health patterns described by Gordon (1987). Reliability was measured using proportions of agreement and Kappas. Content validity of the groups created was measured using indices of content validity and average congruency percentages. The experts used a new method to sort the diagnoses in a new way that decreased overlaps among the domains. The Developmental and Disease domains were judged reliable and valid. The Daily Living domain of nursing diagnoses showed marginally acceptable validity with acceptable reliability. Six Functional Health Patterns were judged reliable and valid, mixed results were determined for four categories, and the Coping/Stress Tolerance category was judged reliable but not valid using either test. There were considerable differences between the panel's, Gordon's (1987), and NANDA's clustering of NANDA diagnoses. This study defines the diagnostic practice of nurses from a holistic, patient

Chronic Pain: Content Validation of Nursing Diagnosis in Slovakia and the Czech Republic.

Science.gov (United States)

Zeleníková, Renáta; Maniaková, Lenka

2015-10-01

The main purpose of the study was to validate the defining characteristics and related factors of the nursing diagnosis "chronic pain" in Slovakia and the Czech Republic. This is a descriptive study. The validation process involved was based on Fehring's Diagnostic Content Validity Model. Three defining characteristics (reports pain, altered ability to continue previous activities, and depression) were classified as major by Slovak nurses, and one defining characteristic (reports pain) was classified as major by Czech nurses. The results of the study provide guidance in devising strategies of pain assessment and can aid in the formulation of accurate nursing diagnoses. The defining characteristic "reports pain" is important for arriving at the nursing diagnosis "chronic pain." © 2014 NANDA International, Inc.

A content validated questionnaire for assessment of self reported venous blood sampling practices.

Science.gov (United States)

Bölenius, Karin; Brulin, Christine; Grankvist, Kjell; Lindkvist, Marie; Söderberg, Johan

2012-01-19

Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward.

A New Method for Analyzing Content Validity Data Using Multidimensional Scaling

Science.gov (United States)

Li, Xueming; Sireci, Stephen G.

2013-01-01

Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test…

Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

Science.gov (United States)

Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

2017-08-17

The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

A Scale for E-Content Preparation Skills: Development, Validity and Reliability

Science.gov (United States)

Tekin, Ahmet; Polat, Ebru

2016-01-01

Problem Statement: For an effective teaching and learning process it is critical to provide support for teachers in the development of e-content, and teachers should play an active role in this development. Purpose of the Study: The purpose of this study is to develop a valid and reliable Likert-type scale that will determine pre-service teachers'…

Content validation: clarity/relevance, reliability and internal consistency of enunciative signs of language acquisition.

Science.gov (United States)

Crestani, Anelise Henrich; Moraes, Anaelena Bragança de; Souza, Ana Paula Ramos de

2017-08-10

To analyze the results of the validation of building enunciative signs of language acquisition for children aged 3 to 12 months. The signs were built based on mechanisms of language acquisition in an enunciative perspective and on clinical experience with language disorders. The signs were submitted to judgment of clarity and relevance by a sample of six experts, doctors in linguistic in with knowledge of psycholinguistics and language clinic. In the validation of reliability, two judges/evaluators helped to implement the instruments in videos of 20% of the total sample of mother-infant dyads using the inter-evaluator method. The method known as internal consistency was applied to the total sample, which consisted of 94 mother-infant dyads to the contents of the Phase 1 (3-6 months) and 61 mother-infant dyads to the contents of Phase 2 (7 to 12 months). The data were collected through the analysis of mother-infant interaction based on filming of dyads and application of the parameters to be validated according to the child's age. Data were organized in a spreadsheet and then converted to computer applications for statistical analysis. The judgments of clarity/relevance indicated no modifications to be made in the instruments. The reliability test showed an almost perfect agreement between judges (0.8 ≤ Kappa ≥ 1.0); only the item 2 of Phase 1 showed substantial agreement (0.6 ≤ Kappa ≥ 0.79). The internal consistency for Phase 1 had alpha = 0.84, and Phase 2, alpha = 0.74. This demonstrates the reliability of the instruments. The results suggest adequacy as to content validity of the instruments created for both age groups, demonstrating the relevance of the content of enunciative signs of language acquisition.

Injection Drug User Quality of Life Scale (IDUQOL: Findings from a content validation study

Directory of Open Access Journals (Sweden)

Palepu Anita

2007-07-01

Full Text Available Abstract Background Quality of life studies among injection drug users have primarily focused on health-related measures. The chaotic life-style of many injection drug users (IDUs, however, extends far beyond their health, and impacts upon social relationships, employment opportunities, housing, and day to day survival. Most current quality of life instruments do not capture the realities of people living with addictions. The Injection Drug Users' Quality of Life Scale (IDUQOL was developed to reflect the life areas of relevance to IDUs. The present study examined the content validity of the IDUQOL using judgmental methods based on subject matter experts' (SMEs ratings of various elements of this measure (e.g., appropriateness of life areas or items, names and descriptions of life areas, instructions for administration and scoring. Methods Six SMEs were provided with a copy of the IDUQOL and its administration and scoring manual and a detailed content validation questionnaire. Two commonly used judgmental measures of inter-rater agreement, the Content Validity Index (CVI and the Average Deviation Mean Index (ADM, were used to evaluate SMEs' agreement on ratings of IDUQOL elements. Results A total of 75 elements of the IDUQOL were examined. The CVI results showed that all elements were endorsed by the required number of SMEs or more. The ADM results showed that acceptable agreement (i.e., practical significance was obtained for all elements but statistically significant agreement was missed for nine elements. For these elements, SMEs' feedback was examined for ways to improve the elements. Open-ended feedback also provided suggestions for other revisions to the IDUQOL. Conclusion The results of the study provided strong evidence in support of the content validity of the IDUQOL and direction for the revision of some IDUQOL elements.

A content validated questionnaire for assessment of self reported venous blood sampling practices

Directory of Open Access Journals (Sweden)

Bölenius Karin

2012-01-01

Full Text Available Abstract Background Venous blood sampling is a common procedure in health care. It is strictly regulated by national and international guidelines. Deviations from guidelines due to human mistakes can cause patient harm. Validated questionnaires for health care personnel can be used to assess preventable "near misses"--i.e. potential errors and nonconformities during venous blood sampling practices that could transform into adverse events. However, no validated questionnaire that assesses nonconformities in venous blood sampling has previously been presented. The aim was to test a recently developed questionnaire in self reported venous blood sampling practices for validity and reliability. Findings We developed a questionnaire to assess deviations from best practices during venous blood sampling. The questionnaire contained questions about patient identification, test request management, test tube labeling, test tube handling, information search procedures and frequencies of error reporting. For content validity, the questionnaire was confirmed by experts on questionnaires and venous blood sampling. For reliability, test-retest statistics were used on the questionnaire answered twice. The final venous blood sampling questionnaire included 19 questions out of which 9 had in total 34 underlying items. It was found to have content validity. The test-retest analysis demonstrated that the items were generally stable. In total, 82% of the items fulfilled the reliability acceptance criteria. Conclusions The questionnaire could be used for assessment of "near miss" practices that could jeopardize patient safety and gives several benefits instead of assessing rare adverse events only. The higher frequencies of "near miss" practices allows for quantitative analysis of the effect of corrective interventions and to benchmark preanalytical quality not only at the laboratory/hospital level but also at the health care unit/hospital ward.

Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0

Energy Technology Data Exchange (ETDEWEB)

TRUCANO,TIMOTHY G.; MOYA,JAIME L.

1999-12-01

This report summarizes general guidelines for the development of Verification and Validation (V and V) plans for ASCI code projects at Sandia National Laboratories. The main content categories recommended by these guidelines for explicit treatment in Sandia V and V plans are (1) stockpile drivers influencing the code development project (2) the key phenomena to be modeled by the individual code; (3) software verification strategy and test plan; and (4) code validation strategy and test plans. The authors of this document anticipate that the needed content of the V and V plans for the Sandia ASCI codes will evolve as time passes. These needs will be reflected by future versions of this document.

Method validation for uranium content analysis using a potentiometer T-90

International Nuclear Information System (INIS)

Torowati; Ngatijo; Rahmiati

2016-01-01

An experimental method validation has been conducted for uranium content analysis using Potentiometer T-90. The method validation experiment was performed in the quality control laboratory of Experiment Fuel Element Installation, PTBBN - BATAN. The objective is to determine the level of precision and accuracy of analytical results for uranium analysis referring to the latest American Standard Test Method (ASTM) of ASTM C1267-11, which is a modified reference method by reducing of reagent consumption by 10% of the amount used by the original method. The ASTM C 1267-11 reference is a new ASTM as a substitute for the older ASTM namely ASTM C799, Vol.12.01, 2003. It is, therefore, necessary to validate the renewed method. The tool used for the analysis of uranium was potentiometer T-90 and the material used was standard uranium oxide powder CRM (Certificate Reference Material). Validation of the method was done by analyzing standard uranium powder by 7 times weighing and 7 times analysis. Analysis results were used to determine the level of accuracy, precision, Relative Standard Deviation (RSD) and Horwitz coefficient Variation and limit detection and quantitation. The average uranium obtained for this method validation is 84.36% with Standard Deviation (SD) of 0.12%, Relative Standard Deviation (RSD) 0.14% and 2/3 Horwitz coefficient Variation (CV Horwitz) 2.05%. The results show that RSD value is smaller than the value of (2/3) CV Horwitz, which means that this method has a high precision. The accuracy value obtained is 0.48%, and since the acceptance limit of high level of accuracy is when the accuracy value is <2.00%, this method is regarded as having a high degree of accuracy [1]. The limit of detection (LOD) and and the limit of quantitation (LOQ) are 0.0145 g/L and 0.0446 g/L respectively. It is concluded that the ASTM C 1267-11 reference method is valid for use. (author)

Face, Content, and Construct Validations of Endoscopic Needle Injection Simulator for Transurethral Bulking Agent in Treatment of Stress Urinary Incontinence.

Science.gov (United States)

Farhan, Bilal; Soltani, Tandis; Do, Rebecca; Perez, Claudia; Choi, Hanul; Ghoniem, Gamal

2018-05-02

Endoscopic injection of urethral bulking agents is an office procedure that is used to treat stress urinary incontinence secondary to internal sphincteric deficiency. Validation studies important part of simulator evaluation and is considered important step to establish the effectiveness of simulation-based training. The endoscopic needle injection (ENI) simulator has not been formally validated, although it has been used widely at University of California, Irvine. We aimed to assess the face, content, and construct validity of the UC, Irvine ENI simulator. Dissected female porcine bladders were mounted in a modified Hysteroscopy Diagnostic Trainer. Using routine endoscopic equipment for this procedure with video monitoring, 6 urologists (experts group) and 6 urology trainee (novice group) completed urethral bulking agents injections on a total of 12 bladders using ENI simulator. Face and content validities were assessed by using structured quantitative survey which rating the realism. Construct validity was assessed by comparing the performance, time of the procedure, and the occlusive (anatomical and functional) evaluations between the experts and novices. Trainees also completed a postprocedure feedback survey. Effective injections were evaluated by measuring the retrograde urethral opening pressure, visual cystoscopic coaptation, and postprocedure gross anatomic examination. All 12 participants felt the simulator was a good training tool and should be used as essential part of urology training (face validity). ENI simulator showed good face and content validity with average score varies between the experts and the novices was 3.9/5 and 3.8/5, respectively. Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.9-3.8/5). However, the bladder does not bleed, and sometimes thin. Experts significantly outperformed novices (p ENI simulator shows face, content and construct validities, although few

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

Science.gov (United States)

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

The Content Validity of a Chemotherapy-Induced Peripheral Neuropathy Patient-Reported Outcome Measure

Science.gov (United States)

Lavoie Smith, Ellen M.; Haupt, Rylie; Kelly, James P.; Lee, Deborah; Kanzawa-Lee, Grace; Knoerl, Robert; Bridges, Celia; Alberti, Paola; Prasertsri, Nusara; Donohoe, Clare

2018-01-01

Purpose/Objectives To test the content validity of a 16-item version of the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire–Chemotherapy-Induced Peripheral Neuropathy (QLQ-CIPN20). Research Approach Cross-sectional, prospective, qualitative design. Setting Six outpatient oncology clinics within the University of Michigan Health System’s comprehensive cancer center in Ann Arbor. Participants 25 adults with multiple myeloma or breast, gynecologic, gastrointestinal, or head and neck malignancies experiencing peripheral neuropathy caused by neurotoxic chemotherapy. Methodologic Approach Cognitive interviewing methodology was used to evaluate the content validity of a 16-item version of the QLQ-CIPN20 instrument. Findings Minor changes were made to three questions to enhance readability. Twelve questions were revised to define unfamiliar terminology, clarify the location of neuropathy, and emphasize important aspects. One question was deleted because of clinical and conceptual redundancy with other items, as well as concerns regarding generalizability and social desirability. Interpretation Cognitive interviewing methodology revealed inconsistencies between patients’ understanding and researchers’ intent, along with points that required clarification to avoid misunderstanding. Implications for Nursing Patients’ interpretations of the instrument’s items were inconsistent with the intended meanings of the questions. One item was dropped and others were revised, resulting in greater consistency in how patients, clinicians, and researchers interpreted the items’ meanings and improving the instrument’s content validity. Following additional revision and psychometric testing, the QLQ-CIPN20 could evolve into a gold-standard CIPN patient-reported outcome measure. PMID:28820525

Content validity across methods of malnutrition assessment in patients with cancer is limited

NARCIS (Netherlands)

Sealy, Martine J.; Nijholt, Willemke; Stuiver, Martijn M.; van der Berg, Marit M.; Roodenburg, Jan L. N.; Schans, van der Cees P.; Ottery, Faith D.; Jager-Wittenaar, Harriet

Objective: To identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition. Study Design and Setting: Systematic review of studies in cancer patients that operationalized malnutrition as a variable,

Content validity across methods of malnutrition assessment in patients with cancer is limited

NARCIS (Netherlands)

Sealy, Martine; Nijholt, Willemke; Stuiver, M.M.; van der Berg, M.M.; Roodenburg, Jan; Ottery, Faith D.; van der Schans, Cees; Jager, Harriët

2016-01-01

Objective To identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition. Study Design and Setting Systematic review of studies in cancer patients that operationalized malnutrition as a variable,

Face, content and construct validity of a virtual reality simulator for robotic surgery (SEP Robot).

Science.gov (United States)

Gavazzi, Andrea; Bahsoun, Ali N; Van Haute, Wim; Ahmed, Kamran; Elhage, Oussama; Jaye, Peter; Khan, M Shamim; Dasgupta, Prokar

2011-03-01

This study aims to establish face, content and construct validation of the SEP Robot (SimSurgery, Oslo, Norway) in order to determine its value as a training tool. The tasks used in the validation of this simulator were arrow manipulation and performing a surgeon's knot. Thirty participants (18 novices, 12 experts) completed the procedures. The simulator was able to differentiate between experts and novices in several respects. The novice group required more time to complete the tasks than the expert group, especially suturing. During the surgeon's knot exercise, experts significantly outperformed novices in maximum tightening stretch, instruments dropped, maximum winding stretch and tool collisions in addition to total task time. A trend was found towards the use of less force by the more experienced participants. The SEP robotic simulator has demonstrated face, content and construct validity as a virtual reality simulator for robotic surgery. With steady increase in adoption of robotic surgery world-wide, this simulator may prove to be a valuable adjunct to clinical mentorship.

The Johns Hopkins model of psychological first aid (RAPID-PFA): curriculum development and content validation.

Science.gov (United States)

Everly, George S; Barnett, Daniel J; Links, Jonathan M

2012-01-01

There appears to be virtual universal endorsement of the need for and value of acute "psychological first aid" (PFA) in the wake of trauma and disasters. In this paper, we describe the development of the curriculum for The Johns Hopkins RAPID-PFA model of psychological first aid. We employed an adaptation of the basic framework for the development of a clinical science as recommended by Millon which entailed: historical review, theoretical development, and content validation. The process of content validation of the RAPID-PFA curriculum entailed the assessment of attitudes (confidence in the application of PFA interventions, preparedness in the application of PFA); knowledge related to the application of immediate mental health interventions; and behavior (the ability to recognize clinical markers in the field as assessed via a videotape recognition exercise). Results of the content validation phase suggest the six-hour RAPID-PFA curriculum, initially based upon structural modeling analysis, can improve confidence in the application of PFA interventions, preparedness in the application of PFA, knowledge related to the application of immediate mental health interventions, and the ability to recognize clinical markers in the field as assessed via a videotape recognition exercise.

Development and content validity of a screening instrument for gaming addiction in adolescents: the Gaming Addiction Identification Test (GAIT).

Science.gov (United States)

Vadlin, Sofia; Åslund, Cecilia; Nilsson, Kent W

2015-08-01

This study describes the development of a screening tool for gaming addiction in adolescents - the Gaming Addiction Identification Test (GAIT). Its development was based on the research literature on gaming and addiction. An expert panel comprising professional raters (n = 7), experiential adolescent raters (n = 10), and parent raters (n = 10) estimated the content validity of each item (I-CVI) as well as of the whole scale (S-CVI/Ave), and participated in a cognitive interview about the GAIT scale. The mean scores for both I-CVI and S-CVI/Ave ranged between 0.97 and 0.99 compared with the lowest recommended I-CVI value of 0.78 and the S-CVI/Ave value of 0.90. There were no sex differences and no differences between expert groups regarding ratings in content validity. No differences in the overall evaluation of the scale emerged in the cognitive interviews. Our conclusions were that GAIT showed good content validity in capturing gaming addiction. The GAIT needs further investigation into its psychometric properties of construct validity (convergent and divergent validity) and criterion-related validity, as well as its reliability in both clinical settings and in community settings with adolescents. © 2015 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

A Content Validity Study of AIMIT (Assessing Interpersonal Motivation in Transcripts).

Science.gov (United States)

Fassone, Giovanni; Lo Reto, Floriana; Foggetti, Paola; Santomassimo, Chiara; D'Onofrio, Maria Rita; Ivaldi, Antonella; Liotti, Giovanni; Trincia, Valeria; Picardi, Angelo

2016-07-01

Multi-motivational theories of human relatedness state that different motivational systems with an evolutionary basis modulate interpersonal relationships. The reliable assessment of their dynamics may usefully inform the understanding of the therapeutic relationship. The coding system of the Assessing Interpersonal Motivation in Transcripts (AIMIT) allows to identify in the clinical the activity of five main interpersonal motivational systems (IMSs): attachment (care-seeking), caregiving, ranking, sexuality and peer cooperation. To assess whether the criteria currently used to score the AIMIT are consistently correlated with the conceptual formulation of the interpersonal multi-motivational theory, two different studies were designed. Study 1: Content validity as assessed by highly qualified independent raters. Study 2: Content validity as assessed by unqualified raters. Results of study 1 show that out of the total 60 AIMIT verbal criteria, 52 (86.7%) met the required minimum degree of correspondence. The average semantic correspondence scores between these items and the related IMSs were quite good (overall mean: 3.74, standard deviation: 0.61). In study 2, a group of 20 naïve raters had to identify each prevalent motivation (IMS) in a random sequence of 1000 utterances drawn from therapy sessions. Cohen's Kappa coefficient was calculated for each rater with reference to each IMS and then calculated the average Kappa for all raters for each IMS. All average Kappa values were satisfactory (>0.60) and ranged between 0.63 (ranking system) and 0.83 (sexuality system). Data confirmed the overall soundness of AIMIT's theoretical-applicative approach. Results are discussed, corroborating the hypothesis that the AIMIT possesses the required criteria for content validity. Copyright © 2015 John Wiley & Sons, Ltd. Assessing Interpersonal Motivations in psychotherapy transcripts as a useful tool to better understand links between motivational systems and intersubjectivity

The reliability and validity of hand-held refractometry water content measures of hydrogel lenses.

Science.gov (United States)

Nichols, Jason J; Mitchell, G Lynn; Good, Gregory W

2003-06-01

To investigate within- and between-examiner reliability and validity of hand-held refractometry water content measures of hydrogel lenses. Nineteen lenses of various nominal water contents were examined by two examiners on two occasions separated by 1 hour. An Atago N2 hand-held refractometer was used for all water content measures. Lenses were presented in a random order to each examiner by a third party, and examiners were masked to any potential lens identifiers. Intraclass correlation coefficients (ICC), 95% limits of agreement, and Wilcoxon signed rank test were used to characterize the within- and between-examiner reliability and validity of lens water content measures. Within-examiner reliability was excellent (ICC, 0.97; 95% limits of agreement, -3.6% to +5.7%), and the inter-visit mean difference of 1.1 +/- 2.4% was not biased (p = 0.08). Between-examiner reliability was also excellent (ICC, 0.98; 95% limits of agreement, -4.1% to +3.9%). The mean difference between examiners was -0.1 +/- 2.1% (p = 0.83). The mean difference between the nominally reported water content and our water content measures was -2.1 +/- 1.7% (p refractometry and is material dependent. Therefore, investigators may need to account for bias when measuring hydrogel lens water content via hand-held refractometry.

Technique Triangulation for Validation in Directed Content Analysis

Directory of Open Access Journals (Sweden)

Áine M. Humble PhD

2009-09-01

Full Text Available Division of labor in wedding planning varies for first-time marriages, with three types of couples—traditional, transitional, and egalitarian—identified, but nothing is known about wedding planning for remarrying individuals. Using semistructured interviews, the author interviewed 14 couples in which at least one person had remarried and used directed content analysis to investigate the extent to which the aforementioned typology could be transferred to this different context. In this paper she describes how a triangulation of analytic techniques provided validation for couple classifications and also helped with moving beyond “blind spots” in data analysis. Analytic approaches were the constant comparative technique, rank order comparison, and visual representation of coding, using MAXQDA 2007's tool called TextPortraits.

Mining user-generated geographic content : an interactive, crowdsourced approach to validation and supervision

NARCIS (Netherlands)

Ostermann, F.O.; Garcia Chapeton, Gustavo Adolfo; Zurita-Milla, R.; Kraak, M.J.; Bergt, A.; Sarjakoski, T.; van Lammeren, R.; Rip, F.

2017-01-01

This paper describes a pilot study that implements a novel approach to validate data mining tasks by using the crowd to train a classifier. This hybrid approach to processing successfully addresses challenges faced during human curation or machine processing of user-generated geographic content

Instrument for assessing the quality of mobile emergency pre-hospital care: content validation

Directory of Open Access Journals (Sweden)

Rodrigo Assis Neves Dantas

2015-06-01

Full Text Available OBJECTIVES To validate an instrument to assess quality of mobile emergency pre-hospital care. METHOD A methodological study where 20 professionals gave their opinions on the items of the proposed instrument. The analysis was performed using Kappa test (K and Content Validity Index (CVI, considering K> 0.80 and CVI ≥ 0.80. RESULTS Three items were excluded from the instrument: Professional Compensation; Job Satisfaction and Services Performed. Items that obtained adequate K and CVI indexes and remained in the instrument were: ambulance conservation status; physical structure; comfort in the ambulance; availability of material resources; user/staff safety; continuous learning; safety demonstrated by the team; access; welcoming; humanization; response time; costumer privacy; guidelines on care; relationship between professionals and costumers; opportunity for costumers to make complaints and multiprofessional conjunction/actuation. CONCLUSION The instrument to assess quality of care has been validated and may contribute to the evaluation of pre-hospital care in mobile emergency services.

Validity of the Danish Prostate Symptom Score questionnaire in stroke

DEFF Research Database (Denmark)

Tibaek, S.; Dehlendorff, Christian

2009-01-01

Objective – To determine the content and face validity of the Danish Prostate Symptom Score (DAN-PSS-1) questionnaire in stroke patients. Materials and methods – Content validity was judged among an expert panel in neuro-urology. The judgement was measured by the content validity index (CVI). Face...... validity was indicated in a clinical sample of 482 stroke patients in a hospital-based, cross-sectional survey. Results – I-CVI was rated >0.78 (range 0.94–1.00) for 75% of symptom and bother items corresponding to adequate content validity. The expert panel rated the entire DAN-PSS-1 questionnaire highly...... questionnaire appears to be content and face valid for measuring lower urinary tract symptoms after stroke....

Content validation of an interprofessional learning video peer assessment tool.

Science.gov (United States)

Nisbet, Gillian; Jorm, Christine; Roberts, Chris; Gordon, Christopher J; Chen, Timothy F

2017-12-16

Large scale models of interprofessional learning (IPL) where outcomes are assessed are rare within health professional curricula. To date, there is sparse research describing robust assessment strategies to support such activities. We describe the development of an IPL assessment task based on peer rating of a student generated video evidencing collaborative interprofessional practice. We provide content validation evidence of an assessment rubric in the context of large scale IPL. Two established approaches to scale development in an educational setting were combined. A literature review was undertaken to develop a conceptual model of the relevant domains and issues pertaining to assessment of student generated videos within IPL. Starting with a prototype rubric developed from the literature, a series of staff and student workshops were undertaken to integrate expert opinion and user perspectives. Participants assessed five-minute videos produced in a prior pilot IPL activity. Outcomes from each workshop informed the next version of the rubric until agreement was reached on anchoring statements and criteria. At this point the rubric was declared fit to be used in the upcoming mandatory large scale IPL activity. The assessment rubric consisted of four domains: patient issues, interprofessional negotiation; interprofessional management plan in action; and effective use of video medium to engage audience. The first three domains reflected topic content relevant to the underlying construct of interprofessional collaborative practice. The fourth domain was consistent with the broader video assessment literature calling for greater emphasis on creativity in education. We have provided evidence for the content validity of a video-based peer assessment task portraying interprofessional collaborative practice in the context of large-scale IPL activities for healthcare professional students. Further research is needed to establish the reliability of such a scale.

Development of a youth-report measure of DPN symptoms: Conceptualization and content validation

Directory of Open Access Journals (Sweden)

Joanne Moser

2017-09-01

Conclusions: This study is the first to generate a content valid self-report measure of youth’s lived experiences with DPN that uses developmentally appropriate terminology. With further psychometric testing, the measure could be used to advance research on pediatric DPN and enhance clinicians’ capacity to identify the condition in childhood.

Development and validation of the goal content for exercise questionnaire.

Science.gov (United States)

Sebire, Simon J; Standage, Martyn; Vansteenkiste, Maarten

2008-08-01

Self-determination theory (SDT; Deci & Ryan, 2000) proposes that intrinsic, relative to extrinsic, goal content is a critical predictor of the quality of an individual's behavior and psychological well-being. Through three studies, we developed and psychometrically tested a measure of intrinsic and extrinsic goal content in the exercise context: the Goal Content for Exercise Questionnaire (GCEQ). In adults, exploratory (N = 354; Study 1) and confirmatory factor analyses (N = 312; Study 2) supported a 20-item solution consisting of 5 lower order factors (i.e., social affiliation, health management, skill development, image and social recognition) that could be subsumed within a 2-factor higher order structure (i.e., intrinsic and extrinsic). Evidence for external validity, temporal stability, gender invariance, and internal consistency of the GCEQ was found. An independent sample (N = 475; Study 3) provided further support for the lower order structure of the GCEQ and some support for the higher order structure. The GCEQ was supported as a measure of exercise-based goal content, which may help understand how intrinsic and extrinsic goals can motivate exercise behavior.

Content and cultural validity in the development of the Indigenous Play Partner Scale.

Science.gov (United States)

Dender, Alma M; Stagnitti, Karen E

2017-08-01

Culturally relevant assessments of Australian Indigenous children's social pretend play do not exist. This study investigated the content validity and cultural validity of the Indigenous Play Partner Scale (I-PPS). Six pairs of children (i.e. 12 children) aged four-six years from a remote Australian town were videoed playing in pairs, and 14 community elders and mothers participated across three focus groups. The social interactions between the children were transcribed from the videos. Nineteen verbs, grouped into five categories of social interaction, described the social interactions between the pairs of children. The descriptions of the social interaction verbs were presented to the community elders and mothers in a focus group. The themes from the focus groups were 'background of Indigenous understanding of play' and 'proposed social interaction verbs'. The first theme reflected community collaboration, children playing in multi-aged groups and the role of older children within the play. Guided by the focus group discussion, the videos were re-analysed and 20 social interaction verbs were described that reflected the cultural context of play. The content and cultural validity of the I-PPS was established through community consultation. Twenty social interaction verbs, which form the basis of the items of the I-PPS, reflected Indigenous cultural values of being non-judgemental of Indigenous children's social interactions during pretend play. Culturally relevant assessments for Australian Indigenous children do not disadvantage this population group and are essential for practice in occupational therapy. © 2017 Occupational Therapy Australia.

Student mathematical imagination instruments: construction, cultural adaptation and validity

Science.gov (United States)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

What Does It Cost to Prevent On-Duty Firefighter Cardiac Events? A Content Valid Method for Calculating Costs

Directory of Open Access Journals (Sweden)

P. Daniel Patterson

2013-01-01

Full Text Available Cardiac arrest is a leading cause of mortality among firefighters. We sought to develop a valid method for determining the costs of a workplace prevention program for firefighters. In 2012, we developed a draft framework using human resource accounting and in-depth interviews with experts in the firefighting and insurance industries. The interviews produced a draft cost model with 6 components and 26 subcomponents. In 2013, we randomly sampled 100 fire chiefs out of >7,400 affiliated with the International Association of Fire Chiefs. We used the Content Validity Index (CVI to identify the content valid components of the draft cost model. This was accomplished by having fire chiefs rate the relevancy of cost components using a 4-point Likert scale (highly relevant to not relevant. We received complete survey data from 65 fire chiefs (65% response rate. We retained 5 components and 21 subcomponents based on CVI scores ≥0.70. The five main components include, (1 investment costs, (2 orientation and training costs, (3 medical and pharmaceutical costs, (4 education and continuing education costs, and (5 maintenance costs. Data from a diverse sample of fire chiefs has produced a content valid method for calculating the cost of a prevention program among firefighters.

Development and Initial Validation of the Need Satisfaction and Need Support at Work Scales: A Validity-Focused Approach

Directory of Open Access Journals (Sweden)

Susanne Tafvelin

2018-01-01

Full Text Available Although the relevance of employee need satisfaction and manager need support have been examined, the integration of self-determination theory (SDT into work and organizational psychology has been hampered by the lack of validated measures. The purpose of the current study was to develop and validate measures of employees’ perception of need satisfaction (NSa-WS and need support (NSu-WS at work that were grounded in SDT. We used three Swedish samples (total 'N' = 1,430 to develop and validate our scales. We used a confirmatory approach including expert panels to assess item content relevance, confirmatory factor analysis for factorial validity, and associations with theoretically warranted outcomes to assess criterion-related validity. Scale reliability was also assessed. We found evidence of content, factorial, and criterion-related validity of our two scales of need satisfaction and need support at work. Further, the scales demonstrated high internal consistency. Our newly developed scales may be used in research and practice to further our understanding regarding how satisfaction and support of employee basic needs influence employee motivation, performance, and well-being. Our study makes a contribution to the current literature by providing (1 scales that are specifically designed for the work context, (2 an example of how expert panels can be used to assess content validity, and (3 testing of theoretically derived hypotheses that, although SDT is built on them, have not been examined before.

Validation of adipose lipid content as a body condition index for polar bears

Science.gov (United States)

McKinney, Melissa A.; Atwood, Todd C.; Dietz, Rune; Sonne, Christian; Iverson, Sara J.; Peacock, Elizabeth

2014-01-01

Body condition is a key indicator of individual and population health. Yet, there is little consensus as to the most appropriate condition index (CI), and most of the currently used CIs have not been thoroughly validated and are logistically challenging. Adipose samples from large datasets of capture biopsied, remote biopsied, and harvested polar bears were used to validate adipose lipid content as a CI via tests of accuracy, precision, sensitivity, biopsy depth, and storage conditions and comparisons to established CIs, to measures of health and to demographic and ecological parameters. The lipid content analyses of even very small biopsy samples were highly accurate and precise, but results were influenced by tissue depth at which the sample was taken. Lipid content of capture biopsies and samples from harvested adult females was correlated with established CIs and/or conformed to expected biological variation and ecological changes. However, lipid content of remote biopsies was lower than capture biopsies and harvested samples, possibly due to lipid loss during dart retrieval. Lipid content CI is a biologically relevant, relatively inexpensive and rapidly assessed CI and can be determined routinely for individuals and populations in order to infer large-scale spatial and long-term temporal trends. As it is possible to collect samples during routine harvesting or remotely using biopsy darts, monitoring and assessment of body condition can be accomplished without capture and handling procedures or noninvasively, which are methods that are preferred by local communities. However, further work is needed to apply the method to remote biopsies.

The Nursing Diagnosis Development of Unemployment Disorder: Content Validation With Nursing Experts.

Science.gov (United States)

Bocchino, Anna; Medialdea, María Jesús; Lepiani, Isabel; Mejías, Concepción; Dueñas, María

2017-10-01

This study aimed to validate the definition and define the characteristics and related factors of unemployment disorder, a proposed nursing diagnosis. Using Fehring's diagnostic content validity model, Spanish experts were asked to assess the adequacy of the label, defining the characteristics and other related factors. The content validity index was 0.8690. A total of 16 defining characteristics reached major criteria (>0.80). The present study supports the proposed development of a nursing diagnosis for the human response to unemployment. The results suggest that the inclusion of the "unemployment disorder" diagnostic NANDA-I taxonomy would allow nursing professionals to identify the disorder and its causes and manifestations, and therefore provide the information needed for planning more relevant interventions and results. Validación de la definición, características definitorias y factores relacionados de trastorno por desempleo, una propuesta de diagnóstico enfermero. METODOLOGÍA: Usando el modelo de validación de contenido de Fehring, se consensuó mediante expertos españoles la denominación de la etiqueta, las características definitorias y otros factores relacionados. El índice de validez de contenido global fue 0.8690. Un total de 16 características definitorias alcanzaron carácter crítico (>0.80). CONCLUSIÓN: El presente estudio apoya la propuesta de elaborar un diagnóstico de enfermería para la respuesta humana al desempleo. IMPLICACIONES PRÁCTICAS: Los resultados obtenidos sugieren que la inclusión en la taxonomía NANDA-I del diagnóstico "trastorno por desempleo" permitiría a los profesionales de enfermería identificar el problema, sus causas y manifestaciones, y por lo tanto ofrecerían la información necesaria para planificar las intervenciones y resultados más pertinentes. © 2016 NANDA International, Inc.

Development of a golf-specific load monitoring tool: Content validity and feasibility.

Science.gov (United States)

Williams, Scott B; Gastin, Paul B; Saw, Anna E; Robertson, Sam

2018-05-01

Athletes often record details of their training and competitions, supported by information such as environmental conditions, travel, as well as how they felt. However, it is not known how prevalent these practices are in golfers, or how valuable this process is perceived. The purpose of this study was to develop a golf-specific load monitoring tool (GLMT), and establish the content validity and feasibility of this tool amongst high-level golfers. In the first phase of development, 21 experts were surveyed to determine the suitability of items for inclusion in the GLMT. Of the 36 items, 21 received >78% agreement, a requirement to establish content validity and for inclusion in the GLMT. Total duration was the preferred metric for golf-specific activities, whilst rating of perceived exertion (RPE) was preferred for measuring physical training. In the second phase, feasibility of the tool was assessed by surveying 13 high-level male golfers following 28-days of daily GLMT use. All items included in the GLMT were deemed feasible to record, with all players participating in the feasibility study providing high to very high ratings. Golfers responded that they would consider using a load monitoring tool of this nature long term, provided it can be completed in less than five minutes per day.

Validation of the MMPI-2 Low Self-Esteem Content Scale.

Science.gov (United States)

Brems, C; Lloyd, P

1995-12-01

We explored the concurrent validity of the MMPI-2 Low Self-Esteem (LSE) Content scale by asking 216 undergraduate students to complete the Minnesota Multiphasic Personality Inventory-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1991), Harter Adult Self-Perception Profile (Harter, 1986a) and Rosenberg Self-Esteem Scale (Rosenberg, 1965). Results suggest the LSE renders a good assessment of global self-esteem as well as being a measure of three distinct components of self-esteem. These specific subscales, identified by factor analysis, were labeled Ineptitude, Negative Self-Value, and Negative Comparison with Others. The LSE and its subscales produced good internal consistency (alpha and Gutman Split Half) coefficients.

An evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool): Concurrent, face and content validity.

Science.gov (United States)

De Groef, An; Van Kampen, Marijke; Moortgat, Peter; Anthonissen, Mieke; Van den Kerckhove, Eric; Christiaens, Marie-Rose; Neven, Patrick; Geraerts, Inge; Devoogdt, Nele

2018-01-01

To investigate the concurrent, face and content validity of an evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool). 1) Concurrent validity of the MAP-BC evaluation tool was investigated by exploring correlations (Spearman's rank Correlation Coefficient) between the subjective scores (0 -no adhesions to 3 -very strong adhesions) of the skin level using the MAP-BC evaluation tool and objective elasticity parameters (maximal skin extension and gross elasticity) generated by the Cutometer Dual MPA 580. Nine different examination points on and around the mastectomy scar were evaluated. 2) Face and content validity were explored by questioning therapists experienced with myofascial therapy in breast cancer patients about the comprehensibility and comprehensiveness of the MAP-BC evaluation tool. 1) Only three meaningful correlations were found on the mastectomy scar. For the most lateral examination point on the mastectomy scar a moderate negative correlation (-0.44, p = 0.01) with the maximal skin extension and a moderate positive correlation with the resistance versus ability of returning or 'gross elasticity' (0.42, p = 0.02) were found. For the middle point on the mastectomy scar an almost moderate positive correlation with gross elasticity was found as well (0.38, p = 0.04) 2) Content and face validity have been found to be good. Eighty-nine percent of the respondent found the instructions understandable and 98% found the scoring system obvious. Thirty-seven percent of the therapists suggested to add the possibility to evaluate additional anatomical locations in case of reconstructive and/or bilateral surgery. The MAP-BC evaluation tool for myofascial adhesions in breast cancer patients has good face and content validity. Evidence for good concurrent validity of the skin level was found only on the mastectomy scar itself.

Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers.

Directory of Open Access Journals (Sweden)

Helena Larsson

Full Text Available The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI was calculated for each work task. The result showed excellent CVI (≥0.78 for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test, dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99 for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82-0.96 with an acceptable standard error of mean (SEM, except for the side-bridge test (SEM%>15. Thus, the final suggested test battery for a valid and reliable evaluation of soldiers' muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload.

Content validation of an instrument of evaluation of body scheme for blind children

Directory of Open Access Journals (Sweden)

Patricia Santos de Oliveira

2012-11-01

Full Text Available The aim of this study was to describe the process of content validation of an instrument of evaluation of Body Scheme for children with congenital blindness with aged between 6 and 9 years old. The population was composed of seven judges who received a first version of the instrument, they analyzed each item in the categories, clarity of language, theoretical pertinence, viability of application, and adequacy of construction. Item 1 – “Exploring the body” obtained 80% agreement; item 2 – “Playing getting dressed” received 70% agreement; item 3 – “Imitating gestures” 60% agreement; item 4 – “Puzzle” 75% agreement. It was adopted as a criterion of permanence in the proof at least 80% agreement. The item 1 remained as it was in the first version; item 2 was excluded and items 3 and 4 were modified. Based on the suggestions of the judges and the rate of agreement, a second version of the instrument composed of three items was elaborated. It was possible to consider the changes suggested by the judges were important to ensure the content validity of the instrument.

Cultural and ethnic differences in content validation responses.

Science.gov (United States)

Evans, Bronwynne C

2004-04-01

Eight instruments to evaluate grant interventions aimed at increasing recruitment and retention of Hispanic/Latino and American Indian nurses were developed for a Nursing Workforce Diversity Grant. This article compares expert reviewer responses during content validation of these instruments with (a) current literature and (b) seven filmed intervals of Hispanic/Latino and American Indian nurses speaking about their educational experiences. White reviewers responded differently to certain items than did Hispanic/Latino and American Indian reviewers (or reviewers closely affiliated with such persons). Responses of Hispanic/Latino and American Indian experts were aligned with one another but not aligned with the responses of White experts, who also agreed with one another, prompting literature and film comparisons with their responses. Faculty development may be needed to help teachers uncover their assumptions about students of color, acquire knowledge about cultural perspectives, recognize institutional racism, and attain the skills necessary to develop and implement a curriculum of inclusion.

Content validation of a standardized algorithm for ostomy care.

Science.gov (United States)

Beitz, Janice; Gerlach, Mary; Ginsburg, Pat; Ho, Marianne; McCann, Eileen; Schafer, Vickie; Scott, Vera; Stallings, Bobbie; Turnbull, Gwen

2010-10-01

The number of ostomy care clinician experts is limited and the majority of ostomy care is provided by non-specialized clinicians or unskilled caregivers and family. The purpose of this study was to obtain content validation data for a new standardized algorithm for ostomy care developed by expert wound ostomy continence nurse (WOCN) clinicians. After face validity was established using overall review and suggestions from WOCN experts, 166 WOCNs self-identified as having expertise in ostomy care were surveyed online for 6 weeks in 2009. Using a cross-sectional, mixed methods study design and a 30-item instrument with a 4-point Likert-type scale, the participants were asked to quantify the degree of validity of the Ostomy Algorithm's decisions and components. Participants' open-ended comments also were thematically analyzed. Using a scale of 1 to 4, the mean score of the entire algorithm was 3.8 (4 = relevant/very relevant). The algorithm's content validity index (CVI) was 0.95 (out of 1.0). Individual component mean scores ranged from 3.59 to 3.91. Individual CVIs ranged from 0.90 to 0.98. Qualitative data analysis revealed themes of difficulty associated with algorithm formatting, especially orientation and use of the Studio Alterazioni Cutanee Stomali (Study on Peristomal Skin Lesions [SACS™ Instrument]) and the inability of algorithms to capture all individual patient attributes affecting ostomy care. Positive themes included content thoroughness and the helpful clinical photos. Suggestions were offered for algorithm improvement. Study results support the strong content validity of the algorithm and research to ascertain its construct validity and effect on care outcomes is warranted.

Adaptation and content validity by expert judgment of the Oral Health Impact Profile applied to Periodontal Disease.

Directory of Open Access Journals (Sweden)

Norma Idalia Rodríguez

2017-04-01

Full Text Available Background: In Mexico, there is no available instrument based on a biopsychosocial model to evaluate the impact of periodontal disease on oral health-related quality of life (OHRQL. The Oral Health Impact Profile (OHIP-14 was developed in Australia and the United States based on the same model and can be adapted to evaluate the impact of periodontal disease on OHRQL. Objectives: To adapt the OHIP-14 questions to periodontal disease evaluation and validate the content of this new instrument. Materials and Methods: One expert in periodontics and one expert in health psychology adapted the OHIP-14 to evaluate the impact of periodontal disease on OHRQL, creating the Oral Health Impact Profile applied to Periodontal Disease (OHIP-14-PD. Using the format proposed by Escobar and Cuervo, five experts in periodontics and public health performed the OHIP-14-PD content validation. Results: Item 7 had a compliance rate of 80% for clarity, and the other items, a compliance rate of 100%, for clarity, sufficiency, coherence and relevance. The kappa coefficient showed perfect agreement for items 1 to 6 (k= 1 and 8 to 14, and very high agreement for item 7 (k= 0.967. Conclusion: The OHIP-14-PD shows content validity.

Program of neuropsychological stimulation of cognition in students: Emphasis on executive functions - development and evidence of content validity

Directory of Open Access Journals (Sweden)

Caroline de Oliveira Cardoso

Full Text Available ABSTRACT Objective: The goal of this study was to describe the construction process and content validity evidence of an early and preventive intervention program for stimulating executive functions (EF in Elementary School children within the school environment. Methods: The process has followed the recommended steps for creating neuropsychological instruments: internal phase of program organization, with literature search and analyses of available materials in the classroom; program construction; analysis by expert judges; data integration and program finalization. To determine the level of agreement among the judges, a Content Validity Index (CVI was calculated. Results: Content validity was evidenced by the agreement among the experts with regards to the program, both in general and for each activity. All steps taken were deemed necessary because they contributed to the identification of positive aspects and possible flaws in the process Conclusion: The steps also helped to adapt stimuli and improve program tasks and activities. Methodological procedures implemented in this study can be adopted by other researchers to create or adapt neuropsychological stimulation and rehabilitation programs. Furthermore, the methodological approach allows the reader to understand, in detail, the technical and scientific rigor adopted in devising this program.

The Nursing Diagnosis of risk for pressure ulcer: content validation.

Science.gov (United States)

Santos, Cássia Teixeira Dos; Almeida, Miriam de Abreu; Lucena, Amália de Fátima

2016-06-14

to validate the content of the new nursing diagnosis, termed risk for pressure ulcer. the content validation with a sample made up of 24 nurses who were specialists in skin care from six different hospitals in the South and Southeast of Brazil. Data collection took place electronically, through an instrument constructed using the SurveyMonkey program, containing a title, definition, and 19 risk factors for the nursing diagnosis. The data were analyzed using Fehring's method and descriptive statistics. The project was approved by a Research Ethics Committee. title, definition and seven risk factors were validated as "very important": physical immobilization, pressure, surface friction, shearing forces, skin moisture, alteration in sensation and malnutrition. Among the other risk factors, 11 were validated as "important": dehydration, obesity, anemia, decrease in serum albumin level, prematurity, aging, smoking, edema, impaired circulation, and decrease in oxygenation and in tissue perfusion. The risk factor of hyperthermia was discarded. the content validation of these components of the nursing diagnosis corroborated the importance of the same, being able to facilitate the nurse's clinical reasoning and guiding clinical practice in the preventive care for pressure ulcers. validar o conteúdo do novo diagnóstico de enfermagem, denominado risco de úlcera por pressão. trata-se de uma validação de conteúdo, com amostra composta por 24 enfermeiros especialistas no cuidado à pele, procedentes de seis diferentes hospitais do Sul e Sudeste brasileiro. A coleta de dados ocorreu por meio eletrônico, em instrumento construído pelo programa SurveyMonkey, que continha título, definição e 19 fatores de risco para o diagnóstico de enfermagem. Os dados foram analisados pelo método de Fehring e pela estatística descritiva. O projeto foi aprovado em Comitê de Ética em Pesquisa. título, definição e sete fatores de risco foram validados como "muito importante

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

Science.gov (United States)

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Development and content validation of a questionnaire to assess moral distress among social workers in long-term care facilities.

Science.gov (United States)

Lev, Sagit; Ayalon, Liat

2018-03-01

Despite the significance of ethical issues faced by social workers, research on moral distress among social workers has been extremely limited. The aim of the current study is to describe the development and content validation of a unique questionnaire to measure moral distress among social workers in long-term care facilities for older adults in Israel. The construction of the questionnaire was based on a secondary analysis of a qualitative study that addressed the moral dilemma of social workers in nursing homes in Israel. A content validation included review and evaluation by two experts, a cognitive interview with a nursing home social worker, and three focus groups of experts and the target population. The initial questionnaire consisted of 25 items. After the content validation process the questionnaire in its final version, consisted of 17 items and included two scales, measuring the frequency of morally loaded events and the intensity of distress that followed them. We believe that the questionnaire can contribute by broadening and deepening ethics discourse and research, with regard to social workers' obligation dilemmas and conflicts.

Reliability and validity in a nutshell.

Science.gov (United States)

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

Serial album validation for promotion of infant body weight control

Directory of Open Access Journals (Sweden)

Nathalia Costa Gonzaga Saraiva

2018-05-01

Full Text Available ABSTRACT Objective: to validate the content and appearance of a serial album for children aged from 7 to 10 years addressing the topic of prevention and control of body weight. Method: methodological study with descriptive nature. The validation process was attended by 33 specialists in educational technologies and/or in excess of infantile weight. The agreement index of 80% was the minimum considered to guarantee the validation of the material. Results: most of the specialists had a doctoral degree and a graduate degree in nursing. Regarding content, illustrations, layout and relevance, all items were validated and 69.7% of the experts considered the album as great. The overall agreement validation index for the educational technology was 0.88. Only the script-sheet 3 did not reach the cutoff point of the content validation index. Changes were made to the material, such as title change, inclusion of the school context and insertion of nutritionist and physical educator in the story narrated in the album. Conclusion: the proposed serial album was considered valid by experts regarding content and appearance, suggesting that this technology has the potential to contribute in health education by promoting healthy weight in the age group of 7 to 10 years.

Development and content validity of a patient reported outcomes measure to assess symptoms of major depressive disorder

Directory of Open Access Journals (Sweden)

Lasch Kathryn

2012-04-01

Full Text Available Abstract Background Although many symptoms of Major Depressive Disorder (MDD are assessed through patient-report, there are currently no patient-reported outcome (PRO instruments that incorporate documented evidence of patient input in PRO instrument development. A review of existing PROs used in MDD suggested the need to conduct qualitative research with patients with MDD to better understand their experience of MDD and develop an evaluative instrument with content validity. The aim of this study was to develop a disease-specific questionnaire to assess symptoms important and relevant to adult MDD patients. Methods The questionnaire development involved qualitative interviews for concept elicitation, instrument development, and cognitive interviews to support content validity. For concept elicitation, ten MDD severity-specific focus group interviews with thirty-eight patients having clinician-confirmed diagnoses of MDD were conducted in January 2009. A semi-structured discussion guide was used to elicit patients' spontaneous descriptions of MDD symptoms. Verbatim transcripts of focus groups were coded and analyzed to develop a conceptual framework to describe MDD. A PRO instrument was developed by operationalizing concepts elicited in the conceptual framework. Cognitive interviews were carried out in patients (n = 20 to refine and test the content validity of the instrument in terms of item relevance and comprehension, instructions, recall period, and response categories. Results Concept elicitation focus groups identified thirty-five unique concepts falling into several domains: i emotional, ii cognitive, iii motivation, iv work, v sleep, vi appetite, vii social, viii activities of daily living, ix tired/fatigue, x body pain, and xi suicidality. Concept saturation, the point at which no new relevant information emerges in later interviews, was achieved for each of the concepts. Based on the qualitative findings, the PRO instrument developed

Scale for Assessment of Giftedness - teacher's version: evidence of validity content

Directory of Open Access Journals (Sweden)

Tatiana de Cassia Nakano

2016-07-01

Full Text Available The assessment of high abilities is of great importance in psychology, despite scarce studies in literature. Therefore, the aim of this study was to verify, through content validity, the appropriateness of the items of the High Assessment Scale Skills - Teacher Version. The judges were six post-graduate students in the psychological assessment area who rated the 41 items of the instrument in six factors (academic intellectual ability, specific academic skills, leadership, creativity, artistic talent. The results demonstrated the suitability of the items, most of them with concordance rates above 80% (n = 29 and between 60 and 80% (n = 8. Only four items showed agreement at or below 50%, suggesting the need for reformulation. The analysis of the Kappa coefficients showed indices between 0.69 and 0.81. In general, the results indicated the suitability of the scale to the contents of the pretended model.

Content Validity of the ADHD Rating Scale (ADHD RS-IV and Adult ADHD Self-Report Scale (ASRS in Phenylketonuria

Directory of Open Access Journals (Sweden)

Kathleen W. Wyrwich PhD

2016-03-01

Full Text Available The ADHD Rating Scale (ADHD RS-IV; parent report and Adult ADHD Self-Rating Scale (ASRS; self-report are validated instruments for measuring symptoms of attention-deficit/hyperactivity disorder (ADHD. The objectives of this study were to elicit descriptions of phenylketonuria (PKU symptoms and assess content validity of these instruments in PKU. Parents (N = 15 of children with PKU (≥8 years old and adults with PKU (N=13 described PKU-related symptoms and commented on the scale’s clarity, comprehensiveness, and relevance to their experience with PKU. Most of the adults (84.6% and all of the children were on a phenylalanine-restricted diet, according to respondent report. The inattentiveness symptoms reported by participants mapped to the inattentive items of the questionnaires. Most participants felt the inattentive items were clear and relevant to their experience. Despite study design limitations, these results demonstrate the relevance of assessing inattentiveness in PKU, and both instruments achieved content validity for inattentive subscale items.

The Danish anal sphincter rupture questionnaire: Validity and reliability

DEFF Research Database (Denmark)

Due, Ulla; Ottesen, Marianne

2008-01-01

Objective. To revise, validate and test for reliability an anal sphincter rupture questionnaire in relation to construct, content and face validity. Setting and background. Since 1996 women with anal sphincter rupture (ASR) at one of the public university hospitals in Copenhagen, Denmark have been...... main questions but one. Two questions needed further explanation. Seven women made minor errors. Conclusion. The validated Danish questionnaire has a good construct, content and face validity. It is a well accepted, reliable, simple and clinically relevant screening tool. It reveals physical problems...... offered pelvic floor muscle examination and instruction by a specialist physiotherapist. In relation to that, a non-validated questionnaire about anal and urinary incontinence was to be answered six months after childbirth. Method. The original questionnaire was revised and a pilot test was performed...

Development and validation of climate change system thinking instrument (CCSTI) for measuring system thinking on climate change content

Science.gov (United States)

Meilinda; Rustaman, N. Y.; Firman, H.; Tjasyono, B.

2018-05-01

The Climate Change System Thinking Instrument (CCSTI) is developed to measure a system thinking ability in the concept of climate change. CCSTI is developed in four phase’s development including instrument draft development, validation and evaluation including readable material test, expert validation, and field test. The result of field test is analyzed by looking at the readability score in Cronbach’s alpha test. Draft instrument is tested on college students majoring in Biology Education, Physics Education, and Chemistry Education randomly with a total number of 80 college students. Score of Content Validation Index at 0.86, which means that the CCSTI developed are categorized as very appropriate with question indicators and Cronbach’s alpha about 0.605 which mean categorized undesirable to minimal acceptable. From 45 questions of system thinking, there are 37 valid questions spread in four indicators of system thinking, which are system thinking phase I (pre-requirement), system thinking phase II (basic), system thinking phase III (intermediate), and system thinking phase IV (coherent expert).

Design for validation: An approach to systems validation

Science.gov (United States)

Carter, William C.; Dunham, Janet R.; Laprie, Jean-Claude; Williams, Thomas; Howden, William; Smith, Brian; Lewis, Carl M. (Editor)

1989-01-01

Every complex system built is validated in some manner. Computer validation begins with review of the system design. As systems became too complicated for one person to review, validation began to rely on the application of adhoc methods by many individuals. As the cost of the changes mounted and the expense of failure increased, more organized procedures became essential. Attempts at devising and carrying out those procedures showed that validation is indeed a difficult technical problem. The successful transformation of the validation process into a systematic series of formally sound, integrated steps is necessary if the liability inherent in the future digita-system-based avionic and space systems is to be minimized. A suggested framework and timetable for the transformtion are presented. Basic working definitions of two pivotal ideas (validation and system life-cyle) are provided and show how the two concepts interact. Many examples are given of past and present validation activities by NASA and others. A conceptual framework is presented for the validation process. Finally, important areas are listed for ongoing development of the validation process at NASA Langley Research Center.

Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

Science.gov (United States)

Erkin, Özüm; Göl, İlknur

2018-04-01

This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

Development and initial validity of the in-hand manipulation assessment.

Science.gov (United States)

Klymenko, Gabrielle; Liu, Karen P Y; Bissett, Michelle; Fong, Kenneth N K; Welage, Nandana; Wong, Rebecca S M

2018-04-01

A review of the literature related to in-hand manipulation (IHM) revealed that there is no assessment which specifically measures this construct in the adult population. This study reports the face and content validity of an IHM assessment for adults with impaired hand function based on expert opinion. The definition of IHM skills, assessment tasks and scoring methods identified from literature was discussed in a focus group (n = 4) to establish face validity. An expert panel (n = 16) reviewed the content validity of the proposed assessment; evaluating the representativeness and relevance of encompassing the IHM skills in the proposed assessment tasks, the clarity and importance to daily life of the task and the clarity and applicability to clinical environment of the scoring method. The content validity was calculated using the content validity index for both the individual task and all tasks together (I-CVI and S-CVI). Feedback was incorporated to create the assessment. The focus group members agreed to include 10 assessment tasks that covered all IHM skills. In the expert panel review, all tasks received an I-CVI above 0.78 and S-CVI above 0.80 in representativeness and relevance ratings, representing good content validity. With the comments from the expert panel, tasks were modified to improve the clarity and importance to daily life. A four-point Likert scale was identified for assessing both the completion of the assessment tasks and the quality of IHM skills within the task performance. Face and content validity were established in this new IHM assessment. Further studies to examine psychometric properties and use within clinical practice are recommended. © 2018 Occupational Therapy Australia.

Construct validity of adolescents' self-reported big five personality traits: importance of conceptual breadth and initial validation of a short measure.

Science.gov (United States)

Morizot, Julien

2014-10-01

While there are a number of short personality trait measures that have been validated for use with adults, few are specifically validated for use with adolescents. To trust such measures, it must be demonstrated that they have adequate construct validity. According to the view of construct validity as a unifying form of validity requiring the integration of different complementary sources of information, this article reports the evaluation of content, factor, convergent, and criterion validities as well as reliability of adolescents' self-reported personality traits. Moreover, this study sought to address an inherent potential limitation of short personality trait measures, namely their limited conceptual breadth. In this study, starting with items from a known measure, after the language-level was adjusted for use with adolescents, items tapping fundamental primary traits were added to determine the impact of added conceptual breadth on the psychometric properties of the scales. The resulting new measure was named the Big Five Personality Trait Short Questionnaire (BFPTSQ). A group of expert judges considered the items to have adequate content validity. Using data from a community sample of early adolescents, the results confirmed the factor validity of the Big Five structure in adolescence as well as its measurement invariance across genders. More important, the added items did improve the convergent and criterion validities of the scales, but did not negatively affect their reliability. This study supports the construct validity of adolescents' self-reported personality traits and points to the importance of conceptual breadth in short personality measures. © The Author(s) 2014.

Educational testing validity and reliability in pharmacy and medical education literature.

Science.gov (United States)

Hoover, Matthew J; Jung, Rose; Jacobs, David M; Peeters, Michael J

2013-12-16

To evaluate and compare the reliability and validity of educational testing reported in pharmacy education journals to medical education literature. Descriptions of validity evidence sources (content, construct, criterion, and reliability) were extracted from articles that reported educational testing of learners' knowledge, skills, and/or abilities. Using educational testing, the findings of 108 pharmacy education articles were compared to the findings of 198 medical education articles. For pharmacy educational testing, 14 articles (13%) reported more than 1 validity evidence source while 83 articles (77%) reported 1 validity evidence source and 11 articles (10%) did not have evidence. Among validity evidence sources, content validity was reported most frequently. Compared with pharmacy education literature, more medical education articles reported both validity and reliability (59%; particles in pharmacy education compared to medical education, validity, and reliability reporting were limited in the pharmacy education literature.

Identification and validation of quantitative trait loci for seed yield, oil and protein contents in two recombinant inbred line populations of soybean.

Science.gov (United States)

Wang, Xianzhi; Jiang, Guo-Liang; Green, Marci; Scott, Roy A; Song, Qijian; Hyten, David L; Cregan, Perry B

2014-10-01

Soybean seeds contain high levels of oil and protein, and are the important sources of vegetable oil and plant protein for human consumption and livestock feed. Increased seed yield, oil and protein contents are the main objectives of soybean breeding. The objectives of this study were to identify and validate quantitative trait loci (QTLs) associated with seed yield, oil and protein contents in two recombinant inbred line populations, and to evaluate the consistency of QTLs across different environments, studies and genetic backgrounds. Both the mapping population (SD02-4-59 × A02-381100) and validation population (SD02-911 × SD00-1501) were phenotyped for the three traits in multiple environments. Genetic analysis indicated that oil and protein contents showed high heritabilities while yield exhibited a lower heritability in both populations. Based on a linkage map constructed previously with the mapping population and using composite interval mapping and/or interval mapping analysis, 12 QTLs for seed yield, 16 QTLs for oil content and 11 QTLs for protein content were consistently detected in multiple environments and/or the average data over all environments. Of the QTLs detected in the mapping population, five QTLs for seed yield, eight QTLs for oil content and five QTLs for protein content were confirmed in the validation population by single marker analysis in at least one environment and the average data and by ANOVA over all environments. Eight of these validated QTLs were newly identified. Compared with the other studies, seven QTLs for seed yield, eight QTLs for oil content and nine QTLs for protein content further verified the previously reported QTLs. These QTLs will be useful for breeding higher yield and better quality cultivars, and help effectively and efficiently improve yield potential and nutritional quality in soybean.

Construct Validity and Case Validity in Assessment

Science.gov (United States)

Teglasi, Hedwig; Nebbergall, Allison Joan; Newman, Daniel

2012-01-01

Clinical assessment relies on both "construct validity", which focuses on the accuracy of conclusions about a psychological phenomenon drawn from responses to a measure, and "case validity", which focuses on the synthesis of the full range of psychological phenomena pertaining to the concern or question at hand. Whereas construct validity is…

Determining the Feasibility, Content Validity, and Internal Consistency of a Newly Developed Care Coordination Scale for People with Brain Injury

Directory of Open Access Journals (Sweden)

Brian P. Johnson

2017-07-01

Full Text Available Background: With the increasing complexity of care, people with disabilities and supportive significant others (SSO must often coordinate key aspects of their own care, but no validated scale currently exists to comprehensively characterize the activities done to manage and coordinate their care. Method: This study aimed to improve the feasibility, acceptability, and content validity of the Care and Service Coordination and Management (CASCAM scale and to test its internal consistency. Questionnaire items were administered to 23 individuals with acquired brain injury and 17 SSO. Results: Respondents confirmed content validity and that the instrument addresses important care coordination and management issues. The internal consistency of care coordination domains for medical/ rehabilitative and independent living needs for people with brain injury and their SSO ranged from α = .774 to .945. Conclusion: Care coordination activities by persons with disabilities, including brain injury, and their SSO are multifaceted but feasibly measurable and should be assessed to improve care.

Brief Assessment of Motor Function: Content Validity and Reliability of the Upper Extremity Gross Motor Scale

Science.gov (United States)

Cintas, Holly Lea; Parks, Rebecca; Don, Sarah; Gerber, Lynn

2011-01-01

Content validity and reliability of the Brief Assessment of Motor Function (BAMF) Upper Extremity Gross Motor Scale (UEGMS) were evaluated in this prospective, descriptive study. The UEGMS is one of five BAMF ordinal scales designed for quick documentation of gross, fine, and oral motor skill levels. Designed to be independent of age and…

How valid are commercially available medical simulators?

Science.gov (United States)

Stunt, JJ; Wulms, PH; Kerkhoffs, GM; Dankelman, J; van Dijk, CN; Tuijthof, GJM

2014-01-01

Background Since simulators offer important advantages, they are increasingly used in medical education and medical skills training that require physical actions. A wide variety of simulators have become commercially available. It is of high importance that evidence is provided that training on these simulators can actually improve clinical performance on live patients. Therefore, the aim of this review is to determine the availability of different types of simulators and the evidence of their validation, to offer insight regarding which simulators are suitable to use in the clinical setting as a training modality. Summary Four hundred and thirty-three commercially available simulators were found, from which 405 (94%) were physical models. One hundred and thirty validation studies evaluated 35 (8%) commercially available medical simulators for levels of validity ranging from face to predictive validity. Solely simulators that are used for surgical skills training were validated for the highest validity level (predictive validity). Twenty-four (37%) simulators that give objective feedback had been validated. Studies that tested more powerful levels of validity (concurrent and predictive validity) were methodologically stronger than studies that tested more elementary levels of validity (face, content, and construct validity). Conclusion Ninety-three point five percent of the commercially available simulators are not known to be tested for validity. Although the importance of (a high level of) validation depends on the difficulty level of skills training and possible consequences when skills are insufficient, it is advisable for medical professionals, trainees, medical educators, and companies who manufacture medical simulators to critically judge the available medical simulators for proper validation. This way adequate, safe, and affordable medical psychomotor skills training can be achieved. PMID:25342926

Content Validity of Game-based Assessment: Case study of a Serious Game for ICT managers in training

NARCIS (Netherlands)

Hummel, Hans; Joosten-ten Brinke, Desirée; Nadolski, Rob; Baartman, Liesbeth

2017-01-01

Serious games foster the acquisition of complex problem solving skills. Assessment of such skills should be in line with instruction, and within a serious game environment its content validity should equal face-to-face assessment. Research on assessment in serious gaming has remained rather

Content validity of game-based assessment : Case study of a serious game for ict managers in training

NARCIS (Netherlands)

Hans Hummel; Rob Nadolski; Dr. Desiree Joosten-ten Brinke; Dr. Liesbeth Baartman

2017-01-01

Serious games foster the acquisition of complex problem-solving skills. Assessment of such skills should be in line with instruction, and within a serious game environment its content validity should equal face-to-face assessment. Research on assessment in serious gaming has remained rather scarce.

Instructional Support System--Occupational Education II. ISSOE Automotive Mechanics Content Validation.

Science.gov (United States)

Abramson, Theodore

A study was conducted to validate the Instructional Support System-Occupational Education (ISSOE) automotive mechanics curriculum. The following four steps were undertaken: (1) review of the ISSOE materials in terms of their "validity" as task statements; (2) a comparison of the ISSOE tasks to the tasks included in the V-TECS Automotive…

A Delphi Study and Initial Validation of Counselor Supervision Competencies

Science.gov (United States)

Neuer Colburn, Anita A.; Grothaus, Tim; Hays, Danica G.; Milliken, Tammi

2016-01-01

The authors addressed the lack of supervision training standards for doctoral counseling graduates by developing and validating an initial list of supervision competencies. They used content analysis, Delphi polling, and content validity methods to generate a list, vetted by 2 different panels of supervision experts, of 33 competencies grouped…

Face and content validation of a novel three-dimensional printed temporal bone for surgical skills development.

Science.gov (United States)

Da Cruz, M J; Francis, H W

2015-07-01

To assess the face and content validity of a novel synthetic, three-dimensional printed temporal bone for surgical skills development and training. A synthetic temporal bone was printed using composite materials and three-dimensional printing technology. Surgical trainees were asked to complete three structured temporal bone dissection exercises. Attitudes and impressions were then assessed using a semi-structured questionnaire. Previous cadaver and real operating experiences were used as a reference. Trainees' experiences of the synthetic temporal bone were analysed in terms of four domains: anatomical realism, usefulness as a training tool, task-based usefulness and overall reactions. Responses across all domains indicated a high degree of acceptance, suggesting that the three-dimensional printed temporal bone was a useful tool in skills development. A sophisticated three-dimensional printed temporal bone that demonstrates face and content validity was developed. The efficiency in cost savings coupled with low associated biohazards make it likely that the printed temporal bone will be incorporated into traditional temporal bone skills development programmes in the near future.

Validation of methods for determination of free water content in poultry meat

Directory of Open Access Journals (Sweden)

Jarmila Žítková

2007-01-01

Full Text Available Methods for determination of free water content in poultry meat are described in Commission Regulation EEC No 1538/91 as amended and in ČSN 57 3100. Two of them (method A and D have been validated in conditions of a Czech poultry processing plant. The capacity of slaughtering was 6000 pieces per hour and carcasses were chilled by air with spraying. All determinations were carried out in the plant’s lab and in the lab of the Institute of Food Technology. Method A was used to detect the amount of water lost from frozen chicken during thawing in controlled conditions. Twenty carcasses from six weight groups (900 g–1400 g were tested. The average values of thaw loss water contents ranged between 0.46% and 1.71%, the average value of total 120 samples was 1.16%. The results were compared with the required maximum limit value of 3.3%. The water loss content was in negative correlation with the weight of chicken (r = –0.56. Method D (chemical test has been applied to determine the total water content of certain poultry cuts. It involved the determination of water and protein contents of 62 representative samples in total. The average values of ratio of water weight to proteins weight WA/RPA were in breast fillets 3.29, in legs with a portion of the back 4.06, legs 4.00, thighs 3.85 and drumsticks 4.10. The results corresponded to the required limit values for breast fillets 3.40 and for leg cuts 4.15. The ratio of water weight to proteins weight WA/RPA was correlated with the weight of chicken for breast fillets negatively (r = –0.61 and for leg cuts positively (r = 0.70. Different correlations can be explained by the distribution of water, protein and fat in carcasses. The evaluation of methods in the parameter of percentage ratio of the average value to the limit showed that method D (results were at the level of 97% of the limit was more exact than method A (results were at the level 32% of the limit but it is more expensive. Both methods

Explicating Validity

Science.gov (United States)

Kane, Michael T.

2016-01-01

How we choose to use a term depends on what we want to do with it. If "validity" is to be used to support a score interpretation, validation would require an analysis of the plausibility of that interpretation. If validity is to be used to support score uses, validation would require an analysis of the appropriateness of the proposed…

Content Validity of the Hypogonadism Impact of Symptoms Questionnaire (HIS-Q): A Patient-Reported Outcome Measure to Evaluate Symptoms of Hypogonadism.

Science.gov (United States)

Gelhorn, Heather L; Vernon, Margaret K; Stewart, Katie D; Miller, Michael G; Brod, Meryl; Althof, Stanley E; DeRogatis, Leonard R; Dobs, Adrian; Seftel, Allen D; Revicki, Dennis A

2016-04-01

Hypogonadism, or low testosterone, is a common disorder. There are currently no patient-reported outcome (PRO) instruments designed to comprehensively evaluate the symptoms of hypogonadism and to detect changes in these symptoms in response to treatment. The purpose of this study was to develop a PRO instrument, the Hypogonadism Impact of Symptoms Questionnaire (HIS-Q) and to assess its content validity. A literature review, expert clinician input, and qualitative concept elicitation with 39 male hypogonadism patients (four focus groups: n = 25; individual interviews: n = 14; mean age 52.3 ± 14.3 years) from the USA were used to develop the draft HIS-Q. Subsequent cognitive interviews (n = 29; mean age 51.5 ± 15.4 years) were used to evaluate content validity. Emergent discussion with participants yielded symptoms within the sexual, physical, energy, sleep, cognition, and mood domains. Low libido and tiredness were most commonly reported. The initial version of the HIS-Q includes 53 items that were consistently understood by the participants, who found the instrument to be relevant to their experiences with hypogonadism and comprehensive in the content coverage of symptoms. The HIS-Q is a comprehensive PRO measure of hypogonadism symptom severity in males. Its design elements, including the response options and recall period, were suitable, and content validity was confirmed.

Validation of the prosthetic esthetic index

DEFF Research Database (Denmark)

Özhayat, Esben B; Dannemand, Katrine

2014-01-01

OBJECTIVES: In order to diagnose impaired esthetics and evaluate treatments for these, it is crucial to evaluate all aspects of oral and prosthetic esthetics. No professionally administered index currently exists that sufficiently encompasses comprehensive prosthetic esthetics. This study aimed...... to validate a new comprehensive index, the Prosthetic Esthetic Index (PEI), for professional evaluation of esthetics in prosthodontic patients. MATERIAL AND METHODS: The content, criterion, and construct validity; the test-retest, inter-rater, and internal consistency reliability; and the sensitivity...... furthermore distinguish between participants and controls, indicating sufficient sensitivity. CONCLUSION: The PEI is considered a valid and reliable instrument involving sufficient aspects for assessment of the professionally evaluated esthetics in prosthodontic patients. CLINICAL RELEVANCE...

How valid are commercially available medical simulators?

Directory of Open Access Journals (Sweden)

Stunt JJ

2014-10-01

Full Text Available JJ Stunt,1 PH Wulms,2 GM Kerkhoffs,1 J Dankelman,2 CN van Dijk,1 GJM Tuijthof1,2 1Orthopedic Research Center Amsterdam, Department of Orthopedic Surgery, Academic Medical Centre, Amsterdam, the Netherlands; 2Department of Biomechanical Engineering, Faculty of Mechanical, Materials and Maritime Engineering, Delft University of Technology, Delft, the Netherlands Background: Since simulators offer important advantages, they are increasingly used in medical education and medical skills training that require physical actions. A wide variety of simulators have become commercially available. It is of high importance that evidence is provided that training on these simulators can actually improve clinical performance on live patients. Therefore, the aim of this review is to determine the availability of different types of simulators and the evidence of their validation, to offer insight regarding which simulators are suitable to use in the clinical setting as a training modality. Summary: Four hundred and thirty-three commercially available simulators were found, from which 405 (94% were physical models. One hundred and thirty validation studies evaluated 35 (8% commercially available medical simulators for levels of validity ranging from face to predictive validity. Solely simulators that are used for surgical skills training were validated for the highest validity level (predictive validity. Twenty-four (37% simulators that give objective feedback had been validated. Studies that tested more powerful levels of validity (concurrent and predictive validity were methodologically stronger than studies that tested more elementary levels of validity (face, content, and construct validity. Conclusion: Ninety-three point five percent of the commercially available simulators are not known to be tested for validity. Although the importance of (a high level of validation depends on the difficulty level of skills training and possible consequences when skills are

Gaia Data Release 1. Catalogue validation

NARCIS (Netherlands)

Arenou, F.; Luri, X.; Babusiaux, C.; Fabricius, C.; Helmi, A.; Robin, A. C.; Vallenari, A.; Blanco-Cuaresma, S.; Cantat-Gaudin, T.; Findeisen, K.; Reylé, C.; Ruiz-Dern, L.; Sordo, R.; Turon, C.; Walton, N. A.; Shih, I.-C.; Antiche, E.; Barache, C.; Barros, M.; Breddels, M.; Carrasco, J. M.; Costigan, G.; Diakité, S.; Eyer, L.; Figueras, F.; Galluccio, L.; Heu, J.; Jordi, C.; Krone-Martins, A.; Lallement, R.; Lambert, S.; Leclerc, N.; Marrese, P. M.; Moitinho, A.; Mor, R.; Romero-Gómez, M.; Sartoretti, P.; Soria, S.; Soubiran, C.; Souchay, J.; Veljanoski, J.; Ziaeepour, H.; Giuffrida, G.; Pancino, E.; Bragaglia, A.

Context. Before the publication of the Gaia Catalogue, the contents of the first data release have undergone multiple dedicated validation tests. Aims: These tests aim to provide in-depth analysis of the Catalogue content in order to detect anomalies and individual problems in specific objects or in

What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling

Science.gov (United States)

Koller, Ingrid; Levenson, Michael R.; Glück, Judith

2017-01-01

The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. PMID:28270777

Development and Validation of a Theoretical Test in Endosonography for Pulmonary Diseases

DEFF Research Database (Denmark)

Savran, Mona M; Clementsen, Paul Frost; Annema, Jouke T

2014-01-01

evidence for this test. METHODS: Initially, 78 questions were constructed after informal conversational interviews with 4 international experts in endosonography. The clarity and content validity of the questions were tested using a Delphi-like approach. Construct validity was explored by administering......BACKGROUND: Theoretical testing provides the necessary foundation to perform technical skills. Additionally, testing improves the retention of knowledge. OBJECTIVES: The aims of this study were to develop a multiple-choice test in endosonography for pulmonary diseases and to gather validity...... consistently than the novices (p = 0.037) and the intermediates (p Validity evidence was gathered, and the test demonstrated content and construct validity....

Cross-cultural differences in the conceptualisation of patients' satisfaction with psychiatric services--content validity of the English version of the Verona Service Satisfaction Scale.

Science.gov (United States)

Henderson, Claire; Hales, Heidi; Ruggeri, Mirella

2003-03-01

The VSSS is a multi-dimensional questionnaire developed to address methodological concerns about measurement of satisfaction with services on the part of psychiatric patients. The acceptability, sensitivity, content validity and test-retest reliability of the original version of the VSSS, in Italian, have already been demonstrated [1, 2]. The internal consistency [3] and test-retest reliability [4] of the English translation have been shown to be within acceptable ranges. The content validity of the original 82-item and the 54-item English version has not yet been assessed. The aims of this study were to assess the content validity of the English translation of the VSSS and to compare it with that of the original version in Italian. We used data collected as part of the first wave (T1) of the PRiSM Psychosis Study [5] and repeated the methods used to assess the content validity of the original Italian version of the VSSS [1, 2]. Content elements derived from answers to four open questions were rated independently by CH and HH in terms of their equivalence to VSSS items or dimensions. were compared to those from the content validity study of the Italian version. Results Inter-rater agreement was very high. The largest proportion of the content elements of the answers were rated as equivalent or related to a questionnaire item or a dimension of the VSSS. The dimension 'Professionals' Skills and Behaviour' appears the most significant contributor to satisfaction, as it was most often related to content elements in answers to all four key questions (39.1 %). The second most frequently mentioned dimension was that of 'Types of Intervention' for three out of four open questions, while 'Access' was second most frequent for the fourth. Of the content elements, 17.2 % did not include items or dimensions covered by the VSSS; the three most frequently mentioned were other patients, food and security. The 82-item English version of the VSSS captures sharply most contents

Assessing readiness to work in primary health care: the content validity of a self-check tool for physiotherapists and other health professionals.

Science.gov (United States)

Stewart, Jenny; Haswell, Kate

2013-03-01

The New Zealand Primary Health Care Strategy has emphasised the importance of well-coordinated service teams in managing complex chronic conditions. There is international evidence that physiotherapists can contribute effectively to the prevention and management of these conditions. However, there are few examples of physiotherapists in New Zealand (NZ) engaging in primary health care (PHC). It has been recognised that professional development is necessary to optimise physiotherapists' participation in PHC. The aim of this study was to both design a self-check tool that physiotherapists could use as an initial step in preparing to work in PHC and to assess the content validity of the tool. A literature review informed the development of the self-check tool. The tool was reviewed by members of the Physiotherapy New Zealand PHC working party to establish content validity. The tool was found to have excellent content validity with an overall score of 0.937, exceeding the acceptable index of 0.8. Item validity was excellent or acceptable for all except two items, which were subsequently modified in the final tool. This investigation provides initial support for the tool's potential use by physiotherapists as a means of determining their readiness to work in PHC. It could have application beyond individual professional development to the wider context of team and organisational development. Additionally, with minor modifications the tool could have broader application to other professional groups.

The Perseverative Thinking Questionnaire (PTQ): validation of a content-independent measure of repetitive negative thinking.

Science.gov (United States)

Ehring, Thomas; Zetsche, Ulrike; Weidacker, Kathrin; Wahl, Karina; Schönfeld, Sabine; Ehlers, Anke

2011-06-01

Repetitive negative thinking (RNT) has been found to be involved in the maintenance of several types of emotional problems and has therefore been suggested to be a transdiagnostic process. However, existing measures of RNT typically focus on a particular disorder-specific content. In this article, the preliminary validation of a content-independent self-report questionnaire of RNT is presented. The 15-item Perseverative Thinking Questionnaire was evaluated in two studies (total N = 1832), comprising non-clinical as well as clinical participants. Results of confirmatory factor analyses across samples supported a second-order model with one higher-order factor representing RNT in general and three lower-order factors representing (1) the core characteristics of RNT (repetitiveness, intrusiveness, difficulties with disengagement), (2) perceived unproductiveness of RNT and (3) RNT capturing mental capacity. High internal consistencies and high re-test reliability were found for the total scale and all three subscales. The validity of the Perseverative Thinking Questionnaire was supported by substantial correlations with existing measures of RNT and associations with symptom levels and clinical diagnoses of depression and anxiety. Results suggest the usefulness of the new measure for research into RNT as a transdiagnostic process. Copyright © 2010 Elsevier Ltd. All rights reserved.

Utilizing job/task analysis to establish content validity in the design of training programs

Energy Technology Data Exchange (ETDEWEB)

Nay, W.E.

1988-01-01

The decade of the 1980's has been a turbulent time for the Department of Energy. With concern mounting about the terrorist threat, a wave of congressional inquiries and internal inspections crossed the nation and engulfed many of the nuclear laboratories and facilities operated by DOE contractors. A typical finding was the need to improve, and increase, the training of the protective force. The immediate reaction resulted in a wide variety of responses, with most contractors feeling safer with too much, rather than not enough training. As soon as the initial pressures to upgrade subsided, a task force was established to evaluate the overall training needs. Representatives from the contractor facilities worked together to conduct a job analysis of the protective force. A generic task inventory was established, and validated at the different sites. This list has been invaluable for determining the tasks, conditions, and standards needed to develop well stated learning objectives. The enhanced training programs are being refined to ensure job content validity based on the data collected.

Convergent validity test, construct validity test and external validity test of the David Liberman algorithm

Directory of Open Access Journals (Sweden)

David Maldavsky

2013-08-01

Full Text Available The author first exposes a complement of a previous test about convergent validity, then a construct validity test and finally an external validity test of the David Liberman algorithm.  The first part of the paper focused on a complementary aspect, the differential sensitivity of the DLA 1 in an external comparison (to other methods, and 2 in an internal comparison (between two ways of using the same method, the DLA.  The construct validity test exposes the concepts underlined to DLA, their operationalization and some corrections emerging from several empirical studies we carried out.  The external validity test examines the possibility of using the investigation of a single case and its relation with the investigation of a more extended sample.

Assessment of juveniles testimonies’ validity

Directory of Open Access Journals (Sweden)

Dozortseva E.G.

2015-12-01

Full Text Available The article presents a review of the English language publications concerning the history and the current state of differential psychological assessment of validity of testimonies produced by child and adolescent victims of crimes. The topicality of the problem in Russia is high due to the tendency of Russian specialists to use methodical means and instruments developed abroad in this sphere for forensic assessments of witness testimony veracity. A system of Statement Validity Analysis (SVA by means of Criteria-Based Content Analysis (CBCA and Validity Checklist is described. The results of laboratory and field studies of validity of CBCA criteria on the basis of child and adult witnesses are discussed. The data display a good differentiating capacity of the method, however, a high level of error probability. The researchers recommend implementation of SVA in the criminal investigation process, but not in the forensic assessment. New perspective developments in the field of methods for differentiation of witness statements based on the real experience and fictional are noted. The conclusion is drawn that empirical studies and a special work for adaptation and development of new approaches should precede their implementation into Russian criminal investigation and forensic assessment practice

Elaboration and Validation of the Medication Prescription Safety Checklist 1

Science.gov (United States)

Pires, Aline de Oliveira Meireles; Ferreira, Maria Beatriz Guimarães; do Nascimento, Kleiton Gonçalves; Felix, Márcia Marques dos Santos; Pires, Patrícia da Silva; Barbosa, Maria Helena

2017-01-01

ABSTRACT Objective: to elaborate and validate a checklist to identify compliance with the recommendations for the structure of medication prescriptions, based on the Protocol of the Ministry of Health and the Brazilian Health Surveillance Agency. Method: methodological research, conducted through the validation and reliability analysis process, using a sample of 27 electronic prescriptions. Results: the analyses confirmed the content validity and reliability of the tool. The content validity, obtained by expert assessment, was considered satisfactory as it covered items that represent the compliance with the recommendations regarding the structure of the medication prescriptions. The reliability, assessed through interrater agreement, was excellent (ICC=1.00) and showed perfect agreement (K=1.00). Conclusion: the Medication Prescription Safety Checklist showed to be a valid and reliable tool for the group studied. We hope that this study can contribute to the prevention of adverse events, as well as to the improvement of care quality and safety in medication use. PMID:28793128

The Legality and Validity of Administrative Enforcement

Directory of Open Access Journals (Sweden)

Sergei V. Iarkovoi

2018-01-01

Full Text Available The article discusses the concept and content of the validity of adopted by the executive authorities and other bodies of public administration legal acts and committed by them legal actions as an important characteristic of law enforcement by these bodies. The Author concludes that the validity of the administrative law enforcement is not an independent requirement for it, and acts as an integral part of its legal requirements.

[Reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test].

Science.gov (United States)

Zhang, C; Yang, G P; Li, Z; Li, X N; Li, Y; Hu, J; Zhang, F Y; Zhang, X J

2017-08-10

Objective: To assess the reliability and validity of the Chinese version on Alcohol Use Disorders Identification Test (AUDIT) among medical students in China and to provide correct way of application on the recommended scales. Methods: An E-questionnaire was developed and sent to medical students in five different colleges. Students were all active volunteers to accept the testings. Cronbach's α and split-half reliability were calculated to evaluate the reliability of AUDIT while content, contract, discriminant and convergent validity were performed to measure the validity of the scales. Results: The overall Cronbach's α of AUDIT was 0.782 and the split-half reliability was 0.711. Data showed that the domain Cronbach's α and split-half reliability were 0.796 and 0.794 for hazardous alcohol use, 0.561 and 0.623 for dependence symptoms, and 0.647 and 0.640 for harmful alcohol use. Results also showed that the content validity index on the levels of items I-CVI) were from 0.83 to 1.00, the content validity index of scale level (S-CVI/UA) was 0.90, content validity index of average scale level (S-CVI/Ave) was 0.99 and the content validity ratios (CVR) were from 0.80 to 1.00. The simplified version of AUDIT supported a presupposed three-factor structure which could explain 61.175% of the total variance revealed through exploratory factor analysis. AUDIT semed to have good convergent and discriminant validity, with the success rate of calibration experiment as 100%. Conclusion: AUDIT showed good reliability and validity among medical students in China thus worth for promotion on its use.

Validation of Robotic Surgery Simulator (RoSS).

Science.gov (United States)

Kesavadas, Thenkurussi; Stegemann, Andrew; Sathyaseelan, Gughan; Chowriappa, Ashirwad; Srimathveeravalli, Govindarajan; Seixas-Mikelus, Stéfanie; Chandrasekhar, Rameella; Wilding, Gregory; Guru, Khurshid

2011-01-01

Recent growth of daVinci Robotic Surgical System as a minimally invasive surgery tool has led to a call for better training of future surgeons. In this paper, a new virtual reality simulator, called RoSS is presented. Initial results from two studies - face and content validity, are very encouraging. 90% of the cohort of expert robotic surgeons felt that the simulator was excellent or somewhat close to the touch and feel of the daVinci console. Content validity of the simulator received 90% approval in some cases. These studies demonstrate that RoSS has the potential of becoming an important training tool for the daVinci surgical robot.

The Danish anal sphincter rupture questionnaire: Validity and reliability

DEFF Research Database (Denmark)

Due, Ulla; Ottesen, Marianne

2008-01-01

Objective. To revise, validate and test for reliability an anal sphincter rupture questionnaire in relation to construct, content and face validity. Setting and background. Since 1996 women with anal sphincter rupture (ASR) at one of the public university hospitals in Copenhagen, Denmark have bee...

Construct validity of the Thai version of the job content questionnaire in a large population of heterogeneous occupations.

Science.gov (United States)

Phakthongsuk, Pitchaya

2009-04-01

To test the construct validity of the Thai version of the job content questionnaire (TJCQ). The present descriptive study recruited 10415 participants from all occupations according to the International Standard Classification of Occupations. The instrument consisted of a 48-item of the job content questionnaire. Eight items newly developed by the authors from in-depth interviews were added. Exploratory factor analysis showed six factor models of work hazards, decision latitude, psychological demand, social support, physical demand, and job security. However, supervisor and co-worker support were not distinguished into two factors and some items distributed differently along the factors extracted. Confirmatory factor analysis supported the construct of six latent factors, although the overall fit was moderately acceptable. Cronbach's alpha coefficients higher than 0.7, supported the internal consistency of TJCQ scales except for job security (0.55). These findings suggest that TJCQ is valid and reliable for assessing job stress among Thai populations.

Development and validation of a theoretical test in basic laparoscopy

DEFF Research Database (Denmark)

Strandbygaard, Jeanett; Maagaard, Mathilde; Larsen, Christian Rifbjerg

2013-01-01

for first-year residents in obstetrics and gynecology. This study therefore aimed to develop and validate a framework for a theoretical knowledge test, a multiple-choice test, in basic theory related to laparoscopy. METHODS: The content of the multiple-choice test was determined by conducting informal...... conversational interviews with experts in laparoscopy. The subsequent relevance of the test questions was evaluated using the Delphi method involving regional chief physicians. Construct validity was tested by comparing test results from three groups with expected different clinical competence and knowledge.......001). Internal consistency (Cronbach's alpha) was 0.82. There was no evidence of differential item functioning between the three groups tested. CONCLUSIONS: A newly developed knowledge test in basic laparoscopy proved to have content and construct validity. The formula for the development and validation...

Construction and validation of the Self-care Assessment Instrument for patients with type 2 diabetes mellitus

Directory of Open Access Journals (Sweden)

Simonize Cunha Barreto de Mendonça

Full Text Available ABSTRACT Objective: to construct and validate the contents of the Self-care Assessment instrument for patients with type 2 diabetes mellitus. Method: methodological study, based on Orem's General Theory of Nursing. The empirical categories and the items of the instrument were elucidated through a focus group. The content validation process was performed by seven specialists and the semantic analysis by 14 patients. The Content Validity Indices of the items, ≥0.78, and of the scale, ≥0.90, were considered excellent. Results: the instrument contains 131 items in six dimensions corresponding to the health deviation self-care requisites. Regarding the maintenance, a Content Validity Index of 0.98 was obtained for the full set of items, and, regarding the relevance, Content Validity Indices ≥0.80 were obtained for the majority of the assessed psychometric criteria. Conclusion: the instrument showed evidence of content validity.

Development and validation of a reversed phase High Performance ...

African Journals Online (AJOL)

A simple, rapid, accurate and economical isocratic Reversed Phase High Performance Liquid Chromatography (RPHPLC) method was developed, validated and used for the evaluation of content of different brands of paracetamol tablets. The method was validated according to ICH guidelines and may be adopted for the ...

Development and Content Validation of the Transition Readiness Inventory Item Pool for Adolescent and Young Adult Survivors of Childhood Cancer.

Science.gov (United States)

Schwartz, Lisa A; Hamilton, Jessica L; Brumley, Lauren D; Barakat, Lamia P; Deatrick, Janet A; Szalda, Dava E; Bevans, Katherine B; Tucker, Carole A; Daniel, Lauren C; Butler, Eliana; Kazak, Anne E; Hobbie, Wendy L; Ginsberg, Jill P; Psihogios, Alexandra M; Ver Hoeve, Elizabeth; Tuchman, Lisa K

2017-10-01

The development of the Transition Readiness Inventory (TRI) item pool for adolescent and young adult childhood cancer survivors is described, aiming to both advance transition research and provide an example of the application of NIH Patient Reported Outcomes Information System methods. Using rigorous measurement development methods including mixed methods, patient and parent versions of the TRI item pool were created based on the Social-ecological Model of Adolescent and young adult Readiness for Transition (SMART). Each stage informed development and refinement of the item pool. Content validity ratings and cognitive interviews resulted in 81 content valid items for the patient version and 85 items for the parent version. TRI represents the first multi-informant, rigorously developed transition readiness item pool that comprehensively measures the social-ecological components of transition readiness. Discussion includes clinical implications, the application of TRI and the methods to develop the item pool to other populations, and next steps for further validation and refinement. © The Author 2017. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

IMatter: validation of the NHS Scotland Employee Engagement Index.

Science.gov (United States)

Snowden, Austyn; MacArthur, Ewan

2014-11-08

Employee engagement is a fundamental component of quality healthcare. In order to provide empirical data of engagement in NHS Scotland an Employee Engagement Index was co-constructed with staff. 'iMatter' consists of 25 Likert questions developed iteratively from the literature and a series of validation events with NHS Scotland staff. The aim of this study was to test the face, content and construct validity of iMatter. Cross sectional survey of NHS Scotland staff. In January 2013 iMatter was sent to 2300 staff across all disciplines in NHS Scotland. 1280 staff completed it. Demographic data were collected. Internal consistency of the scale was calculated. Construct validity consisted of concurrent application of factor analysis and Rasch analysis. Face and content validity were checked using 3 focus groups. The sample was representative of the NHSScotland population. iMatter showed very strong reliability (α = 0.958). Factor analysis revealed a four-factor structure consistent with the following interpretation: iMatter showed evidence of high reliability and validity. It is a popular measure of staff engagement in NHS Scotland. Implications for practice focus on the importance of coproduction in psychometric development.

Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences: A Systematic Review.

Science.gov (United States)

Wickert, Natasha M; Wong Riff, Karen W Y; Mansour, Mark; Forrest, Christopher R; Goodacre, Timothy E E; Pusic, Andrea L; Klassen, Anne F

2018-01-01

Objective The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured. Design MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing. Results A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., "Because of the way my face looks I wish I had never been born"). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance. Conclusions Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

Development and content validation of the information assessment method for patients and consumers.

Science.gov (United States)

Pluye, Pierre; Granikov, Vera; Bartlett, Gillian; Grad, Roland M; Tang, David L; Johnson-Lafleur, Janique; Shulha, Michael; Barbosa Galvão, Maria Cristiane; Ricarte, Ivan Lm; Stephenson, Randolph; Shohet, Linda; Hutsul, Jo-Anne; Repchinsky, Carol A; Rosenberg, Ellen; Burnand, Bernard; Légaré, France; Dunikowski, Lynn; Murray, Susan; Boruff, Jill; Frati, Francesca; Kloda, Lorie; Macaulay, Ann; Lagarde, François; Doray, Geneviève

2014-02-18

Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective. We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers. Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire. The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded and all inconsistencies in using a

A Qualitative Study on the Content Validity of the Social Capital Scales in the Copenhagen Psychosocial Questionnaire (COPSOQ II

Directory of Open Access Journals (Sweden)

Hanne Berthelsen

2016-06-01

Full Text Available The Copenhagen Psychosocial Questionnaire (COPSOQ II includes scales for measuring 'workplace social capital'. The overall aim of this article is to evaluate the content validity of the following scales: horizontal trust, vertical trust and justice based on data from cognitive interviews using a think-aloud procedure. Informants were selected to achieve variation in gender, age, region of residence, and occupation. A predetermined coding scheme was used to identify: 1 Perspective (reflection on behalf of oneself only or abstraction to a broader perspective, 2 Use of response options, 3 Contexts challenging the process of answering, and 4 Overall reflections included in the retrieval and judgement processes leading to an answer for each item. The results showed that 1 the intended shift from individual to a broader perspective worked for eight out of eleven items. 2 The response option balancing in the middle covered different meanings. Retrieval of information needed to answer constituted a problem in four out of eleven items. 3 Three contextually challenging situations were identified. 4 For most items the reflections corresponded well with the intention of the scales, though the items asking about withheld information caused more problems in answering and lower content validity compared to the other items of the scales. In general, the findings supported the content validity of the COPSOQ II measurement of workplace social capital as a group construct. The study opens for new insight into how concepts and questions are understood and answered among people coming from different occupations and organizational settings.

Development and Preliminary Face and Content Validation of the "Which Health Approaches and Treatments Are You Using?" (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology.

Science.gov (United States)

Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M; Huber, Adam M; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

2016-01-01

Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the "Which Health Approaches and Treatments are you using?" (WHAT) questionnaires in pediatric rheumatology. A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children's Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child's CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic

Development and Preliminary Face and Content Validation of the "Which Health Approaches and Treatments Are You Using?" (WHAT Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology.

Directory of Open Access Journals (Sweden)

Karine Toupin April

Full Text Available Complementary and alternative medicine (CAM is commonly used by children with juvenile idiopathic arthritis (JIA, yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the "Which Health Approaches and Treatments are you using?" (WHAT questionnaires in pediatric rheumatology.A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children's Hospital of Eastern Ontario and the Hospital for Sick Children, and (b 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items.Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child's CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity.Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other

Test validation of nuclear and fossil fuel control operators

International Nuclear Information System (INIS)

Moffie, D.J.

1976-01-01

To establish job relatedness, one must go through a procedure of concurrent and predictive validation. For concurrent validity a group of employees is tested and the test scores are related to performance concurrently or during the same time period. For predictive validity, individuals are tested but the results of these tests are not used at the time of employment. The tests are sealed and scored at a later date, and then related to job performance. Job performance data include ratings by supervisors, actual job performance indices, turnover, absenteeism, progress in training, etc. The testing guidelines also stipulate that content and construct validity can be used

Development and validation of a toddler silhouette scale.

Science.gov (United States)

Hager, Erin R; McGill, Adrienne E; Black, Maureen M

2010-02-01

The purpose of this study is to develop and validate a toddler silhouette scale. A seven-point scale was developed by an artist based on photographs of 15 toddlers (6 males, 9 females) varying in race/ethnicity and body size, and a list of phenotypic descriptions of toddlers of varying body sizes. Content validity, age-appropriateness, and gender and race/ethnicity neutrality were assessed among 180 pediatric health professionals and 129 parents of toddlers. Inter- and intrarater reliability and concurrent validity were assessed by having 138 pediatric health professionals match the silhouettes with photographs of toddlers. Assessments of content validity revealed that most health professionals (74.6%) and parents of toddlers (63.6%) ordered all seven silhouettes correctly, and interobserver agreement for weight status classification was high (kappa = 0.710, r = 0.827, P gender (68.5%) and race/ethnicity (77.3%) neutral. The inter-rater reliability, based on matching silhouettes with photographs, was 0.787 (Cronbach's alpha) and the intrarater reliability was 0.855 (P parents' perception of and satisfaction with their toddler's body size. Interventions can be targeted toward parents who have inaccurate perceptions of or are dissatisfied with their toddler's body size.

Translation, cultural adaptation, and content validity index of the Juvenile Love Scale to the Brazilian context

Directory of Open Access Journals (Sweden)

Lorrayne Stephane Soares

Full Text Available Abstract Background Passionate love involves physiological, emotional, and cognitive features that greatly changes behavior. This phenomenon seems universal or near universal. Even other animal species choose partners. An intense state of passionate love is associated with activity in dopamine pathways of the brain ‘reward system’, and recently has been regarded as a ‘natural addiction’. Instruments or tools to evaluate romantic love during childhood is still scarce. Objective To perform the translation and cultural adaptation of the Juvenile Love Scale (JLS for use in the Brazilian context targeted for adolescents between 14 and 18 years old. Methods The translation and cultural adaptation of JLS followed international recommendations, and its content validity was analyzed by a panel of experts in different areas of knowledge. Results The final version of the JLS for use in the Brazilian context showed high content validity (> 90%. Discussion To our knowledge, this is the first scale for measuring romantic or passionate love in adolescents adapted to the Brazilian context. This instrument is a significant contribution to the study of the dimensions of love, as well as to understand the impact of love on the psychiatric phenomena that pervade life in this stage of development.

Cyber Victim and Bullying Scale: A Study of Validity and Reliability

Science.gov (United States)

Cetin, Bayram; Yaman, Erkan; Peker, Adem

2011-01-01

The purpose of this study is to develop a reliable and valid scale, which determines cyber victimization and bullying behaviors of high school students. Research group consisted of 404 students (250 male, 154 male) in Sakarya, in 2009-2010 academic years. In the study sample, mean age is 16.68. Content validity and face validity of the scale was…

Content Validation of Athletic Therapy Clinical Presentations in Canada

Science.gov (United States)

Lafave, Mark R.; Yeo, Michelle; Westbrook, Khatija; Valdez, Dennis; Eubank, Breda; McAllister, Jenelle

2016-01-01

Context: Competency-based education requires strong planning and a vehicle to deliver and track students' progress across their undergraduate programs. Clinical presentations (CPs) are proposed as 1 method to deliver a competency-based curriculum in a Canadian undergraduate athletic therapy program. Objective: Validation of 253 CPs. Setting:…

Evaluation of biologic occupational risk control practices: quality indicators development and validation.

Science.gov (United States)

Takahashi, Renata Ferreira; Gryschek, Anna Luíza F P L; Izumi Nichiata, Lúcia Yasuko; Lacerda, Rúbia Aparecida; Ciosak, Suely Itsuko; Gir, Elucir; Padoveze, Maria Clara

2010-05-01

There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists' assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. The developed indicators were considered validated, and the method used for construction and validation proved to be effective. Copyright (c) 2010 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

Science.gov (United States)

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

Science.gov (United States)

Akmaz, Hazel Ekin; Uyar, Meltem; Kuzeyli Yıldırım, Yasemin; Akın Korhan, Esra

2018-05-29

Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Methodological and cross sectional study. A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance of chronic pain.

VALIDITY OF THE EMOTIONAL INTELLIGENCE SCALE FOR USE IN SPORT

Directory of Open Access Journals (Sweden)

Andrew M. Lane

2009-06-01

Full Text Available This study investigated the factorial validity of the 33-item self-rated Emotional Intelligence Scale (EIS: Schutte et al., 1998 for use with athletes. In stage 1, content validity of the EIS was assessed by a panel of experts (n = 9. Items were evaluated in terms of whether they assessed EI related to oneself and EI focused on others. Content validity further examined items in terms of awareness, regulation, and utilization of emotions. Content validity results indicated items describe 6-factors: appraisal of own emotions, regulation of own emotions, utilization of own emotions, optimism, social skills, and appraisal of others emotions. Results highlighted 13-items which make no direct reference to emotional experiences, and therefore, it is questionable whether such items should be retained. Stage 2 tested two competing models: a single factor model, which is the typical way researchers use the EIS and the 5-factor model (optimism was discarded as it become a single-item scale fiolliwng stage 1 identified in stage 1. Confirmatory factor analysis (CFA results on EIS data from 1,681 athletes demonstrated unacceptable fit indices for the 33-item single factor model and acceptable fit indices for the 6-factor model. Data were re-analyzed after removing the 13-items lacking emotional content, and CFA results indicate partial support for single factor model, and further support for a five-factor model (optimism was discarded as a factor during item removal. Despite encouraging results for a reduced item version of the EIS, we suggest further validation work is needed

Reliability and validity of the Wolfram Unified Rating Scale (WURS

Directory of Open Access Journals (Sweden)

Nguyen Chau

2012-11-01

Full Text Available Abstract Background Wolfram syndrome (WFS is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS. Methods A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease. WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age. Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated. Results The WURS had high inter-rater reliability (ICCs>.93, moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91 and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, ps>.76, ps=-.86, p=.001. The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83. Conclusions These preliminary findings demonstrate that the WURS has acceptable reliability and validity and captures individual differences in disease severity in children and young adults with WFS.

FACTAR validation

International Nuclear Information System (INIS)

Middleton, P.B.; Wadsworth, S.L.; Rock, R.C.; Sills, H.E.; Langman, V.J.

1995-01-01

A detailed strategy to validate fuel channel thermal mechanical behaviour codes for use of current power reactor safety analysis is presented. The strategy is derived from a validation process that has been recently adopted industry wide. Focus of the discussion is on the validation plan for a code, FACTAR, for application in assessing fuel channel integrity safety concerns during a large break loss of coolant accident (LOCA). (author)

Test-retest reliability and cross validation of the functioning everyday with a wheelchair instrument.

Science.gov (United States)

Mills, Tamara L; Holm, Margo B; Schmeler, Mark

2007-01-01

The purpose of this study was to establish the test-retest reliability and content validity of an outcomes tool designed to measure the effectiveness of seating-mobility interventions on the functional performance of individuals who use wheelchairs or scooters as their primary seating-mobility device. The instrument, Functioning Everyday With a Wheelchair (FEW), is a questionnaire designed to measure perceived user function related to wheelchair/scooter use. Using consumer-generated items, FEW Beta Version 1.0 was developed and test-retest reliability was established. Cross-validation of FEW Beta Version 1.0 was then carried out with five samples of seating-mobility users to establish content validity. Based on the content validity study, FEW Version 2.0 was developed and administered to seating-mobility consumers to examine its test-retest reliability. FEW Beta Version 1.0 yielded an intraclass correlation coefficient (ICC) Model (3,k) of .92, p content validity results revealed that FEW Beta Version 1.0 captured 55% of seating-mobility goals reported by consumers across five samples. FEW Version 2.0 yielded ICC(3,k) = .86, p content validity of FEW Version 2.0 was confirmed. FEW Beta Version 1.0 and FEW Version 2.0 were highly stable in their measurement of participants' seating-mobility goals over a 1-week interval.

Description and Validation of a MATLAB

DEFF Research Database (Denmark)

Johra, Hicham; Heiselberg, Per

This report aims to present the details and the validation tests of a single family house building energy model. The building model includes furniture / additional indoor content, phase change materials, ground source heat pump and water-based under floor heating system....

Development and validation of health related quality of life questionnaire (Indian scenario) in diabetic foot ulcer patients.

Science.gov (United States)

Kateel, Ramya; Augustine, Alfred J; Ullal, Sheetal; Prabhu, Shivananda; Bhat, Rahul; Adhikari, Prabha

2017-12-01

To develop and validate Health Related Quality of Life Questionnaire in Diabetic Foot Ulcer Patients (HRQLQDFU) for Indian scenario. This study was conducted in two phases. First phase was Development of HRQLQDFU which included literature search and expert interview. Second phase was validation of HRQLQDFL which included face validation, content validation and construct validation. Face validation was done by ten diabetic foot ulcer patients, ten practicing nurses and ten care givers. They were asked to read and respond to questionnaire and report any difficulty in understanding the questions. Further they were asked to add any item to the questionnaire which according to them has a significant effect on quality of life. Content validation was done by six subject experts who judged the content relevance of questionnaire with score ranging from zero to four; zero being least relevant and four being most relevant. Content validity index was calculated for each question. Questions having content validity index≥0.8 were selected for the study. Reliability was tested by calculating Cronbach's alpha. In the development phase a questionnaire containing 37 questions with six domains was developed. None of patient had difficulty in understanding questions. After content validation a new questionnaire containing 20 questions was developed. Cronbach's alpha was 0.86 which shows good reliability. The new health related quality of life questionnaire on diabetic foot ulcer patients for an Indian scenario is validated and can be a reliably measure for quality of life in diabetic foot ulcer patients. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

Validity and validation of expert (Q)SAR systems.

Science.gov (United States)

Hulzebos, E; Sijm, D; Traas, T; Posthumus, R; Maslankiewicz, L

2005-08-01

At a recent workshop in Setubal (Portugal) principles were drafted to assess the suitability of (quantitative) structure-activity relationships ((Q)SARs) for assessing the hazards and risks of chemicals. In the present study we applied some of the Setubal principles to test the validity of three (Q)SAR expert systems and validate the results. These principles include a mechanistic basis, the availability of a training set and validation. ECOSAR, BIOWIN and DEREK for Windows have a mechanistic or empirical basis. ECOSAR has a training set for each QSAR. For half of the structural fragments the number of chemicals in the training set is >4. Based on structural fragments and log Kow, ECOSAR uses linear regression to predict ecotoxicity. Validating ECOSAR for three 'valid' classes results in predictivity of > or = 64%. BIOWIN uses (non-)linear regressions to predict the probability of biodegradability based on fragments and molecular weight. It has a large training set and predicts non-ready biodegradability well. DEREK for Windows predictions are supported by a mechanistic rationale and literature references. The structural alerts in this program have been developed with a training set of positive and negative toxicity data. However, to support the prediction only a limited number of chemicals in the training set is presented to the user. DEREK for Windows predicts effects by 'if-then' reasoning. The program predicts best for mutagenicity and carcinogenicity. Each structural fragment in ECOSAR and DEREK for Windows needs to be evaluated and validated separately.

Is the content of the Chinese Quality of Life Instrument (ChQOL) really valid in the context of traditional Chinese medicine in Hong Kong?

Science.gov (United States)

Wong, Wendy; Lam, Cindy L K; Leung, K F; Zhao, L

2009-01-01

Content validity is crucial in quality of life instrument development but there is very little literature on this in Chinese culture. The Chinese Quality of Life Instrument (ChQOL) was developed in Mainland China to capture the health-related quality of life (HRQOL) concepts specific to traditional Chinese medicine (TCM). The aim of this study was to evaluate the content validity of ChQOL in a Chinese population whose spoken dialect and health-care system are different from those of Mainland China to find out whether the instrument is generalizable. 8 TCM practitioners and 10 patients rated the clarity, relevance and appropriateness of each of the 50 items of the ChQOL (HK version), and completed qualitative cognitive debriefing interviews. The content of ChQOL was rated valid by TCM practitioners with CVIs on clarity, relevance and appropriateness ranging from 80 to 100%. 49 out of 50 items were well understood by patients, but 12 items had CVI on relevance and 5 items had CVI on appropriateness lower than 70% among patients. After reviewing the patients and TCM practitioners' opinions, revisions were made for three items (2, 8 and 29) to form the ChQOL (HK version)-2008. In general, the ChQOL was found to be too long which called for shorter version. The content of ChQOL was shown to be really valid in the context of Chinese Medicine for Cantonese speaking Chinese. There was some discrepancy between the judgments of TCM practitioners and patients indicating the importance of evaluation by both experts and lay persons.

Translation and validation of ICIQ-FLUTS for Tamil-speaking women.

Science.gov (United States)

Ekanayake, Chanil D; Pathmeswaran, Arunasalam; Nishad, A A Nilanga; Samaranayake, Kanishka U; Wijesinghe, Prasantha S

2017-12-01

Research in to lower urinary tract symptoms (LUTS) in women in South Asia is hampered by lack of validated tools. Our aim was to validate the International Consultation on Incontinence Modular Questionnaire on Female Lower Urinary Tract Symptoms (ICIQ-FLUTS) from English to Tamil. After translation to Tamil, a validation study was carried out among women attending the gynecology clinic at District General Hospital-Mannar. Content validity assessed by the level of missing data was Tamil translation of ICIQ-FLUTS retained the psychometric properties of the original English questionnaire and will be an invaluable tool to detect LUTS among Tamil-speaking women.

Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia.

Science.gov (United States)

Halek, Margareta; Holle, Daniela; Bartholomeyczik, Sabine

2017-08-14

One of the most difficult issues for care staff is the manifestation of challenging behaviour among residents with dementia. The first step in managing this type of behaviour is analysing its triggers. A structured assessment instrument can facilitate this process and may improve carers' management of the situation. This paper describes the development of an instrument designed for this purpose and an evaluation of its content validity and its feasibility and practicability in nursing homes. The development process and evaluation of the content validity were based on Lynn's methodology (1998). A literature review (steps 1 + 2) provided the theoretical framework for the instrument and for item formation. Ten experts (step 3) evaluated the first version of the instrument (the Innovative dementia-oriented Assessment (IdA®)) regarding its relevance, clarity, meaningfulness and completeness; content validity indices at the scale-level (S-CVI) and item-level (I-CVI) were calculated. Health care workers (step 4) evaluated the second version in a workshop. Finally, the instrument was introduced to 17 units in 11 nursing homes in a field study (step 5), and 60 care staff members assessed its practicability and feasibility. The IdA® used the need-driven dementia-compromised behaviour (NDB) model as a theoretical framework. The literature review and expert-based panel supported the content validity of the IdA®. At the item level, 77% of the ratings had a CVI greater than or equal to 0.78. The majority of the question-ratings (84%, n = 154) and answer-ratings (69%, n = 122) showed valid results, with none below 0.50. The health care workers confirmed the understandability, completeness and plausibility of the IdA®. Steps 3 and 4 led to further item clarification. The carers in the study considered the instrument helpful for reflecting challenging behaviour and beneficial for the care of residents with dementia. Negative ratings referred to the time required and the

Method validation for strobilurin fungicides in cereals and fruit

DEFF Research Database (Denmark)

Christensen, Hanne Bjerre; Granby, Kit

2001-01-01

Strobilurins are a new class of fungicides that are active against a broad spectrum of fungi. In the present work a GC method for analysis of strobilurin fungicides was validated. The method was based on extraction with ethyl acetate/cyclohexane, clean-up by gel permeation chromatography (GPC......) and determination of the content by gas chromatography (GC) with electron capture (EC-), nitrogen/phosphorous (NP-), and mass spectrometric (MS-) detection. Three strobilurins, azoxystrobin, kresoxim-methyl and trifloxystrobin were validated on three matrices, wheat, apple and grapes. The validation was based...

Content validation of a Danish version of "The McGill Ingestive Skills Assessment" for dysphagia management

DEFF Research Database (Denmark)

Hansen, Tina; Lambert, H.C.; Faber, J.

2011-01-01

of 43 items was found for 93% in terms of adequacy, 67% in terms of clarity of item description, 86% in terms of clarity of score descriptions, and 93% in terms of relevance. Thirteen of 14 sections of the instruction manual and score sheet were content valid. In light of these results, a revised MISA...... for psychometric testing using classical as well as modern test theory. Read More: http://informahealthcare.com/doi/abs/10.3109/11038128.2010.521949...

Validating spatial structure in canopy water content using geostatistics

Science.gov (United States)

Sanderson, E. W.; Zhang, M. H.; Ustin, S. L.; Rejmankova, E.; Haxo, R. S.

1995-01-01

Heterogeneity in ecological phenomena are scale dependent and affect the hierarchical structure of image data. AVIRIS pixels average reflectance produced by complex absorption and scattering interactions between biogeochemical composition, canopy architecture, view and illumination angles, species distributions, and plant cover as well as other factors. These scales affect validation of pixel reflectance, typically performed by relating pixel spectra to ground measurements acquired at scales of 1m(exp 2) or less (e.g., field spectra, foilage and soil samples, etc.). As image analysis becomes more sophisticated, such as those for detection of canopy chemistry, better validation becomes a critical problem. This paper presents a methodology for bridging between point measurements and pixels using geostatistics. Geostatistics have been extensively used in geological or hydrogeolocial studies but have received little application in ecological studies. The key criteria for kriging estimation is that the phenomena varies in space and that an underlying controlling process produces spatial correlation between the measured data points. Ecological variation meets this requirement because communities vary along environmental gradients like soil moisture, nutrient availability, or topography.

A new dataset validation system for the Planetary Science Archive

Science.gov (United States)

Manaud, N.; Zender, J.; Heather, D.; Martinez, S.

2007-08-01

The Planetary Science Archive is the official archive for the Mars Express mission. It has received its first data by the end of 2004. These data are delivered by the PI teams to the PSA team as datasets, which are formatted conform to the Planetary Data System (PDS). The PI teams are responsible for analyzing and calibrating the instrument data as well as the production of reduced and calibrated data. They are also responsible of the scientific validation of these data. ESA is responsible of the long-term data archiving and distribution to the scientific community and must ensure, in this regard, that all archived products meet quality. To do so, an archive peer-review is used to control the quality of the Mars Express science data archiving process. However a full validation of its content is missing. An independent review board recently recommended that the completeness of the archive as well as the consistency of the delivered data should be validated following well-defined procedures. A new validation software tool is being developed to complete the overall data quality control system functionality. This new tool aims to improve the quality of data and services provided to the scientific community through the PSA, and shall allow to track anomalies in and to control the completeness of datasets. It shall ensure that the PSA end-users: (1) can rely on the result of their queries, (2) will get data products that are suitable for scientific analysis, (3) can find all science data acquired during a mission. We defined dataset validation as the verification and assessment process to check the dataset content against pre-defined top-level criteria, which represent the general characteristics of good quality datasets. The dataset content that is checked includes the data and all types of information that are essential in the process of deriving scientific results and those interfacing with the PSA database. The validation software tool is a multi-mission tool that

Psychologist in a Pocket: Lexicon Development and Content Validation of a Mobile-Based App for Depression Screening.

Science.gov (United States)

Cheng, Paula Glenda Ferrer; Ramos, Roann Munoz; Bitsch, Jó Ágila; Jonas, Stephan Michael; Ix, Tim; See, Portia Lynn Quetulio; Wehrle, Klaus

2016-07-20

Language reflects the state of one's mental health and personal characteristics. It also reveals preoccupations with a particular schema, thus possibly providing insights into psychological conditions. Using text or lexical analysis in exploring depression, negative schemas and self-focusing tendencies may be depicted. As mobile technology has become highly integrated in daily routine, mobile devices have the capacity for ecological momentary assessment (EMA), specifically the experience sampling method (ESM), where behavior is captured in real-time or closer in time to experience in one's natural environment. Extending mobile technology to psychological health could augment initial clinical assessment, particularly of mood disturbances, such as depression and analyze daily activities, such as language use in communication. Here, we present the process of lexicon generation and development and the initial validation of Psychologist in a Pocket (PiaP), a mobile app designed to screen signs of depression through text analysis. The main objectives of the study are (1) to generate and develop a depressive lexicon that can be used for screening text-input in mobile apps to be used in the PiaP; and (2) to conduct content validation as initial validation. The first phase of our research focused on lexicon development. Words related to depression and its symptoms based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) and in the ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines classification systems were gathered from focus group discussions with Filipino college students, interviews with mental health professionals, and the review of established scales for depression and other related constructs. The lexicon development phase yielded a database consisting of 13 categories based on the criteria depressive symptoms in the DSM-5 and ICD-10. For the draft of the depression lexicon for

The development and preliminary validation of the Challenge and Threat in Sport (CAT-Sport) Scale

OpenAIRE

Rossato, C.J.L.; Uphill, M.A.; Swain, J.; Coleman, D.

2016-01-01

This paper outlines the development and preliminary validation of a sport-specific measure of\\ud athletes’ experience of challenge and threat. Three independent studies assess the content\\ud validity, factor structure, criterion validity and internal consistency of the Challenge and\\ud Threat in Sport (CAT-Sport) Scale. In study 1, a group of 25 athletes and 2 experts assessed\\ud the content validity of items derived from existing measures of challenge and threat.\\ud Participants examined a p...

Development, content validity and test-retest reliability of the Lifelong Physical Activity Skills Battery in adolescents.

Science.gov (United States)

Hulteen, Ryan M; Barnett, Lisa M; Morgan, Philip J; Robinson, Leah E; Barton, Christian J; Wrotniak, Brian H; Lubans, David R

2018-03-28

Numerous skill batteries assess fundamental motor skill (e.g., kick, hop) competence. Few skill batteries examine lifelong physical activity skill competence (e.g., resistance training). This study aimed to develop and assess the content validity, test-retest and inter-rater reliability of the "Lifelong Physical Activity Skills Battery". Development of the skill battery occurred in three stages: i) systematic reviews of lifelong physical activity participation rates and existing motor skill assessment tools, ii) practitioner consultation and iii) research expert consultation. The final battery included eight skills: grapevine, golf swing, jog, push-up, squat, tennis forehand, upward dog and warrior I. Adolescents (28 boys, 29 girls; M = 15.8 years, SD = 0.4 years) completed the Lifelong Physical Activity Skills Battery on two occasions two weeks apart. The skill battery was highly reliable (ICC = 0.84, 95% CI = 0.72-0.90) with individual skill reliability scores ranging from moderate (warrior I; ICC = 0.56) to high (tennis forehand; ICC = 0.82). Typical error (4.0; 95% CI 3.4-5.0) and proportional bias (r = -0.21, p = .323) were low. This study has provided preliminary evidence for the content validity and reliability of the Lifelong Physical Activity Skills Battery in an adolescent population.

A content validity approach to creating an end-user computer skill assessment tool

Directory of Open Access Journals (Sweden)

Shirley Gibbs

Full Text Available Practical assessment instruments are commonly used in the workplace and educational environments to assess a person\\'s level of digital literacy and end-user computer skill. However, it is often difficult to find statistical evidence of the actual validity of instruments being used. To ensure that the correct factors are being assessed for a particular purpose it is necessary to undertake some type of psychometric testing, and the first step is to study the content relevance of the measure. The purpose of this paper is to report on the rigorous judgment-quantification process using panels of experts in order to establish inter-rater reliability and agreement in the development of end-user instruments developed to measure workplace skills using spreadsheet and word-processing applications.

Validation of cell voltage and water content in a PEM (polymer electrolyte membrane) fuel cell model using neutron imaging for different operating conditions

International Nuclear Information System (INIS)

Salva, J. Antonio; Iranzo, Alfredo; Rosa, Felipe; Tapia, Elvira

2016-01-01

This work presents a one dimensional analytical model developed for a 50 cm"2 PEM (polymer electrolyte membrane) fuel cell with five-channel serpentine flow field. The different coupled physical phenomena such as electrochemistry, mass transfer of hydrogen, oxygen and water (two phases) together with heat transfer have been solved simultaneously. The innovation of this work is that the model has been validated with two different variables simultaneously and quantitatively in order to ensure the accuracy of the results. The selected variables are the cell voltage and the water content within the membrane MEA (Membrane Electrode Assembly) and GDL (gas diffusion layers) experimentally measured by means of neutron radiography. The results show a good agreement for a comprehensive set of different operating conditions of cell temperature, pressure, reactants relative humidity and cathode stoichiometry. The analytical model has a relative error less than 3.5% for the value of the cell voltage and the water content within the GDL + MEA for all experiments performed. This result presents a new standard of validation in the state of art of PEM fuel cell modeling where two variables are simultaneously and quantitatively validated with experimental results. The developed analytical model has been used in order to analyze the behavior of the PEM fuel cell under different values of relative humidity. - Highlights: • One dimensional analytical model has been developed for a PEM fuel cell. • The model is validated with two different variables simultaneously. • New standard of validation is proposed.

Development, content validity, and piloting of an instrument designed to measure managers' attitude toward workplace breastfeeding support.

Science.gov (United States)

Chow, Tan; Wolfe, Edward W; Olson, Beth H

2012-07-01

Manager attitude is influential in female employees' perceptions of workplace breastfeeding support. Currently, no instrument is available to assess manager attitude toward supporting women who wish to combine breastfeeding with work. We developed and piloted an instrument to measure manager attitudes toward workplace breastfeeding support entitled the "Managers' Attitude Toward Breastfeeding Support Questionnaire," an instrument that measures four constructs using 60 items that are rated agree/disagree on a 4-point Likert rating scale. We established the content validity of the Managers' Attitude Toward Breastfeeding Support Questionnaire measures through expert content review (n=22), expert assessment of item fit (n=11), and cognitive interviews (n=8). Data were collected from a purposive sample of 185 front-line managers who had experience supervising female employees, and responses were scaled using the Multidimensional Random Coefficients Multinomial Logit Model. Dimensionality analyses supported the proposed four-construct model. Reliability ranged from 0.75 to 0.86, and correlations between the constructs were moderately strong (0.47 to 0.71). Four items in two constructs exhibited model-to-data misfit and/or a low score-measure correlation. One item was revised and the other three items were retained in the Managers' Attitude Toward Breastfeeding Support Questionnaire. Findings of this study suggest that the Managers' Attitude Toward Breastfeeding Support Questionnaire measures are reliable and valid indicators of manager attitude toward workplace breastfeeding support, and future research should be conducted to establish external validity. The Managers' Attitude Toward Breastfeeding Support Questionnaire could be used to collect data in a standardized manner within and across companies to measure and compare manager attitudes toward supporting breastfeeding. Organizations can subsequently develop targeted strategies to improve support for breastfeeding

Family-centred services in the Netherlands : validating a self-report measure for paediatric service providers

NARCIS (Netherlands)

Siebes, RC; Ketelaar, M; Wijnroks, L; van Schie, PE; Nijhuis, Bianca J G; Vermeer, A; Gorter, JW

Objective: To validate the Dutch translation of the Canadian Measure of Processes of Care for Service Providers questionnaire (MPOC-SP) for use in paediatric rehabilitation settings in the Netherlands. Design: The construct validity, content validity, face validity, and reliability of the Dutch

[Preventable drug-related morbidity: determining valid indicators for primary care in Portugal].

Science.gov (United States)

Guerreiro, Mara Pereira; Cantrill, Judith A; Martins, Ana Paula

2007-01-01

Preventable drug-related morbidity (PDRM) indicators are operational measures of therapeutic risk management. These clinical indicators, which cover a wide range of drugs, combine process and outcome in the same instrument. They were developed in the US and have been validated for primary care settings in the US, UK and Canada. This study is part of a research programme; it aimed to determine a valid set of PDRM indicators for adult patients in primary care in Portugal. Face validity of 61 US and UK-derived indicators translated to Portuguese was preliminarily determined by means of a postal questionnaire using a purposive sample of four Portuguese pharmacists with different backgrounds. Preliminary content validity of indicators approved in the previous stage was determined by cross-checking each definition of PDRM with standard drug information sources in Portugal. Face and content validity of indicators yielded by preliminary work were then established by a 37 expert panel (20 community pharmacists and 17 general practitioners) using a two-round Delphi survey. Data were analysed using SPSS release 11.5. Nineteen indicators were ruled out in preliminary validation. Changes were made in the content of eight of the remaining 42 indicators; these were related to differences in the drugs being marketed and patterns of drug monitoring between countries. Thirty-five indicators were consensus approved as PDRM for adult patients in Portuguese primary care by the Delphi panel.

Validation of the Essentials of Magnetism II in Chinese critical care settings.

Science.gov (United States)

Bai, Jinbing; Hsu, Lily; Zhang, Qing

2015-05-01

To translate and evaluate the psychometric properties of the Essentials of Magnetism II tool (EOM II) for Chinese nurses in critical care settings. The EOM II is a reliable and valid scale for measuring the healthy work environment (HWE) for nurses in Western countries, however, it has not been validated among Chinese nurses. The translation of the EOM II followed internationally recognized guidelines. The Chinese version of the Essentials of Magnetism II tool (C-EOM II) was reviewed by an expert panel for culturally semantic equivalence and content validity. Then, 706 nurses from 28 intensive care units (ICUs) affiliated with 14 tertiary hospitals participated in this study. The reliability of the C-EOM II was assessed using the Cronbach's alpha coefficient; the content validity of this scale was assessed using the content validity index (CVI); and the construct validity was assessed using the confirmatory factor analysis (CFA). The C-EOM II showed excellent content validity with a CVI of 0·92. All the subscales of the C-EOM II were significantly correlated with overall nurse job satisfaction and nurse-assessed quality of care. The CFA showed that the C-EOM II was composed of 45 items with nine factors, accounting for 46·51% of the total variance. Cronbach's alpha coefficients for these factors ranged from 0·56 to 0·89. The C-EOM II is a promising scale to assess the HWE for Chinese ICU nurses. Nursing administrators and health care policy-makers can use the C-EOM II to evaluate clinical work environment so that a healthier work environment can be created and sustained for staff nurses. © 2013 British Association of Critical Care Nurses.

Development and Validation of Web-Based Courseware for Junior Secondary School Basic Technology Students in Nigeria

Directory of Open Access Journals (Sweden)

Amosa Isiaka Gambari

2018-02-01

Full Text Available This research aimed to develop and validate a web-based courseware for junior secondary school basic technology students in Nigeria. In this study, a mixed method quantitative pilot study design with qualitative components was used to test and ascertain the ease of development and validation of the web-based courseware. Dick and Carey instructional system design model was adopted for developing the courseware. Convenience sampling technique was used in selecting the three content, computer and educational technology experts to validate the web-based courseware. Non-randomized and non-equivalent Junior secondary school students from two schools were used for field trial validation. Four validating instruments were employed in conducting this study: (i Content Validation Assessment Report (CVAR; (ii Computer Expert Validation Assessment Report (CEAR; (iii Educational Technology Experts Validation Assessment Report (ETEVAR; and (iv Students Validation Questionnaire (SVQ. All the instruments were face and content validated. SVQ was pilot tested and reliability coefficient of 0.85 was obtained using Cronbach Alpha. CVAR, CEAR, ETEVAR were administered on content specialists, computer experts, and educational technology experts, while SVQ was administered on 83 JSS students from two selected secondary schools in Minna. The findings revealed that the process of developing web-based courseware using Dick and Carey Instructional System Design was successful. In addition, the report from the validating team revealed that the web-based courseware is valuable for learning basic technology. It is therefore recommended that web-based courseware should be produced to teach basic technology concepts on large scale.

Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

Science.gov (United States)

Toupin April, Karine; Stinson, Jennifer; Boon, Heather; Duffy, Ciarán M.; Huber, Adam M.; Gibbon, Michele; Descarreaux, Martin; Spiegel, Lynn; Vohra, Sunita; Tugwell, Peter

2016-01-01

Objective Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology. Methods A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items. Results Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity. Conclusions Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric

Validity and Reliability of the Turkish Chronic Pain Acceptance Questionnaire

Directory of Open Access Journals (Sweden)

Hazel Ekin Akmaz

2018-05-01

Full Text Available Background: Pain acceptance is the process of giving up the struggle with pain and learning to live a worthwhile life despite it. In assessing patients with chronic pain in Turkey, making a diagnosis and tracking the effectiveness of treatment is done with scales that have been translated into Turkish. However, there is as yet no valid and reliable scale in Turkish to assess the acceptance of pain. Aims: To validate a Turkish version of the Chronic Pain Acceptance Questionnaire developed by McCracken and colleagues. Study Design: Methodological and cross sectional study. Methods: A simple randomized sampling method was used in selecting the study sample. The sample was composed of 201 patients, more than 10 times the number of items examined for validity and reliability in the study, which totaled 20. A patient identification form, the Chronic Pain Acceptance Questionnaire, and the Brief Pain Inventory were used to collect data. Data were collected by face-to-face interviews. In the validity testing, the content validity index was used to evaluate linguistic equivalence, content validity, construct validity, and expert views. In reliability testing of the scale, Cronbach’s α coefficient was calculated, and item analysis and split-test reliability methods were used. Principal component analysis and varimax rotation were used in factor analysis and to examine factor structure for construct concept validity. Results: The item analysis established that the scale, all items, and item-total correlations were satisfactory. The mean total score of the scale was 21.78. The internal consistency coefficient was 0.94, and the correlation between the two halves of the scale was 0.89. Conclusion: The Chronic Pain Acceptance Questionnaire, which is intended to be used in Turkey upon confirmation of its validity and reliability, is an evaluation instrument with sufficient validity and reliability, and it can be reliably used to examine patients’ acceptance

Streamlining Compliance Validation Through Automation Processes

Science.gov (United States)

2014-03-01

INTENTIONALLY LEFT BLANK xv LIST OF ACRONYMS AND ABBREVIATIONS ACAS Assured Compliance Assessment Suite AMP Apache- MySQL -PHP ANSI American...enemy. Of course , a common standard for DoD security personnel to write and share compliance validation content would prevent duplicate work and aid in...process and consume much of the SCAP content available. Finally, it is free and easy to install as part of the Apache/ MySQL /PHP (AMP) [37

Validation of New Cancer Biomarkers

DEFF Research Database (Denmark)

Duffy, Michael J; Sturgeon, Catherine M; Söletormos, Georg

2015-01-01

BACKGROUND: Biomarkers are playing increasingly important roles in the detection and management of patients with cancer. Despite an enormous number of publications on cancer biomarkers, few of these biomarkers are in widespread clinical use. CONTENT: In this review, we discuss the key steps...... in advancing a newly discovered cancer candidate biomarker from pilot studies to clinical application. Four main steps are necessary for a biomarker to reach the clinic: analytical validation of the biomarker assay, clinical validation of the biomarker test, demonstration of clinical value from performance...... of the biomarker test, and regulatory approval. In addition to these 4 steps, all biomarker studies should be reported in a detailed and transparent manner, using previously published checklists and guidelines. Finally, all biomarker studies relating to demonstration of clinical value should be registered before...

Content Validity of Temporal Bone Models Printed Via Inexpensive Methods and Materials.

Science.gov (United States)

Bone, T Michael; Mowry, Sarah E

2016-09-01

Computed tomographic (CT) scans of the 3-D printed temporal bone models will be within 15% accuracy of the CT scans of the cadaveric temporal bones. Previous studies have evaluated the face validity of 3-D-printed temporal bone models designed to train otolaryngology residents. The purpose of the study was to determine the content validity of temporal bone models printed using inexpensive printers and materials. Four cadaveric temporal bones were randomly selected and clinical temporal bone CT scans were obtained. Models were generated using previously described methods in acrylonitrile butadiene styrene (ABS) plastic using the Makerbot Replicator 2× and Hyrel printers. Models were radiographically scanned using the same protocol as the cadaveric bones. Four images from each cadaveric CT series and four corresponding images from the model CT series were selected, and voxel values were normalized to black or white. Scan slices were compared using PixelDiff software. Gross anatomic structures were evaluated in the model scans by four board certified otolaryngologists on a 4-point scale. Mean pixel difference between the cadaver and model scans was 14.25 ± 2.30% at the four selected CT slices. Mean cortical bone width difference and mean external auditory canal width difference were 0.58 ± 0.66 mm and 0.55 ± 0.46 mm, respectively. Expert raters felt the mastoid air cells were well represented (2.5 ± 0.5), while middle ear and otic capsule structures were not accurately rendered (all averaged bones for training residents in cortical mastoidectomies, but less effective for middle ear procedures.

Validation of Medical Tourism Service Quality Questionnaire (MTSQQ) for Iranian Hospitals.

Science.gov (United States)

Qolipour, Mohammad; Torabipour, Amin; Khiavi, Farzad Faraji; Malehi, Amal Saki

2017-03-01

Assessing service quality is one of the basic requirements to develop the medical tourism industry. There is no valid and reliable tool to measure service quality of medical tourism. This study aimed to determine the reliability and validity of a Persian version of medical tourism service quality questionnaire for Iranian hospitals. To validate the medical tourism service quality questionnaire (MTSQQ), a cross-sectional study was conducted on 250 Iraqi patients referred to hospitals in Ahvaz (Iran) from 2015. To design a questionnaire and determine its content validity, the Delphi Technique (3 rounds) with the participation of 20 medical tourism experts was used. Construct validity of the questionnaire was assessed through exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach's alpha coefficient. Data were analyzed by Excel 2007, SPSS version18, and Lisrel l8.0 software. The content validity of the questionnaire with CVI=0.775 was confirmed. According to exploratory factor analysis, the MTSQQ included 31 items and 8 dimensions (tangibility, reliability, responsiveness, assurance, empathy, exchange and travel facilities, technical and infrastructure facilities and safety and security). Construct validity of the questionnaire was confirmed, based on the goodness of fit quantities of model (RMSEA=0.032, CFI= 0.98, GFI=0.88). Cronbach's alpha coefficient was 0.837 and 0.919 for expectation and perception questionnaire. The results of the study showed that the medical tourism SERVQUAL questionnaire with 31 items and 8 dimensions was a valid and reliable tool to measure service quality of medical tourism in Iranian hospitals.

Validating High-Stakes Testing Programs.

Science.gov (United States)

Kane, Michael

2002-01-01

Makes the point that the interpretations and use of high-stakes test scores rely on policy assumptions about what should be taught and the content standards and performance standards that should be applied. The assumptions built into an assessment need to be subjected to scrutiny and criticism if a strong case is to be made for the validity of the…

The Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE): Construct and Content Validation Using a Modified Delphi Method.

Science.gov (United States)

Paquette-Warren, Jann; Tyler, Marie; Fournie, Meghan; Harris, Stewart B

2017-06-01

In order to scale-up successful innovations, more evidence is needed to evaluate programs that attempt to address the rising prevalence of diabetes and the associated burdens on patients and the healthcare system. This study aimed to assess the construct and content validity of the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE), a tool developed to guide the evaluation, design and implementation with built-in knowledge translation principles. A modified Delphi method, including 3 individual rounds (questionnaire with 7-point agreement/importance Likert scales and/or open-ended questions) and 1 group round (open discussion) were conducted. Twelve experts in diabetes, research, knowledge translation, evaluation and policy from Canada (Ontario, Quebec and British Columbia) and Australia participated. Quantitative consensus criteria were an interquartile range of ≤1. Qualitative data were analyzed thematically and confirmed by participants. An importance scale was used to determine a priority multi-level indicator set. Items rated very or extremely important by 80% or more of the experts were reviewed in the final group round to build the final set. Participants reached consensus on the content and construct validity of DEFINE, including its title, overall goal, 5-step evaluation approach, medical and nonmedical determinants of health schematics, full list of indicators and associated measurement tools, priority multi-level indicator set and next steps in DEFINE's development. Validated by experts, DEFINE has the right theoretic components to evaluate comprehensively diabetes prevention and management programs and to support acquisition of evidence that could influence the knowledge translation of innovations to reduce the burden of diabetes. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Content validity and electronic PRO (ePRO) usability of the Lung Cancer Symptom Scale-Mesothelioma (LCSS-Meso) in mesothelioma patients.

Science.gov (United States)

Gelhorn, Heather L; Skalicky, Anne M; Balantac, Zaneta; Eremenco, Sonya; Cimms, Tricia; Halling, Katarina; Hollen, Patricia J; Gralla, Richard J; Mahoney, Martin C; Sexton, Chris

2018-02-01

Obtaining qualitative data directly from the patient perspective enhances the content validity of patient-reported outcome (PRO) instruments. The objective of this qualitative study was to evaluate the content validity of the Lung Cancer Symptom Scale for Mesothelioma (LCSS-Meso) and its usability on an electronic device. A cross-sectional methodological study, using a qualitative approach, was conducted among patients recruited from four clinical sites. The primary target population included patients with pleural mesothelioma; data were also collected from patients with peritoneal mesothelioma on an exploratory basis. Semi-structured interviews were conducted consisting of concept elicitation, cognitive interviewing, and evaluation of electronic patient-reported outcome (ePRO) usability. Participants (n = 21) were interviewed in person (n = 9) or by telephone (n = 12); 71% were male with a mean age of 69 years (SD = 14). The most common signs and symptoms experienced by participants with pleural mesothelioma (n = 18) were shortness of breath, fluid build-up, pain, fatigue, coughing, and appetite loss. The most commonly described symptoms for those with peritoneal mesothelioma (n = 4) were bloating, changes in appetite, fatigue, fluid build-up, shortness of breath, and pain. Participants with pleural mesothelioma commonly described symptoms assessed by the LCSS-Meso in language consistent with the questionnaire and a majority understood and easily completed each of the items. The ePRO version was easy to use, and there was no evidence that the electronic formatting changed the way participants responded to the questions. Results support the content validity of the LCSS-Meso and the usability of the electronic format for use in assessing symptoms among patients with pleural mesothelioma.

Content Validation and Semantic Evaluation of a Check-List Elaborated for the Prevention of Gluten Cross-Contamination in Food Services

Directory of Open Access Journals (Sweden)

Priscila Farage

2017-01-01

Full Text Available Conditions associated to the consumption of gluten have emerged as a major health care concern and the treatment consists on a lifelong gluten-free diet. Providing safe food for these individuals includes adapting to safety procedures within the food chain and preventing gluten cross-contamination in gluten-free food. However, a gluten cross-contamination prevention protocol or check-list has not yet been validated. Therefore, the aim of this study was to perform the content validation and semantic evaluation of a check-list elaborated for the prevention of gluten cross-contamination in food services. The preliminary version of the check-list was elaborated based on the Brazilian resolution for food safety Collegiate Board Resolution 216 (RDC 216 and Collegiate Board Resolution 275 (RDC 275, the standard 22000 from the International Organization for Standardization (ISO 22000 and the Canadian Celiac Association Gluten-Free Certification Program documents. Seven experts with experience in the area participated in the check-list validation and semantic evaluation. The criteria used for the approval of the items, as to their importance for the prevention of gluten cross-contamination and clarity of the wording, was the achievement of a minimal of 80% of agreement between the experts (W-values ≥ 0.8. Moreover, items should have a mean ≥4 in the evaluation of importance (Likert scale from 1 to 5 and clarity (Likert scale from 0 to 5 in order to be maintained in the instrument. The final version of the check-list was composed of 84 items, divided into 12 sections. After being redesigned and re-evaluated, the items were considered important and comprehensive by the experts (both with W-values ≥ 0.89. The check-list developed was validated with respect to content and approved in the semantic evaluation.

Content Validation and Semantic Evaluation of a Check-List Elaborated for the Prevention of Gluten Cross-Contamination in Food Services.

Science.gov (United States)

Farage, Priscila; Puppin Zandonadi, Renata; Cortez Ginani, Verônica; Gandolfi, Lenora; Pratesi, Riccardo; de Medeiros Nóbrega, Yanna Karla

2017-01-06

Conditions associated to the consumption of gluten have emerged as a major health care concern and the treatment consists on a lifelong gluten-free diet. Providing safe food for these individuals includes adapting to safety procedures within the food chain and preventing gluten cross-contamination in gluten-free food. However, a gluten cross-contamination prevention protocol or check-list has not yet been validated. Therefore, the aim of this study was to perform the content validation and semantic evaluation of a check-list elaborated for the prevention of gluten cross-contamination in food services. The preliminary version of the check-list was elaborated based on the Brazilian resolution for food safety Collegiate Board Resolution 216 (RDC 216) and Collegiate Board Resolution 275 (RDC 275), the standard 22000 from the International Organization for Standardization (ISO 22000) and the Canadian Celiac Association Gluten-Free Certification Program documents. Seven experts with experience in the area participated in the check-list validation and semantic evaluation. The criteria used for the approval of the items, as to their importance for the prevention of gluten cross-contamination and clarity of the wording, was the achievement of a minimal of 80% of agreement between the experts (W-values ≥ 0.8). Moreover, items should have a mean ≥4 in the evaluation of importance (Likert scale from 1 to 5) and clarity (Likert scale from 0 to 5) in order to be maintained in the instrument. The final version of the check-list was composed of 84 items, divided into 12 sections. After being redesigned and re-evaluated, the items were considered important and comprehensive by the experts (both with W-values ≥ 0.89). The check-list developed was validated with respect to content and approved in the semantic evaluation.

Rating scales for dystonia in cerebral palsy: reliability and validity.

Science.gov (United States)

Monbaliu, E; Ortibus, E; Roelens, F; Desloovere, K; Deklerck, J; Prinzie, P; de Cock, P; Feys, H

2010-06-01

This study investigated the reliability and validity of the Barry-Albright Dystonia Scale (BADS), the Burke-Fahn-Marsden Movement Scale (BFMMS), and the Unified Dystonia Rating Scale (UDRS) in patients with bilateral dystonic cerebral palsy (CP). Three raters independently scored videotapes of 10 patients (five males, five females; mean age 13 y 3 mo, SD 5 y 2 mo, range 5-22 y). One patient each was classified at levels I-IV in the Gross Motor Function Classification System and six patients were classified at level V. Reliability was measured by (1) intraclass correlation coefficient (ICC) for interrater reliability, (2) standard error of measurement (SEM) and smallest detectable difference (SDD), and (3) Cronbach's alpha for internal consistency. Validity was assessed by Pearson's correlations among the three scales used and by content analysis. Moderate to good interrater reliability was found for total scores of the three scales (ICC: BADS=0.87; BFMMS=0.86; UDRS=0.79). However, many subitems showed low reliability, in particular for the UDRS. SEM and SDD were respectively 6.36% and 17.72% for the BADS, 9.88% and 27.39% for the BFMMS, and 8.89% and 24.63% for the UDRS. High internal consistency was found. Pearson's correlations were high. Content validity showed insufficient accordance with the new CP definition and classification. Our results support the internal consistency and concurrent validity of the scales; however, taking into consideration the limitations in reliability, including the large SDD values and the content validity, further research on methods of assessment of dystonia is warranted.

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

Science.gov (United States)

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Development and validation of a questionnaire designed to measure foot-health status.

Science.gov (United States)

Bennett, P J; Patterson, C; Wearing, S; Baglioni, T

1998-09-01

The aim of this study was to apply the principles of content, criterion, and construct validation to a new questionnaire specifically designed to measure foot-health status. One hundred eleven subjects completed two different questionnaires designed to measure foot health (the new Foot Health Status Questionnaire and the previously validated Foot Function Index) and underwent a clinical examination in order to provide data for a second-order confirmatory factor analysis. Presented herein is a psychometrically evaluated questionnaire that contains 13 items covering foot pain, foot function, footwear, and general foot health. The tool demonstrates a high degree of content, criterion, and construct validity and test-retest reliability.

French Translation and Validation of Three Scales Evaluating Stigma in Mental Health

Directory of Open Access Journals (Sweden)

Carla Garcia

2017-12-01

Full Text Available ObjectiveThe concept of stigma refers to problems of knowledge (ignorance, attitudes (prejudice, and behavior (discrimination. Stigma may hinder access to care, housing, and work. In the context of implementation of programs such as “housing first” or “individual placement and support” in French speaking regions, validated instruments measuring stigma are necessary. “Attitudes to Mental Illness 2011” is a questionnaire that includes three scales measuring stigma through these three dimensions. This study aimed to translate, adapt, and validate these three scales in French.MethodsThe “Attitudes to Mental Illness 2011” questionnaire was translated into French and back-translated into English by an expert. Two hundred and sixty-eight nursing students completed the questionnaire. Content validity, face validity, internal validity, and convergent validity were assessed. Long-term reliability was also estimated over a three-month period.ResultsExperts and participants found that the questionnaire’s content validity and face validity were appropriate. The internal validities of the three scales were also considered adequate. Convergent validity indicated that the scales did indeed measure what they were supposed to. Long-term stability estimates were moderate; this pattern of results suggested that the construct targeted by the three scales is adequately measured but does not necessarily represent stable and enduring traits.ConclusionBecause of their good psychometric properties, these three scales can be used in French, either separately, to measure one specific dimension of stigma, or together, to assess stigma in its three dimensions. This would seem of paramount importance in evaluating campaigns against stigma since it allows measures to be adapted according to campaign goals and the target population.

Development, content validity, and cross-cultural adaptation of a patient-reported outcome measure for real-time symptom assessment in irritable bowel syndrome.

Science.gov (United States)

Vork, L; Keszthelyi, D; Mujagic, Z; Kruimel, J W; Leue, C; Pontén, I; Törnblom, H; Simrén, M; Albu-Soda, A; Aziz, Q; Corsetti, M; Holvoet, L; Tack, J; Rao, S S; van Os, J; Quetglas, E G; Drossman, D A; Masclee, A A M

2018-03-01

End-of-day questionnaires, which are considered the gold standard for assessing abdominal pain and other gastrointestinal (GI) symptoms in irritable bowel syndrome (IBS), are influenced by recall and ecological bias. The experience sampling method (ESM) is characterized by random and repeated assessments in the natural state and environment of a subject, and herewith overcomes these limitations. This report describes the development of a patient-reported outcome measure (PROM) based on the ESM principle, taking into account content validity and cross-cultural adaptation. Focus group interviews with IBS patients and expert meetings with international experts in the fields of neurogastroenterology & motility and pain were performed in order to select the items for the PROM. Forward-and-back translation and cognitive interviews were performed to adapt the instrument for the use in different countries and to assure on patients' understanding with the final items. Focus group interviews revealed 42 items, categorized into five domains: physical status, defecation, mood and psychological factors, context and environment, and nutrition and drug use. Experts reduced the number of items to 32 and cognitive interviewing after translation resulted in a few slight adjustments regarding linguistic issues, but not regarding content of the items. An ESM-based PROM, suitable for momentary assessment of IBS symptom patterns was developed, taking into account content validity and cross-cultural adaptation. This PROM will be implemented in a specifically designed smartphone application and further validation in a multicenter setting will follow. © 2017 John Wiley & Sons Ltd.

Development and validation of a premature ejaculation diagnostic tool.

Science.gov (United States)

Symonds, Tara; Perelman, Michael A; Althof, Stanley; Giuliano, François; Martin, Mona; May, Kathryn; Abraham, Lucy; Crossland, Anna; Morris, Mark

2007-08-01

Diagnosis of premature ejaculation (PE) for clinical trial purposes has typically relied on intravaginal ejaculation latency time (IELT) for entry, but this parameter does not capture the multidimensional nature of PE. Therefore, the aim was to develop a brief, multidimensional, psychometrically validated instrument for diagnosing PE status. The questionnaire development involved three stages: (1) Five focus groups and six individual interviews were conducted to develop the content; (2) psychometric validation using three different groups of men; and (3) generation of a scoring system. For psychometric validation/scoring system development, data was collected from (1) men with PE based on clinician diagnosis, using DSM-IV-TR, who also had IELTs or =11 PE. The development and validation of this new PE diagnostic tool has resulted in a new, user-friendly, and brief self-report questionnaire for use in clinical trials to diagnose PE.

Reliability and validity of the McDonald Play Inventory.

Science.gov (United States)

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Validation studies of nursing diagnoses in neonatology

Directory of Open Access Journals (Sweden)

Pavlína Rabasová

2016-03-01

Full Text Available Aim: The objective of the review was the analysis of Czech and foreign literature sources and professional periodicals to obtain a relevant comprehensive overview of validation studies of nursing diagnoses in neonatology. Design: Review. Methods: The selection criterion was studies concerning the validation of nursing diagnoses in neonatology. To obtain data from relevant sources, the licensed professional databases EBSCO, Web of Science and Scopus were utilized. The search criteria were: date of publication - unlimited; academic periodicals - full text; peer-reviewed periodicals; search language - English, Czech and Slovak. Results: A total of 788 studies were found. Only 5 studies were eligible for content analysis, dealing specifically with validation of nursing diagnoses in neonatology. The analysis of the retrieved studies suggests that authors are most often concerned with identifying the defining characteristics of nursing diagnoses applicable to both the mother (parents and the newborn. The diagnoses were validated in the domains Role Relationship; Coping/Stress tolerance; Activity/Rest, and Elimination and Exchange. Diagnoses represented were from the field of dysfunctional physical needs as well as the field of psychosocial and spiritual needs. The diagnoses were as follows: Parental role conflict (00064; Impaired parenting (00056; Grieving (00136; Ineffective breathing pattern (00032; Impaired gas exchange (00030; and Impaired spontaneous ventilation (00033. Conclusion: Validation studies enable effective planning of interventions with measurable results and support clinical nursing practice.

Development and validation of Incontinence - Activity Participation Scale for spinal cord injury.

Science.gov (United States)

Walia, Priya; Kaur, Jaskirat

2017-01-01

We aimed to develop and validate an Incontinence - Activity Participation Scale (I-APS) for measurement of activity limitation and participation restriction due to bladder problems in spinal cord injury (SCI). The process of development was initiated by formation of open-ended questions after thorough review of literature which were then administered to SCI participants, caretakers, and professionals working with SCI. Items were generated based on their responses and initial draft of scale was formulated. This initial draft of the scale containing 77 items was then administered to 56 SCI participants for reduction of items using factor analysis, and a prefinal version of the scale was obtained containing thirty items only. Content validity and face validity was then established. The I-APS is both health professional and self-administered questionnaire including two domains: Activities of daily living and occupation with 16 items having a content validity of 0.84. The overall internal consistency reliability was 0.86. The I-APS is a valid, comprehensive instrument that measures the activity limitation and participation restrictions due to bladder problems in SCI.

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

Science.gov (United States)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Safe pediatric surgery: development and validation of preoperative interventions checklist

Directory of Open Access Journals (Sweden)

Maria Paula de Oliveira Pires

2013-09-01

Full Text Available OBJECTIVES: this study was aimed at developing and validating a checklist of preoperative pediatric interventions related to the safety of surgical patients. METHOD: methodological study concerning the construction and validation of an instrument with safe preoperative care indicators. The checklist was subject to validation through the Delphi technique, establishing a consensus level of 80%. RESULTS: five professional specialists in the area conducted the validation and a consensus on the content and the construct was reached after two applications of the Delphi technique. CONCLUSION: the "Safe Pediatric Surgery Checklist", simulating the preoperative trajectory of children, is an instrument capable of contributing to the preparation and promotion of safe surgery, as it identifies the presence or absence of measures required to promote patient safety.

Principles of Proper Validation

DEFF Research Database (Denmark)

Esbensen, Kim; Geladi, Paul

2010-01-01

to suffer from the same deficiencies. The PPV are universal and can be applied to all situations in which the assessment of performance is desired: prediction-, classification-, time series forecasting-, modeling validation. The key element of PPV is the Theory of Sampling (TOS), which allow insight......) is critically necessary for the inclusion of the sampling errors incurred in all 'future' situations in which the validated model must perform. Logically, therefore, all one data set re-sampling approaches for validation, especially cross-validation and leverage-corrected validation, should be terminated...

Validation of virtual learning object to support the teaching of nursing care systematization

Directory of Open Access Journals (Sweden)

Pétala Tuani Candido de Oliveira Salvador

Full Text Available ABSTRACT Objective: to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. Method: methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. Results: in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. Conclusion: it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Internal consistency and content validity of a questionnaire aimed to assess the stages of behavioral lifestyle changes in Colombian schoolchildren: The Fuprecol study

Directory of Open Access Journals (Sweden)

Yasmira CARRILLO-BERNATE

Full Text Available ABSTRACT Objective To assess internal consistency and content validity of a questionnaire aimed to assess the stages of Behavioural Lifestyle Changes in a sample of school-aged children and adolescents aged 9 to 17 years-old. Methods This validation study involved 675 schoolchildren from three official school in the city of Bogota, Colombia. A self-administered questionnaire called Behavioural Lifestyle Changes has been designed to explore stages of change regarding to physical activity/exercise, fruit and vegetable consumption, alcohol abuse, tobacco use, and drug abuse. Cronbach-α, Kappa index and exploratory factor analysis were used for evaluating the internal consistency and validity of content, respectively. Results The study population consisted of 51.1% males and the participants’ average age was 12.7±2.4 years-old. Behavioural Lifestyle Changes scored 0.720 (range 0.691 to 0.730 on the Cronbach α and intra-observer reproducibility was good (Kappa=0.71. Exploratory factor analysis determined two factors (factor 1: physical activity/exercise, fruit and vegetable consumption, and factor 2: alcohol abuse tobacco use and drug abuse, explaining 67.78% of variance by the items and six interactions χ2/gL=11649.833; p<0.001. Conclusion Behavioural Lifestyle Changes Questionnaire was seen to have suitable internal consistency and validity. This instrument can be recommended, mainly within the context of primary attention for studying the stages involved in the lifestyle behavioural changes model on a school-based population.

Validation of the Goal Content for Exercise Questionnaire (GCEQ for a sample of elderly Portuguese people

Directory of Open Access Journals (Sweden)

Raul Antunes

2017-06-01

Full Text Available According Sebire, Standage and Vansteenkiste (2008, goals contents (motives are the major drivers of behavior, giving rise to the goal content theory, which is in the basis of Goal Content for Exercise Questionnaire (GCEQ: Sebire et al., 2008 development. So, the main goal of present study was to conduct the validation of GCEQ for a sample of Portuguese elderly (n = 311, with equal or higher ages than 60 years old (M = 68.53; DP = 6.69. The main results show us that CGEQ measurement model (5 factors, 20 items only present adequate fit to data after the elimination of 3 items: S-Bχ²=219.9, df=109, p=.001, SRMR=.049, TLI=.916, CFI=.934, RMSEA=.057, RMSEA 90% CI=.046-.068, PCFI=.747. Besides that, the 5 factors show us acceptable values of composite reliability: between .76 and .88. Those findings allow us to conclude that GCEQ with 5 factors and 17 items can be used to measure goal content in a population of elderly Portuguese people in physical activity domain.

The Quality of Life Scale (QOLS: Reliability, Validity, and Utilization

Directory of Open Access Journals (Sweden)

Anderson Kathryn L

2003-10-01

Full Text Available Abstract The Quality of Life Scale (QOLS, created originally by American psychologist John Flanagan in the 1970's, has been adapted for use in chronic illness groups. This paper reviews the development and psychometric testing of the QOLS. A descriptive review of the published literature was undertaken and findings summarized in the frequently asked questions format. Reliability, content and construct validity testing has been performed on the QOLS and a number of translations have been made. The QOLS has low to moderate correlations with physical health status and disease measures. However, content validity analysis indicates that the instrument measures domains that diverse patient groups with chronic illness define as quality of life. The QOLS is a valid instrument for measuring quality of life across patient groups and cultures and is conceptually distinct from health status or other causal indicators of quality of life.

Vivaldi: Visualization and validation of biomacromolecular NMR structures from the PDB

Science.gov (United States)

Hendrickx, Pieter M S; Gutmanas, Aleksandras; Kleywegt, Gerard J

2013-01-01

We describe Vivaldi (VIsualization and VALidation DIsplay; http://pdbe.org/vivaldi), a web-based service for the analysis, visualization, and validation of NMR structures in the Protein Data Bank (PDB). Vivaldi provides access to model coordinates and several types of experimental NMR data using interactive visualization tools, augmented with structural annotations and model-validation information. The service presents information about the modeled NMR ensemble, validation of experimental chemical shifts, residual dipolar couplings, distance and dihedral angle constraints, as well as validation scores based on empirical knowledge and databases. Vivaldi was designed for both expert NMR spectroscopists and casual non-expert users who wish to obtain a better grasp of the information content and quality of NMR structures in the public archive. © Proteins 2013. © 2012 Wiley Periodicals, Inc. PMID:23180575

Development and Validation of a Persian Version of Dichotic Emotional Word Test

Directory of Open Access Journals (Sweden)

Atefe Davudazde

2016-03-01

Full Text Available Introduction: Emotional words in comparison with neutral words have different hemispheric specialization. It is assumed that the right hemisphere has a role in processing every kind of emotional word. The objective of the present study was the development of a Persian version of the dichotic emotional word test and evaluate its validation among adult Persian speakers.   Materials and Methods: The present study was done on 60 adults, with the age ranging from 18-30 years for both genders, who had no history of neurological disorders with normal hearing. The developed test included eight main lists; each had several dichotic emotional/ neutral pairs of words. Participants were asked to recall as many words in each list as they could after they listened to them. A content validity index was used to analyze the validity of the test.   Results: The mean content validity index score was 0.94. The findings showed that in the left ear, emotional words were remembered more than neutral ones (P=0.007. While in the right ear, neutral words were remembered more (P=0.009. There were no significant differences in male and female scores.   Conclusion:  Dichotic emotional word test has a high content validity. The ability to remember emotional words better in the left ear supports the dominant role of the right hemisphere in emotional word perception.

Validation of a questionnaire of knowledge about asthma

International Nuclear Information System (INIS)

Rodriguez Martinez, Carlos; Sossa, Monica Patricia

2004-01-01

An educative intervention destined to increase the knowledge in asthma allows the children and/or its parents to acquire abilities that allow to prevent and/or to handle the asthmatic attacks, decreasing the morbidity produced by the disease, nevertheless we do not account with a validated instrument that allows us to quantify the level of asthma knowledge. The objective is to develop and to validate a questionnaire of knowledge about asthma to be filled out by the parents and/or people in charge of the care of the asthmatic pediatric patients. The 17 items that conform the questionnaire were obtained alter literature review, realization of focal groups the professional experience of the investigators and the realization of pilot studies. The face content and concurrent validity of the instrument was evaluated; we also determined the factor structure, test-retest reproducibility, and sensitivity to change of the questionnaire. We included 120 patients with average age of 4.5 %3.7 years the factor analysis demonstrated a probable structure of three factors that altogether explain 85% of the total variance of the results the face and content validity was based on the concept of a multi-disciplinary group of experts in the field the concurrent validity was demonstrated by the ability of the questionnaire to distinguish low from high knowledge parents. Test-retest reproducibility and sensitivity to change were demonstrated comparing scores of the questionnaire filled out in two different occasions. The questionnaire of knowledge of asthma developed in the study is a useful and reliable tool to quantify the basal level of asthma knowledge in parents of asthmatic children and to determine the effectiveness of an educative intervention destined to increase the knowledge and understanding of the disease

Development and validation of the coping with terror scale.

Science.gov (United States)

Stein, Nathan R; Schorr, Yonit; Litz, Brett T; King, Lynda A; King, Daniel W; Solomon, Zahava; Horesh, Danny

2013-10-01

Terrorism creates lingering anxiety about future attacks. In prior terror research, the conceptualization and measurement of coping behaviors were constrained by the use of existing coping scales that index reactions to daily hassles and demands. The authors created and validated the Coping with Terror Scale to fill the measurement gap. The authors emphasized content validity, leveraging the knowledge of terror experts and groups of Israelis. A multistep approach involved construct definition and item generation, trimming and refining the measure, exploring the factor structure underlying item responses, and garnering evidence for reliability and validity. The final scale comprised six factors that were generally consistent with the authors' original construct specifications. Scores on items linked to these factors demonstrate good reliability and validity. Future studies using the Coping with Terror Scale with other populations facing terrorist threats are needed to test its ability to predict resilience, functional impairment, and psychological distress.

Translation, cultural adaptation and validation of the Diabetes Attitudes Scale - third version into Brazilian Portuguese 1

Science.gov (United States)

Vieira, Gisele de Lacerda Chaves; Pagano, Adriana Silvino; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Torres, Heloísa de Carvalho

2018-01-01

ABSTRACT Objective: to perform the translation, adaptation and validation of the Diabetes Attitudes Scale - third version instrument into Brazilian Portuguese. Methods: methodological study carried out in six stages: initial translation, synthesis of the initial translation, back-translation, evaluation of the translated version by the Committee of Judges (27 Linguists and 29 health professionals), pre-test and validation. The pre-test and validation (test-retest) steps included 22 and 120 health professionals, respectively. The Content Validity Index, the analyses of internal consistency and reproducibility were performed using the R statistical program. Results: in the content validation, the instrument presented good acceptance among the Judges with a mean Content Validity Index of 0.94. The scale presented acceptable internal consistency (Cronbach’s alpha = 0.60), while the correlation of the total score at the test and retest moments was considered high (Polychoric Correlation Coefficient = 0.86). The Intra-class Correlation Coefficient, for the total score, presented a value of 0.65. Conclusion: the Brazilian version of the instrument (Escala de Atitudes dos Profissionais em relação ao Diabetes Mellitus) was considered valid and reliable for application by health professionals in Brazil. PMID:29319739

Validation of the Foot and Ankle Outcome Score in adult acquired flatfoot deformity.

Science.gov (United States)

Mani, Sriniwasan B; Brown, Haydée C; Nair, Pallavi; Chen, Lan; Do, Huong T; Lyman, Stephen; Deland, Jonathan T; Ellis, Scott J

2013-08-01

The American Orthopaedic Foot and Ankle Society (AOFAS) Ankle-Hindfoot Score has been under recent scrutiny. The Foot and Ankle Outcome Score (FAOS) is an alternative subjective survey, assessing outcomes in 5 subscales. It is validated for lateral ankle instability and hallux valgus patients. The aim of our study was to validate the FAOS for assessing outcomes in flexible adult acquired flatfoot deformity (AAFD). Patients from the authors' institution diagnosed with flexible AAFD from 2006 to 2011 were eligible for the study. In all, 126 patients who completed the FAOS and the Short-Form 12 (SF-12) on the same visit were included in the construct validity component. Correlation was deemed moderate if the Spearman's correlation coefficient was .4 to .7. Content validity was assessed in 63 patients by a questionnaire that asked patients to rate the relevance of each FAOS question, with a score of 2 or greater considered acceptable. Reliability was measured using intraclass correlation coefficients (ICCs) in 41 patients who completed a second FAOS survey. In 49 patients, preoperative and postoperative FAOS scores were compared to determine responsiveness. All of the FAOS subscales demonstrated moderate correlation with 2 physical health related SF-12 domains. Mental health related domains showed poor correlation. Content validity was high for the Quality of Life (QoL; mean 2.26) and Sports/Recreation subscales (mean 2.12). All subscales exhibited very good test-retest reliability, with ICCs of .7 and above. Symptoms, QoL, pain, and daily activities (ADLs) were responsive to change in postoperative patients (P validated the FAOS for AAFD with acceptable construct and content validity, reliability, and responsiveness. Given its previous validation for patients with ankle instability and hallux valgus, the additional findings in this study support its use as an alternative to less reliable outcome surveys. Level II, prospective comparative study.

Groundwater Model Validation

Energy Technology Data Exchange (ETDEWEB)

Ahmed E. Hassan

2006-01-24

Models have an inherent uncertainty. The difficulty in fully characterizing the subsurface environment makes uncertainty an integral component of groundwater flow and transport models, which dictates the need for continuous monitoring and improvement. Building and sustaining confidence in closure decisions and monitoring networks based on models of subsurface conditions require developing confidence in the models through an iterative process. The definition of model validation is postulated as a confidence building and long-term iterative process (Hassan, 2004a). Model validation should be viewed as a process not an end result. Following Hassan (2004b), an approach is proposed for the validation process of stochastic groundwater models. The approach is briefly summarized herein and detailed analyses of acceptance criteria for stochastic realizations and of using validation data to reduce input parameter uncertainty are presented and applied to two case studies. During the validation process for stochastic models, a question arises as to the sufficiency of the number of acceptable model realizations (in terms of conformity with validation data). Using a hierarchical approach to make this determination is proposed. This approach is based on computing five measures or metrics and following a decision tree to determine if a sufficient number of realizations attain satisfactory scores regarding how they represent the field data used for calibration (old) and used for validation (new). The first two of these measures are applied to hypothetical scenarios using the first case study and assuming field data consistent with the model or significantly different from the model results. In both cases it is shown how the two measures would lead to the appropriate decision about the model performance. Standard statistical tests are used to evaluate these measures with the results indicating they are appropriate measures for evaluating model realizations. The use of validation

Verification and validation in computational fluid dynamics

Science.gov (United States)

Oberkampf, William L.; Trucano, Timothy G.

2002-04-01

from traditional experiments and testing. A description is given of a relatively new procedure for estimating experimental uncertainty that has proven more effective at estimating random and correlated bias errors in wind-tunnel experiments than traditional methods. Consistent with the authors’ contention that nondeterministic simulations are needed in many validation comparisons, a three-step statistical approach is offered for incorporating experimental uncertainties into the computational analysis. The discussion of validation assessment ends with the topic of validation metrics, where two sample problems are used to demonstrate how such metrics should be constructed. In the spirit of advancing the state of the art in V&V, the paper concludes with recommendations of topics for future research and with suggestions for needed changes in the implementation of V&V in production and commercial software.

CosmoQuest:Using Data Validation for More Than Just Data Validation

Science.gov (United States)

Lehan, C.; Gay, P.

2016-12-01

It is often taken for granted that different scientists completing the same task (e.g. mapping geologic features) will get the same results, and data validation is often skipped or under-utilized due to time and funding constraints. Robbins et. al (2014), however, demonstrated that this is a needed step, as large variation can exist even among collaborating team members completing straight-forward tasks like marking craters. Data Validation should be much more than a simple post-project verification of results. The CosmoQuest virtual research facility employs regular data-validation for a variety of benefits, including real-time user feedback, real-time tracking to observe user activity while it's happening, and using pre-solved data to analyze users' progress and to help them retain skills. Some creativity in this area can drastically improve project results. We discuss methods of validating data in citizen science projects and outline the variety of uses for validation, which, when used properly, improves the scientific output of the project and the user experience for the citizens doing the work. More than just a tool for scientists, validation can assist users in both learning and retaining important information and skills, improving the quality and quantity of data gathered. Real-time analysis of user data can give key information in the effectiveness of the project that a broad glance would miss, and properly presenting that analysis is vital. Training users to validate their own data, or the data of others, can significantly improve the accuracy of misinformed or novice users.

Global approach for the validation of an in-line Raman spectroscopic method to determine the API content in real-time during a hot-melt extrusion process.

Science.gov (United States)

Netchacovitch, L; Thiry, J; De Bleye, C; Dumont, E; Cailletaud, J; Sacré, P-Y; Evrard, B; Hubert, Ph; Ziemons, E

2017-08-15

Since the Food and Drug Administration (FDA) published a guidance based on the Process Analytical Technology (PAT) approach, real-time analyses during manufacturing processes are in real expansion. In this study, in-line Raman spectroscopic analyses were performed during a Hot-Melt Extrusion (HME) process to determine the Active Pharmaceutical Ingredient (API) content in real-time. The method was validated based on a univariate and a multivariate approach and the analytical performances of the obtained models were compared. Moreover, on one hand, in-line data were correlated with the real API concentration present in the sample quantified by a previously validated off-line confocal Raman microspectroscopic method. On the other hand, in-line data were also treated in function of the concentration based on the weighing of the components in the prepared mixture. The importance of developing quantitative methods based on the use of a reference method was thus highlighted. The method was validated according to the total error approach fixing the acceptance limits at ±15% and the α risk at ±5%. This method reaches the requirements of the European Pharmacopeia norms for the uniformity of content of single-dose preparations. The validation proves that future results will be in the acceptance limits with a previously defined probability. Finally, the in-line validated method was compared with the off-line one to demonstrate its ability to be used in routine analyses. Copyright © 2017 Elsevier B.V. All rights reserved.

Construction and validation of educational materials for the prevention of metabolic syndrome in adolescents.

Science.gov (United States)

Moura, Ionara Holanda de; Silva, Antônia Fabiana Rodrigues da; Rocha, Aparecida do Espírito Santo de Holanda; Lima, Luisa Helena de Oliveira; Moreira, Thereza Maria Magalhães; Silva, Ana Roberta Vilarouca da

2017-10-05

To develop and validate an educational technology focused on prevention of metabolic syndrome among adolescents. This was methodological research. Using an integrative review, the available publications on the subject were analyzed. Then, this knowledge was used to describe the theoretical content and, with the help of a graphic designer, the art and layout of the pages were developed. In the third phase, the booklet was evaluated and validated by 21 specialists and 39 adolescents. Data collection included three different questionnaires, according to the focus of evaluation of each group of participants, analyzed for reliability (Cronbach's Alpha) and agreement by Infraclass Correlation Coefficient. The mean score attributed by technical content experts was 91.7%, and the content validity index, measured by experts responses, was 0.98, showing high reliability and agreement. In addition, the level of agreement of the positive responses given by adolescents was 88.4%. the educational booklet has proved to be a valid and reliable tool to be used for promoting adolescent health.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

Science.gov (United States)

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

Validation of a novel laparoscopic adjustable gastric band simulator.

Science.gov (United States)

Sankaranarayanan, Ganesh; Adair, James D; Halic, Tansel; Gromski, Mark A; Lu, Zhonghua; Ahn, Woojin; Jones, Daniel B; De, Suvranu

2011-04-01

Morbid obesity accounts for more than 90,000 deaths per year in the United States. Laparoscopic adjustable gastric banding (LAGB) is the second most common weight loss procedure performed in the US and the most common in Europe and Australia. Simulation in surgical training is a rapidly advancing field that has been adopted by many to prepare surgeons for surgical techniques and procedures. The aim of our study was to determine face, construct, and content validity for a novel virtual reality laparoscopic adjustable gastric band simulator. Twenty-eight subjects were categorized into two groups (expert and novice), determined by their skill level in laparoscopic surgery. Experts consisted of subjects who had at least 4 years of laparoscopic training and operative experience. Novices consisted of subjects with medical training but with less than 4 years of laparoscopic training. The subjects used the virtual reality laparoscopic adjustable band surgery simulator. They were automatically scored according to various tasks. The subjects then completed a questionnaire to evaluate face and content validity. On a 5-point Likert scale (1 = lowest score, 5 = highest score), the mean score for visual realism was 4.00 ± 0.67 and the mean score for realism of the interface and tool movements was 4.07 ± 0.77 (face validity). There were significant differences in the performances of the two subject groups (expert and novice) based on total scores (p virtual reality laparoscopic adjustable gastric band simulator. Our initial results demonstrate excellent face, construct, and content validity findings. To our knowledge, this is the first virtual reality simulator with haptic feedback for training residents and surgeons in the laparoscopic adjustable gastric banding procedure.

Validation of the Narrowing Beam Walking Test in Lower Limb Prosthesis Users.

Science.gov (United States)

Sawers, Andrew; Hafner, Brian

2018-04-11

To evaluate the content, construct, and discriminant validity of the Narrowing Beam Walking Test (NBWT), a performance-based balance test for lower limb prosthesis users. Cross-sectional study. Research laboratory and prosthetics clinic. Unilateral transtibial and transfemoral prosthesis users (N=40). Not applicable. Content validity was examined by quantifying the percentage of participants receiving maximum or minimum scores (ie, ceiling and floor effects). Convergent construct validity was examined using correlations between participants' NBWT scores and scores or times on existing clinical balance tests regularly administered to lower limb prosthesis users. Known-groups construct validity was examined by comparing NBWT scores between groups of participants with different fall histories, amputation levels, amputation etiologies, and functional levels. Discriminant validity was evaluated by analyzing the area under each test's receiver operating characteristic (ROC) curve. No minimum or maximum scores were recorded on the NBWT. NBWT scores demonstrated strong correlations (ρ=.70‒.85) with scores/times on performance-based balance tests (timed Up and Go test, Four Square Step Test, and Berg Balance Scale) and a moderate correlation (ρ=.49) with the self-report Activities-specific Balance Confidence scale. NBWT performance was significantly lower among participants with a history of falls (P=.003), transfemoral amputation (P=.011), and a lower mobility level (P.50 (ie, chance). The results provide strong evidence of content, construct, and discriminant validity for the NBWT as a performance-based test of balance ability. The evidence supports its use to assess balance impairments and fall risk in unilateral transtibial and transfemoral prosthesis users. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Assessment of teacher competence using video portfolios: reliability, construct validity and consequential validity

NARCIS (Netherlands)

Admiraal, W.; Hoeksma, M.; van de Kamp, M.-T.; van Duin, G.

2011-01-01

The richness and complexity of video portfolios endanger both the reliability and validity of the assessment of teacher competencies. In a post-graduate teacher education program, the assessment of video portfolios was evaluated for its reliability, construct validity, and consequential validity.

Quality data validation: Comprehensive approach to environmental data validation

International Nuclear Information System (INIS)

Matejka, L.A. Jr.

1993-01-01

Environmental data validation consists of an assessment of three major areas: analytical method validation; field procedures and documentation review; evaluation of the level of achievement of data quality objectives based in part on PARCC parameters analysis and expected applications of data. A program utilizing matrix association of required levels of validation effort and analytical levels versus applications of this environmental data was developed in conjunction with DOE-ID guidance documents to implement actions under the Federal Facilities Agreement and Consent Order in effect at the Idaho National Engineering Laboratory. This was an effort to bring consistent quality to the INEL-wide Environmental Restoration Program and database in an efficient and cost-effective manner. This program, documenting all phases of the review process, is described here

Optimization and validation of Folin-Ciocalteu method for the determination of total polyphenol content of Pu-erh tea.

Science.gov (United States)

Musci, Marilena; Yao, Shicong

2017-12-01

Pu-erh tea is a post-fermented tea that has recently gained popularity worldwide, due to potential health benefits related to the antioxidant activity resulting from its high polyphenolic content. The Folin-Ciocalteu method is a simple, rapid, and inexpensive assay widely applied for the determination of total polyphenol content. Over the past years, it has been subjected to many modifications, often without any systematic optimization or validation. In our study, we sought to optimize the Folin-Ciocalteu method, evaluate quality parameters including linearity, precision and stability, and then apply the optimized model to determine the total polyphenol content of 57 Chinese teas, including green tea, aged and ripened Pu-erh tea. Our optimized Folin-Ciocalteu method reduced analysis time, allowed for the analysis of a large number of samples, to discriminate among the different teas, and to assess the effect of the post-fermentation process on polyphenol content.

Validity of Scientific Based Chemistry Android Module to Empower Science Process Skills (SPS) in Solubility Equilibrium

Science.gov (United States)

Antrakusuma, B.; Masykuri, M.; Ulfa, M.

2018-04-01

Evolution of Android technology can be applied to chemistry learning, one of the complex chemistry concept was solubility equilibrium. this concept required the science process skills (SPS). This study aims to: 1) Characteristic scientific based chemistry Android module to empowering SPS, and 2) Validity of the module based on content validity and feasibility test. This research uses a Research and Development approach (RnD). Research subjects were 135 s1tudents and three teachers at three high schools in Boyolali, Central of Java. Content validity of the module was tested by seven experts using Aiken’s V technique, and the module feasibility was tested to students and teachers in each school. Characteristics of chemistry module can be accessed using the Android device. The result of validation of the module contents got V = 0.89 (Valid), and the results of the feasibility test Obtained 81.63% (by the student) and 73.98% (by the teacher) indicates this module got good criteria.

Validation of Symptom Validity Tests Using a "Child-model" of Adult Cognitive Impairments

NARCIS (Netherlands)

Rienstra, A.; Spaan, P. E. J.; Schmand, B.

2010-01-01

Validation studies of symptom validity tests (SVTs) in children are uncommon. However, since children's cognitive abilities are not yet fully developed, their performance may provide additional support for the validity of these measures in adult populations. Four SVTs, the Test of Memory Malingering

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

Science.gov (United States)

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Validation of symptom validity tests using a "child-model" of adult cognitive impairments

NARCIS (Netherlands)

Rienstra, A.; Spaan, P.E.J.; Schmand, B.

2010-01-01

Validation studies of symptom validity tests (SVTs) in children are uncommon. However, since children’s cognitive abilities are not yet fully developed, their performance may provide additional support for the validity of these measures in adult populations. Four SVTs, the Test of Memory Malingering

Computerized content analysis of some adolescent writings of Napoleon Bonaparte: a test of the validity of the method.

Science.gov (United States)

Gottschalk, Louis A; DeFrancisco, Don; Bechtel, Robert J

2002-08-01

The aim of this study was to test the validity of a computer software program previously demonstrated to be capable of making DSM-IV neuropsychiatric diagnoses from the content analysis of speech or verbal texts. In this report, the computer program was applied to three personal writings of Napoleon Bonaparte when he was 12 to 16 years of age. The accuracy of the neuropsychiatric evaluations derived from the computerized content analysis of these writings of Napoleon was independently corroborated by two biographers who have described pertinent details concerning his life situations, moods, and other emotional reactions during this adolescent period of his life. The relevance of this type of computer technology to psychohistorical research and clinical psychiatry is suggested.

Development and validation of educational technology for venous ulcer care.

Science.gov (United States)

Benevides, Jéssica Lima; Coutinho, Janaina Fonseca Victor; Pascoal, Liliane Chagas; Joventino, Emanuella Silva; Martins, Mariana Cavalcante; Gubert, Fabiane do Amaral; Alves, Allana Mirella

2016-04-01

To develop and validate an educational technology venous ulcers care. Methodological study conducted in five steps: Situational diagnosis; literature review; development of texts, illustrations and layout; apparent and content validity by the Content Validity Index, assessment of Flesch Readability Index; and pilot testing. The developed technology was a type of booklet entitled Booklet for Venous Ulcers Care, consisting of seven topics: Diet and food intake, walking and light exercise, resting with elevated leg, bandage care, compression therapy, family support, and keeping healthy habits. The apparent validity revealed minimal agreement of 85.7% in the clarity and comprehensibility. The total content validity index was 0.97, the Flesch Readability Index was 75%, corresponding to the reading "fairly easy". The pilot test showed that 100% of people with venous ulcers evaluated the text and the illustrations as understandable, as appropriate. The educational technology proved to be valid for the appearance and content with potential for use in clinical practice. Construir e validar uma tecnologia educativa para cuidados com úlcera venosa. Estudo metodológico realizado em cinco fases: diagnóstico situacional; revisão da literatura; desenvolvimento de textos, ilustrações e diagramação; validade de aparência e de conteúdo pelo Índice de Validade de Conteúdo, avaliação do Índice de Legibilidade de Flesch; e teste piloto. A tecnologia desenvolvida foi do tipo cartilha intitulada Cartilha para cuidados com úlcera venosa, constituída de sete tópicos: Alimentação, Caminhadas e exercícios leves, Repouso com a perna elevada, Cuidados com o curativo, Terapia compressiva, Apoio familiar, e manter hábitos saudáveis. A validade aparente revelou concordância mínima de 85,7% na clareza e compreensibilidade. O Índice de Validade de Conteúdo total foi de 0,97, o Índice de legibilidade de Flesch foi de 75%, o que correspondeu à leitura "razoavelmente f

Validation of persuasive messages for the promotion of physical activity among people with coronary heart disease.

Science.gov (United States)

Mendez, Roberto Della Rosa; Rodrigues, Roberta Cunha Matheus; Spana, Thaís Moreira; Cornélio, Marília Estevam; Gallani, Maria Cecília Bueno Jayme; Pérez-Nebra, Amalia Raquel

2012-01-01

to validate the content of persuasive messages for promoting walking among patients with coronary heart disease (CHD). The messages were constructed to strengthen or change patients' attitudes to walking. the selection of persuasive arguments was based on behavioral beliefs (determinants of attitude) related to walking. The messages were constructed based in the Elaboration Likelihood Model and were submitted to content validation. the data was analyzed with the content validity index and by the importance which the patients attributed to the messages' persuasive arguments. Positive behavioral beliefs (i.e. positive and negative reinforcement) and self-efficacy were the appeals which the patients considered important. The messages with validation evidence will be tested in an intervention study for the promotion of the practice of physical activity among patients with CHD.

Validation of Collett-Lester's Fear of Death Scale in a sample of nursing students

Directory of Open Access Journals (Sweden)

Maritza Espinoza Venegas

Full Text Available This study aims to evaluate the psychometric properties of Collett-Lester's Fear of Death Scale. A sample of 349 nursing students answered Fear of Death and Attitude toward death scales. Content validity was checked by expert review; reliability was proven using Cronbach's alpha; statistical analysis of the items, correlation between items and construct validity were checked by the correlation of the Scale with the Attitude toward death Scale. The multidimensionality of the scale was reviewed through factor analysis with varimax rotation. The Fear of Death Scale possesses good internal consistency and construct validity, confirmed by the significant correlation with the Attitude toward death Scale. Factor analysis partially supports content validity of the subscale items, but presented a modified multidimensional structure that points towards the reconceptualization of the subscales in this sample.

Model Validation Status Review

International Nuclear Information System (INIS)

E.L. Hardin

2001-01-01

The primary objective for the Model Validation Status Review was to perform a one-time evaluation of model validation associated with the analysis/model reports (AMRs) containing model input to total-system performance assessment (TSPA) for the Yucca Mountain site recommendation (SR). This review was performed in response to Corrective Action Request BSC-01-C-01 (Clark 2001, Krisha 2001) pursuant to Quality Assurance review findings of an adverse trend in model validation deficiency. The review findings in this report provide the following information which defines the extent of model validation deficiency and the corrective action needed: (1) AMRs that contain or support models are identified, and conversely, for each model the supporting documentation is identified. (2) The use for each model is determined based on whether the output is used directly for TSPA-SR, or for screening (exclusion) of features, events, and processes (FEPs), and the nature of the model output. (3) Two approaches are used to evaluate the extent to which the validation for each model is compliant with AP-3.10Q (Analyses and Models). The approaches differ in regard to whether model validation is achieved within individual AMRs as originally intended, or whether model validation could be readily achieved by incorporating information from other sources. (4) Recommendations are presented for changes to the AMRs, and additional model development activities or data collection, that will remedy model validation review findings, in support of licensing activities. The Model Validation Status Review emphasized those AMRs that support TSPA-SR (CRWMS M and O 2000bl and 2000bm). A series of workshops and teleconferences was held to discuss and integrate the review findings. The review encompassed 125 AMRs (Table 1) plus certain other supporting documents and data needed to assess model validity. The AMRs were grouped in 21 model areas representing the modeling of processes affecting the natural and

Model Validation Status Review

Energy Technology Data Exchange (ETDEWEB)

E.L. Hardin

2001-11-28

The primary objective for the Model Validation Status Review was to perform a one-time evaluation of model validation associated with the analysis/model reports (AMRs) containing model input to total-system performance assessment (TSPA) for the Yucca Mountain site recommendation (SR). This review was performed in response to Corrective Action Request BSC-01-C-01 (Clark 2001, Krisha 2001) pursuant to Quality Assurance review findings of an adverse trend in model validation deficiency. The review findings in this report provide the following information which defines the extent of model validation deficiency and the corrective action needed: (1) AMRs that contain or support models are identified, and conversely, for each model the supporting documentation is identified. (2) The use for each model is determined based on whether the output is used directly for TSPA-SR, or for screening (exclusion) of features, events, and processes (FEPs), and the nature of the model output. (3) Two approaches are used to evaluate the extent to which the validation for each model is compliant with AP-3.10Q (Analyses and Models). The approaches differ in regard to whether model validation is achieved within individual AMRs as originally intended, or whether model validation could be readily achieved by incorporating information from other sources. (4) Recommendations are presented for changes to the AMRs, and additional model development activities or data collection, that will remedy model validation review findings, in support of licensing activities. The Model Validation Status Review emphasized those AMRs that support TSPA-SR (CRWMS M&O 2000bl and 2000bm). A series of workshops and teleconferences was held to discuss and integrate the review findings. The review encompassed 125 AMRs (Table 1) plus certain other supporting documents and data needed to assess model validity. The AMRs were grouped in 21 model areas representing the modeling of processes affecting the natural and

Anxiety measures validated in perinatal populations: a systematic review.

Science.gov (United States)

Meades, Rose; Ayers, Susan

2011-09-01

Research and screening of anxiety in the perinatal period is hampered by a lack of psychometric data on self-report anxiety measures used in perinatal populations. This paper aimed to review self-report measures that have been validated with perinatal women. A systematic search was carried out of four electronic databases. Additional papers were obtained through searching identified articles. Thirty studies were identified that reported validation of an anxiety measure with perinatal women. Most commonly validated self-report measures were the General Health Questionnaire (GHQ), State-Trait Anxiety Inventory (STAI), and Hospital Anxiety and Depression Scales (HADS). Of the 30 studies included, 11 used a clinical interview to provide criterion validity. Remaining studies reported one or more other forms of validity (factorial, discriminant, concurrent and predictive) or reliability. The STAI shows criterion, discriminant and predictive validity and may be most useful for research purposes as a specific measure of anxiety. The Kessler 10 (K-10) may be the best short screening measure due to its ability to differentiate anxiety disorders. The Depression Anxiety Stress Scales 21 (DASS-21) measures multiple types of distress, shows appropriate content, and remains to be validated against clinical interview in perinatal populations. Nineteen studies did not report sensitivity or specificity data. The early stages of research into perinatal anxiety, the multitude of measures in use, and methodological differences restrict comparison of measures across studies. There is a need for further validation of self-report measures of anxiety in the perinatal period to enable accurate screening and detection of anxiety symptoms and disorders. Copyright © 2010 Elsevier B.V. All rights reserved.

The smartphone addiction scale: development and validation of a short version for adolescents.

Science.gov (United States)

Kwon, Min; Kim, Dai-Jin; Cho, Hyun; Yang, Soo

2013-01-01

This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (psmartphone addiction (psmartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas.

FastaValidator: an open-source Java library to parse and validate FASTA formatted sequences.

Science.gov (United States)

Waldmann, Jost; Gerken, Jan; Hankeln, Wolfgang; Schweer, Timmy; Glöckner, Frank Oliver

2014-06-14

Advances in sequencing technologies challenge the efficient importing and validation of FASTA formatted sequence data which is still a prerequisite for most bioinformatic tools and pipelines. Comparative analysis of commonly used Bio*-frameworks (BioPerl, BioJava and Biopython) shows that their scalability and accuracy is hampered. FastaValidator represents a platform-independent, standardized, light-weight software library written in the Java programming language. It targets computer scientists and bioinformaticians writing software which needs to parse quickly and accurately large amounts of sequence data. For end-users FastaValidator includes an interactive out-of-the-box validation of FASTA formatted files, as well as a non-interactive mode designed for high-throughput validation in software pipelines. The accuracy and performance of the FastaValidator library qualifies it for large data sets such as those commonly produced by massive parallel (NGS) technologies. It offers scientists a fast, accurate and standardized method for parsing and validating FASTA formatted sequence data.

Validation of the three web quality dimensions of a minimally invasive surgery e-learning platform.

Science.gov (United States)

Ortega-Morán, Juan Francisco; Pagador, J Blas; Sánchez-Peralta, Luisa Fernanda; Sánchez-González, Patricia; Noguera, José; Burgos, Daniel; Gómez, Enrique J; Sánchez-Margallo, Francisco M

2017-11-01

E-learning web environments, including the new TELMA platform, are increasingly being used to provide cognitive training in minimally invasive surgery (MIS) to surgeons. A complete validation of this MIS e-learning platform has been performed to determine whether it complies with the three web quality dimensions: usability, content and functionality. 21 Surgeons participated in the validation trials. They performed a set of tasks in the TELMA platform, where an e-MIS validity approach was followed. Subjective (questionnaires and checklists) and objective (web analytics) metrics were analysed to achieve the complete validation of usability, content and functionality. The TELMA platform allowed access to didactic content with easy and intuitive navigation. Surgeons performed all tasks with a close-to-ideal number of clicks and amount of time. They considered the design of the website to be consistent (95.24%), organised (90.48%) and attractive (85.71%). Moreover, they gave the content a high score (4.06 out of 5) and considered it adequate for teaching purposes. The surgeons scored the professional language and content (4.35), logo (4.24) and recommendations (4.20) the highest. Regarding functionality, the TELMA platform received an acceptance of 95.24% for navigation and 90.48% for interactivity. According to the study, it seems that TELMA had an attractive design, innovative content and interactive navigation, which are three key features of an e-learning platform. TELMA successfully met the three criteria necessary for consideration as a website of quality by achieving more than 70% of agreements regarding all usability, content and functionality items validated; this constitutes a preliminary requirement for an effective e-learning platform. However, the content completeness, authoring tool and registration process required improvement. Finally, the e-MIS validity methodology used to measure the three dimensions of web quality in this work can be applied to other

Validity and Reliability of Knowledge, Attitude and Behavior Assessment Tool Among Vulnerable Women Concerning Sexually Transmitted Diseases

Directory of Open Access Journals (Sweden)

Zahra Boroumandfar

2016-05-01

Full Text Available Objective: The study aimed to design and evaluate the content and face validity, and reliability of knowledge, attitude, and behavior questionnaire on preventive behaviors among vulnerable women concerning sexually transmitted diseases (STDs.Materials and methods: This cross-sectional study was carried out in two phases of an action research. In the first phase, to explain STDs preventive domains, 20 semi- structured interviews were conducted with the vulnerable women, residing at women prison and women referred to counseling centers. After analyzing content of interviews, three domains were identified: improve their knowledge, modify their attitude and change their behaviors. In the second phase, the questionnaire was designed and tested in a pilot study. Then, its content validity was evaluated. Face validity and reliability of the questionnaire were assessed by test re- test method and Cronbach alpha respectively.Results: Index of content validity in each three domain of the questionnaire (knowledge, attitude and behavior concerning STDs was obtained over 0.6. Overall content validity index was 0.86 in all three domains of the questionnaire. The Cronbach’s alpha as reliability of questionnaire was 0.80 for knowledge, 0.79 for attitude and 0.85 for behavior.Conclusion: The results showed that the designed questionnaire was a valid and reliable tool to measure knowledge, attitude and behavior of vulnerable women, predisposed to risk of STDs.

Identifying and Validating a Model of Interpersonal Performance Dimensions

National Research Council Canada - National Science Library

Carpenter, Tara

2004-01-01

.... Two studies were then completed to validate the proposed taxonomy. In the first study empirical evidence for the taxonomy was gathered using a content analysis of critical incidents taken from a job analysis...

The Italian validation of the Salford-Scott Nursing Values Questionnaire.

Science.gov (United States)

Mecugni, Daniela; Albinelli, Patrizia; Pellegrin, Joellemarie; Finotto, Stefano

2015-03-01

To properly direct nursing training and to improve the professional practice to become more effective, it is important to understand students' values. Literature review has shown that there have been changes in students' values in the last 20 years. In contemporary students, a general decrease in altruism has been observed, but also a larger appreciation for honesty toward patients has been declared. The analyzed literature did not find validated tools available in Italian that explore personal and professional values of nursing students. This study was an Italian linguistic and cultural adaptation of a research tool. The authors aimed to validate, for the Italian context, the Salford-Scott Nursing Values Questionnaire, enhanced by Johnson to explore the nursing profession's values. The Beaton Model was used as well as Valmi's. These models require five phases, with the goal of producing a pre-final version of the instrument for it to then be administered to a sample of the target and expert population. The study was approved by the Council of the Nursing Degree University course of the Modena and Reggio Emilia University, Reggio Emilia site, and the identity of the subjects was protected at every moment of the testing. Face validation was achieved since the clarity percentile for each item was 100%. Content validity was also reached, measured from the content validity index and the scale validity index. The study has confirmed the reliability of the instrument's internal consistence with a value of Cronbach's alpha on 0.95 of total of items. The reliability of the test-retest confirms the stability of the instrument in time (r = 0.908; p = 0.01). The study concludes that the instrument is ready to be administered to the target population, a sample group of nursing students. © The Author(s) 2014.

Failure mode and effects analysis outputs: are they valid?

Science.gov (United States)

Shebl, Nada Atef; Franklin, Bryony Dean; Barber, Nick

2012-06-10

Failure Mode and Effects Analysis (FMEA) is a prospective risk assessment tool that has been widely used within the aerospace and automotive industries and has been utilised within healthcare since the early 1990s. The aim of this study was to explore the validity of FMEA outputs within a hospital setting in the United Kingdom. Two multidisciplinary teams each conducted an FMEA for the use of vancomycin and gentamicin. Four different validity tests were conducted: Face validity: by comparing the FMEA participants' mapped processes with observational work. Content validity: by presenting the FMEA findings to other healthcare professionals. Criterion validity: by comparing the FMEA findings with data reported on the trust's incident report database. Construct validity: by exploring the relevant mathematical theories involved in calculating the FMEA risk priority number. Face validity was positive as the researcher documented the same processes of care as mapped by the FMEA participants. However, other healthcare professionals identified potential failures missed by the FMEA teams. Furthermore, the FMEA groups failed to include failures related to omitted doses; yet these were the failures most commonly reported in the trust's incident database. Calculating the RPN by multiplying severity, probability and detectability scores was deemed invalid because it is based on calculations that breach the mathematical properties of the scales used. There are significant methodological challenges in validating FMEA. It is a useful tool to aid multidisciplinary groups in mapping and understanding a process of care; however, the results of our study cast doubt on its validity. FMEA teams are likely to need different sources of information, besides their personal experience and knowledge, to identify potential failures. As for FMEA's methodology for scoring failures, there were discrepancies between the teams' estimates and similar incidents reported on the trust's incident

Exploring Content Validity of Shore Handwriting Screening and Newly Developed Score Sheet With Pre-Kindergarten Students

Directory of Open Access Journals (Sweden)

Denise K. Donica

2015-07-01

Full Text Available Background: Limited tools exist to measure handwriting readiness skills of pre-kindergarten students. This study was a preliminary exploration of content validity of the Shore Handwriting Screening (SHS and the newly developed Score Sheet with the Bruininks-Oseretsky Test of Motor Proficiency, Second Edition (BOT-2 in 4- and 5-year-old pre-kindergarten students. Because socioeconomic status (SES is known to impact handwriting skills, data from two different socioeconomic groups were collected. Method: Students from a Lower SES group (n = 36 and a Higher SES group (n = 14 completed the SHS and fine motor composite of the BOT-2. Pearson’s correlation was used to compare scores on the two assessments within the two groups. Results: SHS overall percentage scores were compared to standard scores and composite scores of the BOT-2. SHS scores displayed moderate to high correlation with fine manual control portions of the BOT-2 for the Lower SES group and low to moderate correlation for the same portion in the Higher SES group. Conclusion: SHS and the Score Sheet correlate to fine and visual-motor skill subtests on the fine manual control portions of the BOT-2, which supports the need for further research on the reliability and validity of the Score Sheet for use in practice.

Development and Validation of WebQuests in Teaching Epics

Directory of Open Access Journals (Sweden)

Ronald Candy Santos Lasaten

2017-05-01

Full Text Available Using the Research Development (R&D methodology, the study aimed to develop and validate WebQuests which can be used in literature subjects, particularly in the tertiary level to address the need of literature teachers for pedagogy in the teaching of epic s. The development of the Web Quests was anchored on the Theory of Constructivism. Two groups of experts validated the Web Quests – the literature experts and the ICT experts. The Content Validation Checklist, used by the literature experts, was utilized t o evaluate the content of the Web Quests. Meanwhile, the Rubric for Evaluating Web Quests, used by the ICT experts, was utilized to evaluate the design characteristics of the Web Quests. Computed weighted means using range interval of point scores were emp loyed to treat the data gathered from the evaluation conducted by both group of experts. The Web Quests developed contain five major parts which include: 1 introduction; 2 task; 3 process; 4 evaluation; and 5 conclusion. Based on the findings, the con tent of the Web Quests developed are valid in terms of objectives, activities and instructional characteristics. Likewise, the design characteristics of the Web Quests are excellent in terms of introductions, tasks, processes, resources, evaluations, concl usions and overall designs. Thus, the Web Quests developed are acceptable and can be utilized as instructional materials by literature teachers in the teaching of epics.

Perceptions of Organizational Politics Scale (POPS Questionnaire into Turkish: A Validity and Reliability Study

Directory of Open Access Journals (Sweden)

Evrim EROL

2016-07-01

Full Text Available In this study it was aimed to make the studies of the translation of Perception of Organizational Politics Scale into Turkish and the validity and reliability of the scale. Perceptions of Organizational Politics Scale’s (POPS validities has been tested in terms of view, content and structure. The application is designed as a two-stage process. In the first stage, face and content validity was tested. In the second stage, it was sought evidences for the construct validity of the scale by making exploratory factor analysis (EFA and then the confirmatory factor analysis (CFA to the data obtained. In determining the reliability of the scale item-total score correlations and Cronbach alpha coefficient was used. The application made for the validity and reliability of the scale was conducted on the data collected from 277 faculty members working in universities’ education faculties. As a method of achieving those faculty members "Simple randomized (random sampling" is used. The psychometric properties of the Turkish version of Perception of Organizational Politics Scale showed that the scale has a satisfactory level of reliability and validity for the Turkish employee sample.

[Reliability and validity of the Chinese version on Comprehensive Scores for Financial Toxicity based on the patient-reported outcome measures].

Science.gov (United States)

Yu, H H; Bi, X; Liu, Y Y

2017-08-10

Objective: To evaluate the reliability and validity of the Chinese version on comprehensive scores for financial toxicity (COST), based on the patient-reported outcome measures. Methods: A total of 118 cancer patients were face-to-face interviewed by well-trained investigators. Cronbach's α and Pearson correlation coefficient were used to evaluate reliability. Content validity index (CVI) and exploratory factor analysis (EFA) were used to evaluate the content validity and construct validity, respectively. Results: The Cronbach's α coefficient appeared as 0.889 for the whole questionnaire, with the results of test-retest were between 0.77 and 0.98. Scale-content validity index (S-CVI) appeared as 0.82, with item-content validity index (I-CVI) between 0.83 and 1.00. Two components were extracted from the Exploratory factor analysis, with cumulative rate as 68.04% and loading>0.60 on every item. Conclusion: The Chinese version of COST scale showed high reliability and good validity, thus can be applied to assess the financial situation in cancer patients.

Simplification and Validation of Leicester Cough Questionnaire in Mandarin-Chinese

Directory of Open Access Journals (Sweden)

Rongjia LIN

2017-06-01

Full Text Available Background and objective Patients often have cough after lung surgery, and there is a lack of tools to specifically assess postoperative coughs. LCQ-MC (Leicester Cough Questionnaire in Mandarin-Chinese was revised and validated to explore its value on clinical application. Methods A total of 250 patients undergone the lung operation of single medical team, from September 2015 to December 2016 in the Department ofThoracic Surgery, West China Hospital, Sichuan University, were investigated. Among them, 121 patients completed LCQ-MC and 129 patients completed simplified LCQ-MC, we verified the reliability and validity. Results The new questionnaire was not changed in terms of content layout and the scoring method of LCQ-MC, consisting of 12 items and three domains (physical, psychological and social. There was good content validity (S-CVI/UA=0.83. Concurrent validity was high when the simplified LCQ-MC was compared with daytime cough symptom score (r=-0.578, P<0.001. There was a moderate relationship with response to night-time cough symptom score (r=-0.358, P=-0.004 and SF36 total score (r=0.346, P=0.030, and weak relationship with the Hospital Anxiety and Depression Scale total score (r=-0.241, P=0.046. Cronbach’s alpha coefficients of simplified LCQ-CM total and three domains varied between 0.79 and 0.89. One week apart test-retest reliability (n=30 was high (r=0.88-0.96. Conclusion Simplified LCQ-MC has good reliability and validity that can be used for clinical applications.

Validity evidence and reliability of a simulated patient feedback instrument.

Science.gov (United States)

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Validation of an instrument for evaluating health care services to ostomized people

Directory of Open Access Journals (Sweden)

Juliano Teixeira Moraes

Full Text Available ABSTRACT Objectives: to develop and validate an array of analysis and judgment for the evaluation of Health Care Services of people with stomas. Methods: cross-sectional study in 28 health facilities in the state of Minas Gerais. A descriptive analysis of the instrument and a study of its psychometric properties were performed. We used the Delphi technique for the validation of content and appearance. A psychometric analysis was carried out through the study of the reliability and validity of the measures obtained with the instrument. Results: it was possible to construct an array analysis and judgment with 16 components (with scores from zero to five grouped according to size and structure and process considered essential to evaluate the service. The results achieved in the reliability for structure and process, through the Cronbach alpha coefficient (α = 0.771 and α = 0.809, respectively, and the validity of content and construct demonstrated good internal consistency and satisfactory validity. An exploratory factor analysis indicated the item "main activity performed in the unit" as a limitation of the scale. Conclusion: the study provides a new tool for the evaluation of structure and process of Health Care Services of a Person with a stoma.

Translation and validation of the Dutch new Knee Society Scoring System ©.

Science.gov (United States)

Van Der Straeten, Catherine; Witvrouw, Erik; Willems, Tine; Bellemans, Johan; Victor, Jan

2013-11-01

A new version of The Knee Society Knee Scoring System(©) (KSS) has recently been developed. Before this scale can be used in non-English-speaking populations, it has to be translated and validated for a particular population. We evaluated the construct and content validity, the test-retest reliability, and the internal consistency of the Dutch version of the New Knee Society KSS. A Dutch translation was performed using a forward-backward translation protocol. We tested the construct validity of the Dutch New KSS by comparing it with the Dutch versions of the WOMAC, Knee Injury and Osteoarthritis Outcome Score (KOOS), and SF-12 scores in 137 patients undergoing total knee arthroplasty (TKA). Content validity was assessed by comparing pre- and postoperative scores and by checking floor and ceiling effects. To evaluate test-retest reliability and consistency, 47 patients completed the questionnaire a second time with a mean of 8 days interval (range, 2-20 days) between tests. Construct validity was demonstrated because the Dutch New KSS correlated well with the Dutch WOMAC (r = -0.751; p Dutch KOOS (r = -0.723; p Dutch SF-12 (r = 0.569; p Dutch New KSS is an excellent instrument to evaluate TKA outcome in Dutch-speaking patients.

Validation of HEDR models

International Nuclear Information System (INIS)

Napier, B.A.; Simpson, J.C.; Eslinger, P.W.; Ramsdell, J.V. Jr.; Thiede, M.E.; Walters, W.H.

1994-05-01

The Hanford Environmental Dose Reconstruction (HEDR) Project has developed a set of computer models for estimating the possible radiation doses that individuals may have received from past Hanford Site operations. This document describes the validation of these models. In the HEDR Project, the model validation exercise consisted of comparing computational model estimates with limited historical field measurements and experimental measurements that are independent of those used to develop the models. The results of any one test do not mean that a model is valid. Rather, the collection of tests together provide a level of confidence that the HEDR models are valid

Validation of an instrument to measure quality of life in British children with inflammatory bowel disease.

Science.gov (United States)

Ogden, C A; Akobeng, A K; Abbott, J; Aggett, P; Sood, M R; Thomas, A G

2011-09-01

To validate IMPACT-III (UK), a health-related quality of life (HRQoL) instrument, in British children with inflammatory bowel disease (IBD). One hundred six children and parents were invited to participate. IMPACT-III (UK) was validated by inspection by health professionals and children to assess face and content validity, factor analysis to determine optimum domain structure, use of Cronbach alpha coefficients to test internal reliability, ANOVA to assess discriminant validity, correlation with the Child Health Questionnaire to assess concurrent validity, and use of intraclass correlation coefficients to assess test-retest reliability. The independent samples t test was used to measure differences between sexes and age groups, and between paper and computerised versions of IMPACT-III (UK). IMPACT-III (UK) had good face and content validity. The most robust factor solution was a 5-domain structure: body image, embarrassment, energy, IBD symptoms, and worries/concerns about IBD, all of which demonstrated good internal reliability (α = 0.74-0.88). Discriminant validity was demonstrated by significant (P  measure HRQoL in British children with IBD.

A Validation Dataset for CryoSat Sea Ice Investigators

DEFF Research Database (Denmark)

Julia, Gaudelli,; Baker, Steve; Haas, Christian

Since its launch in April 2010 Cryosat has been collecting valuable sea ice data over the Arctic region. Over the same period ESA’s CryoVEx and NASA IceBridge validation campaigns have been collecting a unique set of coincident airborne measurements in the Arctic. The CryoVal-SI project has...... community. In this talk we will describe the composition of the validation dataset, summarising how it was processed and how to understand the content and format of the data. We will also explain how to access the data and the supporting documentation....

Validity and Reliability of the Questionnaire for Assessing Women’s Reproductive History in Azar Cohort Study

Directory of Open Access Journals (Sweden)

Mohammad Zakaria Pezeshki

2017-06-01

Full Text Available This study was done to evaluate the validity and reliability of women’s reproductive history questionnaire which will be used in Azar Cohort study; a cohort that is conducted by Tabriz University of Medical Science in Shabestar county for identifying risk factors of no communicable diseases. Content and face validity were evaluated by ten experts in the field and quantified as content validity index (CVI and content validity ratio (CVR. To assess the reliability, using test-retest approach, kappa statistic was calculated for categorical variables and intra-class correlation coefficient (ICC was used for the quantitative items. The calculated CVI and CVR were 0.91and 0.94, respectively. Reliability for all items was high. The ICC was 0.99 and kappa statistic was equal to 1. The final version of questionnaire was redesigned in 26 items with 7 subscales.

[Development and validity of workplace bullying in nursing-type inventory (WPBN-TI)].

Science.gov (United States)

Lee, Younju; Lee, Mihyoung

2014-04-01

The purpose of this study was to develop an instrument to assess bullying of nurses, and test the validity and reliability of the instrument. The initial thirty items of WPBN-TI were identified through a review of the literature on types bullying related to nursing and in-depth interviews with 14 nurses who experienced bullying at work. Sixteen items were developed through 2 content validity tests by 9 experts and 10 nurses. The final WPBN-TI instrument was evaluated by 458 nurses from five general hospitals in the Incheon metropolitan area. SPSS 18.0 program was used to assess the instrument based on internal consistency reliability, construct validity, and criterion validity. WPBN-TI consisted of 16 items with three distinct factors (verbal and nonverbal bullying, work-related bullying, and external threats), which explained 60.3% of the total variance. The convergent validity and determinant validity for WPBN-TI were 100.0%, 89.7%, respectively. Known-groups validity of WPBN-TI was proven through the mean difference between subjective perception of bullying. The satisfied criterion validity for WPBN-TI was more than .70. The reliability of WPBN-TI was Cronbach's α of .91. WPBN-TI with high validity and reliability is suitable to determine types of bullying in nursing workplace.

Development and Validation of a Mobile Device-based External Ventricular Drain Simulator.

Science.gov (United States)

Morone, Peter J; Bekelis, Kimon; Root, Brandon K; Singer, Robert J

2017-10-01

Multiple external ventricular drain (EVD) simulators have been created, yet their cost, bulky size, and nonreusable components limit their accessibility to residency programs. To create and validate an animated EVD simulator that is accessible on a mobile device. We developed a mobile-based EVD simulator that is compatible with iOS (Apple Inc., Cupertino, California) and Android-based devices (Google, Mountain View, California) and can be downloaded from the Apple App and Google Play Store. Our simulator consists of a learn mode, which teaches users the procedure, and a test mode, which assesses users' procedural knowledge. Twenty-eight participants, who were divided into expert and novice categories, completed the simulator in test mode and answered a postmodule survey. This was graded using a 5-point Likert scale, with 5 representing the highest score. Using the survey results, we assessed the module's face and content validity, whereas construct validity was evaluated by comparing the expert and novice test scores. Participants rated individual survey questions pertaining to face and content validity a median score of 4 out of 5. When comparing test scores, generated by the participants completing the test mode, the experts scored higher than the novices (mean, 71.5; 95% confidence interval, 69.2 to 73.8 vs mean, 48; 95% confidence interval, 44.2 to 51.6; P mobile-based EVD simulator that is inexpensive, reusable, and accessible. Our results demonstrate that this simulator is face, content, and construct valid. Copyright © 2017 by the Congress of Neurological Surgeons

Validated RP-HPLC Method for Quantification of Phenolic ...

African Journals Online (AJOL)

Purpose: To evaluate the total phenolic content and antioxidant potential of the methanol extracts of aerial parts and roots of Thymus sipyleus Boiss and also to determine some phenolic compounds using a newly developed and validated reversed phase high performance liquid chromatography (RP-HPLC) method.

On the Statistical Validation of Technical Analysis

Directory of Open Access Journals (Sweden)

Rosane Riera Freire

2007-06-01

Full Text Available Technical analysis, or charting, aims on visually identifying geometrical patterns in price charts in order to antecipate price "trends". In this paper we revisit the issue of thecnical analysis validation which has been tackled in the literature without taking care for (i the presence of heterogeneity and (ii statistical dependence in the analyzed data - various agglutinated return time series from distinct financial securities. The main purpose here is to address the first cited problem by suggesting a validation methodology that also "homogenizes" the securities according to the finite dimensional probability distribution of their return series. The general steps go through the identification of the stochastic processes for the securities returns, the clustering of similar securities and, finally, the identification of presence, or absence, of informatinal content obtained from those price patterns. We illustrate the proposed methodology with a real data exercise including several securities of the global market. Our investigation shows that there is a statistically significant informational content in two out of three common patterns usually found through technical analysis, namely: triangle, rectangle and head and shoulders.

Development of Creative Behavior Observation Form: A Study on Validity and Reliability

Science.gov (United States)

Dere, Zeynep; Ömeroglu, Esra

2018-01-01

This study, Creative Behavior Observation Form was developed to assess creativity of the children. While the study group on the reliability and validity of Creative Behavior Observation Form was being developed, 257 children in total who were at the ages of 5-6 were used as samples with stratified sampling method. Content Validity Index (CVI) and…

How to measure wisdom: content, reliability, and validity of five measures

Science.gov (United States)

Glück, Judith; König, Susanne; Naschenweng, Katja; Redzanowski, Uwe; Dorner, Lara; Straßer, Irene; Wiedermann, Wolfgang

2013-01-01

Wisdom is a field of growing interest both inside and outside academic psychology, and researchers are increasingly interested in using measures of wisdom in their work. However, wisdom is a highly complex construct, and its various operationalizations are based on quite different definitions. Which measure a researcher chooses for a particular research project may have a strong influence on the results. This study compares four well-established measures of wisdom—the Self-Assessed Wisdom Scale (Webster, 2003, 2007), the Three-Dimensional Wisdom Scale (Ardelt, 2003), the Adult Self-Transcendence Inventory (Levenson et al., 2005), and the Berlin Wisdom Paradigm (Baltes and Smith, 1990; Baltes and Staudinger, 2000)—with respect to content, reliability, factorial structure, and construct validity (relationships to wisdom nomination, interview-based wisdom ratings, and correlates of wisdom). The sample consisted of 47 wisdom nominees and 123 control participants. While none of the measures performed “better” than the others by absolute standards, recommendations are given for researchers to select the most suitable measure for their substantive interests. In addition, a “Brief Wisdom Screening Scale” is introduced that contains those 20 items from the three self-report scales that were most highly correlated with the common factor across the scales. PMID:23874310

Reliability and validity of a new dexterity questionnaire (DextQ-24) in Parkinson's disease

NARCIS (Netherlands)

Vanbellingen, Tim; Nyffeler, Thomas; Nef, Tobias; Kwakkel, Gert; Bohlhalter, Stephan; van Wegen, Erwin E.H.

2016-01-01

Background Patients with Parkinson's disease exhibit disturbed dexterity. Validated self-reported outcomes for dexterity in Parkinson's disease are lacking. The aim of this study was to investigate the reliability, content and construct validity of a new Dexterity Questionnaire 24. Methods One

Validation suite for MCNP

International Nuclear Information System (INIS)

Mosteller, Russell D.

2002-01-01

Two validation suites, one for criticality and another for radiation shielding, have been defined and tested for the MCNP Monte Carlo code. All of the cases in the validation suites are based on experiments so that calculated and measured results can be compared in a meaningful way. The cases in the validation suites are described, and results from those cases are discussed. For several years, the distribution package for the MCNP Monte Carlo code1 has included an installation test suite to verify that MCNP has been installed correctly. However, the cases in that suite have been constructed primarily to test options within the code and to execute quickly. Consequently, they do not produce well-converged answers, and many of them are physically unrealistic. To remedy these deficiencies, sets of validation suites are being defined and tested for specific types of applications. All of the cases in the validation suites are based on benchmark experiments. Consequently, the results from the measurements are reliable and quantifiable, and calculated results can be compared with them in a meaningful way. Currently, validation suites exist for criticality and radiation-shielding applications.

Reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish.

Science.gov (United States)

Ulusoy, Hatice; Güler, Güngör; Yıldırım, Gülay; Demir, Ecem

2018-02-01

Developing professional values among nursing students is important because values are a significant predictor of the quality care that will be provided, the clients' recognition, and consequently the nurses' job satisfaction. The literature analysis showed that there is only one validated tool available in Turkish that examines both the personal and the professional values of nursing students. The aim of this study was to assess the reliability and validity of the Salford-Scott Nursing Values Questionnaire in Turkish. This study was a Turkish linguistic and cultural adaptation of a research tool. Participants and research context: The sample of this study consisted of 627 undergraduate nursing students from different geographical areas of Turkey. Two questionnaires were used for data collection: a socio-demographic form and the Salford-Scott Nursing Values Questionnaire. For the Salford-Scott Nursing Values Questionnaire, construct validity was examined using factor analyses. Ethical considerations: The study was approved by the Cumhuriyet University Faculty of Medicine Research Ethics Board. Students were informed that participation in the study was entirely voluntary and anonymous. Item content validity index ranged from 0.66 to 1.0, and the total content validity index was 0.94. The Kaiser-Meyer-Olkin measure of sampling was 0.870, and Bartlett's test of sphericity was statistically significant (x 2 = 3108.714, p < 0.001). Construct validity was examined using factor analyses and the six factors were identified. Cronbach's alpha was used to assess the internal consistency reliability and the value of 0.834 was obtained. Our analyses showed that the Turkish version of Salford-Scott Nursing Values Questionnaire has high validity and reliability.

Spanish translation and validation of the Preschool Activity Card Sort.

Science.gov (United States)

Stoffel, Ashley; Berg, Christine

2008-05-01

Few standardized assessments exist for children living in the United States who are Hispanic/Latino. This study reports the Spanish translation process for the Preschool Activity Card Sort (PACS), which is a measure of participation in preschool children, and examines content, construct, and concurrent validity. Methods of verifying accuracy of translation included expert review and back translation and supported content validity of the Tarjetas de Actividades Preescolares (TAP). Subsequently, a sample of 37 parents of children between 3 and 6 years of age completed the PACS/TAP by structured interview. Twenty-six parents were Spanish speaking, and 11 were English speaking. A comparison of reported participation by Spanish- and English-speaking children provides initial construct validity of the TAP. Results indicate that the TAP differentiates among children of recent immigrants as compared to preschoolers who were born in the United States on domains of self-care, high and low demand leisure, and educational activities. Results emphasize the importance of considering sociocultural influences when assessing participation. PACS/TAP scores were moderately correlated with Pediatric Evaluation of Disability Inventory scores for the self-care domain, but did not correlate with the mobility or social function domains. The PACS/TAP appears to provide a useful means of understanding preschoolers' participation. Future research is needed to further establish the validity of this assessment.

The Japanese Version of the Massachusetts General Hospital Acupuncture Sensation Scale: A Validation Study

Directory of Open Access Journals (Sweden)

Masako Nishiwaki

2017-01-01

Full Text Available Acupuncture sensations are considered essential in producing the treatment effect of acupuncture. The Massachusetts General Hospital Acupuncture Sensation Scale (MASS is a frequently used scale in acupuncture research to measure acupuncture sensations. We translated the MASS into Japanese (Japanese MASS based on Beaton’s guidelines. 30 acupuncturists evaluated the relevancy and meaning of the 12 descriptors included in the Japanese MASS. The content validity ratios for 10 of the 12 descriptors were 0.33 or greater. 42 healthy subjects then evaluated acupuncture sensations evoked by manual acupuncture at LI4 using the Japanese MASS. Cronbach’s alpha was 0.86. The correlation coefficient of total MASS scores and total Short Form McGill Pain Questionnaire scores and MASS indices and sensory visual analogue scores were 0.78 and 0.80, respectively. Factor analysis loaded the 12 descriptors onto two meaningful factors. This study demonstrated that the Japanese MASS has good reliability, content validity, criterion-related validity, and construct validity. Therefore, the Japanese MASS is a valid and reliable instrument for use with Japanese populations.

The Japanese Version of the Massachusetts General Hospital Acupuncture Sensation Scale: A Validation Study.

Science.gov (United States)

Nishiwaki, Masako; Takayama, Miho; Yajima, Hiroyoshi; Nasu, Morihiro; Kong, Jian; Takakura, Nobuari

2017-01-01

Acupuncture sensations are considered essential in producing the treatment effect of acupuncture. The Massachusetts General Hospital Acupuncture Sensation Scale (MASS) is a frequently used scale in acupuncture research to measure acupuncture sensations. We translated the MASS into Japanese (Japanese MASS) based on Beaton's guidelines. 30 acupuncturists evaluated the relevancy and meaning of the 12 descriptors included in the Japanese MASS. The content validity ratios for 10 of the 12 descriptors were 0.33 or greater. 42 healthy subjects then evaluated acupuncture sensations evoked by manual acupuncture at LI4 using the Japanese MASS. Cronbach's alpha was 0.86. The correlation coefficient of total MASS scores and total Short Form McGill Pain Questionnaire scores and MASS indices and sensory visual analogue scores were 0.78 and 0.80, respectively. Factor analysis loaded the 12 descriptors onto two meaningful factors. This study demonstrated that the Japanese MASS has good reliability, content validity, criterion-related validity, and construct validity. Therefore, the Japanese MASS is a valid and reliable instrument for use with Japanese populations.

Validation of a checklist to assess ward round performance in internal medicine

DEFF Research Database (Denmark)

Nørgaard, Kirsten; Ringsted, Charlotte; Dolmans, Diana

2004-01-01

and construct validity of the task-specific checklist. METHODS: To determine content validity, a questionnaire was mailed to 295 internists. They were requested to give their opinion on the relevance of each item included on the checklist and to indicate the comprehensiveness of the checklist. To determine...... construct validity, an observer assessed 4 groups of doctors during performance of a complete ward round (n = 32). The nurse who accompanied the doctor on rounds made a global assessment of the performance. RESULTS: The response rate to the questionnaire was 80.7%. The respondents found that all 10 items......BACKGROUND: Ward rounds are an essential responsibility for doctors in hospital settings. Tools for guiding and assessing trainees' performance of ward rounds are needed. A checklist was developed for that purpose for use with trainees in internal medicine. OBJECTIVE: To assess the content...

Validity and reliability of a questionnaire on knowledge of cardiovascular risk factors for use in Brazil

Directory of Open Access Journals (Sweden)

Marco Aurelio Lumertz Saffi

2013-10-01

Full Text Available Using a sample of patients with coronary artery disease, this methodological study aimed to conduct a cross-cultural adaptation and validation of a questionnaire on knowledge of cardiovascular risk factors (Q-FARCS, lifestyle changes, and treatment adherence for use in Brazil. The questionnaire has three scales: general knowledge of risk factors (RFs; specific knowledge of these RFs; and lifestyle changes achieved. Cross-cultural adaptation included translation, synthesis, back-translation, expert committee review, and pretesting. Face and content validity, reliability, and construct validity were measured. Cronbach’s alpha for the total sample (n = 240 was 0.75. Assessment of psychometric properties revealed adequate face and content validity, and the construct revealed seven components. It was concluded that the Brazilian version of Q-FARCS had adequate reliability and validity for the assessment of knowledge of cardiovascular RFs.

Development of caries risk assessment tool for Iranian preschoolers: A primary validation study

Directory of Open Access Journals (Sweden)

Shiva Mortazavi

2017-01-01

Full Text Available Background: The aim of the present study was to develop a dental caries risk assessment tool for Iranian preschoolers. Methods: In a validation and cross-sectional study, a random sample of 150 preschool children was involved. This study was conducted in three phases: questionnaire design (expert panel and peer evaluation, questionnaire testing (pilot evaluation and field testing, and validation study. The initial assessments include interview, dental examination, and laboratory investigations. Validity and reliability indices, content validity index (CVI, content validity ratio (CVR, impact score, and test-retest and Cronbach's alpha were measured. Decayed, missing, filled teeth (dmft scores were calculated according to the WHO guidelines. Results: The Iranian version of caries risk assessment (CRA questionnaire contained 17 items. Cronbach's alpha coefficient (0.86 indicated a suitable internal consistency. The mean scores for the CVI and the CVR were 0.87 and 0.78, respectively. The prevalence rate of dental caries in the study group was 69.3%, and the mean dmft was 4.57 (range 0–19. Conclusions: The Persian version of CRA questionnaire was adapted to the Iranian population. The findings demonstrated overall acceptable validity and also reliability in the application of test-retest. The results of the present study provide initial evidence that the designed CRA form could be a useful tool for CRA in the Iranian preschoolers.

Validation of the theoretical domains framework for use in behaviour change and implementation research

OpenAIRE

Cane, James E.; O'Connor, Denise; Michie, Susan

2012-01-01

Abstract Background An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework. Methods Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis. Results The...

Validating the Heirarchy of the iStartSmart® Academic Content

Science.gov (United States)

McManis, Perry, W.; McManis, Mark, H.

2016-01-01

The purpose of this analysis was to investigate the validity of skill groupings in an instructional technology learning system designed for use by children in early childhood education classrooms. A Principal Component Analysis was performed to measure the fit of 18 skill games to their 5 assigned groupings in the system, covering a range of…

Construct validity and internal consistency in the Leisure Practices Scale (EPL) for adults.

Science.gov (United States)

Andrade, Rubian Diego; Schwartz, Gisele Maria; Tavares, Giselle Helena; Pelegrini, Andreia; Teixeira, Clarissa Stefani; Felden, Érico Pereira Gomes

2018-02-01

This study proposes and analyzes the construct validity and internal consistency of the Leisure Practices Scale (EPL). This survey seeks to identify the preferences and involvement in in different leisure practices in adults. The instrument was formed based on the cultural leisure content (artistic, manual, physical, sports, intellectual, social, tourist, virtual and contemplation/leisure). The validation process was conducted with: a) content analysis by leisure experts, who evaluated the instrument for clarity of language and practical relevance, which allowed the calculation of the content validity coefficient (CVC); b) reproducibility test-retest with 51 subjects to calculate the temporal variation coefficient; c) internal consistency analysis with 885 participants. The evaluation presented appropriate coefficients, both with respect to language clarity (CVCt = 0.883) and practical relevance (CVCt = 0.879). The reproducibility coefficients were moderate to excellent. The scale showed adequate internal consistency (0.72). The EPL has psychometric quality and acceptable values in its structure, and can be used to investigate adult involvement in leisure activities.

Validity in Qualitative Evaluation

OpenAIRE

Vasco Lub

2015-01-01

This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate), the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of con...

Verification and validation benchmarks.

Energy Technology Data Exchange (ETDEWEB)

Oberkampf, William Louis; Trucano, Timothy Guy

2007-02-01

Verification and validation (V&V) are the primary means to assess the accuracy and reliability of computational simulations. V&V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V&V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the level of

Site characterization and validation - validation drift fracture data, stage 4

International Nuclear Information System (INIS)

Bursey, G.; Gale, J.; MacLeod, R.; Straahle, A.; Tiren, S.

1991-08-01

This report describes the mapping procedures and the data collected during fracture mapping in the validation drift. Fracture characteristics examined include orientation, trace length, termination mode, and fracture minerals. These data have been compared and analysed together with fracture data from the D-boreholes to determine the adequacy of the borehole mapping procedures and to assess the nature and degree of orientation bias in the borehole data. The analysis of the validation drift data also includes a series of corrections to account for orientation, truncation, and censoring biases. This analysis has identified at least 4 geologically significant fracture sets in the rock mass defined by the validation drift. An analysis of the fracture orientations in both the good rock and the H-zone has defined groups of 7 clusters and 4 clusters, respectively. Subsequent analysis of the fracture patterns in five consecutive sections along the validation drift further identified heterogeneity through the rock mass, with respect to fracture orientations. These results are in stark contrast to the results form the D-borehole analysis, where a strong orientation bias resulted in a consistent pattern of measured fracture orientations through the rock. In the validation drift, fractures in the good rock also display a greater mean variance in length than those in the H-zone. These results provide strong support for a distinction being made between fractures in the good rock and the H-zone, and possibly between different areas of the good rock itself, for discrete modelling purposes. (au) (20 refs.)

Smartphone based automatic organ validation in ultrasound video.

Science.gov (United States)

Vaish, Pallavi; Bharath, R; Rajalakshmi, P

2017-07-01

Telesonography involves transmission of ultrasound video from remote areas to the doctors for getting diagnosis. Due to the lack of trained sonographers in remote areas, the ultrasound videos scanned by these untrained persons do not contain the proper information that is required by a physician. As compared to standard methods for video transmission, mHealth driven systems need to be developed for transmitting valid medical videos. To overcome this problem, we are proposing an organ validation algorithm to evaluate the ultrasound video based on the content present. This will guide the semi skilled person to acquire the representative data from patient. Advancement in smartphone technology allows us to perform high medical image processing on smartphone. In this paper we have developed an Application (APP) for a smartphone which can automatically detect the valid frames (which consist of clear organ visibility) in an ultrasound video and ignores the invalid frames (which consist of no-organ visibility), and produces a compressed sized video. This is done by extracting the GIST features from the Region of Interest (ROI) of the frame and then classifying the frame using SVM classifier with quadratic kernel. The developed application resulted with the accuracy of 94.93% in classifying valid and invalid images.

Learning Style Scales: a valid and reliable questionnaire

Directory of Open Access Journals (Sweden)

Abdolghani Abdollahimohammad

2014-08-01

Full Text Available Purpose: Learning-style instruments assist students in developing their own learning strategies and outcomes, in eliminating learning barriers, and in acknowledging peer diversity. Only a few psychometrically validated learning-style instruments are available. This study aimed to develop a valid and reliable learning-style instrument for nursing students. Methods: A cross-sectional survey study was conducted in two nursing schools in two countries. A purposive sample of 156 undergraduate nursing students participated in the study. Face and content validity was obtained from an expert panel. The LSS construct was established using principal axis factoring (PAF with oblimin rotation, a scree plot test, and parallel analysis (PA. The reliability of LSS was tested using Cronbach’s α, corrected item-total correlation, and test-retest. Results: Factor analysis revealed five components, confirmed by PA and a relatively clear curve on the scree plot. Component strength and interpretability were also confirmed. The factors were labeled as perceptive, solitary, analytic, competitive, and imaginative learning styles. Cronbach’s α was > 0.70 for all subscales in both study populations. The corrected item-total correlations were > 0.30 for the items in each component. Conclusion: The LSS is a valid and reliable inventory for evaluating learning style preferences in nursing students in various multicultural environments.

Learning Style Scales: a valid and reliable questionnaire.

Science.gov (United States)

Abdollahimohammad, Abdolghani; Ja'afar, Rogayah

2014-01-01

Learning-style instruments assist students in developing their own learning strategies and outcomes, in eliminating learning barriers, and in acknowledging peer diversity. Only a few psychometrically validated learning-style instruments are available. This study aimed to develop a valid and reliable learning-style instrument for nursing students. A cross-sectional survey study was conducted in two nursing schools in two countries. A purposive sample of 156 undergraduate nursing students participated in the study. Face and content validity was obtained from an expert panel. The LSS construct was established using principal axis factoring (PAF) with oblimin rotation, a scree plot test, and parallel analysis (PA). The reliability of LSS was tested using Cronbach's α, corrected item-total correlation, and test-retest. Factor analysis revealed five components, confirmed by PA and a relatively clear curve on the scree plot. Component strength and interpretability were also confirmed. The factors were labeled as perceptive, solitary, analytic, competitive, and imaginative learning styles. Cronbach's α was >0.70 for all subscales in both study populations. The corrected item-total correlations were >0.30 for the items in each component. The LSS is a valid and reliable inventory for evaluating learning style preferences in nursing students in various multicultural environments.

Ecological content validation of the Information Assessment Method for parents (IAM-parent): A mixed methods study.

Science.gov (United States)

Bujold, M; El Sherif, R; Bush, P L; Johnson-Lafleur, J; Doray, G; Pluye, P

2018-02-01

This mixed methods study content validated the Information Assessment Method for parents (IAM-parent) that allows users to systematically rate and comment on online parenting information. Quantitative data and results: 22,407 IAM ratings were collected; of the initial 32 items, descriptive statistics showed that 10 had low relevance. Qualitative data and results: IAM-based comments were collected, and 20 IAM users were interviewed (maximum variation sample); the qualitative data analysis assessed the representativeness of IAM items, and identified items with problematic wording. Researchers, the program director, and Web editors integrated quantitative and qualitative results, which led to a shorter and clearer IAM-parent. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Failure mode and effects analysis outputs: are they valid?

Directory of Open Access Journals (Sweden)

Shebl Nada

2012-06-01

Full Text Available Abstract Background Failure Mode and Effects Analysis (FMEA is a prospective risk assessment tool that has been widely used within the aerospace and automotive industries and has been utilised within healthcare since the early 1990s. The aim of this study was to explore the validity of FMEA outputs within a hospital setting in the United Kingdom. Methods Two multidisciplinary teams each conducted an FMEA for the use of vancomycin and gentamicin. Four different validity tests were conducted: · Face validity: by comparing the FMEA participants’ mapped processes with observational work. · Content validity: by presenting the FMEA findings to other healthcare professionals. · Criterion validity: by comparing the FMEA findings with data reported on the trust’s incident report database. · Construct validity: by exploring the relevant mathematical theories involved in calculating the FMEA risk priority number. Results Face validity was positive as the researcher documented the same processes of care as mapped by the FMEA participants. However, other healthcare professionals identified potential failures missed by the FMEA teams. Furthermore, the FMEA groups failed to include failures related to omitted doses; yet these were the failures most commonly reported in the trust’s incident database. Calculating the RPN by multiplying severity, probability and detectability scores was deemed invalid because it is based on calculations that breach the mathematical properties of the scales used. Conclusion There are significant methodological challenges in validating FMEA. It is a useful tool to aid multidisciplinary groups in mapping and understanding a process of care; however, the results of our study cast doubt on its validity. FMEA teams are likely to need different sources of information, besides their personal experience and knowledge, to identify potential failures. As for FMEA’s methodology for scoring failures, there were discrepancies

Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

Science.gov (United States)

Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

2018-06-04

To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Validity of contend and the validy apparently and insurance to evaluate the capacity of agency of selfcare

OpenAIRE

Achury Saldaña, Diana Marcela; Pontificia Universidad Javeriana; Sepúlveda, Gloria Judith; Pontificia Universidad Javeriana; Rodríguez Colmenares, Sandra Mónica; Pontificia Universidad Javeriana

2011-01-01

The purpose of this study was to design and identify the indicators of validity of content and the validity apparent of an instrument to evaluate the capacity of agency of self care, that consist of 41 items brought together in three categories (basic capacities, components of power and capacity of fulfilling the self care). The validity of the content was established since the analysis of the persistency, relevance and redaction of the items with the established categories. After the experts...

Reliability and Validity of the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A)

OpenAIRE

Bervoets, Liene; Van Noten, Caroline; Van Roosbroeck, Sofie; Hansen, Dominique; Van Hoorenbeeck, Kim; Verheyen, Els; Van Hal, Guido; Vankerckhoven, Vanessa

2014-01-01

Background This study was designed to validate the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A). Methods After adjustment of the original Canadian PAQ-C and PAQ-A (i.e. translation/back-translation and evaluation by expert committee), content validity of both PAQs was assessed and calculated using item-level (I-CVI) and scale-level (S-CVI) content validity indexes. Inter-item and inter-rater reliability of 196 PAQ-C and 95 PAQ-A filled in by both childre...

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance.

Science.gov (United States)

Holloway, Laura; Humphrey, Louise; Heron, Louise; Pilling, Claire; Kitchen, Helen; Højbjerre, Lise; Strandberg-Larsen, Martin; Hansen, Brian Bekker

2014-07-22

Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and Activity Impairment Questionnaire: Lupus (WPAI

Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance

Science.gov (United States)

2014-01-01

Background Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials. Methods A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials. Results The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and

Statistical methods for mechanistic model validation: Salt Repository Project

International Nuclear Information System (INIS)

Eggett, D.L.

1988-07-01

As part of the Department of Energy's Salt Repository Program, Pacific Northwest Laboratory (PNL) is studying the emplacement of nuclear waste containers in a salt repository. One objective of the SRP program is to develop an overall waste package component model which adequately describes such phenomena as container corrosion, waste form leaching, spent fuel degradation, etc., which are possible in the salt repository environment. The form of this model will be proposed, based on scientific principles and relevant salt repository conditions with supporting data. The model will be used to predict the future characteristics of the near field environment. This involves several different submodels such as the amount of time it takes a brine solution to contact a canister in the repository, how long it takes a canister to corrode and expose its contents to the brine, the leach rate of the contents of the canister, etc. These submodels are often tested in a laboratory and should be statistically validated (in this context, validate means to demonstrate that the model adequately describes the data) before they can be incorporated into the waste package component model. This report describes statistical methods for validating these models. 13 refs., 1 fig., 3 tabs

Validation of a clinical assessment tool for spinal anaesthesia.

LENUS (Irish Health Repository)

Breen, D

2011-07-01

There is a need for a procedure-specific means of assessment of clinical performance in anaesthesia. The aim of this study was to devise a tool for assessing the performance of spinal anaesthesia, which has both content and construct validity.

A systematic review of the reliability and validity of discrete choice experiments in valuing non-market environmental goods

DEFF Research Database (Denmark)

Rokotonarivo, Sarobidy; Schaafsma, Marije; Hockley, Neal

2016-01-01

reliability measures. DCE results were generally consistent with those of other stated preference techniques (convergent validity), but hypothetical bias was common. Evidence supporting theoretical validity (consistency with assumptions of rational choice theory) was limited. In content validity tests, 2...

Validity in Qualitative Evaluation

Directory of Open Access Journals (Sweden)

Vasco Lub

2015-12-01

Full Text Available This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate, the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of connecting them with aspects of evaluation in social policy. It argues that different purposes of qualitative evaluations can be linked with different scientific paradigms and perspectives, thus transcending unproductive paradigmatic divisions as well as providing a flexible yet rigorous validity framework for researchers and reviewers of qualitative evaluations.

An Assessment of the Title III, ESEA Validation Effort, 1973-74. Final Report.

Science.gov (United States)

Shaffer, J. Stephen, Jr.

Evaluation materials and instructional content relevant to the IVD process for 1973-74 are presented. Section 1 of this report is an analysis of on-site experience of the validators in the employment of the Validator Self-Analysis Forms. Section 2 is Scientific Management Associates Educational Systems Division (SMA/ESD) evaluation of the 10…

Functional Literacy Tests: A Case of Anticipatory Validity?

Science.gov (United States)

Anderson, Lorin W.; Anderson, Jo Craig

1981-01-01

Development of the mathematics functional literacy test (MFLT) is described, issues of predictive and content validity are discussed, and implications for educational policy are presented. Ten basic skill areas identified by the National Council of Supervisors of Mathematics were used as the basis for the development of the MFLT. (RL)

Current status of validation for robotic surgery simulators - a systematic review.

Science.gov (United States)

Abboudi, Hamid; Khan, Mohammed S; Aboumarzouk, Omar; Guru, Khurshid A; Challacombe, Ben; Dasgupta, Prokar; Ahmed, Kamran

2013-02-01

To analyse studies validating the effectiveness of robotic surgery simulators. The MEDLINE(®), EMBASE(®) and PsycINFO(®) databases were systematically searched until September 2011. References from retrieved articles were reviewed to broaden the search. The simulator name, training tasks, participant level, training duration and evaluation scoring were extracted from each study. We also extracted data on feasibility, validity, cost-effectiveness, reliability and educational impact. We identified 19 studies investigating simulation options in robotic surgery. There are five different robotic surgery simulation platforms available on the market. In all, 11 studies sought opinion and compared performance between two different groups; 'expert' and 'novice'. Experts ranged in experience from 21-2200 robotic cases. The novice groups consisted of participants with no prior experience on a robotic platform and were often medical students or junior doctors. The Mimic dV-Trainer(®), ProMIS(®), SimSurgery Educational Platform(®) (SEP) and Intuitive systems have shown face, content and construct validity. The Robotic Surgical SimulatorTM system has only been face and content validated. All of the simulators except SEP have shown educational impact. Feasibility and cost-effectiveness of simulation systems was not evaluated in any trial. Virtual reality simulators were shown to be effective training tools for junior trainees. Simulation training holds the greatest potential to be used as an adjunct to traditional training methods to equip the next generation of robotic surgeons with the skills required to operate safely. However, current simulation models have only been validated in small studies. There is no evidence to suggest one type of simulator provides more effective training than any other. More research is needed to validate simulated environments further and investigate the effectiveness of animal and cadaveric training in robotic surgery. © 2012 BJU

Workplace status: The development and validation of a scale.

Science.gov (United States)

Djurdjevic, Emilija; Stoverink, Adam C; Klotz, Anthony C; Koopman, Joel; da Motta Veiga, Serge P; Yam, Kai Chi; Chiang, Jack Ting-Ju

2017-07-01

Research suggests that employee status, and various status proxies, relate to a number of meaningful outcomes in the workplace. The advancement of the study of status in organizational settings has, however, been stymied by the lack of a validated workplace status measure. The purpose of this manuscript, therefore, is to develop and validate a measure of workplace status based on a theoretically grounded definition of status in organizations. Subject-matter experts were used to examine the content validity of the measure. Then, 2 separate samples were employed to assess the psychometric properties (i.e., factor structure, reliability, convergent and discriminant validity) and nomological network of a 5-item, self-report Workplace Status Scale (WSS). To allow for methodological flexibility, an additional 3 samples were used to extend the WSS to coworker reports of a focal employee's status, provide additional evidence for the validity and reliability of the WSS, and to demonstrate consensus among coworker ratings. Together, these studies provide evidence of the psychometric soundness of the WSS for assessing employee status using either self-reports or other-source reports. The implications of the development of the WSS for the study of status in organizations are discussed, and suggestions for future research using the new measure are offered. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Determination of Ethanol in Kombucha Products: Single-Laboratory Validation, First Action 2016.12.

Science.gov (United States)

Ebersole, Blake; Liu, Ying; Schmidt, Rich; Eckert, Matt; Brown, Paula N

2017-05-01

Kombucha is a fermented nonalcoholic beverage that has drawn government attention due to the possible presence of excess ethanol (≥0.5% alcohol by volume; ABV). A validated method that provides better precision and accuracy for measuring ethanol levels in kombucha is urgently needed by the kombucha industry. The current study validated a method for determining ethanol content in commercial kombucha products. The ethanol content in kombucha was measured using headspace GC with flame ionization detection. An ethanol standard curve ranging from 0.05 to 5.09% ABV was used, with correlation coefficients greater than 99.9%. The method detection limit was 0.003% ABV and the LOQ was 0.01% ABV. The RSDr ranged from 1.62 to 2.21% and the Horwitz ratio ranged from 0.4 to 0.6. The average accuracy of the method was 98.2%. This method was validated following the guidelines for single-laboratory validation by AOAC INTERNATIONAL and meets the requirements set by AOAC SMPR 2016.001, "Standard Method Performance Requirements for Determination of Ethanol in Kombucha."

An information architecture for validating courseware

OpenAIRE

Melia, Mark; Pahl, Claus

2007-01-01

Courseware validation should locate Learning Objects inconsistent with the courseware instructional design being used. In order for validation to take place it is necessary to identify the implicit and explicit information needed for validation. In this paper, we identify this information and formally define an information architecture to model courseware validation information explicitly. This promotes tool-support for courseware validation and its interoperability with the courseware specif...

Development, linguistic and clinimetric validation of the WOMAC VA3.01 Bangla for Bangladesh Index.

Science.gov (United States)

Rabbani, M G; Haq, S A; Bellamy, N; Islam, M N; Choudhury, M R; Naheed, A; Ahmed, S; Shahin, A

2015-06-01

The aim of this study was to develop and to validate a Bengali version of the Western Ontario and McMaster Osteoarthritis (WOMAC) index in Bangladesh. The WOMAC was translated into the local language of Bangladesh (Bengali) and adapted in the local sociocultural context, following the standard guidelines by Beaton et al. Content validity of the preliminary Bengali version was assessed by using the index of content validity (ICV) and floor and ceiling effects. Patients were assessed at the Department of Rheumatology of Bangabandhu Sheikh Mujib Medical University and were diagnosed to have knee OA by American College of Rheumatology criteria and recruited according to the requirements of the validation study. Convergent and divergent validity were measured by comparing with Health Assessment Questionnaire (HAQ) and the Short Form-36 (SF-36), and internal consistency was assessed using Cronbach's alpha coefficient. The questionnaire was readministered to 40 patients within a week for assessing reliability by using intra-class correlation coefficient (ICC) and Spearman's rank correlation coefficient. In addition, factor analysis of Bengali WOMAC questionnaire was performed to examine the number of factors influencing a common set of items. A Bengali version was developed with changes in three items to suit local practices. The ICV of the content validity was 1 for all items. The Bengali WOMAC had similar construct validity when compared to the HAQ (ρ 0.74, n = 70) and SF-36 bodily pain and physical functioning. It had dissimilar construct validity to SF-36 mental health domain except WOMAC pain. Factor analysis revealed five factors with eigenvalues of more than 1.0. Cronbach's alpha and ICC exceeded 0.7 in all domains. In the test-retest reliability testing, Spearman's ρ for all items exceeded 0.4 (n = 40). This study has demonstrated that the Bengali version of WOMAC is a valid tool for assessing quality of life of patients with knee osteoarthritis in Bangladesh

A Turkish version of myocardial infarction dimensional assessment scale (TR-MIDAS): reliability-validity assesment.

Science.gov (United States)

Uysal, Hilal; Ozcan, Şeyda

2011-06-01

Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.

Lesson 6: Signature Validation

Science.gov (United States)

Checklist items 13 through 17 are grouped under the Signature Validation Process, and represent CROMERR requirements that the system must satisfy as part of ensuring that electronic signatures it receives are valid.

Development and validation of an asthma first aid knowledge questionnaire.

Science.gov (United States)

Luckie, Kate; Pang, Tsz Chun; Kritikos, Vicky; Saini, Bandana; Moles, Rebekah Jane

2018-05-01

There is no gold standard outcome assessment for asthma first-aid knowledge. We therefore aimed to develop and validate an asthma first-aid knowledge questionnaire (AFAKQ) to be used before and after educational interventions. The AFAKQ was developed based on a content analysis of existing asthma knowledge questionnaires and current asthma management guidelines. Content and face validity was performed by a review panel consisting of expert respiratory physicians, researchers and parents of school aged children. A 21 item questionnaire was then pilot tested among a sample of caregivers, health professionals and pharmacy students. Exploratory Factor analysis was performed to determine internal consistency. The initial 46 item version of the AFAKQ, was reduced to 21 items after revision by the expert panel. This was then pilot tested amongst 161 participants and further reduced to 14 items. The exploratory factor analysis revealed a parsimonious one factor solution with a Cronbach's Alpha of 0.77 with the 14 item AFAKQ. The AFAKQ is a valid tool ready for application in evaluating the impact of educational interventions on asthma first-aid knowledge. Copyright © 2017 Elsevier Inc. All rights reserved.

Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity.

Science.gov (United States)

Hawkins, Melanie; Elsworth, Gerald R; Osborne, Richard H

2018-07-01

Data from subjective patient-reported outcome measures (PROMs) are now being used in the health sector to make or support decisions about individuals, groups and populations. Contemporary validity theorists define validity not as a statistical property of the test but as the extent to which empirical evidence supports the interpretation of test scores for an intended use. However, validity testing theory and methodology are rarely evident in the PROM validation literature. Application of this theory and methodology would provide structure for comprehensive validation planning to support improved PROM development and sound arguments for the validity of PROM score interpretation and use in each new context. This paper proposes the application of contemporary validity theory and methodology to PROM validity testing. The validity testing principles will be applied to a hypothetical case study with a focus on the interpretation and use of scores from a translated PROM that measures health literacy (the Health Literacy Questionnaire or HLQ). Although robust psychometric properties of a PROM are a pre-condition to its use, a PROM's validity lies in the sound argument that a network of empirical evidence supports the intended interpretation and use of PROM scores for decision making in a particular context. The health sector is yet to apply contemporary theory and methodology to PROM development and validation. The theoretical and methodological processes in this paper are offered as an advancement of the theory and practice of PROM validity testing in the health sector.

Verification and validation benchmarks

International Nuclear Information System (INIS)

Oberkampf, William Louis; Trucano, Timothy Guy

2007-01-01

Verification and validation (V and V) are the primary means to assess the accuracy and reliability of computational simulations. V and V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V and V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the

Verification and validation benchmarks

International Nuclear Information System (INIS)

Oberkampf, William L.; Trucano, Timothy G.

2008-01-01

Verification and validation (V and V) are the primary means to assess the accuracy and reliability of computational simulations. V and V methods and procedures have fundamentally improved the credibility of simulations in several high-consequence fields, such as nuclear reactor safety, underground nuclear waste storage, and nuclear weapon safety. Although the terminology is not uniform across engineering disciplines, code verification deals with assessing the reliability of the software coding, and solution verification deals with assessing the numerical accuracy of the solution to a computational model. Validation addresses the physics modeling accuracy of a computational simulation by comparing the computational results with experimental data. Code verification benchmarks and validation benchmarks have been constructed for a number of years in every field of computational simulation. However, no comprehensive guidelines have been proposed for the construction and use of V and V benchmarks. For example, the field of nuclear reactor safety has not focused on code verification benchmarks, but it has placed great emphasis on developing validation benchmarks. Many of these validation benchmarks are closely related to the operations of actual reactors at near-safety-critical conditions, as opposed to being more fundamental-physics benchmarks. This paper presents recommendations for the effective design and use of code verification benchmarks based on manufactured solutions, classical analytical solutions, and highly accurate numerical solutions. In addition, this paper presents recommendations for the design and use of validation benchmarks, highlighting the careful design of building-block experiments, the estimation of experimental measurement uncertainty for both inputs and outputs to the code, validation metrics, and the role of model calibration in validation. It is argued that the understanding of predictive capability of a computational model is built on the

Developing and Validating the Communication Function Classification System for Individuals with Cerebral Palsy

Science.gov (United States)

Hidecker, Mary Jo Cooley; Paneth, Nigel; Rosenbaum, Peter L.; Kent, Raymond D.; Lillie, Janet; Eulenberg, John B.; Chester, Ken, Jr.; Johnson, Brenda; Michalsen, Lauren; Evatt, Morgan; Taylor, Kara

2011-01-01

Aim: The purpose of this study was to create and validate the Communication Function Classification System (CFCS) for children with cerebral palsy (CP), for use by a wide variety of individuals who are interested in CP. This paper reports the content validity, interrater reliability, and test-retest reliability of the CFCS for children with CP.…

MMPI-2 validity, clinical and content scales, and the Fake Bad Scale for personal injury litigants claiming idiopathic environmental intolerance.

Science.gov (United States)

Staudenmayer, Herman; Phillips, Scott

2007-01-01

Idiopathic environmental intolerance (IEI) is a descriptor for nonspecific complaints that are attributed to environmental exposure. The Minnesota Multiphasic Personality Inventory 2 (MMPI-2) was administered to 50 female and 20 male personal injury litigants alleging IEI. The validity scales indicated no overreporting of psychopathology. Half of the cases had elevated scores on validity scales suggesting defensiveness, and a large number had elevations on Fake Bad Scale (FBS) suggesting overreporting of unauthenticated symptoms. The average T-score profile for females was defined by the two-point code type 3-1 (Hysteria-Hypochondriasis), and the average T-score profile for males was defined by the three-point code type 3-1-2 (Hysteria, Hypochondriasis-Depression). On the content scales, Health Concerns (HEA) scale was significantly elevated. Idiopathic environmental intolerance litigants (a) are more defensive about expressing psychopathology, (b) express distress through somatization, (c) use a self-serving misrepresentation of exaggerated health concerns, and (d) may exaggerate unauthenticated symptoms suggesting malingering.

Validation: an overview of definitions

International Nuclear Information System (INIS)

Pescatore, C.

1995-01-01

The term validation is featured prominently in the literature on radioactive high-level waste disposal and is generally understood to be related to model testing using experiments. In a first class, validation is linked to the goal of predicting the physical world as faithfully as possible but is unattainable and unsuitable for setting goals for the safety analyses. In a second class, validation is associated to split-sampling or to blind-tests predictions. In the third class of definition, validation focuses on the quality of the decision-making process. Most prominent in the present review is the observed lack of use of the term validation in the field of low-level radioactive waste disposal. The continued informal use of the term validation in the field of high level wastes disposals can become cause for misperceptions and endless speculations. The paper proposes either abandoning the use of this term or agreeing to a definition which would be common to all. (J.S.). 29 refs

Dragons and Dinosaurs: Directing Inquiry in Biology Using the Notions of "Milieu" and "Validation"

Science.gov (United States)

Achiam, Marianne; Solberg, Jan; Evans, Robert

2013-01-01

This article describes how inquiry teaching can be directed towards specific content learning goals while allowing for student exploration and validation of hypotheses. Drawing from the Theory of Didactical Situations, the concepts of "milieu" and "validation" are illustrated through two sample biology lessons designed to engage and challenge…

Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills.

Science.gov (United States)

Kawaguchi, Koji; Egi, Hiroyuki; Hattori, Minoru; Sawada, Hiroyuki; Suzuki, Takahisa; Ohdan, Hideki

2014-10-01

Virtual reality surgical simulators are becoming popular as a means of providing trainees with an opportunity to practice laparoscopic skills. The Lap-X (Epona Medical, Rotterdam, the Netherlands) is a novel VR simulator for training basic skills in laparoscopic surgery. The objective of this study was to validate the LAP-X laparoscopic virtual reality simulator by assessing the face and construct validity in order to determine whether the simulator is adequate for basic skills training. The face and content validity were evaluated using a structured questionnaire. To assess the construct validity, the participants, nine expert surgeons (median age: 40 (32-45)) (>100 laparoscopic procedures) and 11 novices performed three basic laparoscopic tasks using the Lap-X. The participants reported a high level of content validity. No significant differences were found between the expert surgeons and the novices (Ps > 0.246). The performance of the expert surgeons on the three tasks was significantly better than that of the novices in all parameters (Ps training device.

Content validity of CASA-Q cough domains and UCSD-SOBQ for use in patients with Idiopathic Pulmonary Fibrosis.

Science.gov (United States)

Gries, Katharine Suzanne; Esser, Dirk; Wiklund, Ingela

2013-09-16

The study objective was to assess the content validity of the Cough and Sputum Assessment Questionnaire (CASA-Q) cough domains and the UCSD Shortness of Breath Questionnaire (SOBQ) for use in patients with Idiopathic Pulmonary Fibrosis (IPF). Cross-sectional, qualitative study with cognitive interviews in patients with IPF. Study outcomes included relevance, comprehension of item meaning, understanding of the instructions, recall period, response options, and concept saturation. Interviews were conducted with 18 IPF patients. The mean age was 68.9 years (SD 11.9), 77.8% were male, and 88.9% were Caucasian. The intended meaning of the CASA-Q cough domain items was clearly understood by most of the participants (89-100%). All participants understood the CASA-Q instructions; the correct recall period was reported by 89% of the patients, and the response options were understood by 76%. The intended meaning of the UCSD-SOBQ items was relevant and clearly understood by all participants. Participants understood the instructions (83%) and all patients understood the response options (100%). The reported recall period varied based on the type of activity performed. No concepts were missing, suggesting that saturation was demonstrated for both measures. This study provides evidence for content validity for the CASA-Q cough domains and the UCSD-SOBQ for patients with IPF. Items of both questionnaires were understood and perceived as relevant to measure the key symptoms of IPF. The results of this study support the use of these instruments in IPF clinical trials as well as further studies of their psychometric properties.

Validation philosophy

International Nuclear Information System (INIS)

Vornehm, D.

1994-01-01

To determine when a set of calculations falls within an umbrella of an existing validation documentation, it is necessary to generate a quantitative definition of range of applicability (our definition is only qualitative) for two reasons: (1) the current trend in our regulatory environment will soon make it impossible to support the legitimacy of a validation without quantitative guidelines; and (2) in my opinion, the lack of support by DOE for further critical experiment work is directly tied to our inability to draw a quantitative open-quotes line-in-the-sandclose quotes beyond which we will not use computer-generated values

Developing a model for hospital inherent safety assessment: Conceptualization and validation.

Science.gov (United States)

Yari, Saeed; Akbari, Hesam; Gholami Fesharaki, Mohammad; Khosravizadeh, Omid; Ghasemi, Mohammad; Barsam, Yalda; Akbari, Hamed

2018-01-01

Paying attention to the safety of hospitals, as the most crucial institute for providing medical and health services wherein a bundle of facilities, equipment, and human resource exist, is of significant importance. The present research aims at developing a model for assessing hospitals' safety based on principles of inherent safety design. Face validity (30 experts), content validity (20 experts), construct validity (268 examples), convergent validity, and divergent validity have been employed to validate the prepared questionnaire; and the items analysis, the Cronbach's alpha test, ICC test (to measure reliability of the test), composite reliability coefficient have been used to measure primary reliability. The relationship between variables and factors has been confirmed at 0.05 significance level by conducting confirmatory factor analysis (CFA) and structural equations modeling (SEM) technique with the use of Smart-PLS. R-square and load factors values, which were higher than 0.67 and 0.300 respectively, indicated the strong fit. Moderation (0.970), simplification (0.959), substitution (0.943), and minimization (0.5008) have had the most weights in determining the inherent safety of hospital respectively. Moderation, simplification, and substitution, among the other dimensions, have more weight on the inherent safety, while minimization has the less weight, which could be due do its definition as to minimize the risk.

NVN 5694 intra laboratory validation. Feasibility study for interlaboratory- validation

International Nuclear Information System (INIS)

Voors, P.I.; Baard, J.H.

1998-11-01

Within the project NORMSTAR 2 a number of Dutch prenormative protocols have been defined for radioactivity measurements. Some of these protocols, e.g. the Dutch prenormative protocol NVN 5694, titled Methods for radiochemical determination of polonium-210 and lead-210, have not been validated, neither by intralaboratory nor interlaboratory studies. Validation studies are conducted within the framework of the programme 'Normalisatie and Validatie van Milieumethoden 1993-1997' (Standardization and Validation of test methods for environmental parameters) of the Dutch Ministry of Housing, Physical Planning and the Environment (VROM). The aims of this study were (a) a critical evaluation of the protocol, (b) investigation on the feasibility of an interlaboratory study, and (c) the interlaboratory validation of NVN 5694. The evaluation of the protocol resulted in a list of deficiencies varying from missing references to incorrect formulae. From the survey by interview it appeared that for each type of material, there are 4 to 7 laboratories willing to participate in a interlaboratory validation study. This reflects the situation in 1997. Consequently, if 4 or 6 (the minimal number) laboratories are participating and each laboratory analyses 3 subsamples, the uncertainty in the repeatability standard deviation is 49 or 40 %, respectively. If the ratio of reproducibility standard deviation to the repeatability standard deviation is equal to 1 or 2, then the uncertainty in the reproducibility standard deviation increases from 42 to 67 % and from 34 to 52 % for 4 or 6 laboratories, respectively. The intralaboratory validation was established on four different types of materials. Three types of materials (milkpowder condensate and filter) were prepared in the laboratory using the raw material and certified Pb-210 solutions, and one (sediment) was obtained from the IAEA. The ECN-prepared reference materials were used after testing on homogeneity. The pre-normative protocol can

Reliability and validity of the Spanish version of the modified Yale Preoperative Anxiety Scale.

Science.gov (United States)

Jerez, C; Ullán, A M; Lázaro, J J

2016-01-01

To minimise preoperative stress and increase child cooperation during induction of anaesthesia is one of the most important perioperative objectives. The modified Yale Preoperative Anxiety Scale was developed to evaluate anxiety. The aim of this study was to translate into Spanish, and validate the psychometric properties of the Spanish version of this scale. The Spanish translation of the scale was performed following the World Health Organisation guidelines. During induction of anaesthesia, 81 children aged 2 to 12 years were recorded. Two observers evaluated the recordings independently. Content validity index of modified Yale Preoperative Anxiety Scale Spanish version was assessed. Weighted Kappa was calculated to measure interobserver agreement, and the Pearson correlation between the Induction Compliance Checklist and the modified Yale Preoperative Anxiety Scale was determined. The Spanish version obtained high content validity (0.91 to 0.98). Reliability analysis using weighted Kappa statistics revealed that interobserver agreement ranged from 0.54 to 0.75. Concurrent validity was high (r=0.94; P<.001). Validated assessment tools are needed to evaluate interventions to reduce child preoperative anxiety. The Spanish version of the modified Yale Preoperative Anxiety Scale evaluated in this study has shown good psychometric properties of reliability and validity. Copyright © 2015 Sociedad Española de Anestesiología, Reanimación y Terapéutica del Dolor. Publicado por Elsevier España, S.L.U. All rights reserved.

Validation of the da Vinci Surgical Skill Simulator across three surgical disciplines: A pilot study

Science.gov (United States)

Alzahrani, Tarek; Haddad, Richard; Alkhayal, Abdullah; Delisle, Josée; Drudi, Laura; Gotlieb, Walter; Fraser, Shannon; Bergman, Simon; Bladou, Frank; Andonian, Sero; Anidjar, Maurice

2013-01-01

Objective: In this paper, we evaluate face, content and construct validity of the da Vinci Surgical Skills Simulator (dVSSS) across 3 surgical disciplines. Methods: In total, 48 participants from urology, gynecology and general surgery participated in the study as novices (0 robotic cases performed), intermediates (1–74) or experts (≥75). Each participant completed 9 tasks (Peg board level 2, match board level 2, needle targeting, ring and rail level 2, dots and needles level 1, suture sponge level 2, energy dissection level 1, ring walk level 3 and tubes). The Mimic Technologies software scored each task from 0 (worst) to 100 (best) using several predetermined metrics. Face and content validity were evaluated by a questionnaire administered after task completion. Wilcoxon test was used to perform pair wise comparisons. Results: The expert group comprised of 6 attending surgeons. The intermediate group included 4 attending surgeons, 3 fellows and 5 residents. The novices included 1 attending surgeon, 1 fellow, 13 residents, 13 medical students and 2 research assistants. The median number of robotic cases performed by experts and intermediates were 250 and 9, respectively. The median overall realistic score (face validity) was 8/10. Experts rated the usefulness of the simulator as a training tool for residents (content validity) as 8.5/10. For construct validity, experts outperformed novices in all 9 tasks (p < 0.05). Intermediates outperformed novices in 7 of 9 tasks (p < 0.05); there were no significant differences in the energy dissection and ring walk tasks. Finally, experts scored significantly better than intermediates in only 3 of 9 tasks (matchboard, dots and needles and energy dissection) (p < 0.05). Conclusions: This study confirms the face, content and construct validities of the dVSSS across urology, gynecology and general surgery. Larger sample size and more complex tasks are needed to further differentiate intermediates from experts. PMID:23914275

Analysis of expert validation on developing integrated science worksheet to improve problem solving skills of natural science prospective teachers

Science.gov (United States)

Widodo, W.; Sudibyo, E.; Sari, D. A. P.

2018-04-01

This study aims to develop student worksheets for higher education that apply integrated science learning in discussing issues about motion in humans. These worksheets will guide students to solve the problem about human movement. They must integrate their knowledge about biology, physics, and chemistry to solve the problem. The worksheet was validated by three experts in Natural Science Integrated Science, especially in Human Movement topic. The aspects of the validation were feasibility of the content, the construction, and the language. This research used the Likert scale to measure the validity of each aspect, which is 4.00 for very good validity criteria, 3.00 for good validity criteria, 2.00 for more or less validity criteria, and 1.00 for not good validity criteria. Data showed that the validity for each aspect were in the range of good validity and very good validity criteria (3.33 to 3.67 for the content aspect, 2.33 to 4.00 for the construction aspect, and 3.33 to 4.00 for language aspect). However, there was a part of construction aspect that needed to improve. Overall, this students’ worksheet can be applied in classroom after some revisions based on suggestions from the validators.

Child abuse: validation of a questionnaire translated into Brazilian Portuguese

Directory of Open Access Journals (Sweden)

Glaucia Marengo

2013-04-01

Full Text Available This study sought to validate the Portuguese translation of a questionnaire on maltreatment of children and adolescents, developed by Russell et al. and to test its psychometric properties for use in Brazil. The original questionnaire was translated into Portuguese using a standardized forward-backward linguistic translation method. Both face and content validity were tested in a small pilot study (n = 8. In the main study, a convenience sample of 80 graduate dentistry students with different specialties, from Curitiba, PR, Brazil, were invited to complete the final Brazilian version of the questionnaire. Discriminant validity was assessed by comparing the results obtained from the questionnaire for different specialties (pediatric dentistry, for example. The respondents completed the questionnaire again after 4 weeks to evaluate test-retest reliability. The comparison of test versus retest questionnaire answers showed good agreement (kappa > 0.53, intraclass correlation > 0.84 for most questions. In regard to discriminant validity, a statistically significant difference was observed only in the experience and interest domains, in which pediatric dentists showed more experience with and interest in child abuse compared with dentists of other specialties (Mann-Whitney test, p < 0.05. The Brazilian version of the questionnaire was valid and reliable for assessing knowledge regarding child abuse by Portuguese-speaking dentists.

SHIELD verification and validation report

International Nuclear Information System (INIS)

Boman, C.

1992-02-01

This document outlines the verification and validation effort for the SHIELD, SHLDED, GEDIT, GENPRT, FIPROD, FPCALC, and PROCES modules of the SHIELD system code. Along with its predecessors, SHIELD has been in use at the Savannah River Site (SRS) for more than ten years. During this time the code has been extensively tested and a variety of validation documents have been issued. The primary function of this report is to specify the features and capabilities for which SHIELD is to be considered validated, and to reference the documents that establish the validation

Worst-case study for cleaning validation of equipment in the radiopharmaceutical production of lyophilized reagents: Methodology validation of total organic carbon

International Nuclear Information System (INIS)

Porto, Luciana Valeria Ferrari Machado

2015-01-01

Radiopharmaceuticals are defined as pharmaceutical preparations containing a radionuclide in their composition, mostly intravenously administered, and therefore compliance with the principles of Good Manufacturing Practices (GMP) is essential and indispensable. Cleaning validation is a requirement of the current GMP, and consists of documented evidence, which demonstrates that the cleaning procedures are able to remove residues to pre-determined acceptance levels, ensuring that no cross contamination occurs. A simplification of cleaning processes validation is accepted, and consists in choosing a product, called 'worst case', to represent the cleaning processes of all equipment of the same production area. One of the steps of cleaning validation is the establishment and validation of the analytical method to quantify the residue. The aim of this study was to establish the worst case for cleaning validation of equipment in the radiopharmaceutical production of lyophilized reagent (LR) for labeling with 99m Tc, evaluate the use of Total Organic Carbon (TOC) content as indicator of equipment cleaning used in the LR manufacture, validate the method of Non-Purgeable Organic Carbon (NPOC), and perform recovery tests with the product chosen as worst case. Worst case product's choice was based on the calculation of an index called 'Worst Case Index' (WCI), using information about drug solubility, difficulty of cleaning the equipment and occupancy rate of the products in line production. The products indicated 'worst case' was the LR MIBI-TEC. The method validation assays were performed using carbon analyser model TOC-Vwp coupled to an autosampler model ASI-V, both from Shimadzu®, controlled by TOC Control-V software. It was used the direct method for NPOC quantification. The parameters evaluated in the validation method were: system suitability, robustness, linearity, detection limit (DL) and quantification limit (QL), precision

Development and Validation of Chinese Health Literacy Scale for Low Salt Consumption-Hong Kong Population (CHLSalt-HK.

Directory of Open Access Journals (Sweden)

P H Chau

Full Text Available Globally, sodium intake far exceeds the level recommended by the World Health Organization. Assessing health literacy related to salt consumption among older adults could guide the development of interventions that target their knowledge gaps, misconceptions, or poor dietary practices. This study aimed to develop and validate the Chinese Health Literacy Scale for Low Salt Consumption-Hong Kong population (CHLSalt-HK. Based on previous studies on salt intake and nutrition label reading in other countries, we developed similar questions that were appropriate for the Chinese population in Hong Kong. The questions covered the following eight broad areas: functional literacy (term recognition and nutrition label reading, knowledge of the salt content of foods, knowledge of the diseases related to high salt intake, knowledge of international standards, myths about salt intake, attitudes toward salt intake, salty food consumption practices, and nutrition label reading practices. Eight professionals, including doctors, nurses, and dietitians, provided feedback on the scale. The psychometric properties of the scale were assessed based on data collected from a convenience sample of 603 Chinese elderly adults recruited from Elderly Health Centres in Hong Kong. The 49-item CHLSalt-HK had a possible score range of 0 to 98, with a higher score indicating higher health literacy related to salt intake. The CHLSalt-HK had acceptable content validity; the item-level Content Validity Index ranged from 0.857 to 1.000, and the scale-level Content Validity Index was 0.994. Additionally, it had good internal consistency (Cronbach's alpha of 0.799 and good test-retest reliability (intraclass correlation coefficient of 0.846. The mean CHLSalt-HK score among those who were aware of the public education slogan about nutrition labels and sodium intake was higher by 3.928 points (95% confidence interval: 1.742 to 6.115 than that among those who were not aware of the slogan

Making Validated Educational Models Central in Preschool Standards.

Science.gov (United States)

Schweinhart, Lawrence J.

This paper presents some ideas to preschool educators and policy makers about how to make validated educational models central in standards for preschool education and care programs that are available to all 3- and 4-year-olds. Defining an educational model as a coherent body of program practices, curriculum content, program and child, and teacher…

Validation of Multilevel Constructs: Validation Methods and Empirical Findings for the EDI

Science.gov (United States)

Forer, Barry; Zumbo, Bruno D.

2011-01-01

The purposes of this paper are to highlight the foundations of multilevel construct validation, describe two methodological approaches and associated analytic techniques, and then apply these approaches and techniques to the multilevel construct validation of a widely-used school readiness measure called the Early Development Instrument (EDI;…

Comparative Validation of Building Simulation Software

DEFF Research Database (Denmark)

Kalyanova, Olena; Heiselberg, Per

The scope of this subtask is to perform a comparative validation of the building simulation software for the buildings with the double skin façade. The outline of the results in the comparative validation identifies the areas where is no correspondence achieved, i.e. calculation of the air flow r...... is that the comparative validation can be regarded as the main argument to continue the validation of the building simulation software for the buildings with the double skin façade with the empirical validation test cases.......The scope of this subtask is to perform a comparative validation of the building simulation software for the buildings with the double skin façade. The outline of the results in the comparative validation identifies the areas where is no correspondence achieved, i.e. calculation of the air flow...

Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study.

Science.gov (United States)

González-Chordá, Víctor M; Mena-Tudela, Desirée; Salas-Medina, Pablo; Cervera-Gasch, Agueda; Orts-Cortés, Isabel; Maciá-Soler, Loreto

2016-02-01

Writing a bachelor thesis (BT) is the last step to obtain a nursing degree. In order to perform an effective assessment of a nursing BT, certain reliable and valid tools are required. To develop and validate a 3-rubric system (drafting process, dissertation, and viva) to assess final year nursing students' BT. A multi-disciplinary study of content validity and psychometric properties. The study was carried out between December 2014 and July 2015. Nursing Degree at Universitat Jaume I. Spain. Eleven experts (9 nursing professors and 2 education professors from 6 different universities) took part in the development and content validity stages. Fifty-two theses presented during the 2014-2015 academic year were included by consecutive sampling of cases in order to study the psychometric properties. First, a group of experts was created to validate the content of the assessment system based on three rubrics (drafting process, dissertation, and viva). Subsequently, a reliability and validity study of the rubrics was carried out on the 52 theses presented during the 2014-2015 academic year. The BT drafting process rubric has 8 criteria (S-CVI=0.93; α=0.837; ICC=0.614), the dissertation rubric has 7 criteria (S-CVI=0.9; α=0.893; ICC=0.74), and the viva rubric has 4 criteria (S-CVI=0.86; α=8.16; ICC=0.895). A nursing BT assessment system based on three rubrics (drafting process, dissertation, and viva) has been validated. This system may be transferred to other nursing degrees or degrees from other academic areas. It is necessary to continue with the validation process taking into account factors that may affect the results obtained. Copyright © 2015 Elsevier Ltd. All rights reserved.

Pre-validation methods for developing a patient reported outcome instrument

Directory of Open Access Journals (Sweden)

Castillo Mayret M

2011-08-01

Full Text Available Abstract Background Measures that reflect patients' assessment of their health are of increasing importance as outcome measures in randomised controlled trials. The methodological approach used in the pre-validation development of new instruments (item generation, item reduction and question formatting should be robust and transparent. The totality of the content of existing PRO instruments for a specific condition provides a valuable resource (pool of items that can be utilised to develop new instruments. Such 'top down' approaches are common, but the explicit pre-validation methods are often poorly reported. This paper presents a systematic and generalisable 5-step pre-validation PRO instrument methodology. Methods The method is illustrated using the example of the Aberdeen Glaucoma Questionnaire (AGQ. The five steps are: 1 Generation of a pool of items; 2 Item de-duplication (three phases; 3 Item reduction (two phases; 4 Assessment of the remaining items' content coverage against a pre-existing theoretical framework appropriate to the objectives of the instrument and the target population (e.g. ICF; and 5 qualitative exploration of the target populations' views of the new instrument and the items it contains. Results The AGQ 'item pool' contained 725 items. Three de-duplication phases resulted in reduction of 91, 225 and 48 items respectively. The item reduction phases discarded 70 items and 208 items respectively. The draft AGQ contained 83 items with good content coverage. The qualitative exploration ('think aloud' study resulted in removal of a further 15 items and refinement to the wording of others. The resultant draft AGQ contained 68 items. Conclusions This study presents a novel methodology for developing a PRO instrument, based on three sources: literature reporting what is important to patient; theoretically coherent framework; and patients' experience of completing the instrument. By systematically accounting for all items dropped

End-of-life practices in Danish ICUs: development and validation of a questionnaire.

Science.gov (United States)

Jensen, Hanne Irene; Ammentorp, Jette; Erlandsen, Mogens; Ording, Helle

2012-08-01

Practices for withholding or withdrawing therapy vary according to professional, cultural and religious differences. No Danish-validated questionnaire examining withholding and withdrawing practices exists, thus the aim of this study was to develop and validate a questionnaire for surveying the views of intensive care nurses, intensivists, and primary physicians regarding collaboration and other aspects of withholding and withdrawing therapy in the ICU. A questionnaire was developed on the basis of literature, focus group interviews with intensive care nurses and intensivists, and individual interviews with primary physicians. The questionnaire was validated in the following 3 phases: a qualitative test with 17 participants; a quantitative pilot test with 60 participants; and a survey with 776 participants. The validation process included tests for face and content validity (by interviewing participants in the qualitative part of the pilot study), reliability (by assessing the distribution of responses within the individual response categories), agreement (by conducting a test-retest, evaluated by paired analyses), known groups' validity (as a surrogate test for responsiveness, by comparing two ICUs with a known difference in end-of-life practices), floor and ceiling effect, and missing data. Face and content validity were assessed as good by the participants in the qualitative pilot test; all considered the questions relevant and none of the participants found areas lacking. Almost all response categories were used by the participants, thus demonstrating the questionnaires ability to distinguish between different respondents, agreement was fair (the average test-retest agreement for the Likert scale responses was 0.54 (weighted kappa; range, 0.25-0.73), and known groups' validity was proved by finding significant differences in level of satisfaction with interdisciplinary collaboration and in experiences of withdrawal decisions being unnecessarily postponed. Floor

End-of-life practices in Danish ICUs: development and validation of a questionnaire

Directory of Open Access Journals (Sweden)

Jensen Hanne

2012-08-01

Full Text Available Abstract Background Practices for withholding or withdrawing therapy vary according to professional, cultural and religious differences. No Danish-validated questionnaire examining withholding and withdrawing practices exists, thus the aim of this study was to develop and validate a questionnaire for surveying the views of intensive care nurses, intensivists, and primary physicians regarding collaboration and other aspects of withholding and withdrawing therapy in the ICU. Methods A questionnaire was developed on the basis of literature, focus group interviews with intensive care nurses and intensivists, and individual interviews with primary physicians. The questionnaire was validated in the following 3 phases: a qualitative test with 17 participants; a quantitative pilot test with 60 participants; and a survey with 776 participants. The validation process included tests for face and content validity (by interviewing participants in the qualitative part of the pilot study, reliability (by assessing the distribution of responses within the individual response categories, agreement (by conducting a test-retest, evaluated by paired analyses, known groups’ validity (as a surrogate test for responsiveness, by comparing two ICUs with a known difference in end-of-life practices, floor and ceiling effect, and missing data. Results Face and content validity were assessed as good by the participants in the qualitative pilot test; all considered the questions relevant and none of the participants found areas lacking. Almost all response categories were used by the participants, thus demonstrating the questionnaires ability to distinguish between different respondents, agreement was fair (the average test-retest agreement for the Likert scale responses was 0.54 (weighted kappa; range, 0.25-0.73, and known groups’ validity was proved by finding significant differences in level of satisfaction with interdisciplinary collaboration and in experiences of

The A-test: Assessment of functional recovery during early rehabilitation of patients in an orthopedic ward - content, criterion and construct validity

Directory of Open Access Journals (Sweden)

Vukomanović Aleksandra

2014-01-01

Full Text Available Background/Aim. The A-test was designed for assessment of functional recovery during early rehabilitation of patients in an orthopedic ward. This performance-based test consists of 10 items for assessing basic activities by a six level ordinal scale (0-5. Total scores can range from 0 to 50, i.e. from inability to perform any activity despite the help of therapists to complete independence and safety in performing all activities. The aim of this study was to examine the A-test validity. Methods. This prospective study was conducted in an orthopedic ward and included 120 patients [60 patients with hip osteoarthritis that underwent arthroplasty and 60 surgically treated patients with hip fracture (HF] during early inpatient rehabilitation (1st-5th day. Validity was examined through 3 aspects: content validity - floor and ceiling effect, range, skewness; criterion validity - concurrent validity [correlation with the University of Iowa Level of Assistance Scale (ILAS for patients with hip osteoarthritis, and with the Cumulated Ambulation Score (CAS for patients with HF, Spearman rank correlation] and predictive validity [the New Mobility Score (NMS 4 weeks after surgery, Mann-Whitney U test]; construct validity - 4 hypotheses: 1 on the fifth day of rehabilitation in patients underwent arthroplasty due to hip osteoarthritis, the A-test results will strongly correlate with those of ILAS, while the correlation with the Harris hip score will be less strong; 2 in patients with HF, the A-test results will be significantly better in those with allowed weight bearing as compared to patients whom weight bearing is not allowed while walking; 3 results of the A-test will be significantly better in patients with hip osetoarthritis than in those with HF; 4 the A-test results will be significantly better in patients younger than 65 years than in those aged 65 years and older. Results. The obtained results were: low floor (1% and ceiling (2% effect, range 0

Reliability and validity of a tool to measure the severity of tongue thrust in children: the Tongue Thrust Rating Scale.

Science.gov (United States)

Serel Arslan, S; Demir, N; Karaduman, A A

2017-02-01

This study aimed to develop a scale called Tongue Thrust Rating Scale (TTRS), which categorised tongue thrust in children in terms of its severity during swallowing, and to investigate its validity and reliability. The study describes the developmental phase of the TTRS and presented its content and criterion-based validity and interobserver and intra-observer reliability. For content validation, seven experts assessed the steps in the scale over two Delphi rounds. Two physical therapists evaluated videos of 50 children with cerebral palsy (mean age, 57·9 ± 16·8 months), using the TTRS to test criterion-based validity, interobserver and intra-observer reliability. The Karaduman Chewing Performance Scale (KCPS) and Drooling Severity and Frequency Scale (DSFS) were used for criterion-based validity. All the TTRS steps were deemed necessary. The content validity index was 0·857. A very strong positive correlation was found between two examinations by one physical therapist, which indicated intra-observer reliability (r = 0·938, P reliability (r = 0·892, P validity of the TTRS. The TTRS is a valid, reliable and clinically easy-to-use functional instrument to document the severity of tongue thrust in children. © 2016 John Wiley & Sons Ltd.

What Type of Knowledge Provides Valid Housing Standards Addressing Accessibility?

DEFF Research Database (Denmark)

Helle, Tina; Brandt, Åse; Iwarsson, Susanne

evaluations of task-surface heights in elderly people’s homes. Applied Ergonomics, 31, 109-119. Kohlbacher, F. (2006). The use of qualitative content analysis in case study research. Forum: Qualitative social research sozialforschung (FQS), Open Journal Systems, vol 7, No1. Kozey, J.W. & Das, B. (2004...... accessibility aspects such as either reach, seat height or space requirements • Targeted primarily industrial workstation design and only wheelchair/scooter users • Addressed positions (standing/seated) and sex difference with respect to reach • Was generated in lab-like environments, using methods...... of the validity of housing standards. Therefore, it is reasonable to question what type of knowledge that provides the most valid standards addressing accessibility and explore the consequences of using an alternative approach. The idea was thus to examine the validity of a set of housing standards using a so...

Extending the validity of the Feeding Practices and Structure Questionnaire.

Science.gov (United States)

Jansen, Elena; Mallan, Kimberley M; Daniels, Lynne A

2015-06-30

Feeding practices are commonly examined as potentially modifiable determinants of children's eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children's eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n = 388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. The original 9-factor structure was confirmed when children were aged 3.7 ± 0.3 years. Cronbach's alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r = 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and

A systematic review and appraisal of methods of developing and validating lifestyle cardiovascular disease risk factors questionnaires.

Science.gov (United States)

Nse, Odunaiya; Quinette, Louw; Okechukwu, Ogah

2015-09-01

Well developed and validated lifestyle cardiovascular disease (CVD) risk factors questionnaires is the key to obtaining accurate information to enable planning of CVD prevention program which is a necessity in developing countries. We conducted this review to assess methods and processes used for development and content validation of lifestyle CVD risk factors questionnaires and possibly develop an evidence based guideline for development and content validation of lifestyle CVD risk factors questionnaires. Relevant databases at the Stellenbosch University library were searched for studies conducted between 2008 and 2012, in English language and among humans. Using the following databases; pubmed, cinahl, psyc info and proquest. Search terms used were CVD risk factors, questionnaires, smoking, alcohol, physical activity and diet. Methods identified for development of lifestyle CVD risk factors were; review of literature either systematic or traditional, involvement of expert and /or target population using focus group discussion/interview, clinical experience of authors and deductive reasoning of authors. For validation, methods used were; the involvement of expert panel, the use of target population and factor analysis. Combination of methods produces questionnaires with good content validity and other psychometric properties which we consider good.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

Science.gov (United States)

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

[Conception and Content Validation of a Questionnaire Relating to the Potential Need for Information of Visually Impaired Persons with Regard to Services and Contact Persons].

Science.gov (United States)

Hahn, U; Hechler, T; Witt, U; Krummenauer, F

2015-12-01

A questionnaire was drafted to identify the needs of visually impaired persons and to optimize their access to non-medical support and services. Subjects had to rate a list of 15 everyday activities that are typically affected by visual impairment (for example, being able to orient themselves in the home environment), by indicating the degree to which they perceive each activity to be affected, using a four-stage scale. They had to evaluate these aspects by means of a relevance assessment. The needs profile derived from this is then correlated with individualized information for assistance and support. The questionnaire shall be made available for use by subjects through advisers in some ophthalmic practices and via the internet. The validity of the content of the proposed tool was evaluated on the basis of a survey of 59 experts in the fields of medical, optical and psychological care and of persons involved in training initiatives. The experts were asked to rate the activities by relevance and clarity of the wording and to propose methods to further develop and optimize the content. The validity of the content was quantified according to a process adopted in the literature, based on the parameters Interrater Agreement (IRA) and Content Validity Index (CVI). The results of all responses (n = 19) and the sub-group analysis suggest that the questionnaire adequately reflects the potential needs profile of visually impaired persons. Overall, there was at least 80% agreement among the 19 experts for 93% of the proposed parameterisation of the activities relating to the relevance and clarity of the wording. Individual proposals for optimization of the design of the questionnaire were adopted. Georg Thieme Verlag KG Stuttgart · New York.

Validation of simulation models

DEFF Research Database (Denmark)

Rehman, Muniza; Pedersen, Stig Andur

2012-01-01

In philosophy of science, the interest for computational models and simulations has increased heavily during the past decades. Different positions regarding the validity of models have emerged but the views have not succeeded in capturing the diversity of validation methods. The wide variety...

Validation of a scenario-based assessment of critical thinking using an externally validated tool.

Science.gov (United States)

Buur, Jennifer L; Schmidt, Peggy; Smylie, Dean; Irizarry, Kris; Crocker, Carlos; Tyler, John; Barr, Margaret

2012-01-01

With medical education transitioning from knowledge-based curricula to competency-based curricula, critical thinking skills have emerged as a major competency. While there are validated external instruments for assessing critical thinking, many educators have created their own custom assessments of critical thinking. However, the face validity of these assessments has not been challenged. The purpose of this study was to compare results from a custom assessment of critical thinking with the results from a validated external instrument of critical thinking. Students from the College of Veterinary Medicine at Western University of Health Sciences were administered a custom assessment of critical thinking (ACT) examination and the externally validated instrument, California Critical Thinking Skills Test (CCTST), in the spring of 2011. Total scores and sub-scores from each exam were analyzed for significant correlations using Pearson correlation coefficients. Significant correlations between ACT Blooms 2 and deductive reasoning and total ACT score and deductive reasoning were demonstrated with correlation coefficients of 0.24 and 0.22, respectively. No other statistically significant correlations were found. The lack of significant correlation between the two examinations illustrates the need in medical education to externally validate internal custom assessments. Ultimately, the development and validation of custom assessments of non-knowledge-based competencies will produce higher quality medical professionals.

Nuclear data to support computer code validation

International Nuclear Information System (INIS)

Fisher, S.E.; Broadhead, B.L.; DeHart, M.D.; Primm, R.T. III

1997-04-01

The rate of plutonium disposition will be a key parameter in determining the degree of success of the Fissile Materials Disposition Program. Estimates of the disposition rate are dependent on neutronics calculations. To ensure that these calculations are accurate, the codes and data should be validated against applicable experimental measurements. Further, before mixed-oxide (MOX) fuel can be fabricated and loaded into a reactor, the fuel vendors, fabricators, fuel transporters, reactor owners and operators, regulatory authorities, and the Department of Energy (DOE) must accept the validity of design calculations. This report presents sources of neutronics measurements that have potential application for validating reactor physics (predicting the power distribution in the reactor core), predicting the spent fuel isotopic content, predicting the decay heat generation rate, certifying criticality safety of fuel cycle facilities, and ensuring adequate radiation protection at the fuel cycle facilities and the reactor. The U.S. in-reactor experience with MOX fuel is first presented, followed by information related to other aspects of the MOX fuel performance information that is valuable to this program, but the data base remains largely proprietary. Thus, this information is not reported here. It is expected that the selected consortium will make the necessary arrangements to procure or have access to the requisite information

Kepler Data Validation Time Series File: Description of File Format and Content

Science.gov (United States)

Mullally, Susan E.

2016-01-01

The Kepler space mission searches its time series data for periodic, transit-like signatures. The ephemerides of these events, called Threshold Crossing Events (TCEs), are reported in the TCE tables at the NASA Exoplanet Archive (NExScI). Those TCEs are then further evaluated to create planet candidates and populate the Kepler Objects of Interest (KOI) table, also hosted at the Exoplanet Archive. The search, evaluation and export of TCEs is performed by two pipeline modules, TPS (Transit Planet Search) and DV (Data Validation). TPS searches for the strongest, believable signal and then sends that information to DV to fit a transit model, compute various statistics, and remove the transit events so that the light curve can be searched for other TCEs. More on how this search is done and on the creation of the TCE table can be found in Tenenbaum et al. (2012), Seader et al. (2015), Jenkins (2002). For each star with at least one TCE, the pipeline exports a file that contains the light curves used by TPS and DV to find and evaluate the TCE(s). This document describes the content of these DV time series files, and this introduction provides a bit of context for how the data in these files are used by the pipeline.

Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.

Science.gov (United States)

Zendejas, Benjamin; Ruparel, Raaj K; Cook, David A

2016-02-01

The Fundamentals of Laparoscopic Surgery (FLS) program uses five simulation stations (peg transfer, precision cutting, loop ligation, and suturing with extracorporeal and intracorporeal knot tying) to teach and assess laparoscopic surgery skills. We sought to summarize evidence regarding the validity of scores from the FLS assessment. We systematically searched for studies evaluating the FLS as an assessment tool (last search update February 26, 2013). We classified validity evidence using the currently standard validity framework (content, response process, internal structure, relations with other variables, and consequences). From a pool of 11,628 studies, we identified 23 studies reporting validity evidence for FLS scores. Studies involved residents (n = 19), practicing physicians (n = 17), and medical students (n = 8), in specialties of general (n = 17), gynecologic (n = 4), urologic (n = 1), and veterinary (n = 1) surgery. Evidence was most common in the form of relations with other variables (n = 22, most often expert-novice differences). Only three studies reported internal structure evidence (inter-rater or inter-station reliability), two studies reported content evidence (i.e., derivation of assessment elements), and three studies reported consequences evidence (definition of pass/fail thresholds). Evidence nearly always supported the validity of FLS total scores. However, the loop ligation task lacks discriminatory ability. Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.

The smartphone addiction scale: development and validation of a short version for adolescents.

Directory of Open Access Journals (Sweden)

Min Kwon

Full Text Available OBJECTIVE: This study was designed to investigate the revised and short version of the smartphone addiction scale and the proof of its validity in adolescents. In addition, it suggested cutting off the values by gender in order to determine smartphone addiction and elaborate the characteristics of smartphone usage in adolescents. METHOD: A set of questionnaires were provided to a total of 540 selected participants from April to May of 2013. The participants consisted of 343 boys and 197 girls, and their average age was 14.5 years old. The content validity was performed on a selection of shortened items, while an internal-consistency test was conducted for the verification of its reliability. The concurrent validity was confirmed using SAS, SAPS and KS-scale. Receiver operating characteristics analysis was conducted to suggest cut-off. RESULTS: The 10 final questions were selected using content validity. The internal consistency and concurrent validity of SAS were verified with a Cronbach's alpha of 0.911. The SAS-SV was significantly correlated with the SAS, SAPS and KS-scale. The SAS-SV scores of gender (p<.001 and self-evaluation of smartphone addiction (p<.001 showed significant difference. The ROC analysis results showed an area under a curve (AUC value of 0.963(0.888-1.000, a cut-off value of 31, sensitivity value of 0.867 and specificity value of 0.893 in boys while an AUC value of 0.947(0.887-1.000, a cut-off value of 33, sensitivity value of 0.875, and a specificity value of 0.886 in girls. CONCLUSIONS: The SAS-SV showed good reliability and validity for the assessment of smartphone addiction. The smartphone addiction scale short version, which was developed and validated in this study, could be used efficiently for the evaluation of smartphone addiction in community and research areas.

Initial validation of the Yin-Yang Assessment Questionnaire for persons with diabetes mellitus.

Science.gov (United States)

Wong, Yee Chi Peggy; Pang, Mei Che Samantha

2015-09-10

To initially test for the content validity, comprehensibility, test-retest reliability and internal consistency reliability of the Yin-Yang Assessment Questionnaire (YY-AQ). The process of initial validity and reliability test covered: (1) content validation from the findings of 18 multiple-case studies, validated Yin- and Yang-deficiency assessment questionnaires, relevant literatures and registered Chinese medicine practitioners; (2) comprehension with the levels of comprehensibility for each item categorized on a 3-point scale (not comprehensible; moderately comprehensible; highly comprehensible). A minimum of three respondents selecting for each item of moderately or highly comprehensible were regarded as comprehensive; (3) test-retest reliability conducted with a 2-wk interval. The intraclass correlation coefficients (ICCs) and their 95%CIs were calculated using a two-way random effects model. Wilcoxon Signed Rank test for related samples was adopted to compare the medians of test-retest scores. An ICC value of 0.85 or higher together with P > 0.05, was considered acceptable; and (4) internal consistency of the total items was measured and evaluated by Cronbach's coefficient alpha (α). A Cronbach's α of 0.7 or higher was considered to represent good internal consistency. Eighteen Yin-deficiency and 14 Yang-deficiency presentation items were finalized from content validation. Five participants with type 2 diabetes mellitus (T2DM) performed the comprehensibility and test-retest reliability tests. Comprehensibility score level of each presentation item was found to be moderate or high in three out of the five participants. Test-retest reliability showed that the single measure ICC of the total Yin-deficiency presentation items was 0.99 (95%CI: 0.89-0.99) and the median scores on the first and 14(th) days were 17 (IQR 6.5-27) and 21 (IQR 6-29) (P = 0.144) respectively. The single measure ICC of the total Yang-deficiency presentation items was 0.88 (95%CI: 0

Validation of Serious Games

Directory of Open Access Journals (Sweden)

Katinka van der Kooij

2015-09-01

Full Text Available The application of games for behavioral change has seen a surge in popularity but evidence on the efficacy of these games is contradictory. Anecdotal findings seem to confirm their motivational value whereas most quantitative findings from randomized controlled trials (RCT are negative or difficult to interpret. One cause for the contradictory evidence could be that the standard RCT validation methods are not sensitive to serious games’ effects. To be able to adapt validation methods to the properties of serious games we need a framework that can connect properties of serious game design to the factors that influence the quality of quantitative research outcomes. The Persuasive Game Design model [1] is particularly suitable for this aim as it encompasses the full circle from game design to behavioral change effects on the user. We therefore use this model to connect game design features, such as the gamification method and the intended transfer effect, to factors that determine the conclusion validity of an RCT. In this paper we will apply this model to develop guidelines for setting up validation methods for serious games. This way, we offer game designers and researchers handles on how to develop tailor-made validation methods.

Containment Code Validation Matrix

International Nuclear Information System (INIS)

Chin, Yu-Shan; Mathew, P.M.; Glowa, Glenn; Dickson, Ray; Liang, Zhe; Leitch, Brian; Barber, Duncan; Vasic, Aleks; Bentaib, Ahmed; Journeau, Christophe; Malet, Jeanne; Studer, Etienne; Meynet, Nicolas; Piluso, Pascal; Gelain, Thomas; Michielsen, Nathalie; Peillon, Samuel; Porcheron, Emmanuel; Albiol, Thierry; Clement, Bernard; Sonnenkalb, Martin; Klein-Hessling, Walter; Arndt, Siegfried; Weber, Gunter; Yanez, Jorge; Kotchourko, Alexei; Kuznetsov, Mike; Sangiorgi, Marco; Fontanet, Joan; Herranz, Luis; Garcia De La Rua, Carmen; Santiago, Aleza Enciso; Andreani, Michele; Paladino, Domenico; Dreier, Joerg; Lee, Richard; Amri, Abdallah

2014-01-01

The Committee on the Safety of Nuclear Installations (CSNI) formed the CCVM (Containment Code Validation Matrix) task group in 2002. The objective of this group was to define a basic set of available experiments for code validation, covering the range of containment (ex-vessel) phenomena expected in the course of light and heavy water reactor design basis accidents and beyond design basis accidents/severe accidents. It was to consider phenomena relevant to pressurised heavy water reactor (PHWR), pressurised water reactor (PWR) and boiling water reactor (BWR) designs of Western origin as well as of Eastern European VVER types. This work would complement the two existing CSNI validation matrices for thermal hydraulic code validation (NEA/CSNI/R(1993)14) and In-vessel core degradation (NEA/CSNI/R(2001)21). The report initially provides a brief overview of the main features of a PWR, BWR, CANDU and VVER reactors. It also provides an overview of the ex-vessel corium retention (core catcher). It then provides a general overview of the accident progression for light water and heavy water reactors. The main focus is to capture most of the phenomena and safety systems employed in these reactor types and to highlight the differences. This CCVM contains a description of 127 phenomena, broken down into 6 categories: - Containment Thermal-hydraulics Phenomena; - Hydrogen Behaviour (Combustion, Mitigation and Generation) Phenomena; - Aerosol and Fission Product Behaviour Phenomena; - Iodine Chemistry Phenomena; - Core Melt Distribution and Behaviour in Containment Phenomena; - Systems Phenomena. A synopsis is provided for each phenomenon, including a description, references for further information, significance for DBA and SA/BDBA and a list of experiments that may be used for code validation. The report identified 213 experiments, broken down into the same six categories (as done for the phenomena). An experiment synopsis is provided for each test. Along with a test description

A concise, content valid, gender invariant measure of workplace incivility.

Science.gov (United States)

Matthews, Russell A; Ritter, Kelsey-Jo

2016-07-01

The authors present a short, valid, gender invariant measure of workplace incivility that should have a high degree of utility in a variety of research designs, especially those concerned with reducing participant burden such as experience sampling and multiwave longitudinal designs. Given ongoing concerns about the psychometric properties of workplace mistreatment constructs, they validated a 4-item measure of experienced incivility based on series of 3 independent field studies (N = 2,636). In addition to retaining items on the basis of employee rated conceptual alignment (i.e., judgmental criteria) with a standard incivility definition (i.e., ambiguous intent to harm), items were also chosen based on external criteria in terms of their ability to explain incremental variance in outcomes of interest (e.g., role overload, interpersonal deviance). Items with large systematic relationships with other mistreatment constructs (i.e., abusive supervision, supervisor undermining) were excluded. In turn, the authors demonstrated that the 4-item measure is gender invariant, a critical issue that has received limited attention in the literature to date. They also experimentally investigated the effect of recall window (2 weeks, 1 month, 1 year) and found a differential pattern of effect sizes for various outcomes of interest. A fourth independent field study was conducted as a practical application of the measure within a longitudinal framework. An autoregressive model examining experienced incivility and counterproductive work behaviors was tested. Data was collected from a sample of 278 respondents at 3 time points with 1 month between assessments. Implications of these findings are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Issues in developing valid assessments of speech pathology students' performance in the workplace.

Science.gov (United States)

McAllister, Sue; Lincoln, Michelle; Ferguson, Alison; McAllister, Lindy

2010-01-01

Workplace-based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be 'the gold standard', but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace-based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. This paper reviews important conceptual issues in the design of valid and reliable workplace-based assessments of competence including assessment content, process, impact on learning, measurement issues, and validation strategies. It then goes on to share what has been learned about quality assessment and validation of a workplace-based performance assessment using competency-based ratings. The outcomes of a four-year national development and validation of an assessment tool are described. A literature review of issues in conceptualizing, designing, and validating workplace-based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling, and data analysis in the validation stages of the development process. This paper provides an accessible overview of factors to consider in the design and validation of workplace-based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS, used in an every speech pathology programme in Australia, New Zealand, and Singapore. The paper also describes Rasch analysis, a model-based statistical approach which is useful for establishing validity and reliability of assessment tools. Through careful attention to conceptual and design issues in the development and trialling of workplace-based assessments, it has been possible to develop the

Factors affecting unsafe behavior in construction projects: development and validation of a new questionnaire.

Science.gov (United States)

Asilian-Mahabadi, Hassan; Khosravi, Yahya; Hassanzadeh-Rangi, Narmin; Hajizadeh, Ebrahim; Behzadan, Amir H

2018-02-05

Occupational safety in general, and construction safety in particular, is a complex phenomenon. This study was designed to develop a new valid measure to evaluate factors affecting unsafe behavior in the construction industry. A new questionnaire was generated from qualitative research according to the principles of grounded theory. Key measurement properties (face validity, content validity, construct validity, reliability and discriminative validity) were examined using qualitative and quantitative approaches. The receiver operating characteristic curve was used to estimate the discriminating power and the optimal cutoff score. Construct validity revealed an interpretable 12-factor structure which explained 61.87% of variance. Good internal consistency (Cronbach's α = 0.94) and stability (intra-class correlation coefficient = 0.93) were found for the new instrument. The area under the curve, sensitivity and specificity were 0.80, 0.80 and 0.75, respectively. The new instrument also discriminated safety performance among the construction sites with different workers' accident histories (F = 6.40, p construction industry.

[Reliability and validity of Driving Anger Scale in professional drivers in China].

Science.gov (United States)

Li, Z; Yang, Y M; Zhang, C; Li, Y; Hu, J; Gao, L W; Zhou, Y X; Zhang, X J

2017-11-10

Objective: To assess the reliability and validity of the Chinese version of Driving Anger Scale (DAS) in professional drivers in China and provide a scientific basis for the application of the scale in drivers in China. Methods: Professional drivers, including taxi drivers, bus drivers, truck drivers and school bus drivers, were selected to complete the questionnaire. Cronbach's α and split-half reliability were calculated to evaluate the reliability of DAS, and content, contract, discriminant and convergent validity were performed to measure the validity of the scale. Results: The overall Cronbach's α of DAS was 0.934 and the split-half reliability was 0.874. The correlation coefficient of each subscale with the total scale was 0.639-0.922. The simplified version of DAS supported a presupposed six-factor structure, explaining 56.371% of the total variance revealed by exploratory factor analysis. The DAS had good convergent and discriminant validity, with the success rate of calibration experiment of 100%. Conclusion: DAS has a good reliability and validity in professional drivers in China, and the use of DAS is worth promoting in divers.

The validity of the 4-Skills Scan: A double validation study.

Science.gov (United States)

van Kernebeek, W G; de Kroon, M L A; Savelsbergh, G J P; Toussaint, H M

2018-06-01

Adequate gross motor skills are an essential aspect of a child's healthy development. Where physical education (PE) is part of the primary school curriculum, a strong curriculum-based emphasis on evaluation and support of motor skill development in PE is apparent. Monitoring motor development is then a task for the PE teacher. In order to fulfil this task, teachers need adequate tools. The 4-Skills Scan is a quick and easily manageable gross motor skill instrument; however, its validity has never been assessed. Therefore, the purpose of this study is to assess the construct and concurrent validity of both 4-Skills Scans (version 2007 and version 2015). A total of 212 primary school children (6 - 12 years old), was requested to participate in both versions of the 4-Skills Scan. For assessing construct validity, children covered an obstacle course with video recordings for observation by an expert panel. For concurrent validity, a comparison was made with the MABC-2, by calculating Pearson correlations. Multivariable linear regression analyses were performed to determine the contribution of each subscale to the construct of gross motor skills, according to the MABC-2 and the expert panel. Correlations between the 4-Skills Scans and expert valuations were moderate, with coefficients of .47 (version 2007) and .46 (version 2015). Correlations between the 4-Skills Scans and the MABC-2 (gross) were moderate (.56) for version 2007 and high (.64) for version 2015. It is concluded that both versions of the 4-Skills Scans are satisfactory valid instruments for assessing gross motor skills during PE lessons. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Validity of worksheet-based guided inquiry and mind mapping for training students’ creative thinking skills

Science.gov (United States)

Susanti, L. B.; Poedjiastoeti, S.; Taufikurohmah, T.

2018-04-01

The purpose of this study is to explain the validity of guided inquiry and mind mapping-based worksheet that has been developed in this study. The worksheet implemented the phases of guided inquiry teaching models in order to train students’ creative thinking skills. The creative thinking skills which were trained in this study included fluency, flexibility, originality and elaboration. The types of validity used in this study included content and construct validity. The type of this study is development research with Research and Development (R & D) method. The data of this study were collected using review and validation sheets. Sources of the data were chemistry lecturer and teacher. The data is the analyzed descriptively. The results showed that the worksheet is very valid and could be used as a learning media with the percentage of validity ranged from 82.5%-92.5%.

FORENSIC-CLINICAL INTERVIEW: RELIABILITY AND VALIDITY FOR THE EVALUATION OF PSYCHOLOGICAL INJURY

Directory of Open Access Journals (Sweden)

Francisca Fariña

2013-01-01

Full Text Available Forensic evaluation of psychological injury involves the use of a multimethod approximation i.e., a psychometric instrument, normally the MMPI-2, and a clinical interview. In terms of the clinical interview, the traditional clinical interview (e.g., SCID is not valid for forensic settings as it does not fulfil the triple objective of forensic evaluation: diagnosis of psychological injury in terms of Post Traumatic Stress Disorder (PTSD, a differential diagnosis of feigning, and establishing a causal relationship between allegations of intimate partner violence (IPV and psychological injury. To meet this requirement, Arce and Fariña (2001 created the forensic-clinical interview based on two techniques that do not contaminate the contents i.e., reinstating the contexts and free recall, and a methodic categorical system of contents analysis for the diagnosis of psychological injury and a differential diagnosis of feigning. The reliability and validity of the forensic-clinical interview designed for the forensic evaluation of psychological injury was assessed in 51 genuine cases of (IPV and 54 mock victims of IPV who were evaluated using a forensic-clinical interview and the MMPI-2. The result revealed that the forensic-clinical interview was a reliable instrument (α = .85 for diagnostic criteria of psychological injury, and α = .744 for feigning strategies. Moreover, the results corroborated the predictive validity (the diagnosis of PTSD was similar to the expected rate; the convergence validity (the diagnosis of PTSD in the interview strongly correlated with the Pk Scale of the MMPI-2, and discriminant validity (the diagnosis of PTSD in the interview did not correlate with the Pk Scale in feigners. The feigning strategies (differential diagnosis also showed convergent validity (high correlation with the Scales and indices of the MMPI2 for the measure of feigning and discriminant validity (no genuine victim was classified as a feigner

Effort, symptom validity testing, performance validity testing and traumatic brain injury.

Science.gov (United States)

Bigler, Erin D

2014-01-01

To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount. This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed. Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.

Estimating uncertainty of inference for validation

Energy Technology Data Exchange (ETDEWEB)

Booker, Jane M [Los Alamos National Laboratory; Langenbrunner, James R [Los Alamos National Laboratory; Hemez, Francois M [Los Alamos National Laboratory; Ross, Timothy J [UNM

2010-09-30

We present a validation process based upon the concept that validation is an inference-making activity. This has always been true, but the association has not been as important before as it is now. Previously, theory had been confirmed by more data, and predictions were possible based on data. The process today is to infer from theory to code and from code to prediction, making the role of prediction somewhat automatic, and a machine function. Validation is defined as determining the degree to which a model and code is an accurate representation of experimental test data. Imbedded in validation is the intention to use the computer code to predict. To predict is to accept the conclusion that an observable final state will manifest; therefore, prediction is an inference whose goodness relies on the validity of the code. Quantifying the uncertainty of a prediction amounts to quantifying the uncertainty of validation, and this involves the characterization of uncertainties inherent in theory/models/codes and the corresponding data. An introduction to inference making and its associated uncertainty is provided as a foundation for the validation problem. A mathematical construction for estimating the uncertainty in the validation inference is then presented, including a possibility distribution constructed to represent the inference uncertainty for validation under uncertainty. The estimation of inference uncertainty for validation is illustrated using data and calculations from Inertial Confinement Fusion (ICF). The ICF measurements of neutron yield and ion temperature were obtained for direct-drive inertial fusion capsules at the Omega laser facility. The glass capsules, containing the fusion gas, were systematically selected with the intent of establishing a reproducible baseline of high-yield 10{sup 13}-10{sup 14} neutron output. The deuterium-tritium ratio in these experiments was varied to study its influence upon yield. This paper on validation inference is the

Designing and Assessing the Validity and Reliability of the Hospital Readiness Assessment Tools to Conducting Quality Improvement Program

Directory of Open Access Journals (Sweden)

Kamal Gholipoor

2016-09-01

Full Text Available Background and objectives : Identifying the readiness of hospital and its strengths and weaknesses can be useful in developing appropriate planning and situation analyses and management to getting effective in clinical audit programs. The aim of this study was to design and assess the validity of the Hospital Readiness Assessment Tools to conduct quality improvement and clinical audit programs. Material and Methods: In this study, based on the results of a systematic review of literature, an initial questionnaire with 77 items was designed. Questionnaire content validity was reviewed by experts in the field of hospital management and quality improvement in Tabriz University of Medical Sciences. For this purpose, 20 questionnaires were sent to experts. Finally, 15 participants returned completed questionnaire. Questionnaire validity was reviewed and confirmed based on Content Validity Index and Content Validity Ratio. Questionnaire reliability was confirmed based on Cronbach's alpha index (α = 0.96 in a pilot study by participation of 30 hospital managers. Results: The results showed that the final questionnaire contains 54 questions as nine category as: data and information (9 items, teamwork (12 questions, resources (5 questions, patient and education (5, intervention design and implementation (5 questions, clinical audit management (4 questions, human resources (6 questions, evidence and standard (4 items and evaluation and feedback (4 items. The final questionnaire content validity index was 0.91 and final questionnaire Cronbach's alpha coefficient was 0.96. Conclusion: Considering the relative good validity and reliability of the designed tool in this study, it appears that the questionnaire can be used to identify and assess the readiness of hospitals for quality improvement and clinical audit program implementation

Environmental education curriculum evaluation questionnaire: A reliability and validity study

Science.gov (United States)

Minner, Daphne Diane

The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating

Expert validation of a teamwork assessment rubric: A modified Delphi study.

Science.gov (United States)

Parratt, Jenny A; Fahy, Kathleen M; Hutchinson, Marie; Lohmann, Gui; Hastie, Carolyn R; Chaseling, Marilyn; O'Brien, Kylie

2016-01-01

Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical. To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'? Modified Delphi technique incorporating Feminist Collaborative Conversations. A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork. Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric. Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains. The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with

Validity and Reliability of Malay Version of the Job Content Questionnaire among Public Hospital Female Nurses in Malaysia

Directory of Open Access Journals (Sweden)

NA Amin

2015-10-01

Full Text Available Background: The Job Content Questionnaire (M-JCQ is an established self-reported instrument used across the world to measure the work dimensions based on the Karasek's demand-control-support model. Objective: To evaluate the psychometrics properties of the Malay version of M-JCQ among nurses in Malaysia. Methods: This cross-sectional study was carried out on nurses working in 4 public hospitals in Klang Valley area, Malaysia. M-JCQ was used to assess the perceived psychosocial stressors and physical demands of nurses at their workplaces. Construct validity of the questionnaire was examined using exploratory factor analysis (EFA. Cronbach's α values were used to estimate the reliability (internal consistency of the M-JCQ. Results: EFA showed that 34 selected items were loaded in 4 factors. Except for psychological job demand (Cronbach's α 0.51, the remaining 3 α values for 3 subscales (job control, social support, and physical demand were greater than 0.70, indicating acceptable internal consistency. However, an item was excluded due to poor item-total correlation (r<0.3. The final M-JCQ was consisted of 33 items. Conclusion: The M-JCQ is a reliable and valid instrument to measure psychosocial and physical stressors in the workplace of public hospital nurses in Malaysia.

Validation of a short food frequency questionnaire in Australian adults.

Science.gov (United States)

Khalesi, Saman; Doshi, Deepak; Buys, Nicholas; Sun, Jing

2017-05-01

The aim of this article is to report on the validity and internal consistency of a short food frequency questionnaire (FFQ) to measure dietary intake in Australian adults. A total of 407 individuals completed the short FFQ. The Cronbach's alpha of 0.66 indicated acceptable internal consistency for the FFQ. Content validity was measured using factor analysis showed that 35% of total variance was explained by factor analysis. The FFQ was also validated against 31 3-day food records (FR). No significant difference between average intake of energy, most macronutrients, and some micronutrients between two instruments was identified. An acceptable levels of correlation (0.39-0.69) was observed between the two instruments. Bland and Altman's plots showed relative agreement in both instruments with potential bias in measuring iron and iodine. The current FFQ can be an acceptable tool to quickly measuring dietary intake in Australian adults.

Translation, validity, and reliability of a persian version of the iowa tinnitus handicap questionnaire.

Science.gov (United States)

Arian Nahad, Homa; Rouzbahani, Masomeh; Jarollahi, Farnoush; Jalaie, Shohreh; Pourbakht, Akram; Mokrian, Helnaz; Mahdi, Parvane; Amali, Amin; Nodin Zadeh, Abdolmajid

2014-04-01

Tinnitus is a common otologic symptom that can seriously affect a patient's quality of life. The purpose of the present study was to translate and validate the Iowa Tinnitus Handicap Questionnaire (THQ) into the Persian language, and to make it applicable as a tool for determining the effects of tinnitus on a patient's life. The main version of the THQ was translated into the Persian language. The agreed Persian version was administered to 150 tinnitus patients. The validity of the Persian THQ was evaluated and internal reliability was confirmed using Cronbach's α-coefficient. Finally, the effect of independent variables such as age, mean patient threshold, gender, and duration of tinnitus were considered in order to determine the psychometric properties of tinnitus. After an exact translation process, the Persian THQ was found to exhibit face validity. In terms of content validity, content validity index in total questionnaire was 0.93. Further, in structural validity measurements, intermediate correlation with annoyance from tinnitus (r=0.49), low correlation with duration of tinnitus (r=0.34) and high correlation with the Tinnitus Handicap Inventory (THI) questionnaire (r=0.84) were demonstrated. Additionally, a negligible effect of gender and age was noted on degree of tinnitus handicap (P= 0.754, P= 0.573, respectively). In the internal reliability assessment for Factors 1, 2, 3, and the whole questionnaire, Cronbach`s α-coefficient was 0.95, 0.92, 0.25 and 0.88, respectively. The Persian version of the Iowa THQ demonstrates high validity and reliability and can be used for the determination of tinnitus handicap and for following-up in the intervention process in Persian tinnitus patients.

Development and validation of the Characteristics of Resilience in Sports Teams Inventory.

OpenAIRE

Decroos, Steven; Lines, Robin L. J.; Morgan, Paul B. C.; Fletcher, David; Sarkar, Mustafa; Fransen, Katrien; Boen, Filip; Vande Broek, Gert

2017-01-01

This multistudy paper reports the development and initial validation of an inventory for the Characteristics of Resilience in Sports Teams (CREST). In 4 related studies, 1,225 athletes from Belgium and the United Kingdom were sampled. The first study provided content validity for an initial item set. The second study explored the factor structure of the CREST, yielding initial evidence but no conclusive results. In contrast, the third and fourth study provided evidence for a 2-factor measure,...

Construction of a valid and reliable test to determine knowledge on ...

African Journals Online (AJOL)

knowledge-dietary behaviour relationship require use of valid and reliable knowledge .... Which of the following beverages has the lowest energy content per cup (250 ml)?b .... Diploma (ND): Consumer Science: Food and Nutrition together.

[Design and validation of a questionnaire for psychosocial nursing diagnosis in Primary Care].

Science.gov (United States)

Brito-Brito, Pedro Ruymán; Rodríguez-Álvarez, Cristobalina; Sierra-López, Antonio; Rodríguez-Gómez, José Ángel; Aguirre-Jaime, Armando

2012-01-01

To develop a valid, reliable and easy-to-use questionnaire for a psychosocial nursing diagnosis. The study was performed in two phases: first phase, questionnaire design and construction; second phase, validity and reliability tests. A bank of items was constructed using the NANDA classification as a theoretical framework. Each item was assigned a Likert scale or dichotomous response. The combination of responses to the items constituted the diagnostic rules to assign up to 28 labels. A group of experts carried out the validity test for content. Other validated scales were used as reference standards for the criterion validity tests. Forty-five nurses provided the questionnaire to the patients on three separate occasions over a period of three weeks, and the other validated scales only once to 188 randomly selected patients in Primary Care centres in Tenerife (Spain). Validity tests for construct confirmed the six dimensions of the questionnaire with 91% of total variance explained. Validity tests for criterion showed a specificity of 66%-100%, and showed high correlations with the reference scales when the questionnaire was assigning nursing diagnoses. Reliability tests showed agreement of 56%-91% (PQuestionnaire for Psychosocial Nursing Diagnosis was called CdePS, and included 61 items. The CdePS is a valid, reliable and easy-to-use tool in Primary Care centres to improve the assigning of a psychosocial nursing diagnosis. Copyright © 2011 Elsevier España, S.L. All rights reserved.

Process validation for radiation processing

International Nuclear Information System (INIS)

Miller, A.

1999-01-01

Process validation concerns the establishment of the irradiation conditions that will lead to the desired changes of the irradiated product. Process validation therefore establishes the link between absorbed dose and the characteristics of the product, such as degree of crosslinking in a polyethylene tube, prolongation of shelf life of a food product, or degree of sterility of the medical device. Detailed international standards are written for the documentation of radiation sterilization, such as EN 552 and ISO 11137, and the steps of process validation that are described in these standards are discussed in this paper. They include material testing for the documentation of the correct functioning of the product, microbiological testing for selection of the minimum required dose and dose mapping for documentation of attainment of the required dose in all parts of the product. The process validation must be maintained by reviews and repeated measurements as necessary. This paper presents recommendations and guidance for the execution of these components of process validation. (author)

Establishing best practices for the validation of atmospheric composition measurements from satellites

Science.gov (United States)

Lambert, Jean-Christopher

As a contribution to the implementation of the Global Earth Observation System of Systems (GEOSS), the Committee on Earth Observation Satellites (CEOS) is developing a data quality strategy for satellite measurements. To achieve GEOSS requirements of consistency and interoperability (e.g. for comparison and for integrated interpretation) of the measurements and their derived data products, proper uncertainty assessment is essential and needs to be continuously monitored and traceable to standards. Therefore, CEOS has undertaken the task to establish a set of best practices and guidelines for satellite validation, starting with current practices that could be improved with time. Best practices are not intended to be imposed as firm requirements, but rather to be suggested as a baseline for comparing against, which could be used by the widest community and provide guidance to newcomers. The present paper reviews the current development of best practices and guidelines for the validation of atmospheric composition satellites. Terminologies and general principles of validation are reminded. Going beyond elementary definitions of validation like the assessment of uncertainties, the specific GEOSS context calls also for validation of individual service components and against user requirements. This paper insists on two important aspects. First one, the question of the "collocation". Validation generally involves comparisons with "reference" measurements of the same quantities, and the question of what constitutes a valid comparison is not the least of the challenges faced. We present a tentative scheme for defining the validity of a comparison and of the necessary "collocation" criteria. Second focus of this paper: the information content of the data product. Validation against user requirements, or the verification of the "fitness for purpose" of both the data products and their validation, needs to identify what information, in the final product, is contributed really

Validity and reliability of skill-related fitness tests for wheelchair-using youth with Spina Bifida.

NARCIS (Netherlands)

Bloemen, M.A.; Takken, T.; Backx, F.J.; Vos, M.; Kruitwagen, C.L.; Groot, J.F. de

2017-01-01

Objectives: To determine content validity of the Muscle Power Sprint Test (MPST), and construct validity and reliability of the MPST, 10x5 Meter Sprint Test (10x5MST), slalom test, and One Stroke Push Test (1SPT) in wheelchair-using youth with spina bifida (SB). Design: Clinimetric study. Setting:

Validity and Reliability of Skill-Related Fitness Tests for Wheelchair-Using Youth With Spina Bifida

NARCIS (Netherlands)

Bloemen, Manon A.; Takken, Tim; Backx, Frank J.; Vos, Marleen; Kruitwagen, Cas L.; de Groot, Janke F.

OBJECTIVE: To determine content validity of the Muscle Power Sprint Test (MPST) and construct validity and reliability of the MPST, 10x5 Meter Sprint Test (10x5MST), slalom test and one stroke push test (1SPT) in wheelchair-using youth with spina bifida (SB). DESIGN: Clinimetric study SETTING:

Validity and Reliability of Skill-Related Fitness Tests for Wheelchair-Using Youth with Spina Bifida

NARCIS (Netherlands)

Cas L.J.J. Kruitwagen; Frank J.G. Backx; Tim Takken; Janke de Groot; Marleen Vos; Manon A.T. Bloemen

2016-01-01

Objective: To determine content validity of the Muscle Power Sprint Test (MPST) and construct validity and reliability of the MPST, 10x5 Meter Sprint Test (10x5MST), slalom test and one stroke push test (1SPT) in wheelchair-using youth with spina bifida (SB). Design: Clinimetric study Setting:

41 CFR 60-3.14 - Technical standards for validity studies.

Science.gov (United States)

2010-07-01

..., such as intelligence, aptitude, personality, commonsense, judgment, leadership, and spatial ability.... (6) Prior training or experience. A requirement for or evaluation of specific prior training or experience based on content validity, including a specification of level or amount of training or experience...

Validation of a proposal for evaluating hospital infection control programs.

Science.gov (United States)

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs

Development and Validation of Attitude toward Gestational Surrogacy Scale in Iranian Infertile Couples.

Science.gov (United States)

Rahimi Kian, Fatemeh; Zandi, Afsaneh; Omani Samani, Reza; Maroufizadeh, Saman; Mehran, Abbas

2016-01-01

Surrogacy is one of the most challenging infertility treatments engaging ethical, psychological and social issues. Attitudes survey plays an important role to disclosure variant aspects of surrogacy, to help meeting legislative gaps and ambiguities, and to convert controversial dimensions surrounding surrogacy to a normative concept that eliminates stigma. The aim of this study is to develop a comprehensive scale for gestational surrogacy attitudes. Development process of gestational surrogacy attitudes scale (GSAS) performed based on a descriptive cross-sectional study and included a rich data pool gathered from literature reviews, a qualitative pilot study on 15 infertile couples (n=30), use of expert advisory panel (EAP) consisting of 20 members, as well as use of content validity through qualitative and quantitative study by the means of content validity ratio (CVR) and content validity index (CVI). Also internal consistence using Cronbach's alpha and test-retest reliability using intracalss correlation coefficient (ICC) were evaluated. Application of GSAS was tested in a cross-sectional study that was conducted on 200 infertile couples (n=400) at Royan Institute, Tehran, Iran, during 2014. Final version of GSAS had 30 items within five subscales including "acceptance of surrogacy", "Surrogacy and public attitudes", "Child born through surrogacy", "Surrogate mother", and "Intentional attitude and surrogacy future attempt". Content validity was represented with values of CVR=0.73 and CVI =0.98. Cronbach's alpha value was 0.91 for the overall scale, while ICC value due to test-retest responses was 0.89. Acceptable level of competency and capability of GSAS is significantly indicated; therefore, it seems to be an appropriate tool for the evaluation of gestational surrogacy attitudes in Iranian infertile couples.

Contextual Validity in Hybrid Logic

DEFF Research Database (Denmark)

Blackburn, Patrick Rowan; Jørgensen, Klaus Frovin

2013-01-01

interpretations. Moreover, such indexicals give rise to a special kind of validity—contextual validity—that interacts with ordinary logi- cal validity in interesting and often unexpected ways. In this paper we model these interactions by combining standard techniques from hybrid logic with insights from the work...... of Hans Kamp and David Kaplan. We introduce a simple proof rule, which we call the Kamp Rule, and first we show that it is all we need to take us from logical validities involving now to contextual validities involving now too. We then go on to show that this deductive bridge is strong enough to carry us...... to contextual validities involving yesterday, today and tomorrow as well....

The Vocal Cord Dysfunction Questionnaire: Validity and Reliability of the Persian Version.

Science.gov (United States)

Ghaemi, Hamide; Khoddami, Seyyedeh Maryam; Soleymani, Zahra; Zandieh, Fariborz; Jalaie, Shohreh; Ahanchian, Hamid; Khadivi, Ehsan

2017-12-25

The aim of this study was to develop, validate, and assess the reliability of the Persian version of Vocal Cord Dysfunction Questionnaire (VCDQ P ). The study design was cross-sectional or cultural survey. Forty-four patients with vocal fold dysfunction (VFD) and 40 healthy volunteers were recruited for the study. To assess the content validity, the prefinal questions were given to 15 experts to comment on its essential. Ten patients with VFD rated the importance of VCDQ P in detecting face validity. Eighteen of the patients with VFD completed the VCDQ 1 week later for test-retest reliability. To detect absolute reliability, standard error of measurement and smallest detected change were calculated. Concurrent validity was assessed by completing the Persian Chronic Obstructive Pulmonary Disease (COPD) Assessment Test (CAT) by 34 patients with VFD. Discriminant validity was measured from 34 participants. The VCDQ was further validated by administering the questionnaire to 40 healthy volunteers. Validation of the VCDQ as a treatment outcome tool was conducted in 18 patients with VFD using pre- and posttreatment scores. The internal consistency was confirmed (Cronbach α = 0.78). The test-retest reliability was excellent (intraclass correlation coefficient = 0.97). The standard error of measurement and smallest detected change values were acceptable (0.39 and 1.08, respectively). There was a significant correlation between the VCDQ P and the CAT total scores (P validity was significantly different. The VCDQ scores in patients with VFD before and after treatment was significantly different (P valid and reliable self-administered questionnaire in Persian-speaking population. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Validation Process Methods

Energy Technology Data Exchange (ETDEWEB)

Lewis, John E. [National Renewable Energy Lab. (NREL), Golden, CO (United States); English, Christine M. [National Renewable Energy Lab. (NREL), Golden, CO (United States); Gesick, Joshua C. [National Renewable Energy Lab. (NREL), Golden, CO (United States); Mukkamala, Saikrishna [National Renewable Energy Lab. (NREL), Golden, CO (United States)

2018-01-04

This report documents the validation process as applied to projects awarded through Funding Opportunity Announcements (FOAs) within the U.S. Department of Energy Bioenergy Technologies Office (DOE-BETO). It describes the procedures used to protect and verify project data, as well as the systematic framework used to evaluate and track performance metrics throughout the life of the project. This report also describes the procedures used to validate the proposed process design, cost data, analysis methodologies, and supporting documentation provided by the recipients.

Evaluation Of Plutonium Oxide Destructive Chemical Analyses For Validity Of Original 3013 Container Binning

International Nuclear Information System (INIS)

Mcclard, J.; Kessinger, G.

2010-01-01

The surveillance program for 3013 containers is based, in part, on the separation of containers into various bins related to potential container failure mechanisms. The containers are assigned to bins based on moisture content and pre-storage estimates of content chemistry. While moisture content is measured during the packaging of each container, chemistry estimates are made by using a combination of process knowledge, packaging data and prompt gamma analyses to establish the moisture and chloride/fluoride content of the materials. Packages with high moisture and chloride/fluoride contents receive more detailed surveillances than packages with less chloride/fluoride and/or moisture. Moisture verification measurements and chemical analyses performed during the surveillance program provided an opportunity to validate the binning process. Validation results demonstrated that the binning effort was generally successful in placing the containers in the appropriate bin for surveillance and analysis.

CFD validation experiments for hypersonic flows

Science.gov (United States)

Marvin, Joseph G.

1992-01-01

A roadmap for CFD code validation is introduced. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments could provide new validation data.

Human Factors methods concerning integrated validation of nuclear power plant control rooms; Metodutveckling foer integrerad validering

Energy Technology Data Exchange (ETDEWEB)

Oskarsson, Per-Anders; Johansson, Bjoern J.E.; Gonzalez, Natalia (Swedish Defence Research Agency, Information Systems, Linkoeping (Sweden))

2010-02-15

The frame of reference for this work was existing recommendations and instructions from the NPP area, experiences from the review of the Turbic Validation and experiences from system validations performed at the Swedish Armed Forces, e.g. concerning military control rooms and fighter pilots. These enterprises are characterized by complex systems in extreme environments, often with high risks, where human error can lead to serious consequences. A focus group has been performed with representatives responsible for Human Factors issues from all Swedish NPP:s. The questions that were discussed were, among other things, for whom an integrated validation (IV) is performed and its purpose, what should be included in an IV, the comparison with baseline measures, the design process, the role of SSM, which methods of measurement should be used, and how the methods are affected of changes in the control room. The report brings different questions to discussion concerning the validation process. Supplementary methods of measurement for integrated validation are discussed, e.g. dynamic, psychophysiological, and qualitative methods for identification of problems. Supplementary methods for statistical analysis are presented. The study points out a number of deficiencies in the validation process, e.g. the need of common guidelines for validation and design, criteria for different types of measurements, clarification of the role of SSM, and recommendations for the responsibility of external participants in the validation process. The authors propose 12 measures for taking care of the identified problems

MARS Validation Plan and Status

International Nuclear Information System (INIS)

Ahn, Seung-hoon; Cho, Yong-jin

2008-01-01

The KINS Reactor Thermal-hydraulic Analysis System (KINS-RETAS) under development is directed toward a realistic analysis approach of best-estimate (BE) codes and realistic assumptions. In this system, MARS is pivoted to provide the BE Thermal-Hydraulic (T-H) response in core and reactor coolant system to various operational transients and accidental conditions. As required for other BE codes, the qualification is essential to ensure reliable and reasonable accuracy for a targeted MARS application. Validation is a key element of the code qualification, and determines the capability of a computer code in predicting the major phenomena expected to occur. The MARS validation was made by its developer KAERI, on basic premise that its backbone code RELAP5/MOD3.2 is well qualified against analytical solutions, test or operational data. A screening was made to select the test data for MARS validation; some models transplanted from RELAP5, if already validated and found to be acceptable, were screened out from assessment. It seems to be reasonable, but does not demonstrate whether code adequacy complies with the software QA guidelines. Especially there may be much difficulty in validating the life-cycle products such as code updates or modifications. This paper presents the plan for MARS validation, and the current implementation status

Development and validation of an alternative titration method for the determination of sulfate ion in indinavir sulfate

Directory of Open Access Journals (Sweden)

Breno de Carvalho e Silva

2005-02-01

Full Text Available A simple and rapid precipitation titration method was developed and validated to determine sulfate ion content in indinavir sulfate raw material. 0.1 mol L-1 lead nitrate volumetric solution was used as titrant employing potentiometric endpoint determination using a lead-specific electrode. The United States Pharmacopoeia Forum indicates a potentiometric method for sulfate ion quantitation using 0.1 mol L-1 lead perchlorate as titrant. Both methods were validated concerning linearity, precision and accuracy, yielding good results. The sulfate ion content found by the two validated methods was compared by the statistical t-student test, indicating that there was no statistically significant difference between the methods.

Development, Validation, and Implementation of a Medical Judgment Metric

Directory of Open Access Journals (Sweden)

Rami A. Ahmed DO, MHPE

2017-06-01

Full Text Available Background: Medical decision making is a critical, yet understudied, aspect of medical education. Aims: To develop the Medical Judgment Metric (MJM, a numerical rubric to quantify good decisions in practice in simulated environments; and to obtain initial preliminary evidence of reliability and validity of the tool. Methods: The individual MJM items, domains, and sections of the MJM were built based on existing standardized frameworks. Content validity was determined by a convenient sample of eight experts. The MJM instrument was pilot tested in four medical simulations with a team of three medical raters assessing 40 participants with four levels of medical experience and skill. Results: Raters were highly consistent in their MJM scores in each scenario (intraclass correlation coefficient 0.965 to 0.987 as well as their evaluation of the expected patient outcome (Fleiss’s Kappa 0.791 to 0.906. For each simulation scenario, average rater cut-scores significantly predicted expected loss of life or stabilization (Cohen’s Kappa 0.851 to 0.880. Discussion : The MJM demonstrated preliminary evidence of reliability and validity.

Screening for postdeployment conditions: development and cross-validation of an embedded validity scale in the neurobehavioral symptom inventory.

Science.gov (United States)

Vanderploeg, Rodney D; Cooper, Douglas B; Belanger, Heather G; Donnell, Alison J; Kennedy, Jan E; Hopewell, Clifford A; Scott, Steven G

2014-01-01

To develop and cross-validate internal validity scales for the Neurobehavioral Symptom Inventory (NSI). Four existing data sets were used: (1) outpatient clinical traumatic brain injury (TBI)/neurorehabilitation database from a military site (n = 403), (2) National Department of Veterans Affairs TBI evaluation database (n = 48 175), (3) Florida National Guard nonclinical TBI survey database (n = 3098), and (4) a cross-validation outpatient clinical TBI/neurorehabilitation database combined across 2 military medical centers (n = 206). Secondary analysis of existing cohort data to develop (study 1) and cross-validate (study 2) internal validity scales for the NSI. The NSI, Mild Brain Injury Atypical Symptoms, and Personality Assessment Inventory scores. Study 1: Three NSI validity scales were developed, composed of 5 unusual items (Negative Impression Management [NIM5]), 6 low-frequency items (LOW6), and the combination of 10 nonoverlapping items (Validity-10). Cut scores maximizing sensitivity and specificity on these measures were determined, using a Mild Brain Injury Atypical Symptoms score of 8 or more as the criterion for invalidity. Study 2: The same validity scale cut scores again resulted in the highest classification accuracy and optimal balance between sensitivity and specificity in the cross-validation sample, using a Personality Assessment Inventory Negative Impression Management scale with a T score of 75 or higher as the criterion for invalidity. The NSI is widely used in the Department of Defense and Veterans Affairs as a symptom-severity assessment following TBI, but is subject to symptom overreporting or exaggeration. This study developed embedded NSI validity scales to facilitate the detection of invalid response styles. The NSI Validity-10 scale appears to hold considerable promise for validity assessment when the NSI is used as a population-screening tool.

Affordances in the home environment for motor development: Validity and reliability for the use in daycare setting.

Science.gov (United States)

Müller, Alessandra Bombarda; Valentini, Nadia Cristina; Bandeira, Paulo Felipe Ribeiro

2017-05-01

The range of stimuli provided by physical space, toys and care practices contributes to the motor, cognitive and social development of children. However, assessing the quality of child education environments is a challenge, and can be considered a health promotion initiative. This study investigated the validity of the criterion, content, construct and reliability of the Affordances in the Home Environment for Motor Development - Infant Scale (AHEMD-IS), version 3-18 months, for the use in daycare settings. Content validation was conducted with the participation of seven motor development and health care experts; and, face validity by 20 specialists in health and education. The results indicate the suitability of the adapted AHEMD-IS, evidencing its validity for the daycare setting a potential tool to assess the opportunities that the collective context offers to child development. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodology for Validating Building Energy Analysis Simulations

Energy Technology Data Exchange (ETDEWEB)

Judkoff, R.; Wortman, D.; O' Doherty, B.; Burch, J.

2008-04-01

The objective of this report was to develop a validation methodology for building energy analysis simulations, collect high-quality, unambiguous empirical data for validation, and apply the validation methodology to the DOE-2.1, BLAST-2MRT, BLAST-3.0, DEROB-3, DEROB-4, and SUNCAT 2.4 computer programs. This report covers background information, literature survey, validation methodology, comparative studies, analytical verification, empirical validation, comparative evaluation of codes, and conclusions.

Monitoring Landscape Scale Soil Water Content with Cosmic-Ray Neutron Sensors: Validation and Calibration

International Nuclear Information System (INIS)

Wahbi, Ammar; Avery, William A.; Dercon, Gerd; Heng, Lee; Weltin, Georg; Franz, Trenton E.; Strauss, Peter; Oismueller, Markus; Desilets, Darin

2017-01-01

Increasing populations growth combined with climate change are putting pressure on water resources and agricultural systems around the world. The need for effective water management strategies designed to maximize water use efficiency has made access to soil water content (SWC) information crucial to the global community. This work builds upon ongoing research that began in December 2013 in which a stationary Cosmic-Ray Neutron Sensor (CRNS) was used to monitor SWC within an agricultural system located in north central Austria. Past work at this study site at Petzenkirchen, Austria (100 km west of Vienna) has focused on the calibration and validation of the CRNS technology, and has shown the CRNS to reliably estimate SWC on a large scale (circle with radius of cca. 250 m) when compared to other methods of estimating SWC. This was determined via comparisons of insitu soil sampling, time domain reflectometry (TDR), and time domain transmissivity (TDT) of SWC with estimates of SWC determined from the CRNS. However, questions remain regarding the effective use of the CRNS technology.

Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research.

Science.gov (United States)

Gleason, Philip M; Harris, Jeffrey; Sheean, Patricia M; Boushey, Carol J; Bruemmer, Barbara

2010-03-01

This is the sixth in a series of monographs on research design and analysis. The purpose of this article is to describe and discuss several concepts related to the measurement of nutrition-related characteristics and outcomes, including validity, reliability, and diagnostic tests. The article reviews the methodologic issues related to capturing the various aspects of a given nutrition measure's reliability, including test-retest, inter-item, and interobserver or inter-rater reliability. Similarly, it covers content validity, indicators of absolute vs relative validity, and internal vs external validity. With respect to diagnostic assessment, the article summarizes the concepts of sensitivity and specificity. The hope is that dietetics practitioners will be able to both use high-quality measures of nutrition concepts in their research and recognize these measures in research completed by others. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

Science.gov (United States)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2017-04-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Development and Validation of Measures of Secondary Science Teachers' PCK for Teaching Photosynthesis

Science.gov (United States)

Park, Soonhye; Suh, Jeekyung; Seo, Kyungwoon

2018-06-01

This paper describes procedures by which two types of measures of Pedagogical Content Knowledge (PCK) were developed and validated: (a) PCK Survey and (b) PCK Rubric. Given the topic-specificity of PCK, the measures centered on photosynthesis as taught in high school classrooms. The measures were conceptually grounded in the pentagon model of PCK and designed to measure indispensable PCK that can be applied to any teacher, in any teaching context, for the given topic. Because of the exploratory nature of the study, the measures focus on two key components of PCK: (a) knowledge of students' understanding in science and (b) knowledge of instructional strategies and representations. Both measures have established acceptable levels of reliability as determined by internal consistency and inter-rater agreement. Evidence related to content validity was gathered through expert consultations, while evidence related to construct validity was collected through analysis of think-aloud interviews and factor analyses. Issues and challenges emerging from the course of the measure development, administration, and validation are discussed with strategies for confronting them. Directions for future research are proposed in three areas: (a) relationships between PCK and teaching experiences, (b) differences in PCK between science teachers and scientists, and (c) relationships between PCK and student learning.

Recognizing emotional speech in Persian: a validated database of Persian emotional speech (Persian ESD).

Science.gov (United States)

Keshtiari, Niloofar; Kuhlmann, Michael; Eslami, Moharram; Klann-Delius, Gisela

2015-03-01

Research on emotional speech often requires valid stimuli for assessing perceived emotion through prosody and lexical content. To date, no comprehensive emotional speech database for Persian is officially available. The present article reports the process of designing, compiling, and evaluating a comprehensive emotional speech database for colloquial Persian. The database contains a set of 90 validated novel Persian sentences classified in five basic emotional categories (anger, disgust, fear, happiness, and sadness), as well as a neutral category. These sentences were validated in two experiments by a group of 1,126 native Persian speakers. The sentences were articulated by two native Persian speakers (one male, one female) in three conditions: (1) congruent (emotional lexical content articulated in a congruent emotional voice), (2) incongruent (neutral sentences articulated in an emotional voice), and (3) baseline (all emotional and neutral sentences articulated in neutral voice). The speech materials comprise about 470 sentences. The validity of the database was evaluated by a group of 34 native speakers in a perception test. Utterances recognized better than five times chance performance (71.4 %) were regarded as valid portrayals of the target emotions. Acoustic analysis of the valid emotional utterances revealed differences in pitch, intensity, and duration, attributes that may help listeners to correctly classify the intended emotion. The database is designed to be used as a reliable material source (for both text and speech) in future cross-cultural or cross-linguistic studies of emotional speech, and it is available for academic research purposes free of charge. To access the database, please contact the first author.

A questionnaire for assessing breastfeeding intentions and practices in Nigeria: validity, reliability and translation.

Science.gov (United States)

Emmanuel, Andy; Clow, Sheila E

2017-06-07

Validating a questionnaire/instrument (whether developed or adapted) before proceeding to the field for data collection is important. This article presents the modification of an Irish questionnaire for a Nigerian setting. The validation process and reliability testing of this questionnaire (which was used in assessing previous breastfeeding practices and breastfeeding intentions of pregnant women in English and Hausa languages) were also presented. Five experts in the field of breastfeeding and infant feeding voluntarily and independently evaluated the instrument. The experts evaluated the various items of the questionnaire based on relevance, clarity, simplicity and ambiguity on a Likert scale of 4. The analysis was performed to determine the content validity index (CVI).Two language experts performed the translation and back-translation. Ten pregnant women completed questionnaires which were evaluated for internal consistency. Two other pregnant women completed the questionnaire twice at an interval of two weeks to test the reliability. SPSS version 21 was used to calculate the coefficient of reliability. The content validity index was high (0.94 for relevance, clarity and ambiguity and 0.96 for simplicity). The analysis suggested that four of the seventy one items should be removed. Cronbach's Alpha was 0.81, while the reliability coefficient was 0.76. The emerged validated questionnaire was translated from English to Hausa, then, back-translated into English and compared for accuracy. The final instrument is reliable and valid for data collection on breastfeeding in Nigeria among English and Hausa speakers. Therefore, the instrument is recommended for use in assessing breastfeeding intention and practices in Nigeria.

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

Science.gov (United States)

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Verification, validation, and reliability of predictions

International Nuclear Information System (INIS)

Pigford, T.H.; Chambre, P.L.

1987-04-01

The objective of predicting long-term performance should be to make reliable determinations of whether the prediction falls within the criteria for acceptable performance. Establishing reliable predictions of long-term performance of a waste repository requires emphasis on valid theories to predict performance. The validation process must establish the validity of the theory, the parameters used in applying the theory, the arithmetic of calculations, and the interpretation of results; but validation of such performance predictions is not possible unless there are clear criteria for acceptable performance. Validation programs should emphasize identification of the substantive issues of prediction that need to be resolved. Examples relevant to waste package performance are predicting the life of waste containers and the time distribution of container failures, establishing the criteria for defining container failure, validating theories for time-dependent waste dissolution that depend on details of the repository environment, and determining the extent of congruent dissolution of radionuclides in the UO 2 matrix of spent fuel. Prediction and validation should go hand in hand and should be done and reviewed frequently, as essential tools for the programs to design and develop repositories. 29 refs

Translation and validation of the Nurses Self-Concept Instrument for college-level nursing students in Taiwan.

Science.gov (United States)

Chang, Yi-Chuan; Yeh, Mei-Ling

2016-01-01

Nurturing a professional nursing self-concept is crucial in nursing education. To determine whether it has been achieved, a reliable and valid measurement tool is necessary. This study therefore aimed to translate the Nurses Self-Concept Instrument (NSCI), and then ascertain the content and construct validity, and test-retest and internal consistency reliability in the Chinese version of the NSCI (NSCI-C). A methodological design was conducted with 1239 nursing students of a university recruited as the sample frame and 540 randomly selected. The results showed the content validity index of 0.81 overall, alpha of 0.92 overall, and correlation coefficient of 0.87. The mean score of the NSCI-C was significantly higher in freshman than in senior (p<.01). The hypothesized four-factor model did not fit the data well. After restructuring, two factors were explored, with 69.04% explained variance. The findings suggest that the NSCI-C is reliable and valid in nursing students. Copyright © 2015 Elsevier Ltd. All rights reserved.

Validation of a Full-Immersion Simulation Platform for Percutaneous Nephrolithotomy Using Three-Dimensional Printing Technology.

Science.gov (United States)

Ghazi, Ahmed; Campbell, Timothy; Melnyk, Rachel; Feng, Changyong; Andrusco, Alex; Stone, Jonathan; Erturk, Erdal

2017-12-01

The restriction of resident hours with an increasing focus on patient safety and a reduced caseload has impacted surgical training. A complex and complication prone procedure such as percutaneous nephrolithotomy (PCNL) with a steep learning curve may create an unsafe environment for hands-on resident training. In this study, we validate a high fidelity, inanimate PCNL model within a full-immersion simulation environment. Anatomically correct models of the human pelvicaliceal system, kidney, and relevant adjacent structures were created using polyvinyl alcohol hydrogels and three-dimensional-printed injection molds. All steps of a PCNL were simulated including percutaneous renal access, nephroscopy, and lithotripsy. Five experts (>100 caseload) and 10 novices (simulation. Face and content validity were calculated using model ratings for similarity to the real procedure and usefulness as a training tool. Differences in performance among groups with various levels of experience using clinically relevant procedural metrics were used to calculate construct validity. The model was determined to have an excellent face and content validity with an average score of 4.5/5.0 and 4.6/5.0, respectively. There were significant differences between novice and expert operative metrics including mean fluoroscopy time, the number of percutaneous access attempts, and number of times the needle was repositioned. Experts achieved better stone clearance with fewer procedural complications. We demonstrated the face, content, and construct validity of an inanimate, full task trainer for PCNL. Construct validity between experts and novices was demonstrated using incorporated procedural metrics, which permitted the accurate assessment of performance. While hands-on training under supervision remains an integral part of any residency, this full-immersion simulation provides a comprehensive tool for surgical skills development and evaluation before hands-on exposure.

Complementary and Alternative Medicine: Italian Validation of a Questionnaire on Nurses' Personal and Professional Use, Knowledge, and Attitudes.

Science.gov (United States)

Belletti, Giada; Shorofi, Seyed Afshin; Arbon, Paul; Dal Molin, Alberto

2017-08-01

Patients are showing an increasing interest in the use of complementary and alternative medicine (CAM). Most nurses are open to the adoption of CAM into clinical nursing practice, but they may experience a lack of knowledge about the safe and effective use of these therapies. Several studies concerning nurses' knowledge and attitudes toward CAM have been published, but only in one, the authors (Shorofi and Arbon) used a validated questionnaire. In Italy, there are no validated questionnaires to investigate this aspect of nursing practice. To test the psychometric properties of the Italian Shorofi and Arbon questionnaire for use with Italian nurses. A forward-backward translation method was used to translate the questionnaire from English to Italian. Content validity, face validity and reliability were established. This study examined the potential usefulness of the Shorofi and Arbon questionnaire for the evaluation of CAM knowledge of Italian speaking nurses, which showed good content validity and good reliability.

A Generalized Pivotal Quantity Approach to Analytical Method Validation Based on Total Error.

Science.gov (United States)

Yang, Harry; Zhang, Jianchun

2015-01-01

The primary purpose of method validation is to demonstrate that the method is fit for its intended use. Traditionally, an analytical method is deemed valid if its performance characteristics such as accuracy and precision are shown to meet prespecified acceptance criteria. However, these acceptance criteria are not directly related to the method's intended purpose, which is usually a gurantee that a high percentage of the test results of future samples will be close to their true values. Alternate "fit for purpose" acceptance criteria based on the concept of total error have been increasingly used. Such criteria allow for assessing method validity, taking into account the relationship between accuracy and precision. Although several statistical test methods have been proposed in literature to test the "fit for purpose" hypothesis, the majority of the methods are not designed to protect the risk of accepting unsuitable methods, thus having the potential to cause uncontrolled consumer's risk. In this paper, we propose a test method based on generalized pivotal quantity inference. Through simulation studies, the performance of the method is compared to five existing approaches. The results show that both the new method and the method based on β-content tolerance interval with a confidence level of 90%, hereafter referred to as the β-content (0.9) method, control Type I error and thus consumer's risk, while the other existing methods do not. It is further demonstrated that the generalized pivotal quantity method is less conservative than the β-content (0.9) method when the analytical methods are biased, whereas it is more conservative when the analytical methods are unbiased. Therefore, selection of either the generalized pivotal quantity or β-content (0.9) method for an analytical method validation depends on the accuracy of the analytical method. It is also shown that the generalized pivotal quantity method has better asymptotic properties than all of the current

Validation of Reverse-Engineered and Additive-Manufactured Microsurgical Instrument Prototype.

Science.gov (United States)

Singh, Ramandeep; Suri, Ashish; Anand, Sneh; Baby, Britty

2016-12-01

With advancements in imaging techniques, neurosurgical procedures are becoming highly precise and minimally invasive, thus demanding development of new ergonomically aesthetic instruments. Conventionally, neurosurgical instruments are manufactured using subtractive manufacturing methods. Such a process is complex, time-consuming, and impractical for prototype development and validation of new designs. Therefore, an alternative design process has been used utilizing blue light scanning, computer-aided designing, and additive manufacturing direct metal laser sintering (DMLS) for microsurgical instrument prototype development. Deviations of DMLS-fabricated instrument were studied by superimposing scan data of fabricated instrument with the computer-aided designing model. Content and concurrent validity of the fabricated prototypes was done by a group of 15 neurosurgeons by performing sciatic nerve anastomosis in small laboratory animals. Comparative scoring was obtained for the control and study instrument. T test was applied to the individual parameters and P values for force (P direct application of these additive-manufactured instruments in the operating room requires further validation. © The Author(s) 2016.

Ground-water models: Validate or invalidate

Science.gov (United States)

Bredehoeft, J.D.; Konikow, Leonard F.

1993-01-01

The word validation has a clear meaning to both the scientific community and the general public. Within the scientific community the validation of scientific theory has been the subject of philosophical debate. The philosopher of science, Karl Popper, argued that scientific theory cannot be validated, only invalidated. Popper’s view is not the only opinion in this debate; however, many scientists today agree with Popper (including the authors). To the general public, proclaiming that a ground-water model is validated carries with it an aura of correctness that we do not believe many of us who model would claim. We can place all the caveats we wish, but the public has its own understanding of what the word implies. Using the word valid with respect to models misleads the public; verification carries with it similar connotations as far as the public is concerned. Our point is this: using the terms validation and verification are misleading, at best. These terms should be abandoned by the ground-water community.

Test-driven verification/validation of model transformations

Institute of Scientific and Technical Information of China (English)

László LENGYEL; Hassan CHARAF

2015-01-01

Why is it important to verify/validate model transformations? The motivation is to improve the quality of the trans-formations, and therefore the quality of the generated software artifacts. Verified/validated model transformations make it possible to ensure certain properties of the generated software artifacts. In this way, verification/validation methods can guarantee different requirements stated by the actual domain against the generated/modified/optimized software products. For example, a verified/ validated model transformation can ensure the preservation of certain properties during the model-to-model transformation. This paper emphasizes the necessity of methods that make model transformation verified/validated, discusses the different scenarios of model transformation verification and validation, and introduces the principles of a novel test-driven method for verifying/ validating model transformations. We provide a solution that makes it possible to automatically generate test input models for model transformations. Furthermore, we collect and discuss the actual open issues in the field of verification/validation of model transformations.

Validation of near infrared satellite based algorithms to relative atmospheric water vapour content over land

International Nuclear Information System (INIS)

Serpolla, A.; Bonafoni, S.; Basili, P.; Biondi, R.; Arino, O.

2009-01-01

This paper presents the validation results of ENVISAT MERIS and TERRA MODIS retrieval algorithms for atmospheric Water Vapour Content (WVC) estimation in clear sky condition on land. The MERIS algorithms exploits the radiance ratio of the absorbing channel at 900 nm with the almost absorption-free reference at 890 nm, while the MODIS one is based on the ratio of measurements centred at near 0.905, 0.936, and 0.94 μm with atmospheric window reflectance at 0.865 and 1.24 μm. The first test was performed in the Mediterranean area using WVC provided from both ECMWF and AERONET. As a second step, the performances of the algorithms were tested exploiting WVC computed from radio sounding (RAOBs)in the North East Australia. The different comparisons with respect to reference WVC values showed an overestimation of WVC by MODIS (root mean square error percentage greater than 20%) and an acceptable performance of MERIS algorithms (root mean square error percentage around 10%) [it

[Validation of the IBS-SSS].

Science.gov (United States)

Betz, C; Mannsdörfer, K; Bischoff, S C

2013-10-01

Irritable bowel syndrome (IBS) is a functional gastrointestinal disorder characterised by abdominal pain, associated with stool abnormalities and changes in stool consistency. Diagnosis of IBS is based on characteristic symptoms and exclusion of other gastrointestinal diseases. A number of questionnaires exist to assist diagnosis and assessment of severity of the disease. One of these is the irritable bowel syndrome - severity scoring system (IBS-SSS). The IBS-SSS was validated 1997 in its English version. In the present study, the IBS-SSS has been validated in German language. To do this, a cohort of 60 patients with IBS according to the Rome III criteria, was compared with a control group of healthy individuals (n = 38). We studied sensitivity and reproducibility of the score, as well as the sensitivity to detect changes of symptom severity. The results of the German validation largely reflect the results of the English validation. The German version of the IBS-SSS is also a valid, meaningful and reproducible questionnaire with a high sensitivity to assess changes in symptom severity, especially in IBS patients with moderate symptoms. It is unclear if the IBS-SSS is also a valid questionnaire in IBS patients with severe symptoms because this group of patients was not studied. © Georg Thieme Verlag KG Stuttgart · New York.

Further Validation of the IDAS: Evidence of Convergent, Discriminant, Criterion, and Incremental Validity

Science.gov (United States)

Watson, David; O'Hara, Michael W.; Chmielewski, Michael; McDade-Montez, Elizabeth A.; Koffel, Erin; Naragon, Kristin; Stuart, Scott

2008-01-01

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent…

Reliability and Validity of a Turkish version of the Prenatal Breastfeeding Self-Efficacy Scale.

Science.gov (United States)

Aydin, Ayse; Pasinlioglu, Turkan

2018-05-18

This study aims to conduct reliability and validity study of the Turkish version of the "Prenatal Breastfeeding Self-Efficacy Scale", which determines pregnant women's perception of breastfeeding self-efficacy in the prenatal period. This methodological research was carried out between December 2014 and May 2016 in maternity clinics of the Erzurum Nene Hatun Maternity Hospital and Atatürk University Research Hospital. The study population consisted of pregnant women, admitted to the specified clinics for prenatal controls. The study was carried out with 326 pregnant women, who met the inclusion criteria and agreed to participate in the research without any sample selection. "Personal Information Form" and "Prenatal Breastfeeding Self-Efficacy Scale - Turkish Form" were used for data collection. The data were collected by the face-to-face interview method, and analyzed by SPSS 18 software. In the validity-reliability analysis of the scale, language and content validity, explanatory factor analysis, Cronbach's Alpha coefficient, item-total score correlation, and testretest methods were used. Linguistic validity was verified by the translation-backtranslation of the Prenatal Breastfeeding Self-Efficacy Scale, then the necessary corrections were made according to the recommendations of the expert opinions, to ensure the content validity. As a result of the explanatory factor analysis, performed to determine the construct validity of the scale, a single factor structure was found, having factor loadings in the appropriate range (0.30-0.76). In the internal consistency analysis of the scale, Cronbach's Alpha was 0.86, and the item-total score correlations were between 0.23 and 0.65, and no item was removed from the scale. In order to test the time-invariance of the scale, the test-retest correlation value was found to be 0.94. The relationship between the two applications were determined to be statistically significant (p valid and reliable measurement instrument

Face, content, and construct validity of four, inanimate training exercises using the da Vinci ® Si surgical system configured with Single-Site ™ instrumentation.

Science.gov (United States)

Jarc, Anthony M; Curet, Myriam

2015-08-01

Validated training exercises are essential tools for surgeons as they develop technical skills to use robot-assisted minimally invasive surgical systems. The purpose of this study was to show face, content, and construct validity of four, inanimate training exercises using the da Vinci (®) Si surgical system configured with Single-Site (™) instrumentation. New (N = 21) and experienced (N = 6) surgeons participated in the study. New surgeons (11 Gynecology [GYN] and 10 General Surgery [GEN]) had not completed any da Vinci Single-Site cases but may have completed multiport cases using the da Vinci system. They participated in this study prior to attending a certification course focused on da Vinci Single-Site instrumentation. Experienced surgeons (5 GYN and 1 GEN) had completed at least 25 da Vinci Single-Site cases. The surgeons completed four inanimate training exercises and then rated them with a questionnaire. Raw metrics and overall normalized scores were computed using both video recordings and kinematic data collected from the surgical system. The experienced surgeons significantly outperformed new surgeons for many raw metrics and the overall normalized scores derived from video review (p da Vinci Single-Site surgery and actually testing the technical skills used during da Vinci Single-Site surgery. In summary, the four training exercises showed face, content, and construct validity. Improved overall scores could be developed using additional metrics not included in this study. The results suggest that the training exercises could be used in an overall training curriculum aimed at developing proficiency in technical skills for surgeons new to da Vinci Single-Site instrumentation.

Developing and validating the Perioperative Thirst Discomfort Scale.

Science.gov (United States)

Martins, Pamela Rafaela; Fonseca, Lígia Fahl; Rossetto, Edilaine Giovanini

2017-07-20

Developing and validating a scale to assess perioperative thirst discomfort. A methodological research conducted in 2014 and 2015 at the surgical center of a public hospital in the north of Paraná, Brazil. The scale was developed after literature review, followed by face and content validation, and reliability assessment through its internal consistency and inter-observer equivalence. Seven items make up the scale: dry mouth; dry lips; thick tongue; thick saliva; dry throat, bad taste and desire to drink water. The content validity index for attributes and items was 0.98, and the reliability index was 1 for the scale attributes and items. Internal consistency assessed by Cronbach's alpha was 0.91 and inter-rater equivalence was 1, as measured by weighted kappa coefficient. ThePerioperative Thirst Discomfort Scaleshowed high content and reliability indexes. Elaborar e validar uma escala para avaliação do desconforto da sede perioperatória. Pesquisa metodológica realizada em 2014 e 2015, no centro cirúrgico de um hospital público do norte do Paraná. A escala foi elaborada após revisão bibliográfica, seguida de validação aparente e de conteúdo e avaliação da fidedignidade através de sua consistência interna e da equivalência inter observadores. Sete itens compuseram a escala: boca seca; lábios ressecados; língua grossa; saliva grossa; garganta seca; gosto ruim e vontade de beber água. O índice de validade de conteúdo para atributos e itens foi de 0,98, e o índice de fidedignidade foi de 1 para os atributos e itens da escala. A consistência interna avaliada pelo alfa de Cronbach foi de 0,91, e a equivalência interobservadores foi de 1, medida pelo coeficiente de kappa ponderado. A escala de desconforto da sede perioperatóriademonstrou altos índices de validade de conteúdo e fidedignidade.

Development and in house validation of a new thermogravimetric method for water content analysis in soft brown sugar.

Science.gov (United States)

Ducat, Giseli; Felsner, Maria L; da Costa Neto, Pedro R; Quináia, Sueli P

2015-06-15

Recently the use of brown sugar has increased due to its nutritional characteristics, thus requiring a more rigid quality control. The development of a method for water content analysis in soft brown sugar is carried out for the first time by TG/DTA with application of different statistical tests. The results of the optimization study suggest that heating rates of 5°C min(-1) and an alumina sample holder improve the efficiency of the drying process. The validation study showed that thermo gravimetry presents good accuracy and precision for water content analysis in soft brown sugar samples. This technique offers advantages over other analytical methods as it does not use toxic and costly reagents or solvents, it does not need any sample preparation, and it allows the identification of the temperature at which water is completely eliminated in relation to other volatile degradation products. This is an important advantage over the official method (loss on drying). Copyright © 2015 Elsevier Ltd. All rights reserved.

Development, reliability and validity of the psychosocial adaptation scale for Parkinson's disease in Chinese population.

Science.gov (United States)

Zhang, Tingting; Yin, Anchun; Sun, Xiaohong; Liu, Qigui; Song, Guirong; Li, Lianhong

2015-01-01

To develop psychosocial adaptation scale for Parkinson's disease (PD) in Chinese population and evaluate its reliability and validity. The items were designed by literature review, expert consultation and semi-structured interview. The methods of corrected item-total correlation, discrimination analysis and exploratory factor analysis were used for items selection. 427 valid scales from PD patients were collected in the study to test the reliability and validity. The scale incorporated six dimensions: anxiety, self-esteem, attitude, self-acceptance, self-efficacy and social support, a total of 32 items. The scale possessed good internal consistency. The test-retest correlation coefficient was 0.99 and average content validation rate was 0.97. The Hoehn and Yahr stage were correlated with total score of the scale. The psychosocial adaptation scale in this study showed good reliability and validity, it can be used as a reliable and valid instrument to evaluate the psychosocial adaptation of PD objectively and effectively.

The Role of Generalizability in Validity.

Science.gov (United States)

Kane, Michael

The relationship between generalizability and validity is explained, making four important points. The first is that generalizability coefficients provide upper bounds on validity. The second point is that generalization is one step in most interpretive arguments, and therefore, generalizability is a necessary condition for the validity of these…

Validation of limited sampling models (LSM) for estimating AUC in therapeutic drug monitoring - is a separate validation group required?

NARCIS (Netherlands)

Proost, J. H.

Objective: Limited sampling models (LSM) for estimating AUC in therapeutic drug monitoring are usually validated in a separate group of patients, according to published guidelines. The aim of this study is to evaluate the validation of LSM by comparing independent validation with cross-validation

A qualitative examination of the content validity of the EQ-5D-5L in patients with type 2 diabetes.

Science.gov (United States)

Matza, Louis S; Boye, Kristina S; Stewart, Katie D; Curtis, Bradley H; Reaney, Matthew; Landrian, Amanda S

2015-12-01

The EQ-5D is frequently used to derive utilities for patients with type 2 diabetes (T2D). Despite widely available quantitative psychometric data on the EQ-5D, little is known about content validity in this population. Thus, the purpose of this qualitative study was to examine content validity of the EQ-5D in patients with T2D. Patients with T2D in the UK completed concept elicitation interviews, followed by administration of the EQ-5D-5L and cognitive interviewing focused on the instrument's relevance, clarity, and comprehensiveness. A total of 25 participants completed interviews (52.0 % male; mean age = 53.5 years). Approximately half (52 %) reported that the EQ-5D-5L was relevant to their experience with T2D. When asked if each individual item was relevant to their experience with T2D, responses varied widely (24.0 % said the self-care item was relevant; 68.0 % said the anxiety/depression item was relevant). Participants frequently said items were not relevant to themselves, but could be relevant to patients with more severe diabetes. Most participants (92.0 %) reported that T2D and/or its treatment/monitoring requirements had an impact on their quality of life that was not captured by the EQ-5D-5L. Common missing concepts included food awareness/restriction (n = 13, 52.0 %); activities (n = 11, 44.0 %); emotional functioning other than depression/anxiety (n = 8, 32.0 %); and social/relationship functioning (n = 8, 32.0 %). The results highlight strengths and potential limitations of the EQ-5D-5L, including missing content that could be important for some patients with T2D. Suggestions for addressing limitations are provided.

Validation of a clinical critical thinking skills test in nursing.

Science.gov (United States)

Shin, Sujin; Jung, Dukyoo; Kim, Sungeun

2015-01-27

The purpose of this study was to develop a revised version of the clinical critical thinking skills test (CCTS) and to subsequently validate its performance. This study is a secondary analysis of the CCTS. Data were obtained from a convenience sample of 284 college students in June 2011. Thirty items were analyzed using item response theory and test reliability was assessed. Test-retest reliability was measured using the results of 20 nursing college and graduate school students in July 2013. The content validity of the revised items was analyzed by calculating the degree of agreement between instrument developer intention in item development and the judgments of six experts. To analyze response process validity, qualitative data related to the response processes of nine nursing college students obtained through cognitive interviews were analyzed. Out of initial 30 items, 11 items were excluded after the analysis of difficulty and discrimination parameter. When the 19 items of the revised version of the CCTS were analyzed, levels of item difficulty were found to be relatively low and levels of discrimination were found to be appropriate or high. The degree of agreement between item developer intention and expert judgments equaled or exceeded 50%. From above results, evidence of the response process validity was demonstrated, indicating that subjects respondeds as intended by the test developer. The revised 19-item CCTS was found to have sufficient reliability and validity and will therefore represents a more convenient measurement of critical thinking ability.

Construct Validity: Advances in Theory and Methodology

OpenAIRE

Strauss, Milton E.; Smith, Gregory T.

2009-01-01

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this chapter, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review f...

Simulation Validation for Societal Systems

National Research Council Canada - National Science Library

Yahja, Alex

2006-01-01

.... There are however, substantial obstacles to validation. The nature of modeling means that there are implicit model assumptions, a complex model space and interactions, emergent behaviors, and uncodified and inoperable simulation and validation knowledge...

Development and empirical validation of symmetric component measures of multidimensional constructs: customer and competitor orientation.

Science.gov (United States)

Sørensen, Hans Eibe; Slater, Stanley F

2008-08-01

Atheoretical measure purification may lead to construct deficient measures. The purpose of this paper is to provide a theoretically driven procedure for the development and empirical validation of symmetric component measures of multidimensional constructs. Particular emphasis is placed on establishing a formalized three-step procedure for achieving a posteriori content validity. Then the procedure is applied to development and empirical validation of two symmetrical component measures of market orientation, customer orientation and competitor orientation. Analysis suggests that average variance extracted is particularly critical to reliability in the respecification of multi-indicator measures. In relation to this, the results also identify possible deficiencies in using Cronbach alpha for establishing reliable and valid measures.

Translation, adaptation and validation the contents of the Diabetes Medical Management Plan for the Brazilian context.

Science.gov (United States)

Torres, Heloísa de Carvalho; Chaves, Fernanda Figueredo; Silva, Daniel Dutra Romualdo da; Bosco, Adriana Aparecida; Gabriel, Beatriz Diniz; Reis, Ilka Afonso; Rodrigues, Júlia Santos Nunes; Pagano, Adriana Silvina

2016-08-08

to translate, adapt and validate the contents of the Diabetes Medical Management Plan for the Brazilian context. This protocol was developed by the American Diabetes Association and guides the procedure of educators for the care of children and adolescents with diabetes in schools. this methodological study was conducted in four stages: initial translation, synthesis of initial translation, back translation and content validation by an expert committee, composed of 94 specialists (29 applied linguists and 65 health professionals), for evaluation of the translated version through an online questionnaire. The concordance level of the judges was calculated based on the Content Validity Index. Data were exported into the R program for statistical analysis. the evaluation of the instrument showed good concordance between the judges of the Health and Applied Linguistics areas, with a mean content validity index of 0.9 and 0.89, respectively, and slight variability of the index between groups (difference of less than 0.01). The items in the translated version, evaluated as unsatisfactory by the judges, were reformulated based on the considerations of the professionals of each group. a Brazilian version of Diabetes Medical Management Plan was constructed, called the Plano de Manejo do Diabetes na Escola. traduzir, adaptar e validar o conteúdo do Diabetes Medical Management Plan para o contexto brasileiro, protocolo elaborado pela Associação Americana de Diabetes, que orienta a conduta dos educadores para o cuidado das crianças e adolescentes com diabetes mellitus nas escolas. trata-se de estudo metodológico, realizado em quatro etapas: tradução inicial, síntese da tradução inicial, retrotradução e validação de conteúdo por um Comitê de Juízes, composto por 94 especialistas (29 linguistas aplicados e 65 profissionais da área da Saúde), para avaliação da versão traduzida por meio de um questionário online. O nível de concordância dos juízes foi

Development and validation of the Questionnaire of Stressful Life Events (QSLE).

Science.gov (United States)

Butjosa, Anna; Gómez-Benito, Juana; Myin-Germeys, Inez; Barajas, Ana; Baños, Iris; Usall, Judith; Grau, Norma; Granell, Luis; Sola, Andrea; Carlson, Janina; Dolz, Montserrat; Sánchez, Bernardo; Haro, Josep Maria; Ochoa, Susana

2017-12-01

Stressful life events (SLEs) are important indicators prior to the onset of first-episode psychosis (FEP). Although there are well-validated interviews and self-reports for assessing SLE on proximate events, unfortunately there are no instruments to assess SLE covering an entire lifetime. This study includes detailed specific items of childhood, adolescence, and adulthood focused on the presence of SLE, emotional impact (stressfulness), and the age at which the event occurred. Our research describes 2 studies designed to develop and validate a new scale to assess SLE: the Questionnaire of Stressful Life Events (QSLE). In Study 1, an over-inclusive item pool was generated based on review of group of experts at Parc Sanitari Sant Joan de Déu and content validity was examined by an Expert Survey. The whole scale represents the content domain. In Study 2, item-level analyses revealed good distributional properties, intra-rater reliability, and convergent and discriminant validity. In the sensitivity and specificity analysis, 18 items had high relevance in the discriminability between patients with FEP and healthy controls. We note that there was an AUC of 0.676, indicating a good predictor. Using 7 as a cutoff to predict an individual as a patient would yield a sensitivity of 64.8% and a specificity of 65%. Overall, the QSLE displayed satisfactory psychometric characteristics in a Spanish population. These results suggest that QSLE gives us the opportunity to investigate childhood, adolescent, and adult life events by measuring the stress and age at the moment on a continuous scale. Copyright © 2017 Elsevier Ltd. All rights reserved.

A validity test of movie, television, and video-game ratings.

Science.gov (United States)

Walsh, D A; Gentile, D A

2001-06-01

Numerous studies have documented the potential effects on young audiences of violent content in media products, including movies, television programs, and computer and video games. Similar studies have evaluated the effects associated with sexual content and messages. Cumulatively, these effects represent a significant public health risk for increased aggressive and violent behavior, spread of sexually transmitted diseases, and pediatric pregnancy. In partial response to these risks and to public and legislative pressure, the movie, television, and gaming industries have implemented ratings systems intended to provide information about the content and appropriate audiences for different films, shows, and games. To test the validity of the current movie-, television-, and video game-rating systems. Panel study. Participants used the KidScore media evaluation tool, which evaluates films, television shows, and video games on 10 aspects, including the appropriateness of the media product for children based on age. When an entertainment industry rates a product as inappropriate for children, parent raters agree that it is inappropriate for children. However, parent raters disagree with industry usage of many of the ratings designating material suitable for children of different ages. Products rated as appropriate for adolescents are of the greatest concern. The level of disagreement varies from industry to industry and even from rating to rating. Analysis indicates that the amount of violent content and portrayals of violence are the primary markers for disagreement between parent raters and industry ratings. As 1 part of a solution to the complex public health problems posed by violent and sexually explicit media products, ratings can have value if used with caution. Parents and caregivers relying on the ratings systems to guide their children's use of media products should continue to monitor content independently. Industry ratings systems should be revised with input

Social anxiety questionnaire (SAQ): Development and preliminary validation.

Science.gov (United States)

Łakuta, Patryk

2018-05-30

The Social Anxiety Questionnaire (SAQ) was designed to assess five dimensions of social anxiety as posited by the Clark and Wells' (1995; Clark, 2001) cognitive model. The development of the SAQ involved generation of an item pool, followed by a verification of content validity and the theorized factor structure (Study 1). The final version of the SAQ was then assessed for reliability, temporal stability (test re-test reliability), and construct, criterion-related, and contrasted-group validity (Study 2, 3, and 4). Following a systematic process, the results provide support for the SAQ as reliable, and both theoretically and empirically valid measure. A five-factor structure of the SAQ verified and replicated through confirmatory factor analyses reflect five dimensions of social anxiety: negative self-processing; self-focused attention and self-monitoring; safety behaviours; somatic and cognitive symptoms; and anticipatory and post-event rumination. Results suggest that the SAQ possesses good psychometric properties, while recognizing that additional validation is a required future research direction. It is important to replicate these findings in diverse populations, including a large clinical sample. The SAQ is a promising measure that supports social anxiety as a multidimensional construct, and the foundational role of self-focused cognitive processes in generation and maintenance of social anxiety symptoms. The findings make a significant contribution to the literature, moreover, the SAQ is a first instrument that offers to assess all, proposed by the Clark-Wells model, specific cognitive-affective, physiological, attitudinal, and attention processes related to social anxiety. Copyright © 2018 Elsevier B.V. All rights reserved.

Development and Validation of Attitude toward Gestational Surrogacy Scale in Iranian Infertile Couples

Science.gov (United States)

Rahimi Kian, Fatemeh; Zandi, Afsaneh; Omani Samani, Reza; Maroufizadeh, Saman; Mehran, Abbas

2016-01-01

Background Surrogacy is one of the most challenging infertility treatments engaging ethical, psychological and social issues. Attitudes survey plays an important role to disclosure variant aspects of surrogacy, to help meeting legislative gaps and ambiguities, and to convert controversial dimensions surrounding surrogacy to a normative concept that eliminates stigma. The aim of this study is to develop a comprehensive scale for gestational surrogacy attitudes. Materials and Methods Development process of gestational surrogacy attitudes scale (GSAS) performed based on a descriptive cross-sectional study and included a rich data pool gathered from literature reviews, a qualitative pilot study on 15 infertile couples (n=30), use of expert advisory panel (EAP) consisting of 20 members, as well as use of content validity through qualitative and quantitative study by the means of content validity ratio (CVR) and content validity index (CVI). Also internal consistence using Cronbach’s alpha and test-retest reliability using intracalss correlation coefficient (ICC) were evaluated. Application of GSAS was tested in a cross-sectional study that was conducted on 200 infertile couples (n=400) at Royan Institute, Tehran, Iran, during 2014. Results Final version of GSAS had 30 items within five subscales including "acceptance of surrogacy", "Surrogacy and public attitudes", "Child born through surrogacy", "Surrogate mother", and "Intentional attitude and surrogacy future attempt". Content validity was represented with values of CVR=0.73 and CVI =0.98. Cronbach’s alpha value was 0.91 for the overall scale, while ICC value due to test-retest responses was 0.89. Conclusion Acceptable level of competency and capability of GSAS is significantly indicated; therefore, it seems to be an appropriate tool for the evaluation of gestational surrogacy attitudes in Iranian infertile couples. PMID:27123208

Development and Validation of Attitude toward Gestational Surrogacy Scale in Iranian Infertile Couples

Directory of Open Access Journals (Sweden)

Fatemeh Rahimi Kiandeh

2016-05-01

Full Text Available Background: Surrogacy is one of the most challenging infertility treatments engaging ethical, psychological and social issues. Attitudes survey plays an important role to disclosure variant aspects of surrogacy, to help meeting legislative gaps and ambiguities, and to convert controversial dimensions surrounding surrogacy to a normative concept that eliminates stigma. The aim of this study is to develop a comprehensive scale for gestational surrogacy attitudes. Materials and Methods: Development process of gestational surrogacy attitudes scale (GSAS performed based on a descriptive cross-sectional study and included a rich data pool gathered from literature reviews, a qualitative pilot study on 15 infertile couples (n=30, use of expert advisory panel (EAP consisting of 20 members, as well as use of content validity through qualitative and quantitative study by the means of content validity ratio (CVR and content validity index (CVI. Also internal consistence using Cronbach’s alpha and test-retest reliability using intracalss correlation coefficient (ICC were evaluated. Application of GSAS was tested in a cross-sectional study that was conducted on 200 infertile couples (n=400 at Royan Institute, Tehran, Iran, during 2014. Results: Final version of GSAS had 30 items within five subscales including "acceptance of surrogacy", "Surrogacy and public attitudes", "Child born through surrogacy", "Surrogate mother", and "Intentional attitude and surrogacy future attempt". Content validity was represented with values of CVR=0.73 and CVI =0.98. Cronbach’s alpha value was 0.91 for the overall scale, while ICC value due to test-retest responses was 0.89. Conclusion: Acceptable level of competency and capability of GSAS is significantly indicated; therefore, it seems to be an appropriate tool for the evaluation of gestational surrogacy attitudes in Iranian infertile couples.