WorldWideScience

Sample records for reliable assessment instruments

  1. Diagnosing paratonia in the demented elderly : reliability and validity of the Paratonia Assessment Instrument (PAI)

    NARCIS (Netherlands)

    Hobbelen, Hans; Koopmans, Raymond T C M; Verhey, Frans R J; Habraken, Kitty M; de Bie, Rob A.

    BACKGROUND: Paratonia is one of the associated movement disorders characteristic of dementia. The aim of this study was to develop an assessment tool (the Paratonia Assessment Instrument, PAI), based on the new consensus definition of paratonia. An additional aim was to investigate the reliability

  2. Diagnosing paratonia in the demented elderly: reliability and validity of the Paratonia Assessment Instrument (PAI).

    NARCIS (Netherlands)

    Hobbelen, J.S.; Koopmans, R.T.C.M.; Verhey, F.R.J.; Habraken, K.M.; Bie, R.A. de

    2008-01-01

    BACKGROUND: Paratonia is one of the associated movement disorders characteristic of dementia. The aim of this study was to develop an assessment tool (the Paratonia Assessment Instrument, PAI), based on the new consensus definition of paratonia. An additional aim was to investigate the reliability

  3. A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

    Science.gov (United States)

    Ghazali, Nor Hasnida Md

    2016-01-01

    A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

  4. Validity and reliability of the Turkish version of the pressure ulcer prevention knowledge assessment instrument.

    Science.gov (United States)

    Tulek, Zeliha; Polat, Cansu; Ozkan, Ilknur; Theofanidis, Dimitris; Togrol, Rifat Erdem

    2016-11-01

    Sound knowledge of pressure ulcers is important to enable good prevention. There are limited instruments assessing pressure ulcer knowledge. The Pressure Ulcer Prevention Knowledge Assessment Instrument is among the scales of which psychometric properties have been studied rigorously and reflects the latest evidence. This study aimed to evaluate the validity and reliability of the Turkish version of the Pressure Ulcer Prevention Knowledge Assessment Instrument (PUPKAI-T), an instrument that assesses knowledge of pressure ulcer prevention by using multiple-choice questions. Linguistic validity was verified through front-to-back translation. Psychometric properties of the instrument were studied on a sample of 150 nurses working in a tertiary hospital in Istanbul, Turkey. The content validity index of the translated instrument was 0.94, intra-class correlation coefficients were between 0.37 and 0.80, item difficulty indices were between 0.21 and 0.88, discrimination indices were 0.20-0.78, and the Kuder Richardson for the internal consistency was 0.803. The PUPKAI-T was found to be a valid and reliable tool to evaluate nurses' knowledge on pressure ulcer prevention. The PUPKAI-T may be a useful tool for determining educational needs of nurses on pressure ulcer prevention. Copyright © 2016 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

  5. Reliability assessment of a peer evaluation instrument in a team-based learning course

    Directory of Open Access Journals (Sweden)

    Wahawisan J

    2016-03-01

    Full Text Available Objective: To evaluate the reliability of a peer evaluation instrument in a longitudinal team-based learning setting. Methods: Student pharmacists were instructed to evaluate the contributions of their peers. Evaluations were analyzed for the variance of the scores by identifying low, medium, and high scores. Agreement between performance ratings within each group of students was assessed via intra-class correlation coefficient (ICC. Results: We found little variation in the standard deviation (SD based on the score means among the high, medium, and low scores within each group. The lack of variation in SD of results between groups suggests that the peer evaluation instrument produces precise results. The ICC showed strong concordance among raters. Conclusions: Findings suggest that our student peer evaluation instrument provides a reliable method for peer assessment in team-based learning settings.

  6. Diagnosing paratonia in the demented elderly: reliability and validity of the Paratonia Assessment Instrument (PAI).

    Science.gov (United States)

    Hobbelen, Johannes S M; Koopmans, Raymond T C M; Verhey, Frans R J; Habraken, Kitty M; de Bie, Rob A

    2008-08-01

    Paratonia is one of the associated movement disorders characteristic of dementia. The aim of this study was to develop an assessment tool (the Paratonia Assessment Instrument, PAI), based on the new consensus definition of paratonia. An additional aim was to investigate the reliability and validity of the PAI. A three-phase cross-sectional survey was conducted. In the first two phases, the PAI was developed and validated. In the third phase, the inter-observer reliability and feasibility of the instrument was tested. The original PAI consisted of five criteria that all needed to be met in order to make the diagnosis. On the basis of a qualitative analysis, one criterion was reformulated and another was removed. Following this, inter-observer reliability between the two assessors resulted in an improvement of Cohen's kappa from 0.532 in the initial phase to 0.677 in the second phase. This improvement was substantiated in the third phase by two independent assessors with Cohen's kappa ranging from 0.625 to 1. The PAI is a reliable and valid assessment tool for diagnosing paratonia in elderly people with dementia that can be applied easily in daily practice.

  7. Validity and reliability of a dental operator posture assessment instrument (PAI).

    Science.gov (United States)

    Branson, Bonnie G; Williams, Karen B; Bray, Kimberly Krust; Mcllnay, Sandy L; Dickey, Diana

    2002-01-01

    Basic operating posture is considered an important occupational health issue for oral health care clinicians. It is generally agreed that the physical posture of the operator, while providing care, should be such that all muscles are in a relaxed, well-balanced, and neutral position. Postures outside of this neutral position are likely to cause musculoskeletal discomfort. To date, the range of the neutral operator position has not been well-defined; nor have any specific instruments been identified that can quantitatively or semi-quantitatively assess dental operator posture. This paper reports on the development of an instrument that can be used to semi-quantitatively evaluate postural components. During the first phase of the study, an expert panel defined the basic parameters for acceptable, compromised, and harmful operator postures and established face validity of a posture assessment instrument (PAI). During the second phase, the PAI was tested for reliability using generalizability theory. Four raters tested the instrument for reliability. Overall, total PAI scores were similar amongst three of the raters, with the fourth rater's scores being slightly greater than the other three. The main effect of the rater on individual postural components was moderate, indicating that rater variance contributed to 11.9% of total variance. The PAI measures posture as it occurs and will have numerous applications when evaluating operator performance in the dental and dental hygiene education setting. Also, the PAI will prove useful when examining the effects of operator posture and musculoskeletal disorders.

  8. Validity and reliability of an instrument for assessing case analyses in bioengineering ethics education.

    Science.gov (United States)

    Goldin, Ilya M; Pinkus, Rosa Lynn; Ashley, Kevin

    2015-06-01

    Assessment in ethics education faces a challenge. From the perspectives of teachers, students, and third-party evaluators like the Accreditation Board for Engineering and Technology and the National Institutes of Health, assessment of student performance is essential. Because of the complexity of ethical case analysis, however, it is difficult to formulate assessment criteria, and to recognize when students fulfill them. Improvement in students' moral reasoning skills can serve as the focus of assessment. In previous work, Rosa Lynn Pinkus and Claire Gloeckner developed a novel instrument for assessing moral reasoning skills in bioengineering ethics. In this paper, we compare that approach to existing assessment techniques, and evaluate its validity and reliability. We find that it is sensitive to knowledge gain and that independent coders agree on how to apply it.

  9. Automatic creation of Markov models for reliability assessment of safety instrumented systems

    International Nuclear Information System (INIS)

    Guo Haitao; Yang Xianhui

    2008-01-01

    After the release of new international functional safety standards like IEC 61508, people care more for the safety and availability of safety instrumented systems. Markov analysis is a powerful and flexible technique to assess the reliability measurements of safety instrumented systems, but it is fallible and time-consuming to create Markov models manually. This paper presents a new technique to automatically create Markov models for reliability assessment of safety instrumented systems. Many safety related factors, such as failure modes, self-diagnostic, restorations, common cause and voting, are included in Markov models. A framework is generated first based on voting, failure modes and self-diagnostic. Then, repairs and common-cause failures are incorporated into the framework to build a complete Markov model. Eventual simplification of Markov models can be done by state merging. Examples given in this paper show how explosively the size of Markov model increases as the system becomes a little more complicated as well as the advancement of automatic creation of Markov models

  10. Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study.

    Science.gov (United States)

    Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

    2017-01-01

    Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. The objective of this study was to develop a survey instrument for assessing patients' attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18-65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach's alpha and using factor analysis, respectively. The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach's alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman's ρ =-0.429; P higher education level (Kendall's τ =0.51; P mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman's ρ =0.466; P mobile technology for DM self-management. Additionally, we found that even if most of the patients showed positive attitude toward mobile applications, only a moderate level of intention to indeed use them was observed. Moreover, the study indicated that barriers were truthfulness and easiness to use.

  11. Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children.

    Science.gov (United States)

    Lopes, V P; Barnett, L M; Saraiva, L; Gonçalves, C; Bowe, S J; Abbott, G; Rodrigues, L P

    2016-09-01

    It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test-retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample. Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test-retest reliability with Bland-Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills. The majority of children correctly identified the skills and could understand most of the pictures. Test-retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit. The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children. © 2016 John Wiley & Sons Ltd.

  12. The validity and reliability of the Socioeconomic Status Instrument for assessing prostate cancer patients.

    Science.gov (United States)

    Cyrus-David, Mfon

    2010-08-01

    Because of the lack of consistency in the associations of the socioeconomic status (SES) of prostate cancer (PC) patients from diverse racial and ethnic backgrounds with PC health outcomes, I created the Socioeconomic Status Instrument (SESI) from the Demographic and Health Access components of the Behavioral Risk Factor Surveillance System 2004 Questionnaires and the socioeconomic indices of the subjects' residential counties to better assess the SES of PC patients. The SESI was tested on 220 consecutive subjects with pathologically confirmed PC at the Veterans Affairs Medical Center in Houston, TX. A team that included an epidemiologist, a validation statistician/health services research scientist, and PC survivors assessed the content validity of the SESI. The construct validity of the SESI was assessed with factor analysis by extracting and analyzing 5 principal components based on the subjects' individual responses on the assessment: county socioeconomic characteristics, individual socioeconomic characteristics, financial distress, increased domestic burden with limited earnings, and affluence. The internal consistency reliability of the SESI was assessed with Cronbach's alpha coefficients. Based on the reviews of the SESI, all of the initial 10 items were retained. The correlations between individual responses on the SESI were similar to the results of previous studies. The 5 principal components that I assessed accounted for 71.5% of the variance. Factor loadings ranged from 0.66 to 0.98 and communalities ranged from 0.55 to 0.94. County socioeconomic characteristics accounted for 22.6% of the variance, whereas individual socioeconomic characteristics accounted for 14.6% of the variance. The overall Cronbach's alpha coefficient was 0.78. The SESI is valid and reliable. Accurate measurements of the SES of PC patients would provide better guidance for future research and care deliveries.

  13. Satisfactory reliability among nursing students using the instrument PVC ASSESS to evaluate management of peripheral venous catheters.

    Science.gov (United States)

    Ahlqvist, Margary; Berglund, Britta; Nordström, Gun; Klang, Birgitta; Johansson, Eva

    2014-01-01

    Nursing students should be given opportunities to participate in clinical audits during their education. However, audit tools are seldom tested for reliability among nursing students. The aim of this study was to present reliability among nursing students using the instrument PVC assess to assess management of peripheral venous catheters (PVCs) and PVC-related signs of thrombophlebitis. PVC assess was used to assess 67 inserted PVCs in 60 patients at ten wards at a university hospital. One group of nursing students (n=4) assessed PVCs at the bedside (inter-rater reliability) and photographs of these PVCs were taken. Another group of students (n=3) assessed the PVCs in the photographs after 4 weeks (test-retest reliability). To determine reliability, proportion of agreement [P(A)] and Cohen's kappa coefficient (κ) were calculated. For bedside assessment of PVCs, P(A) ranged from good to excellent (0.80-1.0) in 55% of the 26 PVC assess items that were tested. P(A) was poor (satisfactory reliability among nursing students. However, students need training in how to use the instrument before assessing PVCs.

  14. Translation, cross-cultural adaptation to Brazilian- Portuguese and reliability analysis of the instrument Rapid Entire Body Assessment-REBA

    Directory of Open Access Journals (Sweden)

    Andressa M. Lamarão

    2014-06-01

    Full Text Available Background: Observational instruments, such as the Rapid Entire Body Assessment, quickly assess biomechanical risks present in the workplace. However, in order to use these instruments, it is necessary to conduct the translational/cross-cultural adaptation of the instrument and test its measurement properties. Objectives: To perform the translation and the cross-cultural adaptation to Brazilian-Portuguese and test the reliability of the REBA instrument. Method: The procedures of translation and cross-cultural adaptation to Brazilian-Portuguese were conducted following proposed guidelines that involved translation, synthesis of translations, back translation, committee review and testing of the pre-final version. In addition, reliability and the intra- and inter-rater percent agreement were obtained with the Linear Weighted Kappa Coefficient that was associated with the 95% Confidence Interval and the cross tabulation 2×2. Results : The procedures for translation and adaptation were adequate and the necessary adjustments were conducted on the instrument. The intra- and inter-rater reliability showed values of 0.104 to 0.504, respectively, ranging from very poor to moderate. The percentage agreement values ranged from 5.66% to 69.81%. The percentage agreement was closer to 100% at the item 'upper arm' (69.81% for the Intra-rater 1 and at the items 'legs' and 'upper arm' for the Intra-rater 2 (62.26%. Conclusions: The processes of translation and cross-cultural adaptation were conducted on the REBA instrument and the Brazilian version of the instrument was obtained. However, despite the reliability of the tests used to correct the translated and adapted version, the reliability values are unacceptable according to the guidelines standard, indicating that the reliability must be re-evaluated. Therefore, caution in the interpretation of the biomechanical risks measured by this instrument should be taken.

  15. Translation, cross-cultural adaptation to Brazilian- Portuguese and reliability analysis of the instrument Rapid Entire Body Assessment-REBA

    Science.gov (United States)

    Lamarão, Andressa M.; Costa, Lucíola C. M.; Comper, Maria L. C.; Padula, Rosimeire S.

    2014-01-01

    Background: Observational instruments, such as the Rapid Entire Body Assessment, quickly assess biomechanical risks present in the workplace. However, in order to use these instruments, it is necessary to conduct the translational/cross-cultural adaptation of the instrument and test its measurement properties. Objectives: To perform the translation and the cross-cultural adaptation to Brazilian-Portuguese and test the reliability of the REBA instrument. Method: The procedures of translation and cross-cultural adaptation to Brazilian-Portuguese were conducted following proposed guidelines that involved translation, synthesis of translations, back translation, committee review and testing of the pre-final version. In addition, reliability and the intra- and inter-rater percent agreement were obtained with the Linear Weighted Kappa Coefficient that was associated with the 95% Confidence Interval and the cross tabulation 2×2. Results : The procedures for translation and adaptation were adequate and the necessary adjustments were conducted on the instrument. The intra- and inter-rater reliability showed values of 0.104 to 0.504, respectively, ranging from very poor to moderate. The percentage agreement values ranged from 5.66% to 69.81%. The percentage agreement was closer to 100% at the item 'upper arm' (69.81%) for the Intra-rater 1 and at the items 'legs' and 'upper arm' for the Intra-rater 2 (62.26%). Conclusions: The processes of translation and cross-cultural adaptation were conducted on the REBA instrument and the Brazilian version of the instrument was obtained. However, despite the reliability of the tests used to correct the translated and adapted version, the reliability values are unacceptable according to the guidelines standard, indicating that the reliability must be re-evaluated. Therefore, caution in the interpretation of the biomechanical risks measured by this instrument should be taken. PMID:25003273

  16. Product analysis and initial reliability testing of the total mesorectal excision-quality assessment instrument.

    Science.gov (United States)

    Simunovic, Marko R; DeNardi, Franco G; Coates, Angela J; Szalay, David A; Eva, Kevin W

    2014-07-01

    Product analysis of rectal cancer resection specimens before specimen fixation may provide an immediate and relevant evaluation of surgical performance. We tested the interrater reliability (IRR) of a product analysis tool called the Total Mesorectal Excision-Quality Assessment Instrument (TME-QA). Participants included two gold standard raters, five pathology assistants, and eight pathologists. Domains of the TME-QA reflect total mesorectal excision principles including: (1) completeness of mesorectal margin; (2) completeness of mesorectum; (3) coning of distal mesorectum; (4) physical defects; and (5) overall specimen quality. Specimens were scored independently. We used the generalizability theory to assess the tool's internal consistency and IRR. There were 39 specimens and 120 ratings. Mean overall specimen quality scores for the gold standard raters, pathologists, and assistants were 4.43, 4.43, and 4.50, respectively (p > 0.85). IRR for the first nine items was 0.68 for the full sample, 0.62 for assistants alone, 0.63 for pathologists alone, and 0.74 for gold standard raters alone. IRR for the item overall specimen quality was 0.67 for the full sample, 0.45 for assistants, 0.80 for pathologists, and 0.86 for gold standard raters. IRR increased for all groups when scores were averaged across two raters. Assessment of surgical specimens using the TME-QA may provide rapid and relevant feedback to surgeons about their technical performance. Our results show good internal consistency and IRR when the TME-QA is used by pathologists. However, for pathology assistants, multiple ratings with the averaging of scores may be needed.

  17. Face validity and reliability of a pictorial instrument for assessing fundamental movement skill perceived competence in young children.

    Science.gov (United States)

    Barnett, Lisa M; Ridgers, Nicola D; Zask, Avigdor; Salmon, Jo

    2015-01-01

    To determine reliability and face validity of an instrument to assess young children's perceived fundamental movement skill competence. Validation and reliability study. A pictorial instrument based on the Test Gross Motor Development-2 assessed perceived locomotor (six skills) and object control (six skills) competence using the format and item structure from the physical competence subscale of the Pictorial Scale of Perceived Competence and Acceptance for Young Children. Sample 1 completed object control items in May (n=32) and locomotor items in October 2012 (n=23) at two time points seven days apart. Children were asked at the end of the test-retest their understanding of what was happening in each picture to determine face validity. Sample 2 (n=58) completed 12 items in November 2012 on a single occasion to test internal reliability only. Sample 1 children were aged 5-7 years (M=6.0, SD=0.8) at object control assessment and 5-8 years at locomotor assessment (M=6.5, SD=0.9). Sample 2 children were aged 6-8 years (M=7.2, SD=0.73). Intra-class correlations assessed in Sample 1 children were excellent for object control (intra-class correlation=0.78), locomotor (intra-class correlation=0.82) and all 12 skills (intra-class correlations=0.83). Face validity was acceptable. Internal consistency was adequate in both samples for each subscale and all 12 skills (alpha range 0.60-0.81). This study has provided preliminary evidence for instrument reliability and face validity. This enables future alignment between the measurement of perceived and actual fundamental movement skill competence in young children. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

  18. The Nutrition Literacy Assessment Instrument is a Valid and Reliable Measure of Nutrition Literacy in Adults with Chronic Disease.

    Science.gov (United States)

    Gibbs, Heather D; Ellerbeck, Edward F; Gajewski, Byron; Zhang, Chuanwu; Sullivan, Debra K

    2018-03-01

    To test the reliability and validity of the Nutrition Literacy Assessment Instrument (NLit) in adult primary care and identify the relationship between nutrition literacy and diet quality. This instrument validation study included a cross-sectional sample participating in up to 2 visits 1 month apart. A total of 429 adults with nutrition-related chronic disease were recruited from clinics and a patient registry affiliated with a Midwestern university medical center. Nutrition literacy was measured by the NLit, which was composed of 6 subscales: nutrition and health, energy sources in food, food label and numeracy, household food measurement, food groups, and consumer skills. Diet quality was measured by Healthy Eating Index-2010 with nutrient data from Diet History Questionnaire II surveys. The researchers measured factor validity and reliability by using binary confirmatory factor analysis; test-retest reliability was measured by Pearson r and the intraclass correlation coefficient, and relationships between nutrition literacy and diet quality were analyzed by linear regression. The NLit demonstrated substantial factor validity and reliability (0.97; confidence interval, 0.96-0.98) and test-retest reliability (0.88; confidence interval, 0.85-0.90). Nutrition literacy was the most significant predictor of diet quality (β = .17; multivariate coefficient = 0.10; P measuring nutrition literacy in adult primary care patients. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

  19. Antisocial personality disorder and psychopathy in women: a literature review on the reliability and validity of assessment instruments.

    Science.gov (United States)

    Dolan, Mairead; Völlm, Birgit

    2009-01-01

    Crime rates are low in women compared to men. The two disorders most commonly associated with offending behaviour, antisocial personality disorder (ASPD) and psychopathy, are also less prevalent in female samples. However, developments in forensic psychiatry have often ignored gender, and the utility of constructs such as psychopathy and their assessment instruments in female samples remains unclear. This article presents a review of studies looking at rates of ASPD and psychopathy and on the reliability and validity of assessment instruments of these disorders in women. Gender differences in symptom patterns will be considered. The literature seems to suggest that DSM-IV criteria for ASPD may lead to an underestimation of the prevalence of the disorder in women due to the requirement of childhood conduct disorder symptoms. The Psychopathy Checklist-Revised (PCL-R) is a valid and reliable instrument to identify psychopathy in women but there are gender differences in the factor structure and item loadings on this measure. Research to date seems to suggest a three-factor model may be most strongly supported in females. Preliminary evidence suggests the PCL-R may have some value in predicting future offending while the PCL:SV may be useful in predicting institutional violence. Clinical implications are discussed.

  20. Functional leg length discrepancy between theories and reliable instrumental assessment: a study about newly invented NPoS system.

    Science.gov (United States)

    Mahmoud, Asmaa; Abundo, Paolo; Basile, Luisanna; Albensi, Caterina; Marasco, Morena; Bellizzi, Letizia; Galasso, Franco; Foti, Calogero

    2017-01-01

    In spite the instinct social&financial impact of Leg Length Discrepancy (LLD), controversial and conflicting results still exist regarding a reliable assessment/correction method. For proper management it's essential to discriminate between anatomical&functional Leg Length Discrepancy (FLLD). With the newly invented NPoS (New Postural Solution), under the umbrella of the collaboration of PRM Department, Tor Vergata University with Baro Postural Instruments srl, positive results were observed in both measuring& compensating the hemi-pelvic antero-medial rotation in FLLD through personalized bilateral heel raise using two NPoS components: Foot Image System (FIS) and Postural Optimizer System (POS). This led our research interest to test the validity of NPoS as a preliminary step before evaluating its implementations in postural disorders. After clinical evaluation, 4 subjects with FLLD have been assessed by NPoS. Over a period of 2 months, every subject was evaluated 12 times by two different operators, 48 measurements in total, results have been verified in correlation to BTS GaitLab results. Intra-Operator&inter-operator variability analysis showed statistically insignificant differences, while inter-method variability between NPoS and BTS parameters expressed a linear correlation. Results suggest a significant validity of NPoS in assessment&correction of FLLD, with high degree of reproducibility with minimal operator dependency. This can be considered a base for promising clinical implications of NPoS as a reliable cost effective postural assessment/corrective tool. V.

  1. Defining the "Correct Form": Using Biomechanics to Develop Reliable and Valid Assessment Instruments

    Science.gov (United States)

    Satern, Miriam N.

    2011-01-01

    Physical educators should be able to define the "correct form" they expect to see each student performing in their classes. Moreover, they should be able to go beyond assessing students' skill levels by measuring the outcomes (products) of movements (i.e., how far they throw the ball or how many successful attempts are completed) or counting the…

  2. Development and reliability testing of the Nordic Housing Enabler – an instrument for accessibility assessment of the physical housing

    DEFF Research Database (Denmark)

    Helle, Tina

    and adapted according to accessibility norms and guidelines for housing design in Sweden, Denmark, Iceland and Finland. This iterative process involved occupational therapists, architects, building engineers and professional translators, resulting in the Nordic Housing Enabler. For reliability testing...... serious deficits when it comes to accessibility. This study addresses development of a content valid cross-Nordic version of the Housing Enabler and investigation of inter-rater reliability, when used in occupational therapy practice. The instrument was translated from the original Swedish version......, the sample strategy and data collection procedures were the same in all countries. In total, twenty voluntary occupational therapists collected data from 106 cases by means of the Nordic Housing Enabler. Inter-rater reliability was calculated by means of percentage agreement and kappa statistics. Overall...

  3. Quantitative assessment of probability of failing safely for the safety instrumented system using reliability block diagram method

    International Nuclear Information System (INIS)

    Jin, Jianghong; Pang, Lei; Zhao, Shoutang; Hu, Bin

    2015-01-01

    Highlights: • Models of PFS for SIS were established by using the reliability block diagram. • The more accurate calculation of PFS for SIS can be acquired by using SL. • Degraded operation of complex SIS does not affect the availability of SIS. • The safe undetected failure is the largest contribution to the PFS of SIS. - Abstract: The spurious trip of safety instrumented system (SIS) brings great economic losses to production. How to ensure the safety instrumented system is reliable and available has been put on the schedule. But the existing models on spurious trip rate (STR) or probability of failing safely (PFS) are too simplified and not accurate, in-depth studies of availability to obtain more accurate PFS for SIS are required. Based on the analysis of factors that influence the PFS for the SIS, using reliability block diagram method (RBD), the quantitative study of PFS for the SIS is carried out, and gives some application examples. The results show that, the common cause failure will increase the PFS; degraded operation does not affect the availability of the SIS; if the equipment was tested and repaired one by one, the unavailability of the SIS can be ignored; the corresponding occurrence time of independent safe undetected failure should be the system lifecycle (SL) rather than the proof test interval and the independent safe undetected failure is the largest contribution to the PFS for the SIS

  4. Reliability of visual and instrumental color matching.

    Science.gov (United States)

    Igiel, Christopher; Lehmann, Karl Martin; Ghinea, Razvan; Weyhrauch, Michael; Hangx, Ysbrand; Scheller, Herbert; Paravina, Rade D

    2017-09-01

    The aim of this investigation was to evaluate intra-rater and inter-rater reliability of visual and instrumental shade matching. Forty individuals with normal color perception participated in this study. The right maxillary central incisor of a teaching model was prepared and restored with 10 feldspathic all-ceramic crowns of different shades. A shade matching session consisted of the observer (rater) visually selecting the best match by using VITA classical A1-D4 (VC) and VITA Toothguide 3D Master (3D) shade guides and the VITA Easyshade Advance intraoral spectrophotometer (ES) to obtain both VC and 3D matches. Three shade matching sessions were held with 4 to 6 weeks between sessions. Intra-rater reliability was assessed based on the percentage of agreement for the three sessions for the same observer, whereas the inter-rater reliability was calculated as mean percentage of agreement between different observers. The Fleiss' Kappa statistical analysis was used to evaluate visual inter-rater reliability. The mean intra-rater reliability for the visual shade selection was 64(11) for VC and 48(10) for 3D. The corresponding ES values were 96(4) for both VC and 3D. The percentages of observers who matched the same shade with VC and 3D were 55(10) and 43(12), respectively, while corresponding ES values were 88(8) for VC and 92(4) for 3D. The results for visual shade matching exhibited a high to moderate level of inconsistency for both intra-rater and inter-rater comparisons. The VITA Easyshade Advance intraoral spectrophotometer exhibited significantly better reliability compared with visual shade selection. This study evaluates the ability of observers to consistently match the same shade visually and with a dental spectrophotometer in different sessions. The intra-rater and inter-rater reliability (agreement of repeated shade matching) of visual and instrumental tooth color matching strongly suggest the use of color matching instruments as a supplementary tool in

  5. Development of the Human Factors Skills for Healthcare Instrument: a valid and reliable tool for assessing interprofessional learning across healthcare practice settings.

    Science.gov (United States)

    Reedy, Gabriel B; Lavelle, Mary; Simpson, Thomas; Anderson, Janet E

    2017-10-01

    A central feature of clinical simulation training is human factors skills, providing staff with the social and cognitive skills to cope with demanding clinical situations. Although these skills are critical to safe patient care, assessing their learning is challenging. This study aimed to develop, pilot and evaluate a valid and reliable structured instrument to assess human factors skills, which can be used pre- and post-simulation training, and is relevant across a range of healthcare professions. Through consultation with a multi-professional expert group, we developed and piloted a 39-item survey with 272 healthcare professionals attending training courses across two large simulation centres in London, one specialising in acute care and one in mental health, both serving healthcare professionals working across acute and community settings. Following psychometric evaluation, the final 12-item instrument was evaluated with a second sample of 711 trainees. Exploratory factor analysis revealed a 12-item, one-factor solution with good internal consistency (α=0.92). The instrument had discriminant validity, with newly qualified trainees scoring significantly lower than experienced trainees ( t (98)=4.88, pSkills for Healthcare Instrument provides a reliable and valid method of assessing trainees' human factors skills self-efficacy across acute and mental health settings. This instrument has the potential to improve the assessment and evaluation of human factors skills learning in both uniprofessional and interprofessional clinical simulation training.

  6. Instrumented static and dynamic balance assessment after stroke using Wii Balance Boards: reliability and association with clinical tests.

    Science.gov (United States)

    Bower, Kelly J; McGinley, Jennifer L; Miller, Kimberly J; Clark, Ross A

    2014-01-01

    The Wii Balance Board (WBB) is a globally accessible device that shows promise as a clinically useful balance assessment tool. Although the WBB has been found to be comparable to a laboratory-grade force platform for obtaining centre of pressure data, it has not been comprehensively studied in clinical populations. The aim of this study was to investigate the measurement properties of tests utilising the WBB in people after stroke. Thirty individuals who were more than three months post-stroke and able to stand unsupported were recruited from a single outpatient rehabilitation facility. Participants performed standardised assessments incorporating the WBB and customised software (static stance with eyes open and closed, static weight-bearing asymmetry, dynamic mediolateral weight shifting and dynamic sit-to-stand) in addition to commonly employed clinical tests (10 Metre Walk Test, Timed Up and Go, Step Test and Functional Reach) on two testing occasions one week apart. Test-retest reliability and construct validity of the WBB tests were investigated. All WBB-based outcomes were found to be highly reliable between testing occasions (ICC  = 0.82 to 0.98). Correlations were poor to moderate between WBB variables and clinical tests, with the strongest associations observed between task-related activities, such as WBB mediolateral weight shifting and the Step Test. The WBB, used with customised software, is a reliable and potentially useful tool for the assessment of balance and weight-bearing asymmetry following stroke. Future research is recommended to further investigate validity and responsiveness.

  7. Operational and reliability experience with reactor instrumentation

    International Nuclear Information System (INIS)

    Dixon, F.; Gow, R.S.

    1978-01-01

    In the last 15 years the CEGB has experienced progressive plant development, integration and changes in operating regime through nine nuclear (gas-cooled reactor) power stations with corresponding instrumentation advances leading towards more refined centralized control. Operation and reliability experience with reactor instrumentation is reported in this paper with reference to the progressive changes related to the early magnox, late magnox and AGR periods. Data on instrumentation reliability in terms of reactor forced outages are presented and show that the instrumentation contributions to loss of generating plant availability are small. Reactor safety circuits, neutron flux and temperature measurements, gas analysis and vibration monitoring are discussed. In reviewing the reactor instrumentation the emphasis is on reporting recent experience, particularly on AGR equipment, but overall performance and changes to magnox equipment are included so that some appreciation can be obtained of instrumentation requirements with respect to plant lifetimes. (author)

  8. Reliability and Validity of Three Instruments (DSM-IV, CPGI, and PPGM) in the Assessment of Problem Gambling in South Korea.

    Science.gov (United States)

    Back, Ki-Joon; Williams, Robert J; Lee, Choong-Ki

    2015-09-01

    Most research on the assessment, epidemiology, and treatment of problem gambling has occurred in Western jurisdictions. This potentially limits the cross-cultural validity of problem gambling assessment instruments as well as etiological models of problem gambling. The primary objective of the present research was to investigate the reliability and validity of three problem gambling assessment instruments within a South Korean context. A total of 4,330 South Korean adults participated in a comprehensive assessment of their gambling behavior that included the administration of the DSM-IV criteria for pathological gambling (NODS), the Canadian Problem Gambling Index (CPGI), and the Problem and Pathological Gambling Measure (PPGM). Cronbach alpha showed that all three instruments had good internal consistency. Concurrent validity was established by the significant associations observed between scores on the instruments and measures of gambling involvement (number of gambling formats engaged in; frequency of gambling; and gambling expenditure). Most importantly, kappa statistics showed that all instruments have satisfactory classification accuracy against clinical assessment of problem gambling conducted by South Korean clinicians (NODS κ = .66; PPGM κ = .62; CPGI κ = .51). These results confirm that Western-derived operationalizations of problem gambling have applicability in a South Korean setting.

  9. Instrumented static and dynamic balance assessment after stroke using Wii Balance Boards: reliability and association with clinical tests.

    Directory of Open Access Journals (Sweden)

    Kelly J Bower

    Full Text Available The Wii Balance Board (WBB is a globally accessible device that shows promise as a clinically useful balance assessment tool. Although the WBB has been found to be comparable to a laboratory-grade force platform for obtaining centre of pressure data, it has not been comprehensively studied in clinical populations. The aim of this study was to investigate the measurement properties of tests utilising the WBB in people after stroke.Thirty individuals who were more than three months post-stroke and able to stand unsupported were recruited from a single outpatient rehabilitation facility. Participants performed standardised assessments incorporating the WBB and customised software (static stance with eyes open and closed, static weight-bearing asymmetry, dynamic mediolateral weight shifting and dynamic sit-to-stand in addition to commonly employed clinical tests (10 Metre Walk Test, Timed Up and Go, Step Test and Functional Reach on two testing occasions one week apart. Test-retest reliability and construct validity of the WBB tests were investigated.All WBB-based outcomes were found to be highly reliable between testing occasions (ICC  = 0.82 to 0.98. Correlations were poor to moderate between WBB variables and clinical tests, with the strongest associations observed between task-related activities, such as WBB mediolateral weight shifting and the Step Test.The WBB, used with customised software, is a reliable and potentially useful tool for the assessment of balance and weight-bearing asymmetry following stroke. Future research is recommended to further investigate validity and responsiveness.

  10. The contribution of instrumentation and control software to system reliability

    International Nuclear Information System (INIS)

    Fryer, M.O.

    1984-01-01

    Advanced instrumentation and control systems are usually implemented using computers that monitor the instrumentation and issue commands to control elements. The control commands are based on instrument readings and software control logic. The reliability of the total system will be affected by the software design. When comparing software designs, an evaluation of how each design can contribute to the reliability of the system is desirable. Unfortunately, the science of reliability assessment of combined hardware and software systems is in its infancy. Reliability assessment of combined hardware/software systems is often based on over-simplified assumptions about software behavior. A new method of reliability assessment of combined software/hardware systems is presented. The method is based on a procedure called fault tree analysis which determines how component failures can contribute to system failure. Fault tree analysis is a well developed method for reliability assessment of hardware systems and produces quantitative estimates of failure probability based on component failure rates. It is shown how software control logic can be mapped into a fault tree that depicts both software and hardware contributions to system failure. The new method is important because it provides a way for quantitatively evaluating the reliability contribution of software designs. In many applications, this can help guide designers in producing safer and more reliable systems. An application to the nuclear power research industry is discussed

  11. Approach to reliability assessment

    International Nuclear Information System (INIS)

    Green, A.E.; Bourne, A.J.

    1975-01-01

    Experience has shown that reliability assessments can play an important role in the early design and subsequent operation of technological systems where reliability is at a premium. The approaches to and techniques for such assessments, which have been outlined in the paper, have been successfully applied in variety of applications ranging from individual equipments to large and complex systems. The general approach involves the logical and systematic establishment of the purpose, performance requirements and reliability criteria of systems. This is followed by an appraisal of likely system achievment based on the understanding of different types of variational behavior. A fundamental reliability model emerges from the correlation between the appropriate Q and H functions for performance requirement and achievement. This model may cover the complete spectrum of performance behavior in all the system dimensions

  12. Assessment of Perceived Stress Related to Migration and Acculturation in Patients with Psychiatric Disorders (MIGSTR10)-Development, Reliability, and Dimensionality of a Brief Instrument.

    Science.gov (United States)

    Müller, Matthias J; Zink, Sabrina; Koch, Eckhardt

    2017-09-01

    Assessment of stressors related to migration and acculturation in patients with psychiatric disorder and migration background could help improve culturally sensitive concepts of psychiatry and psychotherapy for diagnosis and treatment. The present overview delineates development and psychometric properties of an instrument (MIGSTR10) for assessment of stressors related to migration and acculturation, particularly for application in patients with psychiatric disorders. Ten migration-related stressors were derived from a qualitative content analysis of case histories of patients with psychiatric disorder and migration background and put into a suitable interview and questionnaire format (MIGSTR10; 10 questions, answer format: categorical yes/no, and dimensional 0-10) for self-assessment and observer ratings in several languages. Reliability (interrater agreement, internal consistency) and dimensionality (multi-dimensional scaling, MDS) were investigated in n = 235 patients with migration background and n = 612 indigenous German patients. Interrater agreement (ICC) for MIGSTR10 single items and sum scores (categorical and dimensional) was sufficiently high (≥.58); internal consistency (Cronbach's α) reached medium to high values (.56-.73). MDS revealed a two-dimensional solution with two item clusters (A: communication, migration history, forced marriage, homesickness, discrimination, other stressors; B: family conflicts, loss of status, feelings of shame, guilt feelings). The MIGSTR10 is a rationally developed, straightforward 10-item screening instrument with satisfactory psychometric properties for the assessment of individual and specific stressors related to migration and acculturation.

  13. An approach based on defense-in-depth and diversity (3D) for the reliability assessment of digital instrument and control systems of nuclear power plants

    Energy Technology Data Exchange (ETDEWEB)

    Silva, Paulo Adriano da; Saldanha, Pedro L.C., E-mail: pasilva@cnen.gov.b, E-mail: Saldanha@cnen.gov.b [Comissao Nacional de Energia Nuclear (CNEN), Rio de Janeiro, RJ (Brazil). Coord. Geral de Reatores Nucleares; Melo, Paulo F. Frutuoso e, E-mail: frutuoso@nuclear.ufrj.b [Universidade Federal do Rio de Janeiro (PEN/COPPE/UFRJ), RJ (Brazil). Coordenacao dos Programas de Pos-Graduacao em Engenharia. Programa de Engenharia Nuclear; Araujo, Ademir L. de [Associacao Brasileira de Ensino Universitario (UNIABEU), Angra dos Reis, RJ (Brazil)

    2011-07-01

    The adoption of instrumentation and control (I and C) digital technology has been slower in nuclear power plants. The reason has been unfruitful efforts to obtain evidence in order to prove that I and C systems can be used in nuclear safety systems, for example, the Reactor Protection System (RPS), ensuring the proper operation of all its functions. This technology offers a potential improvement for safety and reliability. However, there still no consensus about the model to be adopted for digital systems software to be used in reliability studies. This paper presents the 3D methodology approach to assess digital I and C reliability. It is based on the study of operational events occurring in NPPs. It is easy to identify, in general, the level of I and C system reliability, showing its key vulnerabilities, enabling to trace regulatory actions to minimize or avoid them. This approach makes it possible to identify the main types of digital I and C system failure, with the potential for common cause failures as well as evaluating the dominant failure modes. The MAFIC-D software was developed to assist the implementation of the relationships between the reliability criteria, the analysis of relationships and data collection. The results obtained through this tool proved to be satisfactory and complete the process of regulatory decision-making from licensing I and C digital of NPPs and call still be used to monitor the performance of I and C digital post-licensing during the lifetime of the system, providing the basis for the elaboration of checklists of regulatory inspections. (author)

  14. An approach based on defense-in-depth and diversity (3D) for the reliability assessment of digital instrument and control systems of nuclear power plants

    International Nuclear Information System (INIS)

    Silva, Paulo Adriano da; Saldanha, Pedro L.C.

    2011-01-01

    The adoption of instrumentation and control (I and C) digital technology has been slower in nuclear power plants. The reason has been unfruitful efforts to obtain evidence in order to prove that I and C systems can be used in nuclear safety systems, for example, the Reactor Protection System (RPS), ensuring the proper operation of all its functions. This technology offers a potential improvement for safety and reliability. However, there still no consensus about the model to be adopted for digital systems software to be used in reliability studies. This paper presents the 3D methodology approach to assess digital I and C reliability. It is based on the study of operational events occurring in NPPs. It is easy to identify, in general, the level of I and C system reliability, showing its key vulnerabilities, enabling to trace regulatory actions to minimize or avoid them. This approach makes it possible to identify the main types of digital I and C system failure, with the potential for common cause failures as well as evaluating the dominant failure modes. The MAFIC-D software was developed to assist the implementation of the relationships between the reliability criteria, the analysis of relationships and data collection. The results obtained through this tool proved to be satisfactory and complete the process of regulatory decision-making from licensing I and C digital of NPPs and call still be used to monitor the performance of I and C digital post-licensing during the lifetime of the system, providing the basis for the elaboration of checklists of regulatory inspections. (author)

  15. Failure mode taxonomy for assessing the reliability of Field Programmable Gate Array based Instrumentation and Control systems

    International Nuclear Information System (INIS)

    McNelles, Phillip; Zeng, Zhao Chang; Renganathan, Guna; Chirila, Marius; Lu, Lixuan

    2017-01-01

    Highlights: • The use FPGAs in I&C systems in Nuclear Power Plants is an important issue (IAEA). • OECD-NEA published a failure mode taxonomy for software-based digital I&C systems. • This paper extends the OECD-NEA taxonomy to model FPGA-based systems. • FPGA failure modes, failure effects, uncovering methods are categorized/described. • Provides an example of modelling an FPGA-Based RTS/ESFAS using the FPGA taxonomy. - Abstract: Field Programmable Gate Arrays (FPGAs) are a form of programmable digital hardware configured to perform digital logic functions. This configuration (programming) is performed using Hardware Description Language (HDL), making FPGAs a form of HDL Programmed Device (HPD). In the nuclear field, FPGAs have seen use in upgrades and replacements of obsolete Instrumentation and Control (I&C) systems. This paper expands upon previous work that resulted in extensive FPGA failure mode data, to allow for the application of the OECD-NEA failure modes taxonomy. The OECD-NEA taxonomy presented a method to model digital (software-based) I&C systems, based on the hardware and software failure modes, failure uncovering effects and levels of abstraction, using a Reactor Trip System/Engineering Safety Feature Actuation System (RTS/ESFAS) as an example system. To create the FPGA taxonomy, this paper presents an additional “sub-component” level of abstraction, to demonstrate the effect of the FPGA failure modes and failure categories on an FPGA-based system. The proposed FPGA taxonomy is based on the FPGA failure modes, failure categories, failure effects and uncovering situations. The FPGA taxonomy is applied to the RTS/ESFAS test system, to demonstrate the effects of the anticipated FPGA failure modes on a digital I&C system, and to provide a modelling example for this proposed taxonomy.

  16. Safety and reliability assessment

    International Nuclear Information System (INIS)

    1979-01-01

    This report contains the papers delivered at the course on safety and reliability assessment held at the CSIR Conference Centre, Scientia, Pretoria. The following topics were discussed: safety standards; licensing; biological effects of radiation; what is a PWR; safety principles in the design of a nuclear reactor; radio-release analysis; quality assurance; the staffing, organisation and training for a nuclear power plant project; event trees, fault trees and probability; Automatic Protective Systems; sources of failure-rate data; interpretation of failure data; synthesis and reliability; quantification of human error in man-machine systems; dispersion of noxious substances through the atmosphere; criticality aspects of enrichment and recovery plants; and risk and hazard analysis. Extensive examples are given as well as case studies

  17. Failure Modes Taxonomy for Reliability Assessment of Digital Instrumentation and Control Systems for Probabilistic Risk Analysis - Failure modes taxonomy for reliability assessment of digital I and C systems for PRA

    International Nuclear Information System (INIS)

    Amri, A.; Blundell, N.; ); Authen, S.; Betancourt, L.; Coyne, K.; Halverson, D.; Li, M.; Taylor, G.; Bjoerkman, K.; Brinkman, H.; Postma, W.; Bruneliere, H.; Chirila, M.; Gheorge, R.; Chu, L.; Yue, M.; Delache, J.; Georgescu, G.; Deleuze, G.; Quatrain, R.; Thuy, N.; Holmberg, J.-E.; Kim, M.C.; Kondo, K.; Mancini, F.; Piljugin, E.; Stiller, J.; Sedlak, J.; Smidts, C.; Sopira, V.

    2015-01-01

    Digital protection and control systems appear as upgrades in older nuclear power plants (NPP), and are commonplace in new NPPs. To assess the risk of NPP operation and to determine the risk impact of digital systems, there is a need to quantitatively assess the reliability of the digital systems in a justifiable manner. Due to the many unique attributes of digital systems (e.g., functions are implemented by software, units of the system interact in a communication network, faults can be identified and handled online), a number of modelling and data collection challenges exist, and international consensus on the reliability modelling has not yet been reached. The objective of the task group called DIGREL has been to develop a taxonomy of failure modes of digital components for the purposes of probabilistic risk analysis (PRA). An activity focused on the development of a common taxonomy of failure modes is seen as an important step towards standardised digital instrumentation and control (I and C) reliability assessment techniques for PRA. Needs from PRA has guided the work, meaning, e.g., that the I and C system and its failures are studied from the point of view of their functional significance point of view. The taxonomy will be the basis of future modelling and quantification efforts. It will also help to define a structure for data collection and to review PRA studies. The proposed failure modes taxonomy has been developed by first collecting examples of taxonomies provided by the task group organisations. This material showed some variety in the handling of I and C hardware failure modes, depending on the context where the failure modes have been defined. Regarding the software part of I and C, failure modes defined in NPP PRAs have been simple - typically a software CCF failing identical processing units. The DIGREL task group has defined a new failure modes taxonomy based on a hierarchical definition of five levels of abstraction: 1. system level (complete

  18. Safety instrumented systems in the oil and gas industry : Concepts and methods for safety and reliability assessments in design and operation

    Energy Technology Data Exchange (ETDEWEB)

    Lundteigen, Mary Ann

    2009-07-01

    This thesis proposes new methods and gives new insight to safety and reliability assessments of safety instrumented systems (SISs). These systems play an important role in many industry sectors and are used to detect the onset of hazardous events and mitigate their consequences to humans, the environment, and material assets. The thesis focuses on SIS applications in the oil and gas industry. Here, the SIS must respond to hazardous events such as gas leakages, fires, and over pressurization. Because there are personnel onboard the oil and gas installations, the operations take place in a vulnerable marine environment, and substantial values are associated with the offshore facilities, the reliability of SIS is of great concern to the public, the authorities, and the plant owners. The objective of this project has been to identify some of the key factors that influence the SIS reliability, clarify their effects on reliability, and suggest means to improve the treatment of these factors in safety and reliability assessments in design and operation. The project builds on concepts, methods, and definitions in two key standards for SIS design, construction, and operation: IEC 61508 and IEC 61511. The main contributions from this project are: A product development model that integrates reliability, availability, maintainability, and safety (RAMS) requirements with product development. The contributions have been presented in ten articles, five published in international journals, two submitted for publication, and three presented at conferences and in conference proceedings. The contributions are also directed to the industry and the actors that are involved in SIS design, construction, and operation. Even if the oil and gas industry is the main focus area, the results may be relevant for other industry sectors as well. SIS manufacturers and SIS designers face a large number of requirements from authorities, oil companies, international standards, and so on. At the same

  19. Validity evidence and reliability of a simulated patient feedback instrument.

    Science.gov (United States)

    Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

    2012-01-27

    In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

  20. OSS reliability measurement and assessment

    CERN Document Server

    Yamada, Shigeru

    2016-01-01

    This book analyses quantitative open source software (OSS) reliability assessment and its applications, focusing on three major topic areas: the Fundamentals of OSS Quality/Reliability Measurement and Assessment; the Practical Applications of OSS Reliability Modelling; and Recent Developments in OSS Reliability Modelling. Offering an ideal reference guide for graduate students and researchers in reliability for open source software (OSS) and modelling, the book introduces several methods of reliability assessment for OSS including component-oriented reliability analysis based on analytic hierarchy process (AHP), analytic network process (ANP), and non-homogeneous Poisson process (NHPP) models, the stochastic differential equation models and hazard rate models. These measurement and management technologies are essential to producing and maintaining quality/reliable systems using OSS.

  1. Manual dexterity in hereditary motor and sensory neuropathy type 1a: severity of limitations and feasibility and reliability of two assessment instruments

    NARCIS (Netherlands)

    Videler, Annemieke J.; Beelen, Anita; van Schaik, Ivo N.; de Visser, Marianne; Nollet, Frans

    2008-01-01

    OBJECTIVE: To assess the prevalence and significance of impaired manual dexterity in hereditary motor and sensory neuropathy type 1a (HMSN 1a), with the Sollerman hand function and the Functional Dexterity test, and compare the reliability and agreement of the tests. DESIGN: Descriptive

  2. Reliability Assessment Of Wind Turbines

    DEFF Research Database (Denmark)

    Sørensen, John Dalsgaard

    2014-01-01

    Reduction of cost of energy for wind turbines are very important in order to make wind energy competitive compared to other energy sources. Therefore the turbine components should be designed to have sufficient reliability but also not be too costly (and safe). This paper presents models...... for uncertainty modeling and reliability assessment of especially the structural components such as tower, blades, substructure and foundation. But since the function of a wind turbine is highly dependent on many electrical and mechanical components as well as a control system also reliability aspects...... of these components are discussed and it is described how there reliability influences the reliability of the structural components. Two illustrative examples are presented considering uncertainty modeling, reliability assessment and calibration of partial safety factors for structural wind turbine components exposed...

  3. Software reliability assessment

    International Nuclear Information System (INIS)

    Barnes, M.; Bradley, P.A.; Brewer, M.A.

    1994-01-01

    The increased usage and sophistication of computers applied to real time safety-related systems in the United Kingdom has spurred on the desire to provide a standard framework within which to assess dependable computing systems. Recent accidents and ensuing legislation have acted as a catalyst in this area. One particular aspect of dependable computing systems is that of software, which is usually designed to reduce risk at the system level, but which can increase risk if it is unreliable. Various organizations have recognized the problem of assessing the risk imposed to the system by unreliable software, and have taken initial steps to develop and use such assessment frameworks. This paper relates the approach of Consultancy Services of AEA Technology in developing a framework to assess the risk imposed by unreliable software. In addition, the paper discusses the experiences gained by Consultancy Services in applying the assessment framework to commercial and research projects. The framework is applicable to software used in safety applications, including proprietary software. Although the paper is written with Nuclear Reactor Safety applications in mind, the principles discussed can be applied to safety applications in all industries

  4. A Database Management Assessment Instrument

    Science.gov (United States)

    Landry, Jeffrey P.; Pardue, J. Harold; Daigle, Roy; Longenecker, Herbert E., Jr.

    2013-01-01

    This paper describes an instrument designed for assessing learning outcomes in data management. In addition to assessment of student learning and ABET outcomes, we have also found the instrument to be effective for determining database placement of incoming information systems (IS) graduate students. Each of these three uses is discussed in this…

  5. An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

    Science.gov (United States)

    Kuçukosmanoglu, Hayrettin Onur

    2015-01-01

    The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

  6. New Approaches to Reliability Assessment

    DEFF Research Database (Denmark)

    Ma, Ke; Wang, Huai; Blaabjerg, Frede

    2016-01-01

    of energy. New approaches for reliability assessment are being taken in the design phase of power electronics systems based on the physics-of-failure in components. In this approach, many new methods, such as multidisciplinary simulation tools, strength testing of components, translation of mission profiles......, and statistical analysis, are involved to enable better prediction and design of reliability for products. This article gives an overview of the new design flow in the reliability engineering of power electronics from the system-level point of view and discusses some of the emerging needs for the technology...

  7. Reliability of Instruments Measuring At-Risk and Problem Gambling Among Young Individuals

    DEFF Research Database (Denmark)

    Edgren, Robert; Castrén, Sari; Mäkelä, Marjukka

    2016-01-01

    This review aims to clarify which instruments measuring at-risk and problem gambling (ARPG) among youth are reliable and valid in light of reported estimates of internal consistency, classification accuracy, and psychometric properties. A systematic search was conducted in PubMed, Medline, and Psyc......Info covering the years 2009–2015. In total, 50 original research articles fulfilled the inclusion criteria: target age under 29 years, using an instrument designed for youth, and reporting a reliability estimate. Articles were evaluated with the revised Quality Assessment of Diagnostic Accuracy Studies tool....... Reliability estimates were reported for five ARPG instruments. Most studies (66%) evaluated the South Oaks Gambling Screen Revised for Adolescents. The Gambling Addictive Behavior Scale for Adolescents was the only novel instrument. In general, the evaluation of instrument reliability was superficial. Despite...

  8. Instrument reliability for high-level nuclear-waste-repository applications

    International Nuclear Information System (INIS)

    Rogue, F.; Binnall, E.P.; Armantrout, G.A.

    1983-01-01

    Reliable instrumentation will be needed to evaluate the characteristics of proposed high-level nuclear-wasted-repository sites and to monitor the performance of selected sites during the operational period and into repository closure. A study has been done to assess the reliability of instruments used in Department of Energy (DOE) waste repository related experiments and in other similar geological applications. The study included experiences with geotechnical, hydrological, geochemical, environmental, and radiological instrumentation and associated data acquisition equipment. Though this paper includes some findings on the reliability of instruments in each of these categories, the emphasis is on experiences with geotechnical instrumentation in hostile repository-type environments. We review the failure modes, rates, and mechanisms, along with manufacturers modifications and design changes to enhance and improve instrument performance; and include recommendations on areas where further improvements are needed

  9. Development of assessment instruments to measure critical thinking skills

    Science.gov (United States)

    Sumarni, W.; Supardi, K. I.; Widiarti, N.

    2018-04-01

    Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

  10. Reliability Estimation for Digital Instrument/Control System

    International Nuclear Information System (INIS)

    Yang, Yaguang; Sydnor, Russell

    2011-01-01

    Digital instrumentation and controls (DI and C) systems are widely adopted in various industries because of their flexibility and ability to implement various functions that can be used to automatically monitor, analyze, and control complicated systems. It is anticipated that the DI and C will replace the traditional analog instrumentation and controls (AI and C) systems in all future nuclear reactor designs. There is an increasing interest for reliability and risk analyses for safety critical DI and C systems in regulatory organizations, such as The United States Nuclear Regulatory Commission. Developing reliability models and reliability estimation methods for digital reactor control and protection systems will involve every part of the DI and C system, such as sensors, signal conditioning and processing components, transmission lines and digital communication systems, D/A and A/D converters, computer system, signal processing software, control and protection software, power supply system, and actuators. Some of these components are hardware, such as sensors and actuators, their failure mechanisms are well understood, and the traditional reliability model and estimation methods can be directly applied. But many of these components are firmware which has software embedded in the hardware, and software needs special consideration because its failure mechanism is unique, and the reliability estimation method for a software system will be different from the ones used for hardware systems. In this paper, we will propose a reliability estimation method for the entire DI and C system reliability using a recently developed software reliability estimation method and a traditional hardware reliability estimation method

  11. Reliability Estimation for Digital Instrument/Control System

    Energy Technology Data Exchange (ETDEWEB)

    Yang, Yaguang; Sydnor, Russell [U.S. Nuclear Regulatory Commission, Washington, D.C. (United States)

    2011-08-15

    Digital instrumentation and controls (DI and C) systems are widely adopted in various industries because of their flexibility and ability to implement various functions that can be used to automatically monitor, analyze, and control complicated systems. It is anticipated that the DI and C will replace the traditional analog instrumentation and controls (AI and C) systems in all future nuclear reactor designs. There is an increasing interest for reliability and risk analyses for safety critical DI and C systems in regulatory organizations, such as The United States Nuclear Regulatory Commission. Developing reliability models and reliability estimation methods for digital reactor control and protection systems will involve every part of the DI and C system, such as sensors, signal conditioning and processing components, transmission lines and digital communication systems, D/A and A/D converters, computer system, signal processing software, control and protection software, power supply system, and actuators. Some of these components are hardware, such as sensors and actuators, their failure mechanisms are well understood, and the traditional reliability model and estimation methods can be directly applied. But many of these components are firmware which has software embedded in the hardware, and software needs special consideration because its failure mechanism is unique, and the reliability estimation method for a software system will be different from the ones used for hardware systems. In this paper, we will propose a reliability estimation method for the entire DI and C system reliability using a recently developed software reliability estimation method and a traditional hardware reliability estimation method.

  12. Study to determine the reliability and validity of a needs-assessment instrument used within the mechanical maintenance field of the nuclear electrical-generating industry

    International Nuclear Information System (INIS)

    Russell, L.O.

    1982-01-01

    This study was to determine if task parameter ratings provided by nuclear power plant maintenance mechanics assessed the true task frequency, criticality, and difficulty. This was to measure the data's usefulness as a training needs assessment indicator. A questionnaire entitled Job Task Questionnaire for Maintenance Mechanics was developed and used to collect data from job incumbents. Development was based on plant visits and incumbent interviews. Duties, tasks, parameters, and scales were then compiled to form the questionnaire. The questionnaire was then pilot tested. A random sample was selected from the national population of nuclear power plant maintenance mechanics. This resulted in a sample which was stratified across the job title and random within the job title. The descriptive analysis did not tend to indicate that the mean value of each task parameter provided a true or valid value. The overall conclusion drawn from the data analysis was that the ratings did not provide a substantially valid or reliable indication on which to base task training needs

  13. Instruments to assess integrated care

    DEFF Research Database (Denmark)

    Lyngsø, Anne Marie; Godtfredsen, Nina Skavlan; Høst, Dorte

    2014-01-01

    INTRODUCTION: Although several measurement instruments have been developed to measure the level of integrated health care delivery, no standardised, validated instrument exists covering all aspects of integrated care. The purpose of this review is to identify the instruments concerning how to mea...... was prevalent. It is uncertain whether development of a single 'all-inclusive' model for assessing integrated care is desirable. We emphasise the continuing need for validated instruments embedded in theoretical contexts.......INTRODUCTION: Although several measurement instruments have been developed to measure the level of integrated health care delivery, no standardised, validated instrument exists covering all aspects of integrated care. The purpose of this review is to identify the instruments concerning how...... to measure the level of integration across health-care sectors and to assess and evaluate the organisational elements within the instruments identified. METHODS: An extensive, systematic literature review in PubMed, CINAHL, PsycINFO, Cochrane Library, Web of Science for the years 1980-2011. Selected...

  14. Reliability Assessment of Concrete Bridges

    DEFF Research Database (Denmark)

    Thoft-Christensen, Palle; Middleton, C. R.

    This paper is partly based on research performed for the Highways Agency, London, UK under the project DPU/9/44 "Revision of Bridge Assessment Rules Based on Whole Life Performance: concrete bridges". It contains the details of a methodology which can be used to generate Whole Life (WL) reliability...... profiles. These WL reliability profiles may be used to establish revised rules for concrete bridges. This paper is to some extend based on Thoft-Christensen et. al. [1996], Thoft-Christensen [1996] et. al. and Thoft-Christensen [1996]....

  15. Reliability assessment of Wind turbines

    DEFF Research Database (Denmark)

    Sørensen, John Dalsgaard

    2015-01-01

    Wind turbines can be considered as structures that are in between civil engineering structures and machines since they consist of structural components and many electrical and machine components together with a control system. Further, a wind turbine is not a one-of-a-kind structure...... but manufactured in series production based on many component tests, some prototype tests and zeroseries wind turbines. These characteristics influence the reliability assessment where focus in this paper is on the structural components. Levelized Cost Of Energy is very important for wind energy, especially when...... comparing to other energy sources. Therefore much focus is on cost reductions and improved reliability both for offshore and onshore wind turbines. The wind turbine components should be designed to have sufficient reliability level with respect to both extreme and fatigue loads but also not be too costly...

  16. The Assumption of a Reliable Instrument and Other Pitfalls to Avoid When Considering the Reliability of Data

    Science.gov (United States)

    Nimon, Kim; Zientek, Linda Reichwein; Henson, Robin K.

    2012-01-01

    The purpose of this article is to help researchers avoid common pitfalls associated with reliability including incorrectly assuming that (a) measurement error always attenuates observed score correlations, (b) different sources of measurement error originate from the same source, and (c) reliability is a function of instrumentation. To accomplish our purpose, we first describe what reliability is and why researchers should care about it with focus on its impact on effect sizes. Second, we review how reliability is assessed with comment on the consequences of cumulative measurement error. Third, we consider how researchers can use reliability generalization as a prescriptive method when designing their research studies to form hypotheses about whether or not reliability estimates will be acceptable given their sample and testing conditions. Finally, we discuss options that researchers may consider when faced with analyzing unreliable data. PMID:22518107

  17. DEVELOPING OF INDIVIDUAL INSTRUMENT PERFORMANCE ANXIETY SCALE: VALIDITY - RELIABILITY STUDY

    Directory of Open Access Journals (Sweden)

    Esra DALKIRAN

    2014-07-01

    Full Text Available The purpose of this study is to develop a scale unique to our culture, concerning  individual instrument performance anxiety of the students  who are getting instrument training  in the Department of Music Education. In the study, the descriptive research model is used and qualitative research techniques are utilized. The study population consists of the students attending the 23 universities which has Music Education Department. The sample of the study consists of 438 girls and 312 boys, totally 750 students  who are studying in the Department of Music Education of randomly selected 10 universities. As a result of the explanatory and confirmatory factor analyses that were performed, a one-dimensional structure consisting of 14 items was obtained. Also, t-scores and  the coefficient scores of total item correlation concerning the distinguishing power of the items, the difference in the scores of the set of lower and upper 27% was calculated, and it was observed that the items are distinguishing as a result of both analyses. Of the scale, Cronbach's alpha coefficient of internal consistency was calculated as .94, and test-retest reliability coefficient was calculated as .93. As a result, a valid and reliable assessment and evaluation instrument that measures the exam performance anxiety of the students studying in the Department of Music Education, has been developed.Extended AbstractsIntroductionAnxiety is a universal phenomenon which people experience once or a few times during lives. It was accepted as concern for the future or as an unpleasant emotional experience regarding probable hitches of the events (Di Tomasso & Gosch, 2002.In general, the occasions on which negative feelings are experienced cause anxiety to arise (Baltaş and Baltaş, 2000. People also feel anxious in dangerous situations. Anxiety may lead a person to be creative, while it may have hindering characteristics. Anxiety is that an individual considers him

  18. Human reliability assessment and probabilistic risk assessment

    International Nuclear Information System (INIS)

    Embrey, D.E.; Lucas, D.A.

    1989-01-01

    Human reliability assessment (HRA) is used within Probabilistic Risk Assessment (PRA) to identify the human errors (both omission and commission) which have a significant effect on the overall safety of the system and to quantify the probability of their occurrence. There exist a variey of HRA techniques and the selection of an appropriate one is often difficult. This paper reviews a number of available HRA techniques and discusses their strengths and weaknesses. The techniques reviewed include: decompositional methods, time-reliability curves and systematic expert judgement techniques. (orig.)

  19. RICE: A Reliable and Efficient Remote Instrumentation Collaboration Environment

    Directory of Open Access Journals (Sweden)

    Prasad Calyam

    2008-01-01

    Full Text Available Remote access of scientific instruments over the Internet (i.e., remote instrumentation demand high-resolution (2D and 3D video image transfers with simultaneous real-time mouse and keyboard controls. Consequently, user quality of experience (QoE is highly sensitive to network bottlenecks. Further, improper user control while reacting to impaired video caused due to network bottlenecks could result in physical damages to the expensive instrument equipment. Hence, it is vital to understand the interplay between (a user keyboard/mouse actions toward the instrument, and (b corresponding network reactions for transfer of instrument video images toward the user. In this paper, we first present an analytical model for characterizing user and network interplay during remote instrumentation sessions in terms of demand and supply interplay principles of traditional economics. Next, we describe the trends of the model parameters using subjective and objective measurements obtained from QoE experiments. Thereafter, we describe our Remote Instrumentation Collaboration Environment (RICE software that leverages our experiences from the user and network interplay studies, and has functionalities that facilitate reliable and efficient remote instrumentation such as (a network health awareness to detect network bottleneck periods, and (b collaboration tools for multiple participants to interact during research and training sessions.

  20. Interactive reliability assessment using an integrated reliability data bank

    International Nuclear Information System (INIS)

    Allan, R.N.; Whitehead, A.M.

    1986-01-01

    The logical structure, techniques and practical application of a computer-aided technique based on a microcomputer using floppy disc Random Access Files is described. This interactive computational technique is efficient if the reliability prediction program is coupled directly to a relevant source of data to create an integrated reliability assessment/reliability data bank system. (DG)

  1. Operator reliability assessment system (OPERAS)

    International Nuclear Information System (INIS)

    Singh, A.; Spurgin, A.J.; Martin, T.; Welsch, J.; Hallam, J.W.

    1991-01-01

    OPERAS is a personal-computer (PC) based software to collect and process simulator data on control-room operators responses during requalification training scenarios. The data collection scheme is based upon approach developed earlier during the EPRI Operator Reliability Experiments project. The software allows automated data collection from simulator, thus minimizing simulator staff time and resources to collect, maintain and process data which can be useful in monitoring, assessing and enhancing the progress of crew reliability and effectiveness. The system is designed to provide the data and output information in the form of user-friendly charts, tables and figures for use by plant staff. OPERAS prototype software has been implemented at the Diablo Canyon (PWR) and Millstone (BWR) plants and is currently being used to collect operator response data. Data collected from similator include plant-state variables such as reactor pressure and temperature, malfunction, times at which annunciators are activated, operator actions and observations of crew behavior by training staff. The data and systematic analytical results provided by the OPERAS system can contribute to increase objectivity by the utility probabilistic risk analysis (PRA) and training staff in monitoring and assessing reliability of their crews

  2. A study examining inter-rater and intrarater reliability of a novel instrument for assessment of psoriasis: the Copenhagen Psoriasis Severity Index.

    NARCIS (Netherlands)

    Berth-Jones, J.; Thompson, J.; Papp, K.

    2008-01-01

    BACKGROUND: There is a perceived need for a better method for clinical assessment of the severity of psoriasis vulgaris. The most frequently used system is the Psoriasis Area and Severity Index (PASI), which has significant disadvantages, including the requirement for assessment of the percentage of

  3. Human reliability assessment in context

    International Nuclear Information System (INIS)

    Hollnagel, Erik

    2005-01-01

    Human Reliability Assessment (HRA) is conducted on the unspoken premise that 'human error' is a meaningful concept and that it can be associated with individual actions. The basis for this assumption it found in the origin of HRA, as a necessary extension of PSA to account for the impact of failures emanating from human actions. Although it was natural to model HRA on PSA, a large number of studies have shown that the premises are wrong, specifically that human and technological functions cannot be decomposed in the same manner. The general experience from accident studies also indicates that action failures are a function of the context, and that it is the variability of the context rather than the 'human error probability' that is the much sought for signal. Accepting this will have significant consequences for the way in which HRA, and ultimately also PSA, should be pursued

  4. Vitiligo Area Scoring Index and Vitiligo European Task Force assessment: reliable and responsive instruments to measure the degree of depigmentation in vitiligo

    NARCIS (Netherlands)

    Komen, L.; da Graça, V.; Wolkerstorfer, A.; de Rie, M. A.; Terwee, C. B.; van der Veen, J. P. W.

    2015-01-01

    Background Vitiligo is a common skin disorder causing depigmented macules that can impair a patient's quality of life. Currently, there are no standardized outcome measures to assess the degree of depigmentation. Moreover, there is limited knowledge on the measurement properties of outcome measures

  5. Test - retest reliability of two instruments for measuring public attitudes towards persons with mental illness

    Directory of Open Access Journals (Sweden)

    Leufstadius Christel

    2011-01-01

    Full Text Available Abstract Background Research has identified stigmatization as a major threat to successful treatment of individuals with mental illness. As a consequence several anti-stigma campaigns have been carried out. The results have been discouraging and the field suffers from lack of evidence about interventions that work. There are few reports on psychometric data for instruments used to assess stigma, which thus complicates research efforts. The aim of the present study was to investigate test-retest reliability of the Swedish versions of the questionnaires: FABI and "Changing Minds" and to examine the internal consistency of the two instruments. Method Two instruments, fear and behavioural intentions (FABI and "Changing Minds", used in earlier studies on public attitudes towards persons with mental illness were translated into Swedish and completed by 51 nursing students on two occasions, with an interval of three weeks. Test-retest reliability was calculated by using weighted kappa coefficient and internal consistency using the Cronbach's alpha coefficient. Results Both instruments attain at best moderate test-retest reliability. For the Changing Minds questionnaire almost one fifth (17.9% of the items present poor test-retest reliability and the alpha coefficient for the subscales ranges between 0.19 - 0.46. All of the items in the FABI reach a fair or a moderate agreement between the test and retest, and the questionnaire displays a high internal consistency, alpha 0.80. Conclusions There is a need for development of psychometrically tested instruments within this field of research.

  6. Rater reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS).

    Science.gov (United States)

    Baker, Nancy A; Cook, James R; Redfern, Mark S

    2009-01-01

    This paper describes the inter-rater and intra-rater reliability, and the concurrent validity of an observational instrument, the Keyboard Personal Computer Style instrument (K-PeCS), which assesses stereotypical postures and movements associated with computer keyboard use. Three trained raters independently rated the video clips of 45 computer keyboard users to ascertain inter-rater reliability, and then re-rated a sub-sample of 15 video clips to ascertain intra-rater reliability. Concurrent validity was assessed by comparing the ratings obtained using the K-PeCS to scores developed from a 3D motion analysis system. The overall K-PeCS had excellent reliability [inter-rater: intra-class correlation coefficients (ICC)=.90; intra-rater: ICC=.92]. Most individual items on the K-PeCS had from good to excellent reliability, although six items fell below ICC=.75. Those K-PeCS items that were assessed for concurrent validity compared favorably to the motion analysis data for all but two items. These results suggest that most items on the K-PeCS can be used to reliably document computer keyboarding style.

  7. Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

    Science.gov (United States)

    Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

    2015-05-01

    The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

  8. Using Google Earth to conduct a neighborhood audit: reliability of a virtual audit instrument.

    Science.gov (United States)

    Clarke, Philippa; Ailshire, Jennifer; Melendez, Robert; Bader, Michael; Morenoff, Jeffrey

    2010-11-01

    Over the last two decades, the impact of community characteristics on the physical and mental health of residents has emerged as an important frontier of research in population health and health disparities. However, the development and evaluation of measures to capture community characteristics is still at a relatively early stage. The purpose of this work was to assess the reliability of a neighborhood audit instrument administered in the city of Chicago using Google Street View by comparing these "virtual" data to those obtained from an identical instrument administered "in-person". We find that a virtual audit instrument can provide reliable indicators of recreational facilities, the local food environment, and general land use. However, caution should be exercised when trying to gather more finely detailed observations. Using the internet to conduct a neighborhood audit has the potential to significantly reduce the costs of collecting data objectively and unobtrusively. Copyright © 2010 Elsevier Ltd. All rights reserved.

  9. The Children's Play Therapy Instrument (CPTI): Description, Development, and Reliability Studies

    Science.gov (United States)

    Kernberg, Paulina F.; Chazan, Saralea E.; Normandin, Lina

    1998-01-01

    The Children's Play Therapy Instrument (CPTI), its development, and reliability studies are described. The CPTI is a new instrument to examine a child's play activity in individual psychotherapy. Three independent raters used the CPTI to rate eight videotaped play therapy vignettes. Results were compared with the authors' consensual scores from a preliminary study. Generally good to excellent levels of interrater reliability were obtained for the independent raters on intraclass correlation coefficients for ordinal categories of the CPTI. Likewise, kappa levels were acceptable to excellent for nominal categories of the scale. The CPTI holds promise to become a reliable measure of play activity in child psychotherapy. Further research is needed to assess discriminant validity of the CPTI for use as a diagnostic tool and as a measure of process and outcome.(The Journal of Psychotherapy Practice and Research 1998; 7:196–207) PMID:9631341

  10. The Children's Play Therapy Instrument (CPTI). Description, development, and reliability studies.

    Science.gov (United States)

    Kernberg, P F; Chazan, S E; Normandin, L

    1998-01-01

    The Children's Play Therapy Instrument (CPTI), its development, and reliability studies are described. The CPTI is a new instrument to examine a child's play activity in individual psychotherapy. Three independent raters used the CPTI to rate eight videotaped play therapy vignettes. Results were compared with the authors' consensual scores from a preliminary study. Generally good to excellent levels of interrater reliability were obtained for the independent raters on intraclass correlation coefficients for ordinal categories of the CPTI. Likewise, kappa levels were acceptable to excellent for nominal categories of the scale. The CPTI holds promise to become a reliable measure of play activity in child psychotherapy. Further research is needed to assess discriminant validity of the CPTI for use as a diagnostic tool and as a measure of process and outcome.

  11. Structural reliability assessment capability in NESSUS

    Science.gov (United States)

    Millwater, H.; Wu, Y.-T.

    1992-07-01

    The principal capabilities of NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), an advanced computer code developed for probabilistic structural response analysis, are reviewed, and its structural reliability assessed. The code combines flexible structural modeling tools with advanced probabilistic algorithms in order to compute probabilistic structural response and resistance, component reliability and risk, and system reliability and risk. An illustrative numerical example is presented.

  12. Reliability assessments in qualitative health promotion research.

    Science.gov (United States)

    Cook, Kay E

    2012-03-01

    This article contributes to the debate about the use of reliability assessments in qualitative research in general, and health promotion research in particular. In this article, I examine the use of reliability assessments in qualitative health promotion research in response to health promotion researchers' commonly held misconception that reliability assessments improve the rigor of qualitative research. All qualitative articles published in the journal Health Promotion International from 2003 to 2009 employing reliability assessments were examined. In total, 31.3% (20/64) articles employed some form of reliability assessment. The use of reliability assessments increased over the study period, ranging from qualitative articles decreased. The articles were then classified into four types of reliability assessments, including the verification of thematic codes, the use of inter-rater reliability statistics, congruence in team coding and congruence in coding across sites. The merits of each type were discussed, with the subsequent discussion focusing on the deductive nature of reliable thematic coding, the limited depth of immediately verifiable data and the usefulness of such studies to health promotion and the advancement of the qualitative paradigm.

  13. Can Reliability of Multiple Component Measuring Instruments Depend on Response Option Presentation Mode?

    Science.gov (United States)

    Menold, Natalja; Raykov, Tenko

    2016-01-01

    This article examines the possible dependency of composite reliability on presentation format of the elements of a multi-item measuring instrument. Using empirical data and a recent method for interval estimation of group differences in reliability, we demonstrate that the reliability of an instrument need not be the same when polarity of the…

  14. The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

    Science.gov (United States)

    Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

    2017-01-12

    Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in

  15. Operator reliability assessment system (OPERAS)

    International Nuclear Information System (INIS)

    Spurgin, A.J.; Hallam, J.W.; Spurgin, J.P.; Singh, A.

    1991-01-01

    The paper gives an overview of the OPERAS project. It discusses the background which led to the design of the PC-based data collection and analysis system connected to plant training simulators including those used for nuclear power plants. The usefulness of a system like OPERAS was perceived during an earlier EPRI project, the Operator Reliability Experiments project, by EPRI and PG and E. The data collection and analysis approaches used in OPERAS were developed during the ORE project. The paper not only discusses the design of OPERAS but discusses the functions performed and the current experiences with the two prototype systems. Also listed are potential uses of OPERAS by utility personnel in Operations, Training and PRA groups

  16. Low-Budget Instrumentation of a Conventional Leg Press to Measure Reliable Isometric-Strength Capacity.

    Science.gov (United States)

    Baur, Heiner; Groppa, Alessia Severina; Limacher, Regula; Radlinger, Lorenz

    2016-02-02

    Maximum strength and rate of force development (RFD) are 2 important strength characteristics for everyday tasks and athletic performance. Measurements of both parameters must be reliable. Expensive isokinetic devices with isometric modes are often used. The possibility of cost-effective measurements in a practical setting would facilitate quality control. The purpose of this study was to assess the reliability of measurements of maximum isometric strength (Fmax) and RFD on a conventional leg press. Sixteen subjects (23 ± 2 y, 1.68 ± 0.05 m, 59 ± 5 kg) were tested twice within 1 session. After warm-up, subjects performed 2 times 5 trials eliciting maximum voluntary isometric contractions on an instrumented leg press (1- and 2-legged randomized). Fmax (N) and RFD (N/s) were extracted from force-time curves. Reliability was determined for Fmax and RFD by calculating the intraclass correlation coefficient (ICC), the test-retest variability (TRV), and the bias and limits of agreement. Reliability measures revealed good to excellent ICCs of .80-.93. TRV showed mean differences between measurement sessions of 0.4-6.9%. The systematic error was low compared with the absolute mean values (Fmax 5-6%, RFD 1-4%). The implementation of a force transducer into a conventional leg press provides a viable procedure to assess Fmax and RFD. Both performance parameters can be assessed with good to excellent reliability allowing quality control of interventions.

  17. Assessment of Work Performance (AWP)--development of an instrument.

    Science.gov (United States)

    Sandqvist, Jan L; Törnquist, Kristina B; Henriksson, Chris M

    2006-01-01

    Adequate work assessments are a matter of importance both for individuals and society [5,29,31,38,40,46,52]. However, there is a lack of adequate and reliable instruments for use in work rehabilitation [14,15,20,21,31,44]. The purpose of this study was to develop and evaluate an observation instrument for assessing work performance, the AWP (Assessment of Work Performance). The purpose of the 14-item instrument is to assess the individual's observable working skills in three different areas: motor skills, process skills, and communication and interaction skills. This article describes the development and results of preliminary testing of the AWP. The testing indicates a satisfactory face validity and utility for the AWP and supports further research and testing of the instrument.

  18. Reevaluating Interrater Reliability in Offender Risk Assessment

    NARCIS (Netherlands)

    van der Knaap, L.M.; Leenarts, L.E.W.; Born, M.P.; Oosterveld, P.

    2012-01-01

    Offender risk and needs assessment, one of the pillars of the risk-need-responsivity model of offender rehabilitation, usually depends on raters assessing offender risk and needs. The few available studies of interrater reliability in offender risk assessment are, however, limited in the

  19. Reevaluating Interrater Reliability in Offender Risk Assessment

    Science.gov (United States)

    van der Knaap, Leontien M.; Leenarts, Laura E. W.; Born, Marise Ph.; Oosterveld, Paul

    2012-01-01

    Offender risk and needs assessment, one of the pillars of the risk-need-responsivity model of offender rehabilitation, usually depends on raters assessing offender risk and needs. The few available studies of interrater reliability in offender risk assessment are, however, limited in the generalizability of their results. The present study…

  20. Validity and reliability of the Mastication Observation and Evaluation (MOE) instrument.

    Science.gov (United States)

    Remijn, Lianne; Speyer, Renée; Groen, Brenda E; van Limbeek, Jacques; Nijhuis-van der Sanden, Maria W G

    2014-07-01

    The Mastication Observation and Evaluation (MOE) instrument was developed to allow objective assessment of a child's mastication process. It contains 14 items and was developed over three Delphi rounds. The present study concerns the further development of the MOE using the COSMIN (Consensus based Standard for the Selection of Measurement Instruments) and investigated the instrument's internal consistency, inter-observer reliability, construct validity and floor and ceiling effects. Consumption of three bites of bread and biscuit was evaluated using the MOE. Data of 59 healthy children (6-48 mths) and 38 children (bread) and 37 children (biscuit) with cerebral palsy (24-72 mths) were used. Four items were excluded before analysis due to zero variance. Principal Components Analysis showed one factor with 8 items. Internal consistency was >0.70 (Chronbach's alpha) for both food consistencies and for both groups of children. Inter-observer reliability varied from 0.51 to 0.98 (weighted Gwet's agreement coefficient). The total MOE scores for both groups showed normal distribution for the population. There were no floor or ceiling effects. The revised MOE now contains 8 items that (a) have a consistent concept for mastication and can be scored on a 4-point scale with sufficient reliability and (b) are sensitive to stages of chewing development in young children. The removed items are retained as part of a criterion referenced list within the MOE. Copyright © 2014 Elsevier Ltd. All rights reserved.

  1. An approach for assessing human decision reliability

    International Nuclear Information System (INIS)

    Pyy, P.

    2000-01-01

    This paper presents a method to study human reliability in decision situations related to nuclear power plant disturbances. Decisions often play a significant role in handling of emergency situations. The method may be applied to probabilistic safety assessments (PSAs) in cases where decision making is an important dimension of an accident sequence. Such situations are frequent e.g. in accident management. In this paper, a modelling approach for decision reliability studies is first proposed. Then, a case study with two decision situations with relatively different characteristics is presented. Qualitative and quantitative findings of the study are discussed. In very simple decision cases with time pressure, time reliability correlation proved out to be a feasible reliability modelling method. In all other decision situations, more advanced probabilistic decision models have to be used. Finally, decision probability assessment by using simulator run results and expert judgement is presented

  2. Assessing reliability in energy supply systems

    International Nuclear Information System (INIS)

    McCarthy, Ryan W.; Ogden, Joan M.; Sperling, Daniel

    2007-01-01

    Reliability has always been a concern in the energy sector, but concerns are escalating as energy demand increases and the political stability of many energy supply regions becomes more questionable. But how does one define and measure reliability? We introduce a method to assess reliability in energy supply systems in terms of adequacy and security. It derives from reliability assessment frameworks developed for the electricity sector, which are extended to include qualitative considerations and to be applicable to new energy systems by incorporating decision-making processes based on expert opinion and multi-attribute utility theory. The method presented here is flexible and can be applied to any energy system. To illustrate its use, we apply the method to two hydrogen pathways: (1) centralized steam reforming of imported liquefied natural gas with pipeline distribution of hydrogen, and (2) on-site electrolysis of water using renewable electricity produced independently from the electricity grid

  3. Reliability assessment based on subjective inferences

    International Nuclear Information System (INIS)

    Ma Zhibo; Zhu Jianshi; Xu Naixin

    2003-01-01

    The reliability information which comes from subjective analysis is often incomplete prior. This information can be generally assumed to exist in the form of either a stated prior mean of R (reliability) or a stated prior credibility interval on R. An efficient approach is developed to determine a complete beta prior distribution from the subjective information according to the principle of maximum entropy, and the the reliability of survival/failure product is assessed via Bayes theorem. Numerical examples are presented to illustrate the methods

  4. An Exploratory Factor Analysis and Reliability Analysis of the Student Online Learning Readiness (SOLR) Instrument

    Science.gov (United States)

    Yu, Taeho; Richardson, Jennifer C.

    2015-01-01

    The purpose of this study was to develop an effective instrument to measure student readiness in online learning with reliable predictors of online learning success factors such as learning outcomes and learner satisfaction. The validity and reliability of the Student Online Learning Readiness (SOLR) instrument were tested using exploratory factor…

  5. Reliability of the Q Force; a mobile instrument for measuring isometric quadriceps muscle strength.

    Science.gov (United States)

    Douma, K W; Regterschot, G R H; Krijnen, W P; Slager, G E C; van der Schans, C P; Zijlstra, W

    2016-01-01

    The ability to generate muscle strength is a pre-requisite for all human movement. Decreased quadriceps muscle strength is frequently observed in older adults and is associated with a decreased performance and activity limitations. To quantify the quadriceps muscle strength and to monitor changes over time, instruments and procedures with a sufficient reliability are needed. The Q Force is an innovative mobile muscle strength measurement instrument suitable to measure in various degrees of extension. Measurements between 110 and 130° extension present the highest values and the most significant increase after training. The objective of this study is to determine the test-retest reliability of muscle strength measurements by the Q Force in older adults in 110° extension. Forty-one healthy older adults, 13 males and 28 females were included in the study. Mean (SD) age was 81.9 (4.89) years. Isometric muscle strength of the Quadriceps muscle was assessed with the Q Force at 110° of knee extension. Participants were measured at two sessions with a three to eight day interval between sessions. To determine relative reliability, the intraclass correlation coefficient (ICC) was calculated. To determine absolute reliability, Bland and Altman Limits of Agreement (LOA) were calculated and t-tests were performed. Relative reliability of the Q Force is good to excellent as all ICC coefficients are higher than 0.75. Generally a large 95 % LOA, reflecting only moderate absolute reliability, is found as exemplified for the peak torque left leg of -18.6 N to 33.8 N and the right leg of -9.2 N to 26.4 N was between 15.7 and 23.6 Newton representing 25.2 % to 39.9 % of the size of the mean. Small systematic differences in mean were found between measurement session 1 and 2. The present study shows that the Q Force has excellent relative test-retest reliability, but limited absolute test-retest reliability. Since the Q Force is relatively cheap and mobile it is suitable for

  6. Human reliability. Is probabilistic human reliability assessment possible?

    International Nuclear Information System (INIS)

    Mosneron Dupin, F.

    1996-01-01

    The possibility of carrying out Probabilistic Human Reliability Assessments (PHRA) is often doubted. Basing ourselves on the experience Electricite de France (EDF) has acquired in Probabilistic Safety Assessments for nuclear power plants, we show why the uncertainty of PHRA is very high. We then specify the limits of generic data and models for PHRA: very important factors are often poorly taken into account. To account for them, you need to have proper understanding of the actual context in which operators work. This demands surveys on the field (power plant and simulator) all of which must be carried out with behaviours science skills. The idea of estimating the probabilities of operator failure must not be abandoned, but probabilities must be given less importance, for they are only approximate indications. The qualitative aspects of PHRA should be given greater value (analysis process and qualitative insights). That is why the description (illustrated by case histories) of the main mechanisms of human behaviour, and of their manifestations in the nuclear power plant context (in terms of habits, attitudes, and informal methods and organization in particular) should be an important part of PHRA handbooks. These handbooks should also insist more on methods for gathering information on the actual context of the work of operators. Under these conditions, the PHRA should be possible and even desirable as a process for systematic analysis and assessment of human intervention. (author). 24 refs, 2 figs, 1 tab

  7. Human reliability. Is probabilistic human reliability assessment possible?

    Energy Technology Data Exchange (ETDEWEB)

    Mosneron Dupin, F

    1997-12-31

    The possibility of carrying out Probabilistic Human Reliability Assessments (PHRA) is often doubted. Basing ourselves on the experience Electricite de France (EDF) has acquired in Probabilistic Safety Assessments for nuclear power plants, we show why the uncertainty of PHRA is very high. We then specify the limits of generic data and models for PHRA: very important factors are often poorly taken into account. To account for them, you need to have proper understanding of the actual context in which operators work. This demands surveys on the field (power plant and simulator) all of which must be carried out with behaviours science skills. The idea of estimating the probabilities of operator failure must not be abandoned, but probabilities must be given less importance, for they are only approximate indications. The qualitative aspects of PHRA should be given greater value (analysis process and qualitative insights). That is why the description (illustrated by case histories) of the main mechanisms of human behaviour, and of their manifestations in the nuclear power plant context (in terms of habits, attitudes, and informal methods and organization in particular) should be an important part of PHRA handbooks. These handbooks should also insist more on methods for gathering information on the actual context of the work of operators. Under these conditions, the PHRA should be possible and even desirable as a process for systematic analysis and assessment of human intervention. (author). 24 refs, 2 figs, 1 tab.

  8. Introduction: The effectiveness of impact assessment instruments

    OpenAIRE

    Cashmore, M; Bond, A; Sadler, B

    2009-01-01

    The global application of impact assessment instruments to achieve a variety of policy integration goals (e.g. the mainstreaming of environmental, gender or economic efficiency concerns) continues to proliferate. These instruments represent important components of contemporary political governance and hence are an important locus for applied research. This special issue of Impact Assessment and Project Appraisal critically examines 'state-of-the-art' knowledge and understanding of the effecti...

  9. Developing of Individual Instrument Performance Anxiety Scale: ValidityReliability Study

    Directory of Open Access Journals (Sweden)

    Esra DALKIRAN

    2016-07-01

    Full Text Available In this study, it is intended to develop a scale unique to our culture, concerning individual instrument performance anxiety of the students who are getting instrument training in the Department of Music Education. In the study, the descriptive research model is used and qualitative research techniques are utilized. The study population consists of the students attending the 23 universities which has Music Education Department. The sample of the study consists of 438 girls and 312 boys, totally 750 students who are studying in the Department of Music Education of randomly selected 10 universities. As a result of the explanatory and confirmatory factor analyses that were performed, a onedimensional structure consisting of 14 items was obtained. Also, t-scores and the coefficient scores of total item correlation concerning the distinguishing power of the items, the difference in the scores of the set of lower and upper 27% was calculated, and it was observed that the items are distinguishing as a result of both analyses. Of the scale, Cronbach's alpha coefficient of internal consistency was calculated as .94, and test-retest reliability coefficient was calculated as .93. As a result, a valid and reliable assessment and evaluation instrument that measures the exam performance anxiety of the students studying in the Department of Music Education, has been developed.

  10. Reliability of patient specific instrumentation in total knee arthroplasty.

    Science.gov (United States)

    Jennart, Harold; Ngo Yamben, Marie-Ange; Kyriakidis, Theofylaktos; Zorman, David

    2015-12-01

    The aim of this study was to compare the precision between Patient Specific Instrumentation (PSI) and Conventional Instrumentation (CI) as determined intra-operatively by a pinless navigation system. Eighty patients were included in this prospective comparative study and they were divided into two homogeneous groups. We defined an original score from 6 to 30 points to evaluate the accuracy of the position of the cutting guides. This score is based on 6 objective criteria. The analysis indicated that PSI was not superior to conventional instrumentation in the overall score (p = 0.949). Moreover, no statistically significant difference was observed for any individual criteria of our score. Level of evidence II.

  11. System 80+ instrumentation and controls - certification of a reliable design

    International Nuclear Information System (INIS)

    Matzie, R.A.; Scarola, K.; Turk, R.S.

    1993-01-01

    ABB Combustion Engineering's (ABB) System 80+ advanced light water plant design includes a modern, fully digitized instrumentation and controls complex, Nuplex 80+. This complex incorporates an evolutionary advanced control room, replacing conventional analog instruments with more capable computer driven components. As a result, Nuplex 80+ results in significant improvements in operator information handling and control to enhance plant safety and availability. The design implements features which the U.S. NRC has determined to be acceptable for addressing the potential for common mode failure in software implemented for protective functions. (author)

  12. Intelligence Assessment Instruments in Adult Prison Populations: A Systematic Review.

    Science.gov (United States)

    van Esch, A Y M; Denzel, A D; Scherder, E J A; Masthoff, E D M

    2017-10-01

    Detection of intellectual disability (ID) in the penitentiary system is important for the following reasons: (a) to provide assistance to people with ID in understanding their legal rights and court proceedings; (b) to facilitate rehabilitation programs tailored to ID patients, which improves the enhancement of their quality of life and reduces their risk of reoffending; and (c) to provide a reliable estimate of the risk of offence recidivism. It requires a short assessment instrument that provides a reliable estimation of a person's intellectual functioning at the earliest possible stage of this process. The aim of this systematic review is (a) to provide an overview of recent short assessment instruments that provide a full-scale IQ score in adult prison populations and (b) to achieve a quality measurement of the validation studies regarding these instruments to determine which tests are most feasible in this target population. The Preferred Reporting Items for Systematic reviews and Meta-Analyses Statement is used to ensure reliability. The Satz-Mögel, an item-reduction short form of the Wechsler Adult Intelligence Scale, shows the highest correlation with the golden standard and is described to be most reliable. Nevertheless, when it comes to applicability in prison populations, the shorter and less verbal Quick Test can be preferred over others. Without affecting these conclusions, major limitations emerge from the present systematic review, which give rise to several important recommendations for further research.

  13. Clinical reliability and validity of elbow functional assessment in rheumatoid arthritis.

    NARCIS (Netherlands)

    Boer, Y.A. de; Ende, C.H.M. van den; Eygendaal, D.; Jolie, I.M.M.; Hazes, J.M.W.; Rozing, P.M.

    1999-01-01

    OBJECTIVES: (1) To investigate the measurement characteristics of the Hospital for Special Surgery (HSS) and Mayo Clinic elbow assessment instruments, utilizing methodological criteria including feasibility, reliability, validity, and discriminative ability; and (2) to develop an efficient and

  14. Automated reliability assessment for spectroscopic redshift measurements

    Science.gov (United States)

    Jamal, S.; Le Brun, V.; Le Fèvre, O.; Vibert, D.; Schmitt, A.; Surace, C.; Copin, Y.; Garilli, B.; Moresco, M.; Pozzetti, L.

    2018-03-01

    Context. Future large-scale surveys, such as the ESA Euclid mission, will produce a large set of galaxy redshifts (≥106) that will require fully automated data-processing pipelines to analyze the data, extract crucial information and ensure that all requirements are met. A fundamental element in these pipelines is to associate to each galaxy redshift measurement a quality, or reliability, estimate. Aim. In this work, we introduce a new approach to automate the spectroscopic redshift reliability assessment based on machine learning (ML) and characteristics of the redshift probability density function. Methods: We propose to rephrase the spectroscopic redshift estimation into a Bayesian framework, in order to incorporate all sources of information and uncertainties related to the redshift estimation process and produce a redshift posterior probability density function (PDF). To automate the assessment of a reliability flag, we exploit key features in the redshift posterior PDF and machine learning algorithms. Results: As a working example, public data from the VIMOS VLT Deep Survey is exploited to present and test this new methodology. We first tried to reproduce the existing reliability flags using supervised classification in order to describe different types of redshift PDFs, but due to the subjective definition of these flags (classification accuracy 58%), we soon opted for a new homogeneous partitioning of the data into distinct clusters via unsupervised classification. After assessing the accuracy of the new clusters via resubstitution and test predictions (classification accuracy 98%), we projected unlabeled data from preliminary mock simulations for the Euclid space mission into this mapping to predict their redshift reliability labels. Conclusions: Through the development of a methodology in which a system can build its own experience to assess the quality of a parameter, we are able to set a preliminary basis of an automated reliability assessment for

  15. Evaluating the effectiveness of impact assessment instruments

    DEFF Research Database (Denmark)

    Cashmore, Matthew; Richardson, Tim; Hilding-Ryedvik, Tuija

    2010-01-01

    to sharpen effectiveness evaluation theory for impact assessment instruments this article critically examines the neglected issue of their political constitution. Analytical examples are used to concretely explore the nature and significance of the politicisation of impact assessment. It is argued......The central role of impact assessment instruments globally in policy integration initiatives has been cemented in recent years. Associated with this trend, but also reflecting political emphasis on greater accountability in certain policy sectors and a renewed focus on economic competitiveness...... that raising awareness about the political character of impact assessment instruments, in itself, is a vital step in advancing effectiveness evaluation theory. Broader theoretical lessons on the framing of evaluation research are also drawn from the political analysis. We conclude that, at least within...

  16. Assessment of the Reliability of Concrete Bridges

    DEFF Research Database (Denmark)

    Middleton, C. R.; Thoft-Christensen, Palle

    Although there has been a considerable amount of research into different aspects of concrete bridge reliability, it has still not been widely adopted in professional practice other than in the development and calibration of codes. This situation appears to be changing as there has been a signific......Although there has been a considerable amount of research into different aspects of concrete bridge reliability, it has still not been widely adopted in professional practice other than in the development and calibration of codes. This situation appears to be changing as there has been...... adopted to assist in achieving this goal. Rather than review the specific research on this subject this paper examines a number of key issues related to the practical application of reliability analysis to the assessment of concrete bridges....

  17. Global impression of perceived difficulties in children and adolescents with attention-deficit/hyperactivity disorder: Reliability and validity of a new instrument assessing perceived difficulties from a patient, parent and physician perspective over the day

    Directory of Open Access Journals (Sweden)

    Dittmann Ralf W

    2008-05-01

    Full Text Available Abstract Background The objective of this analysis was to evaluate the psychometric properties of a brief scale developed to assess the degree of difficulties in children with Attention-Deficit/Hyperactivity Disorder (ADHD. The Global Impression of Perceived Difficulties (GIPD scale reflects overall impairment, psychosocial functioning and Quality of Life (QoL as rated by patient, parents and physician at various times of the day. Methods In two open-label studies, ADHD-patients aged 6–17 years were treated with atomoxetine (target-dose 0.5–1.2 mg/kg/day. ADHD-related difficulties were assessed up to week 24 using the GIPD. Data from both studies were combined to validate the scale. Results Overall, 421 patients received atomoxetine. GIPD scores improved over time. All three GIPD-versions (patient, parent, physician were internally consistent; all items showed at least moderate item-total correlation. The scale showed good test-retest reliability over a two-week period from all three perspectives. Good convergent and discriminant validity was shown. Conclusion GIPD is an internally consistent, reliable and valid measure to assess difficulties in children with ADHD at various times of the day and can be used as indicator for psychosocial impairment and QoL. The scale is sensitive to treatment-related change.

  18. Reliability analysis and assessment of structural systems

    International Nuclear Information System (INIS)

    Yao, J.T.P.; Anderson, C.A.

    1977-01-01

    The study of structural reliability deals with the probability of having satisfactory performance of the structure under consideration within any specific time period. To pursue this study, it is necessary to apply available knowledge and methodology in structural analysis (including dynamics) and design, behavior of materials and structures, experimental mechanics, and the theory of probability and statistics. In addition, various severe loading phenomena such as strong motion earthquakes and wind storms are important considerations. For three decades now, much work has been done on reliability analysis of structures, and during this past decade, certain so-called 'Level I' reliability-based design codes have been proposed and are in various stages of implementation. These contributions will be critically reviewed and summarized in this paper. Because of the undesirable consequences resulting from the failure of nuclear structures, it is important and desirable to consider the structural reliability in the analysis and design of these structures. Moreover, after these nuclear structures are constructed, it is desirable for engineers to be able to assess the structural reliability periodically as well as immediately following the occurrence of severe loading conditions such as a strong-motion earthquake. During this past decade, increasing use has been made of techniques of system identification in structural engineering. On the basis of non-destructive test results, various methods have been developed to obtain an adequate mathematical model (such as the equations of motion with more realistic parameters) to represent the structural system

  19. Validación de un cuestionario para el estudio del comportamiento sexual, social y corporal, de adolescentes escolares Validity and reliability of an instrument for assessing the social, and corporal sexual behaviors among school adolescents

    Directory of Open Access Journals (Sweden)

    Alfredo Hidalgo-San Martín

    2003-01-01

    Full Text Available OBJETIVO: Validar un cuestionario autoadministrado de comportamientos sexuales, sociales y corporales para adolescentes por nivel escolar y género. MATERIAL Y MÉTODOS: Instrumento de 26 preguntas construido según DeVellis, aplicado en un estudio longitudinal prospectivo, hecho en 1994 a 1 243 alumnos y alumnas de secundaria y preparatoria en Guadalajara, Jalisco, México. Validez de constructo establecida por análisis factorial exploratorio y la confiabilidad por la prueba Alfa de Cronbach. RESULTADOS: Aparecen cinco factores en hombres usando valores propios (eigenvalue >1 y cinco en mujeres, forzando la mejor solución. Veinte factores explican entre 59.3 y 70.6% de varianza, con promedio de pesos factoriales de 0.63- 0.75, y con 13 factores diferentes. El promedio de Alfa de Cronbach fue de 0.87-0.93 y en 16 factores hubo valores de Alpha de 0.71 o más. CONCLUSIONES: Cuestionario para poblaciones equivalentes con validez de constructo y confiabilidad interna aceptables.OBJECTIVE: To validate a self-administered questionnaire about social and corporal sexual behaviors among adolescents, by school level and gender. MATERIAL AND METHODS: The data collection instrument was constructed according to DeVellis and consisted of 26 items. It was used in a prospective longitudinal study conducted in 1994 in Guadalajara, Mexico, among 1243 secondary and high school students. The construct validity of the instrument was established using exploratory factorial analysis, and its reliability using the Cronbach's alpha test. RESULTS: Five factors were obtained in males and an equal number in women, using eigenvalues >1 and by forcing the best solution. The explained variance was 59.3-70.6%; the factorial weight average was 0.63-0.75, and 13 different factors were selected. The Cronbach's alpha mean was 0.87-0.93 and 16 factors had Cronbach's alpha over 0.70. CONCLUSIONS: The instrumen has an acceptable validity and reliability for studying the sexual

  20. Reliability

    OpenAIRE

    Condon, David; Revelle, William

    2017-01-01

    Separating the signal in a test from the irrelevant noise is a challenge for all measurement. Low test reliability limits test validity, attenuates important relationships, and can lead to regression artifacts. Multiple approaches to the assessment and improvement of reliability are discussed. The advantages and disadvantages of several different approaches to reliability are considered. Practical advice on how to assess reliability using open source software is provided.

  1. Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

    Science.gov (United States)

    Erkin, Özüm; Göl, İlknur

    2018-04-01

    This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

  2. Methodology for reliability based condition assessment

    International Nuclear Information System (INIS)

    Mori, Y.; Ellingwood, B.

    1993-08-01

    Structures in nuclear power plants may be exposed to aggressive environmental effects that cause their strength to decrease over an extended period of service. A major concern in evaluating the continued service for such structures is to ensure that in their current condition they are able to withstand future extreme load events during the intended service life with a level of reliability sufficient for public safety. This report describes a methodology to facilitate quantitative assessments of current and future structural reliability and performance of structures in nuclear power plants. This methodology takes into account the nature of past and future loads, and randomness in strength and in degradation resulting from environmental factors. An adaptive Monte Carlo simulation procedure is used to evaluate time-dependent system reliability. The time-dependent reliability is sensitive to the time-varying load characteristics and to the choice of initial strength and strength degradation models but not to correlation in component strengths within a system. Inspection/maintenance strategies are identified that minimize the expected future costs of keeping the failure probability of a structure at or below an established target failure probability during its anticipated service period

  3. Reliability and validity of instruments measuring job satisfaction - a systematic review

    NARCIS (Netherlands)

    van Saane, N.; Sluiter, J. K.; Verbeek, J. H. A. M.; Frings-Dresen, M. H. W.

    2003-01-01

    Background Although job satisfaction research has been carried out for decades, no recent overview of job satisfaction instruments and their quality is available. Aim The aim of this systematic review is to select job satisfaction instruments of adequate reliability and validity for use as

  4. An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

    Science.gov (United States)

    Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

    2018-03-01

    Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

  5. Operational human performance reliability assessment (OHPRA)

    International Nuclear Information System (INIS)

    Haas, P.M.; Swanson, P.J.; Connelly, E.M.

    1993-01-01

    Operational Human Performance Reliability Assessment (OHPRA) is an approach for assessing human performance that is being developed in response to demands from modern process industries for practical and effective tools to assess and improve human performance, and therefore overall system performance and safety. The single most distinguishing feature of the approach is that is defines human performance in open-quotes operationalclose quotes terms. OHPRA is focused not on generation of human error probabilities, but on practical analysis of human performance to aid management in (1) identifying open-quotes fixableclose quotes problems and (2) providing input on the importance and nature of potential improvements. Development of the model in progress uses a unique approach for eliciting expert strategies for assessing performance. A PC-based model incorporating this expertise is planned. A preliminary version of the approach has already been used successfully to identify practical human performance problems in reactor and chemical process plant operations

  6. Development and testing of an assessment instrument for the formative peer review of significant event analyses.

    Science.gov (United States)

    McKay, J; Murphy, D J; Bowie, P; Schmuck, M-L; Lough, M; Eva, K W

    2007-04-01

    To establish the content validity and specific aspects of reliability for an assessment instrument designed to provide formative feedback to general practitioners (GPs) on the quality of their written analysis of a significant event. Content validity was quantified by application of a content validity index. Reliability testing involved a nested design, with 5 cells, each containing 4 assessors, rating 20 unique significant event analysis (SEA) reports (10 each from experienced GPs and GPs in training) using the assessment instrument. The variance attributable to each identified variable in the study was established by analysis of variance. Generalisability theory was then used to investigate the instrument's ability to discriminate among SEA reports. Content validity was demonstrated with at least 8 of 10 experts endorsing all 10 items of the assessment instrument. The overall G coefficient for the instrument was moderate to good (G>0.70), indicating that the instrument can provide consistent information on the standard achieved by the SEA report. There was moderate inter-rater reliability (G>0.60) when four raters were used to judge the quality of the SEA. This study provides the first steps towards validating an instrument that can provide educational feedback to GPs on their analysis of significant events. The key area identified to improve instrument reliability is variation among peer assessors in their assessment of SEA reports. Further validity and reliability testing should be carried out to provide GPs, their appraisers and contractual bodies with a validated feedback instrument on this aspect of the general practice quality agenda.

  7. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology.

    Science.gov (United States)

    Cicchetti, Domenic V.

    1994-01-01

    In the context of developing assessment instruments in psychology, issues of standardization, norming procedures, and test reliability and validity are discussed. Criteria, guidelines, and rules of thumb are provided to help the clinician with instrument selection for a given psychological assessment. (SLD)

  8. the research quality plus (rq+) assessment instrument

    International Development Research Centre (IDRC) Digital Library (Canada)

    Thomas Schwandt

    THE RESEARCH QUALITY PLUS (RQ+) ASSESSMENT INSTRUMENT ... consistent way to allow for further meta-analysis about research quality over time. ... Addresses complex and integrative problems, requiring systems-based approaches ..... benefits or financial costs for participants that might not be appropriate in the ...

  9. Reliability assessment of nuclear structural systems

    International Nuclear Information System (INIS)

    Reich, M.; Hwang, H.

    1983-01-01

    Reliability assessment of nuclear structural systems has been receiving more emphasis over the last few years. This paper deals with the recent progress made by the Structural Analysis Division of Brookhaven National Laboratory (BNL), in the development of a probability-based reliability analysis methodology for safety evaluation of reactor containments and other seismic category I structures. An important feature of this methodology is the incorporation of finite element analysis and random vibration theory. By utilizing this method, it is possible to evaluate the safety of nuclear structures under various static and dynamic loads in terms of limit state probability. Progress in other related areas, such as the establishment of probabilistic characteristics for various loads and structural resistance, are also described. Results of an application of the methodology to a realistic reinforced concrete containment subjected to dead and live loads, accidental internal pressures and earthquake ground accelerations are presented

  10. Instruments to assess stigmatization in dermatology.

    Science.gov (United States)

    Dimitrov, Dimitre; Szepietowski, Jacek C

    2017-11-03

    Stigmatization is the assignment of negative perceptions to an individual because of a perceived difference from the population at large. Skin conditions are frequently the reason of social rejection with a consequent negative influence on the personal and social life of patients. The aim of the current study was to review the available instruments that can be successfully utilized to measure the stigmatization level among dermatological patients. We performed our search on PubMed up to November 2016 and utilized combinations of key phrases containing such words as stigmatization, skin, dermatology, names of various skin conditions (psoriasis, vitiligo, acne, etc.), measurement. The search found a considerable number of articles - 548. After filtering them through a precise selection process, 58 articles remained. We concentrated only on the methodological aspects to assess stigmatization in various dermatoses. The review ascertained that there exist numerous instruments in the form of questionnaires. They were utilized in various researches in order to assess the stigmatization level in patients with skin problems. We divided them into two main groups: dermatology specific instruments (6 questionnaires) and dermatosis/disease specific ones (8 questionnaires). It is recommended to use dermatology-specific instruments to compare the stigmatization level in various skin conditions. They can be utilized as well as a first line tools to study the feeling of stigmatization in specific skin diseases; however, where it is possible, they should be supplemented with the disease-specific instrument for deeper analysis of both qualities of life and stigmatization.

  11. Reliability assessment using Bayesian networks. Case study on quantative reliability estimation of a software-based motor protection relay

    International Nuclear Information System (INIS)

    Helminen, A.; Pulkkinen, U.

    2003-06-01

    In this report a quantitative reliability assessment of motor protection relay SPAM 150 C has been carried out. The assessment focuses to the methodological analysis of the quantitative reliability assessment using the software-based motor protection relay as a case study. The assessment method is based on Bayesian networks and tries to take the full advantage of the previous work done in a project called Programmable Automation System Safety Integrity assessment (PASSI). From the results and experiences achieved during the work it is justified to claim that the assessment method presented in the work enables a flexible use of qualitative and quantitative elements of reliability related evidence in a single reliability assessment. At the same time the assessment method is a concurrent way of reasoning one's beliefs and references about the reliability of the system. Full advantage of the assessment method is taken when using the method as a way to cultivate the information related to the reliability of software-based systems. The method can also be used as a communicational instrument in a licensing process of software-based systems. (orig.)

  12. Intrajudge and Interjudge Reliability of the Stuttering Severity Instrument-Fourth Edition.

    Science.gov (United States)

    Davidow, Jason H; Scott, Kathleen A

    2017-11-08

    The Stuttering Severity Instrument (SSI) is a tool used to measure the severity of stuttering. Previous versions of the instrument have known limitations (e.g., Lewis, 1995). The present study examined the intra- and interjudge reliability of the newest version, the Stuttering Severity Instrument-Fourth Edition (SSI-4) (Riley, 2009). Twelve judges who were trained on the SSI-4 protocol participated. Judges collected SSI-4 data while viewing 4 videos of adults who stutter at Time 1 and 4 weeks later at Time 2. Data were analyzed for intra- and interjudge reliability of the SSI-4 subscores (for Frequency, Duration, and Physical Concomitants), total score, and final severity rating. Intra- and interjudge reliability across the subscores and total score concurred with the manual's reported reliability when reliability was calculated using the methods described in the manual. New calculations of judge agreement produced different values from those in the manual-for the 3 subscores, total score, and final severity rating-and provided data absent from the manual. Clinicians and researchers who use the SSI-4 should carefully consider the limitations of the instrument. Investigation into the multitasking demands of the instrument may provide information on whether separating the collection of data for specific variables will improve intra- and interjudge reliability of those variables.

  13. Human reliability in probabilistic safety assessments

    International Nuclear Information System (INIS)

    Nunez Mendez, J.

    1989-01-01

    Nowadays a growing interest in medioambiental aspects is detected in our country. It implies an assessment of the risk involved in the industrial processess and installations in order to determine if those are into the acceptable limits. In these safety assessments, among which PSA (Probabilistic Safety Assessments), can be pointed out the role played by the human being in the system is one of the more relevant subjects. (This relevance has been demostrated in the accidents happenned). However in Spain there aren't manuals specifically dedicated to asses the human contribution to risk in the frame of PSAs. This report aims to improve this situation providing: a) a theoretical background to help the reader in the understanding of the nature of the human error, b) a guide to carry out a Human Reliability Analysis and c) a selected overwiev of the techniques and methodologies currently applied in this area. (Author)

  14. Human Reliability in Probabilistic Safety Assessments

    International Nuclear Information System (INIS)

    Nunez Mendez, J.

    1989-01-01

    Nowadays a growing interest in environmental aspects is detected in our country. It implies an assessment of the risk involved in the industrial processes and installations in order to determine if those are into the acceptable limits. In these safety assessments, among which PSA (Probabilistic Safety Assessments), can be pointed out the role played by the human being in the system is one of the more relevant subjects (This relevance has been demonstrated in the accidents happened) . However, in Spain there aren't manuals specifically dedicated to asses the human contribution to risk in the frame of PSAs. This report aims to improve this situation providing: a) a theoretical background to help the reader in the understanding of the nature of the human error, b) a quid to carry out a Human Reliability Analysis and c) a selected overview of the techniques and methodologies currently applied in this area. (Author) 20 refs

  15. Incorporation of Markov reliability models for digital instrumentation and control systems into existing PRAs

    International Nuclear Information System (INIS)

    Bucci, P.; Mangan, L. A.; Kirschenbaum, J.; Mandelli, D.; Aldemir, T.; Arndt, S. A.

    2006-01-01

    Markov models have the ability to capture the statistical dependence between failure events that can arise in the presence of complex dynamic interactions between components of digital instrumentation and control systems. One obstacle to the use of such models in an existing probabilistic risk assessment (PRA) is that most of the currently available PRA software is based on the static event-tree/fault-tree methodology which often cannot represent such interactions. We present an approach to the integration of Markov reliability models into existing PRAs by describing the Markov model of a digital steam generator feedwater level control system, how dynamic event trees (DETs) can be generated from the model, and how the DETs can be incorporated into an existing PRA with the SAPHIRE software. (authors)

  16. Student Precision and Reliability of the Team Sport Assessment in ...

    African Journals Online (AJOL)

    TSAP) and formative assessment of invasion sport. The specific objectives were to determine the degree of agreement among expert observers, inter-observer reliability (internal consistency), and intra observer reliability (temporal reliability).

  17. Analysis of the Reliability and Validity of a Mentor's Assessment for Principal Internships

    Science.gov (United States)

    Koonce, Glenn L.; Kelly, Michael D.

    2014-01-01

    In this study, researchers analyzed the reliability and validity of the mentor's assessment for principal internships at a university in the Southeast region of the United States. The results of the study yielded how trustworthy and dependable the instrument is and the effectiveness of the instrument in the current principal preparation program.…

  18. Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

    Science.gov (United States)

    Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

    2018-02-01

    Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

  19. Development of an instrument for direct ozone production rate measurements: measurement reliability and current limitations

    Science.gov (United States)

    Sklaveniti, Sofia; Locoge, Nadine; Stevens, Philip S.; Wood, Ezra; Kundu, Shuvashish; Dusanter, Sébastien

    2018-02-01

    Ground-level ozone (O3) is an important pollutant that affects both global climate change and regional air quality, with the latter linked to detrimental effects on both human health and ecosystems. Ozone is not directly emitted in the atmosphere but is formed from chemical reactions involving volatile organic compounds (VOCs), nitrogen oxides (NOx = NO + NO2) and sunlight. The photochemical nature of ozone makes the implementation of reduction strategies challenging and a good understanding of its formation chemistry is fundamental in order to develop efficient strategies of ozone reduction from mitigation measures of primary VOCs and NOx emissions. An instrument for direct measurements of ozone production rates (OPRs) was developed and deployed in the field as part of the IRRONIC (Indiana Radical, Reactivity and Ozone Production Intercomparison) field campaign. The OPR instrument is based on the principle of the previously published MOPS instrument (Measurement of Ozone Production Sensor) but using a different sampling design made of quartz flow tubes and a different Ox (O3 and NO2) conversion-detection scheme composed of an O3-to-NO2 conversion unit and a cavity attenuated phase shift spectroscopy (CAPS) NO2 monitor. Tests performed in the laboratory and in the field, together with model simulations of the radical chemistry occurring inside the flow tubes, were used to assess (i) the reliability of the measurement principle and (ii) potential biases associated with OPR measurements. This publication reports the first field measurements made using this instrument to illustrate its performance. The results showed that a photo-enhanced loss of ozone inside the sampling flow tubes disturbs the measurements. This issue needs to be solved to be able to perform accurate ambient measurements of ozone production rates with the instrument described in this study. However, an attempt was made to investigate the OPR sensitivity to NOx by adding NO inside the instrument

  20. Being an Informed Consumer of Health Information and Assessment of Electronic Health Literacy in a National Sample of Internet Users: Validity and Reliability of the e-HLS Instrument.

    Science.gov (United States)

    Seçkin, Gül; Yeatts, Dale; Hughes, Susan; Hudson, Cassie; Bell, Valarie

    2016-07-11

    The Internet, with its capacity to provide information that transcends time and space barriers, continues to transform how people find and apply information to their own lives. With the current explosion in electronic sources of health information, including thousands of websites and hundreds of mobile phone health apps, electronic health literacy is gaining an increasing prominence in health and medical research. An important dimension of electronic health literacy is the ability to appraise the quality of information that will facilitate everyday health care decisions. Health information seekers explore their care options by gathering information from health websites, blogs, Web-based forums, social networking websites, and advertisements, despite the fact that information quality on the Internet varies greatly. Nonetheless, research has lagged behind in establishing multidimensional instruments, in part due to the evolving construct of health literacy itself. The purpose of this study was to examine psychometric properties of a new electronic health literacy (ehealth literacy) measure in a national sample of Internet users with specific attention to older users. Our paper is motivated by the fact that ehealth literacy is an underinvestigated area of inquiry. Our sample was drawn from a panel of more than 55,000 participants maintained by Knowledge Networks, the largest national probability-based research panel for Web-based surveys. We examined the factor structure of a 19-item electronic Health Literacy Scale (e-HLS) through exploratory factor analysis (EFA) and confirmatory factor analysis, internal consistency reliability, and construct validity on sample of adults (n=710) and a subsample of older adults (n=194). The AMOS graphics program 21.0 was used to construct a measurement model, linking latent factors obtained from EFA with 19 indicators to determine whether this factor structure achieved a good fit with our entire sample and the subsample (age ≥ 60

  1. Development and validation of an instrument to assess perceived social influence on health behaviors

    Science.gov (United States)

    HOLT, CHERYL L.; CLARK, EDDIE M.; ROTH, DAVID L.; CROWTHER, MARTHA; KOHLER, CONNIE; FOUAD, MONA; FOUSHEE, RUSTY; LEE, PATRICIA A.; SOUTHWARD, PENNY L.

    2012-01-01

    Assessment of social influence on health behavior is often approached through a situational context. The current study adapted an existing, theory-based instrument from another content domain to assess Perceived Social Influence on Health Behavior (PSI-HB) among African Americans, using an individual difference approach. The adapted instrument was found to have high internal reliability (α = .81–.84) and acceptable testretest reliability (r = .68–.85). A measurement model revealed a three-factor structure and supported the theoretical underpinnings. Scores were predictive of health behaviors, particularly among women. Future research using the new instrument may have applied value assessing social influence in the context of health interventions. PMID:20522506

  2. Assessment of wind turbine load measurement instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Morfiadakis, E; Papadopoulos, K [CRES (Greece); Borg, N van der [ECN, Petten (Netherlands); Petersen, S M [Risoe, Roskilde (Denmark); Seifert, H [DEWI, Wilhelmshaven (Germany)

    1999-03-01

    In the framework of Sub-Task3 `Wind turbine load measurement instrumentation` of EU-project `European Wind Turbine Testing Procedure Development`, the load measurement techniques have been assessed by laboratory, full scale and numerical tests. The existing methods have been reviewed with emphasis on the strain gage application techniques on composite materials and recommendations are provided for the optimisation of load measurement techniques. (au) EU. 14 refs.

  3. Assessment of physical server reliability in multi cloud computing system

    Science.gov (United States)

    Kalyani, B. J. D.; Rao, Kolasani Ramchand H.

    2018-04-01

    Business organizations nowadays functioning with more than one cloud provider. By spreading cloud deployment across multiple service providers, it creates space for competitive prices that minimize the burden on enterprises spending budget. To assess the software reliability of multi cloud application layered software reliability assessment paradigm is considered with three levels of abstractions application layer, virtualization layer, and server layer. The reliability of each layer is assessed separately and is combined to get the reliability of multi-cloud computing application. In this paper, we focused on how to assess the reliability of server layer with required algorithms and explore the steps in the assessment of server reliability.

  4. A Systematic Review of Statistical Methods Used to Test for Reliability of Medical Instruments Measuring Continuous Variables

    Directory of Open Access Journals (Sweden)

    Rafdzah Zaki

    2013-06-01

    Full Text Available   Objective(s: Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice.   Materials and Methods: In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. Results: The Intra-class Correlation Coefficient (ICC is the most popular method with 25 (60% studies having used this method followed by the comparing means (8 or 19%. Out of 25 studies using the ICC, only 7 (28% reported the confidence intervals and types of ICC used. Most studies (71% also tested the agreement of instruments. Conclusion: This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies.

  5. The psychometric properties of a shortened corporate entrepreneurship assessment instrument

    Directory of Open Access Journals (Sweden)

    Renier Steyn

    2017-08-01

    Aim: The aim of this research was to evaluate the psychometric properties of a measure of entrepreneurial climate. Entrepreneurial climate was measured using a shortened version of the Hornsby, Kuratko and Zahra (2002 instrument, called the Corporate Entrepreneurship Assessment Instrument (CEAI. Making information on the psychometric properties of the instrument available directly relates to its utility. Setting: The setting was medium to large South African companies. A random sample of employees was drawn from 53 selected companies across South Africa, with 60 respondents per company (N = 3 180. Methods: A cross-sectional survey design was used. Several instruments were administered, including the shortened version of the CEAI. Cronbach’s alpha was used to test for reliability and several methods were used to test for validity. Correlation analysis was used to test for concurrent validity, convergent validity and divergent validity. Principle component factor analysis was used to test for factorial validity and a t-test to test for known-group validity. Results: The results showed that the reliability for the total score of the shortened version of the CEAI was acceptable at 0.758. The results also showed some evidence of concurrent validity, as well as homogeneity among the items. With regard to factorial validity, all items loaded in accordance with the subscales of the instrument. The measure was able to distinguish, as expected, between government organisations and private business entities, suggesting known-group validity. Convergent validity and divergent validity were also assessed. Interesting to note was that entrepreneurship climate correlates more with general employee attitude (e.g. employee engagement; R= 0.420, p < 0.001 and organisational commitment, R = 0.331, p < 0.001 than with self-reported innovation (R = 0.277, p < 0.001 and R = 0.267, p < 0.001. Contribution: This paper not only provided information on the reliability

  6. Reliability data collection and use in risk and availability assessment

    International Nuclear Information System (INIS)

    Colombari, V.

    1989-01-01

    For EuReDatA it is a prevailing objective to initiate and support contact between experts, companies and institutions active in reliability engineering and research. Main topics of this 6th EuReDatA Conference are: Reliability data banks; incidents data banks; common cause data; source and propagation of uncertainties; computer aided risk analysis; reliability and incidents data acquisition and processing; human reliability; probabilistic safety and availability assessment; feedback of reliability into system design; data fusion; reliability modeling and techniques; structural and mechanical reliability; consequence modeling; software and electronic reliability; reliability tests. Some conference papers are separately indexed in the database. (HP)

  7. The Toronto outcome measure for craniofacial prosthetics: reliability and validity of a condition-specific quality-of-life instrument.

    Science.gov (United States)

    Anderson, James D; Johnston, Dennis A; Haugh, Gil S; Kiat-Amnuay, Sudarat; Gettleman, Lawrence

    2013-01-01

    The purpose of this study was to refine the Toronto Outcome Measure for Craniofacial Prosthetics (TOMCP), present evidence for its reliability and validity, and use the instrument to explore differences in quality of life between prostheses made with chlorinated polyethylene (CPE) (experimental) and silicone (control). As part of a multicenter prospective controlled randomized double-blind single-crossover clinical trial of the two materials, the TOMCP was administered at the start and end of two 4-month study arms, during which 42 patients wore prostheses made from one material then the other. Reliability was assessed at the crossover. To determine validity of the TOMCP, the Linear Analogue Self-Assessment (LASA-12) and the Short-Form 8 (SF-8) were also administered with the TOMCP. The TOMCP was reduced by removing items that were unreliable, had poorly distributed answers, showed increased internal consistency after their removal, or were too highly correlated with more than one other item. The tests of reliability and validity were then repeated. Finally, the reduced instrument was used to test for differences in quality of life between prostheses made of the two materials. The item reduction tactics pared the 52-item instrument down to 27 items. The correlations of both TOMCP versions with the LASA-12 and the SF-8 were found to be statistically significant, providing evidence of the validity of the TOMCP. The instrument revealed significantly better quality of life with silicone rather than CPE prostheses. Both versions of the TOMCP were found to be reliable and valid. The instrument was able to show differences in quality of life between two materials.

  8. Translation, Validation, and Reliability of the Dutch Late-Life Function and Disability Instrument Computer Adaptive Test.

    Science.gov (United States)

    Arensman, Remco M; Pisters, Martijn F; de Man-van Ginkel, Janneke M; Schuurmans, Marieke J; Jette, Alan M; de Bie, Rob A

    2016-09-01

    Adequate and user-friendly instruments for assessing physical function and disability in older adults are vital for estimating and predicting health care needs in clinical practice. The Late-Life Function and Disability Instrument Computer Adaptive Test (LLFDI-CAT) is a promising instrument for assessing physical function and disability in gerontology research and clinical practice. The aims of this study were: (1) to translate the LLFDI-CAT to the Dutch language and (2) to investigate its validity and reliability in a sample of older adults who spoke Dutch and dwelled in the community. For the assessment of validity of the LLFDI-CAT, a cross-sectional design was used. To assess reliability, measurement of the LLFDI-CAT was repeated in the same sample. The item bank of the LLFDI-CAT was translated with a forward-backward procedure. A sample of 54 older adults completed the LLFDI-CAT, World Health Organization Disability Assessment Schedule 2.0, RAND 36-Item Short-Form Health Survey physical functioning scale (10 items), and 10-Meter Walk Test. The LLFDI-CAT was repeated in 2 to 8 days (mean=4.5 days). Pearson's r and the intraclass correlation coefficient (ICC) (2,1) were calculated to assess validity, group-level reliability, and participant-level reliability. A correlation of .74 for the LLFDI-CAT function scale and the RAND 36-Item Short-Form Health Survey physical functioning scale (10 items) was found. The correlations of the LLFDI-CAT disability scale with the World Health Organization Disability Assessment Schedule 2.0 and the 10-Meter Walk Test were -.57 and -.53, respectively. The ICC (2,1) of the LLFDI-CAT function scale was .84, with a group-level reliability score of .85. The ICC (2,1) of the LLFDI-CAT disability scale was .76, with a group-level reliability score of .81. The high percentage of women in the study and the exclusion of older adults with recent joint replacement or hospitalization limit the generalizability of the results. The Dutch LLFDI

  9. Reliability of the Q Force; a mobile instrument for measuring isometric quadriceps muscle strength

    OpenAIRE

    Schans, van der, C.P.; Zijlstra, W.; Regterschot, G.R.H.; Krijnen, W.P.; Douma, K.W.; Slager, G.E.C.

    2016-01-01

    BACKGROUND: The ability to generate muscle strength is a pre-requisite for all human movement. Decreased quadriceps muscle strength is frequently observed in older adults and is associated with a decreased performance and activity limitations. To quantify the quadriceps muscle strength and to monitor changes over time, instruments and procedures with a sufficient reliability are needed. The Q Force is an innovative mobile muscle strength measurement instrument suitable to measure in various d...

  10. Validation of the Organizational Culture Assessment Instrument

    Science.gov (United States)

    Heritage, Brody; Pollock, Clare; Roberts, Lynne

    2014-01-01

    Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

  11. Validation of the organizational culture assessment instrument.

    Directory of Open Access Journals (Sweden)

    Brody Heritage

    Full Text Available Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102 Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

  12. Validity of instruments to assess students' travel and pedestrian safety.

    Science.gov (United States)

    Mendoza, Jason A; Watson, Kathy; Baranowski, Tom; Nicklas, Theresa A; Uscanga, Doris K; Hanfling, Marcus J

    2010-05-18

    Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI) and intraclass correlations (ICC) across research assistant ratings. The SRTS travel survey had high test-retest reliability (kappa = 0.97, n = 96, p < 0.001) and convergent validity (kappa = 0.87, n = 81, p < 0.001). The pedestrian safety behavior checklist had moderate reliability across research assistants' ratings (ICC = 0.48) and moderate correlation with the PI (r = 0.55, p = < 0.01). When two raters simultaneously used the instrument, the ICC increased to 0.65. Overall percent agreement (91%), sensitivity (85%) and specificity (83%) were acceptable. These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.

  13. [Development and reliability evaluation of an instrument to measure health-related quality of life in independent elderly].

    Science.gov (United States)

    Lima, Maria José Barbosa de; Portela, Margareth Crisóstomo

    2010-08-01

    This study presents an instrument, the health-related quality of life (HRQOL) profile for independent elderly, to measure the health-related quality of life of the functionally independent elderly assisted in the outpatient setting, based on the adaptation of four validated scales: Short-Form Health Survey (SF-36), Duke-UNC Health Profile (DUHP), Sickness Impact Profile (SIP), and Nottingham Health Profile (NHP). The study also evaluates the instrument's reliability based on its use by two different observers with a 15-day interval. The instrument includes five dimensions (health perception, symptoms, physical function, psychological function, and social function) and 45 items. Reliability evaluation of the QUASI instrument was based on interviews with 142 elderly outpatients in the city of Rio de Janeiro, Brazil. Prevalence-adjusted kappa statistic was used to assess all 45 items. Correlation was also calculated between overall scores and scores on individual dimensions. In the reliability evaluation, 39 of the 45 items showed prevalence-adjusted kappa greater than 0.60.

  14. The Development and Evaluation of a Novel Instrument Assessing Residents' Discharge Summaries.

    Science.gov (United States)

    Hommos, Musab S; Kuperman, Ethan F; Kamath, Aparna; Kreiter, Clarence D

    2017-04-01

    To develop and determine the reliability of a novel measurement instrument assessing the quality of residents' discharge summaries. In 2014, the authors created a discharge summary evaluation instrument based on consensus recommendations from national regulatory bodies and input from primary care providers at their institution. After a brief pilot, they used the instrument to evaluate discharge summaries written by first-year internal medicine residents (n = 24) at a single U.S. teaching hospital during the 2013-2014 academic year. They conducted a generalizability study to determine the reliability of the instrument and a series of decision studies to determine the number of discharge summaries and raters needed to achieve a reliable evaluation score. The generalizability study demonstrated that 37% of the variance reflected residents' ability to generate an adequate discharge summary (true score variance). The decision studies estimated that the mean score from six discharge summary reviews completed by a unique rater for each review would yield a reliability coefficient of 0.75. Because of high interrater reliability, multiple raters per discharge summary would not significantly enhance the reliability of the mean rating. This evaluation instrument reliably measured residents' performance writing discharge summaries. A single rating of six discharge summaries can achieve a reliable mean evaluation score. Using this instrument is feasible even for programs with a limited number of inpatient encounters and a small pool of faculty preceptors.

  15. Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

    Science.gov (United States)

    Azizah, K. N.; Ibrahim, M.; Widodo, W.

    2018-01-01

    Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

  16. Reliability of instruments in a cooperative, multisite study: employment intervention demonstration program.

    Science.gov (United States)

    Salyers, M P; McHugo, G J; Cook, J A; Razzano, L A; Drake, R E; Mueser, K T

    2001-09-01

    Reliability of well-known instruments was examined in 202 people with severe mental illness participating in a multisite vocational study. We examined interrater reliability of the Positive and Negative Syndrome Scale (PANSS) and the internal consistency and test-retest reliability of the PANSS, the Rosenberg Self-Esteem Scale, the Medical Outcomes Study Short Form-36 (SF-36), and the Quality of Life Interview. Most scales had good levels of reliability, with intraclass correlation coefficients (ICCs) and coefficient alphas above .70. However, the SF-36 scales were generally less stable over time, particularly Social Functioning (ICC = .55). Test-retest reliability was lower among less educated respondents and among ethnic minorities. We recommend close monitoring of psychometric issues in future multisite studies.

  17. Portfolio assessment during medical internships: How to obtain a reliable and feasible assessment procedure?

    Science.gov (United States)

    Michels, Nele R M; Driessen, Erik W; Muijtjens, Arno M M; Van Gaal, Luc F; Bossaert, Leo L; De Winter, Benedicte Y

    2009-12-01

    A portfolio is used to mentor and assess students' clinical performance at the workplace. However, students and raters often perceive the portfolio as a time-consuming instrument. In this study, we investigated whether assessment during medical internship by a portfolio can combine reliability and feasibility. The domain-oriented reliability of 61 double-rated portfolios was measured, using a generalisability analysis with portfolio tasks and raters as sources of variation in measuring the performance of a student. We obtained reliability (Phi coefficient) of 0.87 with this internship portfolio containing 15 double-rated tasks. The generalisability analysis showed that an acceptable level of reliability (Phi = 0.80) was maintained when the amount of portfolio tasks was decreased to 13 or 9 using one and two raters, respectively. Our study shows that a portfolio can be a reliable method for the assessment of workplace learning. The possibility of reducing the amount of tasks or raters while maintaining a sufficient level of reliability suggests an increase in feasibility of portfolio use for both students and raters.

  18. Towards an Operational Definition of Effective Co-Teaching: Instrument Development, Validity, and Reliability

    Science.gov (United States)

    La Monte, Michelle Evonne

    2012-01-01

    This study focused on developing a valid and reliable instrument that can not only identify successful co-teaching, but also the professional development needs of co-teachers and their administrators in public schools. Two general questions about the quality of co-teaching were addressed in this study: (a) How well did descriptors within each of…

  19. Reliability of the Motor Learning Strategy Rating Instrument for Children and Youth with Acquired Brain Injury

    Science.gov (United States)

    Kamath, Trishna; Pfeifer, Megan; Banerjee-Guenette, Priyanka; Hunter, Theresa; Ito, Julia; Salbach, Nancy M.; Wright, Virginia; Levac, Danielle

    2012-01-01

    Purpose: To evaluate reliability and feasibility of the Motor Learning Strategy Rating Instrument (MLSRI) in children with acquired brain injury (ABI). The MLSRI quantifies the extent to which motor learning strategies (MLS) are used within physiotherapy (PT) interventions. Methods: PT sessions conducted by ABI team physiotherapists with a…

  20. The Effect of Instrument-Specific Rater Training on Interrater Reliability and Counseling Skills Performance Differentiation

    Science.gov (United States)

    Meacham, Paul Douglas, Jr.

    2013-01-01

    The purpose of this study was to explore the effect of instrument-specific rater training on interrater reliability (IRR) and counseling skills performance differentiation. Strong IRR is of primary concern to effective program evaluation (McCullough, Kuhn, Andrews, Valen, Hatch, & Osimo, 2003; Schanche, Nielsen, McCullough, Valen, &…

  1. Integrating software reliability concepts into risk and reliability modeling of digital instrumentation and control systems used in nuclear power plants

    International Nuclear Information System (INIS)

    Arndt, S. A.

    2006-01-01

    As software-based digital systems are becoming more and more common in all aspects of industrial process control, including the nuclear power industry, it is vital that the current state of the art in quality, reliability, and safety analysis be advanced to support the quantitative review of these systems. Several research groups throughout the world are working on the development and assessment of software-based digital system reliability methods and their applications in the nuclear power, aerospace, transportation, and defense industries. However, these groups are hampered by the fact that software experts and probabilistic safety assessment experts view reliability engineering very differently. This paper discusses the characteristics of a common vocabulary and modeling framework. (authors)

  2. The evaluation of equipment and Instrumentation Reliability Factors on Power Reactor

    International Nuclear Information System (INIS)

    Supriatna, Piping; Karlina, Itjeu; Widagdo, Suharyo; Santosa, Kussigit; Darlis; Sudiyono, Bambang; Yuniyanta, Sasongko; Sudarmin

    1999-01-01

    Equipment and instrumentation reliability on type power reactor control room was determined by its pattern and design. the principle of ergonomy applied on equipment and instrumentation layout in this ABWR type reactor are geometric pattern appropriate with economic body motion, average anthropometry data of operator especially operator hand-reach, range of vision, angle of vision, lighting, color arrangement and harmony as will as operator case in operating the equipment system. Limitation criteria of the parameter mentioned above are based on EPRI NP-3659, NURG 0700, and NUREG/CR-3331 documents. Besides that, the (working) physical environment parameter factor of the control room must be designed in order to fulfil the standard criteria of ergonomic condition based on NUREG-0800. The reliability evaluation of equipment and instrumentation system also occurs observed from man machine interaction side which happen between operator and equipment and instrumentation in the ABWR type power reactor control room. From the MMI analysis can be known the working failure possibility which is caused by the operator. The evaluation result of equipment and instrumentation reliability on ABWR type power reactor control room showed that the design of this ABWR control room is good and fulfils the ergonomy standard criteria have been determined

  3. INSTRUMENTS OF HIGH RISK SEXUAL BEHAVIOR ASSESSMENT: A SYSTEMATIC REVIEW.

    Science.gov (United States)

    Mirzaei, Mojtaba; Ahmadi, Khodabakhsh; Saadat, Seyed-Hassan; Ramezani, Mohammad Arash

    2016-02-01

    Sexual behavior is a complex activity affecting all aspects of human's life. Risky sexual behaviors impose negative outcomes on family, relationships and health. Unsafe sex is the second most leading cause of disability adjusted life years worldwide. Valid and reliable tools for assessment of risky sexual behaviors are necessary for implementing preventive measures. we searched Medline and the Cochrane Library of Systematic Reviews, with the keywords of "risky sexual behavior assessment", "sexual risk assessment", "high risk sexual behavior", "sexual risk taking". By reviewing references of the articles, some complementary studies were added. Assessment can be performed by questionnaire or non-questionnaire instruments. Questionnaires vary depending on their target population, evaluation of risky sexual behavior as a whole or focusing on an associated risk factor. In order to avoid usual biases in self reports, objective biomarker assessment of unprotected sex are employed. These markers include prostate specific antigen, chromosome Y DNA and Seminogelin. Risky sexual behavior can be assessed by various subjective and objective methods. While self-reports are more feasible, objective methods offer a higher degree of reliability. Further studies for finding more feasible methods of using biomarkers are recommended.

  4. Validity of instruments to assess students' travel and pedestrian safety

    Directory of Open Access Journals (Sweden)

    Baranowski Tom

    2010-05-01

    Full Text Available Abstract Background Safe Routes to School (SRTS programs are designed to make walking and bicycling to school safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research validated the SRTS school travel survey and a pedestrian safety behavior checklist. Methods Fourth grade students completed a brief written survey on how they got to school that day with set responses. Test-retest reliability was obtained 3-4 hours apart. Convergent validity of the SRTS travel survey was assessed by comparison to parents' report. For the measure of pedestrian safety behavior, 10 research assistants observed 29 students at a school intersection for completion of 8 selected pedestrian safety behaviors. Reliability was determined in two ways: correlations between the research assistants' ratings to that of the Principal Investigator (PI and intraclass correlations (ICC across research assistant ratings. Results The SRTS travel survey had high test-retest reliability (κ = 0.97, n = 96, p Conclusions These validated instruments can be used to assess SRTS programs. The pedestrian safety behavior checklist may benefit from further formative work.

  5. Reliability and Validity Study of the Attitude towards Mathematics Instruments Short Form

    Directory of Open Access Journals (Sweden)

    Güney HACIÖMEROĞLU

    2017-05-01

    Full Text Available Purpose of this study was to investigate the reliability and validity of the Turkish form of the Attitude Towards Mathematics Instrument Short Form developed by Lim and Chapman (2013. In this study, data gathered from 310 elementary students were utilized for Exploratory and Confirmatory Factor Analysis to determine the structure of factor loading. The factor loading among the sub-scales were different from original. Confirmatory Factor analysis revealed that the model was acceptable. There were three sub-scales, value, self-confidence, enjoyment and motivation. Cronbach’s alpha coefficient for the overall instrument was calculated as .84, respectively. The adapted instrument includes three sub-scales: value (α=.91, self-confidence (α=.86, enjoyment and motivation (α=.82. Turkish adaptation of the questionnaire is valid and reliable and appropriate to use in Turkish culture.

  6. A Systematic Review of Instruments to Assess Organizational Readiness for Knowledge Translation in Health Care

    Science.gov (United States)

    Gagnon, Marie-Pierre; Attieh, Randa; Ghandour, El Kebir; Légaré, France; Ouimet, Mathieu; Estabrooks, Carole A.; Grimshaw, Jeremy

    2014-01-01

    Background The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments. Methods We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments. Findings We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University –ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University – Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments. Conclusion Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could

  7. A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

    Directory of Open Access Journals (Sweden)

    Marie-Pierre Gagnon

    Full Text Available The translation of research into practices has been incomplete. Organizational readiness for change (ORC is a potential facilitator of effective knowledge translation (KT. However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc. up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69% of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D, reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19% instruments.Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its

  8. Translation, Assessment and Deployment of Stuttering Instruments into Different Languages: Comments Arising from Bakhtiar et al., "Investigation of the Reliability of the SSI-3 for Preschool Persian-Speaking Children Who Stutter" ["J. Fluency Disord." 35 (2010) 87-91

    Science.gov (United States)

    Karimi, Hamid; Nilipour, Reza; Shafiei, Bijan; Howell, Peter

    2011-01-01

    Bakhtiar, Seifpanahi, Ansari, Ghanadzade and Packman (2010) reported high inter-, and intra-judge agreement of a translation of the Stuttering Severity Instrument (SSI-3) for preschool Persian-speaking children who stutter. Translation of SSI-3 into Persian is desirable as there is no standardised stuttering severity test for that language.…

  9. Investigating the Validity and Reliability of the Vanderbilt Assessment of Leadership in Education

    Science.gov (United States)

    Porter, Andrew C.; Polikoff, Morgan S.; Goldring, Ellen B.; Murphy, Joseph; Elliott, Stephen N.; May, Henry

    2010-01-01

    The Vanderbilt Assessment of Leadership in Education (VAL-ED) is a multirater assessment of principals' learning-centered leadership. The instrument was developed based on the Standards for Educational and Psychological Testing. In this article, we report on the validity and reliability evidence for the VAL-ED accumulated in a national field…

  10. Using the Hemophilia Joint Health Score for assessment of children: Reliability of the Spanish version.

    Science.gov (United States)

    R, Cuesta-Barriuso; A, Torres-Ortuño; S, Pérez-Alenda; J, Carrasco Juan; F, Querol; J, Nieto-Munuera; Ja, López-Pina

    2018-02-27

    Numerous measuring instruments for the evaluation of hemophilic arthropathy have been developed. One of the most used systems is the Hemophilia Joint Health Score (HJHS) given its sensitivity to clinical changes appearing in the joints because of recurrent hemarthrosis. Assessing the interrater reliability, using the Spanish version of the HJHS (version 2.1) in children with hemophilia. Reliability study to assess the interrater reliability of the Spanish version of HJHS. A sample of 36 children aged 7-13 years diagnosed with hemophilia A or B was used. Two physiotherapists performed physical assessments with the Spanish version of the HJHS. Descriptive statistics (range, mean, standard deviation) and the analysis of interrater reliability were calculated. The interrater reliability was heterogeneous since the Kappa coefficient range (ĸ), although significant (p reliability of the Spanish population version of the HJHS is high. This scale should be used generically in evaluating musculoskeletal pediatric patients with hemophilia.

  11. Risk assessment instruments in clinical practice.

    Science.gov (United States)

    Côté, Gilles; Crocker, Anne G; Nicholls, Tonia L; Seto, Michael C

    2012-04-01

    To determine whether the items in one of the most widely validated instruments of violence risk assessment, the Historical-Clinical-Risk Management-20 (HCR-20), are used in review board hearings to assess the risk of violence by people found Not Criminally Responsible on account of Mental Disorder (NCRMD). This study was conducted from October 2004 to August 2006 in Quebec's sole forensic psychiatric hospital and 2 large civil psychiatric hospitals designated for the care of people declared NCRMD in the Montreal metropolitan area. The risk assessments presented by clinicians at annual review board hearings and the boards' rationale for the release or detention of people found NCRMD were contrasted with the risk assessments conducted by the research team using the HCR-20. The final sample was comprised of 96 men. Very few of the risk factors identified by prior research (HCR-20 items) were mentioned in the hearing process, whether in clinical reports, discussions during the hearing, or in the disposition justification. The findings confirm that there remains a significant gap between research evidence and risk assessment practice.

  12. Metacognition Assessment Interview: Instrument description and factor structure

    Directory of Open Access Journals (Sweden)

    Giovanni Pellecchia

    2015-12-01

    Full Text Available Objective: Metacognition is a multi-component psychological construct, characterised by the ability to identify and describe one’s own mental states and those of others. Evidence has been found for an association between deficits in metacognitive abilities and poor social functioning, low quality of life, psychopathology, and symptoms in Personality Disorders (PDs. However, to date, there are few psychometrically validated instruments available for assessing the different components of metacognition. A semi-structured interview, the Metacognition Assessment Interview (MAI, has been developed to evaluate different domains of metacognition. In the present study, we investigated the psychometric properties of the MAI in an outpatient clinical sample. Method: The MAI was administered to a clinical population of 306 outpatients attending a private clinical centre. Exploratory factor analysis, confirmatory factor analysis and correlation with instruments assessing alexithymia and interpersonal problems were carried out to examine the dimensionality and validity of the MAI. Result: Explorative and confirmatory factor analyses revealed a good fit for both a two-factor model and a four-factor model of metacognition. The two-factor model yielded two main dimensions, which we named: Self domain, defined as self-reflection, and Other domain, defined as critical distancing from one’s own mental state and that of others. The four-factor solution is composed of four sub-domains: monitoring, integration, differentiation and decentration. Moreover, the MAI showed good convergent validity, with significant correlations with both alexithymia and interpersonal problems. Conclusions: These results confirm that the MAI is a reliable instrument for measuring metacognition and its different sub-domains. In particular, the MAI represents a useful and flexible instrument for the assessment of metacognition impairments in different psychopathologies and it can provide

  13. Lifetime Reliability Assessment of Concrete Slab Bridges

    DEFF Research Database (Denmark)

    Thoft-Christensen, Palle

    A procedure for lifetime assesment of the reliability of short concrete slab bridges is presented in the paper. Corrosion of the reinforcement is the deterioration mechanism used for estimating the reliability profiles for such bridges. The importance of using sensitivity measures is stressed....... Finally the produce is illustrated on 6 existing UK bridges....

  14. Validity and reliability of a new instrument for the evaluation of dental collaboration in disabled people

    Directory of Open Access Journals (Sweden)

    Scilla Sparabombe

    2013-10-01

    Full Text Available Background: nowadays, oral health in people with disabilities is an important topic. The phsychological and behavioural problems of these people, their difficulties with environmental adaptations and the absence of any traditional communication determine the compliance needed for treatment The aim of this work was to test the validity and reliability of an original questionnaire that could become an instrument assessing the individual features in people with mental retardation and other developmental disabilities at the time of dental treatment.Methods: it was created a questionnaire with standardised answers regarding four specific areas: neuropsychology, emotional-affect, autonomy and environmental resources. The questionnaire was completed by 63 patients from three different institutes (two rehabilitation institutes and an Institute of Dentistry for patients with special needs. To analyse the answers, each item was transformed into a numeric value. A value of 1 was displayed as the minimum while 4 represented full possession of the considered skills. A total of 17 variables were analysed with descriptive statistics and multivariate analysis. Internal consistency reliability was measured using Cronbach’s alpha. Furthermore, an analysis on convergent/discriminant validity was provided.Results: all variables were positively correlated. The most significant were “guidance”, “communication”, “sociability”, “view”, “hearing” and “feeding”. Items like “self-control”, “equanimity”, “problematic behaviour”, “extroversion” and “autonomy” offered vague and less significant information in identifying the patient’s collaboration level. Variables like “evaluation by the compiler about the patient’s collaboration”, “previous dental experiences” and “attendant” were confirmed. Cronbach’s alpha was 0.77 (standardized result, which meet the a priori criterion of 0.90≥alpha≥0.70.Conclusions

  15. Computer-aided reliability and risk assessment

    International Nuclear Information System (INIS)

    Leicht, R.; Wingender, H.J.

    1989-01-01

    Activities in the fields of reliability and risk analyses have led to the development of particular software tools which now are combined in the PC-based integrated CARARA system. The options available in this system cover a wide range of reliability-oriented tasks, like organizing raw failure data in the component/event data bank FDB, performing statistical analysis of those data with the program FDA, managing the resulting parameters in the reliability data bank RDB, and performing fault tree analysis with the fault tree code FTL or evaluating the risk of toxic or radioactive material release with the STAR code. (orig.)

  16. Assessing the reliability of skilled performance

    International Nuclear Information System (INIS)

    Dougherty, E.M.; Collins, E.P.

    1996-01-01

    In some high-hazard military tasks, precision of motor skills is crucial to avoid a risk-sensitive drop or other mishap. Sparse data supports a basic level of reliability for this activity seemingly much lower than typical, individual action, slip-mode errors would yield. A typical occurrence failure rate seems to be of the order of 1 x 10 -5 per opportunity. A speculation is tendered that this represents a difference in kind; that the reliability of skills is a different taxon than previously called out in the typical scheme of human reliability

  17. Instrument for assessing coronary symptoms in women

    Directory of Open Access Journals (Sweden)

    Cándida Rosa Castañeda Valencia

    2015-09-01

    Full Text Available Objective: To design and validate an instrument for assessing the symptoms in women with coronary disease framed in the Theory of the Unpleasant Symptoms. Methodology: Methodological, psychometric study oriented by The symptoms, first concept of the Theory of Unpleasant Symptoms by Lenz et al. Theoretical critique of the construct chosen was performed proving usefulness in research and practice discipline. From the empirical, 260 evidences were weighted through methodological and empirical critique, applying the Integrative Review System articulated to the Empirical Conceptual Model by Fawcett Garity. Only 30 research pieces were obtained, used for the construction of the items. To the Lenz symptoms were added the reported psychosocial symptoms in women with coronary disease, generating a first design composed of 87 items. Results:The design was done by experts Content Validation with the Escobar and Cuervo Model 2008 (statistical analysis spss, 20 with Kendall Correlation Coefficient k = 0.682 (p ; 0.05 with good agreement between judges. Lawshe Model normalized by Tristán 2008 reported a Content Validity Ratio = 0.57 and Content Validity Index = 0.797, showing that items are units of essential analysis. Finally, Validation Facial made by means of the pilot test, conducted on 21 women who met the inclusion criteria, allowed the discrimination semiotics of items, obtaining an instrument consisting of 67 items.  Conclusions:This is a remnant of research that requires further validation to increase its psychometric capacity.

  18. Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

    Directory of Open Access Journals (Sweden)

    Ammerman Alice S

    2007-07-01

    Full Text Available Abstract Background Few assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed. Methods To measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment. Results For inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%. Conclusion This study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for

  19. Highly Reliable Power and Communication System for Essential Instruments under a Severe Accident of NPPs

    International Nuclear Information System (INIS)

    Yoo, S. J.; Choi, B. H.; Jung, S. Y.; Rim, Chun T.

    2013-01-01

    In this paper, three survivable strategies to overcome the problems listed above are proposed for the essential instruments under the severe accident of NPPs. First, wire/wireless multi power systems are adopted to the essential instruments for continuous power supply. Second, wire/wireless communication systems are proposed for reliable transmission of measuring information among instruments and operators. Third, a physical protection system such as a harness and a heat isolation box is introduced to ensure operable conditions for the proposed systems. In this paper, a highly reliable strategy, which consists of wire/wireless multi power and communication systems and physical protection system is proposed to ensure the survival of the essential instruments under harsh external conditions. The wire/wireless multi power and communication systems are designed to transfer power and data in spite of the failure of conventional wired systems. The physical protection system provides operable environments to the instruments. Therefore, the proposed system can be considered as a candidate of practical and urgent remedy for NPPs under the severe accident. After the Fukushima nuclear accident, survivability of essential instruments has been emphasized for immediate and accurate response. The essential instruments can measure environment conditions such as temperature, pressure, radioactivity and corium behavior inside nuclear power plants (NPPs) under a severe accident. Access to the inside of NPPs is restricted to human beings because of hazardous environment such as high radioactivity, high temperature and high pressure. Thus, monitoring the inside of NPPs is necessary for avoiding damage from the severe accident. Even though there were a number of instruments in Fukushima Daiichi NPP, they failed to obtain exact monitoring information. According to the details of the Fukushima nuclear accident, following problems can be counted as strong candidates of this instruments

  20. Highly Reliable Power and Communication System for Essential Instruments under a Severe Accident of NPPs

    Energy Technology Data Exchange (ETDEWEB)

    Yoo, S. J.; Choi, B. H.; Jung, S. Y.; Rim, Chun T. [Korea Advanced Institute of Science and Technology, Daejeon (Korea, Republic of)

    2013-10-15

    In this paper, three survivable strategies to overcome the problems listed above are proposed for the essential instruments under the severe accident of NPPs. First, wire/wireless multi power systems are adopted to the essential instruments for continuous power supply. Second, wire/wireless communication systems are proposed for reliable transmission of measuring information among instruments and operators. Third, a physical protection system such as a harness and a heat isolation box is introduced to ensure operable conditions for the proposed systems. In this paper, a highly reliable strategy, which consists of wire/wireless multi power and communication systems and physical protection system is proposed to ensure the survival of the essential instruments under harsh external conditions. The wire/wireless multi power and communication systems are designed to transfer power and data in spite of the failure of conventional wired systems. The physical protection system provides operable environments to the instruments. Therefore, the proposed system can be considered as a candidate of practical and urgent remedy for NPPs under the severe accident. After the Fukushima nuclear accident, survivability of essential instruments has been emphasized for immediate and accurate response. The essential instruments can measure environment conditions such as temperature, pressure, radioactivity and corium behavior inside nuclear power plants (NPPs) under a severe accident. Access to the inside of NPPs is restricted to human beings because of hazardous environment such as high radioactivity, high temperature and high pressure. Thus, monitoring the inside of NPPs is necessary for avoiding damage from the severe accident. Even though there were a number of instruments in Fukushima Daiichi NPP, they failed to obtain exact monitoring information. According to the details of the Fukushima nuclear accident, following problems can be counted as strong candidates of this instruments

  1. Instruments to assess self-care among healthy children: A systematic review of measurement properties.

    Science.gov (United States)

    Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

    2017-12-01

    To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

  2. Different Reliability Assessment Approaches for Wave Energy Converters

    DEFF Research Database (Denmark)

    Ambühl, Simon; Kramer, Morten Mejlhede; Sørensen, John Dalsgaard

    2015-01-01

    Reliability assessments are of importance for wave energy converters (WECs) due to the fact that accessibility might be limited in case of failure and maintenance. These failure rates can be adapted by reliability considerations. There are two different approaches to how reliability can...

  3. Probabilistic assessment of pressure vessel and piping reliability

    International Nuclear Information System (INIS)

    Sundararajan, C.

    1986-01-01

    The paper presents a critical review of the state-of-the-art in probabilistic assessment of pressure vessel and piping reliability. First the differences in assessing the reliability directly from historical failure data and indirectly by a probabilistic analysis of the failure phenomenon are discussed and the advantages and disadvantages are pointed out. The rest of the paper deals with the latter approach of reliability assessment. Methods of probabilistic reliability assessment are described and major projects where these methods are applied for pressure vessel and piping problems are discussed. An extensive list of references is provided at the end of the paper

  4. The control-and-instrumentation system of the IEA zero power reactor and its reliability calculation

    International Nuclear Information System (INIS)

    Peluso, M.A.V.

    1978-01-01

    The control-and instrumentation system for the Instituto de Energia Atomica Zero Power Reactor is described and the design criteria are presented and discussed. The reliability analysis for the reactor protection system was performed using the fault tree method. This was done using a computer code based on the Monte Carlo simulation. That code is an adaptation of the SAFTE-I, for the IBM 360/155 IEA Computer. (Author) [pt

  5. The reliability of three psoriasis assessment tools: Psoriasis area and severity index, body surface area and physician global assessment.

    Science.gov (United States)

    Bożek, Agnieszka; Reich, Adam

    2017-08-01

    A wide variety of psoriasis assessment tools have been proposed to evaluate the severity of psoriasis in clinical trials and daily practice. The most frequently used clinical instrument is the psoriasis area and severity index (PASI); however, none of the currently published severity scores used for psoriasis meets all the validation criteria required for an ideal score. The aim of this study was to compare and assess the reliability of 3 commonly used assessment instruments for psoriasis severity: the psoriasis area and severity index (PASI), body surface area (BSA) and physician global assessment (PGA). On the scoring day, 10 trained dermatologists evaluated 9 adult patients with plaque-type psoriasis using the PASI, BSA and PGA. All the subjects were assessed twice by each physician. Correlations between the assessments were analyzed using the Pearson correlation coefficient. Intra-class correlation coefficient (ICC) was calculated to analyze intra-rater reliability, and the coefficient of variation (CV) was used to assess inter-rater variability. Significant correlations were observed among the 3 scales in both assessments. In all 3 scales the ICCs were > 0.75, indicating high intra-rater reliability. The highest ICC was for the BSA (0.96) and the lowest one for the PGA (0.87). The CV for the PGA and PASI were 29.3 and 36.9, respectively, indicating moderate inter-rater variability. The CV for the BSA was 57.1, indicating high inter-rater variability. Comparing the PASI, PGA and BSA, it was shown that the PGA had the highest inter-rater reliability, whereas the BSA had the highest intra-rater reliability. The PASI showed intermediate values in terms of interand intra-rater reliability. None of the 3 assessment instruments showed a significant advantage over the other. A reliable assessment of psoriasis severity requires the use of several independent evaluations simultaneously.

  6. Parts and Components Reliability Assessment: A Cost Effective Approach

    Science.gov (United States)

    Lee, Lydia

    2009-01-01

    System reliability assessment is a methodology which incorporates reliability analyses performed at parts and components level such as Reliability Prediction, Failure Modes and Effects Analysis (FMEA) and Fault Tree Analysis (FTA) to assess risks, perform design tradeoffs, and therefore, to ensure effective productivity and/or mission success. The system reliability is used to optimize the product design to accommodate today?s mandated budget, manpower, and schedule constraints. Stand ard based reliability assessment is an effective approach consisting of reliability predictions together with other reliability analyses for electronic, electrical, and electro-mechanical (EEE) complex parts and components of large systems based on failure rate estimates published by the United States (U.S.) military or commercial standards and handbooks. Many of these standards are globally accepted and recognized. The reliability assessment is especially useful during the initial stages when the system design is still in the development and hard failure data is not yet available or manufacturers are not contractually obliged by their customers to publish the reliability estimates/predictions for their parts and components. This paper presents a methodology to assess system reliability using parts and components reliability estimates to ensure effective productivity and/or mission success in an efficient manner, low cost, and tight schedule.

  7. WATCH: Warwick Assessment insTrument for Clinical teacHing: Development and testing.

    Science.gov (United States)

    Haider, Sonia Ijaz; Johnson, Neil; Thistlethwaite, Jill Elizabeth; Fagan, Gay; Bari, Muhammad Furqan

    2015-03-01

    Medical education and teaching skills are core competencies included in the generic curriculum for specialty training. To support the development of these skills, there is need for a validated instrument. This study aims to develop and test an instrument to measure the attributes of specialty trainees as effective teachers. The study was conducted in two phases. In first phase, the content of the instrument was generated from the literature and tested using the Delphi technique. In second phase, the instrument was field tested for validity and reliability using factor analysis and generalizability study. Feasibility was calculated by the time taken to complete the instrument. Acceptability and educational impact were determined by qualitative analysis of written feedback. Attributes of specialty trainees were assessed by clinical supervisors, peers, and students. The Delphi study produced consensus on 15 statements which formed the basis of the instrument. In field study, a total of 415 instruments were completed. Factor analysis demonstrated a three-factor solution ('learning-teaching milieu', 'teaching skills', and 'learner-orientated'). A generalizability coefficient was 0.92. Mean time to complete the instrument was five minutes. Feedback indicated that it was an acceptable and useful method of assessment. This new instrument provides valid, reliable, feasible, and acceptable assessment of clinical teaching.

  8. Preliminary investigation on reliability assessment of passive safety system

    International Nuclear Information System (INIS)

    Huang Changfan; Kuang Bo

    2012-01-01

    The reliability evaluation of passive safety system plays an important part in probabilistic safety assessment (PSA) of nuclear power plant applying passive safety design, which depends quantitatively on reliabilities of passive safety system. According to the object of reliability assessment of passive safety system, relevant parameters are identified. Then passive system behavior during accident scenarios are studied. A practical example of this method is given for the case of reliability assessment of AP1000 passive heat removal system in loss of normal feedwater accident. Key and design parameters of PRHRS are identified and functional failure criteria are established. Parameter combinations acquired by Latin hyper~ cube sampling (LHS) in possible parametric ranges are input and calculations of uncertainty propagation through RELAP5/MOD3 code are carried out. Based on the calculations, sensitivity assessment on PRHRS functional criteria and reliability evaluation of the system are presented, which might provide further PSA with PRHR system reliability. (authors)

  9. The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery

    Directory of Open Access Journals (Sweden)

    Patorn Piromchai

    2014-01-01

    Full Text Available Introduction. We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. Methods. Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos. Results. Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components. Conclusion. Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

  10. Assessing Academic Advising Outcomes Using Social Cognitive Theory: A Validity and Reliability Study

    Science.gov (United States)

    Erlich, Richard J.; Russ-Eft, Darlene F.

    2012-01-01

    The validity and reliability of three instruments, the "Counselor Rubric for Gauging Student Understanding of Academic Planning," micro-analytic questions, and the "Student Survey for Understanding Academic Planning," all based on social cognitive theory, were tested as means to assess self-efficacy and self-regulated learning in college academic…

  11. Development of the Test Of Astronomy STandards (TOAST) Assessment Instrument

    Science.gov (United States)

    Slater, Timothy F.; Slater, S. J.

    2008-05-01

    Considerable effort in the astronomy education research (AER) community over the past several years has focused on developing assessment tools in the form of multiple-choice conceptual diagnostics and content knowledge surveys. This has been critically important in advancing the AER discipline so that researchers could establish the initial knowledge state of students as well as to attempt measure some of the impacts of innovative instructional interventions. Unfortunately, few of the existing instruments were constructed upon a solid list of clearly articulated and widely agreed upon learning objectives. This was not done in oversight, but rather as a result of the relative youth of AER as a discipline. Now that several important science education reform documents exist and are generally accepted by the AER community, we are in a position to develop, validate, and disseminate a new assessment instrument which is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. In response, researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science & Math Teaching Center (UWYO SMTC) have designed a criterion-referenced assessment tool, called the Test Of Astronomy STandards (TOAST). Through iterative development, this instrument has a high degree of reliability and validity for instructors and researchers needing information on students’ initial knowledge state at the beginning of a course and can be used, in aggregate, to help measure the impact of course-length duration instructional strategies for courses with learning goals tightly aligned to the consensus goals of our community.

  12. Reliability assessment of underground shaft closure

    International Nuclear Information System (INIS)

    Fossum, A.F.; Munson, D.E.

    1994-01-01

    The intent of the WIPP, being constructed in the bedded geologic salt deposits of Southeastern New Mexico, is to provide the technological basis for the safe disposal of radioactive Transuranic (TRU) wastes generated by the defense programs of the United States. In determining this technological basis, advanced reliability and structural analysis techniques are used to determine the probability of time-to-closure of a hypothetical underground shaft located in an argillaceous salt formation and filled with compacted crushed salt. Before being filled with crushed salt for sealing, the shaft provides access to an underground facility. Reliable closure of the shaft depends upon the sealing of the shaft through creep closure and recompaction of crushed backfill. Appropriate methods are demonstrated to calculate cumulative distribution functions of the closure based on laboratory determined random variable uncertainty in salt creep properties

  13. Risk and reliability assessment for telecommunications networks

    Energy Technology Data Exchange (ETDEWEB)

    Wyss, G.D.; Schriner, H.K.; Gaylor, T.R.

    1996-08-01

    Sandia National Laboratories has assembled an interdisciplinary team to explore the applicability of probabilistic logic modeling (PLM) techniques to model network reliability for a wide variety of communications network architectures. The authors have found that the reliability and failure modes of current generation network technologies can be effectively modeled using fault tree PLM techniques. They have developed a ``plug-and-play`` fault tree analysis methodology that can be used to model connectivity and the provision of network services in a wide variety of current generation network architectures. They have also developed an efficient search algorithm that can be used to determine the minimal cut sets of an arbitrarily-interconnected (non-hierarchical) network without the construction of a fault tree model. This paper provides an overview of these modeling techniques and describes how they are applied to networks that exhibit hybrid network structures (i.e., a network in which some areas are hierarchical and some areas are not hierarchical).

  14. Structural reliability analysis and seismic risk assessment

    International Nuclear Information System (INIS)

    Hwang, H.; Reich, M.; Shinozuka, M.

    1984-01-01

    This paper presents a reliability analysis method for safety evaluation of nuclear structures. By utilizing this method, it is possible to estimate the limit state probability in the lifetime of structures and to generate analytically the fragility curves for PRA studies. The earthquake ground acceleration, in this approach, is represented by a segment of stationary Gaussian process with a zero mean and a Kanai-Tajimi Spectrum. All possible seismic hazard at a site represented by a hazard curve is also taken into consideration. Furthermore, the limit state of a structure is analytically defined and the corresponding limit state surface is then established. Finally, the fragility curve is generated and the limit state probability is evaluated. In this paper, using a realistic reinforced concrete containment as an example, results of the reliability analysis of the containment subjected to dead load, live load and ground earthquake acceleration are presented and a fragility curve for PRA studies is also constructed

  15. Suprahyoid Muscle Complex: A Reliable Neural Assessment Tool For Dysphagia?

    DEFF Research Database (Denmark)

    Kothari, Mohit; Stubbs, Peter William; Pedersen, Asger Roer

    be a non-invasive reliable neural assessment tool for patients with dysphagia. Objective: To investigate the possibility of using the suprahyoid muscle complex (SMC) using surface electromyography (sEMG) to assess changes to neural pathways by determining the reliability of measurements in healthy...

  16. Reliability of assessment of adherence to an antimicrobial treatment guideline

    NARCIS (Netherlands)

    Mol, PGM; Gans, ROB; Panday, PVN; Degener, JE; Laseur, M; Haaijer-Ruskamp, FM

    Assessment procedures for adherence to a guideline must be reliable and credible. The aim of this study was to explore the reliability of assessment of adherence, taking account of the professional backgrounds of the observers. A secondary analysis explored the impact of case characteristics on

  17. Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

    Science.gov (United States)

    Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

    2018-04-12

    The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

  18. Reliability assessment using the concept of possibility

    International Nuclear Information System (INIS)

    Ping, R.; Zhao, G.

    1994-01-01

    The role of the possibility theory in the quantitative approach to the reliability of large scale systems, in particular man-machine systems, is discussed. According to the original idea due to professor L.A. Zadeh, an error rate may be associated with a possibility distribution and a probability distribution. They describe the potentiallity and the actuality for error. This is especially important for the analysis of big accidents

  19. [Development of an Instrument to Assess the Quality of Childbirth Care from the Mother's Perspective].

    Science.gov (United States)

    Jeong, Geum Hee; Kim, Hyun Kyoung; Kim, Young Hee; Kim, Sun Hee; Lee, Sun Hee; Kim, Kyung Won

    2018-02-01

    This study aimed to develop an instrument to assess the quality of childbirth care from the perspective of a mother after delivery. The instrument was developed from a literature review, interviews, and item validation. Thirty-eight items were compiled for the instrument. The data for validity and reliability testing were collected using a questionnaire survey conducted on 270 women who had undergone normal vaginal delivery in Korea and analyzed with descriptive statistics, exploratory factor analysis, and reliability coefficients. The exploratory factor analysis reduced the number of items in the instrument to 28 items that were factored into four subscales: family-centered care, personal care, emotional empowerment, and information provision. With respect to convergence validation, there was positive correlation between this instrument and birth satisfaction scale (r=.34, pinstrument could be used as a measure of the quality of nursing care for women who have a normal vaginal delivery. © 2018 Korean Society of Nursing Science.

  20. A comparative study on the HW reliability assessment methods for digital I and C equipment

    Energy Technology Data Exchange (ETDEWEB)

    Jung, Hoan Sung; Sung, T. Y.; Eom, H. S.; Park, J. K.; Kang, H. G.; Lee, G. Y. [Korea Atomic Energy Research Institute, Taejeon (Korea); Kim, M. C. [Korea Advanced Institute of Science and Technology, Taejeon (Korea); Jun, S. T. [KHNP, Taejeon (Korea)

    2002-03-01

    It is necessary to predict or to evaluate the reliability of electronic equipment for the probabilistic safety analysis of digital instrument and control equipment. But most databases for the reliability prediction have no data for the up-to-date equipment and the failure modes are not classified. The prediction results for the specific component show different values according to the methods and databases. For boards and systems each method shows different values than others also. This study is for reliability prediction of PDC system for Wolsong NPP1 as a digital I and C equipment. Various reliability prediction methods and failure databases are used in calculation of the reliability to compare the effects of sensitivity and accuracy of each model and database. Many considerations for the reliability assessment of digital systems are derived with the results of this study. 14 refs., 19 figs., 15 tabs. (Author)

  1. Instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Decreton, M

    2001-04-01

    SCK-CEN's research and development programme on instrumentation involves the assessment and the development of sensitive measurement systems used within a radiation environment. Particular emphasis is on the assessment of optical fibre components and their adaptability to radiation environments. The evaluation of ageing processes of instrumentation in fission plants, the development of specific data evaluation strategies to compensate for ageing induced degradation of sensors and cable performance form part of these activities. In 2000, particular emphasis was on in-core reactor instrumentation applied to fusion, accelerator driven and water-cooled fission reactors. This involved the development of high performance instrumentation for irradiation experiments in the BR2 reactor in support of new instrumentation needs for MYRRHA, and for diagnostic systems for the ITER reactor.

  2. Instrumentation

    International Nuclear Information System (INIS)

    Decreton, M.

    2001-01-01

    SCK-CEN's research and development programme on instrumentation involves the assessment and the development of sensitive measurement systems used within a radiation environment. Particular emphasis is on the assessment of optical fibre components and their adaptability to radiation environments. The evaluation of ageing processes of instrumentation in fission plants, the development of specific data evaluation strategies to compensate for ageing induced degradation of sensors and cable performance form part of these activities. In 2000, particular emphasis was on in-core reactor instrumentation applied to fusion, accelerator driven and water-cooled fission reactors. This involved the development of high performance instrumentation for irradiation experiments in the BR2 reactor in support of new instrumentation needs for MYRRHA, and for diagnostic systems for the ITER reactor

  3. Extrapolation Method for System Reliability Assessment

    DEFF Research Database (Denmark)

    Qin, Jianjun; Nishijima, Kazuyoshi; Faber, Michael Havbro

    2012-01-01

    of integrals with scaled domains. The performance of this class of approximation depends on the approach applied for the scaling and the functional form utilized for the extrapolation. A scheme for this task is derived here taking basis in the theory of asymptotic solutions to multinormal probability integrals......The present paper presents a new scheme for probability integral solution for system reliability analysis, which takes basis in the approaches by Naess et al. (2009) and Bucher (2009). The idea is to evaluate the probability integral by extrapolation, based on a sequence of MC approximations...... that the proposed scheme is efficient and adds to generality for this class of approximations for probability integrals....

  4. Performance assessment instrument to assess the senior high students' psychomotor for the salt hydrolysis material

    Science.gov (United States)

    Nahadi, Firman, Harry; Yulina, Erlis

    2016-02-01

    The purposes of this study were to develop a performance assessment instrument for assessing the competence of psychomotor high school students on salt hydrolysis concepts. The design used in this study was the Research & Development which consists of three phases: development, testing and application of instruments. Subjects in this study were high school students in class XI science, which amounts to 93 students. In the development phase, seven validators validated 17 tasks instrument. In the test phase, we divided 19 students into three-part different times to conduct performance test in salt hydrolysis lab work and observed by six raters. The first, the second, and the third groups recpectively consist of five, six, and eight students. In the application phase, two raters observed the performance of 74 students in the salt hydrolysis lab work in several times. The results showed that 16 of 17 tasks of performance assessment instrument developed can be stated to be valid with CVR value of 1,00 and 0,714. While, the rest was not valid with CVR value was 0.429, below the critical value (0.622). In the test phase, reliability value of instrument obtained were 0,951 for the five-student group, 0,806 for the six-student group and 0,743 for the eight-student group. From the interviews, teachers strongly agree with the performance instrument developed. They stated that the instrument was feasible to use for maximum number of students were six in a single observation.

  5. Reliability and maintainability assessment factors for reliable fault-tolerant systems

    Science.gov (United States)

    Bavuso, S. J.

    1984-01-01

    A long term goal of the NASA Langley Research Center is the development of a reliability assessment methodology of sufficient power to enable the credible comparison of the stochastic attributes of one ultrareliable system design against others. This methodology, developed over a 10 year period, is a combined analytic and simulative technique. An analytic component is the Computer Aided Reliability Estimation capability, third generation, or simply CARE III. A simulative component is the Gate Logic Software Simulator capability, or GLOSS. The numerous factors that potentially have a degrading effect on system reliability and the ways in which these factors that are peculiar to highly reliable fault tolerant systems are accounted for in credible reliability assessments. Also presented are the modeling difficulties that result from their inclusion and the ways in which CARE III and GLOSS mitigate the intractability of the heretofore unworkable mathematics.

  6. Analysis and assessment of water treatment plant reliability

    Directory of Open Access Journals (Sweden)

    Szpak Dawid

    2017-03-01

    Full Text Available The subject of the publication is the analysis and assessment of the reliability of the surface water treatment plant (WTP. In the study the one parameter method of reliability assessment was used. Based on the flow sheet derived from the water company the reliability scheme of the analysed WTP was prepared. On the basis of the daily WTP work report the availability index Kg for the individual elements included in the WTP, was determined. Then, based on the developed reliability scheme showing the interrelationships between elements, the availability index Kg for the whole WTP was determined. The obtained value of the availability index Kg was compared with the criteria values.

  7. Development of the evaluation instrument use CIPP on the implementation of project assessment topic optik

    Science.gov (United States)

    Asfaroh, Jati Aurum; Rosana, Dadan; Supahar

    2017-08-01

    This research aims to develop an evaluation instrument models CIPP valid and reliable as well as determine the feasibility and practicality of an evaluation instrument models CIPP. An evaluation instrument models CIPP to evaluate the implementation of the project assessment topic optik to measure problem-solving skills of junior high school class VIII in the Yogyakarta region. This research is a model of development that uses 4-D. Subject of product trials are students in class VIII SMP N 1 Galur and SMP N 1 Sleman. Data collection techniques in this research using non-test techniques include interviews, questionnaires and observations. Validity in this research was analyzed using V'Aikens. Reliability analyzed using ICC. This research uses 7 raters are derived from two lecturers expert (expert judgment), two practitioners (science teacher) and three colleagues. The results of this research is the evaluation's instrument model of CIPP is used to evaluate the implementation of the implementation of the project assessment instruments. The validity result of evaluation instrument have V'Aikens values between 0.86 to 1, which means a valid and 0.836 reliability values into categories so well that it has been worth used as an evaluation instrument.

  8. Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

    Science.gov (United States)

    Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

    2014-01-01

    Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

  9. Instrument development and evaluation for patient-related outcomes assessments

    Directory of Open Access Journals (Sweden)

    Farnik M

    2012-03-01

    Full Text Available Małgorzata Farnik, Władysław PierzchałaDepartment of Pneumonology, Silesian University of Medicine, Katowice, PolandAbstract: Patient-related outcomes measures could provide important information for the current state of the art in medical care and even have an impact on macrodecisions in the health care system. Patient-related outcomes were initially defined as subjective health indicators that allow disability and illness to be assessed, based on patient, caregiver, or physician self-reports. As illness involves psychological and behavioral complex processes of care, a multidisciplinary approach in measuring patient-reported outcomes should be recommended, such as quality of life questionnaires. Patient-related outcomes measures should correspond to specific clinical situations and bring opportunities to improve quality of care. Objective measurements enable quantitative data to be collected and analyzed. Depending on the aim of the research, investigators can use existing methods or develop new tools. This publication presents a methodology for developing patient-related outcomes measures, based on a multistage procedure. The proper definition of specific study objectives and the methodology of instrument development are crucial for successfully transferring the study concept. The model of instrument development is the process of starting from the preliminary phase and includes questionnaire design and scaling, pilot testing (cognitive debriefing, revision of the preliminary version, evaluation of the new tool, and implementation. Validation of the new instrument includes reliability, reproducibility, internal consistency, and responsiveness. The process of designing the new tool should involve a panel of experts, including clinicians, psychologists (preliminary phase, and statisticians (scale development and scoring, and patients (cognitive debriefing. Implementation of a new tool should be followed by evaluation study – assessment of

  10. Under sodium reliability tests on core components and in-core instrumentation

    International Nuclear Information System (INIS)

    Ruppert, E.; Stehle, H.; Vinzens, K.

    1977-01-01

    A sodium test facility for fast breeder core components (AKB), built by INTERATOM at Bensberg, has been operating since 1971 to test fuel dummies and blanket elements as well as absorber elements under simulated normal and extreme reactor conditions. Individual full-scale fuel or blanket elements and arrays of seven elements, modelling a section of the SNR-300 reactor core, have been tested under a wide range of sodium mass flow and isothermal test conditions up to 925K as well as under cyclic changed temperature transients. Besides endurance testing of the core components a special sodium and high-temperature instrumentation is provided to investigate thermohydraulic and vibrational behaviour of the test objects. During all test periods the main subassembly characteristics could be reproduced and the reliability of the instrumentation could be proven. (orig.) [de

  11. Good practices in normal childbirth: reliability analysis of an instrument by Cronbach's Alpha.

    Science.gov (United States)

    Gottems, Leila Bernarda Donato; Carvalho, Elisabete Mesquita Peres De; Guilhem, Dirce; Pires, Maria Raquel Gomes Maia

    2018-01-01

    to analyze the internal consistency of the evaluation instrument of the adherence to the good practices of childbirth and birth care in the professionals, through Cronbach's Alpha Coefficient for each of the dimensions and for the total instrument. this is a descriptive and cross-sectional study performed in obstetric centers of eleven public hospitals in the Federal District, with a questionnaire applied to 261 professionals who worked in the delivery care. The study was attended by 261 professionals, 42.5% (111) nurses and 57.5% (150) physicians. The reliability evaluation of the instrument by the Cronbach Alfa resulted in 0.53, 0.78 and 0.76 for dimensions 1, 2 and 3, after debugging that resulted in the exclusion of 11 items. the instrument obtained Cronbach's alpha of 0.80. There is a need for improvement in the items of dimension 1 that refer to attitudes, knowledge, and practices of the organization of the network of care to gestation, childbirth, and birth. However, it can be applied in the way it is used to evaluate practices based on scientific evidence of childbirth care.

  12. The reliability and validity of Cognitive Abilities Screening Instrument C-2.0 in Screening elderly people in Chengdu

    Institute of Scientific and Technical Information of China (English)

    Luo Zhuming; Lu Rong

    2000-01-01

    Background: Cognitive Abilities Screening Instrument C-2.0 (CASI C-2.0) is founded on Chinese culture apply to person with little or no formal education.Objective: In order to assess the reliability and validity of Cognitive Abilities Screening Instrument C-2.0 (CASI C-2.0), we surveyed 807 persons aged from 55 to 100 years and with little or no formal education in the town and country of Chengdu city. Methods: Phase I: 807 persona were assessed by different doctors with CASI C-2.0 and Mini mental State Examination (MMSE). Phase Ⅱ: The positive persons of phase I were assessed by trained field physicians who did not know the CASI C-2.0 and MMSE scores. The physicians assessment included a detail history, a systematic physical examination and a selected group of psychometric tests to ascertain the clinical diagnoses of dementia、 Alzheimer′s disease and vascular dementia utilizing the ICD-10 and NINCDS-ADRAD、 DSM-Ⅳ criteria respectively. Phase Ⅲ: 30 persons were retest with CASI C-2.0 randomly after 3--4 weeks. Results: Among the 807 persons, 55 cases of dementia were identified, including 50 cases of probable Alzheimer′s disease and 5 cases of vascular dementia. Discussion: On reliability, the test-retest reliability coefficient of CASI C-2.0 is 0.97,p<0.001, the person′s correlation coefficient between nine items scores and total scores are all above 0.66, the Cronback a is 0.9056, the split-half reliability coefficient is 0.8355. On validity, using ICD-10 criteria as ”Gold Criteria" and 50 as a cut-offscore, the sensitivity、 specificity、 accuracy of CASI C-2.0 are 94.5%、 89.5%、 89.8% respectively, kappa is 0.5123. Comparing with MMSE, CAS1 C-2.0 has a better specificity, x2 test, p<0.01; a same sensitivity; and a lower refusal answer ratio, x2 test, p<0.005. Conclusion: We consider that CASI C-2.0 has excellent reliability and validity. It is worthy of disseminating and applying for both clinical and epidemiological surveys.

  13. Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism: A novel assessment instrument.

    Science.gov (United States)

    Kesselheim, Jennifer C; Agrawal, Anurag K; Bhatia, Nita; Cronin, Angel; Jubran, Rima; Kent, Paul; Kersun, Leslie; Rao, Amulya Nageswara; Rose, Melissa; Savelli, Stephanie; Sharma, Mukta; Shereck, Evan; Twist, Clare J; Wang, Michael

    2017-05-01

    Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). For 90 participating fellows (74%), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31%) were identified as needing support. The self-assessment had a sensitivity of 50% (95% confidence interval [CI]: 31-69) and a specificity of 77% (95% CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales. © 2016 Wiley Periodicals, Inc.

  14. A Turkish version of myocardial infarction dimensional assessment scale (TR-MIDAS): reliability-validity assesment.

    Science.gov (United States)

    Uysal, Hilal; Ozcan, Şeyda

    2011-06-01

    Many new measuring devices have been developed so that broader psychometric measurements in the coronary artery disease, disease-specific health status measurements, and identification of the broader quality of life can be performed in the recent years. The study was intended to determine whether, and to what extent, MIDAS is a valid and reliable measurement to the patients suffering from myocardial infarction for the first time in Turkey. The research was conducted with the patients hospitalized and treated with myocardial infarction in the cardiology departments of 2 hospitals in Istanbul, Turkey, between 2007 and 2008. Psychometric evaluations of TR-MIDAS were used for validity studies; language validity, content validity, construct validity were examined. For reliability studies; the tool's internal consistency reliability, Cronbach's alpha reliability coefficient, and test-retest reliability were completed. The instrument's content validity index was determined to be "0.95". Principal component analysis revealed six factors with an eigenvalue >1.5. Cronbach's alpha was found to be 0.89 for total scale which was an acceptable value. The total's test-retest reliability was 0.51 (p<0.01). Data obtained at the end of the study supports that Turkish Myocardial Infarction Dimensional Assessment Scale is a valid and reliable instrument as a disease-specific scale to assess the patients' quality of life suffering from myocardial infarction in Turkey. Copyright © 2010 European Society of Cardiology. Published by Elsevier B.V. All rights reserved.

  15. Assessing the Impact of Imperfect Diagnosis on Service Reliability

    DEFF Research Database (Denmark)

    Grønbæk, Lars Jesper; Schwefel, Hans-Peter; Kjærgaard, Jens Kristian

    2010-01-01

    , representative diagnosis performance metrics have been defined and their closed-form solutions obtained for the Markov model. These equations enable model parameterization from traces of implemented diagnosis components. The diagnosis model has been integrated in a reliability model assessing the impact...... of the diagnosis functions for the studied reliability problem. In a simulation study we finally analyze trade-off properties of diagnosis heuristics from literature, map them to the analytic Markov model, and investigate its suitability for service reliability optimization....

  16. Validity and reliability of an instrumented leg-extension machine for measuring isometric muscle strength of the knee extensors.

    Science.gov (United States)

    Ruschel, Caroline; Haupenthal, Alessandro; Jacomel, Gabriel Fernandes; Fontana, Heiliane de Brito; Santos, Daniela Pacheco dos; Scoz, Robson Dias; Roesler, Helio

    2015-05-20

    Isometric muscle strength of knee extensors has been assessed for estimating performance, evaluating progress during physical training, and investigating the relationship between isometric and dynamic/functional performance. To assess the validity and reliability of an adapted leg-extension machine for measuring isometric knee extensor force. Validity (concurrent approach) and reliability (test and test-retest approach) study. University laboratory. 70 healthy men and women aged between 20 and 30 y (39 in the validity study and 31 in the reliability study). Intraclass correlation coefficient (ICC) values calculated for the maximum voluntary isometric torque of knee extensors at 30°, 60°, and 90°, measured with the prototype and with an isokinetic dynamometer (ICC2,1, validity study) and measured with the prototype in test and retest sessions, scheduled from 48 h to 72 h apart (ICC1,1, reliability study). In the validity analysis, the prototype showed good agreement for measurements at 30° (ICC2,1 = .75, SEM = 18.2 Nm) and excellent agreement for measurements at 60° (ICC2,1 = .93, SEM = 9.6 Nm) and at 90° (ICC2,1 = .94, SEM = 8.9 Nm). Regarding the reliability analysis, between-days' ICC1,1 were good to excellent, ranging from .88 to .93. Standard error of measurement and minimal detectable difference based on test-retest ranged from 11.7 Nm to 18.1 Nm and 32.5 Nm to 50.1 Nm, respectively, for the 3 analyzed knee angles. The analysis of validity and repeatability of the prototype for measuring isometric muscle strength has shown to be good or excellent, depending on the knee joint angle analyzed. The new instrument, which presents a relative low cost and easiness of transportation when compared with an isokinetic dynamometer, is valid and provides consistent data concerning isometric strength of knee extensors and, for this reason, can be used for practical, clinical, and research purposes.

  17. Development, reliability, and validity of the Posttraumatic Stress Disorder Interview for Vietnamese refugees: a diagnostic instrument for Vietnamese refugees.

    Science.gov (United States)

    Dao, Tam K; Poritz, Julia M P; Moody, Rachel P; Szeto, Kim

    2012-08-01

    The Posttraumatic Stress Disorder Interview for Vietnamese Refugees (PTSD-IVR) was created specifically to assess for the presence of current and lifetime history of premigration, migration, encampment, and postmigration traumas in Vietnamese refugees. The purpose of the present study was to describe the development of and investigate the interrater and test-retest reliability of the PTSD-IVR and its validity in relation to the diagnoses obtained from the Longitudinal, Expert, and All Data (LEAD; Spitzer, 1983) standard. Clinicians conducted the diagnosis process with 127 Vietnamese refugees using the LEAD standard and the PTSD-IVR. Assessment of the reliability and validity of the PTSD-IVR yielded good to excellent AUC (area under the receiver operating characteristic curve; .86, .87) and κ values (.66, .74) indicating the reliability of the PTSD-IVR and the agreement between the LEAD procedure and the PTSD-IVR. The results of the present study suggest that the PTSD-IVR performs successfully as a diagnostic instrument specifically created for Vietnamese refugees in their native language. Copyright © 2012 International Society for Traumatic Stress Studies.

  18. DEVELOPMENT OF PERFORMANCE ASSESSMENT INSTRUMENT FOR NURSES BASED ON WEB IN INPATIENT UNIT

    Directory of Open Access Journals (Sweden)

    Aprilia Nuryanti

    2017-06-01

    Full Text Available Introduction: Performance assessment instrument will be problematic when it is not representative in describing the competency because it is not obvious indicators and inappropriate performance standard to nursing’s task. The purpose of this study is to develop nurses’ performance assessment instrument based on the web from multi sources assessment inpatient unit at SMC Hospital. Methods: This study had two phases. The first phase was an explanatory overview of the performance assessment system using questionnaires completed by 53 respondents of nurses, selected by purposive sampling. Instrument development based on FGD with six decision makers in the hospital. Validity was tested by Pearson Product Moment Correlation and reliability of instrument’s was tested by alpha Cronbach. The second phase was socialization and instrument test to observe the quality of instrument using a questionnaire by 47 respondents and recommendations made by 8 participants of FGD. The samples were selected by purposive sampling technique. Performance assessment system was moderate at 58.49%. All questions which aimed to measure the performance of nurses were valid and reliable. The quality of nurses’ performance assessment instruments based on the web was a good category, which was functionality: 81.60; reliability: 78.16; efficiency: 80.85; usability: 81.70 and portability: 81.70. Results: The result was a web-based assessment format, scoring with Likert scale, resource assessment by the direct supervisor which was a multisource evaluator, the development of performance graph, and confidentiality of data on the database server. Discussion: Recommendations for hospital is to make policy based on the final value of the performance assessment by the supervisor which was multisource feedback and it needs a global writing on a form of performance assessment result.

  19. Instrumentation

    International Nuclear Information System (INIS)

    Decreton, M.

    2002-01-01

    SCK-CEN's R and D programme on instrumentation involves the development of advanced instrumentation systems for nuclear applications as well as the assessment of the performance of these instruments in a radiation environment. Particular emphasis is on the use of optical fibres as umbilincal links of a remote handling unit for use during maintanance of a fusion reacor, studies on the radiation hardening of plasma diagnostic systems; investigations on new instrumentation for the future MYRRHA accelerator driven system; space applications related to radiation-hardened lenses; the development of new approaches for dose, temperature and strain measurements; the assessment of radiation-hardened sensors and motors for remote handling tasks and studies of dose measurement systems including the use of optical fibres. Progress and achievements in these areas for 2001 are described

  20. Instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Decreton, M

    2002-04-01

    SCK-CEN's R and D programme on instrumentation involves the development of advanced instrumentation systems for nuclear applications as well as the assessment of the performance of these instruments in a radiation environment. Particular emphasis is on the use of optical fibres as umbilincal links of a remote handling unit for use during maintanance of a fusion reacor, studies on the radiation hardening of plasma diagnostic systems; investigations on new instrumentation for the future MYRRHA accelerator driven system; space applications related to radiation-hardened lenses; the development of new approaches for dose, temperature and strain measurements; the assessment of radiation-hardened sensors and motors for remote handling tasks and studies of dose measurement systems including the use of optical fibres. Progress and achievements in these areas for 2001 are described.

  1. Reliability and Validity of the "Decision-Making Skills Instrument for Children"

    Science.gov (United States)

    Pekdogan, Serpil; Ulutas, Ilkay

    2016-01-01

    The purpose of this study is to develop a valid and reliable data collection tool to assess the decision-making skills of children at the age of 5 to 6. The study group is composed of 300 children attending independent pre-schools located in the central district of Amasya province and their parents. In the study, four-factor and 29-item…

  2. Probabilistic simulation applications to reliability assessments

    International Nuclear Information System (INIS)

    Miller, Ian; Nutt, Mark W.; Hill, Ralph S. III

    2003-01-01

    Probabilistic risk/reliability (PRA) analyses for engineered systems are conventionally based on fault-tree methods. These methods are mature and efficient, and are well suited to systems consisting of interacting components with known, low probabilities of failure. Even complex systems, such as nuclear power plants or aircraft, are modeled by the careful application of these approaches. However, for systems that may evolve in complex and nonlinear ways, and where the performance of components may be a sensitive function of the history of their working environments, fault-tree methods can be very demanding. This paper proposes an alternative method of evaluating such systems, based on probabilistic simulation using intelligent software objects to represent the components of such systems. Using a Monte Carlo approach, simulation models can be constructed from relatively simple interacting objects that capture the essential behavior of the components that they represent. Such models are capable of reflecting the complex behaviors of the systems that they represent in a natural and realistic way. (author)

  3. Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia.

    Science.gov (United States)

    Kadar, Masne; Ibrahim, Suhaili; Razaob, Nor Afifi; Chai, Siaw Chui; Harun, Dzalani

    2018-02-01

    The Lawton Instrumental Activities of Daily Living Scale is a tool often used to assess independence among elderly at home. Its suitability to be used with the elderly population in Malaysia has not been validated. This current study aimed to assess the validity and reliability of the Lawton Instrumental Activities of Daily Living Scale - Malay Version to Malay speaking elderly in Malaysia. This study was divided into three phases: (1) translation and linguistic validity involving both forward and backward translations; (2) establishment of face validity and content validity; and (3) establishment of reliability involving inter-rater, test-retest and internal consistency analyses. Data used for these analyses were obtained by interviewing 65 elderly respondents. Percentages of Content Validity Index for 4 criteria were from 88.89 to 100.0. The Cronbach α coefficient for internal consistency was 0.838. Intra-class Correlation Coefficient of inter-rater reliability and test-retest reliability was 0.957 and 0.950 respectively. The result shows that the Lawton Instrumental Activities of Daily Living Scale - Malay Version has excellent reliability and validity for use with the Malay speaking elderly people in Malaysia. This scale could be used by professionals to assess functional ability of elderly who live independently in community. © 2018 Occupational Therapy Australia.

  4. Assessing Ultraviolet Hazards Using Portable Measuring Instruments

    International Nuclear Information System (INIS)

    Ridyard, A.

    2000-01-01

    The 'Erythemal Action Spectrum' shows an increase of 10 3 in human skin sensitivity to UV radiation over only 30 nm of change of wavelength, from 328 nm to 298 nm. This represents a severe challenge to the manufacturing and calibration of a portable instrument which can measure the vanishingly small amounts of short wavelength UV from solarium tanning lamps, and to apply accurately an action spectra to be able to quantify the hazard presented by such lamps to skin. The classification of UV lamp types from their 'effective irradiance' requires very sharp discrimination between UV power contained in the short wavelength and the long wavelength parts of the UV spectra, so radiometers give misleading results. The only instrument suitable for making these measurements is the spectroradiometer. The development of such an instrument in a hand held portable form is described, with the difficulties associated with its calibration and such factors as stray light rejection. (author)

  5. Systems reliability analysis: applications of the SPARCS System-Reliability Assessment Computer Program

    International Nuclear Information System (INIS)

    Locks, M.O.

    1978-01-01

    SPARCS-2 (Simulation Program for Assessing the Reliabilities of Complex Systems, Version 2) is a PL/1 computer program for assessing (establishing interval estimates for) the reliability and the MTBF of a large and complex s-coherent system of any modular configuration. The system can consist of a complex logical assembly of independently failing attribute (binomial-Bernoulli) and time-to-failure (Poisson-exponential) components, without regard to their placement. Alternatively, it can be a configuration of independently failing modules, where each module has either or both attribute and time-to-failure components. SPARCS-2 also has an improved super modularity feature. Modules with minimal-cut unreliabiliy calculations can be mixed with those having minimal-path reliability calculations. All output has been standardized to system reliability or probability of success, regardless of the form in which the input data is presented, and whatever the configuration of modules or elements within modules

  6. Assessment of Equipment Capability to Perform Reliably under Severe Accident Conditions

    International Nuclear Information System (INIS)

    2017-07-01

    The experience from the last 40 years has shown that severe accidents can subject electrical and instrumentation and control (I&C) equipment to environmental conditions exceeding the equipment’s original design basis assumptions. Severe accident conditions can then cause rapid degradation or damage to various degrees up to complete failure of such equipment. This publication provides the technical basis to consider when assessing the capability of electrical and I&C equipment to perform reliably during a severe accident. It provides examples of calculation tools to determine the environmental parameters as well as examples and methods that Member States can apply to assess equipment reliability.

  7. Resident Assessment Instrument/Minimum Data Set (RAI/MDS)

    Data.gov (United States)

    Department of Veterans Affairs — The Resident Assessment Instrument/Minimum Data Set (RAI/MDS) is a comprehensive assessment and care planning process used by the nursing home industry since 1990 as...

  8. Instrumentation

    International Nuclear Information System (INIS)

    Umminger, K.

    2008-01-01

    A proper measurement of the relevant single and two-phase flow parameters is the basis for the understanding of many complex thermal-hydraulic processes. Reliable instrumentation is therefore necessary for the interaction between analysis and experiment especially in the field of nuclear safety research where postulated accident scenarios have to be simulated in experimental facilities and predicted by complex computer code systems. The so-called conventional instrumentation for the measurement of e. g. pressures, temperatures, pressure differences and single phase flow velocities is still a solid basis for the investigation and interpretation of many phenomena and especially for the understanding of the overall system behavior. Measurement data from such instrumentation still serves in many cases as a database for thermal-hydraulic system codes. However some special instrumentation such as online concentration measurement for boric acid in the water phase or for non-condensibles in steam atmosphere as well as flow visualization techniques were further developed and successfully applied during the recent years. Concerning the modeling needs for advanced thermal-hydraulic codes, significant advances have been accomplished in the last few years in the local instrumentation technology for two-phase flow by the application of new sensor techniques, optical or beam methods and electronic technology. This paper will give insight into the current state of instrumentation technology for safety-related thermohydraulic experiments. Advantages and limitations of some measurement processes and systems will be indicated as well as trends and possibilities for further development. Aspects of instrumentation in operating reactors will also be mentioned.

  9. 75 FR 66038 - Planning Resource Adequacy Assessment Reliability Standard

    Science.gov (United States)

    2010-10-27

    ..., providing a common framework for resource adequacy analysis, assessment, and documentation) effectively and...://www.nerc.com/commondocs.php?cd=2 . D. Proposed Effective Date 24. Proposed regional Reliability...

  10. Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

    Science.gov (United States)

    Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

    2018-02-15

    This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

  11. Test-retest reliability and cross validation of the functioning everyday with a wheelchair instrument.

    Science.gov (United States)

    Mills, Tamara L; Holm, Margo B; Schmeler, Mark

    2007-01-01

    The purpose of this study was to establish the test-retest reliability and content validity of an outcomes tool designed to measure the effectiveness of seating-mobility interventions on the functional performance of individuals who use wheelchairs or scooters as their primary seating-mobility device. The instrument, Functioning Everyday With a Wheelchair (FEW), is a questionnaire designed to measure perceived user function related to wheelchair/scooter use. Using consumer-generated items, FEW Beta Version 1.0 was developed and test-retest reliability was established. Cross-validation of FEW Beta Version 1.0 was then carried out with five samples of seating-mobility users to establish content validity. Based on the content validity study, FEW Version 2.0 was developed and administered to seating-mobility consumers to examine its test-retest reliability. FEW Beta Version 1.0 yielded an intraclass correlation coefficient (ICC) Model (3,k) of .92, p content validity results revealed that FEW Beta Version 1.0 captured 55% of seating-mobility goals reported by consumers across five samples. FEW Version 2.0 yielded ICC(3,k) = .86, p content validity of FEW Version 2.0 was confirmed. FEW Beta Version 1.0 and FEW Version 2.0 were highly stable in their measurement of participants' seating-mobility goals over a 1-week interval.

  12. Development and Reliability Evaluation of the Movement Rating Instrument for Virtual Reality Video Game Play.

    Science.gov (United States)

    Levac, Danielle; Nawrotek, Joanna; Deschenes, Emilie; Giguere, Tia; Serafin, Julie; Bilodeau, Martin; Sveistrup, Heidi

    2016-06-01

    Virtual reality active video games are increasingly popular physical therapy interventions for children with cerebral palsy. However, physical therapists require educational resources to support decision making about game selection to match individual patient goals. Quantifying the movements elicited during virtual reality active video game play can inform individualized game selection in pediatric rehabilitation. The objectives of this study were to develop and evaluate the feasibility and reliability of the Movement Rating Instrument for Virtual Reality Game Play (MRI-VRGP). Item generation occurred through an iterative process of literature review and sample videotape viewing. The MRI-VRGP includes 25 items quantifying upper extremity, lower extremity, and total body movements. A total of 176 videotaped 90-second game play sessions involving 7 typically developing children and 4 children with cerebral palsy were rated by 3 raters trained in MRI-VRGP use. Children played 8 games on 2 virtual reality and active video game systems. Intraclass correlation coefficients (ICCs) determined intra-rater and interrater reliability. Excellent intrarater reliability was evidenced by ICCs of >0.75 for 17 of the 25 items across the 3 raters. Interrater reliability estimates were less precise. Excellent interrater reliability was achieved for far reach upper extremity movements (ICC=0.92 [for right and ICC=0.90 for left) and for squat (ICC=0.80) and jump items (ICC=0.99), with 9 items achieving ICCs of >0.70, 12 items achieving ICCs of between 0.40 and 0.70, and 4 items achieving poor reliability (close-reach upper extremity-ICC=0.14 for right and ICC=0.07 for left) and single-leg stance (ICC=0.55 for right and ICC=0.27 for left). Poor video quality, differing item interpretations between raters, and difficulty quantifying the high-speed movements involved in game play affected reliability. With item definition clarification and further psychometric property evaluation, the MRI

  13. Identifying the Barriers to Using Games and Simulations in Education: Creating a Valid and Reliable Survey Instrument

    Science.gov (United States)

    Justice, Lenora Jean

    2012-01-01

    The purpose of this study was to create a valid and reliable instrument to measure teacher perceived barriers to the adoption of games and simulations in instruction. Previous research, interviews with educators, a focus group, an expert review, and a think aloud protocol were used to design a survey instrument. After finalization, the survey was…

  14. Development of Assessment Instrument of Critical Thinking in Physics at Senior High School

    Science.gov (United States)

    Sugiarti, T.; Kaniawati, I.; Aviyanti, L.

    2017-02-01

    The result of preliminary study shows that the assessment of physics in school did not train students’ critical thinking skill. The assessment instrument just measured low cognitive aspects. Supposedly, critical thinking skill is trained in the assessment activity. The study aims to determine the characteristics and the quality of critical thinking skill instrument. It employs descriptive-qualitative method with research and development as the research design. The research participants are 35 students involved in the limited trial and 188 students in the wider trial from three public senior high school in Ciamis which in high level school. The data was collected through expert validation, tests and interviews. The results indicate that the characteristics of the assessment instrument of critical thinking skill is open-ended. The instrument fulfills some indicators namely analyzing argument, deduction, induction, and display information in the form of scenario, text, graphic and table. In addition, the data processing through V4 Anates program shows that the instrument reliability achieves 0.67 with high interpretation of 0.67 and the validity is 0.47 with enough interpretation. Thus, the assessment instrument of critical thinking skill in the form of open-ended essay meets the criteria of quality test, so it can use as instrument of assessment critical thinking skill.

  15. [Development and validation of an instrument for initial nursing assessment].

    Science.gov (United States)

    Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

    2012-12-01

    The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

  16. Assessment on Hybrid E-Learning Instrument

    OpenAIRE

    Intan Farahana Kamsin; Rosseni Din

    2015-01-01

    This study aims to improve Hybrid e-Learning 9.3. A total of 233 students of International Islamic University Malaysia, Gombak who have the experience in hybrid teaching and learning were involved as respondents. Rasch Measurement Model was used for this study. Validity analyses conducted were on (i) the compatibility of the items, (ii) mapping of items and respondents, (iii) scaling of instruments, and (iv) unidimentional items. The findings of the study show that (i) the items developed cor...

  17. Assessing Ultraviolet Hazards Using Portable Measuring Instruments

    Energy Technology Data Exchange (ETDEWEB)

    Ridyard, A

    2000-07-01

    The 'Erythemal Action Spectrum' shows an increase of 10{sup 3} in human skin sensitivity to UV radiation over only 30 nm of change of wavelength, from 328 nm to 298 nm. This represents a severe challenge to the manufacturing and calibration of a portable instrument which can measure the vanishingly small amounts of short wavelength UV from solarium tanning lamps, and to apply accurately an action spectra to be able to quantify the hazard presented by such lamps to skin. The classification of UV lamp types from their 'effective irradiance' requires very sharp discrimination between UV power contained in the short wavelength and the long wavelength parts of the UV spectra, so radiometers give misleading results. The only instrument suitable for making these measurements is the spectroradiometer. The development of such an instrument in a hand held portable form is described, with the difficulties associated with its calibration and such factors as stray light rejection. (author)

  18. School Climate: Historical Review, Instrument Development, and School Assessment

    Science.gov (United States)

    Zullig, Keith J.; Koopman, Tommy M.; Patton, Jon M.; Ubbes, Valerie A.

    2010-01-01

    This study's purpose is to examine the existing school climate literature in an attempt to constitute its definition from a historical context and to create a valid and reliable student-reported school climate instrument. Five historically common school climate domains and five measurement tools were identified, combined, and previewed by the…

  19. Reliability and comparison of acromion assessment techniques on x-ray and magnetic resonance imaging (reliability of acromion assessment techniques)

    International Nuclear Information System (INIS)

    Viskontas, D.G.; MacDermid, J.C.; Drosdowech, D.S.; Garvin, G.J.; Romano, W.M.; Faber, K.J.

    2005-01-01

    To determine the reliability and correlation of plain radiography and magnetic resonance imaging (MRI) in the assessment of acromion morphology. Materials and Methods: Acromion morphology was assessed using the lateral acromion angle (LAA) and the acromion-humeral interval (AHI). Thirty patients who had x-rays and MRI for impingement syndrome were included. Six blinded observers assessed the acromion morphology subjectively and objectively. Results: Neither acromion assessment technique demonstrated a positive correlation (kappa and intraclass coefficient 0.55) when measured objectively by experienced observers. Conclusion: The LAA and the AHI are both reliable acromion assessment techniques on X-ray and MRI when measured objectively and by experienced observers. (author)

  20. Sequential optimization and reliability assessment method for metal forming processes

    International Nuclear Information System (INIS)

    Sahai, Atul; Schramm, Uwe; Buranathiti, Thaweepat; Chen Wei; Cao Jian; Xia, Cedric Z.

    2004-01-01

    Uncertainty is inevitable in any design process. The uncertainty could be due to the variations in geometry of the part, material properties or due to the lack of knowledge about the phenomena being modeled itself. Deterministic design optimization does not take uncertainty into account and worst case scenario assumptions lead to vastly over conservative design. Probabilistic design, such as reliability-based design and robust design, offers tools for making robust and reliable decisions under the presence of uncertainty in the design process. Probabilistic design optimization often involves double-loop procedure for optimization and iterative probabilistic assessment. This results in high computational demand. The high computational demand can be reduced by replacing computationally intensive simulation models with less costly surrogate models and by employing Sequential Optimization and reliability assessment (SORA) method. The SORA method uses a single-loop strategy with a series of cycles of deterministic optimization and reliability assessment. The deterministic optimization and reliability assessment is decoupled in each cycle. This leads to quick improvement of design from one cycle to other and increase in computational efficiency. This paper demonstrates the effectiveness of Sequential Optimization and Reliability Assessment (SORA) method when applied to designing a sheet metal flanging process. Surrogate models are used as less costly approximations to the computationally expensive Finite Element simulations

  1. Assessment of Patient-Reported Outcome Instruments to Assess Chronic Low Back Pain.

    Science.gov (United States)

    Ramasamy, Abhilasha; Martin, Mona L; Blum, Steven I; Liedgens, Hiltrud; Argoff, Charles; Freynhagen, Rainer; Wallace, Mark; McCarrier, Kelly P; Bushnell, Donald M; Hatley, Noël V; Patrick, Donald L

    2017-06-01

     To identify patient-reported outcome (PRO) instruments that assess chronic low back pain (cLBP) symptoms (specifically pain qualities) and/or impacts for potential use in cLBP clinical trials to demonstrate treatment benefit and support labeling claims.  Literature review of existing PRO measures.  Publications detailing existing PRO measures for cLBP were identified, reviewed, and summarized. As recommended by the US Food & Drug Administration (FDA) PRO development guidance, standard measurement characteristics were reviewed, including development history, psychometric properties (validity and reliability), ability to detect change, and interpretation of observed changes.  Thirteen instruments were selected and reviewed: Low Back Pain Bothersomeness Scale, Neuropathic Pain Symptom Inventory, PainDETECT, Pain Quality Assessment Scale Revised, Revised Short Form McGill Pain Questionnaire, Low Back Pain Impact Questionnaire, Oswestry Disability Index, Pain Disability Index, Roland-Morris Disability Questionnaire, Brief Pain Inventory and Brief Pain Inventory Short Form, Musculoskeletal Outcomes Data Evaluation and Management System Spine Module, Orebro Musculoskeletal Pain Questionnaire, and the West Haven-Yale Multidimensional Pain Inventory Interference Scale. The instruments varied in the aspects of pain and/or impacts that they assessed, and none of the instruments fulfilled all criteria for use in clinical trials to support labeling claims based on recommendations outlined in the FDA PRO guidance.  There is an unmet need for a validated PRO instrument to evaluate cLBP-related symptoms and impacts for use in clinical trials. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

  2. Reliability of the input admittance of bowed-string instruments measured by the hammer method.

    Science.gov (United States)

    Zhang, Ailin; Woodhouse, Jim

    2014-12-01

    The input admittance at the bridge, measured by hammer testing, is often regarded as the most useful and convenient measurement of the vibrational behavior of a bowed string instrument. However, this method has been questioned, due especially to differences between human bowing and hammer impact. The goal of the research presented here is to investigate the reliability and accuracy of this classic hammer method. Experimental studies were carried out on cellos, with three different driving conditions and three different boundary conditions. Results suggest that there is nothing fundamentally different about the hammer method, compared to other kinds of excitation. The third series of experiments offers an opportunity to explore the difference between the input admittance measuring from one bridge corner to another and that of single strings. The classic measurement is found to give a reasonable approximation to that of all four strings. Some possible differences between the hammer method and normal bowing and implications of the acoustical results are also discussed.

  3. The reliability and validity of the short version of the WHO Quality of Life Instrument in an Arab general population

    International Nuclear Information System (INIS)

    Ohaeri, Jude U; Awadallab, Abdel W

    2009-01-01

    There is rising interest in quality of life (QOL) research in Arabian countries. The aim of this study was to assess in a nationwide sample of Kuwaiti subjects the reliability and validity of the World Health Organization Quality of Life (WHOQOL-BREF), a shorter version of the widely used QOL assessment instrument that comprises 26 items in the domains of physical health, psychological health, social relationships, and the environment. A one-in-three systematic random proportionate sample of consenting Kuwaiti nationals attending large cooperative stores and municipal government offices in the six governorates completed the Arabic translation of the questionnaire. The indices assessed included test-retest reliability, internal consistency, item internal consistency (2C), item discriminant validity (IDV), known-groups and construct validity. There were 3303 participants (44.8% males, 55.2% females, mean age 35.4 years, range 16 to 87 years). The intra-class correlation for the test-retest statistic and the internal consistency values for the full questionnaire and the domains had a Cronbach's alpha > - 0.7. Of the 24 items that constitute the domains, 21 met the 2 C requirement of correlation > - 0.4 with the corresponding domain, while 16 met the IDV criterion of having a higher correlation with their corresponding domain than other domains. Domain scores discriminated significantly between well and sick groups. In the factor analysis, four strong factors emerged with the same construct as in the WHO report. The Arabic translation of the WHOQOL-BREF has impressive reliability and validity indices. The poor IDV findings are due to the multidimensional nature of the questionnaire. The highly significant validity indices should reassure researchers that the questionnaire represents the same constructs across cultures. Negatively worded items possibly need refinement. (author)

  4. Reliability and Validity of the Greek Migraine Disability Assessment (MIDAS) Questionnaire.

    Science.gov (United States)

    Oikonomidi, Theodora; Vikelis, Michail; Artemiadis, Artemios; Chrousos, George P; Darviri, Christina

    2018-03-01

    The Migraine Disability Assessment (MIDAS) Questionnaire is a reliable and valid instrument for migraine-related disability. Such a tool is needed to quantify migraine-related disability in the Greek population. This validation study aims to assess the test-retest reliability, internal consistency, item discriminant and convergent validity of the Greek translation of the MIDAS. Adults diagnosed with migraine completed the MIDAS Questionnaire on two occasions 3 weeks apart to assess reliability, and completed the RAND-36 to assess validity. Participants (n = 152) had a median MIDAS score of 24 and mostly severe disability (58% were grade IV). The test-retest reliability analysis (N = 59) revealed excellent reliability for the total score. Internal consistency was α = 0.71 for initial and α = 0.82 for retest completion. For item discriminant validity, the correlations between each question and the total score were significant, with high correlations for questions 2-5 (range 0.67 ≤ r ≤ 0.79; p MIDAS score tended to have better wellbeing. Psychometric properties are comparable with those of other published validation studies of the MIDAS and the original. Findings on question 1 show that missing work/school days may be closely related with increased affect issues. The Greek version of the MIDAS Questionnaire has good reliability and validity. This study allowed for cross-cultural comparability of research findings.

  5. Translation, reliability, and clinical utility of the Melbourne Assessment 2.

    Science.gov (United States)

    Gerber, Corinna N; Plebani, Anael; Labruyère, Rob

    2017-10-12

    The aims were to (i) provide a German translation of the Melbourne Assessment 2 (MA2), a quantitative test to measure unilateral upper limb function in children with neurological disabilities and (ii) to evaluate its reliability and aspects of clinical utility. After its translation into German and approval of the back translation by the original authors, the MA2 was performed and videotaped twice with 30 children with neuromotor disorders. For each participant, two raters scored the video of the first test for inter-rater reliability. To determine test-retest reliability, one rater additionally scored the video of the second test while the other rater repeated the scoring of the first video to evaluate intra-rater reliability. Time needed for rater training, test administration, and scoring was recorded. The four subscale scores showed excellent intra-, inter-rater, and test-retest reliability with intraclass correlation coefficients of 0.90-1.00 (95%-confidence intervals 0.78-1.00). Score items revealed substantial to almost perfect intra-rater reliability (weighted kappa k w  = 0.66-1.00) for the more affected side. Score item inter-rater and test-retest reliability of the same extremity were, with one exception, moderate to almost perfect (k w  = 0.42-0.97; k w  = 0.40-0.89). Furthermore, the MA2 was feasible and acceptable for patients and clinicians. The MA2 showed excellent subscale and moderate to almost perfect score item reliability. Implications for Rehabilitation There is a lack of high-quality studies about psychometric properties of upper limb measurement tools in the neuropediatric population. The Melbourne Assessment 2 is a promising tool for reliable measurement of unilateral upper limb movement quality in the neuropediatric population. The Melbourne Assessment 2 is acceptable and practicable to therapists and patients for routine use in clinical care.

  6. Is the Frontal Assessment Battery reliable in ALS patients?

    NARCIS (Netherlands)

    Raaphorst, J.; Beeldman, E.; Jaeger, B.; Schmand, B.A.; Berg, L.H. van den; Weikamp, J.G.; Schelhaas, H.J.; Visser, M. de; Haan, R.J. de

    2013-01-01

    The assessment of frontal functions in ALS patients is important because of the overlap with the behavioural variant of frontotemporal dementia (bvFTD). We investigated the applicability and reliability of the Frontal Assessment Battery (FAB) within a cohort of predominantly prevalent ALS patients.

  7. Photographic assessment of burn size and depth: reliability and validity

    NARCIS (Netherlands)

    Hop, M.; Moues, C.; Bogomolova, K.; Nieuwenhuis, M.; Oen, I.; Middelkoop, E.; Breederveld, R.; de Baar, M.

    2014-01-01

    Objective: The aim of this study was to examine the reliability and validity of using photographs of burns to assess both burn size and depth. Method: Fifty randomly selected photographs taken on day 0-1 post burn were assessed by seven burn experts and eight referring physicians. Inter-rater

  8. Valid and Reliable Science Content Assessments for Science Teachers

    Science.gov (United States)

    Tretter, Thomas R.; Brown, Sherri L.; Bush, William S.; Saderholm, Jon C.; Holmes, Vicki-Lynn

    2013-01-01

    Science teachers' content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper…

  9. Reliability and validity of subjective assessment of lumbar lordosis in ...

    African Journals Online (AJOL)

    Radiological assessment of lumbar lordotic curve aids in early diagnosis of conditions even before neurologic changes set in. Objective: To ascertain the level of reliability and validity of subjective assessment of lumbar lordosis in conventional radiography. Design: A blinded, repeated-measures diagnostic test was carried ...

  10. A computational Bayesian approach to dependency assessment in system reliability

    International Nuclear Information System (INIS)

    Yontay, Petek; Pan, Rong

    2016-01-01

    Due to the increasing complexity of engineered products, it is of great importance to develop a tool to assess reliability dependencies among components and systems under the uncertainty of system reliability structure. In this paper, a Bayesian network approach is proposed for evaluating the conditional probability of failure within a complex system, using a multilevel system configuration. Coupling with Bayesian inference, the posterior distributions of these conditional probabilities can be estimated by combining failure information and expert opinions at both system and component levels. Three data scenarios are considered in this study, and they demonstrate that, with the quantification of the stochastic relationship of reliability within a system, the dependency structure in system reliability can be gradually revealed by the data collected at different system levels. - Highlights: • A Bayesian network representation of system reliability is presented. • Bayesian inference methods for assessing dependencies in system reliability are developed. • Complete and incomplete data scenarios are discussed. • The proposed approach is able to integrate reliability information from multiple sources at multiple levels of the system.

  11. Sequential decision reliability concept and failure rate assessment

    International Nuclear Information System (INIS)

    Ciftcioglu, O.

    1990-11-01

    Conventionally, a reliability concept is considered together with both each basic unit and their integration in a complicated large scale system such as a nuclear power plant (NPP). Basically, as the plant's operational status is determined by the information obtained from various sensors, the plant's reliability and the risk assessment is closely related to the reliability of the sensory information and hence the sensor components. However, considering the relevant information-processing systems, e.g. fault detection processors, there exists a further question about the reliability of such systems, specifically the reliability of the systems' decision-based outcomes by means of which the further actions are performed. To this end, a general sequential decision reliability concept and the failure rate assessment methodology is introduced. The implications of the methodology are investigated and the importance of the decision reliability concept in system operation is demonstrated by means of sensory signals in real-time from the Borssele NPP in the Netherlands. (author). 21 refs.; 8 figs

  12. Reliability of an instrument to determine lower limb comfort in professional football

    Directory of Open Access Journals (Sweden)

    Michael Kinchington

    2010-06-01

    Full Text Available Michael Kinchington1, Kevin Ball1, Geraldine Naughton21School of Human Movement, Recreation and Performance, Victoria University, Melbourne, Australia; 2The Centre of Physical Activity Across the Lifespan (COPAAL, Australian Catholic University, Victoria, AustraliaAims and Objectives: This study extends previous work in the field of injury awareness using a novel lower limb comfort index (LLCI, which was developed to assess comfort in professional football. Participants rated comfort for designated anatomical segments of the lower limb utilizing a seven point Likert scale. The aims of the study were (i to assess the reliability of the LLCI in a competitive football environment (Australian Rules and Rugby League, and (ii to assess whether LLCI measurements were responsive to changes in lower limb comfort over time.Methods and Results: The reliability of the LLCI was observed in two professional football environments: Training Week (mean difference 0.1 point, intra-class correlation coefficient, ICC 0.99 for n = 41 participants; and Match Day (mean difference 0.2 points, ICC 0.97 for n = 22 players. Measurements of lower limb comfort were responsive to changes in comfort over time. Within-player differences were not significant for periods 0–8 hrs (P > 0.05 but, generally, significant for time periods 0–24 hrs (P < 0.05, and significant between 24–96 hrs (P < 0.01. The results indicate that the LLCI was reliable when tested for repeated measures and indicated how the index measures lower limb comfort changes over time.Conclusion: This study shows that the use of a lower limb comfort index, when used in a competitive football environment, is both reliable and responsive to change during both a training week and under match day conditions.Keywords: lower limb comfort, musculoskeletal, football, injury

  13. Reliability of sonographic assessment of tendinopathy in tennis elbow.

    Science.gov (United States)

    Poltawski, Leon; Ali, Syed; Jayaram, Vijay; Watson, Tim

    2012-01-01

    To assess the reliability and compute the minimum detectable change using sonographic scales to quantify the extent of pathology and hyperaemia in the common extensor tendon in people with tennis elbow. The lateral elbows of 19 people with tennis elbow were assessed sonographically twice, 1-2 weeks apart. Greyscale and power Doppler images were recorded for subsequent rating of abnormalities. Tendon thickening, hypoechogenicity, fibrillar disruption and calcification were each rated on four-point scales, and scores were summed to provide an overall rating of structural abnormality; hyperaemia was scored on a five point scale. Inter-rater reliability was established using the intraclass correlation coefficient (ICC) to compare scores assigned independently to the same set of images by a radiologist and a physiotherapist with training in musculoskeletal imaging. Test-retest reliability was assessed by comparing scores assigned by the physiotherapist to images recorded at the two sessions. The minimum detectable change (MDC) was calculated from the test-retest reliability data. ICC values for inter-rater reliability ranged from 0.35 (95% CI: 0.05, 0.60) for fibrillar disruption to 0.77 (0.55, 0.88) for overall greyscale score, and 0.89 (0.79, 0.95) for hyperaemia. Test-retest reliability ranged from 0.70 (0.48, 0.84) for tendon thickening to 0.82 (0.66, 0.90) for overall greyscale score and 0.86 (0.73, 0.93) for calcification. The MDC for the greyscale total score was 2.0/12 and for the hyperaemia score was 1.1/5. The sonographic scoring system used in this study may be used reliably to quantify tendon abnormalities and change over time. A relatively inexperienced imager can conduct the assessment and use the rating scales reliably.

  14. Design and reliability of a didactic inphographic rubric assessment

    OpenAIRE

    Guzmán-cedillo, Yunuen Ixchel

    2017-01-01

    The objective of this study is to describe design, validity process and reliability of a rubric assessment to evaluate didactic infographics quality. Participants were fifteen judges who participate in different moments of elaboration rubric process; it was made in three process phases: design, settings and reliability determination. Content validity was obtained by percentage agreement between 3 judges by component of the rubric; likewise a Krippendorff’s alpha were applied (a = .710) in pi...

  15. Reliability of histologic assessment in patients with eosinophilic oesophagitis.

    Science.gov (United States)

    Warners, M J; Ambarus, C A; Bredenoord, A J; Verheij, J; Lauwers, G Y; Walsh, J C; Katzka, D A; Nelson, S; van Viegen, T; Furuta, G T; Gupta, S K; Stitt, L; Zou, G; Parker, C E; Shackelton, L M; D Haens, G R; Sandborn, W J; Dellon, E S; Feagan, B G; Collins, M H; Jairath, V; Pai, R K

    2018-04-01

    The validity of the eosinophilic oesophagitis (EoE) histologic scoring system (EoEHSS) has been demonstrated, but only preliminary reliability data exist. Formally assess the reliability of the EoEHSS and additional histologic features. Four expert gastrointestinal pathologists independently reviewed slides from adult patients with EoE (N = 45) twice, in random order, using standardised training materials and scoring conventions for the EoEHSS and additional histologic features agreed upon during a modified Delphi process. Intra- and inter-rater reliability for scoring the EoEHSS, a visual analogue scale (VAS) of overall histopathologic disease severity, and additional histologic features were assessed using intra-class correlation coefficients (ICCs). Almost perfect intra-rater reliability was observed for the composite EoEHSS scores and the VAS. Inter-rater reliability was also almost perfect for the composite EoEHSS scores and substantial for the VAS. Of the EoEHSS items, eosinophilic inflammation was associated with the highest ICC estimates and consistent with almost perfect intra- and inter-rater reliability. With the exception of dyskeratotic epithelial cells and surface epithelial alteration, ICC estimates for the remaining EoEHSS items were above the benchmarks for substantial intra-rater, and moderate inter-rater reliability. Estimation of peak eosinophil count and number of lamina propria eosinophils were associated with the highest ICC estimates among the exploratory items. The composite EoEHSS and most component items are associated with substantial reliability when assessed by central pathologists. Future studies should assess responsiveness of the score to change after a therapeutic intervention to facilitate its use in clinical trials. © 2018 John Wiley & Sons Ltd.

  16. Assessing the local windfield with instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Zambrano, T.G.

    1980-10-01

    This report concerns the development and testing of a technique for the initial screening and evaluation of potential sites for wind-energy conversion systems (WECS). The methodology was developed through a realistic siting exercise. The siting exercise involved measurements of winds along the surface and winds aloft using a relatively new instrument system, the Tethered Aerodynamic Lifting Anemometer (TALA) kite; notation of ecological factors such as vegetation flagging, soil erosion and site exposure, and verification of an area best suited for wind-energy development by establishing and maintaining a wind monitoring network. The siting exercise was carried out in an approximately 100-square-mile region of the Tehachapi Mountains of Southern California. The results showed that a comprehensive site survey involving field measurements, ecological survey, and wind-monitoring can be an effective tool for preliminary evaluation of WECS sites.

  17. Development of Highly Reliable Power and Communication System for Essential Instruments Under Severe Accidents in NPP

    Directory of Open Access Journals (Sweden)

    Bo Hwan Choi

    2016-10-01

    Full Text Available This article proposes a highly reliable power and communication system that guarantees the protection of essential instruments in a nuclear power plant under a severe accident. Both power and communication lines are established with not only conventional wired channels, but also the proposed wireless channels for emergency reserve. An inductive power transfer system is selected due to its robust power transfer characteristics under high temperature, high pressure, and highly humid environments with a large amount of scattered debris after a severe accident. A thermal insulation box and a glass-fiber reinforced plastic box are proposed to protect the essential instruments, including vulnerable electronic circuits, from extremely high temperatures of up to 627°C and pressure of up to 5 bar. The proposed wireless power and communication system is experimentally verified by an inductive power transfer system prototype having a dipole coil structure and prototype Zigbee modules over a 7-m distance, where both the thermal insulation box and the glass-fiber reinforced plastic box are fabricated and tested using a high-temperature chamber. Moreover, an experiment on the effects of a high radiation environment on various electronic devices is conducted based on the radiation test having a maximum accumulated dose of 27 Mrad.

  18. Development of highly reliable power and communication system for essential instruments under severe accidents in NPP

    International Nuclear Information System (INIS)

    Choi, Bo Hwan; Jang, Gi Chan; Shin, Sung Min; Kang, Hyun Gook; Rim, Chun Taek; Lee, Soo Ill

    2016-01-01

    This article proposes a highly reliable power and communication system that guarantees the protection of essential instruments in a nuclear power plant under a severe accident. Both power and communication lines are established with not only conventional wired channels, but also the proposed wireless channels for emergency reserve. An inductive power transfer system is selected due to its robust power transfer characteristics under high temperature, high pressure, and highly humid environments with a large amount of scattered debris after a severe accident. A thermal insulation box and a glass-fiber reinforced plastic box are proposed to protect the essential instruments, including vulnerable electronic circuits, from extremely high temperatures of up to 627 .deg. C and pressure of up to 5 bar. The proposed wireless power and communication system is experimentally verified by an inductive power transfer system prototype having a dipole coil structure and prototype Zigbee modules over a 7-m distance, where both the thermal insulation box and the glass-fiber reinforced plastic box are fabricated and tested using a high-temperature chamber. Moreover, an experiment on the effects of a high radiation environment on various electronic devices is conducted based on the radiation test having a maximum accumulated dose of 27 Mrad

  19. Development of highly reliable power and communication system for essential instruments under severe accidents in NPP

    Energy Technology Data Exchange (ETDEWEB)

    Choi, Bo Hwan; Jang, Gi Chan; Shin, Sung Min; Kang, Hyun Gook; Rim, Chun Taek [Dept. of Nuclear and Quantum Engineering, Korea Advanced Institute of Science and Technology, Daejeon (Korea, Republic of); Lee, Soo Ill [I and C Group, Korea Hydro and Nuclear Power Co., Ltd, Central Research Institute, Daejeon (Korea, Republic of)

    2016-10-15

    This article proposes a highly reliable power and communication system that guarantees the protection of essential instruments in a nuclear power plant under a severe accident. Both power and communication lines are established with not only conventional wired channels, but also the proposed wireless channels for emergency reserve. An inductive power transfer system is selected due to its robust power transfer characteristics under high temperature, high pressure, and highly humid environments with a large amount of scattered debris after a severe accident. A thermal insulation box and a glass-fiber reinforced plastic box are proposed to protect the essential instruments, including vulnerable electronic circuits, from extremely high temperatures of up to 627 .deg. C and pressure of up to 5 bar. The proposed wireless power and communication system is experimentally verified by an inductive power transfer system prototype having a dipole coil structure and prototype Zigbee modules over a 7-m distance, where both the thermal insulation box and the glass-fiber reinforced plastic box are fabricated and tested using a high-temperature chamber. Moreover, an experiment on the effects of a high radiation environment on various electronic devices is conducted based on the radiation test having a maximum accumulated dose of 27 Mrad.

  20. [work motivation -- assessment instruments and their relevance for medical care].

    Science.gov (United States)

    Fiedler, Rolf G; Ranft, Andreas; Greitemann, Bernhard; Heuft, Gereon

    2005-11-01

    The relevance of work motivation for medical research and healthcare, in particular rehabilitation, is described. Four diagnostic instruments in the German language are introduced which can assess work motivation using a scale system: AVEM, JDS, LMI and FBTM. Their possible application and potential usage for the clinical area are discussed. Apart from the FBTM, none of these instruments can be directly used as a general instrument in a normal medical clinical setting. Finally, a current model for work motivation (compensatory model of work motivation and volition) is presented that contains basis concepts, which are judged as important for future research questions concerning the development of motivation diagnostic instruments.

  1. Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients' Motivation to Adhere to Insulin Therapy.

    Science.gov (United States)

    Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

    2018-03-01

    Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient's adherence to therapy. Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy.

  2. Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients’ Motivation to Adhere to Insulin Therapy

    Science.gov (United States)

    Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

    2018-01-01

    Introduction: Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient’s adherence to therapy. Aim: Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. Material and Methods: We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results: Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Conclusion: Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy. PMID:29670478

  3. A questionnaire for assessing breastfeeding intentions and practices in Nigeria: validity, reliability and translation.

    Science.gov (United States)

    Emmanuel, Andy; Clow, Sheila E

    2017-06-07

    Validating a questionnaire/instrument (whether developed or adapted) before proceeding to the field for data collection is important. This article presents the modification of an Irish questionnaire for a Nigerian setting. The validation process and reliability testing of this questionnaire (which was used in assessing previous breastfeeding practices and breastfeeding intentions of pregnant women in English and Hausa languages) were also presented. Five experts in the field of breastfeeding and infant feeding voluntarily and independently evaluated the instrument. The experts evaluated the various items of the questionnaire based on relevance, clarity, simplicity and ambiguity on a Likert scale of 4. The analysis was performed to determine the content validity index (CVI).Two language experts performed the translation and back-translation. Ten pregnant women completed questionnaires which were evaluated for internal consistency. Two other pregnant women completed the questionnaire twice at an interval of two weeks to test the reliability. SPSS version 21 was used to calculate the coefficient of reliability. The content validity index was high (0.94 for relevance, clarity and ambiguity and 0.96 for simplicity). The analysis suggested that four of the seventy one items should be removed. Cronbach's Alpha was 0.81, while the reliability coefficient was 0.76. The emerged validated questionnaire was translated from English to Hausa, then, back-translated into English and compared for accuracy. The final instrument is reliable and valid for data collection on breastfeeding in Nigeria among English and Hausa speakers. Therefore, the instrument is recommended for use in assessing breastfeeding intention and practices in Nigeria.

  4. Reliable and valid assessment of Lichtenstein hernia repair skills

    DEFF Research Database (Denmark)

    Carlsen, C G; Lindorff Larsen, Karen; Funch-Jensen, P

    2014-01-01

    PURPOSE: Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity...... of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. METHODS: Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia...... a significant difference between the three groups which indicates construct validity, p skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment...

  5. Instruments used in the assessment of expectation toward a spine surgery: an integrative review

    Directory of Open Access Journals (Sweden)

    Eliane Nepomuceno

    Full Text Available Abstract OBJECTIVE To identify and describe the instruments used to assess patients' expectations toward spine surgery. METHOD An integrative review was carried out in the databases PubMed, CINAHL, LILACS and PsycINFO. RESULTS A total of 4,402 publications were identified, of which 25 met the selection criteria. Of the studies selected, only three used tools that had confirmed validity and reliability to be applied; in five studies, clinical scores were used, and were modified for the assessment of patients' expectations, and in 17 studies the researchers developed scales without an adequate description of the method used for their development and validation. CONCLUSION The assessment of patients' expectations has been methodologically conducted in different ways. Until the completion of this integrative review, only two valid and reliable instruments had been used in three of the selected studies.

  6. Reliability and Probabilistic Risk Assessment - How They Play Together

    Science.gov (United States)

    Safie, Fayssal M.; Stutts, Richard G.; Zhaofeng, Huang

    2015-01-01

    PRA methodology is one of the probabilistic analysis methods that NASA brought from the nuclear industry to assess the risk of LOM, LOV and LOC for launch vehicles. PRA is a system scenario based risk assessment that uses a combination of fault trees, event trees, event sequence diagrams, and probability and statistical data to analyze the risk of a system, a process, or an activity. It is a process designed to answer three basic questions: What can go wrong? How likely is it? What is the severity of the degradation? Since 1986, NASA, along with industry partners, has conducted a number of PRA studies to predict the overall launch vehicles risks. Planning Research Corporation conducted the first of these studies in 1988. In 1995, Science Applications International Corporation (SAIC) conducted a comprehensive PRA study. In July 1996, NASA conducted a two-year study (October 1996 - September 1998) to develop a model that provided the overall Space Shuttle risk and estimates of risk changes due to proposed Space Shuttle upgrades. After the Columbia accident, NASA conducted a PRA on the Shuttle External Tank (ET) foam. This study was the most focused and extensive risk assessment that NASA has conducted in recent years. It used a dynamic, physics-based, integrated system analysis approach to understand the integrated system risk due to ET foam loss in flight. Most recently, a PRA for Ares I launch vehicle has been performed in support of the Constellation program. Reliability, on the other hand, addresses the loss of functions. In a broader sense, reliability engineering is a discipline that involves the application of engineering principles to the design and processing of products, both hardware and software, for meeting product reliability requirements or goals. It is a very broad design-support discipline. It has important interfaces with many other engineering disciplines. Reliability as a figure of merit (i.e. the metric) is the probability that an item will

  7. Assessment of structural reliability of precast concrete buildings

    Directory of Open Access Journals (Sweden)

    Koyankin Alexandr

    2018-01-01

    Full Text Available Precast housing construction is currently being under rapid development, however, reliability of building structures made from precast reinforced concrete cannot be assessed rationally due to insufficient research data on that subject. In this regard, experimental and numerical studies were conducted to assess structural reliability of precast buildings as described in the given paper. Experimental studies of full-scale and model samples were conducted; numerical studies were held based on finite element models using “Lira” software. The objects under study included fragment of flooring of a building under construction, full-size fragment of flooring, full-scale models of precast cross-beams-to-columns joints and joints between hollow-core floor slabs and precast and cast-in-place cross-beams. Conducted research enabled to perform an objective assessment of structural reliability of precast buildings.

  8. A new measurement of workload in Web application reliability assessment

    Directory of Open Access Journals (Sweden)

    CUI Xia

    2015-02-01

    Full Text Available Web application has been popular in various fields of social life.It becomes more and more important to study the reliability of Web application.In this paper the definition of Web application failure is firstly brought out,and then the definition of Web application reliability.By analyzing data in the IIS server logs and selecting corresponding usage and information delivery failure data,the paper study the feasibility of Web application reliability assessment from the perspective of Web software system based on IIS server logs.Because the usage for a Web site often has certain regularity,a new measurement of workload in Web application reliability assessment is raised.In this method,the unit is removed by weighted average technique;and the weights are assessed by setting objective function and optimization.Finally an experiment was raised for validation.The experiment result shows the assessment of Web application reliability base on the new workload is better.

  9. Review of Software Reliability Assessment Methodologies for Digital I and C Software of Nuclear Power Plants

    Energy Technology Data Exchange (ETDEWEB)

    Cho, Jae Hyun; Lee, Seung Jun; Jung, Won Dea [KAERI, Daejeon (Korea, Republic of)

    2014-08-15

    Digital instrumentation and control (I and C) systems are increasingly being applied to current nuclear power plants (NPPs) due to its advantages; zero drift, advanced data calculation capacity, and design flexibility. Accordingly, safety issues of software that is main part of the digital I and C system have been raised. As with hardware components, the software failure in NPPs could lead to a large disaster, therefore failure rate test and reliability assessment of software should be properly performed, and after that adopted in NPPs. However, the reliability assessment of the software is quite different with that of hardware, owing to the nature difference between software and hardware. The one of the most different thing is that the software failures arising from design faults as 'error crystal', whereas the hardware failures are caused by deficiencies in design, production, and maintenance. For this reason, software reliability assessment has been focused on the optimal release time considering the economy. However, the safety goal and public acceptance of the NPPs is so distinctive with other industries that the software in NPPs is dependent on reliability quantitative value rather than economy. The safety goal of NPPs compared to other industries is exceptionally high, so conventional methodologies on software reliability assessment already used in other industries could not adjust to safety goal of NPPs. Thus, the new reliability assessment methodology of the software of digital I and C on NPPs need to be developed. In this paper, existing software reliability assessment methodologies are reviewed to obtain the pros and cons of them, and then to assess the usefulness of each method to software of NPPs.

  10. Review of Software Reliability Assessment Methodologies for Digital I and C Software of Nuclear Power Plants

    International Nuclear Information System (INIS)

    Cho, Jae Hyun; Lee, Seung Jun; Jung, Won Dea

    2014-01-01

    Digital instrumentation and control (I and C) systems are increasingly being applied to current nuclear power plants (NPPs) due to its advantages; zero drift, advanced data calculation capacity, and design flexibility. Accordingly, safety issues of software that is main part of the digital I and C system have been raised. As with hardware components, the software failure in NPPs could lead to a large disaster, therefore failure rate test and reliability assessment of software should be properly performed, and after that adopted in NPPs. However, the reliability assessment of the software is quite different with that of hardware, owing to the nature difference between software and hardware. The one of the most different thing is that the software failures arising from design faults as 'error crystal', whereas the hardware failures are caused by deficiencies in design, production, and maintenance. For this reason, software reliability assessment has been focused on the optimal release time considering the economy. However, the safety goal and public acceptance of the NPPs is so distinctive with other industries that the software in NPPs is dependent on reliability quantitative value rather than economy. The safety goal of NPPs compared to other industries is exceptionally high, so conventional methodologies on software reliability assessment already used in other industries could not adjust to safety goal of NPPs. Thus, the new reliability assessment methodology of the software of digital I and C on NPPs need to be developed. In this paper, existing software reliability assessment methodologies are reviewed to obtain the pros and cons of them, and then to assess the usefulness of each method to software of NPPs

  11. Reliability of risk assessment measures used in sexually violent predator proceedings.

    Science.gov (United States)

    Miller, Cailey S; Kimonis, Eva R; Otto, Randy K; Kline, Suzonne M; Wasserman, Adam L

    2012-12-01

    The field interrater reliability of three assessment tools frequently used by mental health professionals when evaluating sex offenders' risk for reoffending--the Psychopathy Checklist-Revised (PCL-R), the Minnesota Sex Offender Screening Tool-Revised (MnSOST-R) and the Static-99-was examined within the context of sexually violent predator program proceedings. Rater agreement was highest for the Static--99 (intraclass correlation coefficient [ICC₁] = .78) and lowest for the PCL-R (ICC₁ = .60; MnSOST-R ICC₁ = .74), although all instruments demonstrated lower field reliability than that reported in their test manuals. Findings raise concerns about the reliability of risk assessment tools that are used to inform judgments of risk in high-stake sexually violent predator proceedings. Implications for future research and suggestions for improving evaluator training to increase accuracy when informing legal decision making are discussed.

  12. Validation of the translation of an instrument to measure reliability of written information on treatment choices: a study on attention deficit/hyperactivity disorder (ADHD).

    Science.gov (United States)

    Montoya, A; Llopis, N; Gilaberte, I

    2011-12-01

    DISCERN is an instrument designed to help patients assess the reliability of written information on treatment choices. Originally created in English, there is no validated Spanish version of this instrument. This study seeks to validate the Spanish translation of the DISCERN instrument used as a primary measure on a multicenter study aimed to assess the reliability of web-based information on treatment choices for attention deficit/hyperactivity disorder (ADHD). We used a modified version of a method for validating translated instruments in which the original source-language version is formally compared with the back-translated source-language version. Each item was ranked in terms of comparability of language, similarity of interpretability, and degree of understandability. Responses used Likert scales ranging from 1 to 7, where 1 indicates the best interpretability, language and understandability, and 7 indicates the worst. Assessments were performed by 20 raters fluent in the source language. The Spanish translation of DISCERN, based on ratings of comparability, interpretability and degree of understandability (mean score (SD): 1.8 (1.1), 1.4 (0.9) and 1.6 (1.1), respectively), was considered extremely comparable. All items received a score of less than three, therefore no further revision of the translation was needed. The validation process showed that the quality of DISCERN translation was high, validating the comparable language of the tool translated on assessing written information on treatment choices for ADHD.

  13. the research quality plus (rq+) assessment instrument

    International Development Research Centre (IDRC) Digital Library (Canada)

    sclarke

    These need to be taken into account as part of the assessment. 2. .... be cases in which there is not enough information available to make a credible ..... (within a research community) or for decision-making and problem-solving beyond the ...

  14. ASSESSING AND COMBINING RELIABILITY OF PROTEIN INTERACTION SOURCES

    Science.gov (United States)

    LEACH, SONIA; GABOW, AARON; HUNTER, LAWRENCE; GOLDBERG, DEBRA S.

    2008-01-01

    Integrating diverse sources of interaction information to create protein networks requires strategies sensitive to differences in accuracy and coverage of each source. Previous integration approaches calculate reliabilities of protein interaction information sources based on congruity to a designated ‘gold standard.’ In this paper, we provide a comparison of the two most popular existing approaches and propose a novel alternative for assessing reliabilities which does not require a gold standard. We identify a new method for combining the resultant reliabilities and compare it against an existing method. Further, we propose an extrinsic approach to evaluation of reliability estimates, considering their influence on the downstream tasks of inferring protein function and learning regulatory networks from expression data. Results using this evaluation method show 1) our method for reliability estimation is an attractive alternative to those requiring a gold standard and 2) the new method for combining reliabilities is less sensitive to noise in reliability assignments than the similar existing technique. PMID:17990508

  15. Assessment of the reliability of ultrasonic inspection methods

    International Nuclear Information System (INIS)

    Haines, N.F.; Langston, D.B.; Green, A.J.; Wilson, R.

    1982-01-01

    The reliability of NDT techniques has remained an open question for many years. A reliable technique may be defined as one that, when rigorously applied by a number of inspection teams, consistently finds then correctly sizes all defects of concern. In this paper we report an assessment of the reliability of defect detection by manual ultrasonic methods applied to the inspection of thick section pressure vessel weldments. Initially we consider the available data relating to the inherent physical capabilities of ultrasonic techniques to detect cracks in weldment and then, independently, we assess the likely variability in team to team performance when several teams are asked to follow the same specified test procedure. The two aspects of 'capability' and 'variability' are brought together to provide quantitative estimates of the overall reliability of ultrasonic inspection of thick section pressure vessel weldments based on currently existing data. The final section of the paper considers current research programmes on reliability and presents a view on how these will help to further improve NDT reliability. (author)

  16. Reliable and valid assessment of performance in thoracoscopy

    DEFF Research Database (Denmark)

    Konge, Lars; Lehnert, Per; Hansen, Henrik Jessen

    2012-01-01

    BACKGROUND: As we move toward competency-based education in medicine, we have lagged in developing competency-based evaluation methods. In the era of minimally invasive surgery, there is a need for a reliable and valid tool dedicated to measure competence in video-assisted thoracoscopic surgery....... The purpose of this study is to create such an assessment tool, and to explore its reliability and validity. METHODS: An expert group of physicians created an assessment tool consisting of 10 items rated on a five-point rating scale. The following factors were included: economy and confidence of movement...

  17. Reliability assessment for safety critical systems by statistical random testing

    International Nuclear Information System (INIS)

    Mills, S.E.

    1995-11-01

    In this report we present an overview of reliability assessment for software and focus on some basic aspects of assessing reliability for safety critical systems by statistical random testing. We also discuss possible deviations from some essential assumptions on which the general methodology is based. These deviations appear quite likely in practical applications. We present and discuss possible remedies and adjustments and then undertake applying this methodology to a portion of the SDS1 software. We also indicate shortcomings of the methodology and possible avenues to address to follow to address these problems. (author). 128 refs., 11 tabs., 31 figs

  18. Reliability assessment for safety critical systems by statistical random testing

    Energy Technology Data Exchange (ETDEWEB)

    Mills, S E [Carleton Univ., Ottawa, ON (Canada). Statistical Consulting Centre

    1995-11-01

    In this report we present an overview of reliability assessment for software and focus on some basic aspects of assessing reliability for safety critical systems by statistical random testing. We also discuss possible deviations from some essential assumptions on which the general methodology is based. These deviations appear quite likely in practical applications. We present and discuss possible remedies and adjustments and then undertake applying this methodology to a portion of the SDS1 software. We also indicate shortcomings of the methodology and possible avenues to address to follow to address these problems. (author). 128 refs., 11 tabs., 31 figs.

  19. Developing Instrumentation for Assessing Creativity in Engineering Design

    Science.gov (United States)

    Denson, Cameron D.; Buelin, Jennifer K.; Lammi, Matthew D.; D'Amico, Susan

    2015-01-01

    A perceived inability to assess creative attributes of students' work has often precluded creativity instruction in the classroom. The Consensual Assessment Technique (CAT) has shown promise in a variety of domains for its potential as a valid and reliable means of creativity assessment. Relying upon an operational definition of creativity and a…

  20. Mixed-realism simulation of adverse event disclosure: an educational methodology and assessment instrument.

    Science.gov (United States)

    Matos, Francisco M; Raemer, Daniel B

    2013-04-01

    Physicians have an ethical duty to disclose adverse events to patients or families. Various strategies have been reported for teaching disclosure, but no instruments have been shown to be reliable for assessing them.The aims of this study were to report a structured method for teaching adverse event disclosure using mixed-realism simulation, develop and begin to validate an instrument for assessing performance, and describe the disclosure practice of anesthesiology trainees. Forty-two anesthesiology trainees participated in a 2-part exercise with mixed-realism simulation. The first part took place using a mannequin patient in a simulated operating room where trainees became enmeshed in a clinical episode that led to an adverse event and the second part in a simulated postoperative care unit where the learner is asked to disclose to a standardized patient who systematically moves through epochs of grief response. Two raters scored subjects using an assessment instrument we developed that combines a 4-element behaviorally anchored rating scale (BARS) and a 5-stage objective rating scale. The performance scores for elements within the BARS and the 5-stage instrument showed excellent interrater reliability (Cohen's κ = 0.7), appropriate range (mean range for BARS, 4.20-4.47; mean range for 5-stage instrument, 3.73-4.46), and high internal consistency (P realism simulation that engages learners in an adverse event and allows them to practice disclosure to a structured range of patient responses. We have developed a reliable 2-part instrument with strong psychometric properties for assessing disclosure performance.

  1. Reliability assessment of complex electromechanical systems under epistemic uncertainty

    International Nuclear Information System (INIS)

    Mi, Jinhua; Li, Yan-Feng; Yang, Yuan-Jian; Peng, Weiwen; Huang, Hong-Zhong

    2016-01-01

    The appearance of macro-engineering and mega-project have led to the increasing complexity of modern electromechanical systems (EMSs). The complexity of the system structure and failure mechanism makes it more difficult for reliability assessment of these systems. Uncertainty, dynamic and nonlinearity characteristics always exist in engineering systems due to the complexity introduced by the changing environments, lack of data and random interference. This paper presents a comprehensive study on the reliability assessment of complex systems. In view of the dynamic characteristics within the system, it makes use of the advantages of the dynamic fault tree (DFT) for characterizing system behaviors. The lifetime of system units can be expressed as bounded closed intervals by incorporating field failures, test data and design expertize. Then the coefficient of variation (COV) method is employed to estimate the parameters of life distributions. An extended probability-box (P-Box) is proposed to convey the present of epistemic uncertainty induced by the incomplete information about the data. By mapping the DFT into an equivalent Bayesian network (BN), relevant reliability parameters and indexes have been calculated. Furthermore, the Monte Carlo (MC) simulation method is utilized to compute the DFT model with consideration of system replacement policy. The results show that this integrated approach is more flexible and effective for assessing the reliability of complex dynamic systems. - Highlights: • A comprehensive study on the reliability assessment of complex system is presented. • An extended probability-box is proposed to convey the present of epistemic uncertainty. • The dynamic fault tree model is built. • Bayesian network and Monte Carlo simulation methods are used. • The reliability assessment of a complex electromechanical system is performed.

  2. Reliable and valid assessment of Lichtenstein hernia repair skills.

    Science.gov (United States)

    Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

    2014-08-01

    Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

  3. Human reliability analysis methods for probabilistic safety assessment

    International Nuclear Information System (INIS)

    Pyy, P.

    2000-11-01

    Human reliability analysis (HRA) of a probabilistic safety assessment (PSA) includes identifying human actions from safety point of view, modelling the most important of them in PSA models, and assessing their probabilities. As manifested by many incidents and studies, human actions may have both positive and negative effect on safety and economy. Human reliability analysis is one of the areas of probabilistic safety assessment (PSA) that has direct applications outside the nuclear industry. The thesis focuses upon developments in human reliability analysis methods and data. The aim is to support PSA by extending the applicability of HRA. The thesis consists of six publications and a summary. The summary includes general considerations and a discussion about human actions in the nuclear power plant (NPP) environment. A condensed discussion about the results of the attached publications is then given, including new development in methods and data. At the end of the summary part, the contribution of the publications to good practice in HRA is presented. In the publications, studies based on the collection of data on maintenance-related failures, simulator runs and expert judgement are presented in order to extend the human reliability analysis database. Furthermore, methodological frameworks are presented to perform a comprehensive HRA, including shutdown conditions, to study reliability of decision making, and to study the effects of wrong human actions. In the last publication, an interdisciplinary approach to analysing human decision making is presented. The publications also include practical applications of the presented methodological frameworks. (orig.)

  4. Time-variant reliability assessment through equivalent stochastic process transformation

    International Nuclear Information System (INIS)

    Wang, Zequn; Chen, Wei

    2016-01-01

    Time-variant reliability measures the probability that an engineering system successfully performs intended functions over a certain period of time under various sources of uncertainty. In practice, it is computationally prohibitive to propagate uncertainty in time-variant reliability assessment based on expensive or complex numerical models. This paper presents an equivalent stochastic process transformation approach for cost-effective prediction of reliability deterioration over the life cycle of an engineering system. To reduce the high dimensionality, a time-independent reliability model is developed by translating random processes and time parameters into random parameters in order to equivalently cover all potential failures that may occur during the time interval of interest. With the time-independent reliability model, an instantaneous failure surface is attained by using a Kriging-based surrogate model to identify all potential failure events. To enhance the efficacy of failure surface identification, a maximum confidence enhancement method is utilized to update the Kriging model sequentially. Then, the time-variant reliability is approximated using Monte Carlo simulations of the Kriging model where system failures over a time interval are predicted by the instantaneous failure surface. The results of two case studies demonstrate that the proposed approach is able to accurately predict the time evolution of system reliability while requiring much less computational efforts compared with the existing analytical approach. - Highlights: • Developed a new approach for time-variant reliability analysis. • Proposed a novel stochastic process transformation procedure to reduce the dimensionality. • Employed Kriging models with confidence-based adaptive sampling scheme to enhance computational efficiency. • The approach is effective for handling random process in time-variant reliability analysis. • Two case studies are used to demonstrate the efficacy

  5. The patient assessment questionnaire: a new instrument for evaluating the interpersonal skills of vocational dental practitioners.

    Science.gov (United States)

    Hurst, Y K; Prescott-Clements, L E; Rennie, J S

    2004-10-23

    This paper describes a pilot study aimed at evaluating a new instrument, the patient assessment questionnaire (PAQ), which uses patient ratings for the assessment of communication skills and professionalism in vocational practitioners (VDPs). The PAQ was developed as part of an assessment system designed to address all round competence. Acohort of 99 VDPs took part in the study. Questionnaires were distributed to consecutive patients in the general dental service at two time points in the training year. Data from the pilot study was analysed to determine whether the PAQ fulfilled the criteria for robust assessment. Results provide evidence of high levels of reliability, validity and feasibility of the PAQ instrument. All indications to date suggest that the PAQ will prove to be a valuable assessment tool. It is currently being evaluated as part of the system used to assess the all round competence of dental graduates undertaking vocational training in Scotland.

  6. Assessing hospitals' clinical risk management: Development of a monitoring instrument

    Directory of Open Access Journals (Sweden)

    Pfeiffer Yvonne

    2010-12-01

    Full Text Available Abstract Background Clinical risk management (CRM plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. Methods The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. Results The monitoring instrument consists of 28 main questions organized in three sections: 1 Implementation and organizational integration of CRM, 2 Strategic objectives and operational implementation of CRM at hospital level, and 3 Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian. It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. Conclusions We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety.

  7. Assessing hospitals' clinical risk management: Development of a monitoring instrument.

    Science.gov (United States)

    Briner, Matthias; Kessler, Oliver; Pfeiffer, Yvonne; Wehner, Theo; Manser, Tanja

    2010-12-13

    Clinical risk management (CRM) plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals) was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. The monitoring instrument consists of 28 main questions organized in three sections: 1) Implementation and organizational integration of CRM, 2) Strategic objectives and operational implementation of CRM at hospital level, and 3) Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian). It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety.

  8. Radiological Instrumentation Assessment for King County Wastewater Treatment Division

    International Nuclear Information System (INIS)

    Strom, Daniel J.; McConn, Ronald J.; Brodzinski, Ronald L.

    2005-01-01

    The King County Wastewater Treatment Division (WTD) have concern about the aftermath of a radiological dispersion event (RDE) leading to the introduction of significant quantities of radioactive material into its combined sanitary and storm sewer system. Radioactive material could come from the use of a radiological dispersion device (RDD). RDDs include 'dirty bombs' that are not nuclear detonations but are explosives designed to spread radioactive material. Radioactive material also could come from deliberate introduction or dispersion of radioactive material into the environment, including waterways and water supply systems. Volume 2 of PNNL-15163 assesses the radiological instrumentation needs for detection of radiological or nuclear terrorism, in support of decisions to treat contaminated wastewater or to bypass the West Point Treatment Plant (WPTP), and in support of radiation protection of the workforce, the public, and the infrastructure of the WPTP. Fixed radiation detection instrumentation should be deployed in a defense-in-depth system that provides (1) early warning of significant radioactive material on the way to the WPTP, including identification of the radionuclide(s) and estimates of the soluble concentrations, with a floating detector located in the wet well at the Interbay Pump Station and telemetered via the internet to all authorized locations; (2) monitoring at strategic locations within the plant, including (2a) the pipe beyond the hydraulic ram in the bar screen room; (2b) above the collection funnels in the fine grit facility; (2c) in the sampling tank in the raw sewage pump room; and (2d) downstream of the concentration facilities that produce 6% blended and concentrated biosolids. Engineering challenges exist for these applications. It is necessary to deploy both ultra-sensitive detectors to provide early warning and identification and detectors capable of functioning in high-dose rate environments that are likely under some scenarios

  9. Reliable and Valid Assessment of Point-of-care Ultrasonography

    DEFF Research Database (Denmark)

    Todsen, Tobias; Tolsgaard, Martin Grønnebæk; Olsen, Beth Härstedt

    2015-01-01

    physicians' OSAUS scores with diagnostic accuracy. RESULTS: The generalizability coefficient was high (0.81) and a D-study demonstrated that 1 assessor and 5 cases would result in similar reliability. The construct validity of the OSAUS scale was supported by a significant difference in the mean scores......OBJECTIVE: To explore the reliability and validity of the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale for point-of-care ultrasonography (POC US) performance. BACKGROUND: POC US is increasingly used by clinicians and is an essential part of the management of acute surgical...... conditions. However, the quality of performance is highly operator-dependent. Therefore, reliable and valid assessment of trainees' ultrasonography competence is needed to ensure patient safety. METHODS: Twenty-four physicians, representing novices, intermediates, and experts in POC US, scanned 4 different...

  10. Validity, reliability and support for implementation of independence-scaled procedural assessment in laparoscopic surgery.

    Science.gov (United States)

    Kramp, Kelvin H; van Det, Marc J; Veeger, Nic J G M; Pierie, Jean-Pierre E N

    2016-06-01

    There is no widely used method to evaluate procedure-specific laparoscopic skills. The first aim of this study was to develop a procedure-based assessment method. The second aim was to compare its validity, reliability and feasibility with currently available global rating scales (GRSs). An independence-scaled procedural assessment was created by linking the procedural key steps of the laparoscopic cholecystectomy to an independence scale. Subtitled and blinded videos of a novice, an intermediate and an almost competent trainee, were evaluated with GRSs (OSATS and GOALS) and the independence-scaled procedural assessment by seven surgeons, three senior trainees and six scrub nurses. Participants received a short introduction to the GRSs and independence-scaled procedural assessment before assessment. The validity was estimated with the Friedman and Wilcoxon test and the reliability with the intra-class correlation coefficient (ICC). A questionnaire was used to evaluate user opinion. Independence-scaled procedural assessment and GRS scores improved significantly with surgical experience (OSATS p = 0.001, GOALS p < 0.001, independence-scaled procedural assessment p < 0.001). The ICCs of the OSATS, GOALS and independence-scaled procedural assessment were 0.78, 0.74 and 0.84, respectively, among surgeons. The ICCs increased when the ratings of scrub nurses were added to those of the surgeons. The independence-scaled procedural assessment was not considered more of an administrative burden than the GRSs (p = 0.692). A procedural assessment created by combining procedural key steps to an independence scale is a valid, reliable and acceptable assessment instrument in surgery. In contrast to the GRSs, the reliability of the independence-scaled procedural assessment exceeded the threshold of 0.8, indicating that it can also be used for summative assessment. It furthermore seems that scrub nurses can assess the operative competence of surgical trainees.

  11. Development of a quality-assessment tool for experimental bruxism studies: reliability and validity.

    Science.gov (United States)

    Dawson, Andreas; Raphael, Karen G; Glaros, Alan; Axelsson, Susanna; Arima, Taro; Ernberg, Malin; Farella, Mauro; Lobbezoo, Frank; Manfredini, Daniele; Michelotti, Ambra; Svensson, Peter; List, Thomas

    2013-01-01

    To combine empirical evidence and expert opinion in a formal consensus method in order to develop a quality-assessment tool for experimental bruxism studies in systematic reviews. Tool development comprised five steps: (1) preliminary decisions, (2) item generation, (3) face-validity assessment, (4) reliability and discriminitive validity assessment, and (5) instrument refinement. The kappa value and phi-coefficient were calculated to assess inter-observer reliability and discriminative ability, respectively. Following preliminary decisions and a literature review, a list of 52 items to be considered for inclusion in the tool was compiled. Eleven experts were invited to join a Delphi panel and 10 accepted. Four Delphi rounds reduced the preliminary tool-Quality-Assessment Tool for Experimental Bruxism Studies (Qu-ATEBS)- to 8 items: study aim, study sample, control condition or group, study design, experimental bruxism task, statistics, interpretation of results, and conflict of interest statement. Consensus among the Delphi panelists yielded good face validity. Inter-observer reliability was acceptable (k = 0.77). Discriminative validity was excellent (phi coefficient 1.0; P reviews of experimental bruxism studies, exhibits face validity, excellent discriminative validity, and acceptable inter-observer reliability. Development of quality assessment tools for many other topics in the orofacial pain literature is needed and may follow the described procedure.

  12. Windfarm Generation Assessment for ReliabilityAnalysis of Power Systems

    DEFF Research Database (Denmark)

    Negra, Nicola Barberis; Holmstrøm, Ole; Bak-Jensen, Birgitte

    2007-01-01

    Due to the fast development of wind generation in the past ten years, increasing interest has been paid to techniques for assessing different aspects of power systems with a large amount of installed wind generation. One of these aspects concerns power system reliability. Windfarm modelling plays...

  13. Windfarm generation assessment for reliability analysis of power systems

    DEFF Research Database (Denmark)

    Negra, N.B.; Holmstrøm, O.; Bak-Jensen, B.

    2007-01-01

    Due to the fast development of wind generation in the past ten years, increasing interest has been paid to techniques for assessing different aspects of power systems with a large amount of installed wind generation. One of these aspects concerns power system reliability. Windfarm modelling plays...

  14. Methodology for reliability, economic and environmental assessment of wave energy

    International Nuclear Information System (INIS)

    Thorpe, T.W.; Muirhead, S.

    1994-01-01

    As part of the Preliminary Actions in Wave Energy R and D for DG XII's Joule programme, methodologies were developed to facilitate assessment of the reliability, economics and environmental impact of wave energy. This paper outlines these methodologies, their limitations and areas requiring further R and D. (author)

  15. Reliable and Valid Assessment of Clinical Bronchoscopy Performance

    DEFF Research Database (Denmark)

    Konge, Lars; Larsen, Klaus Richter; Clementsen, Paul

    2012-01-01

    : The interrater reliability was high, with Cronbach's a = 0.86. Assessment of 3 bronchoscopies by a single rater had a generalizability coefficient of 0.84. The correlation between experience and performance was good (Pearson correlation = 0.76). There were significant differences between the groups for all...

  16. Assessment of the Reliability of Concrete Slab Bridges

    DEFF Research Database (Denmark)

    Thoft-Christensen, Palle; Jensen, F. M.; Middleton, C. R.

    This paper is based on research performed for the Highways Agency, London, UK under the project DPU/9/44 "Revision of Bridge Assessment Rules Based on Whole Life Performance: Concrete Bridges". It contains details of a methodology which can be used to generate Whole Life (WL) reliability profiles....

  17. Assessment of reliability of Greulich and Pyle (gp) method for ...

    African Journals Online (AJOL)

    Background: Greulich and Pyle standards are the most widely used age estimation standards all over the world. The applicability of the Greulich and Pyle standards to populations which differ from their reference population is often questioned. This study aimed to assess the reliability of Greulich and Pyle (GP) method for ...

  18. Reliability of scored patient generated subjective global assessment ...

    African Journals Online (AJOL)

    Objective: Establish the reliability of the scored Patient Generated-Subjective Global Assessment (PG-SGA) in determining nutritional status among Antiretroviral Therapy (ART) naive HIV-infected adults. Methods: A descriptive, cross sectional study among outpatient medical clinics, in The AIDS Support Organization ...

  19. Qualification Users' Perceptions and Experiences of Assessment Reliability

    Science.gov (United States)

    Chamberlain, Suzanne

    2013-01-01

    This paper presents the findings of a study designed to explore qualification users' perceptions and experiences of reliability in the context of national assessment outcomes in England. The study consisted of 17 focus groups conducted across six sectors of qualification users: students, teachers, trainee teachers, job-seekers, employers and…

  20. Reliability of medical audit in quality assessment of medical care

    Directory of Open Access Journals (Sweden)

    Camacho Luiz Antonio Bastos

    1996-01-01

    Full Text Available Medical audit of hospital records has been a major component of quality of care assessment, although physician judgment is known to have low reliability. We estimated interrater agreement of quality assessment in a sample of patients with cardiac conditions admitted to an American teaching hospital. Physician-reviewers used structured review methods designed to improve quality assessment based on judgment. Chance-corrected agreement for the items considered more relevant to process and outcome of care ranged from low to moderate (0.2 to 0.6, depending on the review item and the principal diagnoses and procedures the patients underwent. Results from several studies seem to converge on this point. Comparisons among different settings should be made with caution, given the sensitivity of agreement measurements to prevalence rates. Reliability of review methods in their current stage could be improved by combining the assessment of two or more reviewers, and by emphasizing outcome-oriented events.

  1. The quality of instruments to assess the process of shared decision making: A systematic review

    Science.gov (United States)

    Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

    2018-01-01

    Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of

  2. Risk assessment and reliability for low level radioactive waste disposal

    International Nuclear Information System (INIS)

    Gregory, P.O.; Jones, G.A.

    1986-01-01

    The reliability of critical design features at low-level radioactive waste disposal facilities is a major concern in the licensing of these structures. To date, no systematic methodology has been adopted to evaluate the geotechnical reliability of Uranium Mill Tailings Remedial Action (UMTRA) disposal facilities currently being designed and/or constructed. This paper discusses and critiques the deterministic methods currently used to evaluate UMTRA reliability. Because deterministic methods may not be applicable in some cases because of the unusually long design life of UMTRA facilities, it is proposed that a probabilistic risk assessment-based methodology be used as a secondary method to aid in the evaluating of geotechnical reliability of critical items. Similar methodologies have proven successful in evaluating the reliability of a variety of conventional earth structures. In this paper, an ''acceptable'' level of risk for UMTRA facilities is developed, an evaluation method is presented, and two example applications of the proposed methodology are provided for a generic UMTRA disposal facility. The proposed technique is shown to be a simple method which might be used to aid in reliability evaluations on a selective basis. Finally, other possible applications and the limitations of the proposed methodology are discussed

  3. Technical report on reliability assessment of the digital I and C equipment using reliability block diagram

    Energy Technology Data Exchange (ETDEWEB)

    Lee, Dong Young; Hwang, In Koo; Cha, Kyung Ho; Park, Joo Hyun; Choi, Jong Gyun; Lee, Ki Young; Park, Jong Kyun [Korea Atomic Energy Research Institute, Taejeon (Korea)

    2002-03-01

    As the operational life-time of nuclear power plants being currently developed is increasing with technology improvements, the life-time of instrumentation and control systems is also required to be met to this plant operational period. The electronic devices are usually expected to be available less than for 10 years. Therefore, an appropriate S and PM (surveillance and preventive maintenance) strategy should be established to secure the reliability and availability of the plants. EPRI-URD requires that the mean time between failures caused by any I and C system failure shall be more than 50 operating years. The methodology to access of the mean time between failures of I and C system is included in this report. 35 refs., 19 figs., 3 tabs. (Author)

  4. Observer reliability in assessing placental maturity by histology.

    OpenAIRE

    Khong, T Y; Staples, A; Bendon, R W; Chambers, H M; Gould, S J; Knowles, S; Shen-Schwarz, S

    1995-01-01

    AIMS--To evaluate the ability of five experienced perinatal pathologists to assess placental maturity reliably by histology. METHODS--Twenty four haematoxylin and eosin slides, six each from placentas of 27, 31, 35, and 39 weeks' gestation, were circulated to five pathologists on three separate occasions. The slides were labelled with the correct or incorrect gestational ages. RESULTS--The mean absolute error over all 360 readings was 2.72 weeks. Only 54% of the slides were assessed within tw...

  5. An approach for assessing ALWR passive safety system reliability

    International Nuclear Information System (INIS)

    Hake, T.M.

    1991-01-01

    Many of the advanced light water reactor (ALWR) concepts proposed for the next generation of nuclear power plants rely on passive rather than active systems to perform safety functions. Despite the reduced redundancy of the passive systems as compared to active systems in current plants, the assertion is that the overall safety of the plant is enhanced due to the much higher expected reliability of the passive systems. In order to investigate this assertion, a study is being conducted at Sandia National Laboratories to evaluate the reliability of ALWR passive safety features in the context of probabilistic risk assessment (PRA). The purpose of this paper is to provide a brief overview of the approach to this study. The quantification of passive system reliability is not as straightforward as for active systems, due to the lack of operating experience, and to the greater uncertainty in the governing physical phenomena. Thus, the adequacy of current methods for evaluating system reliability must be assessed, and alternatives proposed if necessary. For this study, the Westinghouse Advanced Passive 600 MWe reactor (AP600) was chosen as the advanced reactor for analysis, because of the availability of AP600 design information. This study compares the reliability of AP600 emergency cooling system with that of corresponding systems in a current generation reactor

  6. Reliability of Computerized Neurocognitive Tests for Concussion Assessment: A Meta-Analysis.

    Science.gov (United States)

    Farnsworth, James L; Dargo, Lucas; Ragan, Brian G; Kang, Minsoo

    2017-09-01

      Although widely used, computerized neurocognitive tests (CNTs) have been criticized because of low reliability and poor sensitivity. A systematic review was published summarizing the reliability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) scores; however, this was limited to a single CNT. Expansion of the previous review to include additional CNTs and a meta-analysis is needed. Therefore, our purpose was to analyze reliability data for CNTs using meta-analysis and examine moderating factors that may influence reliability.   A systematic literature search (key terms: reliability, computerized neurocognitive test, concussion) of electronic databases (MEDLINE, PubMed, Google Scholar, and SPORTDiscus) was conducted to identify relevant studies.   Studies were included if they met all of the following criteria: used a test-retest design, involved at least 1 CNT, provided sufficient statistical data to allow for effect-size calculation, and were published in English.   Two independent reviewers investigated each article to assess inclusion criteria. Eighteen studies involving 2674 participants were retained. Intraclass correlation coefficients were extracted to calculate effect sizes and determine overall reliability. The Fisher Z transformation adjusted for sampling error associated with averaging correlations. Moderator analyses were conducted to evaluate the effects of the length of the test-retest interval, intraclass correlation coefficient model selection, participant demographics, and study design on reliability. Heterogeneity was evaluated using the Cochran Q statistic.   The proportion of acceptable outcomes was greatest for the Axon Sports CogState Test (75%) and lowest for the ImPACT (25%). Moderator analyses indicated that the type of intraclass correlation coefficient model used significantly influenced effect-size estimates, accounting for 17% of the variation in reliability.   The Axon Sports CogState Test, which

  7. Reliability of the Hazelbaker Assessment Tool for Lingual Frenulum Function

    Directory of Open Access Journals (Sweden)

    James Jennifer P

    2006-03-01

    Full Text Available Abstract Background About 3% of infants are born with a tongue-tie which may lead to breastfeeding problems such as ineffective latch, painful attachment or poor weight gain. The Hazelbaker Assessment Tool for Lingual Frenulum Function (HATLFF has been developed to give a quantitative assessment of the tongue-tie and recommendation about frenotomy (release of the frenulum. The aim of this study was to assess the inter-rater reliability of the HATLFF. Methods Fifty-eight infants referred to the Breastfeeding Education and Support Services (BESS at The Royal Women's Hospital for assessment of tongue-tie and 25 control infants were assessed by two clinicians independently. Results The Appearance items received kappas between about 0.4 to 0.6, which represents "moderate" reliability. The first three Function items (lateralization, lift and extension of tongue had kappa values over 0.65 which indicates "substantial" agreement. The four Function items relating to infant sucking (spread, cupping, peristalsis and snapback received low kappa values with insignificant p values. There was 96% agreement between the two assessors on the recommendation for frenotomy (kappa 0.92, excellent agreement. The study found that the Function Score can be more simply assessed using only the first three function items (ie not scoring the sucking items, with a cut-off of ≤4 for recommendation of frenotomy. Conclusion We found that the HATLFF has a high reliability in a study of infants with tongue-tie and control infants

  8. Avaliação da saúde bucal de idosos por enfermeiros: validade e confiabilidade do instrumentO ASBTO Evaluación de la salud bucal de ancianos por enfermeros: fiabilidad y validez del instrumento IESB Nurse's assessment of oral health of elderly people: OHAT validity and reliability

    Directory of Open Access Journals (Sweden)

    Ana Lúcia Schaefer Ferreira de Mello

    2012-06-01

    utilizado por enfermeros para rastreo, sin embargo demanda entrenamiento práctico para ajuste de los criterios de examen.The aim of the study was to apply the Oral Health Assessment Tool (OHAT for determination of the reliability and validity indexes, when utilized by nursing staff. The OHAT was administered to 50 elderly individuals. The exams were performed in different periods of times by a Nurse and a Dental Surgeon (DS. The determination of internal consistency was verified through Cronbach's Alpha Coeficient and ANOVA. For the determination of stability and reliability, the percentage agreement and Kappa test were considered. There was no statistical difference among the final averages obtained by the DS and the nurse (p=0.41. There was a higher internal consistency in the exams performed by the DS. The Kappa value of the instrument reached 0.46, being considered moderate. The OHAT instrument can be used by nurses as a screening tool; however, previous training is needed for criteria standardization.

  9. Virtualization of Legacy Instrumentation Control Computers for Improved Reliability, Operational Life, and Management.

    Science.gov (United States)

    Katz, Jonathan E

    2017-01-01

    Laboratories tend to be amenable environments for long-term reliable operation of scientific measurement equipment. Indeed, it is not uncommon to find equipment 5, 10, or even 20+ years old still being routinely used in labs. Unfortunately, the Achilles heel for many of these devices is the control/data acquisition computer. Often these computers run older operating systems (e.g., Windows XP) and, while they might only use standard network, USB or serial ports, they require proprietary software to be installed. Even if the original installation disks can be found, it is a burdensome process to reinstall and is fraught with "gotchas" that can derail the process-lost license keys, incompatible hardware, forgotten configuration settings, etc. If you have running legacy instrumentation, the computer is the ticking time bomb waiting to put a halt to your operation.In this chapter, I describe how to virtualize your currently running control computer. This virtualized computer "image" is easy to maintain, easy to back up and easy to redeploy. I have used this multiple times in my own lab to greatly improve the robustness of my legacy devices.After completing the steps in this chapter, you will have your original control computer as well as a virtual instance of that computer with all the software installed ready to control your hardware should your original computer ever be decommissioned.

  10. Using Longitudinal Scales Assessment for Instrumental Music Students

    Science.gov (United States)

    Simon, Samuel H.

    2014-01-01

    In music education, current assessment trends emphasize student reflection, tracking progress over time, and formative as well as summative measures. This view of assessment requires instrumental music educators to modernize their approaches without interfering with methods that have proven to be successful. To this end, the Longitudinal Scales…

  11. Towards Developing a Quantitative Literacy/Reasoning Assessment Instrument

    Directory of Open Access Journals (Sweden)

    Eric Gaze

    2014-07-01

    Full Text Available This article reports on the development and implementation of a non-proprietary assessment instrument for Quantitative Literacy/Reasoning. This instrument was based on prior work by Bowdoin College, Colby-Sawyer College, and Wellesley College and was piloted in 2012 and 2013. This article presents a discussion of its development as well as the results of the pilot implementation. This work was supported by a TUES Type 1 grant from the National Science Foundation.

  12. Nonspecialist Raters Can Provide Reliable Assessments of Procedural Skills

    DEFF Research Database (Denmark)

    Mahmood, Oria; Dagnæs, Julia; Bube, Sarah

    2018-01-01

    was significant (p Pearson's correlation of 0.77 for the nonspecialists and 0.75 for the specialists. The test-retest reliability showed the biggest difference between the 2 groups, 0.59 and 0.38 for the nonspecialist raters and the specialist raters, respectively (p ... was chosen as it is a simple procedural skill that is crucial to master in a resident urology program. RESULTS: The internal consistency of assessments was high, Cronbach's α = 0.93 and 0.95 for nonspecialist and specialist raters, respectively (p correlations). The interrater reliability...

  13. Quantitative reliability assessment for safety critical system software

    International Nuclear Information System (INIS)

    Chung, Dae Won; Kwon, Soon Man

    2005-01-01

    An essential issue in the replacement of the old analogue I and C to computer-based digital systems in nuclear power plants is the quantitative software reliability assessment. Software reliability models have been successfully applied to many industrial applications, but have the unfortunate drawback of requiring data from which one can formulate a model. Software which is developed for safety critical applications is frequently unable to produce such data for at least two reasons. First, the software is frequently one-of-a-kind, and second, it rarely fails. Safety critical software is normally expected to pass every unit test producing precious little failure data. The basic premise of the rare events approach is that well-tested software does not fail under normal routine and input signals, which means that failures must be triggered by unusual input data and computer states. The failure data found under the reasonable testing cases and testing time for these conditions should be considered for the quantitative reliability assessment. We will present the quantitative reliability assessment methodology of safety critical software for rare failure cases in this paper

  14. Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

    Directory of Open Access Journals (Sweden)

    Bárbara Backes

    2014-07-01

    Full Text Available Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.

  15. High reliability flow system - an assessment of pump reliability and optimisation of the number of pumps

    International Nuclear Information System (INIS)

    Butterfield, J.M.

    1981-01-01

    A system is considered where a number of pumps operate in parallel. Normally, all pumps operate, driven by main motors fed from the grid. Each pump has a pony motor fed from an individual battery supply. Each pony motor is normally running, but not engaged to the pump shaft. On demand, e.g. failure of grid supplies, each pony motor is designed to clutch-in automatically when the pump speed falls to a specified value. The probability of all the pony motors failing to clutch-in on demand must be demonstrated with 95% confidence to be less than 10 -8 per demand. This assessment considers how the required reliability of pony motor drives might be demonstrated in practice and the implications on choice of the number of pumps at the design stage. The assessment recognises that not only must the system prove to be extremely reliable, but that demonstration that reliability is adequate must be done during plant commissioning, with practical limits on the amount of testing performed. It is concluded that a minimum of eight pony motors should be provided, eight pumps each with one pony motor (preferred) or five pumps each with two independent pony motors. A minimum of two diverse pony motor systems should be provided. (author)

  16. Reliability Assessment of Transformerless PV Inverters considering Mission Profiles

    Directory of Open Access Journals (Sweden)

    Yongheng Yang

    2015-01-01

    Full Text Available Due to the small volume and high efficiency, transformerless inverters have gained much popularity in grid-connected PV applications, where minimizing leakage current injection is mandatory. This can be achieved by either modifying the modulation schemes or adding extra power switching devices, resulting in an uneven distribution of the power losses on the switching devices. Consequently, the device thermal loading is redistributed and thus may alter the entire inverter reliability performance, especially under a long-term operation. In this consideration, this paper assesses the device reliability of three transformerless inverters under a yearly mission profile (i.e., solar irradiance and ambient temperature. The mission profile is translated to device thermal loading, which is used for lifetime prediction. Comparison results reveal the lifetime mismatches among the power switching devices operating under the same condition, which offers new thoughts for a robust design and a reliable operation of grid-connected transformerless PV inverters with high efficiency.

  17. Reliability-based assessment of polyethylene pipe creep lifetime

    International Nuclear Information System (INIS)

    Khelif, Rabia; Chateauneuf, Alaa; Chaoui, Kamel

    2007-01-01

    Lifetime management of underground pipelines is mandatory for safe hydrocarbon transmission and distribution systems. The use of high-density polyethylene tubes subjected to internal pressure, external loading and environmental variations requires a reliability study in order to define the service limits and the optimal operating conditions. In service, the time-dependent phenomena, especially creep, take place during the pipe lifetime, leading to significant strength reduction. In this work, the reliability-based assessment of pipe lifetime models is carried out, in order to propose a probabilistic methodology for lifetime model selection and to determine the pipe safety levels as well as the most important parameters for pipeline reliability. This study is enhanced by parametric analysis on pipe configuration, gas pressure and operating temperature

  18. Reliability-based assessment of polyethylene pipe creep lifetime

    Energy Technology Data Exchange (ETDEWEB)

    Khelif, Rabia [LaMI-UBP and IFMA, Campus de Clermont-Fd, Les Cezeaux, BP 265, 63175 Aubiere Cedex (France); LR3MI, Departement de Genie Mecanique, Universite Badji Mokhtar, BP 12, Annaba 23000 (Algeria)], E-mail: rabia.khelif@ifma.fr; Chateauneuf, Alaa [LGC-University Blaise Pascal, Campus des Cezeaux, BP 206, 63174 Aubiere Cedex (France)], E-mail: alaa.chateauneuf@polytech.univ-bpclermont.fr; Chaoui, Kamel [LR3MI, Departement de Genie Mecanique, Universite Badji Mokhtar, BP 12, Annaba 23000 (Algeria)], E-mail: chaoui@univ-annaba.org

    2007-12-15

    Lifetime management of underground pipelines is mandatory for safe hydrocarbon transmission and distribution systems. The use of high-density polyethylene tubes subjected to internal pressure, external loading and environmental variations requires a reliability study in order to define the service limits and the optimal operating conditions. In service, the time-dependent phenomena, especially creep, take place during the pipe lifetime, leading to significant strength reduction. In this work, the reliability-based assessment of pipe lifetime models is carried out, in order to propose a probabilistic methodology for lifetime model selection and to determine the pipe safety levels as well as the most important parameters for pipeline reliability. This study is enhanced by parametric analysis on pipe configuration, gas pressure and operating temperature.

  19. Test-retest Reliability and Agreement of the Satisfaction with the Assistive Technology Services (SATS) Instrument in Two Nordic Countries

    DEFF Research Database (Denmark)

    Sund, Terje; Anttila, Heidi; Iwarsson, Susanne

    2014-01-01

    Purpose: The purpose of this study was to investigate test–retest reliability, agreement, internal consistency, and floor- and ceiling effects of the Danish and Finnish versions of the Satisfaction with the Assistive Technology Services (SATS) instrument among adult users of powered wheelchairs (...

  20. Reliability and Validity Assessment of a Linear Position Transducer

    Science.gov (United States)

    Garnacho-Castaño, Manuel V.; López-Lastra, Silvia; Maté-Muñoz, José L.

    2015-01-01

    The objectives of the study were to determine the validity and reliability of peak velocity (PV), average velocity (AV), peak power (PP) and average power (AP) measurements were made using a linear position transducer. Validity was assessed by comparing measurements simultaneously obtained using the Tendo Weightlifting Analyzer Systemi and T-Force Dynamic Measurement Systemr (Ergotech, Murcia, Spain) during two resistance exercises, bench press (BP) and full back squat (BS), performed by 71 trained male subjects. For the reliability study, a further 32 men completed both lifts using the Tendo Weightlifting Analyzer Systemz in two identical testing sessions one week apart (session 1 vs. session 2). Intraclass correlation coefficients (ICCs) indicating the validity of the Tendo Weightlifting Analyzer Systemi were high, with values ranging from 0.853 to 0.989. Systematic biases and random errors were low to moderate for almost all variables, being higher in the case of PP (bias ±157.56 W; error ±131.84 W). Proportional biases were identified for almost all variables. Test-retest reliability was strong with ICCs ranging from 0.922 to 0.988. Reliability results also showed minimal systematic biases and random errors, which were only significant for PP (bias -19.19 W; error ±67.57 W). Only PV recorded in the BS showed no significant proportional bias. The Tendo Weightlifting Analyzer Systemi emerged as a reliable system for measuring movement velocity and estimating power in resistance exercises. The low biases and random errors observed here (mainly AV, AP) make this device a useful tool for monitoring resistance training. Key points This study determined the validity and reliability of peak velocity, average velocity, peak power and average power measurements made using a linear position transducer The Tendo Weight-lifting Analyzer Systemi emerged as a reliable system for measuring movement velocity and power. PMID:25729300

  1. The Modified Abbreviated Math Anxiety Scale: A Valid and Reliable Instrument for Use with Children.

    Science.gov (United States)

    Carey, Emma; Hill, Francesca; Devine, Amy; Szűcs, Dénes

    2017-01-01

    Mathematics anxiety (MA) can be observed in children from primary school age into the teenage years and adulthood, but many MA rating scales are only suitable for use with adults or older adolescents. We have adapted one such rating scale, the Abbreviated Math Anxiety Scale (AMAS), to be used with British children aged 8-13. In this study, we assess the scale's reliability, factor structure, and divergent validity. The modified AMAS (mAMAS) was administered to a very large ( n = 1746) cohort of British children and adolescents. This large sample size meant that as well as conducting confirmatory factor analysis on the scale itself, we were also able to split the sample to conduct exploratory and confirmatory factor analysis of items from the mAMAS alongside items from child test anxiety and general anxiety rating scales. Factor analysis of the mAMAS confirmed that it has the same underlying factor structure as the original AMAS, with subscales measuring anxiety about Learning and Evaluation in math. Furthermore, both exploratory and confirmatory factor analysis of the mAMAS alongside scales measuring test anxiety and general anxiety showed that mAMAS items cluster onto one factor (perceived to represent MA). The mAMAS provides a valid and reliable scale for measuring MA in children and adolescents, from a younger age than is possible with the original AMAS. Results from this study also suggest that MA is truly a unique construct, separate from both test anxiety and general anxiety, even in childhood.

  2. The Child Dental Control Assessment (CDCA) in youth: reliability, validity and cross-cultural differences.

    Science.gov (United States)

    Coolidge, T; Heima, M; Heaton, L J; Nakai, Y; Höskuldsson, O; Smith, T A; Weinstein, P; Milgrom, P

    2005-03-01

    The Child Dental Control Assessment (CDCA) measures children's preferred control strategies in the dental situation. Three studies are reported, assessing aspects of this instrument in youths from the USA, Japan and Australia. In particular, measurements were made as to the reliability and validity of this instrument in this age group in the three cultures, as well as comparing some results across cultures. These studies used a questionnaire design. Questionnaires (including the CDCA and other measures) were given to youths aged 11-15 in the three cultures. In one culture, youths received the questionnaire twice, to compute test-retest reliability. The measure's reliability and validity were similar to those of other measures. The CDCA behaves similarly to the Revised Iowa Dental Control Index (R-IDCI). Youths in all three cultures showed similar responses, although the Japanese were less likely to endorse items. Internal reliability of the scale ranged from 0.74 to 0.85. Test- retest reliability was 0.74. Participants in the High Desire/Low Predicted classification on the R-IDCI scored higher on the CDCA (t (73) = 2.9, p < .01). In the Japanese and Australian samples the correlation between CDCA and dental fear was 0.29-0.33 (p < .001). The Australian and USA samples scored significantly higher than the Japanese sample (overall F(2,1544) = 383.98, p < .001, followed by Tukey's HSD, p < .001). These results provide evidence for the reliability and validity of the CDCA in youth. It appears to measure the discrepancy between Desired and Predicted Control identified in the Revised Iowa Dental Control Index (R-IDCI). Responses of the youth in all three cultures were similar, indicating common dental control preferences for individuals of this age. However, consistent with cultural values, Japanese youth were less likely to endorse the control strategies. These results underline the need to develop culturally-specific, as well as situationally-specific control measures.

  3. Nanoscale deformation measurements for reliability assessment of material interfaces

    Science.gov (United States)

    Keller, Jürgen; Gollhardt, Astrid; Vogel, Dietmar; Michel, Bernd

    2006-03-01

    With the development and application of micro/nano electronic mechanical systems (MEMS, NEMS) for a variety of market segments new reliability issues will arise. The understanding of material interfaces is the key for a successful design for reliability of MEMS/NEMS and sensor systems. Furthermore in the field of BIOMEMS newly developed advanced materials and well known engineering materials are combined despite of fully developed reliability concepts for such devices and components. In addition the increasing interface-to volume ratio in highly integrated systems and nanoparticle filled materials are challenges for experimental reliability evaluation. New strategies for reliability assessment on the submicron scale are essential to fulfil the needs of future devices. In this paper a nanoscale resolution experimental method for the measurement of thermo-mechanical deformation at material interfaces is introduced. The determination of displacement fields is based on scanning probe microscopy (SPM) data. In-situ SPM scans of the analyzed object (i.e. material interface) are carried out at different thermo-mechanical load states. The obtained images are compared by grayscale cross correlation algorithms. This allows the tracking of local image patterns of the analyzed surface structure. The measurement results are full-field displacement fields with nanometer resolution. With the obtained data the mixed mode type of loading at material interfaces can be analyzed with highest resolution for future needs in micro system and nanotechnology.

  4. EARLY READING ASSESSMENT INSTRUMENTS: ABILITIES AND PROCESSES INVOLVED

    Directory of Open Access Journals (Sweden)

    Ana Cláudia de Souza

    2017-04-01

    Full Text Available This study investigates the following early reading assessment instruments: “Bateria de Recepção e Produção da Linguagem Verbal” (SCLIAR-CABRAL, 2003a and “Teste de Competência de Leitura de Palavras e Pseudopalavras” (SEABRA; CAPOVILLA, 2010. The main research goal is to analyze in each one of these reading assessment instruments some of the multiple cognitive processes and basic low-level abilities involved in reading. In this sense, decoding, word recognition, lexical access, syntactic and textual processing, and comprehension are the cognitive processes taken into account. With regard to the basic reading abilities, accuracy and fluency (rhythm, prosody and speed are considered. The results indicate that each one of the analyzed reading assessment instruments assesses different aspects of the reading processes and abilities, mainly through off-line measures. ScliarCabral’s assessment battery allows the researcher or the teacher to evaluate the following processes: perception of the grapheme opposition in minimal pairs of words and in sentences, difficulties in sentence processing, skills in decoding the graphemic-phonemic relationship, and textual comprehension. In its turn, the reading assessment instrument proposed by Seabra e Capovilla allows one to evaluate student’s reading development level, by classifying the kind of processing as logographic, alphabetic or orthographic.

  5. Mammography image assessment; validity and reliability of current scheme

    International Nuclear Information System (INIS)

    Hill, C.; Robinson, L.

    2015-01-01

    Mammographers currently score their own images according to criteria set out by Regional Quality Assurance. The criteria used are based on the ‘Perfect, Good, Moderate, Inadequate’ (PGMI) marking criteria established by the National Health Service Breast Screening Programme (NHSBSP) in their Quality Assurance Guidelines of 2006 1 . This document discusses the validity and reliability of the current mammography image assessment scheme. Commencing with a critical review of the literature this document sets out to highlight problems with the national approach to the use of marking schemes. The findings suggest that ‘PGMI’ scheme is flawed in terms of reliability and validity and is not universally applied across the UK. There also appear to be differences in schemes used by trainees and qualified mammographers. Initial recommendations are to be made in collaboration with colleagues within the National Health Service Breast Screening Programme (NHSBSP), Higher Education Centres, College of Radiographers and the Royal College of Radiologists in order to identify a mammography image appraisal scheme that is fit for purpose. - Highlights: • Currently no robust evidence based marking tools in use for the assessment of images in mammography. • Is current system valid, reliable and robust? • How can the current image assessment tool be improved? • Should students and qualified mammographers use the same tool? • What marking criteria are available for image assessment?

  6. Comparing the Psychometric Properties of Two Physical Activity Self-Efficacy Instruments in Urban, Adolescent Girls: Validity, Measurement Invariance, and Reliability

    Science.gov (United States)

    Voskuil, Vicki R.; Pierce, Steven J.; Robbins, Lorraine B.

    2017-01-01

    Aims: This study compared the psychometric properties of two self-efficacy instruments related to physical activity. Factorial validity, cross-group and longitudinal invariance, and composite reliability were examined. Methods: Secondary analysis was conducted on data from a group randomized controlled trial investigating the effect of a 17-week intervention on increasing moderate to vigorous physical activity among 5th–8th grade girls (N = 1,012). Participants completed a 6-item Physical Activity Self-Efficacy Scale (PASE) and a 7-item Self-Efficacy for Exercise Behaviors Scale (SEEB) at baseline and post-intervention. Confirmatory factor analyses for intervention and control groups were conducted with Mplus Version 7.4 using robust weighted least squares estimation. Model fit was evaluated with the chi-square index, comparative fit index, and root mean square error of approximation. Composite reliability for latent factors with ordinal indicators was computed from Mplus output using SAS 9.3. Results: Mean age of the girls was 12.2 years (SD = 0.96). One-third of the girls were obese. Girls represented a diverse sample with over 50% indicating black race and an additional 19% identifying as mixed or other race. Both instruments demonstrated configural invariance for simultaneous analysis of cross-group and longitudinal invariance based on alternative fit indices. However, simultaneous metric invariance was not met for the PASE or the SEEB instruments. Partial metric invariance for the simultaneous analysis was achieved for the PASE with one factor loading identified as non-invariant. Partial metric invariance was not met for the SEEB. Longitudinal scalar invariance was achieved for both instruments in the control group but not the intervention group. Composite reliability for the PASE ranged from 0.772 to 0.842. Reliability for the SEEB ranged from 0.719 to 0.800 indicating higher reliability for the PASE. Reliability was more stable over time in the control

  7. Assessing Social Networks in Patients with Psychotic Disorders: A Systematic Review of Instruments.

    Science.gov (United States)

    Siette, Joyce; Gulea, Claudia; Priebe, Stefan

    2015-01-01

    Evidence suggests that social networks of patients with psychotic disorders influence symptoms, quality of life and treatment outcomes. It is therefore important to assess social networks for which appropriate and preferably established instruments should be used. To identify instruments assessing social networks in studies of patients with psychotic disorders and explore their properties. A systematic search of electronic databases was conducted to identify studies that used a measure of social networks in patients with psychotic disorders. Eight instruments were identified, all of which had been developed before 1991. They have been used in 65 studies (total N of patients = 8,522). They assess one or more aspects of social networks such as their size, structure, dimensionality and quality. Most instruments have various shortcomings, including questionable inter-rater and test-retest reliability. The assessment of social networks in patients with psychotic disorders is characterized by a variety of approaches which may reflect the complexity of the construct. Further research on social networks in patients with psychotic disorders would benefit from advanced and more precise instruments using comparable definitions of and timescales for social networks across studies.

  8. The DYLAM approach to systems safety and reliability assessment

    International Nuclear Information System (INIS)

    Amendola, A.

    1988-01-01

    A survey of the principal features and applications of DYLAM (Dynamic Logical Analytical Methodology) is presented, whose basic principles can be summarized as follows: after a particular modelling of the component states, computerized heuristical procedures generate stochastic configurations of the system, whereas the resulting physical processes are simultaneously simulated to give account of the possible interactions between physics and states and, on the other hand, to search for system dangerous configurations and related probabilities. The association of probabilistic techniques for describing the states with physical equations for describing the process results in a very powerful tool for safety and reliability assessment of systems potentially subjected to dangerous incidental transients. A comprehensive picture of DYLAM capability for manifold applications can be obtained by the review of the study cases analyzed (LMFBR core accident, systems reliability assessment, accident simulation, man-machine interaction analysis, chemical reactors safety, etc.)

  9. Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR): Data manual

    International Nuclear Information System (INIS)

    Gilbert, B.G.; Reece, W.J.; Gertman, D.I.; Gilmore, W.E.; Galyean, W.J.

    1990-12-01

    The Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR) is an automated data base management system for processing and storing human error probability and hardware component failure data. The NUCLARR system software resides on an IBM (or compatible) personal computer. NUCLARR can furnish the end user with data inputs for both human and hardware reliability analysis in support of a variety of risk assessment activities. The NUCLARR system is documented is a five-volume series of reports. Volume V: Data Manual provides a hard-copy representation of all data and related information available within the NUCLARR system software. This document is organized in three sections. Part 1 is the summary description, which presents an overview of the NUCLARR system and data processing procedures. Part 2 contains all data and information relevant to the human error probability (HEP) data side of NUCLARR. Data and information for the hardware component failure data (HCFD) side are presented in Part 3. 7 refs

  10. Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR)

    International Nuclear Information System (INIS)

    Gilbert, B.G.; Reece, W.J.; Gertman, D.I.; Gilmore, W.E.; Galyean, W.J.

    1990-12-01

    The Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR) is an automated data base management system for processing and storing human error probability and hardware component failure data. The NUCLARR system software resides on an IBM (or compatible) personal computer. NUCLARR can furnish the end user with data inputs for both human and hardware reliability analysis in support of a variety of risk assessment activities. The NUCLARR system is documented in a five-volume series of reports. Volume 5: Data Manual provides a hard-copy representation of all data and related information available within the NUCLARR system software. This document is organized in three sections. Part 1 is the summary description, which presents an overview of the NUCLARR system and data processing procedures. Part 2 contains all data and information relevant to the human error probability (HEP) data side of NUCLARR. Data and information for the hardware component failure data (HCFD) side are presented in Part 3. 7 refs

  11. Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR): Data manual

    International Nuclear Information System (INIS)

    Gilbert, B.G.; Reece, W.J.; Gertman, D.I.; Gilmore, W.E.; Galyean, W.J.

    1990-12-01

    The Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR) is an automated data base management system for processing and storing human error probability and hardware component failure data. The NUCLARR system software resides on an IBM (or compatible) personal computer. NUCLARR can furnish the end user with data inputs for both human and hardware reliability analysis in support of a variety of risk assessment activities. The NUCLARR system is documented in a five-volume series of reports. Volume V: Data Manual provides a hard-copy representation of all data and related information available within the NUCLARR system software. This document is organized in three sections. Part 1 is the summary description, which presents an overview of the NUCLARR system and data processing procedures. Part 2 contains all data and information relevant to the human error probability (HEP) side of NUCLARR. Data and information for the hardware component failure data (HCFD) side are presented in Part 3. 7 refs., 1 fig

  12. Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR): Summary description

    International Nuclear Information System (INIS)

    Gertman, D.I.; Gilmore, W.E.; Galyean, W.J.; Groh, M.R.; Gentillon, C.D.; Gilbert, B.G.; Reece, W.J.

    1990-05-01

    The Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR) is an automate data base management system for storing and processing human error probability and hardware component failure rate data. The NUCLARR system software resides on an IBM (or compatible) personal microcomputer. NUCLARR can be accessed by the end user to furnish data suitable for input in human and/or hardware reliability analysis to support a variety of risk assessment activities. The NUCLARR system is documented in a five-volume series of reports. This document Volume 1, of this series is the Summary Description, which presents an overview of the data management system, including a description of data collection, data qualification, data structure, and taxonomies. Programming activities, procedures for processing data, a user's guide, and hard copy data manual are presented in Volumes 2 through 5, NUREG/CR-4639

  13. Reliability Assessment for Low-cost Unmanned Aerial Vehicles

    Science.gov (United States)

    Freeman, Paul Michael

    Existing low-cost unmanned aerospace systems are unreliable, and engineers must blend reliability analysis with fault-tolerant control in novel ways. This dissertation introduces the University of Minnesota unmanned aerial vehicle flight research platform, a comprehensive simulation and flight test facility for reliability and fault-tolerance research. An industry-standard reliability assessment technique, the failure modes and effects analysis, is performed for an unmanned aircraft. Particular attention is afforded to the control surface and servo-actuation subsystem. Maintaining effector health is essential for safe flight; failures may lead to loss of control incidents. Failure likelihood, severity, and risk are qualitatively assessed for several effector failure modes. Design changes are recommended to improve aircraft reliability based on this analysis. Most notably, the control surfaces are split, providing independent actuation and dual-redundancy. The simulation models for control surface aerodynamic effects are updated to reflect the split surfaces using a first-principles geometric analysis. The failure modes and effects analysis is extended by using a high-fidelity nonlinear aircraft simulation. A trim state discovery is performed to identify the achievable steady, wings-level flight envelope of the healthy and damaged vehicle. Tolerance of elevator actuator failures is studied using familiar tools from linear systems analysis. This analysis reveals significant inherent performance limitations for candidate adaptive/reconfigurable control algorithms used for the vehicle. Moreover, it demonstrates how these tools can be applied in a design feedback loop to make safety-critical unmanned systems more reliable. Control surface impairments that do occur must be quickly and accurately detected. This dissertation also considers fault detection and identification for an unmanned aerial vehicle using model-based and model-free approaches and applies those

  14. Preparation of methodology for reliability analysis of selected digital segments of the instrumentation and control systems of NPPs. Pt. 1

    International Nuclear Information System (INIS)

    Hustak, S.; Patrik, M.; Babic, P.

    2000-12-01

    The report is structured as follows: (i) Introduction; (ii) Important notions relating to the safety and dependability of software systems for nuclear power plants (selected notions from IAEA Technical Report No. 397; safety aspects of software application; reliability/dependability aspects of digital systems); (iii) Peculiarities of digital systems and ways to a dependable performance of the required function (failures in the system and principles of defence against them; ensuring resistance of digital systems against failures at various hardware and software levels); (iv) The issue of analytical procedures to assess the safety and reliability of safety-related digital systems (safety and reliability assessment at an early stage of the project; general framework of reliability analysis of complex systems; choice of an appropriate quantitative measure of software reliability); (v) Selected qualitative and quantitative information about the reliability of digital systems; the use of relations between the incidence of various types of faults); and (vi) Conclusions and recommendations. (P.A.)

  15. Validity and reliability of wii fit balance board for the assessment of balance of healthy young adults and the elderly.

    Science.gov (United States)

    Chang, Wen-Dien; Chang, Wan-Yi; Lee, Chia-Lun; Feng, Chi-Yen

    2013-10-01

    [Purpose] Balance is an integral part of human ability. The smart balance master system (SBM) is a balance test instrument with good reliability and validity, but it is expensive. Therefore, we modified a Wii Fit balance board, which is a convenient balance assessment tool, and analyzed its reliability and validity. [Subjects and Methods] We recruited 20 healthy young adults and 20 elderly people, and administered 3 balance tests. The correlation coefficient and intraclass correlation of both instruments were analyzed. [Results] There were no statistically significant differences in the 3 tests between the Wii Fit balance board and the SBM. The Wii Fit balance board had a good intraclass correlation (0.86-0.99) for the elderly people and positive correlations (r = 0.58-0.86) with the SBM. [Conclusions] The Wii Fit balance board is a balance assessment tool with good reliability and high validity for elderly people, and we recommend it as an alternative tool for assessing balance ability.

  16. Assessing Reliability and Validity of the "GroPromo" Audit Tool for Evaluation of Grocery Store Marketing and Promotional Environments

    Science.gov (United States)

    Kerr, Jacqueline; Sallis, James F.; Bromby, Erica; Glanz, Karen

    2012-01-01

    Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

  17. Reliability-based condition assessment of steel containment and liners

    International Nuclear Information System (INIS)

    Ellingwood, B.; Bhattacharya, B.; Zheng, R.

    1996-11-01

    Steel containments and liners in nuclear power plants may be exposed to aggressive environments that may cause their strength and stiffness to decrease during the plant service life. Among the factors recognized as having the potential to cause structural deterioration are uniform, pitting or crevice corrosion; fatigue, including crack initiation and propagation to fracture; elevated temperature; and irradiation. The evaluation of steel containments and liners for continued service must provide assurance that they are able to withstand future extreme loads during the service period with a level of reliability that is sufficient for public safety. Rational methodologies to provide such assurances can be developed using modern structural reliability analysis principles that take uncertainties in loading, strength, and degradation resulting from environmental factors into account. The research described in this report is in support of the Steel Containments and Liners Program being conducted for the US Nuclear Regulatory Commission by the Oak Ridge National Laboratory. The research demonstrates the feasibility of using reliability analysis as a tool for performing condition assessments and service life predictions of steel containments and liners. Mathematical models that describe time-dependent changes in steel due to aggressive environmental factors are identified, and statistical data supporting the use of these models in time-dependent reliability analysis are summarized. The analysis of steel containment fragility is described, and simple illustrations of the impact on reliability of structural degradation are provided. The role of nondestructive evaluation in time-dependent reliability analysis, both in terms of defect detection and sizing, is examined. A Markov model provides a tool for accounting for time-dependent changes in damage condition of a structural component or system. 151 refs

  18. A model for assessing human cognitive reliability in PRA studies

    International Nuclear Information System (INIS)

    Hannaman, G.W.; Spurgin, A.J.; Lukic, Y.

    1985-01-01

    This paper summarizes the status of a research project sponsored by EPRI as part of the Probabilistic Risk Assessment (PRA) technology improvement program and conducted by NUS Corporation to develop a model of Human Cognitive Reliability (HCR). The model was synthesized from features identified in a review of existing models. The model development was based on the hypothesis that the key factors affecting crew response times are separable. The inputs to the model consist of key parameters the values of which can be determined by PRA analysts for each accident situation being assessed. The output is a set of curves which represent the probability of control room crew non-response as a function of time for different conditions affecting their performance. The non-response probability is then a contributor to the overall non-success of operating crews to achieve a functional objective identified in the PRA study. Simulator data and some small scale tests were utilized to illustrate the calibration of interim HCR model coefficients for different types of cognitive processing since the data were sparse. The model can potentially help PRA analysts make human reliability assessments more explicit. The model incorporates concepts from psychological models of human cognitive behavior, information from current collections of human reliability data sources and crew response time data from simulator training exercises

  19. Statistical reliability assessment of software-based systems

    International Nuclear Information System (INIS)

    Korhonen, J.; Pulkkinen, U.; Haapanen, P.

    1997-01-01

    Plant vendors nowadays propose software-based systems even for the most critical safety functions. The reliability estimation of safety critical software-based systems is difficult since the conventional modeling techniques do not necessarily apply to the analysis of these systems, and the quantification seems to be impossible. Due to lack of operational experience and due to the nature of software faults, the conventional reliability estimation methods can not be applied. New methods are therefore needed for the safety assessment of software-based systems. In the research project Programmable automation systems in nuclear power plants (OHA), financed together by the Finnish Centre for Radiation and Nuclear Safety (STUK), the Ministry of Trade and Industry and the Technical Research Centre of Finland (VTT), various safety assessment methods and tools for software based systems are developed and evaluated. This volume in the OHA-report series deals with the statistical reliability assessment of software based systems on the basis of dynamic test results and qualitative evidence from the system design process. Other reports to be published later on in OHA-report series will handle the diversity requirements in safety critical software-based systems, generation of test data from operational profiles and handling of programmable automation in plant PSA-studies. (orig.) (25 refs.)

  20. Interrater reliability of videotaped observational gait-analysis assessments.

    Science.gov (United States)

    Eastlack, M E; Arvidson, J; Snyder-Mackler, L; Danoff, J V; McGarvey, C L

    1991-06-01

    The purpose of this study was to determine the interrater reliability of videotaped observational gait-analysis (VOGA) assessments. Fifty-four licensed physical therapists with varying amounts of clinical experience served as raters. Three patients with rheumatoid arthritis who demonstrated an abnormal gait pattern served as subjects for the videotape. The raters analyzed each patient's most severely involved knee during the four subphases of stance for the kinematic variables of knee flexion and genu valgum. Raters were asked to determine whether these variables were inadequate, normal, or excessive. The temporospatial variables analyzed throughout the entire gait cycle were cadence, step length, stride length, stance time, and step width. Generalized kappa coefficients ranged from .11 to .52. Intraclass correlation coefficients (2,1) and (3,1) were slightly higher. Our results indicate that physical therapists' VOGA assessments are only slightly to moderately reliable and that improved interrater reliability of the assessments of physical therapists utilizing this technique is needed. Our data suggest that there is a need for greater standardization of gait-analysis training.

  1. Reliability assessment of PARR-1 renovated I and C system startup channel-b

    Energy Technology Data Exchange (ETDEWEB)

    Qamar, M.A.; Habib, M.A.; Iqbal, M.

    1991-11-20

    The report covers the reliability assessment of the startup channel-B of the PARR-1 renovated instrumentation and Control. For startup channel-A, a separate report (DNSRP-10(7)/88) was prepared in 1988. As the modules are of different origins in both the channels, a separate calculation was necessary. In the report the overall unreliability of the startup channel has been calculated by considering 1 out of 2 operation mode. In the assessment, the reliability calculations for the channel has been performed using similar assumptions as used in the authors' report on startup channel-A. For the analysis the Component Count Method (CCM) was applied. Comparison of results for channel-A and channel-B were made.

  2. Reliability and availability assessments for the next European Torus

    International Nuclear Information System (INIS)

    Bunde, R.

    1988-01-01

    To achieve its targets in reasonable time, the Next European Torus (NET) must be operated with considerable reliability and availability (R and A). Therefore, failure modes, effects, and criticality analysis (FMECA) of the overall plant and of its major components is already being performed as the design evolves. The present status of the R and A work is described in four steps: First, the R and A targets envisaged for the NET operation are discussed. Then an FMECA covering the overall plant is described, and a more detailed FMECA of major components is presented concerning the toroidal field coil systeml plasma heating systems; protection, instrumentation, and control systems; first wall and blanket, as well as the cooling system. Finally, the R and A results are compared with the targets, and measures for improvements are given

  3. The Italian version of cognitive function instrument (CFI): reliability and validity in a cohort of healthy elderly.

    Science.gov (United States)

    Chipi, Elena; Frattini, Giulia; Eusebi, Paolo; Mollica, Anita; D'Andrea, Katia; Russo, Mirella; Bernardelli, Alice; Montanucci, Chiara; Luchetti, Elisa; Calabresi, Paolo; Parnetti, Lucilla

    2018-01-01

    The Alzheimer's disease Cooperative Study (ADCS)-Cognitive Function Instrument (CFI) is a 14-item questionnaire administered to the subject and the referent, aimed at detecting early changes in cognitive and functional abilities in individuals without clinical impairment. It is used for monitoring annual variations in cognitive functioning in prevention trials. The aim of the present study was to validate the Italian version of the CFI. A consecutive series of 257 functionally independent subjects was recruited among relatives of patients or as volunteers. They were administered CFI and global cognition measurements: Mini-Mental Status Examination (MMSE) and Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). The reliability and criterion validity were comparable to the original in both self- and partner-report. Similarly to what reported in the original version, we found a corrected item-total correlation ranging between 0.38 and 0.54 in self-report and between 0.33 and 0.64 in partner-report. Cronbach's α was 0.77 (95% CI 0.72-0.83) in self-report and 0.78 (95% CI 0.73-0.84) in partner-report. Total partner- and self-report scores were significantly correlated (rS = 0.31, p reliability and validity of the Italian version of CFI. In order to definitely propose the use of CFI for tracking longitudinal changes of cognitive and functional abilities in subjects without clinical impairment, data from the follow-up of this cohort are needed.

  4. [Reliability and validity of the PAQ-A questionnaire to assess physical activity in Spanish adolescents].

    Science.gov (United States)

    Martínez-Gómez, David; Martínez-de-Haro, Vicente; Pozo, Tamara; Welk, Gregory J; Villagra, Ariel; Calle, Marisa E; Marcos, Ascensión; Veiga, Oscar L

    2009-01-01

    Questionnaires are feasible instruments to assess physical activity (PA) in large samples. The aim of the current study was to evaluate the reliability and validity of the PAQ-A questionnaire in Spanish adolescents using the measurement of PA by accelerometer as criterion. In a sample of 82 adolescents, aged 12 to 17 years, 1-week PAQ-A test-retest was administered. Reliability was analyzed by the Intraclass Correlation Coefficient (ICC) and the internal consistency by the Cronbach's alpha Coefficient. Two hundred thirty-two adolescents, aged 13-17 years, completed the PAQ-A and wore the ActiGraph GT1M accelerometer during 7-days. The PAQ-A was compared against total PA and moderate to vigorous PA (MVPA) obtained by the accelerometer. Test-retest reliability showed ICC = 0.71 for the final score of PAQ-A. Internal consistency was alpha = 0.65 in the first self-report, alpha = 0.67 in the retest in 82 adolescents sample, and alpha = 0.74 in the 232 adolescents sample. The PAQ-A was moderately correlated with total PA (rho = 0.39) and MVPA (rho= 0.34) assessed by the accelerometer. The PAQ-A obtained significantly moderate correlations in boys but not in girls against the accelerometer. The PAQ-A questionnaire shows an adequate reliability and a reasonable validity for assessing PA in Spanish adolescents.

  5. Reliability assessment of passive containment isolation system using APSRA methodology

    International Nuclear Information System (INIS)

    Nayak, A.K.; Jain, Vikas; Gartia, M.R.; Srivastava, A.; Prasad, Hari; Anthony, A.; Gaikwad, A.J.; Bhatia, S.; Sinha, R.K.

    2008-01-01

    In this paper, a methodology known as APSRA (Assessment of Passive System ReliAbility) has been employed for evaluation of the reliability of passive systems. The methodology has been applied to the passive containment isolation system (PCIS) of the Indian advanced heavy water reactor (AHWR). In the APSRA methodology, the passive system reliability evaluation is based on the failure probability of the system to carryout the desired function. The methodology first determines the operational characteristics of the system and the failure conditions by assigning a predetermined failure criterion. The failure surface is predicted using a best estimate code considering deviations of the operating parameters from their nominal states, which affect the PCIS performance. APSRA proposes to compare the code predictions with the test data to generate the uncertainties on the failure parameter prediction, which is later considered in the code for accurate prediction of failure surface of the system. Once the failure surface of the system is predicted, the cause of failure is examined through root diagnosis, which occurs mainly due to failure of mechanical components. The failure probability of these components is evaluated through a classical PSA treatment using the generic data. The reliability of the PCIS is evaluated from the probability of availability of the components for the success of the passive containment isolation system

  6. A reliability assessment methodology for the VHTR passive safety system

    International Nuclear Information System (INIS)

    Lee, Hyungsuk; Jae, Moosung

    2014-01-01

    The passive safety system of a VHTR (Very High Temperature Reactor), which has recently attracted worldwide attention, is currently being considered for the design of safety improvements for the next generation of nuclear power plants in Korea. The functionality of the passive system does not rely on an external source of an electrical support system, but on the intelligent use of natural phenomena. Its function involves an ultimate heat sink for a passive secondary auxiliary cooling system, especially during a station blackout such as the case of the Fukushima Daiichi reactor accidents. However, it is not easy to quantitatively evaluate the reliability of passive safety for the purpose of risk analysis, considering the existing active system failure since the classical reliability assessment method cannot be applied. Therefore, we present a new methodology to quantify the reliability based on reliability physics models. This evaluation framework is then applied to of the conceptually designed VHTR in Korea. The Response Surface Method (RSM) is also utilized for evaluating the uncertainty of the maximum temperature of nuclear fuel. The proposed method could contribute to evaluating accident sequence frequency and designing new innovative nuclear systems, such as the reactor cavity cooling system (RCCS) in VHTR to be designed and constructed in Korea.

  7. Choosing Assessment Instruments for Bulimia Practice and Outcome Research

    Science.gov (United States)

    Sandberg, Katie; Erford, Bradley T.

    2013-01-01

    Six commonly used instruments for assessment of eating disorders were analyzed. Effect size results from Erford et al.'s (2013) meta-analysis for the treatment of bulimia nervosa were used to compare each scale's ability to measure treatment outcomes for bulimia nervosa. Effect size comparisons indicated higher overall effect sizes using the…

  8. STAMINA - Model description. Standard Model Instrumentation for Noise Assessments

    NARCIS (Netherlands)

    Schreurs EM; Jabben J; Verheijen ENG; CMM; mev

    2010-01-01

    Deze rapportage beschrijft het STAMINA-model, dat staat voor Standard Model Instrumentation for Noise Assessments en door het RIVM is ontwikkeld. Het instituut gebruikt dit standaardmodel om omgevingsgeluid in Nederland in kaart te brengen. Het model is gebaseerd op de Standaard Karteringsmethode

  9. development and validation of an instrument for assessing junior ...

    African Journals Online (AJOL)

    PROF. BARTH EKWEME

    school Mathematics classroom environment as it affects teaching and learning of Mathematics in Enugu. State. ... plays a significant role in computer technology. ... classroom. The main purpose of this study was to develop and validate an instrument for assessing junior secondary school Mathematics classroom learning ...

  10. Reliability and Convergent Validity of the Algometer for Vestibular Pain Assessment in Women with Provoked Vestibulodynia.

    Science.gov (United States)

    Cyr, Marie-Pierre; Bourbonnais, Daniel; Pinard, Alexandra; Dubois, Olivia; Morin, Mélanie

    2016-07-01

    Women with provoked vestibulodynia (PVD) suffer pain at the entry of the vagina elicited by pressure as during vaginal penetration. To quantify vestibular pain, we developed a new instrument, an algometer. The aim of this study was to investigate the test-retest reliability of the algometer and evaluate its convergent validity for vestibular pain assessment in women with PVD. Twenty-six women with PVD participated in the study. Vestibular pain was assessed with the new algometer and the already known vulvalgesiometer during two different sessions 2 to 4 weeks apart. At each session, the pressure pain threshold (PPT) and pressure pain tolerance (PPTol) were measured twice at the 3, 6, and 9 o'clock sites of the vestibule in random order. The test-retest reliability (intra- and inter-session) of the algometer was calculated using the intraclass correlation coefficient (ICC) and standard error of measurement (SEM). Its convergent validity was evaluated by the correlation coefficients between PPTs and PPTols measured by the algometer and those measured with the vulvalgesiometer. Intra-session reliability at all three sites for PPTs and PPTols in both sessions was excellent (ICC = 0.859 to 0.988, P ≤ 0.002). Inter-session reliability was good to excellent (ICC = 0.683 to 0.922, SEM = 15.06 to 47.04 g, P ≤ 0.001). Significant correlations were found between the two tools for all sites for PPTs (r = 0.500 to 0.614, P ≤ 0.009) and PPTols (r = 0.809 to 0.842, P algometer is a reliable and valid instrument for measuring PPTs and PPTols in the vestibular area in women with PVD. This technology is promising for pinpointing treatment mechanisms and efficacy. © 2015 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  11. Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned.

    Science.gov (United States)

    Brown, Stephen D; Rider, Elizabeth A; Jamieson, Katherine; Meyer, Elaine C; Callahan, Michael J; DeBenedectis, Carolynn M; Bixby, Sarah D; Walters, Michele; Forman, Sara F; Varrin, Pamela H; Forbes, Peter; Roussin, Christopher J

    2017-08-01

    The purpose of this study was to develop and test a standardized communication skills assessment instrument for radiology. The Delphi method was used to validate the Kalamazoo Communication Skills Assessment instrument for radiology by revising and achieving consensus on the 43 items of the preexisting instrument among an interdisciplinary team of experts consisting of five radiologists and four nonradiologists (two men, seven women). Reviewers assessed the applicability of the instrument to evaluation of conversations between radiology trainees and trained actors portraying concerned parents in enactments about bad news, radiation risks, and diagnostic errors that were video recorded during a communication workshop. Interrater reliability was assessed by use of the revised instrument to rate a series of enactments between trainees and actors video recorded in a hospital-based simulator center. Eight raters evaluated each of seven different video-recorded interactions between physicians and parent-actors. The final instrument contained 43 items. After three review rounds, 42 of 43 (98%) items had an average rating of relevant or very relevant for bad news conversations. All items were rated as relevant or very relevant for conversations about error disclosure and radiation risk. Reliability and rater agreement measures were moderate. The intraclass correlation coefficient range was 0.07-0.58; mean, 0.30; SD, 0.13; and median, 0.30. The range of weighted kappa values was 0.03-0.47; mean, 0.23; SD, 0.12; and median, 0.22. Ratings varied significantly among conversations (χ 2 6 = 1186; p communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

  12. Design and reliability of a didactic inphographic rubric assessment

    Directory of Open Access Journals (Sweden)

    Yunuen Ixchel GUZMÁN-CEDILLO

    2017-12-01

    Full Text Available The objective of this study is to describe design, validity process and reliability of a rubric assessment to evaluate didactic infographics quality. Participants were fifteen judges who participate in different moments of elaboration rubric process; it was made in three process phases: design, settings and reliability determination. Content validity was obtained by percentage agreement between 3 judges by component of the rubric; likewise a Krippendorff’s alpha were applied (a = .710 in pilot assessment with 5 infographics in order to set possible writings contradictions between components and criteria of performance. The intern consistence was determined by Cronbach’s alpha (? = .806 in 22 infographics gradation. An Intraclass correlation coefficient icc (a = .909 was applied to 6 judges qualifications also a Krippendorff’s alpha (a = .538 both of them in ordinal levels. The rubric is composed by 9 components, 3 performance levels, definitions of each component and assignments how to use the rubric. Results suggest the rubric is valid and reliable to grade quality of didactic infographic.

  13. The Maastricht Clinical Teaching Questionnaire (MCTQ) as a valid and reliable instrument for the evaluation of clinical teachers.

    Science.gov (United States)

    Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

    2010-11-01

    Clinical teaching's importance in the medical curriculum has led to increased interest in its evaluation. Instruments for evaluating clinical teaching must be theory based, reliable, and valid. The Maastricht Clinical Teaching Questionnaire (MCTQ), based on the theoretical constructs of cognitive apprenticeship, elicits evaluations of individual clinical teachers' performance at the workplace. The authors investigated its construct validity and reliability, and they used the underlying factors to test a causal model representing effective clinical teaching. Between March 2007 and December 2008, the authors asked students who had completed clerkship rotations in different departments of two teaching hospitals to use the MCTQ to evaluate their clinical teachers. To establish construct validity, the authors performed a confirmatory factor analysis of the evaluation data, and they estimated reliability by calculating the generalizability coefficient and standard error measurement. Finally, to test a model of the factors, they fitted a structural linear model to the data. Confirmatory factor analysis yielded a five-factor model which fit the data well. Generalizability studies indicated that 7 to 10 student ratings can produce reliable ratings of individual teachers. The hypothesized structural linear model underlined the central roles played by modeling and coaching (mediated by articulation). The MCTQ is a valid and reliable evaluation instrument, thereby demonstrating the usefulness of the cognitive apprenticeship concept for clinical teaching during clerkships. Furthermore, a valuable model of clinical teaching emerged, highlighting modeling, coaching, and stimulating students' articulation and exploration as crucial to effective teaching at the clinical workplace.

  14. Reliability and Validity Assessment of a Linear Position Transducer

    Directory of Open Access Journals (Sweden)

    Manuel V. Garnacho-Castaño

    2015-03-01

    Full Text Available The objectives of the study were to determine the validity and reliability of peak velocity (PV, average velocity (AV, peak power (PP and average power (AP measurements were made using a linear position transducer. Validity was assessed by comparing measurements simultaneously obtained using the Tendo Weightlifting Analyzer Systemi and T-Force Dynamic Measurement Systemr (Ergotech, Murcia, Spain during two resistance exercises, bench press (BP and full back squat (BS, performed by 71 trained male subjects. For the reliability study, a further 32 men completed both lifts using the Tendo Weightlifting Analyzer Systemz in two identical testing sessions one week apart (session 1 vs. session 2. Intraclass correlation coefficients (ICCs indicating the validity of the Tendo Weightlifting Analyzer Systemi were high, with values ranging from 0.853 to 0.989. Systematic biases and random errors were low to moderate for almost all variables, being higher in the case of PP (bias ±157.56 W; error ±131.84 W. Proportional biases were identified for almost all variables. Test-retest reliability was strong with ICCs ranging from 0.922 to 0.988. Reliability results also showed minimal systematic biases and random errors, which were only significant for PP (bias -19.19 W; error ±67.57 W. Only PV recorded in the BS showed no significant proportional bias. The Tendo Weightlifting Analyzer Systemi emerged as a reliable system for measuring movement velocity and estimating power in resistance exercises. The low biases and random errors observed here (mainly AV, AP make this device a useful tool for monitoring resistance training.

  15. Developing the Coach Analysis and Intervention System (CAIS): establishing validity and reliability of a computerised systematic observation instrument.

    Science.gov (United States)

    Cushion, Christopher; Harvey, Stephen; Muir, Bob; Nelson, Lee

    2012-01-01

    We outline the evolution of a computerised systematic observation tool and describe the process for establishing the validity and reliability of this new instrument. The Coach Analysis and Interventions System (CAIS) has 23 primary behaviours related to physical behaviour, feedback/reinforcement, instruction, verbal/non-verbal, questioning and management. The instrument also analyses secondary coach behaviour related to performance states, recipient, timing, content and questioning/silence. The CAIS is a multi-dimensional and multi-level mechanism able to provide detailed and contextualised data about specific coaching behaviours occurring in complex and nuanced coaching interventions and environments that can be applied to both practice sessions and competition.

  16. Reliability Assessment of Transformerless PV Inverters Considering Mission Profiles

    DEFF Research Database (Denmark)

    Yang, Yongheng; Wang, Huai; Blaabjerg, Frede

    2015-01-01

    reliability of three transformerless inverters under a yearly mission profile (i.e., solar irradiance and ambient temperature). The mission profile is translated to device thermal loading, which is used for lifetime prediction. Compar¬ison results reveal the lifetime mismatches among the power switching......Due to the small volume and high efficiency, transformerless inverters have gained much popularity in grid-connected PV applications, where minimizing leakage current injection is mandatory. This can be achieved either by modifying the modulation schemes or adding extra power switching devices......, resulting in an uneven distribution of the power losses on the switching devices. Consequently, the device thermal loading is redis-tributed, and thus may alter the entire inverter reliability performance, especially under a long-term operation. In this consideration, this paper assesses the device...

  17. Improving risk assessment by defining consistent and reliable system scenarios

    Directory of Open Access Journals (Sweden)

    B. Mazzorana

    2009-02-01

    Full Text Available During the entire procedure of risk assessment for hydrologic hazards, the selection of consistent and reliable scenarios, constructed in a strictly systematic way, is fundamental for the quality and reproducibility of the results. However, subjective assumptions on relevant impact variables such as sediment transport intensity on the system loading side and weak point response mechanisms repeatedly cause biases in the results, and consequently affect transparency and required quality standards. Furthermore, the system response of mitigation measures to extreme event loadings represents another key variable in hazard assessment, as well as the integral risk management including intervention planning. Formative Scenario Analysis, as a supplement to conventional risk assessment methods, is a technique to construct well-defined sets of assumptions to gain insight into a specific case and the potential system behaviour. By two case studies, carried out (1 to analyse sediment transport dynamics in a torrent section equipped with control measures, and (2 to identify hazards induced by woody debris transport at hydraulic weak points, the applicability of the Formative Scenario Analysis technique is presented. It is argued that during scenario planning in general and with respect to integral risk management in particular, Formative Scenario Analysis allows for the development of reliable and reproducible scenarios in order to design more specifically an application framework for the sustainable assessment of natural hazards impact. The overall aim is to optimise the hazard mapping and zoning procedure by methodologically integrating quantitative and qualitative knowledge.

  18. Reliability assessment of creep rupture life for Gr. 91 steel

    International Nuclear Information System (INIS)

    Kim, Woo-Gon; Park, Jae-Young; Kim, Seon-Jin; Jang, Jinsung

    2013-01-01

    Highlights: • Statistical analysis of a number of creep rupture data based on Z parameter. • Determination of the constant C in LM parameter and long-term creep life prediction. • Generation of random variables for Z s and Z cr by Monte-Carlo simulation in a SCRI model. • Examples for design application were reasonably drawn from the viewpoints of reliability. - Abstract: This paper presents reliability assessment of the long-term creep life of Gr. 91 steel, which is a major structural material for high temperature structural components of Generation-IV reactor systems. A number of creep rupture data for Gr. 91 steel were collected through literature surveys, and the long-term creep life was predicted by Larson–Miller parameter. A “Z parameter” method was used to describe the magnitude of the deviation of the creep rupture data to a master curve. A “Service Condition-creep Rupture property Interference (SCRI) model” based on the Z parameter was used to simultaneously consider the scattering of the creep rupture data of materials and the fluctuations of service conditions in reliability assessment. A statistical analysis of the creep rupture data was conducted by the Z parameter. To carry out the SCRI model, a number of random variables for Z s describing service conditions and Z cr describing the dispersion of the creep rupture data were generated using a Monte-Carlo simulation technique. As examples for application, the creep rupture life under a certain service conditions of Gr. 91 steel was reasonably drawn from the viewpoints of reliability

  19. Blinded evaluation of interrater reliability of an operative competency assessment tool for direct laryngoscopy and rigid bronchoscopy.

    Science.gov (United States)

    Ishman, Stacey L; Benke, James R; Johnson, Kaalan Erik; Zur, Karen B; Jacobs, Ian N; Thorne, Marc C; Brown, David J; Lin, Sandra Y; Bhatti, Nasir; Deutsch, Ellen S

    2012-10-01

    OBJECTIVES To confirm interrater reliability using blinded evaluation of a skills-assessment instrument to assess the surgical performance of resident and fellow trainees performing pediatric direct laryngoscopy and rigid bronchoscopy in simulated models. DESIGN Prospective, paired, blinded observational validation study. SUBJECTS Paired observers from multiple institutions simultaneously evaluated residents and fellows who were performing surgery in an animal laboratory or using high-fidelity manikins. The evaluators had no previous affiliation with the residents and fellows and did not know their year of training. INTERVENTIONS One- and 2-page versions of an objective structured assessment of technical skills (OSATS) assessment instrument composed of global and a task-specific surgical items were used to evaluate surgical performance. RESULTS Fifty-two evaluations were completed by 17 attending evaluators. The instrument agreement for the 2-page assessment was 71.4% when measured as a binary variable (ie, competent vs not competent) (κ = 0.38; P = .08). Evaluation as a continuous variable revealed a 42.9% percentage agreement (κ = 0.18; P = .14). The intraclass correlation was 0.53, considered substantial/good interrater reliability (69% reliable). For the 1-page instrument, agreement was 77.4% when measured as a binary variable (κ = 0.53, P = .0015). Agreement when evaluated as a continuous measure was 71.0% (κ = 0.54, P formative feedback on operational competency.

  20. Development of an instrument to assess readiness to recover in anorexia nervosa.

    Science.gov (United States)

    Rieger, E; Touyz, S; Schotte, D; Beumont, P; Russell, J; Clarke, S; Kohn, M; Griffiths, R

    2000-12-01

    The degree to which patients with anorexia nervosa demonstrate readiness to recover from their illness has received scant theoretical or empirical attention. Investigating the prevalence and degree of amotivation for recovery in anorexia nervosa, its role in outcome, and the effectiveness of interventions designed to enhance readiness to recover necessitates the existence of a reliable and valid measure of motivational issues relevant to the disorder. The present study aimed to develop and evaluate an instrument for assessing readiness to recover in anorexia nervosa, namely, the Anorexia Nervosa Stages of Change Questionnaire (ANSOCQ), a 23-item self-report questionnaire based on Prochaska and DiClemente's stages of change model. Seventy-one inpatients with anorexia nervosa participated in the study. On several occasions during their admission, participants completed the ANSOCQ as well as questionnaires assessing readiness to recover, anorexic symptomatology, general distress, and social desirability. The ANSOCQ demonstrated good internal consistency (.90) and 1-week test-retest reliability (.89). Various aspects of validity were also supported, such as significant relationships with other instruments assessing readiness to recover and the prediction of weight gain during different periods of treatment. The results suggest that the ANSOCQ is a psychometrically sound instrument that may prove useful in investigating the role of readiness to recover in anorexia nervosa. Copyright 2000 John Wiley & Sons, Inc.

  1. The Cognitive Telephone Screening Instrument (COGTEL: A Brief, Reliable, and Valid Tool for Capturing Interindividual Differences in Cognitive Functioning in Epidemiological and Aging Studies

    Directory of Open Access Journals (Sweden)

    Andreas Ihle

    2017-10-01

    Full Text Available Aims: The present study set out to evaluate the psychometric properties of the Cognitive Telephone Screening Instrument (COGTEL in 2 different samples of older adults. Methods: We assessed COGTEL in 116 older adults, with retest after 7 days to evaluate the test-retest reliability. Moreover, we assessed COGTEL in 868 older adults to evaluate convergent validity to the Mini-Mental State Examination (MMSE. Results: Test-retest reliability of the COGTEL total score was good at 0.85 (p < 0.001. Latent variable analyses revealed that COGTEL and MMSE correlated by 0.93 (p < 0.001, indicating convergent validity of the COGTEL. Conclusion: The present analyses suggest COGTEL as a brief, reliable, and valid instrument for capturing interindividual differences in cognitive functioning in epidemiological and aging studies, with the advantage of covering more cognitive domains than traditional screening tools such as the MMSE, as well as differentiating between individual performance levels, in healthy older adults.

  2. Risk Assessment Stability: A Revalidation Study of the Arizona Risk/Needs Assessment Instrument

    Science.gov (United States)

    Schwalbe, Craig S.

    2009-01-01

    The actuarial method is the gold standard for risk assessment in child welfare, juvenile justice, and criminal justice. It produces risk classifications that are highly predictive and that may be robust to sampling error. This article reports a revalidation study of the Arizona Risk/Needs Assessment instrument, an actuarial instrument for juvenile…

  3. The Development, Validity, and Reliability of a Psychometric Instrument Measuring Competencies in Student Affairs

    Science.gov (United States)

    Sriram, Rishi

    2014-01-01

    The study of competencies in student affairs began more than 4 decades ago, but no instrument currently exists to measure competencies broadly. This study builds upon previous research by developing an instrument to measure student affairs competencies. Results not only validate the competencies espoused by NASPA and ACPA, but also suggest adding…

  4. Assessing health status and quality-of-life instruments: attributes and review criteria.

    Science.gov (United States)

    Aaronson, Neil; Alonso, Jordi; Burnam, Audrey; Lohr, Kathleen N; Patrick, Donald L; Perrin, Edward; Stein, Ruth E

    2002-05-01

    The field of health status and quality of life (QoL) measurement - as a formal discipline with a cohesive theoretical framework, accepted methods, and diverse applications--has been evolving for the better part of 30 years. To identify health status and QoL instruments and review them against rigorous criteria as a precursor to creating an instrument library for later dissemination, the Medical Outcomes Trust in 1994 created an independently functioning Scientific Advisory Committee (SAC). In the mid-1990s, the SAC defined a set of attributes and criteria to carry out instrument assessments; 5 years later, it updated and revised these materials to take account of the expanding theories and technologies upon which such instruments were being developed. This paper offers the SAC's current conceptualization of eight key attributes of health status and QoL instruments (i.e., conceptual and measurement model; reliability; validity; responsiveness; interpretability; respondent and administrative burden; alternate forms; and cultural and language adaptations) and the criteria by which instruments would be reviewed on each of those attributes. These are suggested guidelines for the field to consider and debate; as measurement techniques become both more familiar and more sophisticated, we expect that experts will wish to update and refine these criteria accordingly.

  5. Reliability, compliance, and security in web-based course assessments

    Directory of Open Access Journals (Sweden)

    Scott Bonham

    2008-04-01

    Full Text Available Pre- and postcourse assessment has become a very important tool for education research in physics and other areas. The web offers an attractive alternative to in-class paper administration, but concerns about web-based administration include reliability due to changes in medium, student compliance rates, and test security, both question leakage and utilization of web resources. An investigation was carried out in introductory astronomy courses comparing pre- and postcourse administration of assessments using the web and on paper. Overall no difference was seen in performance due to the medium. Compliance rates fluctuated greatly, and factors that seemed to produce higher rates are identified. Notably, email reminders increased compliance by 20%. Most of the 559 students complied with requests to not copy, print, or save questions nor use web resources; about 1% did copy some question text and around 2% frequently used other windows or applications while completing the assessment.

  6. A comparative evaluation of five human reliability assessment techniques

    International Nuclear Information System (INIS)

    Kirwan, B.

    1988-01-01

    A field experiment was undertaken to evaluate the accuracy, usefulness, and resources requirements of five human reliability quantification techniques (Techniques for Human Error Rate Prediction (THERP); Paired Comparisons, Human Error Assessment and Reduction Technique (HEART), Success Liklihood Index Method (SLIM)-Multi Attribute Utility Decomposition (MAUD), and Absolute Probability Judgement). This was achieved by assessing technique predictions against a set of known human error probabilities, and by comparing their predictions on a set of five realistic Probabilisitc Risk Assessment (PRA) human error. On a combined measure of accuracy THERP and Absolute Probability Judgement performed best, whilst HEART showed indications of accuracy and was lower in resources usage than other techniques. HEART and THERP both appear to benefit from using trained assessors in order to obtain the best results. SLIM and Paired Comparisons require further research on achieving a robust calibration relationship between their scale values and absolute probabilities. (author)

  7. How to interpret safety critical failures in risk and reliability assessments

    International Nuclear Information System (INIS)

    Selvik, Jon Tømmerås; Signoret, Jean-Pierre

    2017-01-01

    Management of safety systems often receives high attention due to the potential for industrial accidents. In risk and reliability literature concerning such systems, and particularly concerning safety-instrumented systems, one frequently comes across the term ‘safety critical failure’. It is a term associated with the term ‘critical failure’, and it is often deduced that a safety critical failure refers to a failure occurring in a safety critical system. Although this is correct in some situations, it is not matching with for example the mathematical definition given in ISO/TR 12489:2013 on reliability modeling, where a clear distinction is made between ‘safe failures’ and ‘dangerous failures’. In this article, we show that different interpretations of the term ‘safety critical failure’ exist, and there is room for misinterpretations and misunderstandings regarding risk and reliability assessments where failure information linked to safety systems are used, and which could influence decision-making. The article gives some examples from the oil and gas industry, showing different possible interpretations of the term. In particular we discuss the link between criticality and failure. The article points in general to the importance of adequate risk communication when using the term, and gives some clarification on interpretation in risk and reliability assessments.

  8. Fitness to plead: Development and validation of a standardised assessment instrument.

    Directory of Open Access Journals (Sweden)

    Penelope Brown

    Full Text Available The ability of an individual to participate in courtroom proceedings is assessed by clinicians using legal 'fitness to plead' criteria. Findings of 'unfitness' are so rare that there is considerable professional unease concerning the utility of the current subjective assessment process. As a result, mentally disordered defendants may be subjected unfairly to criminal trials. The Law Commission in England and Wales has proposed legal reform, as well as the utilisation of a defined psychiatric instrument to assist in fitness to plead assessments. Similar legal reforms are occurring in other jurisdictions. Our objective was to produce and validate a standardised assessment instrument of fitness to plead employing a filmed vignette of criminal proceedings. The instrument was developed in consultation with legal and clinical professionals, and was refined using standard item reduction methods in two initial rounds of testing (n = 212. The factorial structure, test-retest reliability and convergent validity of the resultant instrument were assessed in a further round (n = 160. As a result of this iterative process a 25-item scale was produced, with an underlying two-factor structure representing the foundational and decision-making abilities underpinning fitness to plead. The sub-scales demonstrate good internal consistency (factor 1: 0·76; factor 2: 0·65 and test-retest stability (0·7 as well as excellent convergent validity with scores of intelligence, executive function and mentalising abilities (p≤0·01 in all domains. Overall the standardised Fitness to Plead Assessment instrument has good psychometric properties. It has the potential to ensure that the significant numbers of mentally ill and cognitively impaired individuals who face trial are objectively assessed, and the courtroom process critically informed.

  9. Assessing patient-centred communication in teaching: a systematic review of instruments.

    Science.gov (United States)

    Brouwers, Marianne; Rasenberg, Ellemieke; van Weel, Chris; Laan, Roland; van Weel-Baumgarten, Evelyn

    2017-11-01

    Patient-centred communication is a key component of patient centredness in medical care. Therefore, adequate education in and assessment of patient-centred communication skills are necessary. In general, feedback on communication skills is most effective when it is provided directly and is systematic. This calls for adequate measurement instruments. The aim of this study was to provide a systematic review of existing instruments that measure patient centredness in doctor-patient communication and can be used to provide direct feedback. A systematic review was conducted using an extensive validated search strategy for measurement instruments in PubMed, EMBASE, PsycINFO and CINAHL. The databases were searched from their inception to 1 July 2016. Articles describing the development or evaluation of the measurement properties of instruments that measure patient centredness (by applying three or more of the six dimensions of a published definition of patient centredness) in doctor-patient communication and that can be used for the provision of direct feedback were included. The methodological quality of measurement properties was evaluated using the COSMIN checklist. Thirteen articles describing 14 instruments measuring patient centredness in doctor-patient communication were identified. These studies cover a wide range of settings and patient populations, and vary in the dimensions of patient centredness applied and in methodological quality on aspects of reliability and validity. This review gives a comprehensive overview of all instruments available for the measurement of patient centredness in doctor-patient communication that can be used for the provision of direct feedback and are described in the literature. Despite the widely felt need for valid and reliable instruments for the measurement of patient-centred communication, most of the instruments currently available have not been thoroughly investigated. Therefore, we recommend further research into and

  10. An instrument to assess subjective task value beliefs regarding the decision to pursue postgraduate training.

    Science.gov (United States)

    Hagemeier, Nicholas E; Murawski, Matthew M

    2014-02-12

    To develop and validate an instrument to assess subjective ratings of the perceived value of various postgraduate training paths followed using expectancy-value as a theoretical framework; and to explore differences in value beliefs across type of postgraduate training pursued and type of pharmacy training completed prior to postgraduate training. A survey instrument was developed to sample 4 theoretical domains of subjective task value: intrinsic value, attainment value, utility value, and perceived cost. Retrospective self-report methodology was employed to examine respondents' (N=1,148) subjective task value beliefs specific to their highest level of postgraduate training completed. Exploratory and confirmatory factor analytic techniques were used to evaluate and validate value belief constructs. Intrinsic, attainment, utility, cost, and financial value constructs resulted from exploratory factor analysis. Cross-validation resulted in a 26-item instrument that demonstrated good model fit. Differences in value beliefs were noted across type of postgraduate training pursued and pharmacy training characteristics. The Postgraduate Training Value Instrument demonstrated evidence of reliability and construct validity. The survey instrument can be used to assess value beliefs regarding multiple postgraduate training options in pharmacy and potentially inform targeted recruiting of individuals to those paths best matching their own value beliefs.

  11. Reliability and validity of the transport and physical activity questionnaire (TPAQ) for assessing physical activity behaviour.

    Science.gov (United States)

    Adams, Emma J; Goad, Mary; Sahlqvist, Shannon; Bull, Fiona C; Cooper, Ashley R; Ogilvie, David

    2014-01-01

    No current validated survey instrument allows a comprehensive assessment of both physical activity and travel behaviours for use in interdisciplinary research on walking and cycling. This study reports on the test-retest reliability and validity of physical activity measures in the transport and physical activity questionnaire (TPAQ). The TPAQ assesses time spent in different domains of physical activity and using different modes of transport for five journey purposes. Test-retest reliability of eight physical activity summary variables was assessed using intra-class correlation coefficients (ICC) and Kappa scores for continuous and categorical variables respectively. In a separate study, the validity of three survey-reported physical activity summary variables was assessed by computing Spearman correlation coefficients using accelerometer-derived reference measures. The Bland-Altman technique was used to determine the absolute validity of survey-reported time spent in moderate-to-vigorous physical activity (MVPA). In the reliability study, ICC for time spent in different domains of physical activity ranged from fair to substantial for walking for transport (ICC = 0.59), cycling for transport (ICC = 0.61), walking for recreation (ICC = 0.48), cycling for recreation (ICC = 0.35), moderate leisure-time physical activity (ICC = 0.47), vigorous leisure-time physical activity (ICC = 0.63), and total physical activity (ICC = 0.56). The proportion of participants estimated to meet physical activity guidelines showed acceptable reliability (k = 0.60). In the validity study, comparison of survey-reported and accelerometer-derived time spent in physical activity showed strong agreement for vigorous physical activity (r = 0.72, ptravel behaviours and may be suitable for wider use. Its physical activity summary measures have comparable reliability and validity to those of similar existing questionnaires.

  12. Reliability of Volumetry and Perimetry to Assess Knee Volume.

    Science.gov (United States)

    Nunes, Guilherme S; Yamashitafuji, Igor; Wageck, Bruna; Teixeira, Guilherme Garcia; Karloh, Manuela; de Noronha, Marcos

    2016-08-24

    The treatment of edema after a knee injury is usually 1 of the main objectives during rehabilitation. To assess the success of treatment, 2 methods are commonly used in clinical practice: volumetry and perimetry. To investigate the intra- and interassessor reliability of volumetry and perimetry to assess knee volume. Cross-sectional. Laboratory. 45 healthy participants (26 women) with mean age of 22.4 ± 2.8 y. Knee volume was assessed by 3 assessors (A, B, and C) with 3 methods (lower-limb volumetry [LLV], knee volumetry [KV], and knee perimetry [KP]). Assessor A was the most-experienced assessor, and assessor C, the least experienced. LLV and KV were performed with participants in the orthostatic position, while KP was performed with participants in supine. For the interassessor analysis, the ICC2,1 was high (.82) for KV and very high for LLV (.99) and KP (.99). For the intra-assessor analysis, ICC2,1 ranged from moderate to high for KV (.69-.83) and was very high for LLV (.99) and KP (.97-.99). KV, LLV, and KP are reliable methods, both intra- and interassessor, to measure knee volume.

  13. Assessing Reliability of Cold Spray Sputter Targets in Photovoltaic Manufacturing

    Science.gov (United States)

    Hardikar, Kedar; Vlcek, Johannes; Bheemreddy, Venkata; Juliano, Daniel

    2017-10-01

    Cold spray has been used to manufacture more than 800 Cu-In-Ga (CIG) sputter targets for deposition of high-efficiency photovoltaic thin films. It is a preferred technique since it enables high deposit purity and transfer of non-equilibrium alloy states to the target material. In this work, an integrated approach to reliability assessment of such targets with deposit weight in excess of 50 lb. is undertaken, involving thermal-mechanical characterization of the material in as-deposited condition, characterization of the interface adhesion on cylindrical substrate in as-deposited condition, and developing means to assess target integrity under thermal-mechanical loads during the physical vapor deposition (PVD) sputtering process. Mechanical characterization of cold spray deposited CIG alloy is accomplished through the use of indentation testing and adaptation of Brazilian disk test. A custom lever test was developed to characterize adhesion along the cylindrical interface between the CIG deposit and cylindrical substrate, overcoming limitations of current standards. A cohesive zone model for crack initiation and propagation at the deposit interface is developed and validated using the lever test and later used to simulate the potential catastrophic target failure in the PVD process. It is shown that this approach enables reliability assessment of sputter targets and improves robustness.

  14. Adaptation and testing of psychosocial assessment instruments for cross-cultural use: an example from the Thailand Burma border.

    Science.gov (United States)

    Haroz, Emily E; Bass, Judith K; Lee, Catherine; Murray, Laura K; Robinson, Courtland; Bolton, Paul

    2014-01-01

    The purpose of this study was to develop valid and reliable instruments to assess priority psychosocial problems and functioning among adult survivors of systematic violence from Burma living in Thailand. The process involved four steps: 1) instrument drafting and piloting; 2) reliability and validity testing; 3) instrument revision; and 4) retesting revised instrument. A total of N = 158 interviews were completed. Overall subscales showed good internal consistency (0.73-0.92) and satisfactory combined test-retest/inter rater reliability (0.63-0.84). Criterion validity, was not demonstrated for any scale. The alcohol and functioning scales underperformed and were revised (step 3) and retested (step 4). Upon retesting, the function scale showed good internal consistency reliability (0.91-0.92), and the alcohol scale showed acceptable internal consistency (0.79) and strong test-retest/inter-rater reliability (0.86-0.89). This paper describes the importance and process of adaptation and testing, illustrated by the experiences and results for selected instruments in this population.

  15. Method for assessing reliability of a network considering probabilistic safety assessment

    International Nuclear Information System (INIS)

    Cepin, M.

    2005-01-01

    A method for assessment of reliability of the network is developed, which uses the features of the fault tree analysis. The method is developed in a way that the increase of the network under consideration does not require significant increase of the model. The method is applied to small examples of network consisting of a small number of nodes and a small number of their connections. The results give the network reliability. They identify equipment, which is to be carefully maintained in order that the network reliability is not reduced, and equipment, which is a candidate for redundancy, as this would improve network reliability significantly. (author)

  16. Assessing high reliability via Bayesian approach and accelerated tests

    International Nuclear Information System (INIS)

    Erto, Pasquale; Giorgio, Massimiliano

    2002-01-01

    Sometimes the assessment of very high reliability levels is difficult for the following main reasons: - the high reliability level of each item makes it impossible to obtain, in a reasonably short time, a sufficient number of failures; - the high cost of the high reliability items to submit to life tests makes it unfeasible to collect enough data for 'classical' statistical analyses. In the above context, this paper presents a Bayesian solution to the problem of estimation of the parameters of the Weibull-inverse power law model, on the basis of a limited number (say six) of life tests, carried out at different stress levels, all higher than the normal one. The over-stressed (i.e. accelerated) tests allow the use of experimental data obtained in a reasonably short time. The Bayesian approach enables one to reduce the required number of failures adding to the failure information the available a priori engineers' knowledge. This engineers' involvement conforms to the most advanced management policy that aims at involving everyone's commitment in order to obtain total quality. A Monte Carlo study of the non-asymptotic properties of the proposed estimators and a comparison with the properties of maximum likelihood estimators closes the work

  17. Reliability assessment of distribution power systems including distributed generations

    International Nuclear Information System (INIS)

    Megdiche, M.

    2004-12-01

    Nowadays, power systems have reached a good level of reliability. Nevertheless, considering the modifications induced by the connections of small independent producers to distribution networks, there's a need to assess the reliability of these new systems. Distribution networks present several functional characteristics, highlighted by the qualitative study of the failures, as dispersed loads at several places, variable topology and some electrotechnical phenomena which must be taken into account to model the events that can occur. The adopted reliability calculations method is Monte Carlo simulations, the probabilistic method most powerful and most flexible to model complex operating of the distribution system. We devoted a first part on the case of a 20 kV feeder to which a cogeneration unit is connected. The method was applied to a software of stochastic Petri nets simulations. Then a second part related to the study of a low voltage power system supplied by dispersed generations. Here, the complexity of the events required to code the method in an environment of programming allowing the use of power system calculations (load flow, short-circuit, load shedding, management of units powers) in order to analyse the system state for each new event. (author)

  18. An approach for assessing ALWR passive safety system reliability

    International Nuclear Information System (INIS)

    Hake, T.M.

    1991-01-01

    Many advanced light water reactor designs incorporate passive rather than active safety features for front-line accident response. A method for evaluating the reliability of these passive systems in the context of probabilistic risk assessment has been developed at Sandia National Laboratories. This method addresses both the component (e.g. valve) failure aspect of passive system failure, and uncertainties in system success criteria arising from uncertainties in the system's underlying physical processes. These processes provide the system's driving force; examples are natural circulation and gravity-induced injection. This paper describes the method, and provides some preliminary results of application of the approach to the Westinghouse AP600 design

  19. Seismic reliability assessment methodology for CANDU concrete containment structures

    International Nuclear Information System (INIS)

    Stephens, M.J.; Nessim, M.A.; Hong, H.P.

    1995-05-01

    A study was undertaken to develop a reliability-based methodology for the assessment of existing CANDU concrete containment structures with respect to seismic loading. The focus of the study was on defining appropriate specified values and partial safety factors for earthquake loading and resistance parameters. Key issues addressed in the work were the identification of an approach to select design earthquake spectra that satisfy consistent safety levels, and the use of structure-specific data in the evaluation of structural resistance. (author). 23 refs., 9 tabs., 15 figs

  20. Complex method to calculate objective assessments of information systems protection to improve expert assessments reliability

    Science.gov (United States)

    Abdenov, A. Zh; Trushin, V. A.; Abdenova, G. A.

    2018-01-01

    The paper considers the questions of filling the relevant SIEM nodes based on calculations of objective assessments in order to improve the reliability of subjective expert assessments. The proposed methodology is necessary for the most accurate security risk assessment of information systems. This technique is also intended for the purpose of establishing real-time operational information protection in the enterprise information systems. Risk calculations are based on objective estimates of the adverse events implementation probabilities, predictions of the damage magnitude from information security violations. Calculations of objective assessments are necessary to increase the reliability of the proposed expert assessments.

  1. A systematic review of instruments that assess the implementation of hospital quality management systems.

    Science.gov (United States)

    Groene, Oliver; Botje, Daan; Suñol, Rosa; Lopez, Maria Andrée; Wagner, Cordula

    2013-10-01

    Health-care providers invest substantial resources to establish and implement hospital quality management systems. Nevertheless, few tools are available to assess implementation efforts and their effect on quality and safety outcomes. This review aims to (i) identify instruments to assess the implementation of hospital quality management systems, (ii) describe their measurement properties and (iii) assess the effects of quality management on quality improvement and quality of care outcomes. We performed a systematic literature search from 1990 to 2011 in PubMed, CINAHL, EMBASE, Cochrane Library and Web of Science. In addition, we used snowball strategies, screened the reference lists of eligible papers, reviewed grey literature and contacted experts in the field. and data extraction Two reviewers screened eligible papers based on pre-defined inclusion and exclusion criteria and all authors extracted data. Eligible papers are described in terms of general characteristics (settings, type and level of respondents, mode of data collection), methodological properties (sampling strategy, item derivation, conceptualization of quality management, assessment of reliability and validity, scoring) and application/implementation (accounting for context, organizational adaptations, sensitivity to change, deployment and effect size). Eighteen papers were deemed eligible for inclusion. While some common domains emerged in measurement conceptualization, substantial differences in scope persist. The instruments' measurement properties were insufficiently described and only few instruments assessed links between the implementation of quality management systems (QMS) and improvement strategies or outcomes. There is currently no well-established measure to assess the implementation and effectiveness of quality management systems. Future research should address this gap.

  2. Reliability of a novel thermal imaging system for temperature assessment of healthy feet.

    Science.gov (United States)

    Petrova, N L; Whittam, A; MacDonald, A; Ainarkar, S; Donaldson, A N; Bevans, J; Allen, J; Plassmann, P; Kluwe, B; Ring, F; Rogers, L; Simpson, R; Machin, G; Edmonds, M E

    2018-01-01

    Thermal imaging is a useful modality for identifying preulcerative lesions ("hot spots") in diabetic foot patients. Despite its recognised potential, at present, there is no readily available instrument for routine podiatric assessment of patients at risk. To address this need, a novel thermal imaging system was recently developed. This paper reports the reliability of this device for temperature assessment of healthy feet. Plantar skin foot temperatures were measured with the novel thermal imaging device (Diabetic Foot Ulcer Prevention System (DFUPS), constructed by Photometrix Imaging Ltd) and also with a hand-held infrared spot thermometer (Thermofocus® 01500A3, Tecnimed, Italy) after 20 min of barefoot resting with legs supported and extended in 105 subjects (52 males and 53 females; age range 18 to 69 years) as part of a multicentre clinical trial. The temperature differences between the right and left foot at five regions of interest (ROIs), including 1st and 4th toes, 1st, 3rd and 5th metatarsal heads were calculated. The intra-instrument agreement (three repeated measures) and the inter-instrument agreement (hand-held thermometer and thermal imaging device) were quantified using intra-class correlation coefficients (ICCs) and the 95% confidence intervals (CI). Both devices showed almost perfect agreement in replication by instrument. The intra-instrument ICCs for the thermal imaging device at all five ROIs ranged from 0.95 to 0.97 and the intra-instrument ICCs for the hand-held-thermometer ranged from 0.94 to 0.97. There was substantial to perfect inter-instrument agreement between the hand-held thermometer and the thermal imaging device and the ICCs at all five ROIs ranged between 0.94 and 0.97. This study reports the performance of a novel thermal imaging device in the assessment of foot temperatures in healthy volunteers in comparison with a hand-held infrared thermometer. The newly developed thermal imaging device showed very good agreement in

  3. Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

    Science.gov (United States)

    Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

    2015-01-01

    Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the

  4. Reliable scar scoring system to assess photographs of burn patients.

    Science.gov (United States)

    Mecott, Gabriel A; Finnerty, Celeste C; Herndon, David N; Al-Mousawi, Ahmed M; Branski, Ludwik K; Hegde, Sachin; Kraft, Robert; Williams, Felicia N; Maldonado, Susana A; Rivero, Haidy G; Rodriguez-Escobar, Noe; Jeschke, Marc G

    2015-12-01

    Several scar-scoring scales exist to clinically monitor burn scar development and maturation. Although scoring scars through direct clinical examination is ideal, scars must sometimes be scored from photographs. No scar scale currently exists for the latter purpose. We modified a previously described scar scale (Yeong et al., J Burn Care Rehabil 1997) and tested the reliability of this new scale in assessing burn scars from photographs. The new scale consisted of three parameters as follows: scar height, surface appearance, and color mismatch. Each parameter was assigned a score of 1 (best) to 4 (worst), generating a total score of 3-12. Five physicians with burns training scored 120 representative photographs using the original and modified scales. Reliability was analyzed using coefficient of agreement, Cronbach alpha, intraclass correlation coefficient, variance, and coefficient of variance. Analysis of variance was performed using the Kruskal-Wallis test. Color mismatch and scar height scores were validated by analyzing actual height and color differences. The intraclass correlation coefficient, the coefficient of agreement, and Cronbach alpha were higher for the modified scale than those of the original scale. The original scale produced more variance than that in the modified scale. Subanalysis demonstrated that, for all categories, the modified scale had greater correlation and reliability than the original scale. The correlation between color mismatch scores and actual color differences was 0.84 and between scar height scores and actual height was 0.81. The modified scar scale is a simple, reliable, and useful scale for evaluating photographs of burn patients. Copyright © 2015 Elsevier Inc. All rights reserved.

  5. Dynamic reliability assessment and prediction for repairable systems with interval-censored data

    International Nuclear Information System (INIS)

    Peng, Yizhen; Wang, Yu; Zi, YanYang; Tsui, Kwok-Leung; Zhang, Chuhua

    2017-01-01

    The ‘Test, Analyze and Fix’ process is widely applied to improve the reliability of a repairable system. In this process, dynamic reliability assessment for the system has been paid a great deal of attention. Due to instrument malfunctions, staff omissions and imperfect inspection strategies, field reliability data are often subject to interval censoring, making dynamic reliability assessment become a difficult task. Most traditional methods assume this kind of data as multiple normal distributed variables or the missing mechanism as missing at random, which may cause a large bias in parameter estimation. This paper proposes a novel method to evaluate and predict the dynamic reliability of a repairable system subject to interval-censored problem. First, a multiple imputation strategy based on the assumption that the reliability growth trend follows a nonhomogeneous Poisson process is developed to derive the distributions of missing data. Second, a new order statistic model that can transfer the dependent variables into independent variables is developed to simplify the imputation procedure. The unknown parameters of the model are iteratively inferred by the Monte Carlo expectation maximization (MCEM) algorithm. Finally, to verify the effectiveness of the proposed method, a simulation and a real case study for gas pipeline compressor system are implemented. - Highlights: • A new multiple imputation strategy was developed to derive the PDF of missing data. • A new order statistic model was developed to simplify the imputation procedure. • The parameters of the order statistic model were iteratively inferred by MCEM. • A real cases study was conducted to verify the effectiveness of the proposed method.

  6. Evaluation of the McMahon Competence Assessment Instrument for Use with Midwifery Students During a Simulated Shoulder Dystocia.

    Science.gov (United States)

    McMahon, Erin; Jevitt, Cecilia; Aronson, Barbara

    2018-03-01

    Intrapartum emergencies occur infrequently but require a prompt and competent response from the midwife to prevent morbidity and mortality of the woman, fetus, and newborn. Simulation provides the opportunity for student midwives to develop competence in a safe environment. The purpose of this study was to determine the inter-rater reliability of the McMahon Competence Assessment Instrument (MCAI) for use with student midwives during a simulated shoulder dystocia scenario. A pilot study using a nonprobability convenience sample was used to evaluate the MCAI. Content validity indices were calculated for the individual items and the overall instrument using data from a panel of expert reviewers. Fourteen student midwives consented to be video recorded while participating in a simulated shoulder dystocia scenario. Three faculty raters used the MCAI to evaluate the student performance. These quantitative data were used to determine the inter-rater reliability of the MCAI. The intraclass correlation coefficient (ICC) was used to assess the inter-rater reliability of MCAI scores between 2 or more raters. The ICC was 0.86 (95% confidence interval, 0.60-0.96). Fleiss's kappa was calculated to determine the inter-rater reliability for individual items. Twenty-three of the 42 items corresponded to excellent strength of agreement. This study demonstrates a method to determine the inter-rater reliability of a competence assessment instrument to be used with student midwives. Data produced by this study were used to revise and improve the instrument. Additional research will further document the inter-rater reliability and can be used to determine changes in student competence. Valid and reliable methods of assessment will encourage the use of simulation to efficiently develop the competence of student midwives. © 2018 by the American College of Nurse-Midwives.

  7. Validity and Reliability of Persian Version of Johns Hopkins Fall Risk Assessment Tool among Aged People

    Directory of Open Access Journals (Sweden)

    hadi hojati

    2018-04-01

    Full Text Available Background & Aim: It is crucial to identify aged patients in risk of falls in clinical settings. Johns Hopkins Fall Risk Assessment Tool (JHFRAT is one of most applied international instrument to assess elderly patients for the risk of falls. The aim of this study was to evaluate reliability and internal consistency of the JHFRAT. Methods & Materials: In this cross-sectional study for validity assessment of the tool, WHO’s standard protocol was applied for translation-back translation of the tool. Face and content validity of the tool was confirmed by ten person of expert faculty members for its applicability in clinical setting. In this pilot study, the inclusion criteria were being 60 or more years old, hospitalized in the last 8 hours prior to assessment and in proper cognitive condition assessed by MMSE. Subjects of the study were (n=70 elderly patients who were newly hospitalized in Shahroud Emam Hossein Hospital. Data were analyzed using SPSS software- version 16. Internal consistency of the tool was calculated by Cronbach’s alpha. Results: According to the results of the study Persian version of JHFRAT was a valid tool for application on clinical setting. The Persian version of the tool had Cronbach’s alpha equal to 0/733. Conclusion: Based on the findings of the current study, it can be concluded that Persian version of the JHFRAT is a valid and reliable tool to be applied for assessment of elderly senior citizens on admission in any clinical settings.

  8. Metacognition assessment interview: Instrument description and factor structure

    OpenAIRE

    Pellecchia, Giovanni; Moroni, Fabio; Carcione, Antonino; Colle, Livia; Dimaggio, Giancarlo; Nicolò, Giuseppe; Pedone, Roberto; Procacci, Michele; Semerari, Antonio

    2015-01-01

    Objective: Metacognition is a multi-component psychological construct, characterised by the ability to identify and describe one’s own mental states and those of others. Evidence has been found for an association between deficits in metacognitive abilities and poor social functioning, low quality of life, psychopathology, and symptoms in Personality Disorders (PDs). However, to date, there are few psychometrically validated instruments available for assessing the different components of metac...

  9. Application of nonparametric statistics to material strength/reliability assessment

    International Nuclear Information System (INIS)

    Arai, Taketoshi

    1992-01-01

    An advanced material technology requires data base on a wide variety of material behavior which need to be established experimentally. It may often happen that experiments are practically limited in terms of reproducibility or a range of test parameters. Statistical methods can be applied to understanding uncertainties in such a quantitative manner as required from the reliability point of view. Statistical assessment involves determinations of a most probable value and the maximum and/or minimum value as one-sided or two-sided confidence limit. A scatter of test data can be approximated by a theoretical distribution only if the goodness of fit satisfies a test criterion. Alternatively, nonparametric statistics (NPS) or distribution-free statistics can be applied. Mathematical procedures by NPS are well established for dealing with most reliability problems. They handle only order statistics of a sample. Mathematical formulas and some applications to engineering assessments are described. They include confidence limits of median, population coverage of sample, required minimum number of a sample, and confidence limits of fracture probability. These applications demonstrate that a nonparametric statistical estimation is useful in logical decision making in the case a large uncertainty exists. (author)

  10. Mechanical reliability assessment of optical fibres in Radiation environments

    International Nuclear Information System (INIS)

    Van Uffelen, M.

    2006-01-01

    After more than two decades of intensive research and even some pioneering applications in space, optical fibres are now finding their way in various radiation environments, including both fission and future fusion nuclear-power plants, and high-energy physics experiments. For example, next to distributed monitoring applications of large nuclear infrastructures, fibre-optics can also be used for data communications during maintenance operations in the reactor vessel of the future ITER (International Thermonuclear Experimental Reactor), or for plasma diagnostics applications during operation of the reactor. These maintenance and diagnostics tasks require the optical fibres to withstand extremely high doses of radiation, up to MGy dose levels and temperatures above 150 degrees Celsius. The reliability assessment of fibre-optic systems for their qualification in nuclear environments often requires to meet stringent radiation tolerance levels. The majority of (usually accelerated) radiation assessments have so far focused on optical properties, such as wavelength-dependent radiation induced attenuation and radio-luminescence. The relation of these radiation effects with the fabrication methods and other environmental parameters has been the subject of years of research. Only a few results are available on the long-term evolution of mechanical properties of irradiated optical fibres. As a first step towards understanding the long-term reliability of fibre-optic composite cables in hostile radiation environments, we therefore performed dynamic fatigue tests with different commercial-grade optical fibres, both multi-mode and single-mode types

  11. The psychophysiological assessment method for pilot's professional reliability.

    Science.gov (United States)

    Zhang, L M; Yu, L S; Wang, K N; Jing, B S; Fang, C

    1997-05-01

    Previous research has shown that a pilot's professional reliability depends on two relative factors: the pilot's functional state and the demands of task workload. The Psychophysiological Reserve Capacity (PRC) is defined as a pilot's ability to accomplish additive tasks without reducing the performance of the primary task (flight task). We hypothesized that the PRC was a mirror of the pilot's functional state. The purpose of this study was to probe the psychophysiological method for evaluating a pilot's professional reliability on a simulator. The PRC Comprehensive Evaluating System (PRCCES) which was used in the experiment included four subsystems: a) quantitative evaluation system for pilot's performance on simulator; b) secondary task display and quantitative estimating system; c) multiphysiological data monitoring and statistical system; and d) comprehensive evaluation system for pilot PRC. Two studies were performed. In study one, 63 healthy and 13 hospitalized pilots participated. Each pilot performed a double 180 degrees circuit flight program with and without secondary task (three digit operation). The operator performance, score of secondary task and cost of physiological effort were measured and compared by PRCCES in the two conditions. Then, each pilot's flight skill in training was subjectively scored by instructor pilot ratings. In study two, 7 healthy pilots volunteered to take part in the experiment on the effects of sleep deprivation on pilot's PRC. Each participant had PRC tested pre- and post-8 h sleep deprivation. The results show that the PRC values of a healthy pilot was positively correlated with abilities of flexibility, operating and correcting deviation, attention distribution, and accuracy of instrument flight in the air (r = 0.27-0.40, p < 0.05), and negatively correlated with emotional anxiety in flight (r = -0.40, p < 0.05). The values of PRC in healthy pilots (0.61 +/- 0.17) were significantly higher than that of hospitalized pilots

  12. A systematic review of instruments for assessing parent satisfaction with family-centred care in neonatal intensive care units.

    Science.gov (United States)

    Dall'Oglio, Immacolata; Mascolo, Rachele; Gawronski, Orsola; Tiozzo, Emanuela; Portanova, Anna; Ragni, Angela; Alvaro, Rosaria; Rocco, Gennaro; Latour, Jos M

    2018-03-01

    This systematic review synthesised and described instruments measuring parent satisfaction with the increasing standard practice of family-centred care (FCC) in neonatal intensive care units. We evaluated 11 studies published from January 2006 to March 2016: two studies validated a parent satisfaction questionnaire, and nine developed or modified previous questionnaires to use as outcome measures in their local settings. Most instruments were not tested on reliability and validity. Only two validated instruments included all six of the FCC principles and could assess parent satisfaction with FCC in neonatal intensive care units and be considered as outcome indicators for further research. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

  13. Assessment of the measurement properties of the post stroke motor function instruments available in Brazil: a systematic review.

    Science.gov (United States)

    Lima, Elaine; Teixeira-Salmela, Luci F; Simões, Luan; Guerra, Ana C C; Lemos, Andrea

    2016-03-15

    While there are several instruments in Brazil that measure motor function in patients after stroke, it is unknown whether the measurement properties of these instruments are appropriate. To identify the motor function instruments available in Brazil for patients after stroke. To assess the methodological quality of the studies and the results related to the measurement properties of these instruments. Two independent reviewers conducted searches on PubMed, LILACS, CINAHL, Web of Science, and Scopus. Studies that aimed to cross-culturally adapt an existing instrument or create a Brazilian instrument and test at least one measurement property related to motor function in patients after stroke were included. The methodological quality of these studies was checked by the COSMIN checklist with 4-point rating scale and the results of the measurement properties were analyzed by the criteria developed by Terwee et al. A total of 11 instruments were considered eligible, none of which were created in Brazil. The process of cross-cultural adaptation was inadequate in 10 out of 11 instruments due to the lack of back-translation or due to inappropriate target population. All of the instruments presented flaws in the measurement properties, especially reliability, internal consistency, and construct validity. The flaws observed in both cross-cultural adaptation process and testing measurement properties make the results inconclusive on the validity of the available instruments. Adequate procedures of cross-cultural adaptation and measurement properties of these instruments are strongly needed.

  14. Assessment of the measurement properties of the post stroke motor function instruments available in Brazil: a systematic review

    Directory of Open Access Journals (Sweden)

    Elaine Lima

    2016-01-01

    Full Text Available Background While there are several instruments in Brazil that measure motor function in patients after stroke, it is unknown whether the measurement properties of these instruments are appropriate. Objective To identify the motor function instruments available in Brazil for patients after stroke. To assess the methodological quality of the studies and the results related to the measurement properties of these instruments. Method Two independent reviewers conducted searches on PubMed, LILACS, CINAHL, Web of Science, and Scopus. Studies that aimed to cross-culturally adapt an existing instrument or create a Brazilian instrument and test at least one measurement property related to motor function in patients after stroke were included. The methodological quality of these studies was checked by the COSMIN checklist with 4-point rating scale and the results of the measurement properties were analyzed by the criteria developed by Terwee et al. Results A total of 11 instruments were considered eligible, none of which were created in Brazil. The process of cross-cultural adaptation was inadequate in 10 out of 11 instruments due to the lack of back-translation or due to inappropriate target population. All of the instruments presented flaws in the measurement properties, especially reliability, internal consistency, and construct validity. Conclusion The flaws observed in both cross-cultural adaptation process and testing measurement properties make the results inconclusive on the validity of the available instruments. Adequate procedures of cross-cultural adaptation and measurement properties of these instruments are strongly needed.

  15. Reliability and validity of the German version of the Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (D-OAR).

    Science.gov (United States)

    Spiekermann, Christoph; Rudack, Claudia; Stenner, Markus

    2017-11-01

    The outcome of aesthetic rhinoplasty is determined by the patient's subjective satisfaction with the nasal appearance which is difficult to assess. The Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (OAR) is a brief and reliable instrument to assess the influence of the subjective nasal appearance on quality of life in patients undergoing aesthetic rhinoplasty. Preoperative application of this questionnaire reveals important aspects and possible disturbances of the body image which could be negative predictors concerning the result. On the other hand, it represents an appropriate tool to assess the postoperative outcome. The aim of this study was to determine the validity, reliability and responsiveness of the adapted German version of the OAR (D-OAR). The adaption of the OAR to German language was performed by a forward and backward translation process. Patients undergoing rhinoplasty were asked to complete the D-OAR preoperatively, 1, 3 and 12 months after procedure and healthy volunteers without any nasal complaints served as controls to test validity, reliability and responsiveness. An excellent internal consistency, a good test-retest reliability and good inter-item and item-total correlations demonstrated a good reliability of the D-OAR. The convincing validity of the adapted version was proven by an excellent discriminant and a sufficient content validity. Significant differences between pre- and postoperative D-OAR scores revealed a good responsiveness of the instrument. Hence, with a sufficient validity, reliability and sensitivity to changes, the D-OAR is a short and helpful instrument to assess the subjective perception of the nasal appearance in German patients.

  16. Reliability assessment using degradation models: bayesian and classical approaches

    Directory of Open Access Journals (Sweden)

    Marta Afonso Freitas

    2010-04-01

    Full Text Available Traditionally, reliability assessment of devices has been based on (accelerated life tests. However, for highly reliable products, little information about reliability is provided by life tests in which few or no failures are typically observed. Since most failures arise from a degradation mechanism at work for which there are characteristics that degrade over time, one alternative is monitor the device for a period of time and assess its reliability from the changes in performance (degradation observed during that period. The goal of this article is to illustrate how degradation data can be modeled and analyzed by using "classical" and Bayesian approaches. Four methods of data analysis based on classical inference are presented. Next we show how Bayesian methods can also be used to provide a natural approach to analyzing degradation data. The approaches are applied to a real data set regarding train wheels degradation.Tradicionalmente, o acesso à confiabilidade de dispositivos tem sido baseado em testes de vida (acelerados. Entretanto, para produtos altamente confiáveis, pouca informação a respeito de sua confiabilidade é fornecida por testes de vida no quais poucas ou nenhumas falhas são observadas. Uma vez que boa parte das falhas é induzida por mecanismos de degradação, uma alternativa é monitorar o dispositivo por um período de tempo e acessar sua confiabilidade através das mudanças em desempenho (degradação observadas durante aquele período. O objetivo deste artigo é ilustrar como dados de degradação podem ser modelados e analisados utilizando-se abordagens "clássicas" e Bayesiana. Quatro métodos de análise de dados baseados em inferência clássica são apresentados. A seguir, mostramos como os métodos Bayesianos podem também ser aplicados para proporcionar uma abordagem natural à análise de dados de degradação. As abordagens são aplicadas a um banco de dados real relacionado à degradação de rodas de trens.

  17. Modelling of nuclear power plant control and instrumentation elements for automatic disturbance and reliability analysis

    International Nuclear Information System (INIS)

    Hollo, E.

    1985-08-01

    Present Final Report summarizes results of R/D work done within IAEA-VEIKI (Institute for Electrical Power Research, Budapest, Hungary) Research Contract No. 3210 during 3 years' period of 01.08.1982 - 31.08.1985. Chapter 1 lists main research objectives of the project. Main results obtained are summarized in Chapters 2 and 3. Outcomes from development of failure modelling methodologies and their application for C/I components of WWER-440 units are as follows (Chapter 2): improvement of available ''failure mode and effect analysis'' methods and mini-fault tree structures usable for automatic disturbance (DAS) and reliability (RAS) analysis; general classification and determination of functional failure modes of WWER-440 NPP C/I components; set up of logic models for motor operated control valves and rod control/drive mechanism. Results of development of methods and their application for reliability modelling of NPP components and systems cover (Chapter 3): development of an algorithm (computer code COMPREL) for component-related failure and reliability parameter calculation; reliability analysis of PAKS II NPP diesel system; definition of functional requirements for reliability data bank (RDB) in WWER-440 units. Determination of RDB input/output data structure and data manipulation services. Methods used are a-priori failure mode and effect analysis, combined fault tree/event tree modelling technique, structural computer programming, probability theory application to nuclear field

  18. Instrumentation

    International Nuclear Information System (INIS)

    Prieur, G.; Nadi, M.; Hedjiedj, A.; Weber, S.

    1995-01-01

    This second chapter on instrumentation gives little general consideration on history and classification of instrumentation, and two specific states of the art. The first one concerns NMR (block diagram of instrumentation chain with details on the magnets, gradients, probes, reception unit). The first one concerns precision instrumentation (optical fiber gyro-meter and scanning electron microscope), and its data processing tools (programmability, VXI standard and its history). The chapter ends with future trends on smart sensors and Field Emission Displays. (D.L.). Refs., figs

  19. Reliability worth assessment of radial systems with distributed generation

    OpenAIRE

    Bellart Llavall, Francesc Xavier

    2010-01-01

    With recent advances in technology, utilities generation (DG) on the distribution systems. Reliability worth is very important in power system planning and operation. Having a DG ensures reli increase the reliability worth. This research project presents the study of a radial distribution system and the impact of placing DG in order to increase the reliability worth. where a DG have to be placed. The reliability improvement is measured by different reliability indices tha...

  20. Development and validation of an instrument to assess the prescribing readiness of medical students in Malaysia.

    Science.gov (United States)

    Lai, Pauline Siew Mei; Sim, Si Mui; Chua, Siew Siang; Tan, Choo Hock; Ng, Chirk Jenn; Achike, Francis Ifejika; Teng, Cheong Lieng

    2015-09-21

    Prescribing incompetence is an important factor that contributes to prescribing error, and this is often due to inadequate training during medical schools. We therefore aimed to develop and validate an instrument to assess the prescribing readiness of medical students (PROMS) in Malaysia. The PROMS comprised of 26 items with four domains: undergraduate learning opportunities; hands-on clinical skills practice; information gathering behaviour; and factors affecting the learning of prescribing skills. The first three domains were adapted from an existing questionnaire, while items from the last domain were formulated based on findings from a nominal group discussion. Face and content validity was determined by an expert panel, pilot tested in a class of final year (Year 5) medical students, and assessed using the Flesch reading ease. To assess the reliability of the PROMS, the internal consistency and test-retest (at baseline and 2 weeks later) were assessed using the Wilcoxon Signed Ranks test and Spearman's rho. The discriminative validity of the PROMS was assessed using the Mann-Whitney U-test (to assess if the PROMS could discriminate between final year medical students from a public and a private university). A total of 119 medical students were recruited. Flesch reading ease was 46.9, indicating that the instrument was suitable for use in participants undergoing tertiary education. The overall Cronbach alpha value of the PROMS was 0.695, which was satisfactory. Test-retest showed no difference for 25/26 items, indicating that our instrument was reliable. Responses from the public and private university final year medical students were significantly different in 10/26 items, indicating that the PROMS was able to discriminate between these two groups. Medical students from the private university reported fewer learning opportunities and hands-on practice compared to those from the public university. On the other hand, medical students from the private university

  1. Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

    Science.gov (United States)

    Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

    2018-04-01

    BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

  2. Unfavorable attitudes towards women leaders. An instrument to assess them

    Directory of Open Access Journals (Sweden)

    María Laura Lupano Perugini

    2011-12-01

    Full Text Available The main objective of the investigation consisted in designing a test to evaluate unfavorable attitudes towards women leaders. Based on Peters, Terborg and Taylor test –WAMS-, it was designed the instrument ACT-ML. This one contains 7 items and presents two dimensions, one evaluates the level that people consider if women display characteristics associate with leadership (Instrumental characteristics; and the other evaluates the level of acceptance of women like leaders (Acceptance Feminine Leadership. 789 subjects participated, 419 male (53,1% and 370 female (46,9% (Age average = 36,52; SD = 11,7. 45,8% (n = 361 of the participants occupied directive position and the 54,2% (n = 428 were subordinates. Results indicated good psychometric properties (reliability and validity. In addition, it was tried to verify the existence of significant differences according to sex and position (leader-subordinate, finding differences in favor of men and followers in a greater level of unfavorable attitudes to women leaders.

  3. Assessment of microelectronics packaging for high temperature, high reliability applications

    Energy Technology Data Exchange (ETDEWEB)

    Uribe, F.

    1997-04-01

    This report details characterization and development activities in electronic packaging for high temperature applications. This project was conducted through a Department of Energy sponsored Cooperative Research and Development Agreement between Sandia National Laboratories and General Motors. Even though the target application of this collaborative effort is an automotive electronic throttle control system which would be located in the engine compartment, results of this work are directly applicable to Sandia`s national security mission. The component count associated with the throttle control dictates the use of high density packaging not offered by conventional surface mount. An enabling packaging technology was selected and thermal models defined which characterized the thermal and mechanical response of the throttle control module. These models were used to optimize thick film multichip module design, characterize the thermal signatures of the electronic components inside the module, and to determine the temperature field and resulting thermal stresses under conditions that may be encountered during the operational life of the throttle control module. Because the need to use unpackaged devices limits the level of testing that can be performed either at the wafer level or as individual dice, an approach to assure a high level of reliability of the unpackaged components was formulated. Component assembly and interconnect technologies were also evaluated and characterized for high temperature applications. Electrical, mechanical and chemical characterizations of enabling die and component attach technologies were performed. Additionally, studies were conducted to assess the performance and reliability of gold and aluminum wire bonding to thick film conductor inks. Kinetic models were developed and validated to estimate wire bond reliability.

  4. Results of a Demonstration Assessment of Passive System Reliability Utilizing the Reliability Method for Passive Systems (RMPS)

    Energy Technology Data Exchange (ETDEWEB)

    Bucknor, Matthew; Grabaskas, David; Brunett, Acacia; Grelle, Austin

    2015-04-26

    Advanced small modular reactor designs include many advantageous design features such as passively driven safety systems that are arguably more reliable and cost effective relative to conventional active systems. Despite their attractiveness, a reliability assessment of passive systems can be difficult using conventional reliability methods due to the nature of passive systems. Simple deviations in boundary conditions can induce functional failures in a passive system, and intermediate or unexpected operating modes can also occur. As part of an ongoing project, Argonne National Laboratory is investigating various methodologies to address passive system reliability. The Reliability Method for Passive Systems (RMPS), a systematic approach for examining reliability, is one technique chosen for this analysis. This methodology is combined with the Risk-Informed Safety Margin Characterization (RISMC) approach to assess the reliability of a passive system and the impact of its associated uncertainties. For this demonstration problem, an integrated plant model of an advanced small modular pool-type sodium fast reactor with a passive reactor cavity cooling system is subjected to a station blackout using RELAP5-3D. This paper discusses important aspects of the reliability assessment, including deployment of the methodology, the uncertainty identification and quantification process, and identification of key risk metrics.

  5. Ecological Assessment of Substance-abuse Experiences (EASE): findings from a new instrument development pilot study.

    Science.gov (United States)

    Matto, Holly C; Miller, Keith; Spera, Christopher

    2005-08-01

    A newly developed instrument that assesses a client's orientation to addiction or recovery communities using social context referents was pilot tested with a sample of 103 adults seeking treatment for substance abuse at outpatient and residential treatment facilities on the East Coast. Preliminary findings show promising subscale reliabilities, and suggest that drug- and recovery-related social identities are related to drug-use severity and drug-use concern; and drug-related attitudinal congruence between the treatment-seeker and family and treatment-seeker and other significant persons are related to intention to make behavioral changes in reducing substance abuse.

  6. Reliability of a semi-quantitative method for dermal exposure assessment (DREAM)

    NARCIS (Netherlands)

    Wendel de Joode, B. van; Hemmen, J.J. van; Meijster, T.; Major, V.; London, L.; Kromhout, H.

    2005-01-01

    Valid and reliable semi-quantitative dermal exposure assessment methods for epidemiological research and for occupational hygiene practice, applicable for different chemical agents, are practically nonexistent. The aim of this study was to assess the reliability of a recently developed

  7. Probabilistic risk assessment course documentation. Volume 3. System reliability and analysis techniques, Session A - reliability

    International Nuclear Information System (INIS)

    Lofgren, E.V.

    1985-08-01

    This course in System Reliability and Analysis Techniques focuses on the quantitative estimation of reliability at the systems level. Various methods are reviewed, but the structure provided by the fault tree method is used as the basis for system reliability estimates. The principles of fault tree analysis are briefly reviewed. Contributors to system unreliability and unavailability are reviewed, models are given for quantitative evaluation, and the requirements for both generic and plant-specific data are discussed. Also covered are issues of quantifying component faults that relate to the systems context in which the components are embedded. All reliability terms are carefully defined. 44 figs., 22 tabs

  8. Instrumentation

    International Nuclear Information System (INIS)

    Decreton, M.

    2000-01-01

    SCK-CEN's research and development programme on instrumentation aims at evaluating the potentials of new instrumentation technologies under the severe constraints of a nuclear application. It focuses on the tolerance of sensors to high radiation doses, including optical fibre sensors, and on the related intelligent data processing needed to cope with the nuclear constraints. Main achievements in these domains in 1999 are summarised

  9. A quick aphasia battery for efficient, reliable, and multidimensional assessment of language function.

    Science.gov (United States)

    Wilson, Stephen M; Eriksson, Dana K; Schneck, Sarah M; Lucanie, Jillian M

    2018-01-01

    This paper describes a quick aphasia battery (QAB) that aims to provide a reliable and multidimensional assessment of language function in about a quarter of an hour, bridging the gap between comprehensive batteries that are time-consuming to administer, and rapid screening instruments that provide limited detail regarding individual profiles of deficits. The QAB is made up of eight subtests, each comprising sets of items that probe different language domains, vary in difficulty, and are scored with a graded system to maximize the informativeness of each item. From the eight subtests, eight summary measures are derived, which constitute a multidimensional profile of language function, quantifying strengths and weaknesses across core language domains. The QAB was administered to 28 individuals with acute stroke and aphasia, 25 individuals with acute stroke but no aphasia, 16 individuals with chronic post-stroke aphasia, and 14 healthy controls. The patients with chronic post-stroke aphasia were tested 3 times each and scored independently by 2 raters to establish test-retest and inter-rater reliability. The Western Aphasia Battery (WAB) was also administered to these patients to assess concurrent validity. We found that all QAB summary measures were sensitive to aphasic deficits in the two groups with aphasia. All measures showed good or excellent test-retest reliability (overall summary measure: intraclass correlation coefficient (ICC) = 0.98), and excellent inter-rater reliability (overall summary measure: ICC = 0.99). Sensitivity and specificity for diagnosis of aphasia (relative to clinical impression) were 0.91 and 0.95 respectively. All QAB measures were highly correlated with corresponding WAB measures where available. Individual patients showed distinct profiles of spared and impaired function across different language domains. In sum, the QAB efficiently and reliably characterized individual profiles of language deficits.

  10. Modified Tuck Jump Assessment: Reliability and Training of Raters

    Directory of Open Access Journals (Sweden)

    Craig A. Smith, Nicole J. Chimera, Monica R. Lininger, Meghan Warren

    2017-09-01

    Full Text Available We are writing with regard to “Intra- and inter-rater reliability of the modified tuck jump assessment,” by Fort-Vanmeerhaeghe et al. (2017 published in the Journal of Sports Science & Medicine. The authors reported on the reliability of the modified Tuck Jump Assessment (TJA. The purpose of the article was twofold: to introduce a new scoring methodology and to report on the interrater and intrarater reliability. The authors found the modified TJA to have excellent interrater reliability (ICC = 0.94, 95% CI = 0.88-0.97 and intrarater reliability (rater 1 ICC = 0.94, 95% CI = 0.88-0.9; rater 2 ICC = 0.96, 95% CI = 0.92-0.98 with experienced raters (n = 2 in a sample of 24 elite volleyball athletes. Overall, we found the study to be well conducted and valuable to the field of injury screening; however, the study did not adequately explain how the raters were trained in the modified TJA to improve consistency of scoring, or the modifications of the individual flaw “excessive contact noise at landing.” This information is necessary to improve the clinical utility of the TJA and direct future reliability studies. The TJA has been changed at least three times in the literature: from the initial introduction (Myer et al., 2006 to the most referenced and detailed protocol (Myer et al., 2011 to the publication under discussion (Fort-Vanmeerhaeghe et al., 2017. The initial test protocol was based upon clinical expertise and has evolved over time as new research emerged and problems arose with the original TJA. Initially, the TJA was scored on a visual analog scale (Myer et al., 2006, changed to a dichotomous scale (0 for no flaw or 1 for flaw present (Myer et al., 2011 and most recently modified using an ordinal scale (Fort-Vanmeerhaeghe et al., 2017. A significant disparity in the reported interrater and intrarater reliability arose with the dichotomously scored TJA, between those involved in the development of the TJA (Herrington et al., 2013

  11. The Spanish version of the fatique assessment scale : Reliability and validity assessment in postpartum women

    NARCIS (Netherlands)

    Cano-Climent, A.; Oliver-Roig, A.; Cabrero-Garcia, J.; de Vries, J.; Richart-Martinez, M.

    2017-01-01

    Background Fatigue is the most widely reported symptom by women during pregnancy, labour, the postpartum period, and early parenting. The objective was to translate the Fatigue Assessment Scale (FAS) into Spanish and assess its psychometric properties. Methods Instrumental Design. The FAS was

  12. Development and validation of an instrument to evaluate science teachers' assessment beliefs and practices

    Science.gov (United States)

    Genc, Evrim

    The primary purpose of this study was to develop a valid and reliable instrument to examine science teachers' assessment beliefs and practices in science classrooms. The present study also investigated the relationship between teachers' beliefs and practices in terms of assessment issues in science, their perceptions of the factors that influenced their assessment practices and their feelings towards high-stakes testing. The participants of the study were 408 science teachers teaching at middle and high school levels in the State of Florida. Data were collected through two modes of administration of the instrument as a paper-and-pencil and a web-based form. The response rate for paper-and-pencil administration was estimated as 68% whereas the response for the web administration was found to be 27%. Results from the various dimensions of validity and reliability analyses revealed that the 24 item-four-factor belief and practice measures were psychometrically sound and conceptually anchored measures of science teachers' assessment beliefs and self-reported practices. Reliability estimates for the belief measure ranged from .83 to .91 whereas alpha values for the practice measure ranged from .56 to .90. Results from the multigroup analysis supported that the instrument has the same theoretical structure across both administration groups. Therefore, future researchers may use either a paper-and-pencil or web-based format of the instrument. This study underscored a discrepancy between what teachers believe and how they act in classroom settings. It was emphasized that certain factors were mediating the dynamics between the belief and the practice. The majority of teachers reported that instruction time, class size, professional development activities, availability of school funding, and state testing mandates impact their assessment routines. Teachers reported that both the preparation process and the results of the test created unbelievable tension both on students and

  13. The Reliability and Validity of a Campus Caring Instrument Developed for Undergraduate Students in Hong Kong

    Science.gov (United States)

    Ng, Petrus; Su, Xiqing Susan; Chan, Vivien; Leung, Heidi; Cheung, Wendy; Tsun, Angela

    2013-01-01

    This study validated a Perceived Campus Caring Scale with 1,520 university students. Using factor analysis, seven factors namely, Faculty Support, Nonfaculty Support, Peer Relationship, Sense of Detachment, Sense of Belonging, Caring Attitude, and Campus Involvement, are identified with high reliability, validity, and close correlation with the…

  14. Internal consistency reliability and validity of the Arabic translation of the Mathematics Teaching Efficacy Beliefs Instrument.

    Science.gov (United States)

    Alkhateeb, Haitham M

    2004-06-01

    The Arabic translation of the Mathematics Teaching Efficacy Beliefs was completed by 144 undergraduate students (M age=20.6) in Jordan. The findings support the internal reliability of the Arabic translation of the Mathematics Teaching Efficacy Beliefs as well as its construct validity.

  15. Establishing Reliability and Construct Validity for an Instrument to Measure Environmental Connectedness

    Science.gov (United States)

    Beery, Thomas H.

    2013-01-01

    The purpose of this preliminary study is to establish a reliable and valid measure of environmental connectedness (EC) to allow for further exploration of the Swedish Outdoor Recreation in Change national survey data. The Nordic concept of friluftsliv (nature-based outdoor recreation) and the environmental psychology concept of EC are explored to…

  16. Frame-of-Reference Training: Establishing Reliable Assessment of Teaching Effectiveness.

    Science.gov (United States)

    Newman, Lori R; Brodsky, Dara; Jones, Richard N; Schwartzstein, Richard M; Atkins, Katharyn Meredith; Roberts, David H

    2016-01-01

    Frame-of-reference (FOR) training has been used successfully to teach faculty how to produce accurate and reliable workplace-based ratings when assessing a performance. We engaged 21 Harvard Medical School faculty members in our pilot and implementation studies to determine the effectiveness of using FOR training to assess health professionals' teaching performances. All faculty were novices at rating their peers' teaching effectiveness. Before FOR training, we asked participants to evaluate a recorded lecture using a criterion-based peer assessment of medical lecturing instrument. At the start of training, we discussed the instrument and emphasized its precise behavioral standards. During training, participants practiced rating lectures and received immediate feedback on how well they categorized and scored performances as compared with expert-derived scores of the same lectures. At the conclusion of the training, we asked participants to rate a post-training recorded lecture to determine agreement with the experts' scores. Participants and experts had greater rating agreement for the post-training lecture compared with the pretraining lecture. Through this investigation, we determined that FOR training is a feasible method to teach faculty how to accurately and reliably assess medical lectures. Medical school instructors and continuing education presenters should have the opportunity to be observed and receive feedback from trained peer observers. Our results show that it is possible to use FOR rater training to teach peer observers how to accurately rate medical lectures. The process is time efficient and offers the prospect for assessment and feedback beyond traditional learner evaluation of instruction.

  17. Usage models in reliability assessment of software-based systems

    Energy Technology Data Exchange (ETDEWEB)

    Haapanen, P.; Pulkkinen, U. [VTT Automation, Espoo (Finland); Korhonen, J. [VTT Electronics, Espoo (Finland)

    1997-04-01

    This volume in the OHA-project report series deals with the statistical reliability assessment of software based systems on the basis of dynamic test results and qualitative evidence from the system design process. Other reports to be published later on in the OHA-project report series will handle the diversity requirements in safety critical software-based systems, generation of test data from operational profiles and handling of programmable automation in plant PSA-studies. In this report the issues related to the statistical testing and especially automated test case generation are considered. The goal is to find an efficient method for building usage models for the generation of statistically significant set of test cases and to gather practical experiences from this method by applying it in a case study. The scope of the study also includes the tool support for the method, as the models may grow quite large and complex. (32 refs., 30 figs.).

  18. Analysis of dependent failures in risk assessment and reliability evaluation

    International Nuclear Information System (INIS)

    Fleming, K.N.; Mosleh, A.; Kelley, A.P. Jr.; Gas-Cooled Reactors Associates, La Jolla, CA)

    1983-01-01

    The ability to estimate the risk of potential reactor accidents is largely determined by the ability to analyze statistically dependent multiple failures. The importance of dependent failures has been indicated in recent probabilistic risk assessment (PRA) studies as well as in reports of reactor operating experiences. This article highlights the importance of several different types of dependent failures from the perspective of the risk and reliability analyst and provides references to the methods and data available for their analysis. In addition to describing the current state of the art, some recent advances, pitfalls, misconceptions, and limitations of some approaches to dependent failure analysis are addressed. A summary is included of the discourse on this subject, which is presented in the Institute of Electrical and Electronics Engineers/American Nuclear Society PRA Procedures Guide

  19. Usage models in reliability assessment of software-based systems

    International Nuclear Information System (INIS)

    Haapanen, P.; Pulkkinen, U.; Korhonen, J.

    1997-04-01

    This volume in the OHA-project report series deals with the statistical reliability assessment of software based systems on the basis of dynamic test results and qualitative evidence from the system design process. Other reports to be published later on in the OHA-project report series will handle the diversity requirements in safety critical software-based systems, generation of test data from operational profiles and handling of programmable automation in plant PSA-studies. In this report the issues related to the statistical testing and especially automated test case generation are considered. The goal is to find an efficient method for building usage models for the generation of statistically significant set of test cases and to gather practical experiences from this method by applying it in a case study. The scope of the study also includes the tool support for the method, as the models may grow quite large and complex. (32 refs., 30 figs.)

  20. Time-dependent reliability analysis and condition assessment of structures

    International Nuclear Information System (INIS)

    Ellingwood, B.R.

    1997-01-01

    Structures generally play a passive role in assurance of safety in nuclear plant operation, but are important if the plant is to withstand the effect of extreme environmental or abnormal events. Relative to mechanical and electrical components, structural systems and components would be difficult and costly to replace. While the performance of steel or reinforced concrete structures in service generally has been very good, their strengths may deteriorate during an extended service life as a result of changes brought on by an aggressive environment, excessive loading, or accidental loading. Quantitative tools for condition assessment of aging structures can be developed using time-dependent structural reliability analysis methods. Such methods provide a framework for addressing the uncertainties attendant to aging in the decision process

  1. Quantification of human reliability in probabilistic safety assessment

    International Nuclear Information System (INIS)

    Hirschberg, S.; Dankg, Vinh N.

    1996-01-01

    Human performance may substantially influence the reliability and safety of complex technical systems. For this reason, Human Reliability Analysis (HRA) constitutes an important part of Probabilistic Safety Assessment (PSAs) or Quantitative Risk Analyses (QRAs). The results of these studies as well as analyses of past accidents and incidents clearly demonstrate the importance of human interactions. The contribution of human errors to the core damage frequency (CDF), as estimated in the Swedish nuclear PSAs, are between 15 and 88%. A survey of the FRAs in the Swiss PSAs shows that also for the Swiss nuclear power plants the estimated HE contributions are substantial (49% of the CDF due to internal events in the case of Beznau and 70% in the case of Muehleberg; for the total CDF, including external events, 25% respectively 20%). Similar results can be extracted from the PSAs carried out for French, German, and US plants. In PSAs or QRAs, the adequate treatment of the human interactions with the system is a key to the understanding of accident sequences and their relative importance to overall risk. The main objectives of HRA are: first, to ensure that the key human interactions are systematically identified and incorporated into the safety analysis in a traceable manner, and second, to quantify the probabilities of their success and failure. Adopting a structured and systematic approach to the assessment of human performance makes it possible to provide greater confidence that the safety and availability of human-machine systems is not unduly jeopardized by human performance problems. Section 2 discusses the different types of human interactions analysed in PSAs. More generally, the section presents how HRA fits in the overall safety analysis, that is, how the human interactions to be quantified are identified. Section 3 addresses the methods for quantification. Section 4 concludes the paper by presenting some recommendations and pointing out the limitations of the

  2. Assessment of Data Reliability of Wireless Sensor Network for Bioinformatics

    Directory of Open Access Journals (Sweden)

    Ting Dong

    2017-09-01

    Full Text Available As a focal point of biotechnology, bioinformatics integrates knowledge from biology, mathematics, physics, chemistry, computer science and information science. It generally deals with genome informatics, protein structure and drug design. However, the data or information thus acquired from the main areas of bioinformatics may not be effective. Some researchers combined bioinformatics with wireless sensor network (WSN into biosensor and other tools, and applied them to such areas as fermentation, environmental monitoring, food engineering, clinical medicine and military. In the combination, the WSN is used to collect data and information. The reliability of the WSN in bioinformatics is the prerequisite to effective utilization of information. It is greatly influenced by factors like quality, benefits, service, timeliness and stability, some of them are qualitative and some are quantitative. Hence, it is necessary to develop a method that can handle both qualitative and quantitative assessment of information. A viable option is the fuzzy linguistic method, especially 2-tuple linguistic model, which has been extensively used to cope with such issues. As a result, this paper introduces 2-tuple linguistic representation to assist experts in giving their opinions on different WSNs in bioinformatics that involve multiple factors. Moreover, the author proposes a novel way to determine attribute weights and uses the method to weigh the relative importance of different influencing factors which can be considered as attributes in the assessment of the WSN in bioinformatics. Finally, an illustrative example is given to provide a reasonable solution for the assessment.

  3. Data driven CAN node reliability assessment for manufacturing system

    Science.gov (United States)

    Zhang, Leiming; Yuan, Yong; Lei, Yong

    2017-01-01

    The reliability of the Controller Area Network(CAN) is critical to the performance and safety of the system. However, direct bus-off time assessment tools are lacking in practice due to inaccessibility of the node information and the complexity of the node interactions upon errors. In order to measure the mean time to bus-off(MTTB) of all the nodes, a novel data driven node bus-off time assessment method for CAN network is proposed by directly using network error information. First, the corresponding network error event sequence for each node is constructed using multiple-layer network error information. Then, the generalized zero inflated Poisson process(GZIP) model is established for each node based on the error event sequence. Finally, the stochastic model is constructed to predict the MTTB of the node. The accelerated case studies with different error injection rates are conducted on a laboratory network to demonstrate the proposed method, where the network errors are generated by a computer controlled error injection system. Experiment results show that the MTTB of nodes predicted by the proposed method agree well with observations in the case studies. The proposed data driven node time to bus-off assessment method for CAN networks can successfully predict the MTTB of nodes by directly using network error event data.

  4. Human reliability assessment on the basis of operating experience

    International Nuclear Information System (INIS)

    Straeter, O.

    1997-01-01

    For development of methodology, available models for qualitative assessment of human errors (e.g. by Swain, Hacker, Rasmussen) and a variety of known systematic approaches for quantitiative assessment of inadequate human action (e.g. THERP, ASEP, HCR, SLIM) were taken as a basis to establish a job specification, which in turn was used for developing a method for acquisition, characterisation and evaluation of errors. This method encompasses the two processes of event analysis and event evaluation: The first step comprises analysis of events by analysis of information describing the conditions and scenarios of relevance to the inadequate human action examined. In addition to the description of process sequences, information is taken into account on possible conditions that may bring about failure. As an assessment of human reliability requires manifold approaches for evaluation, a connectionistic procedure was developed for evaluation of the compilation of events based on a debate about various approaches from the domain of artificial intelligence (AI). This procedure yields both qualitative and quantitative information through a homogenous approach. (orig./GL) [de

  5. Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS).

    Science.gov (United States)

    Jalil, Rozh; Soukup, Tayana; Akhter, Waseem; Sevdalis, Nick; Green, James S A

    2018-03-03

    High-quality leadership and chairing skills are vital for good performance in multidisciplinary tumor boards (MTBs), but no instruments currently exist for assessing and improving these skills. To construct and validate a robust instrument for assessment of MTB leading and chairing skills. We developed an observational MTB leadership assessment instrument (ATLAS). ATLAS includes 12 domains that assess the leadership and chairing skills of the MTB chairperson. ATLAS has gone through a rigorous process of refinement and content validation prior to use to assess the MTB lead by two urological surgeons (blinded to each other) in 7 real-live (n = 286 cases) and 10 video-recorded (n = 131 cases) MTBs. ATLAS domains were analyzed via descriptive statistics. Instrument content was evaluated for validity using the content validation index (CVI). Intraclass correlation coefficients (ICCs) were used to assess inter-observer reliability. Instrument refining resulted in ATLAS including the following 12 domains: time management, communication, encouraging contribution, ability to summarize, ensuring all patients have treatment plan, case prioritization, keeping meeting focused, facilitate discussion, conflict management, leadership, creating good working atmosphere, and recruitment for clinical trials. CVI was acceptable and inter-rater agreement adequate to high for all domains. Agreement was somewhat higher in real-time MTBs compared to video ratings. Concurrent validation evidence was derived via positive and significant correlations between ATLAS and an established validated brief MTB leadership assessment scale. ATLAS is an observational assessment instrument that can be reliably used for assessing leadership and chairing skills in cancer MTBs (both live and video-recorded). The ability to assess and feedback on team leader performance provides the ground for promotion of good practice and continuing professional development of tumor board leaders.

  6. Satisfaction and adherence in patients with iron overload receiving iron chelation therapy as assessed by a newly developed patient instrument.

    Science.gov (United States)

    Rofail, Diana; Abetz, Linda; Viala, Muriel; Gait, Claire; Baladi, Jean-Francois; Payne, Krista

    2009-01-01

    This study assesses satisfaction with iron chelation therapy (ICT) based on a reliable and valid instrument, and explores the relationship between satisfaction and adherence to ICT. Patients in the USA and UK completed a new "Satisfaction with ICT" (SICT) instrument consisting of 28 items, three pertaining to adherence. Simple and multivariate regression analyses assessed the relationship between satisfaction with different aspects of ICT and adherence. First assessments of the SICT instrument indicate its validity and reliability. Recommended thresholds for internal consistency, convergent validity, discriminant validity, and floor and ceiling effects were met. A number of variables were identified in the simple linear regression analyses as significant predictors of "never thinking about stopping ICT," a proxy for adherence. These significant variables were entered into the multivariate model to assess the combined factor effects, explaining 42% of the total variance of "never thinking about stopping ICT." A significant and positive relationship was demonstrated between "never thinking about stopping ICT" and age (P = 0.04), Perceived Effectiveness of ICT (P = 0.003), low Burden of ICT (P = 0.002), and low Side Effects of ICT (P = 0.01). The SICT is a reliable and valid instrument which will be useful in ICT clinical trials. Furthermore, the administration of ICT by slow subcutaneous infusion negatively impacts on satisfaction with ICT which was shown to be a determinant of adherence. This points to the need for new more convenient and less burdensome oral iron chelators to increase adherence, and ultimately to improve patient outcomes.

  7. Reliability of patient-reported outcome instruments in US adults with hemophilia: the Pain, Functional Impairment and Quality of life (P-FiQ study

    Directory of Open Access Journals (Sweden)

    Kempton CL

    2017-09-01

    Full Text Available Christine L Kempton,1 Michael Wang,2 Michael Recht,3 Anne Neff,4 Amy D Shapiro,5 Amit Soni,6 Roshni Kulkarni,7 Tyler W Buckner,2 Katharine Batt,8 Neeraj N Iyer,9 David L Cooper9 1Departments of Pediatrics and Hematology and Medical Oncology, Emory University School of Medicine, Atlanta, GA, USA; 2Hemophilia and Thrombosis Center, University of Colorado School of Medicine, Aurora, CO, USA; 3The Hemophilia Center, Oregon Health & Science University, Portland, OR, USA; 4Hematology and Medical Oncology, Cleveland Clinic, Cleveland, OH, USA; 5Indiana Hemophilia & Thrombosis Center, Indianapolis, IN, USA; 6Center for Inherited Blood Disorders and CHOC Children’s Hospital/UC Irvine, Orange, CA, USA; 7MSU Center for Bleeding and Clotting Disorders, Michigan State University, East Lansing, MI, USA; 8Hematology and Oncology, Wake Forest School of Medicine, Winston-Salem, NC, USA; 9Clinical, Medical and Regulatory Affairs, Novo Nordisk Inc., Plainsboro, NJ, USA Background: Hemophilia is marked by frequent joint bleeding, resulting in pain and functional impairment.Objective: This study aimed to assess the reliability of five patient-reported outcome (PRO instruments in people with hemophilia (PWH in a non-bleeding state.Methods: Adult male PWH of any severity and inhibitor status, with a history of joint pain or bleeding, completed a pain history and five PRO instruments (EQ-5D-5L, Brief Pain Inventory v2 [BPI], International Physical Activity Questionnaire [IPAQ], Short Form 36 Health Survey v2 [SF-36v2], and Hemophilia Activities List [HAL] during their routine comprehensive care visit. Patients were approached to complete the PRO instruments again at the end of their visit while in a similar non-bleeding state. Concordance of individual questionnaire items and correlation between domain scores were assessed using intra-class correlation coefficient (ICC.Results: Participants completing the retest (n=164 had a median age of 33.9 years. Median time for

  8. The reasons for betel-quid chewing scale: assessment of factor structure, reliability, and validity.

    Science.gov (United States)

    Little, Melissa A; Pokhrel, Pallav; Murphy, Kelle L; Kawamoto, Crissy T; Suguitan, Gil S; Herzog, Thaddeus A

    2014-06-03

    Despite the fact that betel-quid is one of the most commonly used psychoactive substances worldwide and a major risk-factor for head-and-neck cancer incidence and mortality globally, currently no standardized instrument is available to assess the reasons why individuals chew betel-quid. A measure to assess reasons for chewing betel-quid could help researchers and clinicians develop prevention and treatment strategies. In the current study, we sought to develop and evaluate a self-report instrument for assessing the reasons for chewing betel quid which contributes toward the goal of developing effective interventions to reduce betel quid chewing in vulnerable populations. The current study assessed the factor structure, reliability and convergent validity of the Reasons for Betel-quid Chewing Scale (RBCS), a newly developed 10 item measure adapted from several existing "reasons for smoking" scales. The measure was administered to 351 adult betel-quid chewers in Guam. Confirmatory factor analysis of this measure revealed a three factor structure: reinforcement, social/cultural, and stimulation. Further tests revealed strong support for the internal consistency and convergent validity of this three factor measure. The goal of designing an intervention to reduce betel-quid chewing necessitates an understanding of why chewers chew; the current study makes considerable contributions towards that objective.

  9. Impact of data source on travel time reliability assessment.

    Science.gov (United States)

    2014-08-01

    Travel time reliability measures are becoming an increasingly important input to the mobility and : congestion management studies. In the case of Maryland State Highway Administration, reliability : measures are key elements in the agencys Annual ...

  10. Measurement properties of instruments that assess participation in young people with autism spectrum disorder: a systematic review.

    Science.gov (United States)

    Lami, Francesca; Egberts, Kristine; Ure, Alexandra; Conroy, Rowena; Williams, Katrina

    2018-03-01

    To systematically review the measurement properties of instruments assessing participation in young people with autism spectrum disorder (ASD). A search was performed in MEDLINE, PsycINFO, and PubMed combining three constructs ('ASD', 'test of participation', 'measurement properties'). Results were restricted to articles including people aged 6 to 29 years. The 2539 identified articles were independently screened by two reviewers. For the included articles, data were extracted using standard forms and their risk of bias was assessed. Nine studies (8 cross-sectional) met the inclusion criteria, providing information on seven different instruments. The total sample included 634 participants, with sex available for 600 (males=494; females=106) and age available for 570, with mean age for these participants 140.58 months (SD=9.11; range=36-624). Included instruments were the school function assessment, vocational index, children's assessment of participation and enjoyment/preferences for activities of children, experience sampling method, Pediatric Evaluation of Disability Inventory, Computer Adaptive Test, adolescent and young adult activity card sort, and Patient-Reported Outcomes Measurement Information System parent-proxy peer relationships. Seven studies assessed reliability and validity; good properties were reported for half of the instruments considered. Most studies (n=6) had high risk of bias. Overall the quality of the evidence for each tool was limited. Validation of these instruments, or others that comprehensively assess participation, is needed. Future studies should follow recommended methodological standards. Seven instruments have been used to assess participation in young people with autism. One instrument, with excellent measurement properties in one study, does not comprehensively assess participation. Studies of three instruments that incorporate a more comprehensive assessment of participation have methodological limitations. Overall, limited

  11. Music@Home: A novel instrument to assess the home musical environment in the early years.

    Science.gov (United States)

    Politimou, Nina; Stewart, Lauren; Müllensiefen, Daniel; Franco, Fabia

    2018-01-01

    The majority of children under the age of 5 appear to show spontaneous enjoyment of singing, being exposed to music and interacting with musical instruments, but whether variations in engaging in such activities in the home could contribute to developmental outcomes is still largely unknown. Critically, researchers lack a comprehensive instrument with good psychometric properties to assess the home musical environment from infancy to the preschool years. To address this gap, this paper presents two studies that describe the development and validation of the Music@Home questionnaire, which comprises two versions: Infant and Preschool. In Study 1, an initial pool of items was generated and administered to a wide audience of parents (n = 287 for the Infant, n = 347 for the Preschool version). Exploratory factor analysis was used to identify different dimensions comprising the home musical environment of both infants and pre-schoolers, and to reduce the initial pool of items to a smaller number of meaningful items. In Study 2, convergent and divergent validity and internal and test-retest reliability of the new instrument were established, using data from a different sample of participants (n = 213 for the Infant, n = 213 for the Preschool version). The second study also investigated associations between the Music@Home and musical characteristics of the parents, such as their musical education and personal engagement with music. Overall, the Music@Home constitutes a novel, valid and reliable instrument that allows for the systematic assessment of distinct aspects of the home musical environment in families with children under the age of 5. Furthermore, the Infant and Preschool versions of the Music@Home present differential associations with musical characteristics of the parents opening a new area of inquiry into how musical exposure and interaction in the home may vary across different developmental stages.

  12. Music@Home: A novel instrument to assess the home musical environment in the early years

    Science.gov (United States)

    Stewart, Lauren; Müllensiefen, Daniel; Franco, Fabia

    2018-01-01

    The majority of children under the age of 5 appear to show spontaneous enjoyment of singing, being exposed to music and interacting with musical instruments, but whether variations in engaging in such activities in the home could contribute to developmental outcomes is still largely unknown. Critically, researchers lack a comprehensive instrument with good psychometric properties to assess the home musical environment from infancy to the preschool years. To address this gap, this paper presents two studies that describe the development and validation of the Music@Home questionnaire, which comprises two versions: Infant and Preschool. In Study 1, an initial pool of items was generated and administered to a wide audience of parents (n = 287 for the Infant, n = 347 for the Preschool version). Exploratory factor analysis was used to identify different dimensions comprising the home musical environment of both infants and pre-schoolers, and to reduce the initial pool of items to a smaller number of meaningful items. In Study 2, convergent and divergent validity and internal and test-retest reliability of the new instrument were established, using data from a different sample of participants (n = 213 for the Infant, n = 213 for the Preschool version). The second study also investigated associations between the Music@Home and musical characteristics of the parents, such as their musical education and personal engagement with music. Overall, the Music@Home constitutes a novel, valid and reliable instrument that allows for the systematic assessment of distinct aspects of the home musical environment in families with children under the age of 5. Furthermore, the Infant and Preschool versions of the Music@Home present differential associations with musical characteristics of the parents opening a new area of inquiry into how musical exposure and interaction in the home may vary across different developmental stages. PMID:29641607

  13. Accuracy assessment of ALOS optical instruments: PRISM and AVNIR-2

    Science.gov (United States)

    Tadono, Takeo; Shimada, Masanobu; Iwata, Takanori; Takaku, Junichi; Kawamoto, Sachi

    2017-11-01

    This paper describes the updated results of calibration and validation to assess the accuracies for optical instruments onboard the Advanced Land Observing Satellite (ALOS, nicknamed "Daichi"), which was successfully launched on January 24th, 2006 and it is continuously operating very well. ALOS has an L-band Synthetic Aperture Radar called PALSAR and two optical instruments i.e. the Panchromatic Remotesensing Instrument for Stereo Mapping (PRISM) and the Advanced Visible and Near Infrared Radiometer type-2 (AVNIR-2). PRISM consists of three radiometers and is used to derive a digital surface model (DSM) with high spatial resolution that is an objective of the ALOS mission. Therefore, geometric calibration is important in generating a precise DSM with stereo pair images of PRISM. AVNIR-2 has four radiometric bands from blue to near infrared and uses for regional environment and disaster monitoring etc. The radiometric calibration and image quality evaluation are also important for AVNIR-2 as well as PRISM. This paper describes updated results of geometric calibration including geolocation determination accuracy evaluations of PRISM and AVNIR-2, image quality evaluation of PRISM, and validation of generated PRISM DSM. These works will be done during the ALOS mission life as an operational calibration to keep absolute accuracies of the standard products.

  14. A New Myohaptic Instrument to Assess Wrist Motion Dynamically

    Directory of Open Access Journals (Sweden)

    Mario Manto

    2010-04-01

    Full Text Available The pathophysiological assessment of joint properties and voluntary motion in neurological patients remains a challenge. This is typically the case in cerebellar patients, who exhibit dysmetric movements due to the dysfunction of cerebellar circuitry. Several tools have been developed, but so far most of these tools have remained confined to laboratories, with a lack of standardization. We report on a new device which combines the use of electromyographic (EMG sensors with haptic technology for the dynamic investigation of wrist properties. The instrument is composed of a drivetrain, a haptic controller and a signal acquisition unit. Angular accuracy is 0.00611 rad, nominal torque is 6 N·m, maximal rotation velocity is 34.907 rad/sec, with a range of motion of –1.0472 to +1.0472 rad. The inertia of the motor and handgrip is 0.004 kg·m². This is the first standardized myohaptic instrument allowing the dynamic characterization of wrist properties, including under the condition of artificial damping. We show that cerebellar patients are unable to adapt EMG activities when faced with an increase in damping while performing fast reversal movements. The instrument allows the extraction of an electrophysiological signature of a cerebellar deficit.

  15. A new myohaptic instrument to assess wrist motion dynamically.

    Science.gov (United States)

    Manto, Mario; Van Den Braber, Niels; Grimaldi, Giuliana; Lammertse, Piet

    2010-01-01

    The pathophysiological assessment of joint properties and voluntary motion in neurological patients remains a challenge. This is typically the case in cerebellar patients, who exhibit dysmetric movements due to the dysfunction of cerebellar circuitry. Several tools have been developed, but so far most of these tools have remained confined to laboratories, with a lack of standardization. We report on a new device which combines the use of electromyographic (EMG) sensors with haptic technology for the dynamic investigation of wrist properties. The instrument is composed of a drivetrain, a haptic controller and a signal acquisition unit. Angular accuracy is 0.00611 rad, nominal torque is 6 N·m, maximal rotation velocity is 34.907 rad/sec, with a range of motion of -1.0472 to +1.0472 rad. The inertia of the motor and handgrip is 0.004 kg·m2. This is the first standardized myohaptic instrument allowing the dynamic characterization of wrist properties, including under the condition of artificial damping. We show that cerebellar patients are unable to adapt EMG activities when faced with an increase in damping while performing fast reversal movements. The instrument allows the extraction of an electrophysiological signature of a cerebellar deficit.

  16. Instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Decreton, M

    2000-07-01

    SCK-CEN's research and development programme on instrumentation aims at evaluating the potentials of new instrumentation technologies under the severe constraints of a nuclear application. It focuses on the tolerance of sensors to high radiation doses, including optical fibre sensors, and on the related intelligent data processing needed to cope with the nuclear constraints. Main achievements in these domains in 1999 are summarised.

  17. Development of an instrument to assess the health related quality of life of kidney stone formers.

    Science.gov (United States)

    Penniston, Kristina L; Nakada, Stephen Y

    2013-03-01

    Urolithiasis is associated with pain and other decreases in health related quality of life, yet there is no urolithiasis specific instrument to measure quality of life. Quality of life is an important end point in the management of urolithiasis. Therefore, we developed the Wisconsin StoneQOL, a disease specific instrument to assess the quality of life of patients with urolithiasis. Patients and urology providers identified important concepts related to quality of life of stone formers in groups and in individual cognitive interviews. Patients were recurrent stone formers including those with and those without current stones. A preliminary instrument was created, followed by patient feedback and item reduction. A 28-question instrument was ultimately developed which was tested for reliability as well as internal face, construct and discriminant validity in 248 stone formers. The internal consistency (for questions within domains) was high (mean Cronbach's α = 0.81). Correlation between domains was confirmed (Cronbach's α = 0.86). Discriminant validity was shown as stone formers with current stones scored lower than those who were stone-free. Among patients with active stones, those with symptoms scored lower on most questions and for the total score (p instrument that captures the unique symptoms and challenges associated with urolithiasis. As such, the Wisconsin StoneQOL is capable of assessing the health related quality of life of stone formers at various points along the disease continuum. Future assessment will establish minimal clinically important differences for use in individual patients. Copyright © 2013 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  18. The Perceived Personal Control (PPC) questionnaire as an outcome of genetic counseling: reliability and validity of the instrument.

    NARCIS (Netherlands)

    Smets, E.M.A.; Pieterse, A.H.; Aalfs, C.M.; Ausems, M.G.E.M.; Dulmen, A.M. van

    2006-01-01

    The perceived personal control (PPC) questionnaire was developed by Berkenstadt and colleagues as an outcome measure for the evaluation of the process of genetic counseling. The present study aimed to further assess the psychometric properties of a Dutch version of the instrument. Data were used

  19. Inter-rater and test-retest reliability, internal consistency, and factorial structure of the instrument for forensic treatment evaluation

    NARCIS (Netherlands)

    Schuringa, E.; Spreen, M.; Bogaerts, S.

    2014-01-01

    In this study, the Instrument for Forensic Treatment Evaluation (IFTE) is introduced. The IFTE includes 14 dynamic items of the risk assessment scheme HKT-R and eight items specifically related to the treatment of forensic psychiatric patients. The items are divided over three factors: protective

  20. Reliability of a single objective measure in assessing sleepiness.

    Science.gov (United States)

    Sunwoo, Bernie Y; Jackson, Nicholas; Maislin, Greg; Gurubhagavatula, Indira; George, Charles F; Pack, Allan I

    2012-01-01

    To evaluate reliability of single objective tests in assessing sleepiness. Subjects who completed polysomnography underwent a 4-nap multiple sleep latency test (MSLT) the following day. Prior to each nap opportunity on MSLT, subjects performed the psychomotor vigilance test (PVT) and divided attention driving task (DADT). Results of single versus multiple test administrations were compared using the intraclass correlation coefficient (ICC) and adjusted for test administration order effects to explore time of day effects. Measures were explored as continuous and binary (i.e., impaired or not impaired). Community-based sample evaluated at a tertiary, university-based sleep center. 372 adult commercial vehicle operators oversampled for increased obstructive sleep apnea risk. N/A. AS CONTINUOUS MEASURES, ICC WERE AS FOLLOWS: MSLT 0.45, PVT median response time 0.69, PVT number of lapses 0.51, 10-min DADT tracking error 0.87, 20-min DADT tracking error 0.90. Based on binary outcomes, ICC were: MSLT 0.63, PVT number of lapses 0.85, 10-min DADT 0.95, 20-min DADT 0.96. Statistically significant time of day effects were seen in both the MSLT and PVT but not the DADT. Correlation between ESS and different objective tests was strongest for MSLT, range [-0.270 to -0.195] and persisted across all time points. Single DADT and PVT administrations are reliable measures of sleepiness. A single MSLT administration can reasonably discriminate individuals with MSL < 8 minutes. These results support the use of a single administration of some objective tests of sleepiness when performed under controlled conditions in routine clinical care.

  1. Content Validity and Inter-Rater Reliability of the Halliwick-Concept-Based Instrument "Swimming with Independent Measure"

    Science.gov (United States)

    Srsen, Katja Groleger; Vidmar, Gaj; Pikl, Masa; Vrecar, Irena; Burja, Cirila; Krusec, Klavdija

    2012-01-01

    The Halliwick concept is widely used in different settings to promote joyful movement in water and swimming. To assess the swimming skills and progression of an individual swimmer, a valid and reliable measure should be used. The Halliwick-concept-based Swimming with Independent Measure (SWIM) was introduced for this purpose. We aimed to determine…

  2. Reliability assessment of restructured power systems using reliability network equivalent and pseudo-sequential simulation techniques

    International Nuclear Information System (INIS)

    Ding, Yi; Wang, Peng; Goel, Lalit; Billinton, Roy; Karki, Rajesh

    2007-01-01

    This paper presents a technique to evaluate reliability of a restructured power system with a bilateral market. The proposed technique is based on the combination of the reliability network equivalent and pseudo-sequential simulation approaches. The reliability network equivalent techniques have been implemented in the Monte Carlo simulation procedure to reduce the computational burden of the analysis. Pseudo-sequential simulation has been used to increase the computational efficiency of the non-sequential simulation method and to model the chronological aspects of market trading and system operation. Multi-state Markov models for generation and transmission systems are proposed and implemented in the simulation. A new load shedding scheme is proposed during generation inadequacy and network congestion to minimize the load curtailment. The IEEE reliability test system (RTS) is used to illustrate the technique. (author)

  3. Remaining life prediction of I and C cables for reliability assessment of NPP systems

    International Nuclear Information System (INIS)

    Santhosh, T.V.; Ghosh, A.K.; Fernandes, B.G.

    2012-01-01

    Highlights: ► A framework for time dependent reliability prediction of I and C cables for use in PSA of NPP has been developed using stress–strength interference theory. ► The proposed methodology has been illustrated with the accelerated thermal aging data on a typical XLPE cable. ► The behavior of insulation resistance when the degradation process is linear or exponential has also been modeled. ► The reliability index or probability of failure obtained from this approach can be used in system reliability evaluation to account for cable aging for PSA of NPP. - Abstract: Instrumentation and control (I and C) cables are one of the most important components in nuclear power plants (NPPs) because they provide power to safety-related equipment and also to transmit signals to and from various controllers to perform safety operations. I and C cables in NPP are subjected to a variety of aging and degradation stressors that can produce immediate degradation or aging-related mechanisms causing the degradation of cable components over time. Although, there exits several life estimation techniques, currently there is no any standard methodology or an approach toward estimating the time dependent reliability of I and C cables that can be directly used in probabilistic safety assessment (PSA) applications. Hence, the objective of this study is to develop an approach to estimate and confirm the continued acceptable margin in cable insulation life over time subjected to aging. This paper presents a framework based on the structural reliability theory to quantify the life time of I and C cable subjecting to thermal aging. Since cross-linked polyethylene (XLPE) cables are extensively being used in Indian NPPs, the remaining life time evaluations have been carried out for a typical XLPE cable. However, the methodology can be extended to other cables such as polyvinyl chloride (PVC), ethylene propylene rubber (EPR), etc.

  4. Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review

    Science.gov (United States)

    2018-01-11

    Background: This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. Methods: A systematic review study design wa...

  5. Design and validation of the INICIARE instrument, for the assessment of dependency level in acutely ill hospitalised patients.

    Science.gov (United States)

    Morales-Asencio, José Miguel; Porcel-Gálvez, Ana María; Oliveros-Valenzuela, Rosa; Rodríguez-Gómez, Susana; Sánchez-Extremera, Lucrecia; Serrano-López, Francisco Andrés; Aranda-Gallardo, Marta; Canca-Sánchez, José Carlos; Barrientos-Trigo, Sergio

    2015-03-01

    The aim of this study was to establish the validity and reliability of an instrument (Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería) used to assess the dependency level in acutely hospitalised patients. This instrument is novel, and it is based on the Nursing Outcomes Classification. Multiple existing instruments for needs assessment have been poorly validated and based predominately on interventions. Standardised Nursing Languages offer an ideal framework to develop nursing sensitive instruments. A cross-sectional validation study in two acute care hospitals in Spain. This study was implemented in two phases. First, the research team developed the instrument to be validated. In the second phase, the validation process was performed by experts, and the data analysis was conducted to establish the psychometric properties of the instrument. Seven hundred and sixty-one patient ratings performed by nurses were collected during the course of the research study. Data analysis yielded a Cronbach's alpha of 0·91. An exploratory factorial analysis identified three factors (Physiological, Instrumental and Cognitive-behavioural), which explained 74% of the variance. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería was demonstrated to be a valid and reliable instrument based on its use in acutely hospitalised patients to assess the level of dependency. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería can be used as an assessment tool in hospitalised patients during the nursing process throughout the entire hospitalisation period. It contributes information to support decisions on nursing diagnoses, interventions and outcomes. It also enables data codification in large databases. © 2014 John Wiley & Sons Ltd.

  6. Systems analysis programs for hands-on integrated reliability evaluations (SAPHIRE) Version 5.0. Fault tree, event tree, and piping ampersand instrumentation diagram (FEP) editors reference manual: Volume 7

    International Nuclear Information System (INIS)

    McKay, M.K.; Skinner, N.L.; Wood, S.T.

    1994-07-01

    The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) refers to a set of several microcomputer programs that were developed to create and analyze probabilistic risk assessments (PRAs), primarily for nuclear power plants. The Fault Tree, Event Tree, and Piping and Instrumentation Diagram (FEP) editors allow the user to graphically build and edit fault trees, and event trees, and piping and instrumentation diagrams (P and IDs). The software is designed to enable the independent use of the graphical-based editors found in the Integrated Reliability and Risk Assessment System (IRRAS). FEP is comprised of three separate editors (Fault Tree, Event Tree, and Piping and Instrumentation Diagram) and a utility module. This reference manual provides a screen-by-screen guide of the entire FEP System

  7. Reliability and Validity of the Korean Cancer Pain Assessment Tool (KCPAT)

    Science.gov (United States)

    Kim, Jeong A; Lee, Juneyoung; Park, Jeanno; Lee, Myung Ah; Yeom, Chang Hwan; Jang, Se Kwon; Yoon, Duck Mi; Kim, Jun Suk

    2005-01-01

    The Korean Cancer Pain Assessment Tool (KCPAT), which was developed in 2003, consists of questions concerning the location of pain, the nature of pain, the present pain intensity, the symptoms associated with the pain, and psychosocial/spiritual pain assessments. This study was carried out to evaluate the reliability and validity of the KCPAT. A stratified, proportional-quota, clustered, systematic sampling procedure was used. The study population (903 cancer patients) was 1% of the target population (90,252 cancer patients). A total of 314 (34.8%) questionnaires were collected. The results showed that the average pain score (5 point on Likert scale) according to the cancer type and the at-present average pain score (VAS, 0-10) were correlated (r=0.56, p<0.0001), and showed moderate agreement (kappa=0.364). The mean satisfaction score was 3.8 (1-5). The average time to complete the questionnaire was 8.9 min. In conclusion, the KCPAT is a reliable and valid instrument for assessing cancer pain in Koreans. PMID:16224166

  8. Reliability of inertial sensors in the assessment of patients with vestibular disorders: a feasibility study

    Directory of Open Access Journals (Sweden)

    Sathish K. Sankarpandi

    2017-02-01

    Full Text Available Abstract Background Vestibular disorders affect an individual’s stability, balance, and gait and predispose them to falls. Traditional laboratory-based semi-objective vestibular assessments are intrusive and cumbersome provide little information about their functional ability. Commercially available wearable inertial sensors allow us to make this real life assessments objective, with a detailed view of their functional abilities. Timed Up and Go (TUG and Postural Sway tests are commonly used tests for gait and balance assessments. Our aim was to assess the feasibility, test-retest reliability and ability to classify fall status in individuals with vestibular disorders using parameters derived from the commercially available wearable system (inertial sensors and the Mobility Lab Software, APDM, Inc.. Methods We recruited 27 individuals diagnosed either with unilateral or bilateral vestibular loss on vestibular function testing. Instrumented Timed Up and Go (iTUG and Postural Sway (iSway were administered three times during the first session and then repeated at a similar time the following week. To evaluate within and between sessions reliability of the parameters the Intra-Class Correlation coefficient (ICC was used. Subsequently, the ability of reliable parameters (ICC ≥ 0.8 to classify fallers from non-fallers was estimated. Results The iTUG test parameters showed good within and between sessions’ reliability with mean ICC (between-sessions values of 0.81 ± 0.17 and 0.69 ± 0.15, respectively. For the iSway test, the relative figures were; 0.76 ± 0.13 and 0.71 ± 0.14, respectively. A retrospective falls classification analysis with past 12 months falls history data yielded an accuracy of 66.70% with an area under the curve of 0.79. Mean Distance from centre of COP (mm of accelerometer’s trajectory (m/s2 from the iSway test was the only significant parameter to classify fallers from non-fallers. Conclusions Using

  9. Reliability and validity of the transport and physical activity questionnaire (TPAQ for assessing physical activity behaviour.

    Directory of Open Access Journals (Sweden)

    Emma J Adams

    Full Text Available No current validated survey instrument allows a comprehensive assessment of both physical activity and travel behaviours for use in interdisciplinary research on walking and cycling. This study reports on the test-retest reliability and validity of physical activity measures in the transport and physical activity questionnaire (TPAQ.The TPAQ assesses time spent in different domains of physical activity and using different modes of transport for five journey purposes. Test-retest reliability of eight physical activity summary variables was assessed using intra-class correlation coefficients (ICC and Kappa scores for continuous and categorical variables respectively. In a separate study, the validity of three survey-reported physical activity summary variables was assessed by computing Spearman correlation coefficients using accelerometer-derived reference measures. The Bland-Altman technique was used to determine the absolute validity of survey-reported time spent in moderate-to-vigorous physical activity (MVPA.In the reliability study, ICC for time spent in different domains of physical activity ranged from fair to substantial for walking for transport (ICC = 0.59, cycling for transport (ICC = 0.61, walking for recreation (ICC = 0.48, cycling for recreation (ICC = 0.35, moderate leisure-time physical activity (ICC = 0.47, vigorous leisure-time physical activity (ICC = 0.63, and total physical activity (ICC = 0.56. The proportion of participants estimated to meet physical activity guidelines showed acceptable reliability (k = 0.60. In the validity study, comparison of survey-reported and accelerometer-derived time spent in physical activity showed strong agreement for vigorous physical activity (r = 0.72, p<0.001, fair but non-significant agreement for moderate physical activity (r = 0.24, p = 0.09 and fair agreement for MVPA (r = 0.27, p = 0.05. Bland-Altman analysis showed a mean

  10. Reliability and Validity of the Transport and Physical Activity Questionnaire (TPAQ) for Assessing Physical Activity Behaviour

    Science.gov (United States)

    Adams, Emma J.; Goad, Mary; Sahlqvist, Shannon; Bull, Fiona C.; Cooper, Ashley R.; Ogilvie, David

    2014-01-01

    Background No current validated survey instrument allows a comprehensive assessment of both physical activity and travel behaviours for use in interdisciplinary research on walking and cycling. This study reports on the test-retest reliability and validity of physical activity measures in the transport and physical activity questionnaire (TPAQ). Methods The TPAQ assesses time spent in different domains of physical activity and using different modes of transport for five journey purposes. Test-retest reliability of eight physical activity summary variables was assessed using intra-class correlation coefficients (ICC) and Kappa scores for continuous and categorical variables respectively. In a separate study, the validity of three survey-reported physical activity summary variables was assessed by computing Spearman correlation coefficients using accelerometer-derived reference measures. The Bland-Altman technique was used to determine the absolute validity of survey-reported time spent in moderate-to-vigorous physical activity (MVPA). Results In the reliability study, ICC for time spent in different domains of physical activity ranged from fair to substantial for walking for transport (ICC = 0.59), cycling for transport (ICC = 0.61), walking for recreation (ICC = 0.48), cycling for recreation (ICC = 0.35), moderate leisure-time physical activity (ICC = 0.47), vigorous leisure-time physical activity (ICC = 0.63), and total physical activity (ICC = 0.56). The proportion of participants estimated to meet physical activity guidelines showed acceptable reliability (k = 0.60). In the validity study, comparison of survey-reported and accelerometer-derived time spent in physical activity showed strong agreement for vigorous physical activity (r = 0.72, pphysical activity (r = 0.24, p = 0.09) and fair agreement for MVPA (r = 0.27, p = 0.05). Bland-Altman analysis showed a mean overestimation of MVPA of 87.6 min/week (p

  11. The Pediatrics Milestones Assessment Pilot: Development of Workplace-Based Assessment Content, Instruments, and Processes.

    Science.gov (United States)

    Hicks, Patricia J; Margolis, Melissa; Poynter, Sue E; Chaffinch, Christa; Tenney-Soeiro, Rebecca; Turner, Teri L; Waggoner-Fountain, Linda; Lockridge, Robin; Clyman, Stephen G; Schwartz, Alan

    2016-05-01

    To report on the development of content and user feedback regarding the assessment process and utility of the workplace-based assessment instruments of the Pediatrics Milestones Assessment Pilot (PMAP). One multisource feedback instrument and two structured clinical observation instruments were developed and refined by experts in pediatrics and assessment to provide evidence for nine competencies based on the Pediatrics Milestones (PMs) and chosen to inform residency program faculty decisions about learners' readiness to serve as pediatric interns in the inpatient setting. During the 2012-2013 PMAP study, 18 U.S. pediatric residency programs enrolled interns and subinterns. Faculty, residents, nurses, and other observers used the instruments to assess learner performance through direct observation during a one-month rotation. At the end of the rotation, data were aggregated for each learner, milestone levels were assigned using a milestone classification form, and feedback was provided to learners. Learners and site leads were surveyed and/or interviewed about their experience as participants. Across the sites, 2,338 instruments assessing 239 learners were completed by 630 unique observers. Regarding end-of-rotation feedback, 93% of learners (128/137) agreed the assessments and feedback "helped me understand how those with whom I work perceive my performance," and 85% (117/137) agreed they were "useful for constructing future goals or identifying a developmental path." Site leads identified several benefits and challenges to the assessment process. PM-based instruments used in workplace-based assessment provide a meaningful and acceptable approach to collecting evidence of learner competency development. Learners valued feedback provided by PM-based assessment.

  12. Reliability, precision, and measurement in the context of data from ability tests, surveys, and assessments

    International Nuclear Information System (INIS)

    Fisher, W P Jr; Elbaum, B; Coulter, A

    2010-01-01

    Reliability coefficients indicate the proportion of total variance attributable to differences among measures separated along a quantitative continuum by a testing, survey, or assessment instrument. Reliability is usually considered to be influenced by both the internal consistency of a data set and the number of items, though textbooks and research papers rarely evaluate the extent to which these factors independently affect the data in question. Probabilistic formulations of the requirements for unidimensional measurement separate consistency from error by modelling individual response processes instead of group-level variation. The utility of this separation is illustrated via analyses of small sets of simulated data, and of subsets of data from a 78-item survey of over 2,500 parents of children with disabilities. Measurement reliability ultimately concerns the structural invariance specified in models requiring sufficient statistics, parameter separation, unidimensionality, and other qualities that historically have made quantification simple, practical, and convenient for end users. The paper concludes with suggestions for a research program aimed at focusing measurement research more on the calibration and wide dissemination of tools applicable to individuals, and less on the statistical study of inter-variable relations in large data sets.

  13. Reliability, validity, and significance of assessment of sense of contribution in the workplace.

    Science.gov (United States)

    Takaki, Jiro; Taniguchi, Toshiyo; Fujii, Yasuhito

    2014-01-29

    The purpose of this study was to assess the validity and reliability of the Sense of Contribution Scale (SCS), a newly developed, 7-item questionnaire used to measure sense of contribution in the workplace. Workers at 272 organizations answered questionnaires that included the SCS. Because of non-participation or missing data, the number of subjects included in the analyses for internal consistency and validity varied from 1,675 to 2,462 (response rates 54.6%-80.2%). Fifty-four workers were included in the analysis of test-retest reliability (response rate, 77.1%). The SCS showed high internal consistency (Cronbach's α coefficients in men and women were 0.85 and 0.86, respectively) and test-retest reliability (intraclass correlation coefficient = 0.91). Significant (p workplace bullying, and procedural and interactional justice. The SCS is a psychometrically satisfactory measure of sense of contribution in the workplace. The SCS provides a new and useful instrument to measure sense of contribution, which is independently associated with mental health in workers, for studies in organizational science, occupational health psychology and occupational medicine.

  14. Measurement properties of instruments assessing permanent functional impairment of the spine: a systematic review protocol

    Science.gov (United States)

    Trask, Catherine M; Boden, Catherine; Bath, Brenna; Hendrick, Paul; Clay, Lynne; Zeng, Xiaoke; Milosavljevic, Stephan

    2018-01-01

    Introduction Permanent functional impairment (PFI) of the spine is a rating system used by compensation authorities, such as workers compensation boards, to establish an appropriate level of financial compensation for persistent loss of function. Determination of PFI of the spine is commonly based on the assessment of spinal movement combined with other measures of physical and functional impairments; however, the reliability and validity of the measurement instruments used for these evaluations have yet to be established. The aim of this study is to systematically review and synthesise the literature concerning measurement properties of the various and different instruments used for assessing PFI of the spine. Methods Three conceptual groups of terms (1) PFI, (2) spinal disorder and (3) measurement properties will be combined to search Medline, EMBASE, CINAHL, Web of Science, Scopus, PEDro, OTSeeker and Health and Safety Science Abstracts. We will examine peer-reviewed, full-text articles over the full available date range. Two reviewers will independently screen citations (title, abstract and full text) and perform data extraction. Included studies will be appraised as to their methodological quality using the COnsensus-based Standards for the selection of health Measurement INstruments criteria. Findings will be summarised and presented descriptively, with meta-analysis pursued as appropriate. Ethics and dissemination This review will summarise the current level of evidence of measurement properties of instruments used for assessing PFI of the spine. Findings of this review may be applicable to clinicians, policy-makers, workers’ compensation boards, other insurers and health and safety organisations. The findings will likely provide a foundation and direction for future research priorities for assessing spinal PFI. PROSPERO registration number CRD42017060390. PMID:29374671

  15. Measurement properties of instruments assessing permanent functional impairment of the spine: a systematic review protocol.

    Science.gov (United States)

    Goes, Suelen Meira; Trask, Catherine M; Boden, Catherine; Bath, Brenna; Ribeiro, Daniel Cury; Hendrick, Paul; Clay, Lynne; Zeng, Xiaoke; Milosavljevic, Stephan

    2018-01-27

    Permanent functional impairment (PFI) of the spine is a rating system used by compensation authorities, such as workers compensation boards, to establish an appropriate level of financial compensation for persistent loss of function. Determination of PFI of the spine is commonly based on the assessment of spinal movement combined with other measures of physical and functional impairments; however, the reliability and validity of the measurement instruments used for these evaluations have yet to be established. The aim of this study is to systematically review and synthesise the literature concerning measurement properties of the various and different instruments used for assessing PFI of the spine. Three conceptual groups of terms (1) PFI, (2) spinal disorder and (3) measurement properties will be combined to search Medline, EMBASE, CINAHL, Web of Science, Scopus, PEDro, OTSeeker and Health and Safety Science Abstracts. We will examine peer-reviewed, full-text articles over the full available date range. Two reviewers will independently screen citations (title, abstract and full text) and perform data extraction. Included studies will be appraised as to their methodological quality using the COnsensus-based Standards for the selection of health Measurement INstruments criteria. Findings will be summarised and presented descriptively, with meta-analysis pursued as appropriate. This review will summarise the current level of evidence of measurement properties of instruments used for assessing PFI of the spine. Findings of this review may be applicable to clinicians, policy-makers, workers' compensation boards, other insurers and health and safety organisations. The findings will likely provide a foundation and direction for future research priorities for assessing spinal PFI. CRD42017060390. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise

  16. Is the Scale for Measuring Motivational Interviewing Skills a valid and reliable instrument for measuring the primary care professionals motivational skills?: EVEM study protocol.

    Science.gov (United States)

    Pérula, Luis Á; Campiñez, Manuel; Bosch, Josep M; Barragán Brun, Nieves; Arboniés, Juan C; Bóveda Fontán, Julia; Martín Alvarez, Remedios; Prados, Jose A; Martín-Rioboó, Enrique; Massons, Josep; Criado, Margarita; Fernández, José Á; Parras, Juan M; Ruiz-Moral, Roger; Novo, Jesús M

    2012-11-22

    Lifestyle is one of the main determinants of people's health. It is essential to find the most effective prevention strategies to be used to encourage behavioral changes in their patients. Many theories are available that explain change or adherence to specific health behaviors in subjects. In this sense the named Motivational Interviewing has increasingly gained relevance. Few well-validated instruments are available for measuring doctors' communication skills, and more specifically the Motivational Interviewing. The hypothesis of this study is that the Scale for Measuring Motivational Interviewing Skills (EVEM questionnaire) is a valid and reliable instrument for measuring the primary care professionals skills to get behavior change in patients. To test the hypothesis we have designed a prospective, observational, multi-center study to validate a measuring instrument. - Thirty-two primary care centers in Spain. -Sampling and Size: a) face and consensual validity: A group composed of 15 experts in Motivational Interviewing. b) Assessment of the psychometric properties of the scale; 50 physician- patient encounters will be videoed; a total of 162 interviews will be conducted with six standardized patients, and another 200 interviews will be conducted with 50 real patients (n=362). Four physicians will be specially trained to assess 30 interviews randomly selected to test the scale reproducibility. -Measurements for to test the hypothesis: a) Face validity: development of a draft questionnaire based on a theoretical model, by using Delphi-type methodology with experts. b) Scale psychometric properties: intraobservers will evaluate video recorded interviews: content-scalability validity (Exploratory Factor Analysis), internal consistency (Cronbach alpha), intra-/inter-observer reliability (Kappa index, intraclass correlation coefficient, Bland & Altman methodology), generalizability, construct validity and sensitivity to change (Pearson product-moment correlation

  17. Is the Scale for Measuring Motivational Interviewing Skills a valid and reliable instrument for measuring the primary care professionals motivational skills?: EVEM study protocol

    Directory of Open Access Journals (Sweden)

    Pérula Luis Á

    2012-11-01

    Full Text Available Abstract Background Lifestyle is one of the main determinants of people’s health. It is essential to find the most effective prevention strategies to be used to encourage behavioral changes in their patients. Many theories are available that explain change or adherence to specific health behaviors in subjects. In this sense the named Motivational Interviewing has increasingly gained relevance. Few well-validated instruments are available for measuring doctors’ communication skills, and more specifically the Motivational Interviewing. Methods/Design The hypothesis of this study is that the Scale for Measuring Motivational Interviewing Skills (EVEM questionnaire is a valid and reliable instrument for measuring the primary care professionals skills to get behavior change in patients. To test the hypothesis we have designed a prospective, observational, multi-center study to validate a measuring instrument. –Scope: Thirty-two primary care centers in Spain. -Sampling and Size: a face and consensual validity: A group composed of 15 experts in Motivational Interviewing. b Assessment of the psychometric properties of the scale; 50 physician- patient encounters will be videoed; a total of 162 interviews will be conducted with six standardized patients, and another 200 interviews will be conducted with 50 real patients (n=362. Four physicians will be specially trained to assess 30 interviews randomly selected to test the scale reproducibility. -Measurements for to test the hypothesis: a Face validity: development of a draft questionnaire based on a theoretical model, by using Delphi-type methodology with experts. b Scale psychometric properties: intraobservers will evaluate video recorded interviews: content-scalability validity (Exploratory Factor Analysis, internal consistency (Cronbach alpha, intra-/inter-observer reliability (Kappa index, intraclass correlation coefficient, Bland & Altman methodology, generalizability, construct validity and

  18. Developing an instrument for assessing students' concepts of the nature of technology

    Science.gov (United States)

    Liou, Pey-Yan

    2015-05-01

    Background:The nature of technology has been rarely discussed despite the fact that technology plays an essential role in modern society. It is important to discuss students' concepts of the nature of technology, and further to advance their technological literacy and adaptation to modern society. There is a need to assess high school students' concepts of the nature of technology. Purpose:This study aims to engage in discourse on students' concepts of the nature of technology based on a proposed theoretical framework. Moreover, another goal is to develop an instrument for measuring students' concepts of the nature of technology. Sample:Four hundred and fifty-five high school students' perceptions of technology were qualitatively analyzed. Furthermore, 530 students' responses to a newly developed questionnaire were quantitatively analyzed in the final test. Design and method:First, content analysis was utilized to discuss and categorize students' statements regarding technology and its related issues. The Student Concepts of the Nature of Technology Questionnaire was developed based on the proposed theoretical framework and was supported by the students' qualitative data. Finally, exploratory factor analysis and reliability analysis were applied to determine the structure of the items and the internal consistency of each scale. Results:Through a process of instrument development, the Student Concepts of the Nature of Technology Questionnaire was shown to be a valid and reliable tool for measuring students' concepts of the nature of technology. This newly developed questionnaire is composed of 29 items in six scales, namely 'technology as artifacts,' 'technology as an innovation change,' 'the current role of technology in society,' 'technology as a double-edged sword,' 'technology as a science-based form,' and 'history of technology.' Conclusions:The Student Concepts of the Nature of Technology Questionnaire has been confirmed as a reasonably valid and reliable

  19. Using Instruments for Tactical Assessment in Physical Education and Extra-Curricular Sports

    Science.gov (United States)

    Arias-Estero, José; Castejón, Francisco

    2014-01-01

    The aim was to analyse the features concerning the applicational purpose and strategy of the most common instruments used to assess game tactics both in Physical Education (PE) and in extra-curricular sport contexts. The review focused on two instruments: the Game Performance Assessment Instrument (GPAI) and the Team Sport Assessment Procedure…

  20. Using the Rasch measurement model to design a report writing assessment instrument.

    Science.gov (United States)

    Carlson, Wayne R

    2013-01-01

    This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

  1. Reliability analysis and computation of computer-based safety instrumentation and control used in German nuclear power plant. Final report

    International Nuclear Information System (INIS)

    Ding, Yongjian; Krause, Ulrich; Gu, Chunlei

    2014-01-01

    The trend of technological advancement in the field of safety instrumentation and control (I and C) leads to increasingly frequent use of computer-based (digital) control systems which consisting of distributed, connected bus communications computers and their functionalities are freely programmable by qualified software. The advantages of the new I and C system over the old I and C system with hard-wired technology are e.g. in the higher flexibility, cost-effective procurement of spare parts, higher hardware reliability (through higher integration density, intelligent self-monitoring mechanisms, etc.). On the other hand, skeptics see the new technology with the computer-based I and C a higher potential by influences of common cause failures (CCF), and the easier manipulation by sabotage (IT Security). In this joint research project funded by the Federal Ministry for Economical Affaires and Energy (BMWi) (2011-2014, FJZ 1501405) the Otto-von-Guericke-University Magdeburg and Magdeburg-Stendal University of Applied Sciences are therefore trying to develop suitable methods for the demonstration of the reliability of the new instrumentation and control systems with the focus on the investigation of CCF. This expertise of both houses shall be extended to this area and a scientific contribution to the sound reliability judgments of the digital safety I and C in domestic and foreign nuclear power plants. First, the state of science and technology will be worked out through the study of national and international standards in the field of functional safety of electrical and I and C systems and accompanying literature. On the basis of the existing nuclear Standards the deterministic requirements on the structure of the new digital I and C system will be determined. The possible methods of reliability modeling will be analyzed and compared. A suitable method called multi class binomial failure rate (MCFBR) which was successfully used in safety valve applications will be

  2. Instruments

    International Nuclear Information System (INIS)

    Buehrer, W.

    1996-01-01

    The present paper mediates a basic knowledge of the most commonly used experimental techniques. We discuss the principles and concepts necessary to understand what one is doing if one performs an experiment on a certain instrument. (author) 29 figs., 1 tab., refs

  3. Assessing Student Outcomes of Undergraduate Research with URSSA, the Undergraduate Student Self-Assessment Instrument

    Science.gov (United States)

    Laursen, S. L.; Weston, T. J.; Thiry, H.

    2012-12-01

    URSSA is the Undergraduate Research Student Self-Assessment, an online survey instrument for programs and departments to use in assessing the student outcomes of undergraduate research (UR). URSSA focuses on what students learn from their UR experience, rather than whether they liked it. The online questionnaire includes both multiple-choice and open-ended items that focus on students' gains from undergraduate research. These gains include skills, knowledge, deeper understanding of the intellectual and practical work of science, growth in confidence, changes in identity, and career preparation. Other items probe students' participation in important research-related activities that lead to these gains (e.g. giving presentations, having responsibility for a project). These activities, and the gains themselves, are based in research and thus constitute a core set of items. Using these items as a group helps to align a particular program assessment with research-demonstrated outcomes. Optional items may be used to probe particular features that are augment the research experience (e.g. field trips, career seminars, housing arrangements). The URSSA items are based on extensive, interview-based research and evaluation work on undergraduate research by our group and others. This grounding in research means that URSSA measures what we know to be important about the UR experience The items were tested with students, revised and re-tested. Data from a large pilot sample of over 500 students enabled statistical testing of the items' validity and reliability. Optional items about UR program elements were developed in consultation with UR program developers and leaders. The resulting instrument is flexible. Users begin with a set of core items, then customize their survey with optional items to probe students' experiences of specific program elements. The online instrument is free and easy to use, with numeric results available as raw data, summary statistics, cross-tabs, and

  4. Vitiligo impact scale: An instrument to assess the psychosocial burden of vitiligo

    Directory of Open Access Journals (Sweden)

    Gaurang S Krishna

    2013-01-01

    Full Text Available Background : Vitiligo is a disease that significantly impairs quality of life. Previous studies have shown that vitiligo has an impact that may not correlate with the size and extent of depigmentation, indicating a need for an independent measure of the psychosocial burden. Aims : To develop a rating scale to assess the psychosocial impact of vitiligo. Methods : The study was undertaken in three broad phases: item generation, pre- and pilot testing, and test administration. Items were generated largely from a qualitative study using semi-structured interviews of patients. Face and content validity were assessed through pre- and pilot testing in 80 patients and the final version was administered to 100 patients who also received the Dermatology Life Quality Index (DLQI and the Skindex-16. Each patient also underwent a physician global assessment (PGA of the impact of vitiligo. Test-retest reliability was assessed in 20 patients. Results: Of 72 items initially generated for the scale, 27 were retained in the final version. Subjects were able to comprehend the items and took about 5-7 min to complete the instrument. The scale was internally consistent (Cronbach′s α = 0.85. Scores on the scale correlated moderately well with the DLQI and the Skindex (Spearman rank correlation: 0.51 and 0.65, respectively. The scale was able to discriminate between patients having mild and those having moderate and severe impact as assessed by PGA. The test-retest reliability coefficient (Spearman rank correlation was 0.80. Conclusion: The Vitiligo Impact Scale appears to be a valid measure of the psychosocial impact of vitiligo and this instrument may be useful both in the clinic and in clinical trials.

  5. Human Reliability Analysis in Support of Risk Assessment for Positive Train Control

    Science.gov (United States)

    2003-06-01

    This report describes an approach to evaluating the reliability of human actions that are modeled in a probabilistic risk assessment : (PRA) of train control operations. This approach to human reliability analysis (HRA) has been applied in the case o...

  6. Inter-rater reliability of the German version of the Nurses' Global Assessment of Suicide Risk scale.

    Science.gov (United States)

    Kozel, Bernd; Grieser, Manuela; Abderhalden, Christoph; Cutcliffe, John R

    2016-10-01

    In comparison to the general population, the suicide rates of psychiatric inpatient populations in Germany and Switzerland are very high. An important preventive contribution to the lowering of the suicide rates in mental health care is to ensure that the risk of suicide of psychiatric inpatients is assessed as accurately as possible. While risk-assessment instruments can serve an important function in determining such risk, very few have been translated to German. Therefore, in the present study, we reported on the German version of Nurses' Global Assessment of Suicide Risk (NGASR) scale. After translating the original instrument into German and pretesting the German version, we tested the inter-rater reliability of the instrument. Twelve video case studies were evaluated by 13 raters with the NGASR scale in a 'laboratory' trial. In each case, the observer's agreement was calculated for the single items, the overall scale, the risk levels, and the sum scores. The statistical data analysis was conducted with kappa and AC1 statistics for dichotomous (items, scale) scales. A high-to-very high observers' agreement (AC1: 0.62-1.00, kappa: 0.00-1.00) was determined for 16 items of the German version of the NGASR scale. We conclude that the German version of the NGASR scale is a reliable instrument for evaluating risk factors for suicide. A reliable application in the clinical practise appears to be enhanced by training in the use of the instrument and the right implementation instructions. © 2016 Australian College of Mental Health Nurses Inc.

  7. Assessing environmental features related to mental health: a reliability study of visual streetscape images.

    Science.gov (United States)

    Wu, Yu-Tzu; Nash, Paul; Barnes, Linda E; Minett, Thais; Matthews, Fiona E; Jones, Andy; Brayne, Carol

    2014-10-22

    An association between depressive symptoms and features of built environment has been reported in the literature. A remaining research challenge is the development of methods to efficiently capture pertinent environmental features in relevant study settings. Visual streetscape images have been used to replace traditional physical audits and directly observe the built environment of communities. The aim of this work is to examine the inter-method reliability of the two audit methods for assessing community environments with a specific focus on physical features related to mental health. Forty-eight postcodes in urban and rural areas of Cambridgeshire, England were randomly selected from an alphabetical list of streets hosted on a UK property website. The assessment was conducted in July and August 2012 by both physical and visual image audits based on the items in Residential Environment Assessment Tool (REAT), an observational instrument targeting the micro-scale environmental features related to mental health in UK postcodes. The assessor used the images of Google Street View and virtually "walked through" the streets to conduct the property and street level assessments. Gwet's AC1 coefficients and Bland-Altman plots were used to compare the concordance of two audits. The results of conducting the REAT by visual image audits generally correspond to direct observations. More variations were found in property level items regarding physical incivilities, with broad limits of agreement which importantly lead to most of the variation in the overall REAT score. Postcodes in urban areas had lower consistency between the two methods than rural areas. Google Street View has the potential to assess environmental features related to mental health with fair reliability and provide a less resource intense method of assessing community environments than physical audits.

  8. Reliability-based Assessment of Fatigue Life for Bridges

    DEFF Research Database (Denmark)

    Toft, Henrik Stensgaard; Sørensen, John Dalsgaard

    2012-01-01

    The reliability level for bridges is discussed based on a comparison of the reliability levels proposed and used by e.g. JCSS, ISO, NKB and Eurocodes. The influence of reserve capacity by which failure of a specific detail does not lead to structural collapse is investigated. The results show...

  9. Construction of Valid and Reliable Test for Assessment of Students

    Science.gov (United States)

    Osadebe, P. U.

    2015-01-01

    The study was carried out to construct a valid and reliable test in Economics for secondary school students. Two research questions were drawn to guide the establishment of validity and reliability for the Economics Achievement Test (EAT). It is a multiple choice objective test of five options with 100 items. A sample of 1000 students was randomly…

  10. Assessment of power reliability and improvement potential by using ...

    African Journals Online (AJOL)

    This paper presents the use of smart reclosers for improving reliability of a distribution system of one of the major cities of Ethiopia. As frequent power interruptions are posing a huge problem to the life of the people and the economy, finding a solution to the problem is very essential. Electric reliability has affected social well ...

  11. A dynamic simulation model for assessing the overall impact of incentive policies on power system reliability, costs and environment

    International Nuclear Information System (INIS)

    Ibanez-Lopez, A.S.; Martinez-Val, J.M.; Moratilla-Soria, B.Y.

    2017-01-01

    The liberalization of power markets has entailed dramatic changes in power system planning worldwide. The inception of new alternative technologies, smart grids and distributed generation and storage is expected to make system planning even more challenging. Government policies still play a major role in the evolution of a country's power generation mix, even in those countries with liberalized markets. This paper presents a System Dynamics model aimed at assessing the overall technical, economic and environmental impact of renewable energy incentives and capacity payment policies. The model has been used to simulate Spain's power industry in order to assess the impact of electric power policies with the goal of getting insights regarding how to achieve an optimum power generation mix. The main conclusions of the present paper are (i) the necessity of specific regulatory actions in Spain in order to keep adequate reliability levels, avoid price spikes and boom and bust investment cycles as well as to deploy specific technologies, (ii) the fact that capacity payments are a better instrument for keeping adequate reserve margins and avoiding power price spikes than renewable energy incentives and (iii) the evidence that both instruments entail additional system costs over the base case scenario. - Highlights: • A System Dynamics model of Spain's power generation mix is proposed. • The overall policy impact on system costs, environment and reliability is assessed. • Current policies are not enough to keep adequate reliability levels. • Capacity payments are an adequate instrument for guaranteeing system reliability. • RES incentives do not solve reliability issues and entail greater system costs.

  12. Reliability assessment of Indian Point Unit 3 containment structure

    International Nuclear Information System (INIS)

    Kawakami, J.; Hwang, H.; Chang, M.T.; Reich, M.

    1984-01-01

    In the current design criteria, the load combinations specified for design of concrete containment structures are in the deterministic formats. However, by applying the probability-based reliability method developed by BNL to the concrete containment structures designed according to the criteria, it is possible to evaluate the reliability levels implied in the current design criteria. For this purpose, the reliability analysis is applied to the Indian Point Unit No. 3 containment. The details of the containment structure such as the geometries and the rebar arrangements, etc., are taken from the working drawings and the final safety analysis reports. Three kinds of loads are considered in the reliability analysis. They are, dead load (D), accidental pressure due to a large LOCA (P), and earthquake ground acceleration (E). Reliability analysis of the containment subjected to all combinations of loads is performed. Results are presented in this report

  13. Validity and reliability of instruments aimed at measuring Evidence-Based Practice in Physical Therapy: a systematic review of the literature.

    Science.gov (United States)

    Fernández-Domínguez, Juan Carlos; Sesé-Abad, Albert; Morales-Asencio, Jose Miguel; Oliva-Pascual-Vaca, Angel; Salinas-Bueno, Iosune; de Pedro-Gómez, Joan Ernest

    2014-12-01

    Our goal is to compile and analyse the characteristics - especially validity and reliability - of all the existing international tools that have been used to measure evidence-based clinical practice in physiotherapy. A systematic review conducted with data from exclusively quantitative-type studies synthesized in narrative format. An in-depth search of the literature was conducted in two phases: initial, structured, electronic search of databases and also journals with summarized evidence; followed by a residual-directed search in the bibliographical references of the main articles found in the primary search procedure. The studies included were assigned to members of the research team who acted as peer reviewers. Relevant information was extracted from each of the selected articles using a template that included the general characteristics of the instrument as well as an analysis of the quality of the validation processes carried out, by following the criteria of Terwee. Twenty-four instruments were found to comply with the review screening criteria; however, in all cases, they were found to be limited as regards the 'constructs' included. Besides, they can all be seen to be lacking as regards comprehensiveness associated to the validation process of the psychometric tests used. It seems that what constitutes a rigorously developed assessment instrument for EBP in physical therapy continues to be a challenge. © 2014 John Wiley & Sons, Ltd.

  14. Development and Testing of Screen-Based and Psychometric Instruments for Assessing Resident Performance in an Operating Room Simulator

    Directory of Open Access Journals (Sweden)

    Richard R. McNeer

    2016-01-01

    Full Text Available Introduction. Medical simulators are used for assessing clinical skills and increasingly for testing hypotheses. We developed and tested an approach for assessing performance in anesthesia residents using screen-based simulation that ensures expert raters remain blinded to subject identity and experimental condition. Methods. Twenty anesthesia residents managed emergencies in an operating room simulator by logging actions through a custom graphical user interface. Two expert raters rated performance based on these entries using custom Global Rating Scale (GRS and Crisis Management Checklist (CMC instruments. Interrater reliability was measured by calculating intraclass correlation coefficients (ICC, and internal consistency of the instruments was assessed with Cronbach’s alpha. Agreement between GRS and CMC was measured using Spearman rank correlation (SRC. Results. Interrater agreement (GRS: ICC = 0.825, CMC: ICC = 0.878 and internal consistency (GRS: alpha = 0.838, CMC: alpha = 0.886 were good for both instruments. Subscale analysis indicated that several instrument items can be discarded. GRS and CMC scores were highly correlated (SRC = 0.948. Conclusions. In this pilot study, we demonstrated that screen-based simulation can allow blinded assessment of performance. GRS and CMC instruments demonstrated good rater agreement and internal consistency. We plan to further test construct validity of our instruments by measuring performance in our simulator as a function of training level.

  15. Development of Instruments to Assess Shame and Guilt in Adolescents: Empirical Differences Between the Constructs

    Directory of Open Access Journals (Sweden)

    Lorena Maria Laskoski

    2013-05-01

    Full Text Available Shame and guilt are terms easily mixed in everyday life and often used as synonyms. Although they are words of similar use, they represent theoretically different moral emotions. The aims of this study were to develop and validate instruments to assess shame and guilt and to test the empirical independence of the constructs. Five hundred and eighty high school students from three Brazilian states participated in this study, 55% of them female, with an average age of 16.0 years. The participants answered a questionnaire containing socio demographic questions and scales designed for this study in order to assess shame and guilt. The scales developed gave appropriate evidence of validity and reliability. A single factor was extracted to assess shame and two factors to assess guilt (recognition of mistake and regret. The constructs revealed to be correlated, but independent. It is considered that there is sufficient evidence to affirm that shame and guilt are emotions with distinctive peculiarities and can be measured using the instruments developed in this research.

  16. Reliability Assessment and Reliability-Based Inspection and Maintenance of Offshore Wind Turbines

    DEFF Research Database (Denmark)

    Ramírez, José G. Rangel; Sørensen, John Dalsgaard

    2009-01-01

    Probabilistic methodologies represent an important tool to identify the suitable strategy to inspect and deal with the deterioration in structures such as offshore wind turbines (OWT). Reliability based methods such as Risk Based Inspection (RBI) planning may represent a proper methodology to opt...

  17. Reliability assessment of ballistic jump squats and bench throws.

    Science.gov (United States)

    Alemany, Joseph A; Pandorf, Clay E; Montain, Scott J; Castellani, John W; Tuckow, Alexander P; Nindl, Bradley C

    2005-02-01

    The purpose of this investigation was to determine the test-retest reliability and coefficient of variation of 2 novel physical performance tests. Ten healthy men (22.0 +/- 3.0 years, 87.0 +/- 8.0 kg, 20.0 +/- 5.0% body fat) performed 30 continuous and dynamic jump squats (JS) and bench throws (BT) on 4 separate occasions. The movements were performed under loaded conditions utilizing 30% of subject's predetermined 1 repetition maximum in the back squat and bench press. Mean power (MP; W), peak power (PP; W), mean velocity (MV; m.s(-1)), peak velocity (PV; m.s(-1)), and total work (TW; J) were assessed using a ballistic measurement system (Innervations Inc., Muncie, IN). Data were analyzed using repeated measures analysis of variance with Duncan's post hoc test when mean differences were p < or = 0.05. Intraclass correlation coefficient (ICC) and within-subject coefficient of variation (CV%) were also calculated. All values are presented as mean +/- SE. BT variables were statistically similar across the 4 sessions: MP (350.0 +/- 13.9 W), PP (431.4 +/- 18.5 W) MV (1.6 +/- 0.03 m.s(-1)), PV (2.0 +/- 0.03 m.s(-1)), and TW (199.1 +/- 7.2 J). For JS, session 3 PP (1,669.8 +/- 111.2 W) was significantly greater vs. sessions 1, 2, and 4 (1,601.2 +/- 58.4 W). Session 4 MP (1,403.2 +/- 88.6 W) and MV (1.9 +/- 0.1 m.s(-1)) for JS were significantly lower during sessions 1, 2, and 3 (MP: 1,479.4.5 +/- 44.8 W, MV: 2.0 +/- 0.05 m.s(-1)). TW (834.7 +/- 24.3 J) and PV (2.2 +/- 0.04 m.s(-1)) were statistically similar during all sessions for JS. The CVs ranged from 3.0 to 7.6% for the BT and 3.2 to 5.7% for the JS. ICCs for MP, PP, MV, PV, and TW were 0.92, 0.95, 0.94, 0.91, and 0.95, respectively, during BT. ICCs during JS for MP, PP, MV, PV, and TW were 0.96, 0.98, 0.94, 0.94, and 0.89, respectively. The results of the current study support the use of a 30 continuous and dynamic BT protocol as a reliable upper-body physical performance test, which can be administered with

  18. The Nurses Self-Concept Instrument (NSCI): assessment of psychometric properties for Australian domestic and international student nurses.

    Science.gov (United States)

    Angel, Elizabeth; Craven, Rhonda; Denson, Nida

    2012-07-01

    Professional self-concept is a critical driver of job satisfaction. In Australia, as international nursing enrolments rise, nursing is increasingly characterised by a professional body of international nurses who may differ from domestic Australian nurses in their nursing self-concept. At present, no psychometrically sound instrument for assessing nursing self-concept for Australian domestic and international nursing students is available. The purpose of this study was to: (1) develop an instrument (the Nurses' Self-Concept Instrument (NSCI)) to measure the professional self-concept of domestic and international nursing students in Australia, and (2) test the psychometric properties of this newly developed instrument. A literature review was conducted to generate the initial dimension and item pools to measure nurses' professional self-concept (NSCI). Two stakeholders examined the content and face validity of dimensions and items. Analysis was performed on data collected from 253 undergraduate nursing students in a large public university in Sydney, Australia, and consisted of domestic (n=218) and international (n=35) nursing students. Internal reliability was assessed using Cronbach's Alpha. Confirmatory factor analysis (CFA) was used to assess the construct validity of the NSCI. The resulting NSCI consisted of 14 items across four self-concept domains: care, leadership, staff relations, and knowledge. The CFA supported the hypothesised factor structure of the self-concept model. All reliabilities were acceptable for both domestic and international students (ranging from r=.78 to .93). The NSCI was shown to be a valid and reliable tool for assessing Australian domestic and international student nurses' professional self-concept. This instrument may also enable those responsible for recruitment of students into nursing courses to assess students' professional self-concept and implement appropriate strategies to foster the growth of lifelong career development

  19. Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi.

    Directory of Open Access Journals (Sweden)

    Glyn Elwyn

    Full Text Available To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids.Scale development study, involving construct, item and scale development, validation and reliability testing.There has been increasing use of decision support technologies--adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.Scale development study, involving construct, item and scale development, validation and reliability testing.Twenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi. In the fourth Stage (reliability study, eight raters assessed thirty randomly selected decision support technologies.IPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100 for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30, enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68. Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92.This work

  20. Development of the Quality of Australian Nursing Documentation in Aged Care (QANDAC) instrument to assess paper-based and electronic resident records.

    Science.gov (United States)

    Wang, Ning; Björvell, Catrin; Hailey, David; Yu, Ping

    2014-12-01

    To develop an Australian nursing documentation in aged care (Quality of Australian Nursing Documentation in Aged Care (QANDAC)) instrument to measure the quality of paper-based and electronic resident records. The instrument was based on the nursing process model and on three attributes of documentation quality identified in a systematic review. The development process involved five phases following approaches to designing criterion-referenced measures. The face and content validities and the inter-rater reliability of the instrument were estimated using a focus group approach and consensus model. The instrument contains 34 questions in three sections: completion of nursing history and assessment, description of care process and meeting the requirements of data entry. Estimates of the validity and inter-rater reliability of the instrument gave satisfactory results. The QANDAC instrument may be a useful audit tool for quality improvement and research in aged care documentation. © 2013 ACOTA.

  1. Instruments assessing attitudes toward or capability regarding self-management of osteoarthritis: a systematic review of measurement properties.

    Science.gov (United States)

    Eyles, J P; Hunter, D J; Meneses, S R F; Collins, N J; Dobson, F; Lucas, B R; Mills, K

    2017-08-01

    To make a recommendation on the "best" instrument to assess attitudes toward and/or capabilities regarding self-management of osteoarthritis (OA) based on available measurement property evidence. Electronic searches were performed in MEDLINE, EMBASE, CINAHL and PsychINFO (inception to 27 December 2016). Two reviewers independently rated measurement properties using the Consensus-based Standards for the selection of Health Measurement Instruments (COSMIN) 4-point scale. Best evidence synthesis was determined by considering COSMIN ratings for measurement property results and the level of evidence available for each measurement property of each instrument. Eight studies out of 5653 publications met the inclusion criteria, with eight instruments identified for evaluation: Multidimensional Health Locus of Control (MHLC), Perceived Behavioural Control (PBC), Patient Activation Measure (PAM), Educational Needs Assessment (ENAT), Stages of Change Questionnaire in Osteoarthritis (SCQOA), Effective Consumer Scale (EC-17) and Perceived Efficacy in Patient-Physician Interactions five item (PEPPI-5) and ten item scales. Measurement properties assessed for these instruments included internal consistency (k = 8), structural validity (k = 8), test-retest reliability (k = 2), measurement error (k = 1), hypothesis testing (k = 3) and cross-cultural validity (k = 3). No information was available for content validity, responsiveness or minimal important change (MIC)/minimal important difference (MID). The Dutch PEPPI-5 demonstrated the best measurement property evidence; strong evidence for internal consistency and structural validity but limited evidence for reliability and construct validity. Although PEPPI-5 was identified as having the best measurement properties, overall there is a poor level of evidence currently available concerning measurement properties of instruments to assess attitudes toward and/or capabilities regarding osteoarthritis self-management. Further

  2. Instruments for the assessment of physical balance in the elderly

    Directory of Open Access Journals (Sweden)

    Ricardo Oliveira Guerra

    2007-12-01

    Full Text Available Esse trabalho objetivou identifi car os instrumentos mais utilizados para avaliação do equilíbrio corporal estático, dinâmico e risco de quedas em idosos no âmbito internacional e no Brasil. O estudo foi do tipo revisão sistemática qualitativa da literatura, os trabalhos consultados foram localizados por meio de pesquisa eletrônica nas bases de dados LILACS e MEDLINE e a partir das referências bibliográfi cas citadas em artigos científi cos. Uma vez escolhidos os instrumentos, realizou-se a investigação do histórico, utilização e adaptação transcultural dos mesmos. Vários testes têm sido desenvolvidos com o objetivo de medir funcionalmente o equilíbrio e estabelecer parâmetros para identificação de idosos com maior suscetibilidade de cair. De acordo com os critérios de seleção desse trabalho, chegou-se a escolha de cinco instrumentos com as propriedades psicométricas bem estabelecidas, o Teste de Alcance Funcional (FRT, o teste “Timed Up and Go” (TUG, o Teste de Performance Física (PPT, a Escala de Equilíbrio de Berg e a porção do equilíbrio da Avaliação da Mobilidade Orientada pelo Desempenho (POMA, tendo sido apenas esses dois últimos adaptados para a língua portuguesa. Diante disso, conclui-se que focalizar a atenção apenas em sinais e sintomas dos pacientes é extremamente limitado quando se deseja decidir qual intervenção melhorará a condição funcional do idoso, portanto, a avaliação funcional é o ponto de partida para uma reabilitação efetiva nessa população. Sendo necessária a existência de instrumentos de medida adaptados e validados para a população brasileira que avaliem o domínio do equilíbrio e contribuam para uma intervenção eficaz. ABSTRACT The objective of this study was to identify the instruments that are most often used to assess seniors for static and dynamic physical balance and risk of falling, both internationally and in Brazil. This was a systematic

  3. Comparison of cough reflex test against instrumental assessment of aspiration.

    Science.gov (United States)

    Miles, Anna; Moore, Sara; McFarlane, Mary; Lee, Fiona; Allen, Jacqueline; Huckabee, Maggie-Lee

    2013-06-13

    Silent aspiration is associated with pneumonia and mortality, and is poorly identified by traditional clinical swallowing evaluation (CSE). The aim of this study was to validate cough reflex testing (CRT) for identification of silent aspiration against aspiration confirmed by instrumental assessment. Cough reflex threshold testing was completed on all patients using inhaled, nebulised citric acid. Within an hour, 80 patients underwent videofluoroscopic study of swallowing (VFSS) and 101 patients underwent fibreoptic endoscopic evaluation of swallowing (FEES). All tests were recorded and analysed by two researchers blinded to the result of the alternate test. Significant associations between CRT result and cough response to aspiration on VFSS (X(2) (2)=11.046, p=.003) and FEES (X(2) (2)=34.079, pacid provide a better predictive measure of silent aspiration. Copyright © 2013 Elsevier Inc. All rights reserved.

  4. The MacArthur Competence Assessment Tool-Fitness to Plead: a preliminary evaluation of a research instrument for assessing fitness to plead in England and Wales.

    Science.gov (United States)

    Akinkunmi, Akintunde A

    2002-01-01

    This study concerns the preliminary evaluation of an instrument, the MacArthur Competence Assessment Tool-Fitness to Plead (MacCAT-FP), for assessing competence to stand trial, according to the legal requirements in England and Wales. The purposes of the study were to ascertain whether the instrument can be administered practically to groups of prisoners, both those with mental illness and those without; to examine its internal consistency and interrater reliability; to determine whether it can distinguish between fit and unfit individuals, as judged by expert forensic psychiatrists; and to discover whether it is sensitive to changes over time. The instrument was administered to two groups of remanded prisoners: those transferred to psychiatric units for treatment and those without mental illness. In addition to the MacCAT-FP, scales measuring symptom severity and IQ were administered to all participants. Results suggest that the instrument is practical, with good internal consistency and interrater reliability. The correlation of scores with psychiatrists' opinions as to fitness was 0.77. Scores of unfit patients were significantly different from those of fit individuals. The instrument was able to detect significant differences in scores over time. It is suggested that once the instrument has been further validated for research purposes, it may be developed for clinical application.

  5. Instrumentation

    International Nuclear Information System (INIS)

    Muehllehner, G.; Colsher, J.G.

    1982-01-01

    This chapter reviews the parameters which are important to positron-imaging instruments. It summarizes the options which various groups have explored in designing tomographs and the methods which have been developed to overcome some of the limitations inherent in the technique as well as in present instruments. The chapter is not presented as a defense of positron imaging versus single-photon or other imaging modality, neither does it contain a description of various existing instruments, but rather stresses their common properties and problems. Design parameters which are considered are resolution, sampling requirements, sensitivity, methods of eliminating scattered radiation, random coincidences and attenuation. The implementation of these parameters is considered, with special reference to sampling, choice of detector material, detector ring diameter and shielding and variations in point spread function. Quantitation problems discussed are normalization, and attenuation and random corrections. Present developments mentioned are noise reduction through time-of-flight-assisted tomography and signal to noise improvements through high intrinsic resolution. Extensive bibliography. (U.K.)

  6. Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills.

    Science.gov (United States)

    Gustin, Jillian L; Way, David P; Wells-Di Gregorio, Sharla; McCallister, Jennifer W

    2016-08-01

    Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings. We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC. We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity. Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC

  7. Network reliability assessment using a cellular automata approach

    International Nuclear Information System (INIS)

    Rocco S, Claudio M.; Moreno, Jose Ali

    2002-01-01

    Two cellular automata (CA) models that evaluate the s-t connectedness and shortest path in a network are presented. CA based algorithms enhance the performance of classical algorithms, since they allow a more reliable and straightforward parallel implementation resulting in a dynamic network evaluation, where changes in the connectivity and/or link costs can readily be incorporated avoiding recalculation from scratch. The paper also demonstrates how these algorithms can be applied for network reliability evaluation (based on Monte-Carlo approach) and for finding s-t path with maximal reliability

  8. A method to assign failure rates for piping reliability assessments

    International Nuclear Information System (INIS)

    Gamble, R.M.; Tagart, S.W. Jr.

    1991-01-01

    This paper reports on a simplified method that has been developed to assign failure rates that can be used in reliability and risk studies of piping. The method can be applied on a line-by-line basis by identifying line and location specific attributes that can lead to piping unreliability from in-service degradation mechanisms and random events. A survey of service experience for nuclear piping reliability also was performed. The data from this survey provides a basis for identifying in-service failure attributes and assigning failure rates for risk and reliability studies

  9. Peer-Assessment Debriefing Instrument (PADI): Assessing Faculty Effectiveness in Simulation Education.

    Science.gov (United States)

    Saylor, Jennifer L; Wainwright, Susan F; Herge, E A; Pohlig, Ryan T

    2016-01-01

    Evaluating the debriefing skill of faculty in simulations is essential but often challenging. The Peer Assessment Debriefing Instrument (PADI) is a self and peer assessment designed to assess a debriefers' effectiveness and is grounded in current scientific debriefing literature and peer review methodology. This pilot study tested the PADI at three institutions during 10 different healthcare debriefing sessions. The PADI is useful to faculty and administrators of simulation centers by demonstrating ongoing quality improvement and as a guide to train new debriefers.

  10. Condition-based Human Reliability Assessment for digitalized control room

    International Nuclear Information System (INIS)

    Kang, H. G.; Jang, S. C.; Eom, H. S.; Ha, J. J.

    2005-04-01

    In safety-critical systems, the generation failure of an actuation signal is caused by the concurrent failures of the automated systems and an operator action. These two sources of safety signals are complicatedly correlated. The failures of sensors or automated systems will cause a lack of necessary information for a human operator and result in error-forcing contexts such as the loss of corresponding alarms and indications. In the conventional analysis, the Human Error Probabilities (HEP) are estimated based on the assumption of 'normal condition of indications and alarms'. In order to construct a more realistic signal-generation failure model, we have to consider more complicated conditions in a more realistic manner. In this study, we performed two kinds of investigation for addressing this issue. We performed the analytic calculations for estimating the effect of sensors failures on the system unavailability and plant risk. For the single-parameter safety signals, the analysis result reveals that the quantification of the HEP should be performed by focusing on the 'no alarm from the automatic system and corresponding indications unavailable' situation. This study also proposes a Condition-Based Human Reliability Assessment (CBHRA) method in order to address these complicated conditions in a practical way. We apply the CBHRA method to the manual actuation of the safety features such as a reactor trip and auxiliary feedwater actuation in Korean Standard Nuclear Power Plants. In the case of conventional single HEP method, it is very hard to consider the multiple HE conditions. The merit of CBHRA is clearly shown in the application to the AFAS generation where no dominating HE condition exits. In this case, even if the HE conditions are carefully investigated, the single HEP method cannot accommodate the multiple conditions in a fault tree. On the other hand, the application result of the reactor trip in SLOCA shows that if there is a dominating condition, the use

  11. The spiritual distress assessment tool: an instrument to assess spiritual distress in hospitalised elderly persons

    Directory of Open Access Journals (Sweden)

    Martin Estelle

    2010-12-01

    Full Text Available Abstract Background Although spirituality is usually considered a positive resource for coping with illness, spiritual distress may have a negative influence on health outcomes. Tools are needed to identify spiritual distress in clinical practice and subsequently address identified needs. This study describes the first steps in the development of a clinically acceptable instrument to assess spiritual distress in hospitalized elderly patients. Methods A three-step process was used to develop the Spiritual Distress Assessment Tool (SDAT: 1 Conceptualisation by a multidisciplinary group of a model (Spiritual Needs Model to define the different dimensions characterizing a patient's spirituality and their corresponding needs; 2 Operationalisation of the Spiritual Needs Model within geriatric hospital care leading to a set of questions (SDAT investigating needs related to each of the defined dimensions; 3 Qualitative assessment of the instrument's acceptability and face validity in hospital chaplains. Results Four dimensions of spirituality (Meaning, Transcendence, Values, and Psychosocial Identity and their corresponding needs were defined. A formalised assessment procedure to both identify and subsequently score unmet spiritual needs and spiritual distress was developed. Face validity and acceptability in clinical practice were confirmed by chaplains involved in the focus groups. Conclusions The SDAT appears to be a clinically acceptable instrument to assess spiritual distress in elderly hospitalised persons. Studies are ongoing to investigate the psychometric properties of the instrument and to assess its potential to serve as a basis for integrating the spiritual dimension in the patient's plan of care.

  12. Structural Reliability Methods for Wind Power Converter System Component Reliability Assessment

    DEFF Research Database (Denmark)

    Kostandyan, Erik; Sørensen, John Dalsgaard

    2012-01-01

    Wind power converter systems are essential subsystems in both off-shore and on-shore wind turbines. It is the main interface between generator and grid connection. This system is affected by numerous stresses where the main contributors might be defined as vibration and temperature loadings....... The temperature variations induce time-varying stresses and thereby fatigue loads. A probabilistic model is used to model fatigue failure for an electrical component in the power converter system. This model is based on a linear damage accumulation and physics of failure approaches, where a failure criterion...... is defined by the threshold model. The attention is focused on crack propagation in solder joints of electrical components due to the temperature loadings. Structural Reliability approaches are used to incorporate model, physical and statistical uncertainties. Reliability estimation by means of structural...

  13. Reliability and Probabilistic Risk Assessment - How They Play Together

    Science.gov (United States)

    Safie, Fayssal M.; Stutts, Richard; Huang, Zhaofeng

    2015-01-01

    The objective of this presentation is to discuss the PRA process and the reliability engineering discipline, their differences and similarities, and how they are used as complimentary analyses to support design and flight decisions.

  14. Briefer assessment of social network drinking: A test of the Important People Instrument-5 (IP-5).

    Science.gov (United States)

    Hallgren, Kevin A; Barnett, Nancy P

    2016-12-01

    The Important People instrument (IP; Longabaugh et al., 2010) is one of the most commonly used measures of social network drinking. Although its reliability and validity are well-supported, the length of the instrument may limit its use in many settings. The present study evaluated whether a briefer, 5-person version of the IP (IP-5) adequately reproduces scores from the full IP. College freshmen (N = 1,053) reported their own past-month drinking, alcohol-related consequences, and information about drinking in their close social networks at baseline and 1 year later. From this we derived network members' drinking frequency, percentage of drinkers, and percentage of heavy drinkers, assessed for up to 10 (full IP) or 5 (IP-5) network members. We first modeled the expected concordance between full-IP scores and scores from simulated shorter IP instruments by sampling smaller subsets of network members from full IP data. Then, using quasi-experimental methods, we administered the full IP and IP-5 and compared the 2 instruments' score distributions and concurrent and year-lagged associations with participants' alcohol consumption and consequences. Most of the full-IP variance was reproduced from simulated shorter versions of the IP (ICCs ≥ 0.80). The full IP and IP-5 yielded similar score distributions, concurrent associations with drinking (r = 0.22 to 0.52), and year-lagged associations with drinking. The IP-5 retains most of the information about social network drinking from the full IP. The shorter instrument may be useful in clinical and research settings that require frequent measure administration, yielding greater temporal resolution for monitoring social network drinking. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  15. Research on the evaluation model of the software reliability in nuclear safety class digital instrumentation and control system

    International Nuclear Information System (INIS)

    Liu Ying; Yang Ming; Li Fengjun; Ma Zhanguo; Zeng Hai

    2014-01-01

    In order to analyze the software reliability (SR) in nuclear safety class digital instrumentation and control system (D-I and C), firstly, the international software design standards were analyzed, the standards' framework was built, and we found that the D-I and C software standards should follow the NUREG-0800 BTP7-14, according to the NRC NUREG-0800 review of requirements. Secondly, the quantitative evaluation model of SR using Bayesian Belief Network and thirteen sub-model frameworks were established. Thirdly, each sub-models and the weight of corresponding indexes in the evaluation model were analyzed. Finally, the safety case was introduced. The models lay a foundation for review and quantitative evaluation on the SR in nuclear safety class D-I and C. (authors)

  16. Job analysis of the instrument and control technician position for the nuclear power plant maintenance personnel reliability model

    International Nuclear Information System (INIS)

    Siegel, A.I.; Bartter, W.D.; Federman, P.J.

    1983-08-01

    This report is one of a series that is planned to describe the results of a program undertaken by the Oak Ridge National Laboratory (ORNL) for the US Nuclear Regulatory Commission, Office of Nuclear Regulatory Research, to define, develop, validate, and disseminate a methodology for the quantitative prediction of human reliability in the conduct of maintenance tasks in nuclear power plants (NPPs). ORNL has subcontracted portions of this effort to Applied Psychological Services, Inc. This report on the job analysis of the Instrument and Control technician (NUREG/CR-3274) and a report on the job analysis of the electrician position (NUREG/CR-3275) comprise a part of the initial efforts of the development phase of this program. With the publication of the job analysis of the electrician position, the series of job analyses reports addressing nuclear power plant maintenance personnel will be complete. Subsequent reports addressing model development and validation are planned

  17. Assessment and Improving Methods of Reliability Indices in Bakhtar Regional Electricity Company

    Directory of Open Access Journals (Sweden)

    Saeed Shahrezaei

    2013-04-01

    Full Text Available Reliability of a system is the ability of a system to do prospected duties in future and the probability of desirable operation for doing predetermined duties. Power system elements failures data are the main data of reliability assessment in the network. Determining antiseptic parameters is the goal of reliability assessment by using system history data. These parameters help to recognize week points of the system. In other words, the goal of reliability assessment is operation improving and decreasing of the failures and power outages. This paper is developed to assess reliability indices of Bakhtar Regional Electricity Company up to 1393 and the improving methods and their effects on the reliability indices in this network. DIgSILENT Power Factory software is employed for simulation. Simulation results show the positive effect of improving methods in reliability indices of Bakhtar Regional Electricity Company.

  18. Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

    Science.gov (United States)

    Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

    2017-06-01

    Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in

  19. Assessing the potential of economic instruments for managing drought risk at river basin scale

    Science.gov (United States)

    Pulido-Velazquez, M.; Lopez-Nicolas, A.; Macian-Sorribes, H.

    2015-12-01

    Economic instruments work as incentives to adapt individual decisions to collectively agreed goals. Different types of economic instruments have been applied to manage water resources, such as water-related taxes and charges (water pricing, environmental taxes, etc.), subsidies, markets or voluntary agreements. Hydroeconomic models (HEM) provide useful insight on optimal strategies for coping with droughts by simultaneously analysing engineering, hydrology and economics of water resources management. We use HEMs for evaluating the potential of economic instruments on managing drought risk at river basin scale, considering three criteria for assessing drought risk: reliability, resilience and vulnerability. HEMs allow to calculate water scarcity costs as the economic losses due to water deliveries below the target demands, which can be used as a vulnerability descriptor of drought risk. Two generic hydroeconomic DSS tools, SIMGAMS and OPTIGAMS ( both programmed in GAMS) have been developed to evaluate water scarcity cost at river basin scale based on simulation and optimization approaches. The simulation tool SIMGAMS allocates water according to the system priorities and operating rules, and evaluate the scarcity costs using economic demand functions. The optimization tool allocates water resources for maximizing net benefits (minimizing total water scarcity plus operating cost of water use). SIMGAS allows to simulate incentive water pricing policies based on water availability in the system (scarcity pricing), while OPTIGAMS is used to simulate the effect of ideal water markets by economic optimization. These tools have been applied to the Jucar river system (Spain), highly regulated and with high share of water use for crop irrigation (greater than 80%), where water scarcity, irregular hydrology and groundwater overdraft cause droughts to have significant economic, social and environmental consequences. An econometric model was first used to explain the variation

  20. Reliability assessment of Port Harcourt 33/11kv Distribution System ...

    African Journals Online (AJOL)

    This makes reliability studies an important task besides all the other analyses required for assessing the system performance. The paper presents an analytical approach in the reliability assessment of the Port Harcourt 33/11kV power distribution system. The assessment was performed with the 2009 power outage data ...

  1. The Functional Living Index-Cancer is a reliable and valid instrument in Chinese cancer patients.

    Science.gov (United States)

    Fong, Daniel Y T; Lee, Alvina H K; Tung, Stewart Y; Wong, Janet Y H; Chan, Y M; Goh, Cynthia R; Cheung, Y B

    2014-02-01

    To evaluate the linguistic and psychometric properties of the Functional Living Index-Cancer (FLIC) in assessing the quality of life of Chinese cancer patients. The English FLIC was translated into Traditional Chinese by the standard forward-backward procedure. After cognitive debriefing, a Traditional Chinese FLIC was administered to 500 cancer patients in a major public hospital in Hong Kong. Of which, 200 were invited to complete the questionnaire in 2 weeks. To identify a scale structure appropriate to Chinese, exploratory and confirmatory factor analyses were performed on two randomly split halves of the sample. We identified five scales of the Traditional Chinese FLIC which assess the physical, psychological, hardship, nausea and social aspects. These five scales and the overall scale demonstrated satisfactory fit and had the alpha coefficient ranged from 0.68 to 0.92. The intra-class correlation coefficient ranged from 0.67 to 0.88. In addition, all FLIC scales were negatively associated with the Eastern Cooperative Oncology Group performance status and, also except for the psychological scale, had lower scores in patients who were treated by chemotherapy. The Traditional Chinese FLIC is an appropriate health indicator for Chinese cancer patients.

  2. [Caregiving consequences in mental disorders--definitions and instruments of assessment].

    Science.gov (United States)

    Ciałkowska-Kuźmińska, Magdalena; Kiejna, Andrzej

    2010-01-01

    Severe mental illnesses have far-reaching consequences for both patients and their relatives. This paper reviews literature on the measures of caregiving consequences. Authors provide a condensed knowledge and research results in the area of caregiving consequences, especially both subjective and objective caregivers' burden. The consequences of care apply to carers' social and leisure activities, financial status, health condition. The burden of care has three fundamental causes: the reorganisation of mental health services, a social isolation of patients and their families and the lack of systemic support for caregivers. The problem of caregiving consequences has been investigated in several studies. In order to identify factors, which have impact on caregiver distress, a variety instruments have been developed. This paper focuses on questionnaires useful for the systematic assessment of both objective an