WorldWideScience

Sample records for assessing computer skills

  1. Assessing computer skills in Tanzanian medical students: an elective experience

    Directory of Open Access Journals (Sweden)

    Melvin Rob

    2004-08-01

    Full Text Available Abstract Background One estimate suggests that by 2010 more than 30% of a physician's time will be spent using information technology tools. The aim of this study is to assess the information and communication technologies (ICT skills of medical students in Tanzania. We also report a pilot intervention of peer mentoring training in ICT by medical students from the UK tutoring students in Tanzania. Methods Design: Cross sectional study and pilot intervention study. Participants: Fourth year medical students (n = 92 attending Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania. Main outcome measures: Self-reported assessment of competence on ICT-related topics and ability to perform specific ICT tasks. Further information related to frequency of computer use (hours per week, years of computer use, reasons for use and access to computers. Skills at specific tasks were reassessed for 12 students following 4 to 6 hours of peer mentoring training. Results The highest levels of competence in generic ICT areas were for email, Internet and file management. For other skills such as word processing most respondents reported low levels of competence. The abilities to perform specific ICT skills were low – less than 60% of the participants were able to perform the core specific skills assessed. A period of approximately 5 hours of peer mentoring training produced an approximate doubling of competence scores for these skills. Conclusion Our study has found a low level of ability to use ICT facilities among medical students in a leading university in sub-Saharan Africa. A pilot scheme utilising UK elective students to tutor basic skills showed potential. Attention is required to develop interventions that can improve ICT skills, as well as computer access, in order to bridge the digital divide.

  2. Assessment of medical communication skills by computer: assessment method and student experiences

    NARCIS (Netherlands)

    Hulsman, R. L.; Mollema, E. D.; Hoos, A. M.; de Haes, J. C. J. M.; Donnison-Speijer, J. D.

    2004-01-01

    BACKGROUND A computer-assisted assessment (CAA) program for communication skills designated ACT was developed using the objective structured video examination (OSVE) format. This method features assessment of cognitive scripts underlying communication behaviour, a broad range of communication

  3. Teaching and Assessing Teamwork Skills in Engineering and Computer Science

    Directory of Open Access Journals (Sweden)

    Robert W. Lingard

    2010-02-01

    Full Text Available To be successful in today's workplace, engineering and computer science students must possess high levels of teamwork skills. Unfortunately, most engineering programs provide little or no specific instruction in this area. This paper outlines an assessment-driven approach toward teaching teamwork skills. Working with the Industrial Advisory Board for the College, a set of performance criteria for teamwork was developed. This set of criteria was used to build an assessment instrument to measure the extent to which students are able to achieve the necessary skills. This set of criteria provides a clear basis for the development of an approach toward teaching teamwork skills. Furthermore, the results from the assessment can be used to adjust the teaching techniques to address the particular skills where students show some weaknesses. Although this effort is in the early stages, the approach seems promising and will be improved over time.

  4. Does Computer-Based Motor Skill Assessment Training Transfer to Live Assessing?

    Science.gov (United States)

    Kelly, Luke E.; Taliaferro, Andrea; Krause, Jennifer

    2012-01-01

    Developing competency in motor skill assessment has been identified as a critical need in physical educator preparation. We conducted this study to evaluate (a) the effectiveness of a web-based instructional program--Motor Skill Assessment Program (MSAP)--for developing assessment competency, and specifically (b) whether competency developed by…

  5. Computer skills for the next generation of healthcare executives.

    Science.gov (United States)

    Côté, Murray J; Van Enyde, Donald F; DelliFraine, Jami L; Tucker, Stephen L

    2005-01-01

    Students beginning a career in healthcare administration must possess an array of professional and management skills in addition to a strong fundamental understanding of the field of healthcare administration. Proficient computer skills are a prime example of an essential management tool for healthcare administrators. However, it is unclear which computer skills are absolutely necessary for healthcare administrators and the extent of congruency between the computer skills possessed by new graduates and the needs of senior healthcare professionals. Our objectives in this research are to assess which computer skills are the most important to senior healthcare executives and recent healthcare administration graduates and examine the level of agreement between the two groups. Based on a survey of senior healthcare executives and graduate healthcare administration students, we identify a comprehensive and pragmatic array of computer skills and categorize them into four groups, according to their importance, for making recent health administration graduates valuable in the healthcare administration workplace. Traditional parametric hypothesis tests are used to assess congruency between responses of senior executives and of recent healthcare administration graduates. For each skill, responses of the two groups are averaged to create an overall ranking of the computer skills. Not surprisingly, both groups agreed on the importance of computer skills for recent healthcare administration graduates. In particular, computer skills such as word processing, graphics and presentation, using operating systems, creating and editing databases, spreadsheet analysis, using imported data, e-mail, using electronic bulletin boards, and downloading information were among the highest ranked computer skills necessary for recent graduates. However, there were statistically significant differences in perceptions between senior executives and healthcare administration students as to the extent

  6. Assessing Practical Skills in Physics Using Computer Simulations

    Science.gov (United States)

    Walsh, Kevin

    2018-01-01

    Computer simulations have been used very effectively for many years in the teaching of science but the focus has been on cognitive development. This study, however, is an investigation into the possibility that a student's experimental skills in the real-world environment can be judged via the undertaking of a suitably chosen computer simulation…

  7. A content validity approach to creating an end-user computer skill assessment tool

    Directory of Open Access Journals (Sweden)

    Shirley Gibbs

    Full Text Available Practical assessment instruments are commonly used in the workplace and educational environments to assess a person\\'s level of digital literacy and end-user computer skill. However, it is often difficult to find statistical evidence of the actual validity of instruments being used. To ensure that the correct factors are being assessed for a particular purpose it is necessary to undertake some type of psychometric testing, and the first step is to study the content relevance of the measure. The purpose of this paper is to report on the rigorous judgment-quantification process using panels of experts in order to establish inter-rater reliability and agreement in the development of end-user instruments developed to measure workplace skills using spreadsheet and word-processing applications.

  8. Improving visual skills: II-remote assessment via Internet.

    Science.gov (United States)

    Powers, Maureen K; Grisham, J David; Wurm, Janice K; Wurm, William C

    2009-02-01

    Even though poor readers often have poor visual skills, such as binocular coordination and oculomotor control, students' visual skills are rarely assessed. Computer assessments have the potential to assist in identifying students whose visual skills are deficient. This study compared assessments made by an Internet-based computer orthoptics program with those of an on-site vision therapist. Students (N = 41) in grades 1 through 8, reading at least 2 levels below grade, were assessed for visual skill dysfunction (including binocular fusion and tracking ability) by a vision therapist at their school in Wisconsin. The therapist determined whether the student had adequate visual skills based on clinical and behavioral observations. A "remote" investigator located in California determined the adequacy of accommodative facility, tracking, and vergence skills in the same students, based on quantitative progress through the modules of an Internet-based computer orthoptics training program during 3 assessment sessions. The on-site therapist made 33 referrals for possible visual skills training (80%). The remote investigator made 25 referrals (61%), all of which were consistent with referrals made by the on-site therapist; thus, no false-positives occurred when using the remote assessment technique. The 8 additional referrals by the therapist were attributed to the ability to observe student behavior during assessment. Remote assessment of visual skills via an Internet orthoptics program may provide a simple means to detect visual skill problems experienced by poor readers.

  9. Computer games and fine motor skills.

    Science.gov (United States)

    Borecki, Lukasz; Tolstych, Katarzyna; Pokorski, Mieczyslaw

    2013-01-01

    The study seeks to determine the influence of computer games on fine motor skills in young adults, an area of incomplete understanding and verification. We hypothesized that computer gaming could have a positive influence on basic motor skills, such as precision, aiming, speed, dexterity, or tremor. We examined 30 habitual game users (F/M - 3/27; age range 20-25 years) of the highly interactive game Counter Strike, in which players impersonate soldiers on a battlefield, and 30 age- and gender-matched subjects who declared never to play games. Selected tests from the Vienna Test System were used to assess fine motor skills and tremor. The results demonstrate that the game users scored appreciably better than the control subjects in all tests employed. In particular, the players did significantly better in the precision of arm-hand movements, as expressed by a lower time of errors, 1.6 ± 0.6 vs. 2.8 ± 0.6 s, a lower error rate, 13.6 ± 0.3 vs. 20.4 ± 2.2, and a shorter total time of performing a task, 14.6 ± 2.9 vs. 32.1 ± 4.5 s in non-players, respectively; p computer games on psychomotor functioning. We submit that playing computer games may be a useful training tool to increase fine motor skills and movement coordination.

  10. The Cognitive Predictors of Computational Skill with Whole versus Rational Numbers: An Exploratory Study.

    Science.gov (United States)

    Seethaler, Pamela M; Fuchs, Lynn S; Star, Jon R; Bryant, Joan

    2011-10-01

    The purpose of the present study was to explore the 3(rd)-grade cognitive predictors of 5th-grade computational skill with rational numbers and how those are similar to and different from the cognitive predictors of whole-number computational skill. Students (n = 688) were assessed on incoming whole-number calculation skill, language, nonverbal reasoning, concept formation, processing speed, and working memory in the fall of 3(rd) grade. Students were followed longitudinally and assessed on calculation skill with whole numbers and with rational numbers in the spring of 5(th) grade. The unique predictors of skill with whole-number computation were incoming whole-number calculation skill, nonverbal reasoning, concept formation, and working memory (numerical executive control). In addition to these cognitive abilities, language emerged as a unique predictor of rational-number computational skill.

  11. Computer Skills Training and Readiness to Work with Computers

    Directory of Open Access Journals (Sweden)

    Arnon Hershkovitz

    2016-05-01

    Full Text Available In today’s job market, computer skills are part of the prerequisites for many jobs. In this paper, we report on a study of readiness to work with computers (the dependent variable among unemployed women (N=54 after participating in a unique, web-supported training focused on computer skills and empowerment. Overall, the level of participants’ readiness to work with computers was much higher at the end of the course than it was at its begin-ning. During the analysis, we explored associations between this variable and variables from four categories: log-based (describing the online activity; computer literacy and experience; job-seeking motivation and practice; and training satisfaction. Only two variables were associated with the dependent variable: knowledge post-test duration and satisfaction with content. After building a prediction model for the dependent variable, another log-based variable was highlighted: total number of actions in the course website along the course. Overall, our analyses shed light on the predominance of log-based variables over variables from other categories. These findings might hint at the need of developing new assessment tools for learners and trainees that take into consideration human-computer interaction when measuring self-efficacy variables.

  12. Students Computer Skills in Faculty of Education

    Directory of Open Access Journals (Sweden)

    Mehmet Caglar

    2010-09-01

    Full Text Available Nowadays; the usage of technology is not a privilege but an obligation. Technological developments influence structures andfunctions of educational institutions. It is also expected from the teachers that they integrate technology in their lessons inorder to educate the individuals of information society. This research has covered 145(68 female, 78 male students, studying inNear East University Faculty of Education. The Computer Skills Scale developed by Güçlü (2010 was used as a data collectingtool. Data were analysed using SPSS software program. In this study, students’ computer skills were investigated; the variationsin the relationships between computer skills and (a gender, (b family’s net monthly income, (c presence of computers athome, (d presence of a computer laboratory at school and (e parents’ computer skills were examined. Frequency analysis,percentage and mean calculations were used. In addition, t-test and multi-variate analysis were used to look at the relationshipbetween different variables. As a result of this study, a statistically significant relationship between computer skills of studentswho had a computer at home and computer skills of those who didn’t have a computer at home were found.

  13. Zoo U: A Stealth Approach to Social Skills Assessment in Schools

    Directory of Open Access Journals (Sweden)

    Melissa E. DeRosier

    2012-01-01

    Full Text Available This paper describes the design and evaluation of Zoo U, a novel computer game to assess children’s social skills development. Zoo U is an innovative product that combines theory-driven content and customized game mechanics. The game-like play creates the opportunity for stealth assessment, in which dynamic evidence of social skills is collected in real time and players’ choices during gameplay provide the needed data. To ensure the development of an engaging and valid game, we utilized an iterative data-driven validation process in which the game was created, tested, revised based on student performance and feedback, and retested until game play was statistically matched to independent ratings of social skills. We first investigated whether the data collected through extensive logging of student actions provided information that could be used to improve the assessment. We found that detailed game logs of socially relevant player behavior combined with external measures of player social skills provided an efficient vector to incrementally improve the accuracy of the embedded assessments. Next, we investigated whether the game performance correlated with teachers’ assessments of students’ social skills competencies. An evaluation of the final game showed (a significant correlations between in-game social skills assessments and independently obtained standard psychological assessments of the same students and (b high levels of engagement and likeability for students. These findings support the use of the interactive and engaging computer game format for the stealth assessment of children’s social skills. The created innovative design methodologies should prove useful in the design and improvement of computer games in education.

  14. The Cognitive Predictors of Computational Skill with Whole versus Rational Numbers: An Exploratory Study

    Science.gov (United States)

    Seethaler, Pamela M.; Fuchs, Lynn S.; Star, Jon R.; Bryant, Joan

    2011-01-01

    The purpose of the present study was to explore the 3rd-grade cognitive predictors of 5th-grade computational skill with rational numbers and how those are similar to and different from the cognitive predictors of whole-number computational skill. Students (n=688) were assessed on incoming whole-number calculation skill, language, nonverbal…

  15. Improving the Teaching of Teamwork Skills in Engineering and Computer Science

    Directory of Open Access Journals (Sweden)

    Robert W. Lingard

    2010-12-01

    Full Text Available It is important that engineering and computer science students learn teamwork skills as an integral part of their educational development. These skills are often not explicitly taught, but rather it is expected that students learn them on their own through participation in various team projects. Furthermore, the actual skills that students are expected to learn are usually not well articulated, or even understood. The approach outlined here attempts to address these problems by first establishing a process for defining what is meant by teamwork, by using this definition to assess the extent to which students are learning teamwork skills, and by using the assessment results to formulate approaches to improve student learning with respect to these skills. Specific attempts at the definition, assessment, and instruction improvement process are discussed.

  16. Skill and independence weighting for multi-model assessments

    International Nuclear Information System (INIS)

    Sanderson, Benjamin M.; Wehner, Michael; Knutti, Reto

    2017-01-01

    We present a weighting strategy for use with the CMIP5 multi-model archive in the fourth National Climate Assessment, which considers both skill in the climatological performance of models over North America as well as the inter-dependency of models arising from common parameterizations or tuning practices. The method exploits information relating to the climatological mean state of a number of projection-relevant variables as well as metrics representing long-term statistics of weather extremes. The weights, once computed can be used to simply compute weighted means and significance information from an ensemble containing multiple initial condition members from potentially co-dependent models of varying skill. Two parameters in the algorithm determine the degree to which model climatological skill and model uniqueness are rewarded; these parameters are explored and final values are defended for the assessment. The influence of model weighting on projected temperature and precipitation changes is found to be moderate, partly due to a compensating effect between model skill and uniqueness. However, more aggressive skill weighting and weighting by targeted metrics is found to have a more significant effect on inferred ensemble confidence in future patterns of change for a given projection.

  17. Critical Emergency Medicine Procedural Skills: A Comparative Study of Methods for Teaching and Assessment.

    Science.gov (United States)

    Chapman, Dane M.; And Others

    Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

  18. Two Thinking Skills Assessment Approaches: "Assessment of Pupils' Thinking Skills" and "Individual Thinking Skills Assessments"

    Science.gov (United States)

    Burke, Lynsey A.; Williams, Joanne M.

    2012-01-01

    This paper is linked to a previous paper outlining an evaluation of a thinking skills intervention (Burke & Williams, 2008). Following extensive requests for the assessment tools used in the intervention, this short paper presents the development and potential uses of two thinking skills assessment tools. The aim of the paper is simply to make…

  19. Skills and the appreciation of computer art

    Science.gov (United States)

    Boden, Margaret A.

    2016-04-01

    The appreciation of art normally includes recognition of the artist's skills in making it. Most people cannot appreciate computer art in that way, because they know little or nothing about coding. Various suggestions are made about how computer artists and/or curators might design and present computer art in such a way as to make the relevant making-skills more intelligible.

  20. A computer-based feedback only intervention with and without a moderation skills component.

    Science.gov (United States)

    Weaver, Cameron C; Leffingwell, Thad R; Lombardi, Nathaniel J; Claborn, Kasey R; Miller, Mary E; Martens, Matthew P

    2014-01-01

    Research on the efficacy of computer-delivered feedback-only interventions (FOIs) for college alcohol misuse has been mixed. Limitations to these FOIs include participant engagement and variation in the use of a moderation skills component. The current investigation sought to address these limitations using a novel computer-delivered FOI, the Drinkers Assessment and Feedback Tool for College Students (DrAFT-CS). Heavy drinking college students (N=176) were randomly assigned to DrAFT-CS, DrAFT-CS plus moderation skills (DrAFT-CS+), moderation skills only (MSO), or assessment only (AO) group, and were assessed at 1-month follow-up (N=157). Participants in the DrAFT-CS and DrAFT-CS+groups reported significantly lower estimated blood alcohol concentrations (eBACs) on typical heaviest drinking day than participants in the AO group. The data also supported the incorporation of a moderation skills component within FOIs, such that participants in DrAFT-CS+group reported significantly fewer drinks per week and drinks per heaviest drinking occasion than participants in the AO group. © 2013.

  1. Assessing computational genomics skills: Our experience in the H3ABioNet African bioinformatics network.

    Science.gov (United States)

    Jongeneel, C Victor; Achinike-Oduaran, Ovokeraye; Adebiyi, Ezekiel; Adebiyi, Marion; Adeyemi, Seun; Akanle, Bola; Aron, Shaun; Ashano, Efejiro; Bendou, Hocine; Botha, Gerrit; Chimusa, Emile; Choudhury, Ananyo; Donthu, Ravikiran; Drnevich, Jenny; Falola, Oluwadamila; Fields, Christopher J; Hazelhurst, Scott; Hendry, Liesl; Isewon, Itunuoluwa; Khetani, Radhika S; Kumuthini, Judit; Kimuda, Magambo Phillip; Magosi, Lerato; Mainzer, Liudmila Sergeevna; Maslamoney, Suresh; Mbiyavanga, Mamana; Meintjes, Ayton; Mugutso, Danny; Mpangase, Phelelani; Munthali, Richard; Nembaware, Victoria; Ndhlovu, Andrew; Odia, Trust; Okafor, Adaobi; Oladipo, Olaleye; Panji, Sumir; Pillay, Venesa; Rendon, Gloria; Sengupta, Dhriti; Mulder, Nicola

    2017-06-01

    The H3ABioNet pan-African bioinformatics network, which is funded to support the Human Heredity and Health in Africa (H3Africa) program, has developed node-assessment exercises to gauge the ability of its participating research and service groups to analyze typical genome-wide datasets being generated by H3Africa research groups. We describe a framework for the assessment of computational genomics analysis skills, which includes standard operating procedures, training and test datasets, and a process for administering the exercise. We present the experiences of 3 research groups that have taken the exercise and the impact on their ability to manage complex projects. Finally, we discuss the reasons why many H3ABioNet nodes have declined so far to participate and potential strategies to encourage them to do so.

  2. Data Entry Skills in a Computer-based Spread Sheet Amongst Postgraduate Medical Students: A Simulation Based Descriptive Assessment.

    Science.gov (United States)

    Khan, Amir Maroof; Shah, Dheeraj; Chatterjee, Pranab

    2014-07-01

    In India, research work in the form of a thesis is a mandatory requirement for the postgraduate (PG) medical students. Data entry in a computer-based spread sheet is one of the important basic skills for research, which has not yet been studied. This study was conducted to assess the data entry skills of the 2(nd) year PG medical students of a medical college of North India. A cross-sectional, descriptive study was conducted among 111 second year PG students by using four simulated filled case record forms and a computer-based spread sheet in which data entry was to be carried out. On a scale of 0-10, only 17.1% of the students scored more than seven. The specific sub-skills that were found to be lacking in more than half of the respondents were as follows: Inappropriate coding (93.7%), long variable names (51.4%), coding not being done for all the variables (76.6%), missing values entered in a non-uniform manner (84.7%) and two variables entered in the same column in the case of blood pressure reading (80.2%). PG medical students were not found to be proficient in data entry skill and this can act as a barrier to do research. This being a first of its kind study in India, more research is needed to understand this issue and then include this yet neglected aspect in teaching research methodology to the medical students.

  3. Health literacy, computer skills and quality of patient-physician communication in Chinese patients with cataract.

    Directory of Open Access Journals (Sweden)

    Xianchai Lin

    Full Text Available PURPOSE: The aim of the study was to assess levels of health literacy and computer skills in Chinese patients with cataract, and their impact on the doctor-patient relationship. METHODS: We undertook a cross-sectional study of cataract patients scheduled for cataract extraction procedures in Guangdong Province, China. Generic health literacy was assessed using 3 established screening questions. Adequate computer skills was determined if patients had used a computer and routinely used search engines on the Internet. Socio-demographic measures (e.g., age, sex, education were obtained from a standardized interview. Participants who indicated that they could not understand what their doctors mean were considered to have had poor patient-physician communications. RESULTS: Of the 211 participants, 92 (43.6% had inadequate health literacy and 204 (96.7% inadequate computer skills. In multivariate analysis, females were more likely to have inadequate health literacy (odds ratio = 2.5, 95% confidence intervals [CI]: 1.3 to 4.7. People with inadequately health literacy were more likely to have a poor patient-physician communication (odds ratio = 3.5, 95% CIs: 1.3 to 9.0. Similar associations were found for inadequate computer skills. CONCLUSION: Chinese elderly patients with cataract have inadequate health literacy and very limited computer skills, which place them at high risk of misunderstanding and mismanaging their ocular conditions. Patient education information other than online materials may improve the eye care and outcomes of these patients.

  4. Open knot-tying skills: residents skills assessed

    NARCIS (Netherlands)

    van Empel, P.J.; Verdam, M.G.E.; Huirne, J.A.; Bonjer, H.J.; Meijerink, W.J.; Scheele, F.

    2013-01-01

    Aim: Open knot-tying and suturing skills are fundamental surgical skills, founding many alternative knot-tying techniques. It is therefore mandatory for residents to possess adequate basic open knot-tying skills. The aim of this study was to compare an objective assessment of open knot-tying skills

  5. The assessment of practical skills

    OpenAIRE

    Reiss, M. J.; Abrahams, I.

    2015-01-01

    Major changes are currently afoot as to how practical work will be assessed in high status examinations (GCSEs for 16 year-olds and ‘A’ levels for 18 year-olds) in England. We explore here how practical skills might best be assessed in school science and introduce two terms: direct assessment of practical skills (DAPS) and indirect assessment of practical skills (IAPS). We conclude that both the direct and indirect assessment of practical skills have their place in effective assessment of sch...

  6. Assessing computational genomics skills: Our experience in the H3ABioNet African bioinformatics network.

    Directory of Open Access Journals (Sweden)

    C Victor Jongeneel

    2017-06-01

    Full Text Available The H3ABioNet pan-African bioinformatics network, which is funded to support the Human Heredity and Health in Africa (H3Africa program, has developed node-assessment exercises to gauge the ability of its participating research and service groups to analyze typical genome-wide datasets being generated by H3Africa research groups. We describe a framework for the assessment of computational genomics analysis skills, which includes standard operating procedures, training and test datasets, and a process for administering the exercise. We present the experiences of 3 research groups that have taken the exercise and the impact on their ability to manage complex projects. Finally, we discuss the reasons why many H3ABioNet nodes have declined so far to participate and potential strategies to encourage them to do so.

  7. Cross-platform digital assessment forms for evaluating surgical skills

    Directory of Open Access Journals (Sweden)

    Steven Arild Wuyts Andersen

    2015-04-01

    Full Text Available A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database containing the digital assessment forms, because this software has cross-platform functionality on both desktop computers and handheld devices. The database is hosted online, and the rating forms can therefore also be accessed through most modern web browsers. Cross-platform digital assessment forms were developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion, digital assessment forms can be used for the structured rating of surgical skills and have the potential to be especially useful in complex assessment situations with multiple raters, repeated assessments in various times and locations, and situations requiring substantial subsequent data processing or complex score calculations.

  8. Data entry skills in a computer-based spread sheet amongst postgraduate medical students: A simulation based descriptive assessment

    Directory of Open Access Journals (Sweden)

    Amir Maroof Khan

    2014-01-01

    Full Text Available Background: In India, research work in the form of a thesis is a mandatory requirement for the postgraduate (PG medical students. Data entry in a computer-based spread sheet is one of the important basic skills for research, which has not yet been studied. This study was conducted to assess the data entry skills of the 2 nd year PG medical students of a medical college of North India. Materials and Methods: A cross-sectional, descriptive study was conducted among 111 second year PG students by using four simulated filled case record forms and a computer-based spread sheet in which data entry was to be carried out. Results: On a scale of 0-10, only 17.1% of the students scored more than seven. The specific sub-skills that were found to be lacking in more than half of the respondents were as follows: Inappropriate coding (93.7%, long variable names (51.4%, coding not being done for all the variables (76.6%, missing values entered in a non-uniform manner (84.7% and two variables entered in the same column in the case of blood pressure reading (80.2%. Conclusion: PG medical students were not found to be proficient in data entry skill and this can act as a barrier to do research. This being a first of its kind study in India, more research is needed to understand this issue and then include this yet neglected aspect in teaching research methodology to the medical students.

  9. COMPUTER EVALUATION OF SKILLS FORMATION QUALITY IN THE IMPLEMENTATION OF COMPETENCE-BASED APPROACH TO LEARNING

    Directory of Open Access Journals (Sweden)

    Vitalia A. Zhuravleva

    2014-01-01

    Full Text Available The article deals with the problem of effective organization of skills forming as an important part of the competence approach in education, implemented via educational standards of new generation. The solution of the problem suggests using of computer tools to assess the quality of skills formation and abilities based on the proposed model of the problem. This paper proposes an approach to creating an assessing model of the level of skills formation in knowledge management systems based on mathematical modeling methods. Attention is paid to the evaluation strategy and technology of assessment, which is based on the use of rules of fuzzy mathematics. Algorithmic implementation of the proposed model of evaluation of the quality of skills development is shown as well. 

  10. EXAMINATION OF THE COMPUTATIONAL THINKING SKILLS OF STUDENTS

    Directory of Open Access Journals (Sweden)

    Agah Tugrul Korucu

    2017-01-01

    Full Text Available Computational thinking is generally considered as a kind of analytical way of thinking. According to Wings (2008 it shares with mathematical thinking, engineering thinking and scientific thinking in the general ways in which we may use for solving a problem, designing and evaluating complex systems or understanding computability and intelligence as well as the mind and human behaviour. It is generally accepted important that like high order thinking skills the analytical way of thinking should be taught to the children at very early ages. The aim of this study is to investigate the computational thinking skills of secondary school students in terms of different variables. The study group of the research is 160 secondary school students who continue their education at different levels in Konya. The “Computational Thinking Skills Scale” which has been developed by Korkmaz, Çakır and Özden (2015 used for data collection. The scale includes 22 items and it is a 5 point likert type scale. The Cronbach Alpha reliability of the scale has been calculated as 0.80 and it has been found to be valid to measure the computational skills levels of the secondary school students as a result of the analysis. As a result of this research, the computational thinking skill levels of participants differ meaningfully in terms of their class levels, do not differ meaningfully in terms of their genders, do not differ meaningfully in terms of their weekly internet usage durations, do not differ meaningfully in terms of their mobile device usage competence situations, differ meaningfully in terms of their mobile Technologies possession durations.

  11. Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial.

    Science.gov (United States)

    Kron, Frederick W; Fetters, Michael D; Scerbo, Mark W; White, Casey B; Lypson, Monica L; Padilla, Miguel A; Gliva-McConvey, Gayle A; Belfore, Lee A; West, Temple; Wallace, Amelia M; Guetterman, Timothy C; Schleicher, Lauren S; Kennedy, Rebecca A; Mangrulkar, Rajesh S; Cleary, James F; Marsella, Stacy C; Becker, Daniel M

    2017-04-01

    To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each group's experiences and learning preferences. A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VR's intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes. student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning. MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters. MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation. MPathic-VR's virtual human simulation offers an effective and engaging means of advanced communication training. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  12. Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial

    Science.gov (United States)

    Kron, Frederick W.; Fetters, Michael D.; Scerbo, Mark W.; White, Casey B.; Lypson, Monica L.; Padilla, Miguel A.; Gliva-McConvey, Gayle A.; Belfore, Lee A.; West, Temple; Wallace, Amelia M.; Guetterman, Timothy C.; Schleicher, Lauren S.; Kennedy, Rebecca A.; Mangrulkar, Rajesh S.; Cleary, James F.; Marsella, Stacy C.; Becker, Daniel M.

    2016-01-01

    Objectives To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each group’s experiences and learning preferences. Methods A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VR’s intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes. Secondary outcomes: student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning. Results MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters. Conclusions MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation. Practice Implications MPathic-VR’s virtual human simulation offers an effective and engaging means of advanced communication training. PMID:27939846

  13. Computer skills and computer anxiety as predictors of internet use ...

    African Journals Online (AJOL)

    The study investigated the extent to which computer skills and computer anxiety predict Internet use among distance learning students in University of Ibadan, Nigeria. The descriptive method of correlative type was used for the study and the sample comprised of one hundred and thirty four (134) distance learning students ...

  14. MENTAL SHIFT TOWARDS SYSTEMS THINKING SKILLS IN COMPUTER SCIENCE

    Directory of Open Access Journals (Sweden)

    MILDEOVÁ, Stanislava

    2012-03-01

    Full Text Available When seeking solutions to current problems in the field of computer science – and other fields – we encounter situations where traditional approaches no longer bring the desired results. Our cognitive skills also limit the implementation of reliable mental simulation within the basic set of relations. The world around us is becoming more complex and mutually interdependent, and this is reflected in the demands on computer support. Thus, in today’s education and science in the field of computer science and all other disciplines and areas of life need to address the issue of the paradigm shift, which is generally accepted by experts. The goal of the paper is to present the systems thinking that facilitates and extends the understanding of the world through relations and linkages. Moreover, the paper introduces the essence of systems thinking and the possibilities to achieve mental a shift toward systems thinking skills. At the same time, the link between systems thinking and functional literacy is presented. We adopted the “Bathtub Test” from the variety of systems thinking tests that allow people to assess the understanding of basic systemic concepts, in order to assess the level of systems thinking. University students (potential information managers were the examined subjects of the examination of systems thinking that was conducted over a longer time period and whose aim was to determine the status of systems thinking. . The paper demonstrates that some pedagogical concepts and activities, in our case the subject of System Dynamics that leads to the appropriate integration of systems thinking in education. There is some evidence that basic knowledge of system dynamics and systems thinking principles will affect students, and their thinking will contribute to an improved approach to solving problems of computer science both in theory and practice.

  15. Comparing the social skills of students addicted to computer games with normal students.

    Science.gov (United States)

    Zamani, Eshrat; Kheradmand, Ali; Cheshmi, Maliheh; Abedi, Ahmad; Hedayati, Nasim

    2010-01-01

    This study aimed to investigate and compare the social skills of studentsaddicted to computer games with normal students. The dependentvariable in the present study is the social skills. The study population included all the students in the second grade ofpublic secondary school in the city of Isfahan at the educational year of2009-2010. The sample size included 564 students selected using thecluster random sampling method. Data collection was conducted usingQuestionnaire of Addiction to Computer Games and Social SkillsQuestionnaire (The Teenage Inventory of Social Skill or TISS). The results of the study showed that generally, there was a significantdifference between the social skills of students addicted to computer gamesand normal students. In addition, the results indicated that normal studentshad a higher level of social skills in comparison with students addicted tocomputer games. As the study results showed, addiction to computer games may affectthe quality and quantity of social skills. In other words, the higher theaddiction to computer games, the less the social skills. The individualsaddicted to computer games have less social skills.).

  16. MOVEMENT SKILL ASSESSMENT OF TYPICALLY DEVELOPING PRESCHOOL CHILDREN: A REVIEW OF SEVEN MOVEMENT SKILL ASSESSMENT TOOLS

    Directory of Open Access Journals (Sweden)

    Wouter Cools

    2009-06-01

    Full Text Available The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children.

  17. Employability Skills Assessment Tool Development

    Science.gov (United States)

    Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

    2012-01-01

    Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

  18. Using the Computer to Improve Basic Skills.

    Science.gov (United States)

    Bozeman, William; Hierstein, William J.

    These presentations offer information on the benefits of using computer-assisted instruction (CAI) for remedial education. First, William J. Hierstein offers a summary of the Computer Assisted Basic Skills Project conducted by Southeastern Community College at the Iowa State Penitentiary. Hierstein provides background on the funding for the…

  19. Two Reading Assessments for Youth in Alternative Basic Skills and Livelihood Skills Training Programs

    Science.gov (United States)

    Comings, John P.; Strucker, John; Bell, Brenda

    2017-01-01

    This article describes two assessment tools that have been used to assess the reading skills of youth participating in alternative basic skills and livelihood skills training programs. The Rapid Assessment of Reading Skills (RARS) was developed to identify potential participants who needed to improve their reading skills before beginning training…

  20. Fostering computational thinking skills with a tangible blocks programming environment

    OpenAIRE

    Turchi, T; Malizia, A

    2016-01-01

    Computational Thinking has recently returned into the limelight as an essential skill to have for both the general public and disciplines outside Computer Science. It encapsulates those thinking skills integral to solving complex problems using a computer, thus widely applicable in our technological society. Several public initiatives such as the Hour of Code successfully introduced it to millions of people of different ages and backgrounds, mostly using Blocks Programming Environments like S...

  1. Written and Computer-Mediated Accounting Communication Skills: An Employer Perspective

    Science.gov (United States)

    Jones, Christopher G.

    2011-01-01

    Communication skills are a fundamental personal competency for a successful career in accounting. What is not so obvious is the specific written communication skill set employers look for and the extent those skills are computer mediated. Using survey research, this article explores the particular skills employers desire and their satisfaction…

  2. A computer-based feedback only intervention with and without a moderation skills component

    OpenAIRE

    Weaver, Cameron C.; Leffingwell, Thad R.; Lombardi, Nathaniel J.; Claborn, Kasey R.; Miller, Mary E.; Martens, Matthew P.

    2013-01-01

    Research on the efficacy of computer-delivered feedback-only interventions (FOIs) for college alcohol misuse has been mixed. Limitations to these FOIs include participant engagement and variation in the use of a moderation skills component. The current investigation sought to address these limitations using a novel computer-delivered FOI, the Drinkers Assessment and Feedback Tool for College Students (DrAFT-CS). Heavy drinking college students (N = 176) were randomly assigned to DrAFT-CS, DrA...

  3. The Effects of Computer Games on the Achievement of Basic Mathematical Skills

    Science.gov (United States)

    Sayan, Hamiyet

    2015-01-01

    This study aims to analyze the relationship between playing computer games and learning basic mathematics skills. It shows the role computer games play in the learning and achievement of basic mathematical skills by students. Nowadays it is clear that individuals, especially young persons are very fond of computer and computer games. Since…

  4. Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

    Science.gov (United States)

    Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

    2009-01-01

    The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: K

  5. Computer proficiency questionnaire: assessing low and high computer proficient seniors.

    Science.gov (United States)

    Boot, Walter R; Charness, Neil; Czaja, Sara J; Sharit, Joseph; Rogers, Wendy A; Fisk, Arthur D; Mitzner, Tracy; Lee, Chin Chin; Nair, Sankaran

    2015-06-01

    Computers and the Internet have the potential to enrich the lives of seniors and aid in the performance of important tasks required for independent living. A prerequisite for reaping these benefits is having the skills needed to use these systems, which is highly dependent on proper training. One prerequisite for efficient and effective training is being able to gauge current levels of proficiency. We developed a new measure (the Computer Proficiency Questionnaire, or CPQ) to measure computer proficiency in the domains of computer basics, printing, communication, Internet, calendaring software, and multimedia use. Our aim was to develop a measure appropriate for individuals with a wide range of proficiencies from noncomputer users to extremely skilled users. To assess the reliability and validity of the CPQ, a diverse sample of older adults, including 276 older adults with no or minimal computer experience, was recruited and asked to complete the CPQ. The CPQ demonstrated excellent reliability (Cronbach's α = .98), with subscale reliabilities ranging from .86 to .97. Age, computer use, and general technology use all predicted CPQ scores. Factor analysis revealed three main factors of proficiency related to Internet and e-mail use; communication and calendaring; and computer basics. Based on our findings, we also developed a short-form CPQ (CPQ-12) with similar properties but 21 fewer questions. The CPQ and CPQ-12 are useful tools to gauge computer proficiency for training and research purposes, even among low computer proficient older adults. © The Author 2013. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  6. Self-perceived assessment skill of prospective physics teachers

    Science.gov (United States)

    Efendi, R.; Rustaman, N. Y.; Kaniawati, I.

    2018-05-01

    Assessment skills are an important component of assessment practice, without adequate assessment skills it is unlikely that teacher assessment practices will produce desired student learning outcomes. This study was conducted to reveal self-perceived assessment skills of prospective physics teachers by using quantitative descriptive analysis, and involving 92 prospective physics teachers who were experiencing teaching practice in junior high school and final project related to assessment. Data was collected by using Self-Perceived Assessment Science Skills Questionnaire consisted of 29 items related seven assessment competencies was developed and used in the study. Internal consistency reliability coefficient for the total scale scores was 0.87 as measured by Cronbach’s alpha. Determination of self-perceived assessment science skills detected from prospective physics teachers was carried out in descriptive statistics, in the form of respondent average values. Research findings show that self-perceived assessment skills of prospective physics teachers was categorized as transition.

  7. Crowd-sourced assessment of technical skills: an opportunity for improvement in the assessment of laparoscopic surgical skills.

    Science.gov (United States)

    Deal, Shanley B; Lendvay, Thomas S; Haque, Mohamad I; Brand, Timothy; Comstock, Bryan; Warren, Justin; Alseidi, Adnan

    2016-02-01

    Objective, unbiased assessment of surgical skills remains a challenge in surgical education. We sought to evaluate the feasibility and reliability of Crowd-Sourced Assessment of Technical Skills. Seven volunteer general surgery interns were given time for training and then testing, on laparoscopic peg transfer, precision cutting, and intracorporeal knot-tying. Six faculty experts (FEs) and 203 Amazon.com Mechanical Turk crowd workers (CWs) evaluated 21 deidentified video clips using the Global Objective Assessment of Laparoscopic Skills validated rating instrument. Within 19 hours and 15 minutes we received 662 eligible ratings from 203 CWs and 126 ratings from 6 FEs over 10 days. FE video ratings were of borderline internal consistency (Krippendorff's alpha = .55). FE ratings were highly correlated with CW ratings (Pearson's correlation coefficient = .78, P Assessment of Technical Skills as a reliable, basic tool to standardize the evaluation of technical skills in general surgery. Copyright © 2016 Elsevier Inc. All rights reserved.

  8. COMPUTER-AIDED ACQUISITION OF WRITING SKILLS

    NARCIS (Netherlands)

    Verhoef, R.; Tomic, W.

    2008-01-01

    This article presents the results of a review of the literature questioning whether and to what extent computers can be used as a means of instruction for the guided acquisition of communicative writing skills in higher education. To answer this question, the present paper first explores the

  9. Differences on the Level of Social Skills between Freshman Computer Gamers and Non-Gamers

    Directory of Open Access Journals (Sweden)

    Joseph B. Campit

    2015-02-01

    Full Text Available Computer games play a large role in socialization and the consequences of playing them have been a topic of debates. This observation led the researcher to conduct the study about the influence of computer games on the social skills of the BSIT first year students of Pangasinan State University, Bayambang Campus, during school year 2012-2013. This study determined the profile of the 115 BSIT first year students according to: preferred computer games and frequency of playing. It investigated the level of social skills among playing and non-playing gamers. This study used the descriptive-comparative method of research. It was found out that crossfire was the most preferred computer game played at least once a week. Computer gamers had lower social skills than non-computer gamers. Gamers have more negative social behaviors compared to non-gamers and there is a negative effect of playing computer games on the level of social skills among first year students. There is a significant difference in the level of social skills of the students when grouped according to frequency of playing computer games. Students who play computer games everyday had significantly lower social skills than who play once a week. Thus, parents and teachers should give proper guidance in the limitation of playing computer games and the choice of games. Teachers should organize seminars on the awareness of the influence and negative effects of violent computer games on social skills. And students should choose educational over violent games to enhance their knowledge and social skills.

  10. Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

    Science.gov (United States)

    Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

    2017-11-01

    In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is

  11. Employability Skills among Students and Employers’ Perceptions: An Assessment of Levels of Employability Skills Acquired by Business Students at Ishik University

    Directory of Open Access Journals (Sweden)

    Fayeq Ali Ali

    2017-01-01

    Full Text Available Skills are prerequisite for managers and employees success, especially for newly graduate students. This study is to evaluate the employability skills of business students at Ishik University and to assess how employability skills are perceived by potential employers. Three sets of employability skills have been used in this study such as basic academic skills, high-order thinking, and personal qualities. A questionnaire has been developed which included above dimensions and was distributed among students in the faculty of administrative sciences and economics at Ishik University, Kurdistan Region. Respondents’ opinions were assessed using a Likert scale analysis that shows divergent opinions between two extremes of levels of agreement and disagreement. Another technique of an open-ended questionnaire was used when conducting interviews with a few of the potential employers in some private sector companies. Study focuses on the common employability skills of business graduates by evaluating the faculty of administrative sciences and economics courses. Study find out that communication skills, team working skills, computer skills, and critical thinking were among the employability skills which are expected by potential employers. The paper concludes that business graduates have developed an adequate level of employability skill through their years of academic training at business department in Ishik University. Thus, the curriculum of business department at Ishik University is adequately developed to prompt the employability skills that are sought by potential employers that every business student should acquire to stand out in the aggressively competitive job market.

  12. Skills and knowledge of informatics, and training needs of hospital pharmacists in Thailand: A self-assessment survey.

    Science.gov (United States)

    Chonsilapawit, Teeraporn; Rungpragayphan, Suang

    2016-10-01

    Because hospital pharmacists have to deal with large amounts of health information and advanced information technology in practice, they must possess adequate skills and knowledge of informatics to operate efficiently. However, most current pharmacy curricula in Thailand barely address the principles and skills concerned with informatics, and Thai pharmacists usually acquire computer literacy and informatics skills through personal-interest training and self-study. In this study, we aimed to assess the skills and knowledge of informatics and the training needs of hospital pharmacists in Thailand, in order to improve curricular and professional development. A self-assessment postal survey of 73 questions was developed and distributed to the pharmacy departments of 601 hospitals throughout the country. Practicing hospital pharmacists were requested to complete and return the survey voluntarily. Within the 3 months of the survey period, a total of 805 out of 2002 surveys were returned. On average, respondents rated themselves as competent or better in the skills of basic computer operation, the Internet, information management, and communication. Understandably, they rated themselves at novice level for information technology and database design knowledge/skills, and at advanced beginner level for project, risk, and change management skills. Respondents believed that skills and knowledge of informatics were highly necessary for their work, and definitely needed training. Thai hospital pharmacists were confident in using computers and the Internet. They realized and appreciated their lack of informatics knowledge and skills, and needed more training. Pharmacy curricula and training should be developed accordingly. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  13. Students' performance in the different clinical skills assessed in OSCE: what does it reveal?

    Science.gov (United States)

    Sim, Joong Hiong; Abdul Aziz, Yang Faridah; Mansor, Azura; Vijayananthan, Anushya; Foong, Chan Choong; Vadivelu, Jamuna

    2015-01-01

    The purpose of this study was to compare students' performance in the different clinical skills (CSs) assessed in the objective structured clinical examination. Data for this study were obtained from final year medical students' exit examination (n=185). Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs), procedural skills (PSs), and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332)=20.253, pskill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students' clinical reasoning development.

  14. Assessment of Surgical Skills and Competency.

    Science.gov (United States)

    Bhatti, Nasir I

    2017-10-01

    Evaluation of surgical skills and competency are important aspects of the medical education process. Measurable and reproducible methods of assessment with objective feedback are essential components of surgical training. Objective Structured Assessment of Technical Skills (OSATS) is widely used across the medical specialties and otolaryngology-specific tools have been developed and validated for sinus and mastoid surgery. Although assessment of surgical skills can be time-consuming and requires human and financial resources, new evaluation methods and emerging technology may alleviate these barriers while also improving data collection practices. Copyright © 2017 Elsevier Inc. All rights reserved.

  15. Assessing Trainee Surgeons’ Nontechnical Skills

    DEFF Research Database (Denmark)

    Spanager, Lene; Konge, Lars; Dieckmann, Peter

    2015-01-01

    BACKGROUND: Trainee surgeons would benefit from regular, formative assessments to ensure they learn the nontechnical aspects of surgical performance. Non-Technical Skills for Surgeons in Denmark (NOTSSdk) is a tool to assess surgeons' nontechnical skills (NTS) during an operation. The aims...... of this study were to explore which parts of NOTSSdk supervisors use to assess trainee surgeons' NTS, to determine the internal consistency reliability of NOTSSdk, and to estimate how many operations were needed to obtain reliable ratings of a trainee surgeon's NTS. METHODS: A total of 12 supervisors from 2...

  16. Teacher Assessment of Practical Skills in A-Level Chemistry

    Science.gov (United States)

    Wood, R.; Ferguson, Carolyn M.

    1975-01-01

    Discusses a two-year assessment undertaken to evaluate the Nuffield A-Level chemistry course. Secondary teachers selected chemistry experiments for assessment purposes and assessed their students in manipulative skills, observational skills, interpretation skills, creative skills, and attitudes. (MLH)

  17. Government services: sector skills assessment 2012

    OpenAIRE

    Parry, Jon; Ojo, Adegbola

    2012-01-01

    The aim of this report is to provide authoritative labour market intelligence (LMI) for the Government Services sector to inform the strategic decision making of national governments in the development of employment and skills policy. It is one of 15 UK Sector Skills Assessment (SSA) reports produced by Sector Skills Councils and the UK Commission for Employment and Skills.

  18. 'I'm good, but not that good': digitally-skilled young people's identity in computing

    Science.gov (United States)

    Wong, Billy

    2016-12-01

    Computers and information technology are fast becoming a part of young people's everyday life. However, there remains a difference between the majority who can use computers and the minority who are computer scientists or professionals. Drawing on 32 semi-structured interviews with digitally skilled young people (aged 13-19), we explore their views and aspirations in computing, with a focus on the identities and discourses that these youngsters articulate in relation to this field. Our findings suggest that, even among digitally skilled young people, traditional identities of computing as people who are clever but antisocial still prevail, which can be unattractive for youths, especially girls. Digitally skilled youths identify with computing in different ways and for different reasons. Most enjoy doing computing but few aspired to being a computer person. Implications of our findings for computing education are discussed especially the continued need to broaden identities in computing, even for the digitally skilled.

  19. Enabling performance skills: Assessment in engineering education

    Science.gov (United States)

    Ferrone, Jenny Kristina

    Current reform in engineering education is part of a national trend emphasizing student learning as well as accountability in instruction. Assessing student performance to demonstrate accountability has become a necessity in academia. In newly adopted criterion proposed by the Accreditation Board for Engineering and Technology (ABET), undergraduates are expected to demonstrate proficiency in outcomes considered essential for graduating engineers. The case study was designed as a formative evaluation of freshman engineering students to assess the perceived effectiveness of performance skills in a design laboratory environment. The mixed methodology used both quantitative and qualitative approaches to assess students' performance skills and congruency among the respondents, based on individual, team, and faculty perceptions of team effectiveness in three ABET areas: Communications Skills. Design Skills, and Teamwork. The findings of the research were used to address future use of the assessment tool and process. The results of the study found statistically significant differences in perceptions of Teamwork Skills (p performance skills, such as teamwork, among freshman engineering students; (2) incorporate feedback into the learning process; (3) strengthen the assessment process with a follow-up plan that specifically targets performance skill deficiencies, and (4) integrate the assessment instrument and practice with ongoing curriculum development. The findings generated by this study provides engineering departments engaged in assessment activity, opportunity to reflect, refine, and develop their programs as it continues. It also extends research on ABET competencies of engineering students in an under-investigated topic of factors correlated with team processes, behavior, and student learning.

  20. Computer-enhanced visual learning method: a paradigm to teach and document surgical skills.

    Science.gov (United States)

    Maizels, Max; Mickelson, Jennie; Yerkes, Elizabeth; Maizels, Evelyn; Stork, Rachel; Young, Christine; Corcoran, Julia; Holl, Jane; Kaplan, William E

    2009-09-01

    Changes in health care are stimulating residency training programs to develop new methods for teaching surgical skills. We developed Computer-Enhanced Visual Learning (CEVL) as an innovative Internet-based learning and assessment tool. The CEVL method uses the educational procedures of deliberate practice and performance to teach and learn surgery in a stylized manner. CEVL is a learning and assessment tool that can provide students and educators with quantitative feedback on learning a specific surgical procedure. Methods involved examine quantitative data of improvement in surgical skills. Herein, we qualitatively describe the method and show how program directors (PDs) may implement this technique in their residencies. CEVL allows an operation to be broken down into teachable components. The process relies on feedback and remediation to improve performance, with a focus on learning that is applicable to the next case being performed. CEVL has been shown to be effective for teaching pediatric orchiopexy and is being adapted to additional adult and pediatric procedures and to office examination skills. The CEVL method is available to other residency training programs.

  1. Peer Assessment of Elementary Science Teaching Skills

    Science.gov (United States)

    Kilic, Gulsen Bagci; Cakan, Mehtap

    2007-01-01

    In this study, peer assessment was applied in assessing elementary science teaching skills. Preservice teachers taught a science topic as a team to their peers in an elementary science methods course. The peers participating in the science lesson assessed teacher-groups' elementary science teaching skills on an assessment form provided by the…

  2. Ecosystem Model Skill Assessment. Yes We Can!

    Science.gov (United States)

    Olsen, Erik; Fay, Gavin; Gaichas, Sarah; Gamble, Robert; Lucey, Sean; Link, Jason S

    2016-01-01

    Accelerated changes to global ecosystems call for holistic and integrated analyses of past, present and future states under various pressures to adequately understand current and projected future system states. Ecosystem models can inform management of human activities in a complex and changing environment, but are these models reliable? Ensuring that models are reliable for addressing management questions requires evaluating their skill in representing real-world processes and dynamics. Skill has been evaluated for just a limited set of some biophysical models. A range of skill assessment methods have been reviewed but skill assessment of full marine ecosystem models has not yet been attempted. We assessed the skill of the Northeast U.S. (NEUS) Atlantis marine ecosystem model by comparing 10-year model forecasts with observed data. Model forecast performance was compared to that obtained from a 40-year hindcast. Multiple metrics (average absolute error, root mean squared error, modeling efficiency, and Spearman rank correlation), and a suite of time-series (species biomass, fisheries landings, and ecosystem indicators) were used to adequately measure model skill. Overall, the NEUS model performed above average and thus better than expected for the key species that had been the focus of the model tuning. Model forecast skill was comparable to the hindcast skill, showing that model performance does not degenerate in a 10-year forecast mode, an important characteristic for an end-to-end ecosystem model to be useful for strategic management purposes. We identify best-practice approaches for end-to-end ecosystem model skill assessment that would improve both operational use of other ecosystem models and future model development. We show that it is possible to not only assess the skill of a complicated marine ecosystem model, but that it is necessary do so to instill confidence in model results and encourage their use for strategic management. Our methods are applicable

  3. Clinical Skills Assessment in the Twenty-First Century.

    Science.gov (United States)

    Elder, Andrew

    2018-05-01

    Clinical skills remain fundamental to the practice of medicine and form a core component of the professional identity of the physician. However, evidence exists to suggest that the practice of some clinical skills is declining, particularly in the United States. A decline in practice of any skill can lead to a decline in its teaching and assessment, with further decline in practice as a result. Consequently, assessment not only drives learning of clinical skills, but their practice. This article summarizes contemporary approaches to clinical skills assessment that, if more widely adopted, could support the maintenance and reinvigoration of bedside clinical skills. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

  4. Avatar Assistant: Improving Social Skills in Students with an ASD through a Computer-Based Intervention

    Science.gov (United States)

    Hopkins, Ingrid Maria; Gower, Michael W.; Perez, Trista A.; Smith, Dana S.; Amthor, Franklin R.; Wimsatt, F. Casey; Biasini, Fred J.

    2011-01-01

    This study assessed the efficacy of "FaceSay," a computer-based social skills training program for children with Autism Spectrum Disorders (ASD). This randomized controlled study (N = 49) indicates that providing children with low-functioning autism (LFA) and high functioning autism (HFA) opportunities to practice attending to eye gaze,…

  5. Assessing Writing Skills

    Science.gov (United States)

    Narayanan, M.

    2013-12-01

    This is an encore presentation of what was presented at the 2012 AGU International Conference. It was entitled: 'ASSESSING CORE COMPETENCIES.' The poster presentation, however, has been redesigned and reorganized with new, revised perspectives. The importance of ASSESSMENT principles has been emphasized. Catherine Palomba and Trudy Banta offer the following definition of assessment, adapted from one provided by Marchese in 1987. Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development. (Palomba and Banta 1999). Educational institutions are committing substantial resources to the establishment of dedicated technology-based laboratories, so that they will be able to accommodate and fulfill students' desire to master certain of these specific skills. This type of technology-based instruction may raise some fundamental questions about the core competencies of the student learner. Some of the most important questions are : 1. Is the utilization of these fast high-powered computers and user-friendly software programs creating a totally non-challenging instructional environment for the student learner ? 2. Can technology itself all too easily overshadow the learning outcomes intended ? 3. Are the educational institutions simply training students how to use technology rather than educating them in the appropriate field ? 4. Are we still teaching content-driven courses and analysis oriented subject matter ? 5. Are these sophisticated modern era technologies contributing to a decline in the Critical Thinking Capabilities of the 21st century technology-savvy students ? The author tries to focus on technology as a tool and not on the technology itself. He further argues that students must demonstrate that they have the have the ability to think critically before they make an attempt to use technology in a chosen application-specific environment. The author further

  6. Teaching and Assessing Engineering Professional Skills

    Directory of Open Access Journals (Sweden)

    Ali M. Al-Bahi

    2013-05-01

    Full Text Available Engineering students are required to have, by the time of graduation, a set of professional skills related to teamwork, oral and written communications, impact of engineering solutions, life-long learning, and knowledge of contemporary issues. Teaching and assessment of these skills, as part of ABET accreditation, remains problematic. A systematic methodology to integrate these skills and their assessment in the curriculum is described. The method was recently applied in several engineering programs and proved to be efficient in generating data and evidences for evaluation and continuous improvement of these outcomes.

  7. Students’ performance in the different clinical skills assessed in OSCE: what does it reveal?

    Directory of Open Access Journals (Sweden)

    Joong Hiong Sim

    2015-02-01

    Full Text Available Introduction: The purpose of this study was to compare students’ performance in the different clinical skills (CSs assessed in the objective structured clinical examination. Methods: Data for this study were obtained from final year medical students’ exit examination (n=185. Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Results: Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs, procedural skills (PSs, and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332=20.253, p<0.001]. Pairwise multiple comparisons revealed significant differences between the means of the eight pairs of CSs assessed, at p<0.05. Conclusions: CRSs appeared to be the weakest while PSs were the strongest, among the six CSs assessed. Students’ unsatisfactory performance in CRS needs to be addressed as CRS is one of the core competencies in medical education and a critical skill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students’ clinical reasoning development.

  8. Assessment of professional engineering skills - define, monitor and assess

    DEFF Research Database (Denmark)

    Andersson, Niclas; Andersson, Pernille Hammar

    2012-01-01

    , professional engineering skills need to be included in the syllabus of engineering courses and study programs, which in turn call for the implementation of learning objectives, teaching activities as well as methods for assessing the professional performance of the engineering students. The implicit...... life experience from industry and consequently, they might have limited knowledge about professional skills which of course delimits their ability to evaluate the students’ professional performance. The objective of this study is to design and test a method to assess professional skills...... in an engineering teaching context. A suggested approach, based on the three consecutive steps of Define – Monitor – Assess, was applied and tested in an engineering course in which the students and professional engineers from industry interacted in an extensive role play simulation. The students’ were actively...

  9. Assessment of technical and nontechnical skills in surgical residents.

    Science.gov (United States)

    Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

    2016-11-01

    Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

  10. A Multilevel Modeling Approach to Examining Individual Differences in Skill Acquisition for a Computer-Based Task

    OpenAIRE

    Nair, Sankaran N.; Czaja, Sara J.; Sharit, Joseph

    2007-01-01

    This article explores the role of age, cognitive abilities, prior experience, and knowledge in skill acquisition for a computer-based simulated customer service task. Fifty-two participants aged 50–80 performed the task over 4 consecutive days following training. They also completed a battery that assessed prior computer experience and cognitive abilities. The data indicated that overall quality and efficiency of performance improved with practice. The predictors of initial level of performan...

  11. Using computer assisted learning for clinical skills education in nursing: integrative review.

    Science.gov (United States)

    Bloomfield, Jacqueline G; While, Alison E; Roberts, Julia D

    2008-08-01

    This paper is a report of an integrative review of research investigating computer assisted learning for clinical skills education in nursing, the ways in which it has been studied and the general findings. Clinical skills are an essential aspect of nursing practice and there is international debate about the most effective ways in which these can be taught. Computer assisted learning has been used as an alternative to conventional teaching methods, and robust research to evaluate its effectiveness is essential. The CINAHL, Medline, BNI, PsycInfo and ERIC electronic databases were searched for the period 1997-2006 for research-based papers published in English. Electronic citation tracking and hand searching of reference lists and relevant journals was also undertaken. Twelve studies met the inclusion criteria. An integrative review was conducted and each paper was explored in relation to: design, aims, sample, outcome measures and findings. Many of the study samples were small and there were weaknesses in designs. There is limited empirical evidence addressing the use of computer assisted learning for clinical skills education in nursing. Computer assisted learning has been used to teach a limited range of clinical skills in a variety of settings. The paucity of evaluative studies indicates the need for more rigorous research to investigate the effect of computer assisted learning for this purpose. Areas that need to be addressed in future studies include: sample size, range of skills, longitudinal follow-up and control of confounding variables.

  12. An Overview of Recent Developments in Cognitive Diagnostic Computer Adaptive Assessments

    Directory of Open Access Journals (Sweden)

    Alan Huebner

    2010-01-01

    Full Text Available Cognitive diagnostic modeling has become an exciting new field of psychometric research. These models aim to diagnose examinees' mastery status of a group of discretely defined skills, or attributes, thereby providing them with detailed information regarding their specific strengths and weaknesses. Combining cognitive diagnosis with computer adaptive assessments has emerged as an important part of this new field. This article aims to provide practitioners and researchers with an introduction to and overview of recent developments in cognitive diagnostic computer adaptive assessments.

  13. Accuracy of young male drivers’ self-assessments of driving skill

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Accurate self-assessment of skill is important because it creates an appropriate level of confidence and hence behaviour. Inaccurate self-assessment of driving ability has been linked to reckless driving and accidents. Inaccurate self-assessment of driving skills may be a contributing factor...... to the over-representation of young male drivers in accident statistics. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aims of this study were: (1) to test the accuracy of young male drivers’ self......-assessments of specific driving skills by comparing them with performance in a driving simulator; (2) to test whether self-assessment accuracy varied with driving skill, driving experience and sensation-seeking propensity. We found that young male drivers’ self-assessments were inconsistent with their driving performance...

  14. Technical and Technological Skills Assessment in Laparoscopic Surgery

    Science.gov (United States)

    Chang, Avril; Vincent, Charles

    2006-01-01

    Objectives: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. Methods: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each operation blindly and independently on DVD. The technological skills were assessed in the operating room. Results: One hundred operations were analyzed. Eight trainees and 10 consultant surgeons were recruited. No adverse events occurred due to technical or technological skills. Mean interrater reliability was kappa=0.88, P=technical and technological skills between trainee and consultant surgeons were significant, Mann-Whitney P=technical and technological skills can be measured to assess performance of laparoscopic surgeons. This technical and technological assessment tool for laparoscopic surgery seems to have face, content, concurrent, and construct validities and could be modified and applied to any laparoscopic operation. The tool has the possibility of being used in surgical training and appraisal. We aim to modify and apply this tool to advanced laparoscopic operations. PMID:17212881

  15. Conception of professional skills in computer engineering education

    Directory of Open Access Journals (Sweden)

    Roberto Barrera Jiménez

    2012-12-01

    Full Text Available This article presents the main results of a research done on improving the process of developing professional skills of students from Computer Engineering degree in the University of Pinar del Rio One of the important elements needed by the students of Informatics, to show greatest potentialities when solving problem situations using languages and programming techniques, is related to the different approaches dealing with the development of skills. The success in this area depends on the didactic procedures to be applied by the discipline.

  16. Skill Assessment in Ocean Biological Data Assimilation

    Science.gov (United States)

    Gregg, Watson W.; Friedrichs, Marjorie A. M.; Robinson, Allan R.; Rose, Kenneth A.; Schlitzer, Reiner; Thompson, Keith R.; Doney, Scott C.

    2008-01-01

    There is growing recognition that rigorous skill assessment is required to understand the ability of ocean biological models to represent ocean processes and distributions. Statistical analysis of model results with observations represents the most quantitative form of skill assessment, and this principle serves as well for data assimilation models. However, skill assessment for data assimilation requires special consideration. This is because there are three sets of information in the free-run model, data, and the assimilation model, which uses Data assimilation information from both the flee-run model and the data. Intercom parison of results among the three sets of information is important and useful for assessment, but is not conclusive since the three information sets are intertwined. An independent data set is necessary for an objective determination. Other useful measures of ocean biological data assimilation assessment include responses of unassimilated variables to the data assimilation, performance outside the prescribed region/time of interest, forecasting, and trend analysis. Examples of each approach from the literature are provided. A comprehensive list of ocean biological data assimilation and their applications of skill assessment, in both ecosystem/biogeochemical and fisheries efforts, is summarized.

  17. Metrics for Objective Assessment of Surgical Skills Workshop

    National Research Council Canada - National Science Library

    Satava, Richard

    2001-01-01

    On 9-10 July, 2001 the Metrics for Objective Assessment of Surgical Skills Workshop convened an international assemblage of subject matter experts in objective assessment of surgical technical skills...

  18. Technology skills assessment for deaf and hard of hearing students in secondary school.

    Science.gov (United States)

    Luft, Pamela; Bonello, Mary; Zirzow, Nichole K

    2009-01-01

    To BE COMPETITIVE in the workplace, deaf and hard of hearing students must not only possess basic computer literacy but also know how to use and care for personal assistive and listening technology. An instrument was developed and pilot-tested on 45 middle school and high school deaf and hard of hearing students in 5 public school programs, 4 urban and 1 suburban, to assess these students' current technology skills and to prepare them for post-high school expectations. The researchers found that the students' computer skills depended on their access to technology, which was not always present in the schools. Many students also did not know basic care practices or troubleshooting techniques for their own personal hearing aids (if worn), or how to access or use personal assistive technology.

  19. Non-technical skills assessment in surgery.

    Science.gov (United States)

    Sharma, Bharat; Mishra, Amit; Aggarwal, Rajesh; Grantcharov, Teodor P

    2011-09-01

    Adverse events in surgery have highlighted the importance of non-technical skills, such as communication, decision-making, teamwork, situational awareness and leadership, to effective organizational performance. These skills carry particular importance to surgical oncology, as members of a multidisciplinary team must work cohesively to formulate effective patient care plans. Several non-technical skills evaluation tools have been developed for use in surgery, without adequate comparison and consensus on which should be standard for training. Eleven articles describing the use of three non-technical evaluation tools related to surgery: NOTSS (Non Technical Skills for Surgeons), NOTECHS (Non Technical Skills) and OTAS (Observational Teamwork Assessment for Surgery) were analyzed with respect to scale formulation, validity, reliability and feasibility. Furthermore, their use in training thus far and the future of non-technical rating scales in surgical curricula was discussed. Future work should focus on incorporating these assessment tools into training and into a real operating room setting to provide formative evaluations for surgical residents. Copyright © 2010 Elsevier Ltd. All rights reserved.

  20. Management and organisational barriers in the acquisition of computer usage skills by mature age workers.

    Science.gov (United States)

    Keogh, Mark

    2009-09-01

    To investigate workplace cultures in the acquisition of computer usage skills by mature age workers. Data were gathered through focus groups conducted at job network centres in the Greater Brisbane metropolitan region. Participants who took part were a mixture of workers and job-seekers. The results suggest that mature age workers can be exposed to inappropriate computer training practices and age-insensitive attitudes towards those with low base computer skills. There is a need for managers to be observant of ageist attitudes in the work place and to develop age-sensitive strategies to help mature age workers learn computer usage skills. Mature age workers also need to develop skills in ways which are practical and meaningful to their work.

  1. The development and validation of measures to assess cooking skills and food skills.

    Science.gov (United States)

    Lavelle, Fiona; McGowan, Laura; Hollywood, Lynsey; Surgenor, Dawn; McCloat, Amanda; Mooney, Elaine; Caraher, Martin; Raats, Monique; Dean, Moira

    2017-09-02

    With the increase use of convenience food and eating outside the home environment being linked to the obesity epidemic, the need to assess and monitor individuals cooking and food skills is key to help intervene where necessary to promote the usage of these skills. Therefore, this research aimed to develop and validate a measure for cooking skills and one for food skills, that are clearly described, relatable, user-friendly, suitable for different types of studies, and applicable across all sociodemographic levels. Two measures were developed in light of the literature and expert opinion and piloted for clarity and ease of use. Following this, four studies were undertaken across different cohorts (including a sample of students, both 'Food preparation novices' and 'Experienced food preparers', and a nationally representative sample) to assess temporal stability, psychometrics, internal consistency reliability and construct validity of both measures. Analysis included T-tests, Pearson's correlations, factor analysis, and Cronbach's alphas, with a significance level of 0.05. Both measures were found to have a significant level of temporal stability (P cooking skills confidence measure ranged from 0.78 to 0.93 across all cohorts. The food skills confidence measure's Cronbach's alpha's ranged from 0.85 to 0.94. The two measures also showed a high discriminate validity as there were significant differences (P cooking skills confidence and P cooking skills confidence measure and the food skills confidence measure have been shown to have a very satisfactory reliability, validity and are consistent over time. Their user-friendly applicability make both measures highly suitable for large scale cross-sectional, longitudinal and intervention studies to assess or monitor cooking and food skills levels and confidence.

  2. Assessing students' communication skills: validation of a global rating.

    Science.gov (United States)

    Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

    2008-12-01

    Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

  3. Assessment of psychomotor skills acquisition during laparoscopic cholecystectomy courses.

    Science.gov (United States)

    Hance, Julian; Aggarwal, Rajesh; Moorthy, Krishna; Munz, Yaron; Undre, Shabnam; Darzi, Ara

    2005-09-01

    Standardized short courses in laparoscopic cholecystectomy aim to teach laparoscopic skills to surgical trainees, although end-of-course assessments of performance remain subjective. The current study aims to objectively assess psychomotor skills acquisition of trainees attending laparoscopic cholecystectomy courses. Thirty-seven junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate 2-day courses (A, B, and C), all with identical format. Assessments were comprised of a standardized simulated laparoscopic task, with performance measured using a valid electromagnetic hand-motion tracking device. Overall, trainees made significant improvements in path length (P=.006), number of movements (Ppsychomotor skills on courses. In addition to providing participants with an insight into their skills, these data can be used to demonstrate course efficacy.

  4. Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan.

    Science.gov (United States)

    Moore, Amy Lawson; Miller, Terissa M

    2018-01-01

    The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills. This study included 2,737 participants aged 5-85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test-retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement. Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test-retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93. The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan.

  5. Reliability and validity of the revised Gibson Test of Cognitive Skills, a computer-based test battery for assessing cognition across the lifespan

    Directory of Open Access Journals (Sweden)

    Moore AL

    2018-02-01

    Full Text Available Amy Lawson Moore, Terissa M Miller Gibson Institute of Cognitive Research, Colorado Springs, CO, USA Purpose: The purpose of the current study is to evaluate the validity and reliability of the revised Gibson Test of Cognitive Skills, a computer-based battery of tests measuring short-term memory, long-term memory, processing speed, logic and reasoning, visual processing, as well as auditory processing and word attack skills.Methods: This study included 2,737 participants aged 5–85 years. A series of studies was conducted to examine the validity and reliability using the test performance of the entire norming group and several subgroups. The evaluation of the technical properties of the test battery included content validation by subject matter experts, item analysis and coefficient alpha, test–retest reliability, split-half reliability, and analysis of concurrent validity with the Woodcock Johnson III Tests of Cognitive Abilities and Tests of Achievement.Results: Results indicated strong sources of evidence of validity and reliability for the test, including internal consistency reliability coefficients ranging from 0.87 to 0.98, test–retest reliability coefficients ranging from 0.69 to 0.91, split-half reliability coefficients ranging from 0.87 to 0.91, and concurrent validity coefficients ranging from 0.53 to 0.93.Conclusion: The Gibson Test of Cognitive Skills-2 is a reliable and valid tool for assessing cognition in the general population across the lifespan. Keywords: testing, cognitive skills, memory, processing speed, visual processing, auditory processing

  6. Acquiring skills in malignant hyperthermia crisis management: comparison of high-fidelity simulation versus computer-based case study

    Directory of Open Access Journals (Sweden)

    Vilma Mejía

    Full Text Available Abstract Introduction: The primary purpose of this study was to compare the effect of high fidelity simulation versus a computer-based case solving self-study, in skills acquisition about malignant hyperthermia on first year anesthesiology residents. Methods: After institutional ethical committee approval, 31 first year anesthesiology residents were enrolled in this prospective randomized single-blinded study. Participants were randomized to either a High Fidelity Simulation Scenario or a computer-based Case Study about malignant hyperthermia. After the intervention, all subjects' performance in was assessed through a high fidelity simulation scenario using a previously validated assessment rubric. Additionally, knowledge tests and a satisfaction survey were applied. Finally, a semi-structured interview was done to assess self-perception of reasoning process and decision-making. Results: 28 first year residents finished successfully the study. Resident's management skill scores were globally higher in High Fidelity Simulation versus Case Study, however they were significant in 4 of the 8 performance rubric elements: recognize signs and symptoms (p = 0.025, prioritization of initial actions of management (p = 0.003, recognize complications (p = 0.025 and communication (p = 0.025. Average scores from pre- and post-test knowledge questionnaires improved from 74% to 85% in the High Fidelity Simulation group, and decreased from 78% to 75% in the Case Study group (p = 0.032. Regarding the qualitative analysis, there was no difference in factors influencing the student's process of reasoning and decision-making with both teaching strategies. Conclusion: Simulation-based training with a malignant hyperthermia high-fidelity scenario was superior to computer-based case study, improving knowledge and skills in malignant hyperthermia crisis management, with a very good satisfaction level in anesthesia residents.

  7. Challenge Course Facilitator Technical Skills Assessment Tool Mark

    Science.gov (United States)

    Wagstaff, William Quinn

    2007-01-01

    A study was conducted to develop a technical skills assessment tool for the training and development of challenge course facilitators. Researchers accessed two professional on-line listserves to collect a sample size of twenty-seven currently used technical skills assessment tools. The assessment tools were critically analysed by three independent…

  8. Brief Report: Suitability of the Social Skills Performance Assessment (SSPA) for the Assessment of Social Skills in Adults with Autism Spectrum Disorders

    Science.gov (United States)

    Verhoeven, E. W. M.; Smeekens, I.; Didden, R.

    2013-01-01

    The present study aims at examining whether the "Social Skills Performance Assessment" (SSPA; Patterson et al. in "Schizophr Res" 48(2-3):351-360, 2001) is a suitable performance-based measure to assess social skills in adults with autism spectrum disorders (ASD). For this purpose, social skills of individuals with ASD and…

  9. An Exploratory Study to Assess Analytical and Logical Thinking Skills of the Software Practitioners using a Gamification Perspective

    Directory of Open Access Journals (Sweden)

    Şahin KAYALI

    2016-12-01

    Full Text Available The link between analytical and logical thinking skills and success of software practitioners attracted an increasing attention in the last decade. Several studies report that the ability to think logically is a requirement for improving software development skills, which exhibits a strong reasoning. Additionally, analytical thinking is a vital part of software development for example while dividing a task into elemental parts with respect to basic rules and principles.  Using the basic essence of gamification, this study proposes a mobile testing platform for assessing analytical and logical thinking skills of software practitioners as well as computer engineering students. The assessment questions were taken from the literature and transformed into a gamified tool based on the software requirements. A focus group study was conducted to capture the requirements. Using the Delphi method, these requirements were discussed by a group of experts to reach a multidisciplinary understanding where a level of moderate agreement has been achieved. In light of these, an assessment tool was developed, which was tested on both software practitioners from the industry and senior computer engineering students. Our results suggest that individuals who exhibit skills in analytical and logical thinking are also more inclined to be successful in software development.

  10. Greek Undergraduate Physical Education Students' Basic Computer Skills

    Science.gov (United States)

    Adamakis, Manolis; Zounhia, Katerina

    2013-01-01

    The purposes of this study were to determine how undergraduate physical education (PE) students feel about their level of competence concerning basic computer skills and to examine possible differences between groups (gender, specialization, high school graduation type, and high school direction). Although many students and educators believe…

  11. Assessment of the critical thinking skills of student radiographers

    Energy Technology Data Exchange (ETDEWEB)

    Castle, Alan [University of Portsmouth, Centre for Radiography Education, St George' s Building, Portsmouth PO1 2HY (United Kingdom)]. E-mail: alan.castle@port.ac.uk

    2006-05-15

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills.

  12. Assessment of the critical thinking skills of student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2006-01-01

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills

  13. The effectiveness of the Geritalk communication skills course: a real-time assessment of skill acquisition and deliberate practice.

    Science.gov (United States)

    Gelfman, Laura P; Lindenberger, Elizabeth; Fernandez, Helen; Goldberg, Gabrielle R; Lim, Betty B; Litrivis, Evgenia; O'Neill, Lynn; Smith, Cardinale B; Kelley, Amy S

    2014-10-01

    Communication skills are critical in Geriatrics and Palliative Medicine because these patients confront complex clinical scenarios. We evaluated the effectiveness of the Geritalk communication skills course by comparing pre- and post-course real-time assessment of the participants leading family meetings. We also evaluated the participants' sustained skills practice. We compare the participants' skill acquisition before and after Geritalk using a direct observation Family Meeting Communication Assessment Tool and assess their deliberate practice at follow-up. First-year Geriatrics or Palliative Medicine fellows at Mount Sinai Medical Center and the James J. Peters Bronx VA Medical Center participated in Geritalk. Pre- and post-course family meeting assessments were compared. An average net gain of 6.8 skills represented a greater than 20% improvement in use of applicable skills. At two month follow-up, most participants reported deliberate practice of fundamental and advanced skills. This intensive training and family meeting assessment offers evidence-based communication skills training. Published by Elsevier Inc.

  14. Teamwork Skills Assessment for Cooperative Learning

    Science.gov (United States)

    Strom, Paris S.; Strom, Robert D.

    2011-01-01

    Teamwork skills are required at work, but teacher efforts in many countries to track achievement within this context have been hindered by lack of assessment tools and input from students. The Teamwork Skills Inventory relies on peer and self-evaluation to establish accountability, identify competencies, and detect learning needs. Twenty-five…

  15. Assessing problem-solving skills in construction education with the virtual construction simulator

    Science.gov (United States)

    Castronovo, Fadi

    The ability to solve complex problems is an essential skill that a construction and project manager must possess when entering the architectural, engineering, and construction industry. Such ability requires a mixture of problem-solving skills, ranging from lower to higher order thinking skills, composed of cognitive and metacognitive processes. These skills include the ability to develop and evaluate construction plans and manage the execution of such plans. However, in a typical construction program, introducing students to such complex problems can be a challenge, and most commonly the learner is presented with only part of a complex problem. To support this challenge, the traditional methodology of delivering design, engineering, and construction instruction has been going through a technological revolution, due to the rise of computer-based technology. For example, in construction classrooms, and other disciplines, simulations and educational games are being utilized to support the development of problem-solving skills. Previous engineering education research has illustrated the high potential that simulations and educational games have in engaging in lower and higher order thinking skills. Such research illustrated their capacity to support the development of problem-solving skills. This research presents evidence supporting the theory that educational simulation games can help with the learning and retention of transferable problem-solving skills, which are necessary to solve complex construction problems. The educational simulation game employed in this study is the Virtual Construction Simulator (VCS). The VCS is a game developed to provide students in an engaging learning activity that simulates the planning and managing phases of a construction project. Assessment of the third iteration of the VCS(3) game has shown pedagogical value in promoting students' motivation and a basic understanding of construction concepts. To further evaluate the benefits on

  16. Building Professionalism and Employability Skills: Embedding Employer Engagement within First-Year Computing Modules

    Science.gov (United States)

    Hanna, Philip; Allen, Angela; Kane, Russell; Anderson, Neil; McGowan, Aidan; Collins, Matthew; Hutchison, Malcolm

    2015-01-01

    This paper outlines a means of improving the employability skills of first-year university students through a closely integrated model of employer engagement within computer science modules. The outlined approach illustrates how employability skills, including communication, teamwork and time management skills, can be contextualised in a manner…

  17. [Acquiring skills in malignant hyperthermia crisis management: comparison of high-fidelity simulation versus computer-based case study].

    Science.gov (United States)

    Mejía, Vilma; Gonzalez, Carlos; Delfino, Alejandro E; Altermatt, Fernando R; Corvetto, Marcia A

    The primary purpose of this study was to compare the effect of high fidelity simulation versus a computer-based case solving self-study, in skills acquisition about malignant hyperthermia on first year anesthesiology residents. After institutional ethical committee approval, 31 first year anesthesiology residents were enrolled in this prospective randomized single-blinded study. Participants were randomized to either a High Fidelity Simulation Scenario or a computer-based Case Study about malignant hyperthermia. After the intervention, all subjects' performance in was assessed through a high fidelity simulation scenario using a previously validated assessment rubric. Additionally, knowledge tests and a satisfaction survey were applied. Finally, a semi-structured interview was done to assess self-perception of reasoning process and decision-making. 28 first year residents finished successfully the study. Resident's management skill scores were globally higher in High Fidelity Simulation versus Case Study, however they were significant in 4 of the 8 performance rubric elements: recognize signs and symptoms (p = 0.025), prioritization of initial actions of management (p = 0.003), recognize complications (p = 0.025) and communication (p = 0.025). Average scores from pre- and post-test knowledge questionnaires improved from 74% to 85% in the High Fidelity Simulation group, and decreased from 78% to 75% in the Case Study group (p = 0.032). Regarding the qualitative analysis, there was no difference in factors influencing the student's process of reasoning and decision-making with both teaching strategies. Simulation-based training with a malignant hyperthermia high-fidelity scenario was superior to computer-based case study, improving knowledge and skills in malignant hyperthermia crisis management, with a very good satisfaction level in anesthesia residents. Copyright © 2018 Sociedade Brasileira de Anestesiologia. Publicado por Elsevier Editora Ltda. All rights

  18. Assessing Business Student Thinking Skills

    Science.gov (United States)

    Smith, Gerald F.

    2014-01-01

    The development of student thinking skills is a major goal of business education. As with other such goals, student outcomes assessment must be undertaken to measure goal achievement. Thinking is difficult to teach; it is also difficult to assess. The purpose of this article is to improve management educators' understanding of student thinking…

  19. Using NCLab-karel to improve computational thinking skill of junior high school students

    Science.gov (United States)

    Kusnendar, J.; Prabawa, H. W.

    2018-05-01

    Increasingly human interaction with technology and the increasingly complex development of digital technology world make the theme of computer science education interesting to study. Previous studies on Computer Literacy and Competency reveal that Indonesian teachers in general have fairly high computational skill, but their skill utilization are limited to some applications. This engenders limited and minimum computer-related learning for the students. On the other hand, computer science education is considered unrelated to real-world solutions. This paper attempts to address the utilization of NCLab- Karel in shaping the computational thinking in students. This computational thinking is believed to be able to making learn students about technology. Implementation of Karel utilization provides information that Karel is able to increase student interest in studying computational material, especially algorithm. Observations made during the learning process also indicate the growth and development of computing mindset in students.

  20. A Perkins Challenge: Assessing Technical Skills in CTE

    Science.gov (United States)

    Stone, James R., III

    2009-01-01

    Federal law requires state to develop performance measures and data-collection systems for secondary and postsecondary technical-skill attainment. This poses many challenges, such as defining a technical skills, measurement and when to assess students. In this article, the author outlines various assessment models and looks at the challenges…

  1. A multi-media computer program for training in basic professional counseling skills

    NARCIS (Netherlands)

    Adema, J.; Van der Zee, K.I.

    2003-01-01

    This paper concerns the development of a self-instructional program for training in basic counseling skills. The product was a multimedia computer program, named GEVAT. The training under consideration was based on a traditional training in which students enhance these skills under supervision.

  2. Indicators of computer skill use among university students. Educational and social implications

    Directory of Open Access Journals (Sweden)

    María del Pilar QUICIOS GARCÍA

    2013-07-01

    Full Text Available This article divulges the findings of the preliminary study for Research Project SEJ 2004-06803 I+D. It provides indicators of the use of the computer skills developed by two groups of Spanish university students. It then indicates the training the sample groups under study declared necessary in order to gain autonomy in their use of computer skills. The sample groups analyzed were two groups of students enrolled in the first year of the audiovisual communication curriculum and the third year of the journalism curriculum at the Complutensian University of Madrid. Each group was made up of 60 students who answered a quantitative questionnaire (Likert scale and a series of questions requiring qualitative answers. One finding was that age is not a telling factor in the use of computer skills, nor is the curriculum a student has chosen to follow. The declared educational needs include systematic instruction in tools and educational training that places limits on the relational use of virtual tools.

  3. Digitalization of Education System and Teacher Educators' Computer Skill in Bangladesh

    Science.gov (United States)

    Rahman, Mohammad Ataur

    2011-01-01

    This study examined how teacher educators perceive the incorporation and use of computer technology resources in Teachers' Training Colleges in Bangladesh. This study encompasses the thorough investigation of teacher educators' "computer skills" by using the valid and reliable instruments. The study finally examined whether any…

  4. The use of advanced physical assessment skills by cardiac nurses.

    Science.gov (United States)

    Edmunds, Linda; Ward, Susan; Barnes, Rhian

    To establish what advanced physical assessment skills are being used by cardiac nurses after they undertook a clinical patient assessment module; and to explore the factors that influence their use of these skills. A longitudinal descriptive approach using convenience sampling was employed. Qualitative data was obtained from individual interviews, non-participant observation within the participants' clinical environment and self-reported activity logs. Five key themes emerged: use of advanced physical assessment skills varied; use and development of skills was linked to personal characteristics; use influenced by perceptions of role boundaries, permission and cooperation; use influenced by participants' perception of nursing and the development of their own nursing practice; and use influenced by the physical environment and the human support within it. Cardiac nurses selectively use physical assessment skills, predominately related to the cardiorespiratory systems. Organisational structure, professional relationships and the professionalism of the individual nurse appear to play a significant part in the use of physical assessment skills. Although the findings from this qualitative study cannot be generalized, they concur with findings from recent research into physical assessment skills used by a variety of UK nurses. The implications identified are: first, for those who provide the education, in terms of what should be taught and facilitated; and second, for organizations, in ensuring staff have assessment skills relevant to their role and that systems are in place to enable the development of a supportive and progressive culture that embraces modernization congruent with healthcare policy.

  5. Mobile computing deployment and management real world skills for Comptia Mobility+ certification and beyond

    CERN Document Server

    Bartz, Robert J

    2015-01-01

    Mobile computing skills are becoming standard in the IT industry Mobile Computing Deployment and Management: Real World Skills for CompTIA Mobility+ Certification and Beyond is the ultimate reference for mobile computing. Certified Wireless Network Expert Robert J. Bartz guides IT and networking professionals through the fundamental and advanced concepts of mobile computing, providing the information and instruction necessary to get up to speed on current technology and best practices. The book maps to the CompTIA Mobility+ (MB0-001) exam, making it an ideal resource for those s

  6. Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills

    Science.gov (United States)

    Polyak, Stephen T.; von Davier, Alina A.; Peterschmidt, Kurt

    2017-01-01

    This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD) and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses. PMID:29238314

  7. Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills

    Directory of Open Access Journals (Sweden)

    Stephen T. Polyak

    2017-11-01

    Full Text Available This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses.

  8. Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills.

    Science.gov (United States)

    Polyak, Stephen T; von Davier, Alina A; Peterschmidt, Kurt

    2017-01-01

    This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD) and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses.

  9. Commentary on: "Toward Computer-Based Support of Metacognitive Skills: A Computational Framework to Coach Self Explanation"

    Science.gov (United States)

    Conati, Cristina

    2016-01-01

    This paper is a commentary on "Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation", by Cristina Conati and Kurt Vanlehn, published in the "IJAED" in 2000 (Conati and VanLehn 2010). This work was one of the first examples of Intelligent Learning Environments (ILE) that…

  10. Comparison between young male drivers' self-assessed and objectively measured driving skills

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Self-assessment of skills is a self-generated feedback process that contributes to confidence in one's skills. The higher one's self-assessed skills, the more likely one is to feel competent a particular domain thereby influencing the related behaviors. Drivers' self-assessed driving skills...... are not always accurate, which may cause serious problems such as underestimation of risk, reckless driving and accidents. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aim of this study was to test the accuracy...

  11. Language Needs Analysis of Iranian Undergraduate Students of Computer Engineering: A Study of Reading Skill

    Directory of Open Access Journals (Sweden)

    Alireza Fard-Kashani

    2015-10-01

    Full Text Available The current study aimed at diagnosing the language needs of Iranian undergraduate students of computer engineering in order to find out whether there is any significant difference in perceptions between the students and their ESAP (English for Specific Academic Purpose teachers, concerning their Reading skill needs. To conduct the intended research study, both qualitative and quantitative approaches were taken. The quantitative approach included the use of self-assessment, and two questionnaires, and the qualitative approach included participant observation. The questionnaires were adapted from Atai and Shoja (2009, and were distributed among 500 undergraduate students of computer engineering and 30 ESAP teachers who were chosen randomly through cluster sampling method from thirteen universities. Mann-Whitney U-test results showed that there was a significant difference between perceptions of the students and their teachers about their Reading skill needs and ‘Reading’ was mentioned as one of the most difficult skills for the students. Moreover, it was found that the majority of students suffered from low level of General English Language Proficiency, and also ‘low motivation’ and the ‘character’ of teachers were found to be important factors affecting students’ learning. Keywords: Needs analysis, English for specific purposes, English for academic purposes, Present situation analysis, Target situation analysis

  12. Clinical skills assessment of procedural and advanced communication skills: performance expectations of residency program directors

    Science.gov (United States)

    Langenau, Erik E.; Zhang, Xiuyuan; Roberts, William L.; DeChamplain, Andre F.; Boulet, John R.

    2012-01-01

    Background High stakes medical licensing programs are planning to augment and adapt current examinations to be relevant for a two-decision point model for licensure: entry into supervised practice and entry into unsupervised practice. Therefore, identifying which skills should be assessed at each decision point is critical for informing examination development, and gathering input from residency program directors is important. Methods Using data from previously developed surveys and expert panels, a web-delivered survey was distributed to 3,443 residency program directors. For each of the 28 procedural and 18 advanced communication skills, program directors were asked which clinical skills should be assessed, by whom, when, and how. Descriptive statistics were collected, and Intraclass Correlations (ICC) were conducted to determine consistency across different specialties. Results Among 347 respondents, program directors reported that all advanced communication and some procedural tasks are important to assess. The following procedures were considered ‘important’ or ‘extremely important’ to assess: sterile technique (93.8%), advanced cardiovascular life support (ACLS) (91.1%), basic life support (BLS) (90.0%), interpretation of electrocardiogram (89.4%) and blood gas (88.7%). Program directors reported that most clinical skills should be assessed at the end of the first year of residency (or later) and not before graduation from medical school. A minority were considered important to assess prior to the start of residency training: demonstration of respectfulness (64%), sterile technique (67.2%), BLS (68.9%), ACLS (65.9%) and phlebotomy (63.5%). Discussion Results from this study support that assessing procedural skills such as cardiac resuscitation, sterile technique, and phlebotomy would be amenable to assessment at the end of medical school, but most procedural and advanced communications skills would be amenable to assessment at the end of the first

  13. A Procedural Skills OSCE: Assessing Technical and Non-Technical Skills of Internal Medicine Residents

    Science.gov (United States)

    Pugh, Debra; Hamstra, Stanley J.; Wood, Timothy J.; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

    2015-01-01

    Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

  14. ASSESSMENT OF KNOWLEDGE AND ATTITUDE OF COMPUTER ASSISTED LEARNING AMONG MEDICAL STUDENTS

    Directory of Open Access Journals (Sweden)

    Ravish

    2015-12-01

    Full Text Available INTRODUCTION: It is going truth globally that the medical course in medical college students are developed via computer mediated learning.1 Utilization of both the range upon online messages options must create study exciting, monetization, and likely as hired. We Hypothesized that survey will facilitate to permit us to be able to blueprint some on this necessary condition among my medical students and also to improve our study facilities a lot of automatically. A set of closed ended problems remained displayed on departmental website, to evaluate their computer skills and talents and their own assessment in computer and internet skills helping in learning. In the beginning months of 1st year MBBS college students 2014-15 batch taken up voluntarily to the study through MCQs questions provided to them in the form of departmental website. A batch of 50 college students surveyed on 3 different days. Although 80% students were confident with the operational skills of the computer, the opinion regarding the usage of computers for web based learning activities was not uniform i.e., 55% of the participants felt uncomfortable with web assisted activity in comparison to paper based activity. However, 49% were of the opinion that paper based activity might become redundant and websites will take over books in the future. Expansion on computer-assisted study requires traditional changes as well as thoughtful strategic planning, resource giving, staff benefits, Edutainment promotion by multidisciplinary working, and efficient quality control.

  15. Computers and the Future of Skill Demand. Educational Research and Innovation Series

    Science.gov (United States)

    Elliott, Stuart W.

    2017-01-01

    Computer scientists are working on reproducing all human skills using artificial intelligence, machine learning and robotics. Unsurprisingly then, many people worry that these advances will dramatically change work skills in the years ahead and perhaps leave many workers unemployable. This report develops a new approach to understanding these…

  16. Assessing Faculty Beliefs about the Importance of Various Marketing Job Skills

    Science.gov (United States)

    Hyman, Michael R.; Hu, Jing

    2005-01-01

    The need to improve the professional skills of those with marketing degrees has spurred surveys of current students, alumni, practitioners, and faculty about the importance of various professional skills; however, previous surveys of marketing faculty have focused only on computer skills. To address this limitation, the goals of this study were…

  17. Tactical and operational response to major incidents: feasibility and reliability of skills assessment using novel virtual environments.

    Science.gov (United States)

    Cohen, Daniel; Sevdalis, Nick; Patel, Vishal; Taylor, Michael; Lee, Henry; Vokes, Mick; Heys, Mick; Taylor, David; Batrick, Nicola; Darzi, Ara

    2013-07-01

    To determine feasibility and reliability of skills assessment in a multi-agency, triple-site major incident response exercise carried out in a virtual world environment. Skills assessment was carried out across three scenarios. The pre-hospital scenario required paramedics to triage and treat casualties at the site of an explosion. Technical skills assessment forms were developed using training syllabus competencies and national guidelines identified by pre-hospital response experts. Non-technical skills were assessed using a seven-point scale previously developed for use by pre-hospital paramedics. The two in-hospital scenarios, focusing on a trauma team leader and a silver/clinical major incident co-ordinator, utilised the validated Trauma-NOTECHS scale to assess five domains of performance. Technical competencies were assessed using an ATLS-style competency scale for the trauma scenario. For the silver scenario, the assessment document was developed using competencies described from a similar role description in a real-life hospital major incident plan. The technical and non-technical performance of all participants was assessed live by two experts in each of the three scenarios and inter-assessor reliability was computed. Participants also self-assessed their performance using identical proformas immediately after the scenarios were completed. Self and expert assessments were correlated (assessment cross-validation). Twenty-three participants underwent all scenarios and assessments. Performance assessments were feasible for both experts as well as the participants. Non-technical performance was generally scored higher than technical performance. Very good inter-rater reliability was obtained between expert raters across all scenarios and both technical and non-technical aspects of performance (reliability range 0.59-0.90, Psassessment in technical skills across all three scenarios (correlation range 0.52-0.84, Psskills. This study establishes feasibility and

  18. Developing Decision-Making Skill: Experiential Learning in Computer Games

    OpenAIRE

    Kurt A. April; Katja M. J. Goebel; Eddie Blass; Jonathan Foster-Pedley

    2012-01-01

    This paper explores the value that computer and video games bring to learning and leadership and explores how games work as learning environments and the impact they have on personal development. The study looks at decisiveness, decision-making ability and styles, and on how this leadership-related skill is learnt through different paradigms. The paper compares the learning from a lecture to the learning from a designed computer game, both of which have the same content through the use of a s...

  19. Content Analysis in Computer-Mediated Communication: Analyzing Models for Assessing Critical Thinking through the Lens of Social Constructivism

    Science.gov (United States)

    Buraphadeja, Vasa; Dawson, Kara

    2008-01-01

    This article reviews content analysis studies aimed to assess critical thinking in computer-mediated communication. It also discusses theories and content analysis models that encourage critical thinking skills in asynchronous learning environments and reviews theories and factors that may foster critical thinking skills and new knowledge…

  20. Students Computer Skills in Faculty of Education

    OpenAIRE

    Mehmet Caglar; Mukaddes Sakalli Demirok

    2010-01-01

    Nowadays; the usage of technology is not a privilege but an obligation. Technological developments influence structures andfunctions of educational institutions. It is also expected from the teachers that they integrate technology in their lessons inorder to educate the individuals of information society. This research has covered 145(68 female, 78 male) students, studying inNear East University Faculty of Education. The Computer Skills Scale developed by Güçlü (2010) was used as a data colle...

  1. Development and validation of the computer technology literacy self-assessment scale for Taiwanese elementary school students.

    Science.gov (United States)

    Chang, Chiung-Sui

    2008-01-01

    The purpose of this study was to describe the development and validation of an instrument to identify various dimensions of the computer technology literacy self-assessment scale (CTLS) for elementary school students. The instrument included five CTLS dimensions (subscales): the technology operation skills, the computer usages concepts, the attitudes toward computer technology, the learning with technology, and the Internet operation skills. Participants were 1,539 elementary school students in Taiwan. Data analysis indicated that the instrument developed in the study had satisfactory validity and reliability. Correlations analysis supported the legitimacy of using multiple dimensions in representing students' computer technology literacy. Significant differences were found between male and female students, and between grades on some CTLS dimensions. Suggestions are made for use of the instrument to examine complicated interplays between students' computer behaviors and their computer technology literacy.

  2. Setting pass scores for clinical skills assessment.

    Science.gov (United States)

    Liu, Min; Liu, Keh-Min

    2008-12-01

    In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  3. A comparison of students' self-assessments with faculty evaluations of their communication skills.

    Science.gov (United States)

    Lundquist, Lisa M; Shogbon, Angela O; Momary, Kathryn M; Rogers, Hannah K

    2013-05-13

    To compare students' self-assessment of their communication skills with faculty members' formal evaluation of their skills in a therapeutics course. Over a 3-year period, faculty members evaluated second-year pharmacy students' communication skills as part of a requirement in a therapeutics course. Immediately following an individual oral assessment and again following a group oral assessment, students self-assessed their communication skills using the same rubric the faculty members had used. Students' self-assessments were then compared with faculty members' evaluation of students' communication skills. Four hundred one (97.3%) students consented to participate in this study. Faculty evaluation scores of students for both the individual and group oral assessments were significantly higher than students' self-assessment scores. Students' self-assessment scores of their communication skills increased from the individual to the group oral assessment. Students' self-assessments of communication skills were consistently lower than faculty members' evaluations. Greater use of oral assessments throughout the pharmacy curriculum may help to improve students' confidence in and self-assessment of their communication skills.

  4. Individualized Special Education with Cognitive Skill Assessment.

    Science.gov (United States)

    Kurhila, Jaakko; Laine, Tei

    2000-01-01

    Describes AHMED (Adaptive and Assistive Hypermedia in Education), a computer learning environment which supports the evaluation of disabled children's cognitive skills in addition to supporting openness in learning materials and adaptivity in learning events. Discusses cognitive modeling and compares it to previous intelligent tutoring systems.…

  5. Cross-platform digital assessment forms for evaluating surgical skills

    DEFF Research Database (Denmark)

    Andersen, Steven Arild Wuyts

    2015-01-01

    developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion......A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex...... assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database...

  6. Discussion of skill improvement in marine ecosystem dynamic models based on parameter optimization and skill assessment

    Science.gov (United States)

    Shen, Chengcheng; Shi, Honghua; Liu, Yongzhi; Li, Fen; Ding, Dewen

    2016-07-01

    Marine ecosystem dynamic models (MEDMs) are important tools for the simulation and prediction of marine ecosystems. This article summarizes the methods and strategies used for the improvement and assessment of MEDM skill, and it attempts to establish a technical framework to inspire further ideas concerning MEDM skill improvement. The skill of MEDMs can be improved by parameter optimization (PO), which is an important step in model calibration. An efficient approach to solve the problem of PO constrained by MEDMs is the global treatment of both sensitivity analysis and PO. Model validation is an essential step following PO, which validates the efficiency of model calibration by analyzing and estimating the goodness-of-fit of the optimized model. Additionally, by focusing on the degree of impact of various factors on model skill, model uncertainty analysis can supply model users with a quantitative assessment of model confidence. Research on MEDMs is ongoing; however, improvement in model skill still lacks global treatments and its assessment is not integrated. Thus, the predictive performance of MEDMs is not strong and model uncertainties lack quantitative descriptions, limiting their application. Therefore, a large number of case studies concerning model skill should be performed to promote the development of a scientific and normative technical framework for the improvement of MEDM skill.

  7. ARAC: a computer-based emergency dose-assessment service

    International Nuclear Information System (INIS)

    Sullivan, T.J.

    1990-01-01

    Over the past 15 years, the Lawrence Livermore National Laboratory's Atmospheric Release Advisory Capability (ARAC) has developed and evolved a computer-based, real-time, radiological-dose-assessment service for the United States Departments of Energy and Defense. This service is built on the integrated components of real-time computer-acquired meteorological data, extensive computer databases, numerical atmospheric-dispersion models, graphical displays, and operational-assessment-staff expertise. The focus of ARAC is the off-site problem where regional meteorology and topography are dominant influences on transport and dispersion. Through application to numerous radiological accidents/releases on scales from small accidental ventings to the Chernobyl reactor disaster, ARAC has developed methods to provide emergency dose assessments from the local to the hemispheric scale. As the power of computers has evolved inversely with respect to cost and size, ARAC has expanded its service and reduced the response time from hours to minutes for an accident within the United States. Concurrently the quality of the assessments has improved as more advanced models have been developed and incorporated into the ARAC system. Over the past six years, the number of directly connected facilities has increased from 6 to 73. All major U.S. Federal agencies now have access to ARAC via the Department of Energy. This assures a level of consistency as well as experience. ARAC maintains its real-time skills by participation in approximately 150 exercises per year; ARAC also continuously validates its modeling systems by application to all available tracer experiments and data sets

  8. The effects of computer-aided design software on engineering students' spatial visualisation skills

    Science.gov (United States)

    Kösa, Temel; Karakuş, Fatih

    2018-03-01

    The purpose of this study was to determine the influence of computer-aided design (CAD) software-based instruction on the spatial visualisation skills of freshman engineering students in a computer-aided engineering drawing course. A quasi-experimental design was applied, using the Purdue Spatial Visualization Test-Visualization of Rotations (PSVT:R) for both the pre- and the post-test. The participants were 116 freshman students in the first year of their undergraduate programme in the Department of Mechanical Engineering at a university in Turkey. A total of 72 students comprised the experimental group; they were instructed with CAD-based activities in an engineering drawing course. The control group consisted of 44 students who did not attend this course. The results of the study showed that a CAD-based engineering drawing course had a positive effect on developing engineering students' spatial visualisation skills. Additionally, the results of the study showed that spatial visualisation skills can be a predictor for success in a computer-aided engineering drawing course.

  9. MODEL AUTHENTIC SELF-ASSESSMENT DALAM PENGEMBANGAN EMPLOYABILITY SKILLS MAHASISWA PENDIDIKAN TINGGI VOKASI

    Directory of Open Access Journals (Sweden)

    I Made Suarta

    2015-06-01

    ______________________________________________________________ AUTHENTIC SELF-ASSESSMENT MODEL FOR DEVELOPING EMPLOYABILITY SKILLS STUDENT IN HIGHER VOCATIONAL EDUCATION Abstract The purpose of this research is to develop assessment tools to evaluate achievement of employability skills which are integrated in the learning database applications. The assessment model developed is a combination of self-assessment and authentic assessment, proposed as models of authentic self-assessment. The steps of developing authentic self-assessment models include: identifying the standards, selecting an authentic task, identifying the criteria for the task, and creating the rubric. The results of development assessment tools include: (1 problem solving skills assessment model, (2 self-management skills assessment model, and (3 competence database applications assessment model. This model can be used to assess the cognitive, affective, and psychomotor achievement. The results indicate: achievement of problem solving and self-management ability was in good category, and competencies in designing conceptual and logical database was in high category. This model also has met the basic principles of assessment, i.e.: validity, reliability, focused on competencies, comprehen-sive, objectivity, and the principle of educating. Keywords: authentic assessment, self-assessment, problem solving skills, self-management skills, vocational education

  10. Comparing the self-assessed and examiner-assessed driving skills of Japanese driving school students

    Directory of Open Access Journals (Sweden)

    Hiroshi Nakai

    2012-03-01

    A sample of Japanese driving test candidates (n=2021 completed a self-assessment using a 5-point scale applied to 19 items. The candidates completed the assessment shortly after passing their practical driving test conducted at a driving school. Their performance was also assessed by an examiner who used the same scale. The comparison between self-assessment and examiner-assessment revealed that around 40% of Japanese driving school students made a realistic assessment of their skills. With regard to the gender differences, although males displayed higher levels of overconfidence than females did, the differences were not as large as earlier studies with questionnaires had suggested. Furthermore, the effect of age on the accuracy of novice drivers' skill assessment was found to be relatively small. Our findings, which are based on a comparison of subjective assessments of driving skills between examiners and novices, instead of a questionable method which relies on a comparison with a hypothetical average driver, suggest that the majority of candidates in fact do not overrate their own skills. These results were discussed from the viewpoint of the driver education system and compared to other European research using the same framework.

  11. Setting Pass Scores for Clinical Skills Assessment

    Directory of Open Access Journals (Sweden)

    Min Liu

    2008-12-01

    Full Text Available In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  12. A qualitative study of advanced nurse practitioners' use of physical assessment skills in the community: shifting skills across professional boundaries.

    Science.gov (United States)

    Raleigh, Mary; Allan, Helen

    2017-07-01

    To explore multiple perspectives on the use of physical assessment skills by advanced nurse practitioners in the UK. Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by advanced nurse practitioners in the community. Case study. A qualitative interpretative single-embedded case study of 22 participants from South of England. A framework method analysed interview data collected by the researcher between March-August 2013. Participants included nurses, doctors, nurse educators and managers. Physical assessment skills education at universities is part of a policy shift to develop a flexible workforce in the UK. Shared physical assessment practices are less to do with role substitution and more about preparing practitioners with skills that are fit for purpose. Competence, capability and performance with physical assessment skills are an expectation of advanced nursing practice. These skills are used successfully by community advanced nurse practitioners to deliver a wide range of services in response to changing patient need. The introduction of physical assessment skills education to undergraduate professional preparation would create a firm foundation to develop these skills in postgraduate education. Physical assessment education prepares nurses with the clinical competencies to carry out healthcare reforms in the UK. Shared sets of clinical assessment competencies between disciplines have better outcomes for patients. Levels of assessment competence can depend on the professional attributes of individual practitioners. Unsupportive learning cultures can hinder professional development of advanced nursing practice. © 2016 John Wiley & Sons Ltd.

  13. How Effective Are Self- and Peer Assessment of Oral Presentation Skills Compared with Teachers' Assessments?

    Science.gov (United States)

    De Grez, Luc; Valcke, Martin; Roozen, Irene

    2012-01-01

    Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the…

  14. Defining and assessing critical thinking skills for student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2009-01-01

    Developing critical thinking skills is a key aim of higher education and is important in preparing student radiographers for their future careers in clinical practice. The aim of this paper was to attempt to devise and assess six key components of critical thinking appropriate for radiographic practice. Each of the six components was divided into three dimensions and a Critical Thinking Skills Scoring Chart (CTSSC) devised to assess students' written performance against each dimension. Scores revealed that approximately 30% of students were rated as good and approximately 10% of students were rated as poor in each component, although there was some variability between different dimensions. It is suggested that educators need to encourage and support students to develop their critical thinking skills by reviewing their curriculum to clearly define specific skills and ensure that they are appropriately taught and assessed

  15. Teachers' Support in Using Computers for Developing Students' Listening and Speaking Skills in Pre-Sessional English Courses

    Science.gov (United States)

    Zou, Bin

    2013-01-01

    Many computer-assisted language learning (CALL) studies have found that teacher direction can help learners develop language skills at their own pace on computers. However, many teachers still do not know how to provide support for students to use computers to reinforce the development of their language skills. Hence, more examples of CALL…

  16. Helpers' Self-Assessment Biases Before and after Helping Skills Training

    Science.gov (United States)

    Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L.; Van Broeck, Nady; Mikolajczak, Moïra

    2017-01-01

    Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

  17. Helpers' Self-Assessment Biases Before and after Helping Skills Training.

    Science.gov (United States)

    Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L; Van Broeck, Nady; Mikolajczak, Moïra

    2017-01-01

    Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

  18. Objective assessment of technical skills in surgery

    OpenAIRE

    Moorthy, Krishna; Munz, Yaron; Sarker, Sudip K; Darzi, Ara

    2003-01-01

    In the past few years, considerable developments have been made in the objective assessment of technical proficiency of surgeons. Technical skills should be assessed during training, and various methods have been developed for this purpose

  19. Automated surgical skill assessment in RMIS training.

    Science.gov (United States)

    Zia, Aneeq; Essa, Irfan

    2018-05-01

    Manual feedback in basic robot-assisted minimally invasive surgery (RMIS) training can consume a significant amount of time from expert surgeons' schedule and is prone to subjectivity. In this paper, we explore the usage of different holistic features for automated skill assessment using only robot kinematic data and propose a weighted feature fusion technique for improving score prediction performance. Moreover, we also propose a method for generating 'task highlights' which can give surgeons a more directed feedback regarding which segments had the most effect on the final skill score. We perform our experiments on the publicly available JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) and evaluate four different types of holistic features from robot kinematic data-sequential motion texture (SMT), discrete Fourier transform (DFT), discrete cosine transform (DCT) and approximate entropy (ApEn). The features are then used for skill classification and exact skill score prediction. Along with using these features individually, we also evaluate the performance using our proposed weighted combination technique. The task highlights are produced using DCT features. Our results demonstrate that these holistic features outperform all previous Hidden Markov Model (HMM)-based state-of-the-art methods for skill classification on the JIGSAWS dataset. Also, our proposed feature fusion strategy significantly improves performance for skill score predictions achieving up to 0.61 average spearman correlation coefficient. Moreover, we provide an analysis on how the proposed task highlights can relate to different surgical gestures within a task. Holistic features capturing global information from robot kinematic data can successfully be used for evaluating surgeon skill in basic surgical tasks on the da Vinci robot. Using the framework presented can potentially allow for real-time score feedback in RMIS training and help surgical trainees have more focused training.

  20. Rubric Authoring Tool Supporting Cognitive Skills Assessment across an Institution

    Science.gov (United States)

    Simper, Natalie

    2018-01-01

    This paper explores a method to support instructors in assessing cognitive skills in their course, designed to enable aggregation of data across an institution. A rubric authoring tool, "BASICS" (Building Assessment Scaffolds for Intellectual Cognitive Skills) was built as part of the Queen's University Learning Outcomes Assessment (LOA)…

  1. Medical and psychology students' self-assessed communication skills: A pilot study.

    Science.gov (United States)

    Tiuraniemi, Juhani; Läärä, Riitta; Kyrö, Tuuli; Lindeman, Sari

    2011-05-01

    The purpose of this study was to describe how psychology and medical students assess their own competency and skills before and after training, in which role-play was used to teach interpersonal and communication skills. Interpersonal and communication skills were assessed with a semi-structured questionnaire before and after the training. The students of both medicine and psychology estimated their skill levels to be higher after the course. The psychology students estimated their skills for communication, motivating interviewing, empathy and reflection, and change orientation to be better at the end of the course. Medical students estimated their communication skills, motivating interviewing skills, and change orientation skills to be better at the end of the course. Even a short period of training in interpersonal and communication skills can positively affect the self-assessed skills of the medical students. In the future, it would be worthwhile to pay attention to reflective teaching practices in the training of both medical and psychology students. The cognitive and emotional components of these practices help students to develop their own communication skills. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

  2. Crowd-sourced assessment of surgical skills in cricothyrotomy procedure.

    Science.gov (United States)

    Aghdasi, Nava; Bly, Randall; White, Lee W; Hannaford, Blake; Moe, Kris; Lendvay, Thomas S

    2015-06-15

    Objective assessment of surgical skills is resource intensive and requires valuable time of expert surgeons. The goal of this study was to assess the ability of a large group of laypersons using a crowd-sourcing tool to grade a surgical procedure (cricothyrotomy) performed on a simulator. The grading included an assessment of the entire procedure by completing an objective assessment of technical skills survey. Two groups of graders were recruited as follows: (1) Amazon Mechanical Turk users and (2) three expert surgeons from University of Washington Department of Otolaryngology. Graders were presented with a video of participants performing the procedure on the simulator and were asked to grade the video using the objective assessment of technical skills questions. Mechanical Turk users were paid $0.50 for each completed survey. It took 10 h to obtain all responses from 30 Mechanical Turk users for 26 training participants (26 videos/tasks), whereas it took 60 d for three expert surgeons to complete the same 26 tasks. The assessment of surgical performance by a group (n = 30) of laypersons matched the assessment by a group (n = 3) of expert surgeons with a good level of agreement determined by Cronbach alpha coefficient = 0.83. We found crowd sourcing was an efficient, accurate, and inexpensive method for skills assessment with a good level of agreement to experts' grading. Copyright © 2015 Elsevier Inc. All rights reserved.

  3. Computer Literacy Improvement Needs: Physicians' Self Assessment in the Makkah Region

    Directory of Open Access Journals (Sweden)

    Hani Abdulsattar Shaker

    2013-11-01

    Full Text Available Objective: A confidential inquiry by the Directorate General of health affairs, Makkah region, Saudi Arabia, found physicians were resistant to enter patient-related information in the electronic medical records system at different hospitals. This study aims to highlight their computer literacy needs.Methods: This cross-sectional survey was conducted on physicians using a structured questionnaire bearing nine questions/stems with dichotomous answers, (i.e., yes/no that was distributed among physicians at six different Ministry of Health hospitals in the Makkah Region, Saudi Arabia, between May and August 2009. The results for future needs in computer skills were categorized as "none" if the rate of answer "yes" to any stem was 0-25%, "little" if 26-50%, "some" if 51-75% and "substantial" if >75% rated "yes".Results: The response rate of 82% of determined sample size (n = 451 was attained. Computer literacy improvement elements (CLIE, i.e., "word processing software skills (MS Word", "presentation software skills (Power Point", "internet search skills", "medical database search skills", "spreadsheet software skills (Excel" and "advanced e-mail management skills" were in "substantial" need of improvement among the majority of settings and categories. All other computer literacy improvement elements were in "some" need of improvement.Conclusion: The overall outcome of this study indicates that physicians need further computer literacy improvements.

  4. Influence of Writing Ability and Computation Skill on Mathematics Writing

    Science.gov (United States)

    Powell, Sarah R.; Hebert, Michael A.

    2016-01-01

    Mathematics standards expect students to communicate about mathematics using oral and written methods, and some high-stakes assessments ask students to answer mathematics questions by writing. Assumptions about mathematics communication via writing include (a) students possess writing skill, (b) students can transfer this writing skill to…

  5. A Qualitative Study of Students' Computational Thinking Skills in a Data-Driven Computing Class

    Science.gov (United States)

    Yuen, Timothy T.; Robbins, Kay A.

    2014-01-01

    Critical thinking, problem solving, the use of tools, and the ability to consume and analyze information are important skills for the 21st century workforce. This article presents a qualitative case study that follows five undergraduate biology majors in a computer science course (CS0). This CS0 course teaches programming within a data-driven…

  6. A multilevel modeling approach to examining individual differences in skill acquisition for a computer-based task.

    Science.gov (United States)

    Nair, Sankaran N; Czaja, Sara J; Sharit, Joseph

    2007-06-01

    This article explores the role of age, cognitive abilities, prior experience, and knowledge in skill acquisition for a computer-based simulated customer service task. Fifty-two participants aged 50-80 performed the task over 4 consecutive days following training. They also completed a battery that assessed prior computer experience and cognitive abilities. The data indicated that overall quality and efficiency of performance improved with practice. The predictors of initial level of performance and rate of change in performance varied according to the performance parameter assessed. Age and fluid intelligence predicted initial level and rate of improvement in overall quality, whereas crystallized intelligence and age predicted initial e-mail processing time, and crystallized intelligence predicted rate of change in e-mail processing time over days. We discuss the implications of these findings for the design of intervention strategies.

  7. Integrating psychoeducation in a basic computer skills course for people suffering from social anxiety: participants' experiences

    Directory of Open Access Journals (Sweden)

    Löhr HD

    2011-08-01

    Full Text Available Hildegard D Löhr1,2, Jan H Rosenvinge1,3, Rolf Wynn2,41Division of General Psychiatry, University Hospital of North Norway, 2Telemedicine Research Group, Department of Clinical Medicine, Faculty of Health Sciences, 3Department of Psychology, Faculty of Health Sciences, University of Tromsø, 4Division of Addiction and Specialized Psychiatry, University Hospital of North Norway, Tromsø, NorwayAbstract: We describe a psychoeducational program integrated in a basic computer skills course for participants suffering from social anxiety. The two main aims of the course were: that the participants learn basic computer skills, and that the participants learn to cope better with social anxiety. Computer skills were taught by a qualified teacher. Psychoeducation and cognitive therapy skills, including topics such as anxiety coping, self-accept, and self-regulation, were taught by a clinical psychologist. Thirteen of 16 participants completed the course, which lasted 11 weeks. A qualitative analysis was performed, drawing on observations during the course and on interviews with the participants. The participants were positive about the integration of psychoeducation sessions in the computer course, and described positive outcomes for both elements, including improved computer skills, improved self-esteem, and reduced social anxiety. Most participants were motivated to undertake further occupational rehabilitation after the course.Keywords: cognitive therapy, information technology, occupational rehabilitation, psychoeducation, self-help, social anxiety

  8. The Effects of Computer-Assisted Instruction of Simple Circuits on Experimental Process Skills

    Directory of Open Access Journals (Sweden)

    Şeyma ULUKÖK

    2013-01-01

    Full Text Available The experimental and control groups were composed of 30 sophomores majoring in Classroom Teaching for this study investigating the effects of computer-assisted instruction of simple circuits on the development of experimental process skills. The instruction includes experiments and studies about simple circuits and its elements (serial, parallel, and mixed conncetions of resistors covered in Science and Technology Laboratory II course curriculum. In this study where quantitative and qualitative methods were used together, the control list developed by the researchers was used to collect data. Results showed that experimental process skills of sophomores in experimental group were more developed than that of those in control group. Thus, it can be said that computer-assisted instruction has a positive impact on the development of experimental process skills of students.

  9. The role of multimedia in surgical skills training and assessment.

    Science.gov (United States)

    Shariff, Umar; Seretis, Charalampos; Lee, Doreen; Balasubramanian, Saba P

    2016-06-01

    Multimedia is an educational resource that can be used to supplement surgical skills training. The aim of this review was to determine the role of multimedia in surgical training and assessment by performing a systematic review of the literature. A systematic review for published articles was conducted on the following databases: PubMed/MEDLINE (1992 to November 2014), SCOPUS (1992 to November 2014) and EMBASE (1992 to November 2014). For each study the educational content, study design, surgical skill assessed and outcomes were recorded. A standard data extraction form was created to ensure systematic retrieval of relevant information. 21 studies were included; 14 randomized controlled trials (RCTs) and 7 non-randomized controlled trials (Non-RCTs). Technical skills were assessed in 7 RCTs and 3 non-RCTs; cognitive skills were assessed in 9 RCTs and 4 non-RCTs. In controlled studies, multimedia was associated with significant improvement in technical skills (4 studies; 4 RCTs) and cognitive skills (7 studies; 6 RCTs). In two studies multimedia was inferior in comparison to conventional teaching. Evaluation of multimedia (9 studies) demonstrated strongly favourable results. This review suggests that multimedia effectively facilitates both technical and cognitive skills acquisition and is well accepted as an educational resource. Copyright © 2015 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

  10. Bimodal Reading: Benefits of a Talking Computer for Average and Less Skilled Readers.

    Science.gov (United States)

    Montali, Julie; Lewandowski, Lawrence

    1996-01-01

    Eighteen average readers and 18 less-skilled readers (grades 8 and 9) were presented with social studies and science passages via a computer either visually (on screen), auditorily (read by digitized voice), or bimodally (on screen, highlighted while being voiced). Less-skilled readers demonstrated comprehension in the bimodal condition equivalent…

  11. Virtual reality simulators: current status in acquisition and assessment of surgical skills.

    Science.gov (United States)

    Cosman, Peter H; Cregan, Patrick C; Martin, Christopher J; Cartmill, John A

    2002-01-01

    Medical technology is currently evolving so rapidly that its impact cannot be analysed. Robotics and telesurgery loom on the horizon, and the technology used to drive these advances has serendipitous side-effects for the education and training arena. The graphical and haptic interfaces used to provide remote feedback to the operator--by passing control to a computer--may be used to generate simulations of the operative environment that are useful for training candidates in surgical procedures. One additional advantage is that the metrics calculated inherently in the controlling software in order to run the simulation may be used to provide performance feedback to individual trainees and mentors. New interfaces will be required to undergo evaluation of the simulation fidelity before being deemed acceptable. The potential benefits fall into one of two general categories: those benefits related to skill acquisition, and those related to skill assessment. The educational value of the simulation will require assessment, and comparison to currently available methods of training in any given procedure. It is also necessary to determine--by repeated trials--whether a given simulation actually measures the performance parameters it purports to measure. This trains the spotlight on what constitutes good surgical skill, and how it is to be objectively measured. Early results suggest that virtual reality simulators have an important role to play in this aspect of surgical training.

  12. The Role of Crowdsourcing in Assessing Surgical Skills.

    Science.gov (United States)

    Katz, Andrew J

    2016-08-01

    Assessing surgical skill is critical in improving patient care while reducing medical errors, length of stay, and readmission rates. Crowdsourcing provides 1 potential method for accurately assessing this; only recently has crowdsourcing been studied as a valid way to provide feedback to surgeons. The results of such studies are explored. A systematic literature search was performed on PubMed to identify studies that have attempted to validate crowdsourcing as a method for assessing surgical skill. Through a combination of abstract screening and full-length review, 9 studies that met the inclusion criteria were reviewed. Crowdsourcing has been validated as an important way to provide feedback for surgical skill. It has been demonstrated to be effective in both dry-lab and live surgery, for a variety of tasks and methods. However, more studies must be performed to ensure that crowdsourcing can provide quality feedback in a wider variety of scenarios.

  13. Video and accelerometer-based motion analysis for automated surgical skills assessment.

    Science.gov (United States)

    Zia, Aneeq; Sharma, Yachna; Bettadapura, Vinay; Sarin, Eric L; Essa, Irfan

    2018-03-01

    Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

  14. Assessing Students' Technical Skill Attainment

    Science.gov (United States)

    Jorgensen, Haley

    2010-01-01

    The Wisconsin Technical College System (WTCS) is working to comply with the Carl D. Perkins Career and Technical Education Improvement Act of 2006 (Perkins) to ensure that its graduates have mastered the technical skills needed by business and industry. The legislation requires that each state identify and approve program assessment strategies…

  15. Assessment of skills using a virtual reality temporal bone surgery simulator.

    Science.gov (United States)

    Linke, R; Leichtle, A; Sheikh, F; Schmidt, C; Frenzel, H; Graefe, H; Wollenberg, B; Meyer, J E

    2013-08-01

    Surgery on the temporal bone is technically challenging due to its complex anatomy. Precise anatomical dissection of the human temporal bone is essential and is fundamental for middle ear surgery. We assessed the possible application of a virtual reality temporal bone surgery simulator to the education of ear surgeons. Seventeen ENT physicians with different levels of surgical training and 20 medical students performed an antrotomy with a computer-based virtual temporal bone surgery simulator. The ease, accuracy and timing of the simulated temporal bone surgery were assessed using the automatic assessment software provided by the simulator device and additionally with a modified Final Product Analysis Scale. Trained ENT surgeons, physicians without temporal bone surgical training and medical students were all able to perform the antrotomy. However, the highly trained ENT surgeons were able to complete the surgery in approximately half the time, with better handling and accuracy as assessed by the significant reduction in injury to important middle ear structures. Trained ENT surgeons achieved significantly higher scores using both dissection analysis methods. Surprisingly, there were no significant differences in the results between medical students and physicians without experience in ear surgery. The virtual temporal bone training system can stratify users of known levels of experience. This system can be used not only to improve the surgical skills of trained ENT surgeons for more successful and injury-free surgeries, but also to train inexperienced physicians/medical students in developing their surgical skills for the ear.

  16. Defining a New 21st Century Skill-Computational Thinking: Concepts and Trends

    Science.gov (United States)

    Haseski, Halil Ibrahim; Ilic, Ulas; Tugtekin, Ufuk

    2018-01-01

    Computational Thinking is a skill that guides the 21th century individual in the problems experienced during daily life and it has an ever-increasing significance. Multifarious definitions were attempted to explain the concept of Computational Thinking. However, it was determined that there was no consensus on this matter in the literature and…

  17. Otologic Skills Training

    DEFF Research Database (Denmark)

    Wiet, Gregory J; Sørensen, Mads Sølvsten; Andersen, Steven Arild Wuyts

    2017-01-01

    This article presents a summary of the current simulation training for otologic skills. There is a wide variety of educational approaches, assessment tools, and simulators in use, including simple low-cost task trainers to complex computer-based virtual reality systems. A systematic approach...

  18. Soft Skills Assessment: Theory Development and the Research Agenda

    Science.gov (United States)

    Gibb, Stephen

    2014-01-01

    Soft skills have become a subject of increasing interest in lifelong learning. Soft skills development is intended to enable and enhance personal development, participation in learning and success in employment. The assessment of soft skill is therefore widely practised, but there is little in the way of research or evidence on how well this…

  19. The impact of patient and physician computer mediated communication skill training on reported communication and patient satisfaction.

    Science.gov (United States)

    Roter, Debra L; Wexler, Randy; Naragon, Phyllis; Forrest, Brian; Dees, Jason; Almodovar, Astrid; Wood, Julie

    2012-09-01

    The objective was to evaluate parallel patient and physician computer-mediated communication skill training on participants' report of skill use and patient satisfaction. Separate patient and clinician web-tools comprised of over 500, 10-s video clips demonstrating patient-centered skills in various ways. Four clinician members of the American Academy of Family Physicians National Research Network participated by enrolling 194 patients into a randomized patient trial and 29 physicians into a non-randomized clinician trial of respective interventions. All participants completed baseline and follow-up self-report measures of visit communication and satisfaction. Intervention patients reported using more skills than controls in five of six skill areas, including identification of problems/concerns, information exchange, treatment adherence, shared decision-making and interpersonal rapport (all ppost intervention, physicians reported using more skills in the same 5 areas (all pCommunication skill training delivered in a computer mediated format had a positive and parallel impact on both patient and clinician reported use of patient-centered communication and in patient satisfaction. Computer-mediated interventions are cost and time effective thereby increasing patient and clinician willingness to undertake training. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

  20. The development of aerobic and skill assessment in soccer.

    Science.gov (United States)

    O'Reilly, John; Wong, Stephen H S

    2012-12-01

    Methods of assessing soccer players' performance have developed significantly in recent times. The fitness profiles and skill levels of a prospective elite soccer player is a valuable resource for coaches in the process of identifying talent. Traditional means to measure aerobic fitness have centred on the 'aerobic capacity' or '&OV0312;O(2max)' test (also known as the maximal oxygen consumption test) but, over time, this has been shown not to be a sensitive measure for specific aspects of soccer in a match situation. Therefore, numerous soccer-specific simulations have been designed to re-create exercise patterns similar to those experienced during a match. Some of these studies have yet to be validated, while others have been shown to result in a similar physiological load to that encountered during regular match play. Further developments have led to specifically designed intermittent sprint tests, which are used as a sensitive tool to accurately measure the fluctuations in players' ability both between and within soccer seasons. Testing procedures have also been developed that incorporate elements of both skill and physical ability. Soccer-specific field tests have been designed, incorporating skill and dynamic movements, and this opens up the possibility of teams testing the aerobic capacity of their elite players using soccer-specific movements. Valid studies assessing soccer-specific skills in an ecologically sound environment have been quite rare until recently. Some test protocols have been deemed largely irrelevant to soccer match play, while others have had limited impact on scientific literature. More recently, skill tests have been developed and shown to be valid and reliable methods of assessing soccer skill performance. Many new skill tests continue to be developed, and some have been shown to be highly reliable, but further study of these relatively novel concepts is required before a more solid recommendation can be made. Overall, while significant

  1. Attitudes to proposed assessment of pharmacy skills in Korean pharmacist licensure examination.

    Science.gov (United States)

    Kim, Joo Hee; Lee, Ju-Yeun; Lee, Young Sook; Yong, Chul-Soon; Han, Nayoung; Gwak, Hye Sun; Oh, Jungmi; Lee, Byung Koo; Lee, Sukhyang

    2017-01-01

    The survey aimed to obtain opinions about a proposed implementation of pharmacy skills assessment in Korean pharmacist licensure examination (KPLE). A 16-question survey was distributed electronically to 2,738 people including 570 pharmacy professors of 35 pharmacy schools, 550 preceptors from 865 practice sites and 1,618 students who graduated in 2015. The survey solicited responses concerning the adequacy of the current KPLE in assessing pharmacy knowledge/skills/attitudes, deficiencies of pharmacy skills testing in assessing the professional competencies necessary for pharmacists, plans for pharmacy skills tests in the current KPLE, and subject areas of pharmacy practice. A total of 466 surveys were returned. The current exam is not adequate for assessing skills and attitudes according to 42%-48% of respondents. Sixty percent felt that skills test is necessary to assess qualifications and professional competencies. Almost two-thirds of participants stated that testing should be implemented within 5 years. More than 60% agreed that candidates should be graduates and that written and skills test scores can be combined for pass-fail decisions. About 70% of respondents felt that the test should be less than 2 hours in duration. Over half of the respondents thought that the assessor should be a pharmacy faculty member with at least 5 years of clinical experience. Up to 70% stated that activities related to patient care were appropriate and practical for the scope of skills test. Pharmacy skills assessment was supported by the majority of respondents.

  2. Enhancing Student Communication Skills Through Arabic Language Competency and Simulated Patient Assessments.

    Science.gov (United States)

    Hasan, Sanah; Tarazi, Hamadeh M Khier; Halim Hilal, Dana Abdel

    2017-05-01

    Objective. To assess student communication and patient management skill with introduction of Arabic and use of simulated patient assessments to a communication and counseling course. Design. Five, 3-hour tutorials (clinical skill laboratory) were added to the course covering: listening and empathic responding, non-verbal communications, interviewing skills, assertiveness, counseling in special situations: conflict, anger, worry or rushed situations, and professional decision making. Arabic content was introduced to the course to enhance Arabic communications and competence among students. Simulated patient assessment was used to evaluate student skills. Students' feedback about course changes was evaluated. Assessment. The course now covers a wider content and Arabic language. Students' scores were similar in the assessment and other assessments within the course and between Arabic and English groups. Students favorably rated the changes in the course and provided constructive feedback on content usefulness and adequacy. Conclusion. Expanding the course to include Arabic language and content and simulated patient assessments enhanced student communication skills.

  3. Development of performance assessment instrument based contextual learning for measuring students laboratory skills

    Science.gov (United States)

    Susilaningsih, E.; Khotimah, K.; Nurhayati, S.

    2018-04-01

    The assessment of laboratory skill in general hasn’t specific guideline in assessment, while the individual assessment of students during a performance and skill in performing laboratory is still not been observed and measured properly. Alternative assessment that can be used to measure student laboratory skill is use performance assessment. The purpose of this study was to determine whether the performance assessment instrument that the result of research can be used to assess basic skills student laboratory. This research was conducted by the Research and Development. The result of the data analysis performance assessment instruments developed feasible to implement and validation result 62.5 with very good categories for observation sheets laboratory skills and all of the components with the very good category. The procedure is the preliminary stages of research and development stages. Preliminary stages are divided in two, namely the field studies and literature studies. The development stages are divided into several parts, namely 1) development of the type instrument, 2) validation by an expert, 3) a limited scale trial, 4) large-scale trials and 5) implementation of the product. The instrument included in the category of effective because 26 from 29 students have very high laboratory skill and high laboratory skill. The research of performance assessment instrument is standard and can be used to assess basic skill student laboratory.

  4. Developing Employability Skills: Peer Assessment in Higher Education

    Science.gov (United States)

    Cassidy, Simon

    2006-01-01

    Purpose: Reports examining graduate employment issues suggest that employers are concerned by the lack of employability skills exhibited by entry-level job applications. It is also suggested that employers consider it the responsibility of educational institutions to develop such skills. The current study seeks to identify peer assessment as a…

  5. [Clinical skills and outcomes of chair-side computer aided design and computer aided manufacture system].

    Science.gov (United States)

    Yu, Q

    2018-04-09

    Computer aided design and computer aided manufacture (CAD/CAM) technology is a kind of oral digital system which is applied to clinical diagnosis and treatment. It overturns the traditional pattern, and provides a solution to restore defect tooth quickly and efficiently. In this paper we mainly discuss the clinical skills of chair-side CAD/CAM system, including tooth preparation, digital impression, the three-dimensional design of prosthesis, numerical control machining, clinical bonding and so on, and review the outcomes of several common kinds of materials at the same time.

  6. Defining and Assessing Team Skills of Business and Accountancy Students

    Science.gov (United States)

    Alghalith, Nabil; Blum, Michael; Medlock, Amanda; Weber, Sandy

    2004-01-01

    The objectives of the project are (1) to define the skills necessary for students to work effectively with others to achieve common goals, and (2) to develop an assessment instrument to measure student progress toward achieving these skills. The defined skill set will form a basis for common expectations related to team skills that will be shared…

  7. Developing Oral and Written Communication Skills in Undergraduate Computer Science and Information Systems Curriculum

    Science.gov (United States)

    Kortsarts, Yana; Fischbach, Adam; Rufinus, Jeff; Utell, Janine M.; Yoon, Suk-Chung

    2010-01-01

    Developing and applying oral and written communication skills in the undergraduate computer science and computer information systems curriculum--one of the ABET accreditation requirements - is a very challenging and, at the same time, a rewarding task that provides various opportunities to enrich the undergraduate computer science and computer…

  8. Accuracy and reliability of peer assessment of athletic training psychomotor laboratory skills.

    Science.gov (United States)

    Marty, Melissa C; Henning, Jolene M; Willse, John T

    2010-01-01

    Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Cross-sectional study. Entry-level master's athletic training education program. First-year (n  =  5) and second-year (n  =  8) students. Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the φ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (φ  =  0.79) for the Faber test, with 1 participant on 2 occasions (φ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (φ  =  0.72). Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills

  9. Young Children's Computer Skills Development from Kindergarten to Third Grade

    Science.gov (United States)

    Sackes, Mesut; Trundle, Kathy Cabe; Bell, Randy L.

    2011-01-01

    This investigation explores young children's computer skills development from kindergarten to third grade using the Early Childhood Longitudinal Study-Kindergarten (ECLS-K) dataset. The sample size of the study was 8642 children. Latent growth curve modeling analysis was used as an analytical tool to examine the development of children's computer…

  10. Non-technical skills assessment for prelicensure nursing students: An integrative review.

    Science.gov (United States)

    Pires, Sara; Monteiro, Sara; Pereira, Anabela; Chaló, Daniela; Melo, Elsa; Rodrigues, Alexandre

    2017-11-01

    In nursing, non-technical skills are recognized as playing an important role to increase patient safety and successful clinical outcomes (Pearson and McLafferty, 2011). Non-technical skills are cognitive and social resource skills that complement technical skills and contribute to safe and efficient task performance (Flin et al., 2008). In order to effectively provide non-technical skills training, it is essential to have an instrument to measure these skills. An online search was conducted. Articles were selected if they referred to and/or described instruments assessing non-technical skills for nurses and/or prelicensure nursing students in educational, clinical and/or simulated settings with validation evidence (inclusion criteria). Of the 53 articles located, 26 met the inclusion criteria. Those referred to and/or described 16 instruments with validation evidence developed to assess non-technical skills in multidisciplinary teams including nurses. Although articles have shown 16 valid and reliable instruments, to our knowledge, no instrument has been published or developed and validated for the assessment of non-technical skills of only nurses in general, relevant for use in high-fidelity simulation-based training for prelicensure nursing students. Therefore, there is a need for the development of such an instrument. Copyright © 2017 Elsevier Ltd. All rights reserved.

  11. Framework and implementation for improving physics essential skills via computer-based practice: Vector math

    Science.gov (United States)

    Mikula, Brendon D.; Heckler, Andrew F.

    2017-06-01

    We propose a framework for improving accuracy, fluency, and retention of basic skills essential for solving problems relevant to STEM introductory courses, and implement the framework for the case of basic vector math skills over several semesters in an introductory physics course. Using an iterative development process, the framework begins with a careful identification of target skills and the study of specific student difficulties with these skills. It then employs computer-based instruction, immediate feedback, mastery grading, and well-researched principles from cognitive psychology such as interleaved training sequences and distributed practice. We implemented this with more than 1500 students over 2 semesters. Students completed the mastery practice for an average of about 13 min /week , for a total of about 2-3 h for the whole semester. Results reveal large (>1 SD ) pretest to post-test gains in accuracy in vector skills, even compared to a control group, and these gains were retained at least 2 months after practice. We also find evidence of improved fluency, student satisfaction, and that awarding regular course credit results in higher participation and higher learning gains than awarding extra credit. In all, we find that simple computer-based mastery practice is an effective and efficient way to improve a set of basic and essential skills for introductory physics.

  12. Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

    Science.gov (United States)

    Schmidt, Jessica N; Kendall, John; Smalley, Courtney

    2015-11-01

    Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.

  13. How to Assess Creative Thinking Skill in Making Products of Liquid Pressure?

    Science.gov (United States)

    Chasanah, L.; Kaniawati, I.; Hernani, H.

    2017-09-01

    The primary skills that must be possessed in the 21st century curriculum are learning and innovation skills. One of the learning strategies that can train students to innovate and improve creative thinking skills is by applying Science, Technology, Engineering and Mathematics (STEM) in learning. Based on an interview to one of the science teachers that learning that aims to train learning and innovation skills has not been applied to learning in the classroom because there is not enough time, learning materials and assessment instruments used. This study aims to determine the results of the implementation of performance assessment of creative thinking skills on STEM-based learning in junior high school for the material of liquid pressure. This research uses descriptive method. Participants in this study were junior high school students 8th in Kudus area. The research instrument consists of observation sheet, performance assessment and documentation. The result showed that creative thinking skills performance assessment can assess student’s creativity in making products of STEM-based learning for junior high school.

  14. Does a Rater's Professional Background Influence Communication Skills Assessment?

    Science.gov (United States)

    Artemiou, Elpida; Hecker, Kent G; Adams, Cindy L; Coe, Jason B

    2015-01-01

    There is increasing pressure in veterinary education to teach and assess communication skills, with the Objective Structured Clinical Examination (OSCE) being the most common assessment method. Previous research reveals that raters are a large source of variance in OSCEs. This study focused on examining the effect of raters' professional background as a source of variance when assessing students' communication skills. Twenty-three raters were categorized according to their professional background: clinical sciences (n=11), basic sciences (n=4), clinical communication (n=5), or hospital administrator/clinical skills technicians (n=3). Raters from each professional background were assigned to the same station and assessed the same students during two four-station OSCEs. Students were in year 2 of their pre-clinical program. Repeated-measures ANOVA results showed that OSCE scores awarded by the rater groups differed significantly: (F(matched_station_1) [2,91]=6.97, p=.002), (F(matched_station_2) [3,90]=13.95, p=.001), (F(matched_station_3) [3,90]=8.76, p=.001), and ((Fmatched_station_4) [2,91]=30.60, p=.001). A significant time effect between the two OSCEs was calculated for matched stations 1, 2, and 4, indicating improved student performances. Raters with a clinical communication skills background assigned scores that were significantly lower compared to the other rater groups. Analysis of written feedback provided by the clinical sciences raters showed that they were influenced by the students' clinical knowledge of the case and that they did not rely solely on the communication checklist items. This study shows that it is important to consider rater background both in recruitment and training programs for communication skills' assessment.

  15. Structured assessment of microsurgery skills in the clinical setting.

    Science.gov (United States)

    Chan, WoanYi; Niranjan, Niri; Ramakrishnan, Venkat

    2010-08-01

    Microsurgery is an essential component in plastic surgery training. Competence has become an important issue in current surgical practice and training. The complexity of microsurgery requires detailed assessment and feedback on skills components. This article proposes a method of Structured Assessment of Microsurgery Skills (SAMS) in a clinical setting. Three types of assessment (i.e., modified Global Rating Score, errors list and summative rating) were incorporated to develop the SAMS method. Clinical anastomoses were recorded on videos using a digital microscope system and were rated by three consultants independently and in a blinded fashion. Fifteen clinical cases of microvascular anastomoses performed by trainees and a consultant microsurgeon were assessed using SAMS. The consultant had consistently the highest scores. Construct validity was also demonstrated by improvement of SAMS scores of microsurgery trainees. The overall inter-rater reliability was strong (alpha=0.78). The SAMS method provides both formative and summative assessment of microsurgery skills. It is demonstrated to be a valid, reliable and feasible assessment tool of operating room performance to provide systematic and comprehensive feedback as part of the learning cycle. Copyright 2009 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

  16. Using a Touch-Based, Computer-Assisted Learning System to Promote Literacy and Math Skills for Low-Income Preschoolers

    Directory of Open Access Journals (Sweden)

    Mark H McManis

    2016-08-01

    Full Text Available The use of touch-based technologies by young children to improve academic skills has seen growth outpacing empirical evidence of its effectiveness. Due to the educational challenges low-income children face, the stakes for providing instructional technology with demonstrated efficacy are high. The current work presents an empirical study of the use of a touch-based, computer-assisted learning system by low-income preschoolers. A description of the system’s design is provided with attention to young children’s interaction with touch devices, learner engagement, and pedagogically-based delivery of academic content. Children in 18 low-income child-care preschool classrooms were assessed on literacy and math skills in the fall and again in the spring. Target children used the iStartSmart learning system throughout the academic year, while control children did not have access to the system. Compared to controls, children using the learning system made significant gains on external standardized measures of literacy and math. Children who spent more time using the system and those who reached the upper levels of skill understanding showed the strongest improvement in test scores. The findings contribute to the currently sparse literature by illuminating that for at-risk early learners, touch-based, computer-assisted instructional technology shows promise as an educational tool.

  17. Training self-assessment and task-selection skills to foster self-regulated learning: Do trained skills transfer across domains?

    Science.gov (United States)

    Raaijmakers, Steven F; Baars, Martine; Paas, Fred; van Merriënboer, Jeroen J G; van Gog, Tamara

    2018-01-01

    Students' ability to accurately self-assess their performance and select a suitable subsequent learning task in response is imperative for effective self-regulated learning. Video modeling examples have proven effective for training self-assessment and task-selection skills, and-importantly-such training fostered self-regulated learning outcomes. It is unclear, however, whether trained skills would transfer across domains. We investigated whether skills acquired from training with either a specific, algorithmic task-selection rule or a more general heuristic task-selection rule in biology would transfer to self-regulated learning in math. A manipulation check performed after the training confirmed that both algorithmic and heuristic training improved task-selection skills on the biology problems compared with the control condition. However, we found no evidence that students subsequently applied the acquired skills during self-regulated learning in math. Future research should investigate how to support transfer of task-selection skills across domains.

  18. Approaching time is important for assessment of endoscopic surgical skills.

    Science.gov (United States)

    Tokunaga, Masakazu; Egi, Hiroyuki; Hattori, Minoru; Yoshimitsu, Masanori; Sumitani, Daisuke; Kawahara, Tomohiro; Okajima, Masazumi; Ohdan, Hideki

    2012-05-01

    This study aimed to verify whether the approaching time (the time taken to reach the target point from another point, a short distance apart, during point-to-point movement in endoscopic surgery), assessed using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), could distinguish the skill level of surgeons. Expert surgeons (who had performed more than 50 endoscopic surgeries) and novice surgeons (who had no experience in performing endoscopic surgery) were tested using the HUESAD. The approaching time, total time, and intermediate time (total time--approaching time) were measured and analyzed using the trajectory of the tip of the instrument. The approaching time and total time were significantly shorter in the expert group than in the novice group (p time did not significantly differ between the groups (p > 0.05). The approaching time, which is a component of the total time, is very mportant in the measurement of the total time to assess endoscopic surgical skills. Further, the approaching time was useful for skill assessment by the HUESAD for evaluating the skill of surgeons performing endoscopic surgery.

  19. Accuracy and Reliability of Peer Assessment of Athletic Training Psychomotor Laboratory Skills

    Science.gov (United States)

    Marty, Melissa C.; Henning, Jolene M.; Willse, John T.

    2010-01-01

    Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was

  20. Technical skills assessment toolbox: a review using the unitary framework of validity.

    Science.gov (United States)

    Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

    2015-02-01

    The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

  1. Educational Assessment Knowledge and Skills for Teachers

    Science.gov (United States)

    Brookhart, Susan M.

    2011-01-01

    The 1990 Standards for Teacher Competence in Educational Assessment of Students (AFT, NCME, & NEA, 1990) made a documentable contribution to the field. However, the Standards have become a bit dated, most notably in two ways: (1) the Standards do not consider current conceptions of formative assessment knowledge and skills, and (2) the Standards…

  2. Assessment Training Effects on Student Assessment Skills and Task Performance in a Technology-Facilitated Peer Assessment

    Science.gov (United States)

    Liu, Xiongyi; Li, Lan

    2014-01-01

    This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the…

  3. Interpersonal Skills in MBA Admissions: How Are They Conceptualized and Assessed?

    Science.gov (United States)

    Beenen, Gerard; Pichler, Shaun; Davoudpour, Shahin

    2018-01-01

    Employers and students concur that soft skills or interpersonal skills are critical to managerial success, yet we know little about how MBA program admissions professionals conceptualize and assess these skills in the context of global management education. Such practices have key implications for interpersonal skills curriculum and training in…

  4. Health Sciences Students' Self-Assessment of Information and Communication Technology Skills and Attitude Toward e-Learning.

    Science.gov (United States)

    Buabbas, Ali Jassem; Al-Shawaf, Hamza Mohammad Hassan; Almajran, Abdullah Abdulaziz

    2016-06-20

    In medical education, information and communication technology (ICT) knowledge and skills have become a necessity and an integral part of preparing tomorrow's doctors to be sufficiently competent to use informatics resources effectively and efficiently for the best practice of medicine. This research aimed to study the literacy of the preprofessional students in ICT before and after taking the basic informatics course at the Health Sciences Center at Kuwait University, to understand their potential and their attitudes toward using ICT, including e-learning. A validated questionnaire was used to collect data from 200 students in 2 stages: before and after the informatics course on the preprofessional program. In addition, the tutors' observational assessments of the students' achievements during the informatics course were obtained. The response rate of students before the course was 85.5% (171/200) and after was 77% (154/200). Of 200 students, 85% were female, and 15% were male. This disproportional representation of genders was due to the fact that 85% of registered students were female. Approximately 59% (101/171) of the students assessed themselves before the course as computer literate; afterward, this increased to 70.1% (108/154). Students who were still computer illiterate (29.2%; 45/154) mostly used the excuse of a lack of time (60%; 27/45). In generic ICT skills, the highest levels were for word processing, email, and Web browsing, whereas the lowest levels were for spreadsheets and database. In specific ICT skills, most respondents were reported low levels for statistical package use and Web page design. The results found that there was a significant improvement between students' general ICT skills before and after the course. The results showed that there were significant improvement between how frequently students were using Medline (PLibrary (Pstudents who completed the course (72.8%; 110/151) chose the learning management system as the most useful e

  5. Energy-Based Metrics for Arthroscopic Skills Assessment.

    Science.gov (United States)

    Poursartip, Behnaz; LeBel, Marie-Eve; McCracken, Laura C; Escoto, Abelardo; Patel, Rajni V; Naish, Michael D; Trejos, Ana Luisa

    2017-08-05

    Minimally invasive skills assessment methods are essential in developing efficient surgical simulators and implementing consistent skills evaluation. Although numerous methods have been investigated in the literature, there is still a need to further improve the accuracy of surgical skills assessment. Energy expenditure can be an indication of motor skills proficiency. The goals of this study are to develop objective metrics based on energy expenditure, normalize these metrics, and investigate classifying trainees using these metrics. To this end, different forms of energy consisting of mechanical energy and work were considered and their values were divided by the related value of an ideal performance to develop normalized metrics. These metrics were used as inputs for various machine learning algorithms including support vector machines (SVM) and neural networks (NNs) for classification. The accuracy of the combination of the normalized energy-based metrics with these classifiers was evaluated through a leave-one-subject-out cross-validation. The proposed method was validated using 26 subjects at two experience levels (novices and experts) in three arthroscopic tasks. The results showed that there are statistically significant differences between novices and experts for almost all of the normalized energy-based metrics. The accuracy of classification using SVM and NN methods was between 70% and 95% for the various tasks. The results show that the normalized energy-based metrics and their combination with SVM and NN classifiers are capable of providing accurate classification of trainees. The assessment method proposed in this study can enhance surgical training by providing appropriate feedback to trainees about their level of expertise and can be used in the evaluation of proficiency.

  6. The Differential Effects of Task Complexity on Domain-Specific and Peer Assessment Skills

    Science.gov (United States)

    van Zundert, Marjo J.; Sluijsmans, Dominique M. A.; Konings, Karen D.; van Merrienboer, Jeroen J. G.

    2012-01-01

    In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial…

  7. Observational assessment of fundamental movement skill proficiency in preschool children

    OpenAIRE

    佐々木, 玲子; 石沢, 順子

    2014-01-01

    Fundamental movement skill competency in children has been declining in recent years. Early childhood is a sensitive period for the development of fundamental movement skills ; the mastery of certain of these skills is a prerequisite for daily functioning and participation in later physical or sport-specific activities. Although quantitative methods have been developed for assessing movement development in children, it is also important to qualitatively evaluate such skills in developing chil...

  8. Training and Assessment of Hysteroscopic Skills: A Systematic Review.

    Science.gov (United States)

    Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars; Tolsgaard, Martin G; Bjerrum, Flemming

    2016-01-01

    The aim of this systematic review was to identify studies on hysteroscopic training and assessment. PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%). This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  9. Objective assessment of technical surgical skills

    NARCIS (Netherlands)

    van Hove, P. D.; Tuijthof, G. J. M.; Verdaasdonk, E. G. G.; Stassen, L. P. S.; Dankelman, J.

    2010-01-01

    Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice. A systematic search was

  10. Reliable and valid assessment of Lichtenstein hernia repair skills

    DEFF Research Database (Denmark)

    Carlsen, C G; Lindorff Larsen, Karen; Funch-Jensen, P

    2014-01-01

    PURPOSE: Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity...... of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. METHODS: Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia...... a significant difference between the three groups which indicates construct validity, p skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment...

  11. A Reconfigurable Simulation-Based Test System for Automatically Assessing Software Operating Skills

    Science.gov (United States)

    Su, Jun-Ming; Lin, Huan-Yu

    2015-01-01

    In recent years, software operating skills, the ability in computer literacy to solve problems using specific software, has become much more important. A great deal of research has also proven that students' software operating skills can be efficiently improved by practicing customized virtual and simulated examinations. However, constructing…

  12. Nurses' Evaluation of Their Use and Mastery in Health Assessment Skills: Selected Iran's Hospitals.

    Science.gov (United States)

    Adib-Hajbaghery, Mohsen; Safa, Azade

    2013-09-01

    Health assessment skills are of the most important skills which nurses require. The more precise assessment, the better results would be obtained and the quality of patient care would be improved. However, in Iran, few studies have investigated nurses' assessment skills. This study was aimed to assessnurses' evaluation of the learned skills of health assessment and their use. This cross-sectional study was conducted on 200 nurses in Isfahan province hospitals. Data was collected by a questionnaire including demographic data and 120 health assessment skills. Nurses scored their frequency of using and proficiency in skills. Statistical analysis was conducted by ANOVA, Tukey test and independent sample T-tests. The highest level of using and proficiency in skills was related to taking history. Nurses received 87.25% of score in this field. The lowest level of application was in assessment of the urogenital system so that nurses received 16.37% of score in this area. Also the lowest proficiency was in assessment of the nervous system and nurses received 34.58% of score in this area. The level of nurses' proficiency in the health assessment skills was not satisfactory. Modifying the curriculum and cooperating of nurse managers and nursing schools can help to improve the situation.

  13. Building professionalism and employability skills: embedding employer engagement within first-year computing modules

    Science.gov (United States)

    Hanna, Philip; Allen, Angela; Kane, Russell; Anderson, Neil; McGowan, Aidan; Collins, Matthew; Hutchison, Malcolm

    2015-07-01

    This paper outlines a means of improving the employability skills of first-year university students through a closely integrated model of employer engagement within computer science modules. The outlined approach illustrates how employability skills, including communication, teamwork and time management skills, can be contextualised in a manner that directly relates to student learning but can still be linked forward into employment. The paper tests the premise that developing employability skills early within the curriculum will result in improved student engagement and learning within later modules. The paper concludes that embedding employer participation within first-year models can help relate a distant notion of employability into something of more immediate relevance in terms of how students can best approach learning. Further, by enhancing employability skills early within the curriculum, it becomes possible to improve academic attainment within later modules.

  14. Teaching and Assessing Communication Skills in Medical Undergraduate Training.

    Science.gov (United States)

    Modi, Jyoti Nath; Anshu, -; Chhatwal, Jugesh; Gupta, Piyush; Singh, Tejinder

    2016-06-08

    Good communication skills are essential for an optimal doctor-patient relationship, and also contribute to improved health outcomes. Although the need for training in communication skills is stated as a requirement in the 1997 Graduate Medical Education Regulations of the Medical Council of India, formal training in these skills has been fragmentary and non-uniform in most Indian curricula. The Vision 2015 document of the Medical Council of India reaffirms the need to include training in communication skills in the MBBS curriculum. Training in communication skills needs approaches which are different from that of teaching other clinical subjects. It is also a challenge to ensure that students not only imbibe the nuances of communication and interpersonal skills, but adhere to them throughout their careers. This article addresses the possible ways of standardizing teaching and assessment of communication skills and integrating them into the existing curriculum.

  15. Attention to gender in communication skills assessment instruments in medical education: a review.

    Science.gov (United States)

    Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

    2011-03-01

    Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

  16. Research Skills for Journalism Students: From Basics to Computer-Assisted Reporting.

    Science.gov (United States)

    Drueke, Jeanetta; Streckfuss, Richard

    1997-01-01

    Despite the availability of computer-assisted research, a survey of 300 newspapers found that many journalists still rely on paper sources or neglect research altogether. This article describes the development and implementation of a beginning reporting course that integrates research skills, demonstrates the value of research in reporting, and…

  17. Increasing Mathematical Computation Skills for Students with Physical and Health Disabilities

    Science.gov (United States)

    Webb, Paula

    2017-01-01

    Students with physical and health disabilities struggle with basic mathematical concepts. The purpose of this research study was to increase the students' mathematical computation skills through implementing new strategies and/or methods. The strategies implemented with the students was utilizing the ten-frame tiles and technology with the purpose…

  18. Developing a strategy for computational lab skills training through Software and Data Carpentry: Experiences from the ELIXIR Pilot action

    NARCIS (Netherlands)

    Pawlik, A.; Gelder, C.W.G. van; Nenadic, A.; Palagi, P.M.; Korpelainen, E.; Lijnzaad, P.; Marek, D.; Sansone, S.A.; Hancock, J.; Goble, C.

    2017-01-01

    Quality training in computational skills for life scientists is essential to allow them to deliver robust, reproducible and cutting-edge research. A pan-European bioinformatics programme, ELIXIR, has adopted a well-established and progressive programme of computational lab and data skills training

  19. Reliability and Validity of the Research Methods Skills Assessment

    Science.gov (United States)

    Smith, Tamarah; Smith, Samantha

    2018-01-01

    The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

  20. The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

    Science.gov (United States)

    Barnett, Lisa M.; Hardy, Louise L.; Brian, Ali S.; Robertson, Sam

    2015-01-01

    The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key points Golf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level, and talent identification in beginner young golf players. Process rather than product oriented outcomes better identify areas of skill deficit in young children. The proposed swing and putt instrument can reliably identify skill deficits in children of elementary school age who are new to golf and can be used by a range

  1. Using Computer-Assisted Argumentation Mapping to develop effective argumentation skills in high school advanced placement physics

    Science.gov (United States)

    Heglund, Brian

    Educators recognize the importance of reasoning ability for development of critical thinking skills, conceptual change, metacognition, and participation in 21st century society. There is a recognized need for students to improve their skills of argumentation, however, argumentation is not explicitly taught outside logic and philosophy---subjects that are not part of the K-12 curriculum. One potential way of supporting the development of argumentation skills in the K-12 context is through incorporating Computer-Assisted Argument Mapping to evaluate arguments. This quasi-experimental study tested the effects of such argument mapping software and was informed by the following two research questions: 1. To what extent does the collaborative use of Computer-Assisted Argumentation Mapping to evaluate competing theories influence the critical thinking skill of argument evaluation, metacognitive awareness, and conceptual knowledge acquisition in high school Advanced Placement physics, compared to the more traditional method of text tables that does not employ Computer-Assisted Argumentation Mapping? 2. What are the student perceptions of the pros and cons of argument evaluation in the high school Advanced Placement physics environment? This study examined changes in critical thinking skills, including argumentation evaluation skills, as well as metacognitive awareness and conceptual knowledge, in two groups: a treatment group using Computer-Assisted Argumentation Mapping to evaluate physics arguments, and a comparison group using text tables to evaluate physics arguments. Quantitative and qualitative methods for collecting and analyzing data were used to answer the research questions. Quantitative data indicated no significant difference between the experimental groups, and qualitative data suggested students perceived pros and cons of argument evaluation in the high school Advanced Placement physics environment, such as self-reported sense of improvement in argument

  2. Validation of a global assessment of arthroscopic skills in a cadaveric knee model.

    Science.gov (United States)

    Slade Shantz, Jesse A; Leiter, Jeff R; Collins, John B; MacDonald, Peter B

    2013-01-01

    The purpose of this study was to determine whether a global assessment of arthroscopic skills was valid for blinded assessment of cadaveric diagnostic knee arthroscopy. A global skills assessment for arthroscopy was created using a published theory of the development of expertise. Faculty surgeons, fellows, and residents were consented and enrolled in this institutional review board-approved validation study. All participants were oriented to the equipment and procedures for diagnostic arthroscopy of the knee. After reviewing the anatomic structures to be visualized, participants were allowed 10 minutes to complete a diagnostic arthroscopy of the knee. The hands and arthroscopic view were recorded during this attempt. Resident participants completed a second filmed diagnostic arthroscopy 1 week after the initial attempt. Five blinded reviewers watched the synchronized videos and assessed arthroscopic skills with a procedure-specific checklist and the newly developed global skills assessment. The agreement between reviewers was determined by intraclass correlation coefficient. Internal consistency was determined with Cronbach's α. Test-retest reliability was measured by correlating repeated arthroscopies by residents. The ability of the global assessment to discriminate skill levels was determined with between-group Mann-Whitney U tests. The agreement between global assessment scores was strong (I.C.C. = 0.80, 95% C.I. 0.68-0.92). The internal consistency of evaluations was excellent (Cronbach's α = 0.97), and the test-retest reliability was strong (r = 0.52). The global assessment score was shown to be able to discriminate between skill levels by an analysis of variance indicating the difference in means among the various levels of training (P Assessment of Arthroscopic Skills is a useful adjunct to arthroscopic educators and learners and could be used for in-training evaluations. The Objective Assessment of Arthroscopic Skills is an instrument that can be

  3. Assessing Thinking Skills in Astro 101: Do We Make an Impact?

    Science.gov (United States)

    Bruning, D.

    2005-12-01

    Most instructors agree that a major goal of "Astronomy 101" is to develop thinking skills in our students (Partridge and Greenstein, AER 2, 46, 2003). Much educational research in astronomy has initially concentrated on "best practices" for improving student learning (development of "think-pair-share", lecture tutorials, peer tutoring, etc.). Little has been done to date to assess our efforts to improve student thinking skills and students' desire to think more deeply about the cognitively rich ideas offered in the typical astronomy class. This study surveys several astronomy and physics courses to determine whether general analytical thinking skills increase because of the science course and whether students' attitudes toward cognition improve. Cacioppo, Petty and Kao's "Need for Cognition" scale is used for the latter assessment (J. Personality Assessment 48, 306, 1984). A shortened version of Whimbey and Lochhead's ASI skills instrument is used to assess analytical skills ("Problem Solving and Comprehension," 1986). Preliminary results suggest that students need for cognition does not change in general, although there may be a correlation between increasing need for cognition and improvement in grades through the semester. There is a suggestion that need for cognition is slightly predictive of course performance, but a greater correlation exists between the post-course survey and grades. Gains in general analytical skills have been seen in initial surveys, but correlations with course performance appear elusive.

  4. Formative assessment of GP trainees' clinical skills.

    Science.gov (United States)

    Wiener-Ogilvie, Sharon; Begg, Drummond

    2012-03-01

    Clinical skill assessment (CSA) has been an integral part of the Royal College of General Practitioners' membership examination (MRCGP) since 2008. It is an expensive, high-stakes examination with first time pass rates ranging from 76.4 to 81.3. In this paper we describe the South East Scotland Deanery, NHS Education Scotland, pilot of a formative clinical skills assessment (fCSA) using the principles of formative assessment and OSCE. The purpose of the study was to assess the acceptability of the fCSA and to examine whether trainees, identified during the fCSA as 'at risk of failing the MRCGP CSA exam', are more likely to fail the MRCGP CSA exam later on in the year. Trainees were assessed in four clinical skills stations under exam conditions. After each station they were given verbal feedback and subsequently both trainee and their trainer received written feedback. We assessed the value of the exercise through written feedback from trainees and trainers. Each trainee's performance in fCSA was triangulated with trainer assessment to identify 'flagged trainees'. We compared flagged and non-flagged trainees' performance in MRCGP CSA. Both trainees and trainers highly rated the fCSA. Overall 97% of non-flagged trainees have passed the RCGP CSA exam by May of that year in comparison to 80% of flagged trainees who have passed the RCGP CSA (P = 0.005). Trainers and trainees rated the fCSA as excellent and useful. We were able to demonstrate that the fCSA can be used to identify those trainees likely to fail the RCGP CSA. Contrary to reservations about the potential to demoralise trainees, the fCSA was viewed as a useful and a positive experience by both trainees and trainers. In addition, we suggest that feedback from fCSA was useful in triggering appropriate educational interventions. Early intervention with trainees who are predicted to fail the CSA has the potential to reduce deaneries overall fail rate. Preventing one trainee failure could save over £30 000.

  5. Development of assessment instruments to measure critical thinking skills

    Science.gov (United States)

    Sumarni, W.; Supardi, K. I.; Widiarti, N.

    2018-04-01

    Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

  6. The development and validation of a golf swing and putt skill assessment for children.

    Science.gov (United States)

    Barnett, Lisa M; Hardy, Louise L; Brian, Ali S; Robertson, Sam

    2015-03-01

    The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument's discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p < 0.001). The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90) and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82), although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key pointsGolf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level

  7. Are general surgeons able to accurately self-assess their level of technical skills?

    Science.gov (United States)

    Rizan, C; Ansell, J; Tilston, T W; Warren, N; Torkington, J

    2015-11-01

    Self-assessment is a way of improving technical capabilities without the need for trainer feedback. It can identify areas for improvement and promote professional medical development. The aim of this review was to identify whether self-assessment is an accurate form of technical skills appraisal in general surgery. The PubMed, MEDLINE(®), Embase(™) and Cochrane databases were searched for studies assessing the reliability of self-assessment of technical skills in general surgery. For each study, we recorded the skills assessed and the evaluation methods used. Common endpoints between studies were compared to provide recommendations based on the levels of evidence. Twelve studies met the inclusion criteria from 22,292 initial papers. There was no level 1 evidence published. All papers compared the correlation between self-appraisal versus an expert score but differed in the technical skills assessment and the evaluation tools used. The accuracy of self-assessment improved with increasing experience (level 2 recommendation), age (level 3 recommendation) and the use of video playback (level 3 recommendation). Accuracy was reduced by stressful learning environments (level 2 recommendation), lack of familiarity with assessment tools (level 3 recommendation) and in advanced surgical procedures (level 3 recommendation). Evidence exists to support the reliability of self-assessment of technical skills in general surgery. Several variables have been shown to affect the accuracy of self-assessment of technical skills. Future work should focus on evaluating the reliability of self-assessment during live operating procedures.

  8. Basic Laparoscopic Skills Assessment Study: Validation and Standard Setting among Canadian Urology Trainees.

    Science.gov (United States)

    Lee, Jason Y; Andonian, Sero; Pace, Kenneth T; Grober, Ethan

    2017-06-01

    As urology training programs move to a competency based medical education model, iterative assessments with objective standards will be required. To develop a valid set of technical skills standards we initiated a national skills assessment study focusing initially on laparoscopic skills. Between February 2014 and March 2016 the basic laparoscopic skill of Canadian urology trainees and attending urologists was assessed using 4 standardized tasks from the AUA (American Urological Association) BLUS (Basic Laparoscopic Urological Surgery) curriculum, including peg transfer, pattern cutting, suturing and knot tying, and vascular clip applying. All performances were video recorded and assessed using 3 methods, including time and error based scoring, expert global rating scores and C-SATS (Crowd-Sourced Assessments of Technical Skill Global Rating Scale), a novel, crowd sourced assessment platform. Different methods of standard setting were used to develop pass-fail cut points. Six attending urologists and 99 trainees completed testing. Reported laparoscopic experience and training level correlated with performance (p standard setting methods to define pass-fail cut points for all 4 AUA BLUS tasks. The 4 AUA BLUS tasks demonstrated good construct validity evidence for use in assessing basic laparoscopic skill. Performance scores using the novel C-SATS platform correlated well with traditional time-consuming methods of assessment. Various standard setting methods were used to develop pass-fail cut points for educators to use when making formative and summative assessments of basic laparoscopic skill. Copyright © 2017 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  9. [The Computer Book of the Internal Medicine resident: validity and reliability of a questionnaire for self-assessment of competences in internal medicine residents].

    Science.gov (United States)

    Oristrell, J; Casanovas, A; Jordana, R; Comet, R; Gil, M; Oliva, J C

    2012-12-01

    There are no simple and validated instruments for evaluating the training of specialists. To analyze the reliability and validity of a computerized self-assessment method to quantify the acquisition of medical competences during the Internal Medicine residency program. All residents of our department participated in the study during a period of 28 months. Twenty-two questionnaires specific for each rotation (the Computer-Book of the Internal Medicine Resident) were constructed with items (questions) corresponding to three competence domains: clinical skills competence, communication skills and teamwork. Reliability was analyzed by measuring the internal consistency of items in each competence domain using Cronbach's alpha index. Validation was performed by comparing mean scores in each competence domain between senior and junior residents. Cut-off levels of competence scores were established in order to identify the strengths and weaknesses of our training program. Finally, self-assessment values were correlated with the evaluations of the medical staff. There was a high internal consistency of the items of clinical skills competences, communication skills and teamwork. Higher scores of clinical skills competence and communication skills, but not in those of teamwork were observed in senior residents than in junior residents. The Computer-Book of the Internal Medicine Resident identified the strengths and weaknesses of our training program. We did not observe any correlation between the results of the self- evaluations and the evaluations made by staff physicians. The items of Computer-Book of the Internal Medicine Resident showed high internal consistency and made it possible to measure the acquisition of medical competences in a team of Internal Medicine residents. This self-assessment method should be complemented with other evaluation methods in order to assess the acquisition of medical competences by an individual resident. Copyright © 2012 Elsevier Espa

  10. Comparing the Social Skills of Students Addicted to Computer Games with Normal Students

    OpenAIRE

    Zamani, Eshrat; Kheradmand, Ali; Cheshmi, Maliheh; Abedi, Ahmad; Hedayati, Nasim

    2010-01-01

    Background This study aimed to investigate and compare the social skills of studentsaddicted to computer games with normal students. The dependentvariable in the present study is the social skills. Methods The study population included all the students in the second grade ofpublic secondary school in the city of Isfahan at the educational year of2009-2010. The sample size included 564 students selected using thecluster random sampling method. Data collection was conducted usingQuestionnaire o...

  11. The Effects of Computer-Aided Design Software on Engineering Students' Spatial Visualisation Skills

    Science.gov (United States)

    Kösa, Temel; Karakus, Fatih

    2018-01-01

    The purpose of this study was to determine the influence of computer-aided design (CAD) software-based instruction on the spatial visualisation skills of freshman engineering students in a computer-aided engineering drawing course. A quasi-experimental design was applied, using the Purdue Spatial Visualization Test-Visualization of Rotations…

  12. The assessment of mindfulness skills: the "what" and the "how".

    Science.gov (United States)

    Iani, Luca; Lauriola, Marco; Cafaro, Valentina

    2017-10-06

    The five facets mindfulness questionnaire-short form (FFMQ-SF) is a new, brief measure for the assessment of mindfulness skills in clinical and nonclinical samples. The construct validity of the FFMQ-SF has not been previously assessed in community samples. The present study investigated the factor structure of the Italian version of the FFMQ-SF. Structured equation modeling was used to test the fit of three alternative models in a sample of highly educated adults (n = 211). A hierarchical model with a single second-order factor loaded by observing, describing, and acting with awareness (i.e. the mindfulness "what" skills) performed slightly better than both a five-factor model with correlated factors and a hierarchical model with a general second-order factor. The FFMQ-SF scores were significantly higher than those reported in both Dutch depressed patients and Australian undergraduate students for all facets (but nonreactivity for the Australian sample). Data support the multifaceted nature of mindfulness skills. Because of its brevity and simplicity of use, the FFMQ-SF is a promising questionnaire in longitudinal and clinical research. This questionnaire can serve as a guideline to help clinicians assess and monitor mindfulness skills acquisition, strengthening, and generalization, and prioritize mindfulness skills that need immediate attention.

  13. The WHATs and HOWs of maturing computational and software engineering skills in Russian higher education institutions

    Science.gov (United States)

    Semushin, I. V.; Tsyganova, J. V.; Ugarov, V. V.; Afanasova, A. I.

    2018-05-01

    Russian higher education institutions' tradition of teaching large-enrolled classes is impairing student striving for individual prominence, one-upmanship, and hopes for originality. Intending to converting these drawbacks into benefits, a Project-Centred Education Model (PCEM) has been introduced to deliver Computational Mathematics and Information Science courses. The model combines a Frontal Competitive Approach and a Project-Driven Learning (PDL) framework. The PDL framework has been developed by stating and solving three design problems: (i) enhance the diversity of project assignments on specific computation methods algorithmic approaches, (ii) balance similarity and dissimilarity of the project assignments, and (iii) develop a software assessment tool suitable for evaluating the technological maturity of students' project deliverables and thus reducing instructor's workload and possible overlook. The positive experience accumulated over 15 years shows that implementing the PCEM keeps students motivated to strive for success in rising to higher levels of their computational and software engineering skills.

  14. Self vs expert assessment of technical and non-technical skills in high fidelity simulation.

    Science.gov (United States)

    Arora, Sonal; Miskovic, Danilo; Hull, Louise; Moorthy, Krishna; Aggarwal, Rajesh; Johannsson, Helgi; Gautama, Sanjay; Kneebone, Roger; Sevdalis, Nick

    2011-10-01

    Accurate assessment is imperative for learning, feedback and progression. The aim of this study was to examine whether surgeons can accurately self-assess their technical and nontechnical skills compared with expert faculty members' assessments. Twenty-five surgeons performed a laparoscopic cholecystectomy (LC) in a simulated operating room. Technical and nontechnical performance was assessed by participants and faculty members using the validated Objective Structured Assessment of Technical Skills (OSATS) and the Non-Technical Skills for Surgeons scale (NOTSS). Assessment of technical performance correlated between self and faculty members' ratings for experienced (median score, 30.0 vs 31.0; ρ = .831; P = .001) and inexperienced (median score, 22.0 vs 28.0; ρ = .761; P = .003) surgeons. Assessment of nontechnical skills between self and faculty members did not correlate for experienced surgeons (median score, 8.0 vs 10.5; ρ = -.375; P = .229) or their more inexperienced counterparts (median score, 9.0 vs 7.0; ρ = -.018; P = .953). Surgeons can accurately self-assess their technical skills in virtual reality LC. Conversely, formal assessment with faculty members' input is required for nontechnical skills, for which surgeons lack insight into their behaviours. Copyright © 2011 Elsevier Inc. All rights reserved.

  15. Developing Enterprise Skills through Peer-Assessed Pitch Presentations

    Science.gov (United States)

    Faherty, Anna

    2015-01-01

    Purpose: The purpose of this paper is to investigate the impact of using summative peer assessment to develop enterprise skills within higher education. Design/methodology/approach: An empirical investigation analysing students own perceptions of the peer assessment process to evaluate its impact. Findings: Participating students indicate that…

  16. Investigating Secondary School Students' Unmediated Peer Assessment Skills

    Science.gov (United States)

    Tsivitanidou, Olia E.; Zacharia, Zacharias C.; Hovardas, Tasos

    2011-01-01

    The purpose of this study was to investigate secondary school students' unmediated peer assessment skills. Specifically, 36 seventh graders, without receiving any kind of support, were anonymously assigned to reciprocally assess their peers' science web-portfolios. Additionally, students' attitudes towards and intentions about the use of…

  17. Development of a learning-oriented computer assisted instruction designed to improve skills in the clinical assessment of the nutritional status: a pilot evaluation.

    Science.gov (United States)

    García de Diego, Laura; Cuervo, Marta; Martínez, J Alfredo

    2015-01-01

    Computer assisted instruction (CAI) is an effective tool for evaluating and training students and professionals. In this article we will present a learning-oriented CAI, which has been developed for students and health professionals to acquire and retain new knowledge through the practice. A two-phase pilot evaluation was conducted, involving 8 nutrition experts and 30 postgraduate students, respectively. In each training session, the software developed guides users in the integral evaluation of a patient's nutritional status and helps them to implement actions. The program includes into the format clinical tools, which can be used to recognize possible patient's needs, to improve the clinical reasoning and to develop professional skills. Among them are assessment questionnaires and evaluation criteria, cardiovascular risk charts, clinical guidelines and photographs of various diseases. This CAI is a complete software package easy to use and versatile, aimed at clinical specialists, medical staff, scientists, educators and clinical students, which can be used as a learning tool. This application constitutes an advanced method for students and health professionals to accomplish nutritional assessments combining theoretical and empirical issues, which can be implemented in their academic curriculum.

  18. A contextual approach to social skills assessment in the peer group: who is the best judge?

    Science.gov (United States)

    Kwon, Kyongboon; Kim, Elizabeth Moorman; Sheridan, Susan M

    2012-09-01

    Using a contextual approach to social skills assessment in the peer group, this study examined the criterion-related validity of contextually relevant social skills and the incremental validity of peers and teachers as judges of children's social skills. Study participants included 342 (180 male and 162 female) students and their classroom teachers (N = 22) from rural communities. As expected, contextually relevant social skills were significantly related to a variety of social status indicators (i.e., likability, peer- and teacher-assessed popularity, reciprocated friendships, clique centrality) and positive school functioning (i.e., school liking and academic competence). Peer-assessed social skills, not teacher-assessed social skills, demonstrated consistent incremental validity in predicting various indicators of social status outcomes; peer- and teacher-assessed social skills alike showed incremental validity in predicting positive school functioning. The relation between contextually relevant social skills and study outcomes did not vary by child gender. Findings are discussed in terms of the significance of peers in the assessment of children's social skills in the peer group as well as the usefulness of a contextual approach to social skills assessment.

  19. Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.

    Science.gov (United States)

    Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa

    2017-04-01

    The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

  20. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality.

    Science.gov (United States)

    Gallagher, A G; Richie, K; McClure, N; McGuigan, J

    2001-11-01

    Objective assessment of psychomotor skills in surgery is now a priority; however, this assessment is difficult to achieve because of measurement difficulties associated with the reliability and validity of assessing surgical skills in vivo and in the laboratory. In this study virtual reality (VR) was used to overcome these problems in the objective psychomotor assessment of senior, junior, and novice laparoscopists. Twelve experienced laparoscopic surgeons (performed >50 Minimal Access Surgery (MAS) procedures), 12 inexperienced laparoscopic surgeons (psychomotor skills for laparoscopic surgery.

  1. Instructor and Dental Student Perceptions of Clinical Communication Skills via Structured Assessments.

    Science.gov (United States)

    McKenzie, Carly T

    2016-05-01

    The aim of this study was to use structured assessments to assess dental students' clinical communication skills exhibited during patient appointments. Fourth-year dental students (n=55) at the University of Alabama at Birmingham evaluated their own interpersonal skills in a clinical setting utilizing the Four Habits Coding Scheme. An instructor also assessed student-patient clinical communication. These assessments were used to identify perceived strengths and weaknesses in students' clinical communication. Both instructor assessments and student self-assessments pinpointed the following clinical communication skills as effective the most often: patient greeting, avoidance of jargon, and non-verbal behavior. There was also relative agreement between instructor assessments and student self-assessments regarding clinical communication skills that were rated as not effective most frequently: ensuring patient comprehension, identification of patient feelings, and exploration of barriers to treatment. These resulted pointed to strengths and weaknesses in the portion of the curriculum designed to prepare students for effective provider-patient communication. These results may suggest a need for the school's current behavioral science curriculum to better address discussion of potential treatment barriers and patient feelings as well as techniques to ensure patient comprehension.

  2. Using the Dynamic Model to Identify Stages of Teacher Skills in Assessment

    Science.gov (United States)

    Christoforidou, Margarita; Xirafidou, Elisavet

    2014-01-01

    The article presents the results of two cross-sectional studies that investigate teachers' skills in using various techniques of assessment in mathematics by taking into account the four phases of assessment. The five dimensions of the dynamic model are also taken into account in proposing a framework for measuring teacher skills in assessment.…

  3. [Use of physical assessment skills and education needs of advanced practice nurses and nurse specialists].

    Science.gov (United States)

    Shin, Hyunsook; Kim, Bog-Ja; Kang, Hee Sun

    2009-10-01

    The study was done to investigate physical assessment skills used by, and educational needs of, advanced practice nurses (APNs) and nurse specialists in Korea. A total of 123 APNs and nurse specialists working in five major hospitals in Seoul were surveyed from July 15 to August 20, 2007. Fourteen skills out of 126 items were reported as being performed on a regular basis by participants. The majority of these skills involved general observation. Forty-six skills were rarely used. Some participants showed a lack of confidence in certain assessment skills, such as in doing a rectal or pelvic exam, and the use of some assessment equipment. Over 90% of participants required in-depth education on health assessment provided by specialists or nursing professional organizations. More educational opportunities in physical assessment should be provided including education programs based on the nurses' skill levels and needs. This effort will help to increase confidence of APNs and nurse specialists in physical assessment skills, ultimately resulting in better nursing outcomes.

  4. A Trend Analysis of Computer Literacy Skills of Preservice Teachers During Six Academic Years.

    Science.gov (United States)

    Sheffield, Caryl J.

    1998-01-01

    Analyzes trends in computer-literacy skills of preservice teachers during the period 1991/92 to 1996/97. A significant linear pattern of increasing means was found in word processing, spreadsheet, hardware, operating system software, and the mouse. Analysis provides a perspective on how increasing access to computers in high school translates into…

  5. A qualitative study of advanced nurse practitioners’ use of physical assessment skills in the community: shifting skills across professional boundaries

    OpenAIRE

    Raleigh, Mary; Allan, Helen T.

    2017-01-01

    Aim\\ud To explore multiple perspectives on the use of physical assessment skills by Advanced Nurse Practitioners in the UK\\ud Background \\ud Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by Advanced Nurse Practitioners' on the community.\\ud Design \\ud Case study\\ud Methodology and methods. \\ud A qualitative interpretative single-embedded case study of 22 participants from South of England. ...

  6. Assessing Change in High School Student Information Literacy Using the Tool for Real-Time Assessment of Information Literacy Skills

    Science.gov (United States)

    Kovalik, Cindy L.; Yutzey, Susan D.; Piazza, Laura M.

    2012-01-01

    Change in high school student information literacy (IL) knowledge and skills, from freshman year to senior year in high school was the focus of this quasi-experimental research project. Researchers used a free information literacy skills assessment tool entitled TRAILS (Tool for Real-time Assessment of Information Literacy Skills) to measure…

  7. Health Sciences Students’ Self-Assessment of Information and Communication Technology Skills and Attitude Toward e-Learning

    Science.gov (United States)

    Al-Shawaf, Hamza Mohammad Hassan; Almajran, Abdullah Abdulaziz

    2016-01-01

    Background In medical education, information and communication technology (ICT) knowledge and skills have become a necessity and an integral part of preparing tomorrow’s doctors to be sufficiently competent to use informatics resources effectively and efficiently for the best practice of medicine. Objective This research aimed to study the literacy of the preprofessional students in ICT before and after taking the basic informatics course at the Health Sciences Center at Kuwait University, to understand their potential and their attitudes toward using ICT, including e-learning. Methods A validated questionnaire was used to collect data from 200 students in 2 stages: before and after the informatics course on the preprofessional program. In addition, the tutors’ observational assessments of the students’ achievements during the informatics course were obtained. Results The response rate of students before the course was 85.5% (171/200) and after was 77% (154/200). Of 200 students, 85% were female, and 15% were male. This disproportional representation of genders was due to the fact that 85% of registered students were female. Approximately 59% (101/171) of the students assessed themselves before the course as computer literate; afterward, this increased to 70.1% (108/154). Students who were still computer illiterate (29.2%; 45/154) mostly used the excuse of a lack of time (60%; 27/45). In generic ICT skills, the highest levels were for word processing, email, and Web browsing, whereas the lowest levels were for spreadsheets and database. In specific ICT skills, most respondents were reported low levels for statistical package use and Web page design. The results found that there was a significant improvement between students’ general ICT skills before and after the course. The results showed that there were significant improvement between how frequently students were using Medline (Pstudents who completed the course (72.8%; 110/151) chose the learning

  8. Towards an Integrated Model for Developing Sustainable Assessment Skills

    Science.gov (United States)

    Fastre, Greet M. J.; van der Klink, Marcel R.; Sluijsmans, Dominique; van Merrienboer, Jeroen J. G.

    2013-01-01

    One of the goals of current education is to ensure that graduates can act as independent lifelong learners. Graduates need to be able to assess their own learning and interpret assessment results. The central question in this article is how to acquire sustainable assessment skills, enabling students to assess their performance and learning…

  9. The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

    Directory of Open Access Journals (Sweden)

    Lisa M. Barnett, Louise L. Hardy, Ali S. Brian

    2015-03-01

    Full Text Available The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test. A Delphi consultation (with golf industry professionals and researchers in movement skill assessment was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24. Children (n = 43 aged 6-10 years (M = 7.8 years, SD = 1.3 were assessed in both skills live in the field by one rater at Time 1(T1. A subset of children (n = 28 had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3. An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years. Intraclass correlations (ICC assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3. Paired t-tests assessed any systematic differences between live and video assessments (T1 and between T2 and T3. Older children were more skilled (F (2, 40 = 11.18, p < 0.001. The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90 and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82, although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback.

  10. Nursing assessment of older people who are in hospital: exploring registered nurses' understanding of their assessment skills.

    Science.gov (United States)

    Penney, Wendy; Poulter, Nola; Cole, Clare; Wellard, Sally

    2016-01-01

    Nurses worldwide are expected to take a leading role in caring for older people. Considerable literature dedicated to the range and application of assessment skills used by nurses vary. There is limited knowledge of registered nurses' (RNs) views of their assessment of older adults. The aim of this project was to explore RNs current perceptions of nursing assessment, and the core skills they identified as necessary. A qualitative descriptive design study was conducted in three inpatient units in one regional hospital in Victoria. Date were collected through participant observation of RNs (n = 13) followed by 1:1 semi-structured interviews. Data were analysed thematically. This research has illuminated that an ill-defined repertoire of skills was used by RNs when assessing older persons. Skills identified appeared to be based on years of personal-professional experience. Differences were noted between the descriptions nurses gave and what was observed during interactions with older persons.

  11. Impact of tailored feedback in assessment of communication skills for medical students.

    Science.gov (United States)

    Uhm, Seilin; Lee, Gui H; Jin, Jeong K; Bak, Yong I; Jeoung, Yeon O; Kim, Chan W

    2015-01-01

    Finding out the effective ways of teaching and assessing communication skills remain a challenging part of medication education. This study aims at exploring the usefulness and effectiveness of having additional feedback using qualitative analysis in assessment of communication skills in undergraduate medical training. We also determined the possibilities of using qualitative analysis in developing tailored strategies for improvement in communication skills training. This study was carried out on medical students (n=87) undergoing their final year clinical performance examination on communication skills using standardized patient by video-recording and transcribing their performances. Video-recordings of 26 students were randomly selected for qualitative analysis, and additional feedback was provided. We assessed the level of acceptance of communication skills scores between the study and nonstudy group and within the study group, before and after receiving feedback based on qualitative analysis. There was a statistically significant increase in the level of acceptance of feedback after delivering additional feedback using qualitative analysis, where the percentage of agreement with feedback increased from 15.4 to 80.8% (pskills assessment gives essential information for medical students to learn and self-reflect, which could potentially lead to improved communication skills. As evident from our study, feedback becomes more meaningful and effective with additional feedback using qualitative analysis.

  12. Assessment of HIV/AIDS and Life Skills Delivery in Primary Schools in Tanzania

    Science.gov (United States)

    Rushahu, Bernadetha Gabriel

    2015-01-01

    This study was conducted to assess the effectiveness of HIV/AIDS and the Life Skills Education delivery in primary schools in Tanzania. Specifically the study investigated pupils' views about the effect of HIV/AIDS and Life Skills teaching in primary schools in Tanzania; assessed pupils' knowledge related to HIV/AIDS and Life Skills education, and…

  13. Developing a strategy for computational lab skills training through Software and Data Carpentry: Experiences from the ELIXIR Pilot action.

    Science.gov (United States)

    Pawlik, Aleksandra; van Gelder, Celia W G; Nenadic, Aleksandra; Palagi, Patricia M; Korpelainen, Eija; Lijnzaad, Philip; Marek, Diana; Sansone, Susanna-Assunta; Hancock, John; Goble, Carole

    2017-01-01

    Quality training in computational skills for life scientists is essential to allow them to deliver robust, reproducible and cutting-edge research. A pan-European bioinformatics programme, ELIXIR, has adopted a well-established and progressive programme of computational lab and data skills training from Software and Data Carpentry, aimed at increasing the number of skilled life scientists and building a sustainable training community in this field. This article describes the Pilot action, which introduced the Carpentry training model to the ELIXIR community.

  14. Assessing maths literacy skills in type 1 diabetic children and their ...

    African Journals Online (AJOL)

    Background: It is essential that children have adequate numeracy and literacy skills in order to manage their diabetes effectively. The objective was to undertake a pilot study to assess the level of numeracy skills in type 1 diabetic children and their caregivers, and to ascertain if there was a deficit in these skills.

  15. Concrete Steps for Assessing the "Soft Skills" in an MBA Program

    Science.gov (United States)

    Ingols, Cynthia; Shapiro, Mary

    2014-01-01

    In 2006, our School of Management began the serious path of assessing both the "hard skills" (such as accounting, finance, and strategy) and the "soft skills" (such as leadership, team work, and ethics) of our MBA Program. The data generated from examining the "soft skills" that we want students to learn within our…

  16. Examining the Relationship between Digital Game Preferences and Computational Thinking Skills

    Science.gov (United States)

    Yildiz, Hatice Durak; Yilmaz, Fatma Gizem Karaoglan; Yilmaz, Ramazan

    2017-01-01

    The purpose of this study is to identify whether computational thinking skills among secondary school students differ depending on the type of digital games they play. The participants of this study were 202 secondary school students at 5th, 6th, 7th and 8th grades during 2016-2017 academic year. Correlational survey method was used during this…

  17. A Guttman scale for assessing condom use skills among college students.

    Science.gov (United States)

    Lindemann, Dana F; Brigham, Thomas A

    2003-03-01

    HIV risk-reduction interventions frequently teach correct condom use skills, yet few researchers actually measure those skills. Without measuring condom use skills, it is not possible to evaluate the effectiveness of condom use interventions, or determine what variables may be related to those skills. The Measure of Observed Condom Use Skills (MOCUS) was developed using standard Guttman scaling procedures, and administered to 106 female and 71 male undergraduates. The MOCUS was administered by the primary investigator to each participant individually. Guttman scale analyses demonstrated the MOCUS has acceptable reproducibility. These findings support future use of the MOCUS to assess condom use skills.

  18. Assessment of Teacher Perceived Skill in Classroom Assessment Practices Using IRT Models

    Science.gov (United States)

    Koloi-Keaikitse, Setlhomo

    2017-01-01

    The purpose of this study was to assess teacher perceived skill in classroom assessment practices. Data were collected from a sample of (N = 691) teachers selected from government primary, junior secondary, and senior secondary schools in Botswana. Item response theory models were used to identify teacher response on items that measured their…

  19. Evaluating structured assessment of anaesthesiologists' non-technical skills

    DEFF Research Database (Denmark)

    Jepsen, R M H G; Dieckmann, P; Spanager, L

    2016-01-01

    BACKGROUND: Non-technical skills (NTS) are essential for safe and efficient anaesthesia. Assessment instruments with appropriate validity evidence can be used to ensure that anaesthesiologists possess the NTS necessary to deliver high-standard patient care. The aims were to collect validity...... evidence using a contemporary validity framework for the assessment instrument Anaesthesiologists' Non-Technical Skills in Denmark (ANTSdk) regarding response process and internal structure (including reliability), and to investigate the effect of rater training on these properties. METHODS: An explorative...... study was undertaken at the Danish Institute for Medical Simulation, Copenhagen, Denmark. In a 1-day session, using ANTSdk, a convenience sample of 19 anaesthesiologists rated trainee anaesthesiologists' NTS in nine video-recorded simulation scenarios before and after a 3-h training session. RESULTS...

  20. The IDEA Assessment Tool: Assessing the Reporting, Diagnostic Reasoning, and Decision-Making Skills Demonstrated in Medical Students' Hospital Admission Notes.

    Science.gov (United States)

    Baker, Elizabeth A; Ledford, Cynthia H; Fogg, Louis; Way, David P; Park, Yoon Soo

    2015-01-01

    Construct: Clinical skills are used in the care of patients, including reporting, diagnostic reasoning, and decision-making skills. Written comprehensive new patient admission notes (H&Ps) are a ubiquitous part of student education but are underutilized in the assessment of clinical skills. The interpretive summary, differential diagnosis, explanation of reasoning, and alternatives (IDEA) assessment tool was developed to assess students' clinical skills using written comprehensive new patient admission notes. The validity evidence for assessment of clinical skills using clinical documentation following authentic patient encounters has not been well documented. Diagnostic justification tools and postencounter notes are described in the literature (1,2) but are based on standardized patient encounters. To our knowledge, the IDEA assessment tool is the first published tool that uses medical students' H&Ps to rate students' clinical skills. The IDEA assessment tool is a 15-item instrument that asks evaluators to rate students' reporting, diagnostic reasoning, and decision-making skills based on medical students' new patient admission notes. This study presents validity evidence in support of the IDEA assessment tool using Messick's unified framework, including content (theoretical framework), response process (interrater reliability), internal structure (factor analysis and internal-consistency reliability), and relationship to other variables. Validity evidence is based on results from four studies conducted between 2010 and 2013. First, the factor analysis (2010, n = 216) yielded a three-factor solution, measuring patient story, IDEA, and completeness, with reliabilities of .79, .88, and .79, respectively. Second, an initial interrater reliability study (2010) involving two raters demonstrated fair to moderate consensus (κ = .21-.56, ρ =.42-.79). Third, a second interrater reliability study (2011) with 22 trained raters also demonstrated fair to moderate agreement

  1. STUDENTS’ COMMUNICATION SKILLS ASSESSMENT BY EXTERNAL LECTURERS AND INDUSTRY REPRESENTATIVES

    Directory of Open Access Journals (Sweden)

    NOORFAZILA KAMAL

    2016-11-01

    Full Text Available Soft skills, especially communication skills, are important skills which each graduate must possess. Accordingly, several courses and approaches have been carried out in universities to train students in communication skills. The skills are normally evaluated by course lecturers. However, assessments by a third party from outside the university are valuable so that the students’ ahievements may be weighed against external evaluators’ point of views. In the Department of Electrical, Electronic and Systems Engineering (DEESE, Universiti Kebangsaan Malaysia (UKM, communication skills assessment by external lecturers and industry representatives are performed on Hari Poster JKEES, where students present their final year project poster. There are two categories of evaluation, namely project and communication skills. The project evaluation covers content, result and impact, while communication skills evaluation covers poster layout and design, and delivery. This study only analyse the students’ communication skills achievement. The participants of this study consists of 109 final year students from two batches, of which 51 students are from year 2014 and the other 58 students from year 2015. The results show that for the year 2014 students, the mean mark given by external lecturers in layout and design category is 6.7, while the mean mark from industry evaluators is 6.5. For the 2015 batch, the mean mark in the layout and design category is 6.3 from external lecturers and 5.9 from industry evaluators. In the delivery category, the mean marks for the 2014 batch are 7.1 and 6.6 from external lecturers and industry evaluators, espectively. Meanwhile, for the 2015 batch, the mean marks by external lecturers and industry evaluators are 6.3 and 5.8, respectively. The results show that both external lecturers and industry representatives judged DEESE students’ communication skills to be good.

  2. Computeen: A Randomized Trial of a Preventive Computer and Psychosocial Skills Curriculum for At-Risk Adolescents

    Science.gov (United States)

    Lang, Jason M.; Waterman, Jill; Baker, Bruce L.

    2009-01-01

    Computeen, a preventive technology and psychosocial skills development program for at-risk adolescents, was designed to improve computer skills, self-esteem, and school attitudes, and reduce behavior problems, by combining elements of community-based and empirically supported prevention programs. Fifty-five mostly Latino adolescents from 12 to 16…

  3. Information and psychomotor skills knowledge acquisition: A student-customer-centered and computer-supported approach.

    Science.gov (United States)

    Nicholson, Anita; Tobin, Mary

    2006-01-01

    This presentation will discuss coupling commercial and customized computer-supported teaching aids to provide BSN nursing students with a friendly customer-centered self-study approach to psychomotor skill acquisition.

  4. Certified Basic Life Support Instructors Assess Cardiopulmonary Resuscitation Skills Poorly

    DEFF Research Database (Denmark)

    Hansen, Camilla; Rasmussen, Stinne E; Kristensen, Mette Amalie

    2016-01-01

    Introduction: High-quality cardiopulmonary resuscitation (CPR) improves survival from cardiac arrest. During basic life support (BLS) training, instructors assess CPR skills to enhance learning outcome. Emergency department staff and senior residents have been shown to assess chest compression...... quality poorly. Currently no studies have evaluated CPR assessment among certified BLS instructors. The aim of this study was to investigate certified BLS instructors’ assessment of chest compressions and rescue breathing.Methods: Data were collected at BLS courses for medical students at Aarhus...... of CPR skills may be beneficial to ensure high-quality learning outcome.Author Disclosures: C. Hansen: None. S.E. Rasmussen: None. M.A. Nebsbjerg: None. M. Stærk: None. B. Løfgren: None....

  5. Self-Assessment of Video-Recorded Presentations: Does It Improve Skills?

    Science.gov (United States)

    Ritchie, Sian M.

    2016-01-01

    The opportunity to give oral presentations is important because it helps develop skills that are necessary for many aspects of professional careers. Competencies for oral presentations include appropriate content, design and organization of the presentation, and delivery skills. Self-assessment has been shown to help students develop…

  6. Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.

    Science.gov (United States)

    Guru, Khurshid A; Esfahani, Ehsan T; Raza, Syed J; Bhat, Rohit; Wang, Katy; Hammond, Yana; Wilding, Gregory; Peabody, James O; Chowriappa, Ashirwad J

    2015-01-01

    To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons. In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics. Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups. Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS. © 2014 The Authors. BJU International © 2014 BJU International.

  7. Assessing Gross Motor Skills of Kosovar Preschool Children

    Science.gov (United States)

    Shala, Merita

    2009-01-01

    In the light of the new developments in preschool education in Kosovo, this study attempts to carry out an assessment of the development of gross motor skills of preschool children attending institutional education. The emphasis is on creating a set of tests to measure the motor attainments of these children by conducting assessments of the…

  8. Assessment Work: Examining the Prevalence and Nature of Assessment Competencies and Skills in Student Affairs Job Postings

    Science.gov (United States)

    Hoffman, John L.; Bresciani, Marilee J.

    2010-01-01

    This mixed method study explored the assessment-related skills and job duties that student affairs administrators expect from new employees as reflected in 1,759 job openings posted in 2008, of which seven job postings were specialist positions in outcomes-based assessment. The skills and duties required of these seven positions were primarily…

  9. Retrospectively Assessed Early Motor and Current Pragmatic Language Skills in Autistic and Neurotypical Children.

    Science.gov (United States)

    Stevenson, Jennifer L; Lindley, Caitlin E; Murlo, Nicole

    2017-08-01

    Autistic individuals often struggle developmentally, even in areas that are not explicit diagnostic criteria, such as motor skills. This study explored the relation between early motor skills, assessed retrospectively, and current pragmatic language skills. Caregivers of neurotypical and autistic children, matched on gender and age, completed assessments of their child's early motor development and current language abilities. Early motor skills were correlated with later pragmatic language skills, and autistic children exhibited fewer motor skills than neurotypical children. In fact, motor skills were a better predictor of an autism spectrum diagnosis than were scores on a measure of current pragmatic language. These results highlight the important role of motor skills in autism spectrum disorders.

  10. Assessment of validity of an OSATS for cystoscopic and ureteroscopic cognitive and psychomotor skills.

    Science.gov (United States)

    Kishore, Thekke Adiyat; Pedro, Renato N; Monga, Manoj; Sweet, Robert M

    2008-12-01

    The purpose of the study was to assess the construct validity of an Objective Structured Assessment of Technical Skills (OSATS) developed for cystoscopic and ureteroscopic cognitive and psychomotor skills. An OSATS was designed based on a 14-point comprehensive curriculum prepared by two experts that targeted both cognitive and psychomotor cystoscopic and ureteroscopic skills. Ten urology residents from a single institution with different levels of training were assessed on a series of stations that targeted these skills. Evaluation of cognitive skills was done via a written examination, and psychomotor skills assessment was done by experts using both subjective and objective metrics. Twelve of 15 cognitive tasks and 5 of 5 psychomotor tasks demonstrated construct validity with correlation coefficient (r) more than .75. All three of the cognitive tasks that failed to initially demonstrate validity did so on editorial revision and restructuring of the questions. Our cystoscopic and ureteroscopic OSATS showed excellent construct validity for our population of residents, and we have incorporated it into our urologic skills curriculum.

  11. Construct validation of teacher portfolio assessment : Procedures for improving teacher competence assessment illustrated by teaching students research skills

    NARCIS (Netherlands)

    Schaaf, M.F. van der

    2005-01-01

    The study aims to design and test procedures for teacher portfolio assessments. What are suitable procedures to assess teachers' competencies in developing students' research skills? We first searched into the tasks teachers have in teaching students research skills and the competencies needed to

  12. Teacher Compliance and Accuracy in State Assessment of Student Motor Skill Performance

    Science.gov (United States)

    Hall, Tina J.; Hicklin, Lori K.; French, Karen E.

    2015-01-01

    Purpose: The purpose of this study was to investigate teacher compliance with state mandated assessment protocols and teacher accuracy in assessing student motor skill performance. Method: Middle school teachers (N = 116) submitted eighth grade student motor skill performance data from 318 physical education classes to a trained monitoring…

  13. Computer-Assisted Face Processing Instruction Improves Emotion Recognition, Mentalizing, and Social Skills in Students with ASD

    Science.gov (United States)

    Rice, Linda Marie; Wall, Carla Anne; Fogel, Adam; Shic, Frederick

    2015-01-01

    This study examined the extent to which a computer-based social skills intervention called "FaceSay"™ was associated with improvements in affect recognition, mentalizing, and social skills of school-aged children with Autism Spectrum Disorder (ASD). "FaceSay"™ offers students simulated practice with eye gaze, joint attention,…

  14. Differences on the Level of Social Skills between Freshman Computer Gamers and Non-Gamers

    OpenAIRE

    Joseph B. Campit

    2015-01-01

    Computer games play a large role in socialization and the consequences of playing them have been a topic of debates. This observation led the researcher to conduct the study about the influence of computer games on the social skills of the BSIT first year students of Pangasinan State University, Bayambang Campus, during school year 2012-2013. This study determined the profile of the 115 BSIT first year students according to: preferred computer games and frequency of playing. It in...

  15. Multi-informant assessment of transition-related skills and skill importance in adolescents with autism spectrum disorder.

    Science.gov (United States)

    Hume, Kara; Dykstra Steinbrenner, Jessica; Sideris, John; Smith, Leann; Kucharczyk, Suzanne; Szidon, Kate

    2018-01-01

    Adolescents with autism spectrum disorder have limited participation in the transition planning process, despite the link between active participation and an improvement in postsecondary education and employment outcomes. The Secondary School Success Checklist was designed to support transition planning for adolescents with autism spectrum disorder by incorporating their own assessments of strengths, skill deficits, and prioritization for instruction along with those of their parents and teachers across multiple skill domains. Findings from more than 500 adolescents with autism spectrum disorder across the United States indicate discrepancies between adolescent, teacher, and parent ratings of skills highlighting the importance of the inclusion of multiple perspectives in transition planning. Although ratings varied, agreement between adolescents with autism spectrum disorder, parents, and teachers across the highest and lowest rated skills suggests the need to broaden the focus on critical transition skills to include problem-solving, planning for life after high school, and self-advocacy.

  16. A psychometric assessment of the LPME scale for the South African skills development context

    Directory of Open Access Journals (Sweden)

    Maelekanyo Christopher Tshilongamulenzhe

    2015-09-01

    Full Text Available A thorough examination of psychometric properties of measurement scales is necessary to ensure that these scales comply with the existing scientific conventions. This article assesses the psychometric properties of the Learning Programme Management and Evaluation (LPME scale. A quantitative, non-experimental cross-sectional survey design was used. Data were collected from a sample of 652 respondents comprising skills development practitioners and learners/apprentices. Data were analyzed using Winsteps, SPSS and AMOS computer software. The findings show that the LPME scale meets the psychometric expectations and complies with the established scientific conventions in terms of validity, reliability, fit and unidimensionality.

  17. A Comparative Study of University of Wisconsin-Stout Freshmen and Senior Education Majors Computing and Internet Technology Skills / Knowledge and Associated Learning Experiences

    OpenAIRE

    Sveum, Evan Charles

    2010-01-01

    A study comparing University of Wisconsin-Stout freshmen and senior education majors’ computing and Internet technology skills/knowledge and associated learning experiences was conducted. Instruments used in this study included the IC³® Exam by Certiport, Inc. and the investigator’s Computing and Internet Skills Learning Experiences survey. UW-Stout freshmen education majors participating in the study demonstrated poor computing and Internet technology skills/knowledge. UW-Stout senior educat...

  18. Assessing study skills among university students: an Iranian survey.

    Science.gov (United States)

    Didarloo, Alireza; Khalkhali, Hamid Reza

    2014-05-05

    Numerous studies have revealed that study skills have a constructive role on the academic performance of students, in addition to educational quality, student' intelligence, and their affective characteristics. This study aims to examine study skills and the factors influencing them among the health sciences students of Urmia University of Medical Sciences in Iran. This was a cross-sectional study carried out from May to November 2013. A total of 340 Urmia health sciences students were selected using a simple sampling method. Data were collected using the Study Skills Assessment Questionnaire of Counseling Center of Houston University and analyzed with descriptive and analytical statistics. The mean and standard deviation of the students' study skills were 172.5±23.2, out of a total score of 240. Around 1.2% of the study skills were weak; 86.8%, moderate; and 12%, good. Among the study skills, the scores of time management, and memory and concentration were better than the others. Also, there was a significant positive correlation between study skills scores and the students' family housing status and academic level (Pstudy skills, these were not sufficient and far from good. Improving and promoting the study skills of university students require the designing and implementing of education programs for study strategies. Therefore, decision makers and planners in the educational areas of universities should consider the topic described above.

  19. Employability Skills Assessment: Measuring Work Ethic for Research and Learning

    Science.gov (United States)

    Park, HwaChoon; Hill, Roger B.

    2016-01-01

    The Employability Skills Assessment (ESA) was developed by Hill (1995) to provide an alternative measure of work ethic needed for success in employment. This study tested goodness-of-fit for a model used to interpret ESA results. The model had three factors: interpersonal skills, initiative, and dependability. Confirmatory factor analysis results…

  20. Assessment of structured physical examination skills training using a retro-pre-questionnaire.

    Science.gov (United States)

    Piryani, Rano Mal; Shankar, P Ravi; Piryani, Suneel; Thapa, Trilok Pati; Karki, Balmansingh; Khakurel, Mahesh Prasad; Bhandary, Shital

    2013-01-01

    The effectiveness of physical examination skills (PES) training is very rarely assessed using the "post-then-pre" approach. In this study, a retro-pre-questionnaire was used to study the effect of structured physical examination skills training (SPEST) imparted to second-year undergraduate medical students. KIST Medical College (KISTMC) affiliated to Tribhuvan University Nepal admitted its first batch of MBBS students in November 2008. The university curriculum recommends the involvement of Medicine and Surgery Departments in PES training, but the methods for teaching and assessment are not well defined. KISTMC has made training more structured and involved the Medicine, Surgery, Gynaecology and Obstetrics, Orthopaedics, ENT, Ophthalmology, Paediatrics, and Family Medicine Departments. SPEST includes the teaching/learning of basic PES for 210 minutes once a week for 28 weeks. Self-assessment is done by using a retro-pre-questionnaire at the end of the last session of training, and these data are analysed using SPSS. Out of 100 students, 98 participated in the objective structured clinical examination (OSCE); 82 completed the retro-pre-questionnaire. Forty-six skills representing various systems were selected for inclusion in the retro-pre-questionnaire from among the many skills taught in different departments. The average perceived skills score (maximum score, 46×4=184) before training was 15.9 and increased to 116.5 after training. The increase was statistically significant upon the application of a paired t-test. The students perceived that their level of skills improved after the training. The retro-pre- instrument seems to be useful for assessing the learners' self-reported changes in PES after training if a large number of skills need to be assessed. However, it should be noted that although a retro-pre-questionnaire may reveal valuable information, it is not a substitute for an objective measure or gold standard.

  1. Aligning CASAS Competencies and Assessments to Basic Skills Content Standards. Second Edition

    Science.gov (United States)

    CASAS - Comprehensive Adult Student Assessment Systems (NJ1), 2009

    2009-01-01

    Since its inception, the Comprehensive Adult Student Assessment System (CASAS) has focused on teaching and assessing basic skills in contexts that are relevant and important to adult learners. CASAS has developed and continues to refine a highly formalized hierarchy of competencies, the application of basic skills that adults need to be fully…

  2. Ability-versus skill-based assessment of emotional intelligence.

    Science.gov (United States)

    Bradberry, Travis R; Su, Lac D

    2006-01-01

    Emotional intelligence has received an intense amount of attention in leadership circles during the last decade and continuing debate exists concerning the best method for measuring this construct. This study analyzed leader emotional intelligence scores, measured via skill and ability methodologies, against leader job performance. Two hundred twelve employees from three organizations participated in this study. Scores on the Emotional Intelligence Appraisal, a skill-based assessment, were positively, though not significantly, correlated with scores on the MSCEIT, an ability-based assessment of emotional intelligence. Scores on the MSCEIT did not have a significant relationship with job performance in this study, whereas, scores on the Emotional Intelligence Appraisal had a strong link to leader job performance. The four subcomponents of the Emotional Intelligence Appraisal were examined against job performance. Relationship management was a stronger predictor of leader job performance than the other three subcomponents. Social awareness was the single emotional intelligence skill that did not have a significant link to leader job performance. Factor analyses yielded a two-component model of emotional intelligence encompassing personal and social competence, rather than confirmation of a four-part taxonomy.

  3. Extended score interval in the assessment of basic surgical skills.

    Science.gov (United States)

    Acosta, Stefan; Sevonius, Dan; Beckman, Anders

    2015-01-01

    The Basic Surgical Skills course uses an assessment score interval of 0-3. An extended score interval, 1-6, was proposed by the Swedish steering committee of the course. The aim of this study was to analyze the trainee scores in the current 0-3 scored version compared to a proposed 1-6 scored version. Sixteen participants, seven females and nine males, were evaluated in the current and proposed assessment forms by instructors, observers, and learners themselves during the first and second day. In each assessment form, 17 tasks were assessed. The inter-rater reliability between the current and the proposed score sheets were evaluated with intraclass correlation (ICC) with 95% confidence intervals (CI). The distribution of scores for 'knot tying' at the last time point and 'bowel anastomosis side to side' given by the instructors in the current assessment form showed that the highest score was given in 31 and 62%, respectively. No ceiling effects were found in the proposed assessment form. The overall ICC between the current and proposed score sheets after assessment by the instructors increased from 0.38 (95% CI 0.77-0.78) on Day 1 to 0.83 (95% CI 0.51-0.94) on Day 2. A clear ceiling effect of scores was demonstrated in the current assessment form, questioning its validity. The proposed score sheet provides more accurate scores and seems to be a better feedback instrument for learning technical surgical skills in the Basic Surgical Skills course.

  4. Multi-model global assessment of subseasonal prediction skill of atmospheric rivers

    Science.gov (United States)

    Deflorio, M. J.

    2017-12-01

    Atmospheric rivers (ARs) are global phenomena that are characterized by long, narrow plumes of water vapor transport. They are most often observed in the midlatitudes near climatologically active storm track regions. Because of their frequent association with floods, landslides, and other hydrological impacts on society, there is significant incentive at the intersection of academic research, water management, and policymaking to understand the skill with which state-of-the-art operational weather models can predict ARs weeks-to-months in advance. We use the newly assembled Subseasonal-to-Seasonal (S2S) database, which includes extensive hindcast records of eleven operational weather models, to assess global prediction skill of atmospheric rivers on S2S timescales. We develop a metric to assess AR skill that is suitable for S2S timescales by counting the total number of AR days which occur over each model and observational grid cell during a 2-week time window. This "2-week AR occurrence" metric is suitable for S2S prediction skill assessment because it does not consider discrete hourly or daily AR objects, but rather a smoothed representation of AR occurrence over a longer period of time. Our results indicate that several of the S2S models, especially the ECMWF model, show useful prediction skill in the 2-week forecast window, with significant interannual variation in some regions. We also present results from an experimental forecast of S2S AR prediction skill using the ECMWF and NCEP models.

  5. MOJECT: MOTION ANALYSIS TO SUPPORT ASSESSMENT OF SURGICAL SKILLS

    NARCIS (Netherlands)

    Uineken, Ruben; Groot Jebbink, Erik; Halfwerk, F.R.; Bulten, Anne; Knoben, Peter; Roux, Moritz; Wicik, Ola; Groenier, Marleen

    2018-01-01

    Assessment of surgical skills is usually performed through direct observation by experts. This is subjective, expensive and requires assessor training. Motion analysis can support objective and cost-effective assessment. The aim of the current study is to design a low-cost, unobtrusive system for

  6. Assessment of time management skills: psychometric properties of the Swedish version.

    Science.gov (United States)

    Janeslätt, Gunnel Kristina; Holmqvist, Kajsa Lidström; White, Suzanne; Holmefur, Marie

    2018-05-01

    Persons with impaired time management skills are often in need of occupational therapy. Valid and reliable instruments to assess time management and organizational skills are needed for the evaluation of intervention. The purpose of this study was to evaluate the psychometric properties of a Swedish version of the Assessment of Time Management Skills (ATMS-S) for persons with and without impaired time management skills. A total of 238 persons participated in the study, of whom 94 had self-reported impaired time management skills due to mental disorders such as schizophrenic spectrum or neurodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and mild intellectual disabilities, and 144 persons had no reported impaired time management skills. Rasch analysis was used to analyze data. Three subscales were detected: the time management subscale with 11 items, the organization & planning subscale with 11 items, and the subscale of regulation of emotions with 5 items, with excellent to acceptable psychometric properties. The conclusions were that: ATMS-S is a valid instrument for self-rating of time management, organization & planning and for the regulation of emotions. ATMS-S can be useful for persons with mental disorders including mild neurodevelopmental disorders.

  7. Teaching emergency medical services management skills using a computer simulation exercise.

    Science.gov (United States)

    Hubble, Michael W; Richards, Michael E; Wilfong, Denise

    2011-02-01

    Simulation exercises have long been used to teach management skills in business schools. However, this pedagogical approach has not been reported in emergency medical services (EMS) management education. We sought to develop, deploy, and evaluate a computerized simulation exercise for teaching EMS management skills. Using historical data, a computer simulation model of a regional EMS system was developed. After validation, the simulation was used in an EMS management course. Using historical operational and financial data of the EMS system under study, students designed an EMS system and prepared a budget based on their design. The design of each group was entered into the model that simulated the performance of the EMS system. Students were evaluated on operational and financial performance of their system design and budget accuracy and then surveyed about their experiences with the exercise. The model accurately simulated the performance of the real-world EMS system on which it was based. The exercise helped students identify operational inefficiencies in their system designs and highlighted budget inaccuracies. Most students rated the exercise as moderately or very realistic in ambulance deployment scheduling, budgeting, personnel cost calculations, demand forecasting, system design, and revenue projections. All students indicated the exercise was helpful in gaining a top management perspective, and 89% stated the exercise was helpful in bridging the gap between theory and reality. Preliminary experience with a computer simulator to teach EMS management skills was well received by students in a baccalaureate paramedic program and seems to be a valuable teaching tool. Copyright © 2011 Society for Simulation in Healthcare

  8. Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

    Science.gov (United States)

    Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

    2015-07-01

    Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

  9. Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures.

    Science.gov (United States)

    Gallagher, Anthony G; Smith, C Daniel; Bowers, Steven P; Seymour, Neal E; Pearson, Adam; McNatt, Steven; Hananel, David; Satava, Richard M

    2003-09-01

    Minimally invasive surgery (MIS) has introduced a new and unique set of psychomotor skills for a surgeon to acquire and master. Although assessment technologies have been proposed, precise and objective psychomotor skills assessment of surgeons performing laparoscopic procedures has not been detailed. Two hundred ten surgeons attending the 2001 annual meeting of the American College of Surgeons in New Orleans who reported having completed more than 50 laparoscopic procedures participated. Subjects were required to complete one box-trainer laparoscopic cutting task and a similar virtual reality task. These tasks were specifically designed to test only psychomotor and not cognitive skills. Both tasks were completed twice. Performance of tasks was assessed and analyzed. Demographic and laparoscopic experience data were also collected. Complete data were available on 195 surgeons. In this group, surgeons performed the box-trainer task better with their dominant hand (p psychomotor skills is now possible. Surgeons who had performed more than 50 laparoscopic procedures showed considerable variability in their performance on a simple laparoscopic and virtual reality task. Approximately 10% of surgeons tested performed the task significantly worse than the group's average performance. Studies such as this may form the methodology for establishing criteria levels and performance objectives in objective assessment of the technical skills component of determining surgical competence.

  10. Assessing the Nontechnical Skills of Surgical Trainees: Views of the Theater Team.

    Science.gov (United States)

    Al-Jundi, Wissam; Wild, Jonathan; Ritchie, Judith; Daniels, Sarah; Robertson, Eleanor; Beard, Jonathan

    2016-01-01

    This study aims to explore the views of members of theater teams regarding the proposed introduction of a workplace-based assessment of nontechnical skills of surgeons (NOTSS) into the Intercollegiate Surgical Curriculum Programme in the United Kingdom. In addition, the previous training and familiarity of the members of the surgical theater team with the concept and assessment of NOTSS would be evaluated. A regional survey of members of theater teams (consultant surgeons, anesthetists, scrub nurses, and trainees) was performed at 1 teaching and 2 district general hospitals in South Yorkshire. There were 160 respondents corresponding to a response rate of 81%. The majority (77%) were not aware of the NOTSS assessment tool with only 9% of respondents reporting to have previously used the NOTSS tool and just 3% having received training in NOTSS assessment. Overall, 81% stated that assessing NOTSS was as important as assessing technical skills. Trainees attributed less importance to nontechnical skills than the other groups (p ≤ 0.016). Although opinion appears divided as to whether the presence of a consultant surgeon in theater could potentially make it difficult to assess a trainee's leadership skills and decision-making capabilities, overall 60% agree that the routine use of NOTSS assessment would enhance safety in the operating theater and 80% agree that the NOTSS tool should be introduced to assess the nontechnical skills of trainees in theater. However, a significantly lower proportion of trainees (45%) agreed on the latter compared with the other groups (p = 0.001). Our survey demonstrates acceptability among the theater team for the introduction of the NOTSS tool into the surgical curriculum. However, lack of familiarity highlights the importance of faculty training for assessors before such an introduction. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  11. Developing Face-to-Face Argumentation Skills: Does Arguing on the Computer Help?

    Science.gov (United States)

    Iordanou, Kalypso

    2013-01-01

    Arguing on the computer was used as a method to promote development of face-to-face argumentation skills in middle schoolers. In the study presented, sixth graders engaged in electronic dialogues with peers on a controversial topic and in some reflective activities based on transcriptions of the dialogues. Although participants initially exhibited…

  12. Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood.

    Science.gov (United States)

    Logan, Samuel W; Barnett, Lisa M; Goodway, Jacqueline D; Stodden, David F

    2017-04-01

    Process-oriented motor competence (MC) assessments evaluate how a movement is performed. Product-oriented assessments evaluate the outcome of a movement. Determining the concurrent validity of process and product assessments is important to address the predictive utility of motor competence for health. The current study aimed to: (1) compare process and product assessments of the standing long jump, hop and throw across age groups and (2) determine the capacity of process assessments to classify levels of MC. Participants included 170 children classified into three age groups: 4-5, 7-8 and 10-11 years old. Participants' skills were examined concurrently using three process assessments ((Test of Gross Motor Development-2nd edition [TGMD-2]), Get Skilled; Get Active, and developmental sequences) and one product measure (throw speed, jump and hop distance). Results indicate moderate to strong correlations between (1) process assessments across skills and age groups (r range = .37-70) and (2) process and product assessments across skills and age groups (r range = .26-.88). In general, sensitivity to detect advanced skill level is lowest for TGMD-2 and highest for developmental sequences for all three skills. The use of process and product assessments is suggested to comprehensively capture levels of MC in human movement.

  13. The Effects of Performance-Based Assessment Criteria on Student Performance and Self-Assessment Skills

    Science.gov (United States)

    Fastre, Greet Mia Jos; van der Klink, Marcel R.; van Merrienboer, Jeroen J. G.

    2010-01-01

    This study investigated the effect of performance-based versus competence-based assessment criteria on task performance and self-assessment skills among 39 novice secondary vocational education students in the domain of nursing and care. In a performance-based assessment group students are provided with a preset list of performance-based…

  14. Training and Assessment of Hysteroscopic Skills

    DEFF Research Database (Denmark)

    Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars

    2016-01-01

    OBJECTIVE: The aim of this systematic review was to identify studies on hysteroscopic training and assessment. DESIGN: PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies...... on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study...... outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. RESULTS: A total of 25 studies on hysteroscopy training were identified...

  15. Implementing and Evaluating a National Certification Technical Skills Examination: The Colorectal Objective Structured Assessment of Technical Skill.

    Science.gov (United States)

    de Montbrun, Sandra; Roberts, Patricia L; Satterthwaite, Lisa; MacRae, Helen

    2016-07-01

    To implement the Colorectal Objective Structured Assessment of Technical skill (COSATS) into American Board of Colon and Rectal Surgery (ABCRS) certification and build evidence of validity for the interpretation of the scores of this high stakes assessment tool. Currently, technical skill assessment is not a formal component of board certification. With the technical demands of surgical specialties, documenting competence in technical skill at the time of certification with a valid tool is ideal. In September 2014, the COSATS was a mandatory component of ABCRS certification. Seventy candidates took the examination, with their performance evaluated by expert colorectal surgeons using a task-specific checklist, global rating scale, and overall performance scale. Passing scores were set and compared using 2 standard setting methodologies, using a compensatory and conjunctive model. Inter-rater reliability and the reliability of the pass/fail decision were calculated using Cronbach alpha and Subkoviak methodology, respectively. Overall COSATS scores and pass/fail status were compared with results on the ABCRS oral examination. The pass rate ranged from 85.7% to 90%. Inter-rater reliability (0.85) and reliability of the pass/fail decision (0.87 and 0.84) were high. A low positive correlation (r= 0.25) was seen between the COSATS and oral examination. All individuals who failed the COSATS passed the ABCRS oral examination. COSATS is the first technical skill examination used in national surgical board certification. This study suggests that the current certification process may be failing to identify individuals who have demonstrated technical deficiencies on this standardized assessment tool.

  16. The assessment of surgical skills as a complement to the training method. Revision.

    Science.gov (United States)

    Sánchez-Fernández, J; Bachiller-Burgos, J; Serrano-Pascual, Á; Cózar-Olmo, J M; Díaz-Güemes Martín-Portugués, I; Pérez-Duarte, F J; Hernández-Hurtado, L; Álvarez-Ossorio, J L; Sánchez-Margallo, F M

    2016-01-01

    The acquisition and improvement of surgical skills constitute a fundamental element in the training of any practitioner. At present, however, the assessment of these skills is a scarcely developed area of research. The aim of this study was to analyse the peculiarities of the various assessment systems and establish the minimum criteria that a skills and knowledge assessment system should meet as a method for assessing surgical skills in urological surgery. Scientific literature review aimed at the various currently available assessment systems for skills and competencies (technical and nontechnical), with a special focus on the systematic reviews and prospective studies. After conducting the review, we found that the various assessment systems for surgical competence have, in our opinion, a number of shortcomings. There is a certain degree of subjectivity in the assessment of surgeons by the evaluators. The assessment of nontechnical competencies is not formally recorded. There is no description of a follow-up assessment or any basic parameters associated with healthcare quality. There is no registration of associated competencies associated with the various surgical techniques. There is also no ranking of these competencies and the specific peculiarities for their application. We believe that the development of a new assessment system for surgical competencies (technical and nontechnical) aimed at assessing urologists in the various surgical techniques is necessary. To this end, our team has worked on developing the Evaluation System for Surgical Competencies on Laparoscopy, which is based on the definition, ranking and assessment of competencies demonstrated by surgeons. Copyright © 2015 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

  17. Computer simulations in the high school: students' cognitive stages, science process skills and academic achievement in microbiology

    Science.gov (United States)

    Huppert, J.; Michal Lomask, S.; Lazarowitz, R.

    2002-08-01

    Computer-assisted learning, including simulated experiments, has great potential to address the problem solving process which is a complex activity. It requires a highly structured approach in order to understand the use of simulations as an instructional device. This study is based on a computer simulation program, 'The Growth Curve of Microorganisms', which required tenth grade biology students to use problem solving skills whilst simultaneously manipulating three independent variables in one simulated experiment. The aims were to investigate the computer simulation's impact on students' academic achievement and on their mastery of science process skills in relation to their cognitive stages. The results indicate that the concrete and transition operational students in the experimental group achieved significantly higher academic achievement than their counterparts in the control group. The higher the cognitive operational stage, the higher students' achievement was, except in the control group where students in the concrete and transition operational stages did not differ. Girls achieved equally with the boys in the experimental group. Students' academic achievement may indicate the potential impact a computer simulation program can have, enabling students with low reasoning abilities to cope successfully with learning concepts and principles in science which require high cognitive skills.

  18. The effects of performance-based assessment criteria on student performance and self-assessment skills

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Van Merriënboer, Jeroen

    2010-01-01

    Fastré, G. M. J., Van der Klink, M. R., & Van Merriënboer, J. J. G. (2010). The effects of performance-based assessment criteria on student performance and self-assessment skills. Advances in Health Science Education, 15(4), 517-532.

  19. What should be included in the assessment of laypersons' paediatric basic life support skills?

    DEFF Research Database (Denmark)

    Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim

    2018-01-01

    BACKGROUND: Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign...... body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. METHODS: A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts...... suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts...

  20. Development and Evaluation of a Computer-Based Learning Environment for Teachers: Assessment of Learning Strategies in Learning Journals

    Directory of Open Access Journals (Sweden)

    Inga Glogger

    2013-01-01

    Full Text Available Training teachers to assess important components of self-regulated learning such as learning strategies is an important, yet somewhat neglected, aspect of the integration of self-regulated learning at school. Learning journals can be used to assess learning strategies in line with cyclical process models of self-regulated learning, allowing for rich formative feedback. Against this background, we developed a computer-based learning environment (CBLE that trains teachers to assess learning strategies with learning journals. The contents of the CBLE and its instructional design were derived from theory. The CBLE was further shaped by research in a design-based manner. Finally, in two evaluation studies, student teachers (N1=44; N2=89 worked with the CBLE. We analyzed satisfaction, interest, usability, and assessment skills. Additionally, in evaluation study 2, effects of an experimental variation on motivation and assessment skills were tested. We found high satisfaction, interest, and good usability, as well as satisfying assessment skills, after working with the CBLE. Results show that teachers can be trained to assess learning strategies in learning journals. The developed CBLE offers new perspectives on how to support teachers in fostering learning strategies as central component of effective self-regulated learning at school.

  1. Interactive Block Games for Assessing Children's Cognitive Skills: Design and Preliminary Evaluation

    Directory of Open Access Journals (Sweden)

    Kiju Lee

    2018-05-01

    Full Text Available Background: This paper presents design and results from preliminary evaluation of Tangible Geometric Games (TAG-Games for cognitive assessment in young children. The TAG-Games technology employs a set of sensor-integrated cube blocks, called SIG-Blocks, and graphical user interfaces for test administration and real-time performance monitoring. TAG-Games were administered to children from 4 to 8 years of age for evaluating preliminary efficacy of this new technology-based approach.Methods: Five different sets of SIG-Blocks comprised of geometric shapes, segmented human faces, segmented animal faces, emoticons, and colors, were used for three types of TAG-Games, including Assembly, Shape Matching, and Sequence Memory. Computational task difficulty measures were defined for each game and used to generate items with varying difficulty. For preliminary evaluation, TAG-Games were tested on 40 children. To explore the clinical utility of the information assessed by TAG-Games, three subtests of the age-appropriate Wechsler tests (i.e., Block Design, Matrix Reasoning, and Picture Concept were also administered.Results: Internal consistency of TAG-Games was evaluated by the split-half reliability test. Weak to moderate correlations between Assembly and Block Design, Shape Matching and Matrix Reasoning, and Sequence Memory and Picture Concept were found. The computational measure of task complexity for each TAG-Game showed a significant correlation with participants' performance. In addition, age-correlations on TAG-Game scores were found, implying its potential use for assessing children's cognitive skills autonomously.

  2. The Measurement Properties of the Assessing Math Concepts' Assessments of Primary Students' Number Sense Skills.

    Science.gov (United States)

    Martin, Christie; Lambert, Richard; Polly, Drew; Wang, Chuang; Pugalee, David

    The purpose of this study was to examine the measurement properties of the Assessing Math Concepts AMC Anywhere Hiding and Ten Frame Assessments, formative assessments of primary students' number sense skills. Each assessment has two parts, where Part 1 is intended to be foundational skills for part two. Part 1 includes manipulatives whereas Part 2 does not. Student data from 228 kindergarten through second grade teachers with a total of 3,666 students was analyzed using Rasch scaling. Data analyses indicated that when the two assessments were examined separately the intended order of item difficulty was clear. When the parts of both assessments were analyzed together, the items in Part 2 were not consistently more difficult that the items in Part 1. This suggests an alternative sequence of tasks in that students may progress from working with a specific number with manipulatives then without manipulatives rather than working with a variety of numbers with manipulatives before moving onto assessments without manipulatives.

  3. Assessing family planning service-delivery skills in Kenya.

    Science.gov (United States)

    Valadez, J J; Transgrud, R; Mbugua, M; Smith, T

    1997-06-01

    This report demonstrates the use of Lot Quality Assurance Sampling (LQAS) to evaluate the technical competence of two cohorts of family planning service providers in Kenya trained with a new curriculum. One cohort had just finished training within two months of the study. The other cohort was the first group trained with the new curriculum about one year before the study. LQAS was adapted from industrial and other public health applications to assess both the individual competence of 30 service providers and the competence of each cohort. Results show that Cohorts One and Two did not differ markedly in the number of tasks needing improvement. However, both cohorts exhibited more tasks needing improvement in counseling skills as compared with physical examination skills or with all other skills. Care-givers who were not currently providing services accounted for most service-delivery problems. This result suggests that providers' use of their skills explains their ability to retain service-delivery skills learned in training to a greater degree than does the amount of time elapsed since they were trained. LQAS proved to be a rapid, easy-to-use empirical method for management decisionmaking for improvement of a family planning training curriculum and services.

  4. Assessment of email communication skills of rheumatology fellows: a pilot study

    Science.gov (United States)

    Dhuper, Sonal; Siva, Chokkalingam; Fresen, John L; Petruc, Marius; Velázquez, Celso R

    2010-01-01

    Physician–patient email communication is gaining popularity. However, a formal assessment of physicians' email communication skills has not been described. We hypothesized that the email communication skills of rheumatology fellows can be measured in an objective structured clinical examination (OSCE) setting using a novel email content analysis instrument which has 18 items. During an OSCE, we asked 50 rheumatology fellows to respond to a simulated patient email. The content of the responses was assessed using our instrument. The majority of rheumatology fellows wrote appropriate responses scoring a mean (±SD) of 10.6 (±2.6) points (maximum score 18), with high inter-rater reliability (0.86). Most fellows were concise (74%) and courteous (68%) but not formal (22%). Ninety-two percent of fellows acknowledged that the patient's condition required urgent medical attention, but only 30% took active measures to contact the patient. No one encrypted their messages. The objective assessment of email communication skills is possible using simulated emails in an OSCE setting. The variable email communication scores and incidental patient safety gaps identified, suggest a need for further training and defined proficiency standards for physicians' email communication skills. PMID:20962134

  5. Validation of Modified Soft Skills Assessment Instrument (MOSSAI) for Use in Nigeria

    Science.gov (United States)

    Aworanti, O. A.; Taiwo, M. B.; Iluobe, O. I.

    2015-01-01

    Currently, it has become an accepted norm nearly all over the globe to teach and assess soft skills. However, in Nigeria, it is an emerging area of interest that needs to be addressed squarely. In the light of the fore-going, this study validated a modified version of Measuring and Assessment Soft Skills (MASS) (an instrument developed and used by…

  6. Rubric Assessment on Science and Creative Thinking Skills of Students

    Science.gov (United States)

    Ratnasusanti, H.; Ana, A.; Nurafiati, P.; Umusyaadah, L.

    2018-02-01

    The result of the monitoring and evaluation of the latest Indonesian curriculum (the 2013 curriculum) implementation at junior high school level year of 2014 showed that one of the difficult things that learners had in implementation 2013 curriculum is doing the result. The characteristic of applying the 2013 curriculum is to emphasize the modern pedagogic dimension of learning, which is using scientific approach, which requires learners to have highlevel thinking skills, one of which is creative thinking skills. The aims of this research is to implement performance assessment in measuring the creative thinking of junior high school students on subject Prakarya. The form of the main performance assessment is the task and assessment criteria. The experimental method that been used is the Quasi Experiment with Non-Equivalent Design Group Research. Population in this study is the students of VIII class of junior high school in Bandung, Indonesia which consists of six classes. And two classes are selected for the sample from that six classes and VIII A class were chosen, while VIII F class has been chosen as control class. The result of this research showed that the rubics of performance assessment can be measure or identify the creative thinking skill, its prove by the result of pre-test dan post-test are more dominant. In material of identification student’s creative thinking skills are reached an average 85 compare 79 with the control class. while in the presentation the experimental class got an average of 85 bigger than the control class which only reached 79.

  7. Patients' assessment of professionalism and communication skills of medical graduates.

    Science.gov (United States)

    Abadel, Fatima T; Hattab, Abdulla S

    2014-02-11

    Professionalism and communication skills constitute important components of the integral formation of physicians which has repercussion on the quality of health care and medical education. The objective of this study was to assess medical graduates' professionalism and communication skills from the patients' perspective and to examine its association with patients' socio-demographic variables. This is a hospital based cross-sectional study. It involved 315 patients and 105 medical graduates selected by convenient sampling method. A modified and validated version of the American Board of Internal Medicine's (ABIM) Patient Assessment survey questionnaire was used for data collection through a face to face interview. Data processing and analysis were performed using the Statistical Package for Social Science (SPSS) 16.0. Mean, frequency distribution, and percentage of the variables were calculated. A non-parametric Kruskal Wallis test was applied to verify whether the patients' assessment was influenced by variables such as age, gender, education, at a level of significance, p ≤ 0.05. Female patients constituted 46% of the sample, whereas males constituted 54%. The mean age was 36 ± 16. Patients' scoring of the graduate's skills ranged from 3.29 to 3.83 with a mean of 3.64 on a five-point Likert scale. Items assessing the "patient involvement in decision-making" were assigned the minimum mean values, while items dealing with "establishing adequate communication with patient" assigned the maximum mean values. Patients, who were older than 45 years, gave higher scores than younger ones (p communication skills at a good level. Patients' age and educational level were significantly associated with the rating level.

  8. Facilitating the implementation of the American College of Surgeons/Association of Program Directors in Surgery phase III skills curriculum: training faculty in the assessment of team skills.

    Science.gov (United States)

    Hull, Louise; Arora, Sonal; Stefanidis, Dimitrios; Sevdalis, Nick

    2015-11-01

    Effective teamwork is critical to safety in the operating room; however, implementation of phase III of the American College of Surgeons (ACS) and Association of Program Directors in Surgery (APDS) Curriculum that focuses on team-based skills remains worryingly low. Training and assessing the complexities of teamwork is challenging. The objective of this study was to establish guidelines and recommendations for training faculty in assessing/debriefing team skills. A multistage survey-based consensus study was completed by 108 experts responsible for training and assessing surgical residents from the ACS Accredited Educational Institutes. Experts agreed that a program to teach faculty to assess team-based skills should include training in the recognition of teamwork skills, practice rating these skills, and training in the provision of feedback/debriefing. Agreement was reached that faculty responsible for conducting team-based skills assessment should be revalidated every 2 years and stringent proficiency criteria should be met. Faculty development is critical to ensure high-quality, standardized training and assessment. Training faculty to assess team-based skills has the potential to facilitate the effective implementation of phase III of the ACS and APDS Curriculum. Copyright © 2015 Elsevier Inc. All rights reserved.

  9. Climate Modeling Computing Needs Assessment

    Science.gov (United States)

    Petraska, K. E.; McCabe, J. D.

    2011-12-01

    This paper discusses early findings of an assessment of computing needs for NASA science, engineering and flight communities. The purpose of this assessment is to document a comprehensive set of computing needs that will allow us to better evaluate whether our computing assets are adequately structured to meet evolving demand. The early results are interesting, already pointing out improvements we can make today to get more out of the computing capacity we have, as well as potential game changing innovations for the future in how we apply information technology to science computing. Our objective is to learn how to leverage our resources in the best way possible to do more science for less money. Our approach in this assessment is threefold: Development of use case studies for science workflows; Creating a taxonomy and structure for describing science computing requirements; and characterizing agency computing, analysis, and visualization resources. As projects evolve, science data sets increase in a number of ways: in size, scope, timelines, complexity, and fidelity. Generating, processing, moving, and analyzing these data sets places distinct and discernable requirements on underlying computing, analysis, storage, and visualization systems. The initial focus group for this assessment is the Earth Science modeling community within NASA's Science Mission Directorate (SMD). As the assessment evolves, this focus will expand to other science communities across the agency. We will discuss our use cases, our framework for requirements and our characterizations, as well as our interview process, what we learned and how we plan to improve our materials after using them in the first round of interviews in the Earth Science Modeling community. We will describe our plans for how to expand this assessment, first into the Earth Science data analysis and remote sensing communities, and then throughout the full community of science, engineering and flight at NASA.

  10. Laparoscopic skills assessment: an additional modality for pediatric surgery fellowship selection.

    Science.gov (United States)

    Hazboun, Rajaie; Rodriguez, Samuel; Thirumoorthi, Arul; Baerg, Joanne; Moores, Donald; Tagge, Edward P

    2017-12-01

    The Pediatric Surgery fellow selection is a multi-layered process which has not included assessment of surgical dexterity. Data was collected prospectively as part of the 2016 Pediatric Surgery Match interview process. Applicants completed a questionnaire to document laparoscopic experience and fine motor skills activities. Actual laparoscopic skills were assessed using a simulator. Time to complete an intracorporeal knot was tabulated. An initial rank list was formulated based only on the ERAS application and interview scores. The rank list was re-formulated following the laparoscopic assessment. Un-paired T-test and regression were utilized to analyze the data. Forty applicants were interviewed with 18 matched (45%). The mean knot tying time was 201.31s for matched and 202.35s for unmatched applicants. Playing a musical instrument correlated with faster knot tying (p=0.03). No correlation was identified between knot tying time and either video game experience (p=0.4) or passing the FLS exam (p=0.78). Laparoscopic skills assessment lead to significant reordering of rank list (p=0.01). Laparoscopic skills performance significantly impacted ranking. Playing a musical instrument correlated with faster knot tying. No correlation was identified between laparoscopic performance and passing the FLS exam or other activities traditionally believed to improve technical ability. Prospective study. Level II. Copyright © 2017 Elsevier Inc. All rights reserved.

  11. Social Validation of the New England Center for Children-Core Skills Assessment

    Science.gov (United States)

    Dickson, Chata A.; MacDonald, Rebecca P. F.; Mansfield, Renee; Guilhardi, Paulo; Johnson, Cammarie; Ahearn, William H.

    2014-01-01

    We investigated the social validity of the NECC Core Skills Assessment (NECC-CSA) with parents and professionals as participants. The NECC-CSA is a measurement tool consisting of direct and indirect measures of skills important to all individuals with autism, across the lifespan. Participants (N = 245) were provided with a list of 66 skills, 47 of…

  12. Computer-based feedback in formative assessment

    NARCIS (Netherlands)

    van der Kleij, Fabienne

    2013-01-01

    Formative assessment concerns any assessment that provides feedback that is intended to support learning and can be used by teachers and/or students. Computers could offer a solution to overcoming obstacles encountered in implementing formative assessment. For example, computer-based assessments

  13. Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

    Science.gov (United States)

    Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

    2012-04-01

    The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

  14. Self-assessment and goal-setting is associated with an improvement in interviewing skills.

    Science.gov (United States)

    Hanley, Kathleen; Zabar, Sondra; Charap, Joseph; Nicholson, Joseph; Disney, Lindsey; Kalet, Adina; Gillespie, Colleen

    2014-01-01

    Describe the relationship between medical students' self-assessment and goal-setting (SAGS) skills and development of interviewing skills during the first-year doctoring course. 157 first-year medical students completed three two-case standardized patient (SP) interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. SAGS improved over time (37% good week 1 vs. 61% good week 10). Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills - those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024). For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1-10 and then increased significantly at week 17. For those whose SAGS remained 'poor' in weeks 1-10, interviewing skills declined in weeks 10-17. In general, the quality of students' SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  15. Goodness of Fit of Skills Assessment Approaches: Insights from Patterns of Real vs. Synthetic Data Sets

    Science.gov (United States)

    Beheshti, Behzad; Desmarais, Michel C.

    2015-01-01

    This study investigates the issue of the goodness of fit of different skills assessment models using both synthetic and real data. Synthetic data is generated from the different skills assessment models. The results show wide differences of performances between the skills assessment models over synthetic data sets. The set of relative performances…

  16. The Promotion of Critical Thinking Skills in School-Based Assessment (SBA)

    Science.gov (United States)

    Kamarulzaman, Wirawani; Kamarulzaman, Wirawahida

    2016-01-01

    The new curriculum introduced in the Malaysian primary students; the Primary School Standard Curriculum (Kurikulum Standard Sekolah Rendah-KSSR) together with the school-based assessment (SBA) is a step taken by the Malaysian government to encourage thinking skills to students, specifically critical thinking skills. The study explores teachers'…

  17. Development of a Laparoscopic Box Trainer Based on Open Source Hardware and Artificial Intelligence for Objective Assessment of Surgical Psychomotor Skills.

    Science.gov (United States)

    Alonso-Silverio, Gustavo A; Pérez-Escamirosa, Fernando; Bruno-Sanchez, Raúl; Ortiz-Simon, José L; Muñoz-Guerrero, Roberto; Minor-Martinez, Arturo; Alarcón-Paredes, Antonio

    2018-05-01

    A trainer for online laparoscopic surgical skills assessment based on the performance of experts and nonexperts is presented. The system uses computer vision, augmented reality, and artificial intelligence algorithms, implemented into a Raspberry Pi board with Python programming language. Two training tasks were evaluated by the laparoscopic system: transferring and pattern cutting. Computer vision libraries were used to obtain the number of transferred points and simulated pattern cutting trace by means of tracking of the laparoscopic instrument. An artificial neural network (ANN) was trained to learn from experts and nonexperts' behavior for pattern cutting task, whereas the assessment of transferring task was performed using a preestablished threshold. Four expert surgeons in laparoscopic surgery, from hospital "Raymundo Abarca Alarcón," constituted the experienced class for the ANN. Sixteen trainees (10 medical students and 6 residents) without laparoscopic surgical skills and limited experience in minimal invasive techniques from School of Medicine at Universidad Autónoma de Guerrero constituted the nonexperienced class. Data from participants performing 5 daily repetitions for each task during 5 days were used to build the ANN. The participants tend to improve their learning curve and dexterity with this laparoscopic training system. The classifier shows mean accuracy and receiver operating characteristic curve of 90.98% and 0.93, respectively. Moreover, the ANN was able to evaluate the psychomotor skills of users into 2 classes: experienced or nonexperienced. We constructed and evaluated an affordable laparoscopic trainer system using computer vision, augmented reality, and an artificial intelligence algorithm. The proposed trainer has the potential to increase the self-confidence of trainees and to be applied to programs with limited resources.

  18. The use of physical assessment skills by registered nurses in Australia: issues for nursing education.

    Science.gov (United States)

    Birks, Melanie; Cant, Robyn; James, Ainsley; Chung, Catherine; Davis, Jenny

    2013-01-01

    The purpose of pre-service nursing education programs is to prepare competent graduates who are able to function as safe, professional registered nurses. An extensive element of these programs is the teaching of physical assessment skills, with most programs educating students to perform over 120 such skills. Previous research from North America suggests that the majority of skills taught to nurses in their pre-service programs are not used in practice. As part of a larger study, an online survey was used to explore use of 121 physical assessment skills by Australian nurses. Recruitment occurred via mailed invitation to members of the Australian Nursing Federation. Data were extracted from 1220 completed questionnaires returned by nurses who were mostly employed in New South Wales, were female and experienced nurses. Respondents indicated that they used only 34% of skills routinely. Results reinforce evidence found in the literature that many of the skills taught to nurses are either not used at all (35.5%) or are used rarely (31%). These findings have implications for the teaching of physical assessment skills in pre-service nursing programs, and raise questions about the value of extensive skills teaching in the context of contemporary health care. Further research into barriers to the use of physical assessment skills in nursing and the need for comprehensive skills preparation for the generalist nurse is likely to offer some solutions to these questions.

  19. Designing Standardized Patient Assessments to Measure SBIRT Skills

    Science.gov (United States)

    Wamsley, Maria A.; Julian, Katherine A.; O'Sullivan, Patricia; Satterfield, Jason M.; Satre, Derek D.; McCance-Katz, Elinore; Batki, Steven L.

    2013-01-01

    Objectives: Resident physicians report insufficient experience caring for patients with substance use disorders (SUDs). Resident training in Screening, Brief Intervention, and Referral to Treatment (SBIRT) has been recommended. We describe the development of a standardized patient (SP) assessment to measure SBIRT skills, resident perceptions of…

  20. Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

    DEFF Research Database (Denmark)

    Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter

    2013-01-01

    Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training.......Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training....

  1. Reliability of the ECHOWS Tool for Assessment of Patient Interviewing Skills.

    Science.gov (United States)

    Boissonnault, Jill S; Evans, Kerrie; Tuttle, Neil; Hetzel, Scott J; Boissonnault, William G

    2016-04-01

    History taking is an important component of patient/client management. Assessment of student history-taking competency can be achieved via a standardized tool. The ECHOWS tool has been shown to be valid with modest intrarater reliability in a previous study but did not demonstrate sufficient power to definitively prove its stability. The purposes of this study were: (1) to assess the reliability of the ECHOWS tool for student assessment of patient interviewing skills and (2) to determine whether the tool discerns between novice and experienced skill levels. A reliability and construct validity assessment was conducted. Three faculty members from the United States and Australia scored videotaped histories from standardized patients taken by students and experienced clinicians from each of these countries. The tapes were scored twice, 3 to 6 weeks apart. Reliability was assessed using interclass correlation coefficients (ICCs) and repeated measures. Analysis of variance models assessed the ability of the tool to discern between novice and experienced skill levels. The ECHOWS tool showed excellent intrarater reliability (ICC [3,1]=.74-.89) and good interrater reliability (ICC [2,1]=.55) as a whole. The summary of performance (S) section showed poor interrater reliability (ICC [2,1]=.27). There was no statistical difference in performance on the tool between novice and experienced clinicians. A possible ceiling effect may occur when standardized patients are not coached to provide complex and obtuse responses to interviewer questions. Variation in familiarity with the ECHOWS tool and in use of the online training may have influenced scoring of the S section. The ECHOWS tool demonstrates excellent intrarater reliability and moderate interrater reliability. Sufficient training with the tool prior to student assessment is recommended. The S section must evolve in order to provide a more discerning measure of interviewing skills. © 2016 American Physical Therapy

  2. Drawing students' attention to relevant assessment criteria: effects on self-assessment skills and performance

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Sluijsmans, Dominique; Van Merriënboer, Jeroen

    2012-01-01

    Fastré, G. M. J., Van der Klink, M. R., Sluijsmans, D., & Van Merriënboer, J. J. G. (2012). Drawing students’ attention to relevant assessment criteria: effects on self-assessment skills and performance. Journal of Vocational Education & Training, 64(2), 185-198. doi:10.1080/13636820.2011.630537

  3. Effects of Computer-Based Practice on the Acquisition and Maintenance of Basic Academic Skills for Children with Moderate to Intensive Educational Needs

    Science.gov (United States)

    Everhart, Julie M.; Alber-Morgan, Sheila R.; Park, Ju Hee

    2011-01-01

    This study investigated the effects of computer-based practice on the acquisition and maintenance of basic academic skills for two children with moderate to intensive disabilities. The special education teacher created individualized computer games that enabled the participants to independently practice academic skills that corresponded with their…

  4. The consequences of using advanced physical assessment skills in medical and surgical nursing: A hermeneutic pragmatic study.

    Science.gov (United States)

    Zambas, Shelaine I; Smythe, Elizabeth A; Koziol-Mclain, Jane

    2016-01-01

    The aim of this study was to explore the consequences of the nurse's use of advanced assessment skills on medical and surgical wards. Appropriate, accurate, and timely assessment by nurses is the cornerstone of maintaining patient safety in hospitals. The inclusion of "advanced" physical assessment skills such as auscultation, palpation, and percussion is thought to better prepare nurses for complex patient presentations within a wide range of clinical situations. This qualitative study used a hermeneutic pragmatic approach. Unstructured interviews were conducted with five experienced medical and surgical nurses to obtain 13 detailed narratives of assessment practice. Narratives were analyzed using Van Manen's six-step approach to identify the consequences of the nurse's use of advanced assessment skills. The consequences of using advanced assessment skills include looking for more, challenging interpretations, and perseverance. The use of advanced assessment skills directs what the nurse looks for, what she sees, interpretation of the findings, and her response. It is the interpretation of what is seen, heard, or felt within the full context of the patient situation, which is the advanced skill. Advanced assessment skill is the means to an accurate interpretation of the clinical situation and contributes to appropriate diagnosis and medical management in complex patient situations. The nurse's use of advanced assessment skills enables her to contribute to diagnostic reasoning within the acute medical and surgical setting.

  5. Taxonomy of Trauma Leadership Skills: A Framework for Leadership Training and Assessment.

    Science.gov (United States)

    Leenstra, Nico F; Jung, Oliver C; Johnson, Addie; Wendt, Klaus W; Tulleken, Jaap E

    2016-02-01

    Good leadership is essential for optimal trauma team performance, and targeted training of leadership skills is necessary to achieve such leadership proficiency. To address the need for a taxonomy of leadership skills that specifies the skill components to be learned and the behaviors by which they can be assessed across the five phases of trauma care, the authors developed the Taxonomy of Trauma Leadership Skills (TTLS). Critical incident interviews were conducted with trauma team leaders and members from different specialties-emergency physicians, trauma surgeons, anesthesiologists, and emergency ward nurses-at three teaching hospitals in the Netherlands during January-June 2013. Data were iteratively analyzed for examples of excellent leadership skills at each phase of trauma care. Using the grounded theory approach, elements of excellent leadership skills were identified and classified. Elements and behavioral markers were sorted and categorized using multiple raters. In a two-round verification process in late 2013, the taxonomy was reviewed and rated by trauma team leaders and members from the multiple specialties for its coverage of essential items. Data were gathered from 28 interviews and 14 raters. The TTLS details 5 skill categories (information coordination, decision making, action coordination, communication management, and coaching and team development) and 37 skill elements. The skill elements are captured by 67 behavioral markers. The three-level taxonomy is presented according to five phases of trauma care. The TTLS provides a framework for teaching, learning, and assessing team leadership skills in trauma care and other complex, acute care situations.

  6. Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

    Science.gov (United States)

    Zhao, Bin; Zhang, Bo

    2018-02-01

    Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called "double-penalty" problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.

  7. E-learning and nursing assessment skills and knowledge - An integrative review.

    Science.gov (United States)

    McDonald, Ewan W; Boulton, Jessica L; Davis, Jacqueline L

    2018-07-01

    This review examines the current evidence on the effectiveness of digital technologies or e-based learning for enhancing the skills and knowledge of nursing students in nursing assessment. This integrative review identifies themes emerging from e-learning and 'nursing assessment' literature. Literature reviews have been undertaken in relation to digital learning and nursing education, including clinical skills, clinical case studies and the nurse-educator role. Whilst perceptions of digital learning are well covered, a gap in knowledge persists for understanding the effectiveness of e-learning on nursing assessment skills and knowledge. This is important as comprehensive assessment skills and knowledge are a key competency for newly qualified nurses. The MEDLINE, CINAHL, Cochrane Library and ProQuest Nursing and Allied Health Source electronic databases were searched for the period 2006 to 2016. Hand searching in bibliographies was also undertaken. Selection criteria for this review included: FINDINGS: Twenty articles met the selection criteria for this review, and five major themes for e-based learning were identified (a) students become self-evaluators; (b) blend and scaffold learning; (c) measurement of clinical reasoning; (d) mobile technology and Facebook are effective; and (e) training and preparation is vital. Although e-based learning programs provide a flexible teaching method, evidence suggests e-based learning alone does not exceed face-to-face patient simulation. This is particularly the case where nursing assessment learning is not scaffolded. This review demonstrates that e-based learning and traditional teaching methods used in conjunction with each other create a superior learning style. Copyright © 2018 Elsevier Ltd. All rights reserved.

  8. Have Basic Mathematical Skills Grown Obsolete in the Computer Age: Assessing Basic Mathematical Skills and Forecasting Performance in a Business Statistics Course

    Science.gov (United States)

    Noser, Thomas C.; Tanner, John R.; Shah, Situl

    2008-01-01

    The purpose of this study was to measure the comprehension of basic mathematical skills of students enrolled in statistics classes at a large regional university, and to determine if the scores earned on a basic math skills test are useful in forecasting student performance in these statistics classes, and to determine if students' basic math…

  9. Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery.

    Science.gov (United States)

    Liu, May; Purohit, Shreya; Mazanetz, Joshua; Allen, Whitney; Kreaden, Usha S; Curet, Myriam

    2018-01-01

    Skill assessment during robotically assisted surgery remains challenging. While the popularity of the Global Evaluative Assessment of Robotics Skills (GEARS) has grown, its lack of discrimination between independent console skills limits its usefulness. The purpose of this study was to evaluate construct validity and interrater reliability of a novel assessment designed to overcome this limitation. We created the Assessment of Robotic Console Skills (ARCS), a global rating scale with six console skill domains. Fifteen volunteers who were console surgeons for 0 ("novice"), 1-100 ("intermediate"), or >100 ("experienced") robotically assisted procedures performed three standardized tasks. Three blinded raters scored the task videos using ARCS, with a 5-point Likert scale for each skill domain. Scores were analyzed for evidence of construct validity and interrater reliability. Group demographics were indistinguishable except for the number of robotically assisted procedures performed (p = 0.001). The mean scores of experienced subjects exceeded those of novices in dexterity (3.8 > 1.4, p  1.8, p  2.2, p  1.9, p = 0.001), and force sensitivity (4.3 > 2.6, p  1.4, p = 0.002), field of view (2.8 > 1.8, p = 0.021), instrument visualization (3.2 > 2.2, p = 0.045), manipulator workspace (3.1 > 1.9, p = 0.004), and force sensitivity (3.7 > 2.6, p = 0.033). The mean scores of experienced subjects exceeded those of intermediates in dexterity (3.8 > 2.8, p = 0.003), field of view (4.1 > 2.8, p  3.2, p = 0.044). Rater agreement in each domain demonstrated statistically significant concordance (p skills plateau faster than others. Therefore, ARCS may be more useful than GEARS to evaluate distinct console skills. Future studies will examine why some domains did not adequately differentiate between subjects and applications for intraoperative use.

  10. Peer Assessment of Soft Skills and Hard Skills

    Science.gov (United States)

    Zhang, Aimao

    2012-01-01

    Both the information technology (IT) industry and the Accreditation Board for Engineering and Technology (ABET) demand soft-skill training in higher education and require IT graduates to demonstrate competence in interpersonal communication, teamwork, and conflict management. Group projects provide teamwork environment for soft-skill training, but…

  11. Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator

    DEFF Research Database (Denmark)

    Larsen, C R; Grantcharov, Teodor; Aggarwal, R

    2006-01-01

    Safe realistic training and unbiased quantitative assessment of technical skills are required for laparoscopy. Virtual reality (VR) simulators may be useful tools for training and assessing basic and advanced surgical skills and procedures. This study aimed to investigate the construct validity...

  12. Assessing competence in communication and interpersonal skills: the Kalamazoo II report.

    Science.gov (United States)

    Duffy, F Daniel; Gordon, Geoffrey H; Whelan, Gerald; Cole-Kelly, Kathy; Frankel, Richard; Buffone, Natalie; Lofton, Stephanie; Wallace, MaryAnne; Goode, Leslie; Langdon, Lynn

    2004-06-01

    Accreditation of residency programs and certification of physicians requires assessment of competence in communication and interpersonal skills. Residency and continuing medical education program directors seek ways to teach and evaluate these competencies. This report summarizes the methods and tools used by educators, evaluators, and researchers in the field of physician-patient communication as determined by the participants in the "Kalamazoo II" conference held in April 2002. Communication and interpersonal skills form an integrated competence with two distinct parts. Communication skills are the performance of specific tasks and behaviors such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills are inherently relational and process oriented; they are the effect communication has on another person such as relieving anxiety or establishing a trusting relationship. This report reviews three methods for assessment of communication and interpersonal skills: (1) checklists of observed behaviors during interactions with real or simulated patients; (2) surveys of patients' experience in clinical interactions; and (3) examinations using oral, essay, or multiple-choice response questions. These methods are incorporated into educational programs to assess learning needs, create learning opportunities, or guide feedback for learning. The same assessment tools, when administered in a standardized way, rated by an evaluator other than the teacher, and using a predetermined passing score, become a summative evaluation. The report summarizes the experience of using these methods in a variety of educational and evaluation programs and presents an extensive bibliography of literature on the topic. Professional conversation between patients and doctors shapes diagnosis, initiates therapy, and establishes a caring relationship. The degree to which these activities are successful depends, in

  13. Comparison of Parent Report and Direct Assessment of Child Skills in Toddlers.

    Science.gov (United States)

    Miller, Lauren E; Perkins, Kayla A; Dai, Yael G; Fein, Deborah A

    2017-09-01

    There are unique challenges associated with measuring development in early childhood. Two primary sources of information are used: parent report and direct assessment. Each approach has strengths and weaknesses, particularly when used to identify and diagnose developmental delays. The present study aimed to evaluate consistency between parent report and direct assessment of child skills in toddlers with and without Autism Spectrum Disorder (ASD) across receptive language, expressive language, and fine motor domains. 109 children were evaluated at an average age of two years; data on child skills were collected via parent report and direct assessment. Children were classified into three groups (i.e., ASD, Other Developmental Disorder, or Typical Development) based on DSM-IV-TR diagnosis. Mixed design ANOVAs, with data source as a within subjects factor and diagnostic group as a between subjects factor, were used to assess agreement. Chi square tests of agreement were then used to examine correspondence at the item level. Results suggested that parent report of language and fine motor skills did not significantly differ from direct assessment, and this finding held across diagnostic groups. Item level analyses revealed that, in most cases of significant disagreement, parents reported a skill as present, but it was not seen on direct testing. Results indicate that parents are generally reliable reporters of child language and fine motor abilities in toddlerhood, even when their children have developmental disorders such as ASD. However, the fullest picture may be obtained by using both parent report and direct assessment.

  14. Impact of teaching and assessment format on electrocardiogram interpretation skills.

    Science.gov (United States)

    Raupach, Tobias; Hanneforth, Nathalie; Anders, Sven; Pukrop, Tobias; Th J ten Cate, Olle; Harendza, Sigrid

    2010-07-01

    Interpretation of the electrocardiogram (ECG) is a core clinical skill that should be developed in undergraduate medical education. This study assessed whether small-group peer teaching is more effective than lectures in enhancing medical students' ECG interpretation skills. In addition, the impact of assessment format on study outcome was analysed. Two consecutive cohorts of Year 4 medical students (n=335) were randomised to receive either traditional ECG lectures or the same amount of small-group, near-peer teaching during a 6-week cardiorespiratory course. Before and after the course, written assessments of ECG interpretation skills were undertaken. Whereas this final assessment yielded a considerable amount of credit points for students in the first cohort, it was merely formative in nature for the second cohort. An unannounced retention test was applied 8 weeks after the end of the cardiovascular course. A significant advantage of near-peer teaching over lectures (effect size 0.33) was noted only in the second cohort, whereas, in the setting of a summative assessment, both teaching formats appeared to be equally effective. A summative instead of a formative assessment doubled the performance increase (Cohen's d 4.9 versus 2.4), mitigating any difference between teaching formats. Within the second cohort, the significant difference between the two teaching formats was maintained in the retention test (p=0.017). However, in both cohorts, a significant decrease in student performance was detected during the 8 weeks following the cardiovascular course. Assessment format appeared to be more powerful than choice of instructional method in enhancing student learning. The effect observed in the second cohort was masked by an overriding incentive generated by the summative assessment in the first cohort. This masking effect should be considered in studies assessing the effectiveness of different teaching methods.

  15. Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery.

    Science.gov (United States)

    Oropesa, Ignacio; Sánchez-González, Patricia; Lamata, Pablo; Chmarra, Magdalena K; Pagador, José B; Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Gómez, Enrique J

    2011-11-01

    Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor-trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons' psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules. Copyright © 2011 Elsevier Inc. All rights reserved.

  16. Self-assessment and goal-setting is associated with an improvement in interviewing skills

    Directory of Open Access Journals (Sweden)

    Kathleen Hanley

    2014-07-01

    Full Text Available Purpose: Describe the relationship between medical students’ self-assessment and goal-setting (SAGS skills and development of interviewing skills during the first-year doctoring course. Method: 157 first-year medical students completed three two-case standardized patient (SP interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. Results: SAGS improved over time (37% good week 1 vs. 61% good week 10. Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills – those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024. For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1–10 and then increased significantly at week 17. For those whose SAGS remained ‘poor’ in weeks 1–10, interviewing skills declined in weeks 10–17. Conclusions: In general, the quality of students’ SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  17. Theory of computation

    CERN Document Server

    Tourlakis, George

    2012-01-01

    Learn the skills and acquire the intuition to assess the theoretical limitations of computer programming Offering an accessible approach to the topic, Theory of Computation focuses on the metatheory of computing and the theoretical boundaries between what various computational models can do and not do—from the most general model, the URM (Unbounded Register Machines), to the finite automaton. A wealth of programming-like examples and easy-to-follow explanations build the general theory gradually, which guides readers through the modeling and mathematical analysis of computational pheno

  18. A Clinic-Based Assessment for Evaluating Job-Related Social Skills in Adolescents and Adults with Autism.

    Science.gov (United States)

    Lerman, Dorothea C; White, Bridgette; Grob, Carolyn; Laudont, Courtney

    2017-12-01

    Many individuals with autism spectrum disorder (ASD) have difficulties obtaining and maintaining employment, yet little research has evaluated methods for assessing and improving critical vocational skills. In this study, we evaluated an assessment of job-related social skills for individuals with ASD by arranging conditions that simulated on-the-job experiences in a clinic setting. The experimenter contrived situations to assess a variety of social skills, including asking for help, asking for more materials, and responding to corrective feedback. A total of eight individuals, aged 16 to 32 years, participated. Results suggested that the assessment was useful for identifying specific social skills that could be targeted for intervention to increase success in the work environment. These findings add to the current literature by demonstrating an objective method for assessing a variety of job-related social skills under controlled, naturalistic conditions.

  19. The Computerized Perceptual Motor Skills Assessment: A new visual perceptual motor skills evaluation tool for children in early elementary grades.

    Science.gov (United States)

    Howe, Tsu-Hsin; Chen, Hao-Ling; Lee, Candy Chieh; Chen, Ying-Dar; Wang, Tien-Ni

    2017-10-01

    Visual perceptual motor skills have been proposed as underlying courses of handwriting difficulties. However, there is no evaluation tool currently available to assess these skills comprehensively and to serve as a sensitive measure. The purpose of this study was to validate the Computerized Perceptual Motor Skills Assessment (CPMSA), a newly developed evaluation tool for children in early elementary grades. Its test-retest reliability, concurrent validity, discriminant validity, and responsiveness were examined in 43 typically developing children and 26 children with handwriting difficulty. The CPMSA demonstrated excellent reliability across all subtests with intra-class correlation coefficients (ICCs)≥0.80. Significant moderate correlations between the domains of the CPMSA and corresponding gold standards including Beery VMI, the TVPS-3, and the eye-hand coordination subtest of the DTVP-2 demonstrated good concurrent validity. In addition, the CPMSA showed evidence of discriminant validity in samples of children with and without handwriting difficulty. This article provides evidence in support of the CPMSA. The CPMSA is a reliable, valid, and promising measure of visual perceptual motor skills for children in early elementary grades. Directions for future study and improvements to the assessment are discussed. Copyright © 2017. Published by Elsevier Ltd.

  20. Development and validation of an instrument to assess and improve clinical consultation skills

    OpenAIRE

    Lefroy, JE; Gay, SP; Gibson, S; Williams, S; McKinley, RK

    2011-01-01

    Context: Development of medical students’ consultation skills with patients is at the core of the UK General Medical Council’s 'Tomorrow’s Doctors' guide (2009). Teaching and assessment of these skills must therefore be a core component of the medical undergraduate curriculum. The Calgary Cambridge guide to the medical interview and the Leicester Assessment Package (LAP) provide a foundation for teaching and assessment, but both have different strengths. Objective: To develop and validate a c...

  1. The Impact of Adaptive Complex Assessment on the HOT Skill Development of Students

    Science.gov (United States)

    Raiyn, Jamal; Tilchin, Oleg

    2016-01-01

    In this paper we propose a method for the adaptive complex assessment (ACA) of the higher-order thinking (HOT) skills needed by students for problem solving, and we examine the impact of the method on the development of HOT skills in a problem-based learning (PBL) environment. Complexity in the assessment is provided by initial, formative, and…

  2. Cinemeducation: teaching family assessment skills using full-length movies.

    Science.gov (United States)

    Wilson, Astrid H; Blake, Barbara J; Taylor, Gloria A; Hannings, Glenda

    2013-05-01

    A thorough family assessment provides a foundation for the nursing process when working with families. Therefore, nurses, along with other health care providers must develop expertise in conducting family assessments to provide the best possible care within the community. This article describes an innovative educational strategy using movies to teach family assessment skills and puts forth recommendations for future research to provide evidence to support this teaching modality. © 2013 Wiley Periodicals, Inc.

  3. Using the Interpersonal Skills tool to assess interpersonal skills of internationally educated nurses.

    Science.gov (United States)

    Shen, Jay J; Xu, Yu; Staples, Shelley; Bolstad, Anne L

    2014-07-01

    To assess interpersonal skills of internationally educated nurses (IEN) while interacting with standardized patients. Participants included 52 IEN at two community hospitals in the southwestern region of the USA. Standardized patients were used to create patient-nurse encounter. Seventeen items in four domains ("skills in interviewing and collecting information"; "skills in counseling and delivering information"; "rapport"; and "personal manner") in an Interpersonal Skills (IPS) instrument were measured by a Likert scale 1-4 with 4 indicating the best performance. The average composite score per domain and scores of the 17 items were compared across the domains. On 10 of the 17 items, the nurses received scores under 3. Counseling with an average score of 2.10 and closure with an average score of 2.44 in domain 2, small talk with an average score of 2.06 in domain 3, and physical exam with average score of 2.21 in domain 4 were below 2.5. The average composite score of domain 1 was 3.54, significantly higher than those of domains 2-4 (2.77, 2.81, and 2.71, respectively). Age was moderately related to the average score per domain with every 10 year increase in age resulting in a 0.1 increase in the average score. Sex and country of origin showed mixed results. The interpersonal skills of IEN in three of the four domains need improvement. Well-designed educational programs may facilitate the improvement, especially in areas of small talk, counseling, closure, and physical exam. Future research should examine relationships between the IPS and demographics factors. © 2013 The Authors. Japan Journal of Nursing Science © 2013 Japan Academy of Nursing Science.

  4. Female and Male Interns and Their Mentors? Perception of Workforce Skill Development

    Science.gov (United States)

    Hall, Cathy W.; Pinelli, Thomas E.; Brush, Kimberly M.

    2013-01-01

    Participants in this study were student interns and mentors taking part in the 2012, 10- week Langley Aerospace Research Student Scholars (LARSS) summer internship program in Hampton, Virginia. The study examined mentors and student interns' ratings of their preparedness in basic knowledge and skills. The study focused on three primary areas: 1) overall evaluation of knowledge and skills by mentors and interns; 2) male and female interns' perceptions of their own skills in these key areas; and 3) mentors' perceptions of their student interns' knowledge and skills in the same areas by gender. Overall mentors were more positive about their interns' improvement in 12 of 17 areas assessed than were the student interns. There were no significant gender differences in how mentors rated their male and female interns' abilities in these workforce skills, but there were four key areas where female interns rated their own abilities lower than did their male peers: analytical thinking, computational skills, computer skills and technical skills. Implications of these findings are discussed.

  5. Reliability and Validity of 3 Methods of Assessing Orthopedic Resident Skill in Shoulder Surgery.

    Science.gov (United States)

    Bernard, Johnathan A; Dattilo, Jonathan R; Srikumaran, Uma; Zikria, Bashir A; Jain, Amit; LaPorte, Dawn M

    Traditional measures for evaluating resident surgical technical skills (e.g., case logs) assess operative volume but not level of surgical proficiency. Our goal was to compare the reliability and validity of 3 tools for measuring surgical skill among orthopedic residents when performing 3 open surgical approaches to the shoulder. A total of 23 residents at different stages of their surgical training were tested for technical skill pertaining to 3 shoulder surgical approaches using the following measures: Objective Structured Assessment of Technical Skills (OSATS) checklists, the Global Rating Scale (GRS), and a final pass/fail assessment determined by 3 upper extremity surgeons. Adverse events were recorded. The Cronbach α coefficient was used to assess reliability of the OSATS checklists and GRS scores. Interrater reliability was calculated with intraclass correlation coefficients. Correlations among OSATS checklist scores, GRS scores, and pass/fail assessment were calculated with Spearman ρ. Validity of OSATS checklists was determined using analysis of variance with postgraduate year (PGY) as a between-subjects factor. Significance was set at p shoulder approaches. Checklist scores showed superior interrater reliability compared with GRS and subjective pass/fail measurements. GRS scores were positively correlated across training years. The incidence of adverse events was significantly higher among PGY-1 and PGY-2 residents compared with more experienced residents. OSATS checklists are a valid and reliable assessment of technical skills across 3 surgical shoulder approaches. However, checklist scores do not measure quality of technique. Documenting adverse events is necessary to assess quality of technique and ultimate pass/fail status. Multiple methods of assessing surgical skill should be considered when evaluating orthopedic resident surgical performance. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights

  6. Defragging Computer/Videogame Implementation and Assessment in the Social Studies

    Science.gov (United States)

    McBride, Holly

    2014-01-01

    Students in this post-industrial technological age require opportunities for the acquisition of new skills, especially in the marketplace of innovation. A pedagogical strategy that is becoming more and more popular within social studies classrooms is the use of computer and video games as enhancements to everyday lesson plans. Computer/video games…

  7. E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

    Science.gov (United States)

    Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

    2018-04-01

    Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure

  8. Video observation of procedural skills for assessment of trabeculectomy performed by residents.

    Science.gov (United States)

    Hassanpour, Narges; Chen, Rebecca; Baikpour, Masoud; Moghimi, Sasan

    2016-06-01

    The efficacy and sufficiency of a healthcare system is directly related to the knowledge and skills of graduates working in the system. In this regard, many different assessment methods have been proposed to evaluate various skills of the learners. Video Observation of Procedural Skills (VOPS) is one newly-proposed method. In this study we aimed to compare the results of the VOPS method with the more commonly used Direct Observation of Procedural Skills (DOPS). In this prospective study conducted in 2012, all 10 ophthalmology residents of post graduate year 4 were selected for participation. Three months into training in the glaucoma ward, these residents performed trabeculectomy surgery on patients, and their procedural skills were assessed in real time by an expert via the DOPS method. All surgeries were also recorded and later evaluated via the VOPS method by an expert. Bland-Altman plot also was used to compare the two methods and calculating the mean and 95% limit of agreement. Residents have been done a mean of 14.9 ± 3.5 (range 10-20) independent trabeculectomy before the assessments. DOPS grade was positively associated with number of independent trabeculectomy during glaucoma rotation (β=0.227, p = 0.004). The intra-observer reproducibility of VOPS measurements was 0.847 (95% CI: 0.634, 0.961). The mean VOPS grade was significantly lower than the mean DOPS grade (8.4 vs. 8.9, p = 0.02). However, a good correlation was observed between the grades of VOPS and DOPS (r = 0.89, p = 0.001). Bland-Altman analysis demonstrated that all data points fell within the 95% limits of agreement (-1.46, 0.46). The present study showed that VOPS might be considered a feasible, valid, and reliable assessment method for procedural skills of medical students and residents that can be used as an alternative to the DOPS method. However, VOPS might underestimate DOPS in evaluating surgical skills of residents.

  9. How can teachers assess reading skills of generation z learners in German language class?

    Science.gov (United States)

    Dirga, R. N.; Wijayati, P. H.

    2018-01-01

    Generation Z is a digital native generation who has unique characteristics on the daily basis includes reading. In order to assess their reading skills correctly, teachers need to take these characteristics into consideration. This paper aims to describe the process in developing an instrument to assess reading skills of Generation Z learners in German language class. This study used developmental method. The developed instrument has not only good quality but also consists of texts that are suitable for German learners of Generation Z. This instrument can be used as an example in assessing German learners’ reading skills in the 21st century.

  10. Development and Application of a Stepwise Assessment Process for Rational Redesign of Sequential Skills-Based Courses.

    Science.gov (United States)

    Gallimore, Casey E; Porter, Andrea L; Barnett, Susanne G

    2016-10-25

    Objective. To develop and apply a stepwise process to assess achievement of course learning objectives related to advanced pharmacy practice experiences (APPEs) preparedness and inform redesign of sequential skills-based courses. Design. Four steps comprised the assessment and redesign process: (1) identify skills critical for APPE preparedness; (2) utilize focus groups and course evaluations to determine student competence in skill performance; (3) apply course mapping to identify course deficits contributing to suboptimal skill performance; and (4) initiate course redesign to target exposed deficits. Assessment. Focus group participants perceived students were least prepared for skills within the Accreditation Council for Pharmacy Education's pre-APPE core domains of Identification and Assessment of Drug-related Problems and General Communication Abilities. Course mapping identified gaps in instruction, performance, and assessment of skills within aforementioned domains. Conclusions. A stepwise process that identified strengths and weaknesses of a course, was used to facilitate structured course redesign. Strengths of the process included input and corroboration from both preceptors and students. Limitations included feedback from a small number of pharmacy preceptors and increased workload on course coordinators.

  11. Social Skills Instruction for Urban Learners with Emotional and Behavioral Disorders: A Culturally Responsive and Computer-Based Intervention

    Science.gov (United States)

    Robinson-Ervin, Porsha; Cartledge, Gwendolyn; Musti-Rao, Shobana; Gibson, Lenwood, Jr.; Keyes, Starr E.

    2016-01-01

    This study examined the effects of culturally relevant/responsive, computer-based social skills instruction on the social skill acquisition and generalization of 6 urban African American sixth graders with emotional and behavioral disorders (EBD). A multiple-probe across participants design was used to evaluate the effects of the social skills…

  12. Ready for OR or not? Human reader supplements Eyesi scoring in cataract surgical skills assessment

    Directory of Open Access Journals (Sweden)

    Selvander M

    2013-10-01

    Full Text Available Madeleine Selvander,1,2 Peter Åsman11Department of Clinical Sciences, Malmö: Ophthalmology, Lund University, Malmö, Sweden; 2Practicum Clinical Skills Centre, Skåne University Hospital, Malmö, SwedenPurpose: To compare the internal computer-based scoring with human-based video scoring of cataract modules in the Eyesi virtual reality intraocular surgical simulator, a comparative case series was conducted at the Department of Clinical Sciences – Ophthalmology, Lund University, Skåne University Hospital, Malmö, Sweden.Methods: Seven cataract surgeons and 17 medical students performed one video-recorded trial with each of the capsulorhexis, hydromaneuvers, and phacoemulsification divide-and-conquer modules. For each module, the simulator calculated an overall score for the performance ranging from 0 to 100. Two experienced masked cataract surgeons analyzed each video using the Objective Structured Assessment of Cataract Surgical Skill (OSACSS for individual models and modified Objective Structured Assessment of Surgical Skills (OSATS for all three modules together. The average of the two assessors' scores for each tool was used as the video-based performance score. The ability to discriminate surgeons from naive individuals using the simulator score and the video score, respectively, was compared using receiver operating characteristic (ROC curves.Results: The ROC areas for simulator score did not differ from 0.5 (random for hydromaneuvers and phacoemulsification modules, yielding unacceptably poor discrimination. OSACSS video scores all showed good ROC areas significantly different from 0.5. The OSACSS video score was also superior compared to the simulator score for the phacoemulsification procedure: ROC area 0.945 vs 0.664 for simulator score (P = 0.010. Corresponding values for capsulorhexis were 0.887 vs 0.761 (P = 0.056 and for hydromaneuvers 0.817 vs 0.571 (P = 0.052 for the video scores and simulator scores, respectively.The ROC

  13. Even Buddhist Monks Use a Gong: A Mindfulness Skills Programme for Young People Delivered through the "Mindful Gnats" Computer Game and App

    Science.gov (United States)

    O'Reilly, Gary; Coyle, David; Tunney, Conall

    2016-01-01

    Mindful Gnats is a computer game and App that introduces mindfulness and relaxation skills to young people aged nine years and older. In this paper the authors describe their model for using technology to support children with the development of psychological skills. This model combines a computer game to introduce and practice psychological…

  14. Haptic feedback can provide an objective assessment of arthroscopic skills.

    Science.gov (United States)

    Chami, George; Ward, James W; Phillips, Roger; Sherman, Kevin P

    2008-04-01

    The outcome of arthroscopic procedures is related to the surgeon's skills in arthroscopy. Currently, evaluation of such skills relies on direct observation by a surgeon trainer. This type of assessment, by its nature, is subjective and time-consuming. The aim of our study was to identify whether haptic information generated from arthroscopic tools could distinguish between skilled and less skilled surgeons. A standard arthroscopic probe was fitted with a force/torque sensor. The probe was used by five surgeons with different levels of experience in knee arthroscopy performing 11 different tasks in 10 standard knee arthroscopies. The force/torque data from the hand and tool interface were recorded and synchronized with a video recording of the procedure. The torque magnitude and patterns generated were analyzed and compared. A computerized system was used to analyze the force/torque signature based on general principles for quality of performance using such measures as economy in movement, time efficiency, and consistency in performance. The results showed a considerable correlation between three haptic parameters and the surgeon's experience, which could be used in an automated objective assessment system for arthroscopic surgery. Level II, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.

  15. Gender-fair assessment of young gifted students' scientific thinking skills

    Science.gov (United States)

    Dori, Y. J.; Zohar, A.; Fischer-Shachor, D.; Kohan-Mass, J.; Carmi, M.

    2018-04-01

    This paper describes an Israeli national-level research examining the extent to which admissions of elementary school students to the gifted programmes based on standardised tests are gender-fair. In the research, the gifted students consisted of 275 boys, 128 girls, and additional 80 girls who were admitted to the gifted programme through affirmative action (AA). To assess these young students' scientific thinking skills, also referred to as science practices, open-ended questions of case-based questionnaires were developed. The investigated scientific thinking skills were question posing, explanation, graphing, inquiry, and metacognition. Analysis of the students' responses revealed that gifted girls who entered the programmes through AA performed at the same level as the other gifted students. We found significant differences between the three research groups in question posing and graphing skills. We suggest increasing gender-fairness by revising the standard national testing system to include case-based narratives followed by open-ended questions that assess gifted students' scientific thinking skills. This may diminish the gender inequity expressed by the different number of girls and boys accepted to the gifted programmes. We show that open-ended tools for analysing students' scientific thinking might better serve both research and practice by identifying gifted girls and boys equally well.

  16. OSCE vs. TEM: Different approaches to assess clinical skills of nursing students

    Directory of Open Access Journals (Sweden)

    Prasuna Jelly

    2017-01-01

    Full Text Available Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001. The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM.

  17. The ribbon microphone - an educational aid: use of a ribbon microphone to teach multi-discipline computer simulation skills

    CSIR Research Space (South Africa)

    Van Wyk, Marius

    2016-07-01

    Full Text Available The ribbon microphone serves as an excellent aid to learn computer simulation and computational skills. Simulation of this seemingly simple device is all but trivial. The ribbon microphone is an all-in-one example for simulations in acoustics...

  18. Educational Game Design as Gateway for Operationalizing Computational Thinking Skills among Middle School Students

    Science.gov (United States)

    Wu, Min Lun

    2018-01-01

    This qualitative case study reports descriptive findings of digital game-based learning involving 15 Taiwanese middle school students' use of computational thinking skills elicited through programmed activities in a game design workshop. Situated learning theory is utilized as framework to evaluate novice game designers' individual advancement in…

  19. Assessing 21st Century Skills: A Guide to Evaluating Mastery and Authentic Learning

    Science.gov (United States)

    Greenstein, Laura

    2012-01-01

    The Common Core State Standards clearly define the skills students need for success in college and the 21st century workplace. The question is, how can you measure student mastery of skills like creativity, problem solving, and use of technology? Laura Greenstein demonstrates how teachers can teach and assess 21st century skills using authentic…

  20. Teaching and assessment of communication skills in undergraduate dental education - a survey in German-speaking countries.

    Science.gov (United States)

    Rüttermann, S; Sobotta, A; Hahn, P; Kiessling, C; Härtl, A

    2017-08-01

    Teaching communication is perceived to be of importance in dental education. Several reports have been published worldwide in the educational literature describing modifications of the dental curriculum by implementing the teaching of communication skills. Surveys which evaluate the current state of training and assessment of communication skills in dental education in different countries exist already in some countries, but little information is available about German-speaking countries. In a cross-sectional study with the aim of a census, all 36 dental schools in Germany (30), Austria (3), and Switzerland (3) were surveyed. The present survey revealed that at 26 of the 34 dental schools (76%), communication skills training has been implemented. Training of communication skills mainly takes place between the 6th and the 9th semester. Ten schools were able to implement a partly longitudinal curriculum, while the other sites only offer stand-alone courses. Of the 34 dental schools, six assess communication skills in a summative way. Three of those schools also use formative assessments for their students. Another seven sites only use formative assessment. From the various formats of assessment, OSCE is mentioned most frequently. The necessity to train and assess communication skills has reached German-speaking dental schools. The present survey allows an overview of the training and assessment of communication skills in undergraduate dental education in German-speaking Europe. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

  1. The effect of using in computer skills on teachers’ perceived self-efficacy beliefs towards technology integration, attitudes and performance

    Directory of Open Access Journals (Sweden)

    Badrie Mohammad Nour ELDaou

    2016-10-01

    Full Text Available The current study analyzesthe relationship between the apparentteacher’s Self-efficacyand attitudes towardsintegrating technology into classroom teaching, self-evaluation reportsand computer performance results. Pre-post measurement of the Computer Technology Integration Survey (CTIS (Wang et al, 2004 was used to determine theconfidence level with of 60 science teachers and 12 mixed-major teachers enrolled at the Lebanese University, Faculty of Education in the academic year 2011-2012. Pre –post measurement onteachers’attitudes towards usingtechnologywas examined using an opened and a closed questionnaire.Teachers’ performance was measured by means of their Activeinspire projects results using active boards after their third practice of training in computer skills and Activeinspire program. To accumulate data on teachers’ self-report, this study uses Robert Reasoner's five components: feeling of security, feeling of belonging, feeling of identity, feeling of goal, and self-actualization which teachers used to rate themselves (Reasoner,1983. The study acknowledged probable impacts of computer training skills on teachers ‘self-evaluation report, effectiveness of computer technology skills, and evaluations of self-efficacy attitudes toward technology integration. Pearson correlation revealed a strong relationship r= 0.99 between the perceived self-efficacy towards technology incorporation and teachers’ self-evaluation report. Also, the findings of this research revealed that 82.7% of teachers earned high computer technology scores on their Activeinspire projects and 33.3% received excellent grades on computer performance test. Recommendations and potential research were discussed

  2. The Effect of Using in Computer Skills on Teachers’ Perceived Self-Efficacy Beliefs Towards Technology Integration, Attitudes and Performance

    Directory of Open Access Journals (Sweden)

    Badrie Mohammad Nour EL-Daou

    2016-07-01

    Full Text Available The current study analyzes the relationship between the apparent teacher’s Self-efficacy and attitudes towards integrating technology into classroom teaching, self- evaluation reports and computer performance results. Pre-post measurement of the Computer Technology Integration Survey (CTIS (Wang et al,2004 was used to determine the confidence level with of 60 science teachers and 12 mixed-major teachers enrolled at the Lebanese University, Faculty of Education in the academic year 2011-2012. Pre –post measurement on teachers’ attitudes towards using technology was examined using an opened and a closed questionnaire. Teachers’ performance was measured by means of their Activeinspire projects results using active boards after their third practice of training in computer skills and Activeinspire program. To accumulate data on teachers’ self-report, this study uses Robert Reasoner's five components: feeling of security, feeling of belonging, feeling of identity, feeling of goal, and self-actualization which teachers used to rate themselves (Reasoner,1983. The study acknowledged probable impacts of computer training skills on teachers ‘self-evaluation report, effectiveness of computer technology skills, and evaluations of self-efficacy attitudes toward technology integration. Pearson correlation revealed a strong relationship r = 0.99 between the perceived self-efficacy towards technology incorporation and teachers’ self-evaluation report. Also, the findings of this research revealed that 82.7% of teachers earned high computer technology scores on their Activeinspire projects and 33.3% received excellent grades on computer performance test. Recommendations and potential research were discussed.

  3. A Comparative Study of University of Wisconsin-Stout Freshmen and Senior Education Major's Computing and Internet Technology Skills/Knowledge and Associated Learning Experiences

    Science.gov (United States)

    Sveum, Evan Charles

    2010-01-01

    A study comparing University of Wisconsin-Stout freshmen and senior education majors' computing and Internet technology skills/knowledge and associated learning experiences was conducted. Instruments used in this study included the IC[superscript 3][R] Exam by Certiport, Inc. and the investigator's Computing and Internet Skills Learning…

  4. Computer Skills and Digital Media Uses among Young Students in Rio de Janeiro

    Science.gov (United States)

    Duarte, Rosalia; Cazelli, Sibele; Migliora, Rita; Coimbra, Carlos

    2013-01-01

    The main purpose of this paper is provide information relevant for the formulation of new policies for the integration of technology in education from the discussion of research results that analyse computer skills and digital media uses among students (between 12 to 18 years old) from schools in the city of Rio de Janeiro, Brazil. The schools…

  5. Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

    Science.gov (United States)

    Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

    2016-07-01

    To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

  6. ASK Standards: Assessment, Skills, and Knowledge Content Standards for Student Affairs Practitioners and Scholars

    Science.gov (United States)

    ACPA College Student Educators International, 2011

    2011-01-01

    The Assessment Skills and Knowledge (ASK) standards seek to articulate the areas of content knowledge, skill and dispositions that student affairs professionals need in order to perform as practitioner-scholars to assess the degree to which students are mastering the learning and development outcomes the professionals intend. Consistent with…

  7. Skills in clinical communication: Are we correctly assessing them at undergraduate level?

    Directory of Open Access Journals (Sweden)

    Alberto Zamora Cervantes

    2014-07-01

    Full Text Available Communicating with the patient in clinical practice refers to the way in which the doctor and the patient interact both verbally and nonverbally, in order to achieve a shared understanding of problems and solutions. Traditional learning and assessment systems are overwhelmed when it comes to addressing the complex and multi-dimensional problems of professional practice. Problem Based Learning (PBL has been put forward as an alternative to the mere reproduction of knowledge and pre-established patterns, enabling students to develop their own learning strategies to overcome problems in their future professional practice. The challenge is to determine how to assess the acquisition of clinical communication skills. The authors have recommended a summative assessment of clinical communication skills based on the combination of different methods. It highlights the importance of feedback-based formative assessment. This raises the need to develop and validate assessment scales in clinical communication at an undergraduate level. Based on this work, the authors put forward a "fanned out" assessment in terms of clinical communication skills in Medicine degrees, with the use of different instruments in a "spiraled" manner, where the greater the contact with clinical practice in the various degree and integral courses, the greater difficulty experienced, with the participation of all the stakeholders involved (self, hetero and peer assessment without precluding the involvement of patients (real or simulated in the design of assessment instruments.

  8. Using systematically observed clinical encounters (SOCEs to assess medical students’ skills in clinical settings

    Directory of Open Access Journals (Sweden)

    George R Bergus

    2010-11-01

    Full Text Available George R Bergus1–3, Jerold C Woodhead4, Clarence D Kreiter2,51Performance Based Assessment Program, Office of Student Affairs and Curriculum, 2Department of Family Medicine, 3Department of Psychiatry, 4Department of Pediatrics, 5Office of Consultation and Research in Medical Education, Roy J and Lucille A Carver College of Medicine, The University of Iowa, Iowa City, IA, USAIntroduction: The Objective Structured Clinical Examination (OSCE is widely used to assess the clinical performance of medical students. However, concerns related to cost, availability, and validity, have led educators to investigate alternatives to the OSCE. Some alternatives involve assessing students while they provide care to patients – the mini-CEX (mini-Clinical Evaluation Exercise and the Long Case are examples. We investigated the psychometrics of systematically observed clinical encounters (SOCEs, in which physicians are supplemented by lay trained observers, as a means of assessing the clinical performances of medical students.Methods: During the pediatrics clerkship at the University of Iowa, trained lay observers assessed the communication skills of third-year medical students using a communication checklist while the students interviewed and examined pediatric patients. Students then verbally presented their findings to faculty, who assessed students’ clinical skills using a standardized form. The reliability of the combined communication and clinical skills scores was calculated using generalizability theory.Results: Fifty-one medical students completed 199 observed patient encounters. The mean combined clinical and communication skills score (out of a maximum 45 points was 40.8 (standard deviation 3.3. The calculated reliability of the SOCE scores, using generalizability theory, from 10 observed patient encounters was 0.81. Students reported receiving helpful feedback from faculty after 97% of their observed clinical encounters.Conclusion: The SOCE can

  9. The effect of video review of resident laparoscopic surgical skills measured by self- and external assessment.

    Science.gov (United States)

    Herrera-Almario, Gabriel E; Kirk, Katherine; Guerrero, Veronica T; Jeong, Kwonho; Kim, Sara; Hamad, Giselle G

    2016-02-01

    Video review of surgical skills is an educational modality that allows trainees to reflect on self-performance. The purpose of this study was to determine whether resident and attending assessments of a resident's laparoscopic performance differ and whether video review changes assessments. Third-year surgery residents were invited to participate. Elective laparoscopic procedures were video recorded. The Global Operative Assessment of Laparoscopic Skills evaluation was completed immediately after the procedure and again 7 to 10 days later by both resident and attending. Scores were compared using t tests. Nine residents participated and 76 video reviews were completed. Residents scored themselves significantly lower than the faculty scores both before and after video review. Resident scores did not change significantly after video review. Attending and resident self-assessment of laparoscopic skills differs and subsequent video review does not significantly affect Global Operative Assessment of Laparoscopic Skills scores. Further studies should evaluate the impact of video review combined with verbal feedback on skill acquisition and assessment. Copyright © 2016 Elsevier Inc. All rights reserved.

  10. Project RAILS: Lessons Learned about Rubric Assessment of Information Literacy Skills

    Science.gov (United States)

    Belanger, Jackie; Zou, Ning; Mills, Jenny Rushing; Holmes, Claire; Oakleaf, Megan

    2015-01-01

    Rubric assessment of information literacy is an important tool for librarians seeking to show evidence of student learning. The authors, who collaborated on the Rubric Assessment of Informational Literacy Skills (RAILS) research project, draw from their shared experience to present practical recommendations for implementing rubric assessment in a…

  11. The Effects of Multimedia Computer- Assisted Instruction on Learning Basic Ballet Skills with Physical Education Students

    Directory of Open Access Journals (Sweden)

    El-Moneim Doaa Abd

    2014-09-01

    Full Text Available Computer technology has become an integral part of physical education, yet there have been few studies exploring the use of multimedia technology in the instruction of Physical Education. The purpose of this study was to investigate if multimedia technology affected the learning of basic ballet skills. A total of 32 female students, mean age 18.1 years, studying at the Faculty of Physical Education Zagazig university were divided into two groups. The experimental group comprised 16 students. Participants in this group participated in a ballet class with multimedia technology for six weeks. Group two participated in the ballet class with the traditional method as the control group. Parameters assessed height, weight, age, and academic level. All participants were free of any disorders known to affect performance, such as bone fractures, osteoporosis, diabetes, or cardiovascular disease. Participants reported no use of anti-seizure drugs or alcohol. In addition, all participants were fully informed of the aims of the study, and gave their voluntary consent prior to participation. The measurement procedures were in accordance with ethical human experimentation. All statistical analyses were calculated with the SPSS statistical package. Results indicated significant differences between the two groups in learning the basic skills and levels of knowledge of ballet. Applying the proposed educational program meant using multimedia to teach basic ballet skills to second-year female students enrolled in the Faculty of Physical Education

  12. Development of a Social Skills Assessment Screening Scale for Psychiatric Rehabilitation Settings: A Pilot Study.

    Science.gov (United States)

    Bhola, Poornima; Basavarajappa, Chethan; Guruprasad, Deepti; Hegde, Gayatri; Khanam, Fatema; Thirthalli, Jagadisha; Chaturvedi, Santosh K

    2016-01-01

    Deficits in social skills may present in a range of psychiatric disorders, particularly in the more serious and persistent conditions, and have an influence on functioning across various domains. This pilot study aimed at developing a brief measure, for structured evaluation and screening for social skills deficits, which can be easily integrated into routine clinical practice. The sample consisted of 380 inpatients and their accompanying caregivers, referred to Psychiatric Rehabilitation Services at a tertiary care government psychiatric hospital. The evaluation included an Inpatient intake Proforma and the 20-item Social Skills Assessment Screening Scale (SSASS). Disability was assessed using the Indian Disability Evaluation and Assessment Scale (IDEAS) for a subset of 94 inpatients. The analysis included means and standard deviations, frequency and percentages, Cronbach's alpha to assess internal consistency, t -tests to assess differences in social skills deficits between select subgroups, and correlation between SSASS and IDEAS scores. The results indicated the profile of social skills deficits assessed among the inpatients with varied psychiatric diagnoses. The "psychosis" group exhibited significantly higher deficits than the "mood disorder" group. Results indicated high internal consistency of the SSASS and adequate criterion validity demonstrated by correlations with select IDEAS domains. Modifications were made to the SSASS following the pilot study. The SSASS has potential value as a measure for screening and individualised intervention plans for social skills training in mental health and rehabilitation settings. The implications for future work on the psychometric properties and clinical applications are discussed.

  13. The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students.

    Science.gov (United States)

    Hastie, Carolyn; Fahy, Kathleen; Parratt, Jenny

    2014-09-01

    Poor teamwork is cited as one of the major root causes of adverse events in healthcare. Bullying, resulting in illness for staff, is an expression of poor teamwork skills. Despite this knowledge, poor teamwork persists in healthcare and teamwork skills are rarely the focus of teaching and assessment in undergraduate health courses. To develop and implement an assessment tool for use in facilitating midwifery students' learning of teamwork skills. This paper describes how the TeamUP rubric tool was developed. A review of the literature found no research reports on how to teach and assess health students' teamwork skills in standing teams. The literature, however, gives guidance about how university educators should evaluate individual students using peer assessment. The developmental processes of the rubric were grounded in the theoretical literature and feminist collaborative conversations. The rubric incorporates five domains of teamwork skills: Fostering a Team Climate; Project Planning; Facilitating Teams; Managing Conflict and Quality Individual Contribution. The process and outcomes of student and academic content validation are described. The TeamUP rubric is useful for articulating, teaching and assessing teamwork skills for health professional students. The TeamUP rubric is a robust, theoretically grounded model that defines and details effective teamwork skills and related behaviours. If these skills are mastered, we predict that graduates will be more effective in teams. Our assumption is that graduates, empowered by having these skills, are more likely to manage conflict effectively and less likely to engage in bullying behaviours. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

  14. Computer versus lecture: a comparison of two methods of teaching oral medication administration in a nursing skills laboratory.

    Science.gov (United States)

    Jeffries, P R

    2001-10-01

    The purpose of this study was to compare the effectiveness of both an interactive, multimedia CD-ROM and a traditional lecture for teaching oral medication administration to nursing students. A randomized pretest/posttest experimental design was used. Forty-two junior baccalaureate nursing students beginning their fundamentals nursing course were recruited for this study at a large university in the midwestern United States. The students ranged in age from 19 to 45. Seventy-three percent reported having average computer skills and experience, while 15% reported poor to below average skills. Two methods were compared for teaching oral medication administration--a scripted lecture with black and white overhead transparencies, in addition to an 18-minute videotape on medication administration, and an interactive, multimedia CD-ROM program, covering the same content. There were no significant (p lecture groups by education or computer skills. Results showed significant differences between the two groups in cognitive gains and student satisfaction (p = .01), with the computer group demonstrating higher student satisfaction and more cognitive gains than the lecture group. The groups were similar in their ability to demonstrate the skill correctly. Importantly, time on task using the CD-ROM was less, with 96% of the learners completing the program in 2 hours or less, compared to 3 hours of class time for the lecture group.

  15. The Impact of Diagnosing Skill Deficiencies and Assessment-Based Communication Training on Managerial Performance.

    Science.gov (United States)

    Papa, Michael J.; Graham, Elizabeth E.

    1991-01-01

    Evaluates an organizational diagnosis program that assesses managerial communication skills and provides the frame for follow-up training programs. Finds that managers participating in follow-up communication skills training performed significantly higher on interpersonal skills, problem-solving ability, and productivity over three long-term…

  16. Development of a tool to support holistic generic assessment of clinical procedure skills.

    Science.gov (United States)

    McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

    2008-06-01

    The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

  17. Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists

    DEFF Research Database (Denmark)

    Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter; Konge, Lars

    2016-01-01

    Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N......-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse...... nontechnical skills of nurse anesthetists....

  18. Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills.

    Science.gov (United States)

    Gustin, Jillian L; Way, David P; Wells-Di Gregorio, Sharla; McCallister, Jennifer W

    2016-08-01

    Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings. We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC. We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity. Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC

  19. Steady State Visual Evoked Potential Based Brain-Computer Interface for Cognitive Assessment

    DEFF Research Database (Denmark)

    Westergren, Nicolai; Bendtsen, Rasmus L.; Kjær, Troels W.

    2016-01-01

    decline is important. Cognitive decline may be detected using fullyautomated computerized assessment. Such systems will provide inexpensive and widely available screenings of cognitive ability. The aim of this pilot study is to develop a real time steady state visual evoked potential (SSVEP) based brain-computer...... interface (BCI) for neurological cognitive assessment. It is intended for use by patients who suffer from diseases impairing their motor skills, but are still able to control their gaze. Results are based on 11 healthy test subjects. The system performance have an average accuracy of 100% ± 0%. The test...... subjects achieved an information transfer rate (ITR) of 14:64 bits/min ± 7:63 bits=min and a subject test performance of 47:22% ± 34:10%. This study suggests that BCI may be applicable in practice as a computerized cognitive assessment tool. However, many improvements are required for the system...

  20. Conducting Computer Security Assessments at Nuclear Facilities

    International Nuclear Information System (INIS)

    2016-06-01

    Computer security is increasingly recognized as a key component in nuclear security. As technology advances, it is anticipated that computer and computing systems will be used to an even greater degree in all aspects of plant operations including safety and security systems. A rigorous and comprehensive assessment process can assist in strengthening the effectiveness of the computer security programme. This publication outlines a methodology for conducting computer security assessments at nuclear facilities. The methodology can likewise be easily adapted to provide assessments at facilities with other radioactive materials

  1. A Preliminary Investigation of General and Technique-specific Assessments for the Evaluation of Laparoscopic Technical Skills.

    Science.gov (United States)

    Vergis, Ashley; Steigerwald, Sarah

    2017-10-07

    Background  Both general and technique-specific assessments of technical skill have been validated in surgical education. The purpose of this study was to assess the correlation between the objective structured assessment of technical skills (OSATS) and the global operative assessment of laparoscopic skills (GOALS) rating scales using a high-fidelity porcine laparoscopic cholecystectomy model. Methods Post-graduate year-one general surgery and urology residents (n=14) performed a live laparoscopic porcine cholecystectomy. Trained surgeons rated their performance using OSATS and GOALS assessment scales. Results Pearson's correlation coefficient between OSATS and GOALS was 0.96 for overall scores. It ranged from 0.78 - 0.89 for domains that overlapped between the two scales. Conclusion There is a very high correlation between OSATS and GOALS. This implies that they likely measure similar constructs and that either may be used for summative-type assessments of trainee skill. However, further investigation is needed to determine if technique-specific assessments may provide more useful feedback in formative evaluation.

  2. Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

    Science.gov (United States)

    Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

    2012-01-01

    After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in

  3. Teachers' Perceptions of a Fundamental Movement Skill (FMS) Assessment Battery in a School Setting

    Science.gov (United States)

    Lander, Natalie; Morgan, Philip J.; Salmon, Jo; Barnett, Lisa M.

    2016-01-01

    Fundamental movement skills (FMS) competence is low in adolescent girls. An assessment tool for teachers is needed to monitor FMS in this demographic. The present study explored whether the Canadian Agility and Movement Skill Assessment (CAMSA) is feasible for use by physical education (PE) teachers of Australian Year 7 girls in a school setting.…

  4. Moving beyond Assessment to Improving Students' Critical Thinking Skills: A Model for Implementing Change

    Science.gov (United States)

    Haynes, Ada; Lisic, Elizabeth; Goltz, Michele; Stein, Barry; Harris, Kevin

    2016-01-01

    This research examines how the use of the CAT (Critical thinking Assessment Test) and involvement in CAT-Apps (CAT Applications within the discipline) training can serve as an important part of a faculty development model that assists faculty in the assessment of students' critical thinking skills and in the development of these skills within…

  5. Assessing Leadership and Problem-Solving Skills and Their Impacts in the Community.

    Science.gov (United States)

    Rohs, F. Richard; Langone, Christine A.

    1993-01-01

    A pretest-posttest control group design was used to assess the leadership and problem-solving skills of 281 participants and 110 controls in a statewide community leadership development program. Quantitative and qualitative data demonstrate that the program has been a catalyst to influence leadership and problem-solving skills for community…

  6. Differential susceptibility in education: interaction between genes, regulatory skills, and computer games

    OpenAIRE

    Kegel, Cornelia Aria Theodore

    2011-01-01

    Early interventions address concerns that an unacceptably large number of children are already, by four years of age, lacking in competencies fundamental to success in learning to read. Using a randomized controlled trial, the studies presented in this thesis examined program features and children’s behavioral and genetic characteristics (e.g., regulatory skills and DRD4) that might be of influence on learning effects of an exemplary computer intervention program Living Letters. Our conclusio...

  7. Assessing neurosurgical non-technical skills: an exploratory study of a new behavioural marker system.

    Science.gov (United States)

    Michinov, Estelle; Jamet, Eric; Dodeler, Virginie; Haegelen, Claire; Jannin, Pierre

    2014-10-01

    The management of non-technical skills is a major factor affecting teamwork quality and patient safety. This article presents a behavioural marker system for assessing neurosurgical non-technical skills (BMS-NNTS). We tested the BMS during deep brain stimulation surgery. We developed the BMS in three stages. First, we drew up a provisional assessment tool based on the literature and observation tools developed for other surgical specialties. We then analysed videos made in an operating room (OR) during deep brain stimulation operations in order to ensure there were no significant omissions from the skills list. Finally, we used five videos of operations to identify the behavioural markers of non-technical skills in verbal communications. Analyses of more than six hours of observations revealed 3515 behaviours from which we determined the neurosurgeon's non-technical skills behaviour pattern. The neurosurgeon frequently engaged in explicit coordination, situation awareness and leadership behaviours. In addition, the neurosurgeon's behaviours differed according to the stage of the operation and the OR staff members with whom she was communicating. Our behavioural marker system provides a structured approach to assessing non-technical skills in the field of neurosurgery. It can also be transferred to other surgical specialties and used in surgeon training curricula. © 2014 John Wiley & Sons, Ltd.

  8. Description of the Assessment of Basic Language and Learning Skills Revisited (ABLLS-R

    Directory of Open Access Journals (Sweden)

    Semenovich M.L.

    2015-12-01

    Full Text Available Diagnostics and assessment of the functional skills of children with disabilities and autism spectrum disorders are to be conducted to develop comprehensive remedial educational programmes. The described Methodology of the Assessment of Basic Language and Learning Skills — Revisited (ABLLS-R allows to simplify and make the diagnostics more efficient, to conduct a comprehensive examination of the child in different areas of development, detect the formed and deficit skills. The second and final part of the description of the methodology offers recommendations on the filling of the Table of the Results of Initial and Repeated Testing and on the choice of goals of correctional work with a child on the basis of performance of individual test scales. The pattern of the table filled after the initial and repeated testing is given. In drawing up of the programme of individual development the willingness of the child to the development of that skill should be considered. Regular practice of selected skills in various situations and the preventive measures against the regression of skills are also important. Conclusive part. Beginning in № 3 (48, 2015

  9. Development and assessment of key skills in undergraduate students: An action-research experience

    Directory of Open Access Journals (Sweden)

    Ana Fernández-Santander

    2012-03-01

    Full Text Available Employers look for professionals able to work in a team, able to approach problems, with the capacity to analyze and resolve problems, under the constant renewal of knowledge and competencies. In this paper, a group of University teachers from different areas of knowledge presents an experience to introduce key employability skills in the higher education students’ curricula. This work has been developed under the action research scope. The first goal was to make an analysis of terms referred to key skills, generating an integrated denomination for each competency. The elaboration of general templates for key skills is proposed here as a useful tool that provides information about development, assessment and marking of each skill. Different types of rubrics and assessment templates, used during this experience, are presented. DOI: 10.18870/hlrc.v2i1.37

  10. Self-assessment of intercultural communication skills: a survey of physicians and medical students in Geneva, Switzerland.

    Science.gov (United States)

    Hudelson, Patricia; Perron, Noelle Junod; Perneger, Thomas

    2011-09-01

    Physicians working with multicultural populations need to know how to elicit the patient's understanding of the illness; determine the patient's sociocultural context and identify any issues that might affect care; communicate effectively across patient-provider social and cultural differences; and collaborate effectively with an interpreter. Skills self-assessment can contribute to identifying training needs and monitoring skills development in these areas. As part of a larger study exploring the knowledge, attitudes and practices of Geneva physicians and medical students regarding the care of immigrant patients, we asked respondents to self-rate their ability to perform a range of common yet challenging intercultural communication tasks. Overall, respondents rated themselves less competent at intercultural tasks than at basic medical skills and less competent at specific intercultural communication skills than at general intercultural skills. Qualified doctors (as opposed to students), those with greater interest in caring for immigrants, and those who rarely encountered difficulties with immigrants rated themselves significantly more competent for all clinical tasks. Having a higher percentage of immigrant patients and previous cultural competence training predicted greater self-rated intercultural communication skills. Our self-assessment results suggest that students and physicians should be provided with the opportunity to practice intercultural skills with immigrant patients as part of their cultural competence training. To strengthen the validity of self-assessment measures, they should ideally be combined with more objective methods to assess actual skills.

  11. Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills

    DEFF Research Database (Denmark)

    Jensen, Jesper Kørup; Dyre, Liv; Jørgensen, Mattis Enggaard

    2017-01-01

    OBJECTIVES: The aim of this study was to examine the validity of a simulator test designed to evaluate focused assessment with sonography for trauma (FAST) skills. METHODS: Participants included a group of ultrasound novices (n = 25) and ultrasound experts (n = 10). All participants had their FAST...... skills assessed using a virtual reality ultrasound simulator. Procedural performance on the 4 FAST windows was assessed by automated simulator metrics, which received a passing or failing score. The validity evidence for these simulator metrics was examined by a stepwise approach according...

  12. A Delphi Study on Technology Enhanced Learning (TEL) Applied on Computer Science (CS) Skills

    Science.gov (United States)

    Porta, Marcela; Mas-Machuca, Marta; Martinez-Costa, Carme; Maillet, Katherine

    2012-01-01

    Technology Enhanced Learning (TEL) is a new pedagogical domain aiming to study the usage of information and communication technologies to support teaching and learning. The following study investigated how this domain is used to increase technical skills in Computer Science (CS). A Delphi method was applied, using three-rounds of online survey…

  13. A Summary of an Assessment of Fourth and Sixth Grade Basic Skills.

    Science.gov (United States)

    CTB / McGraw-Hill, Monterey, CA.

    A comprehensive assessment was made of the status of elementary education in Missouri in reading, mathematics, language, and study skills. The Comprehensive Tests of Basic Skills (CTBS) and the Short Form Test of Academic Aptitude (SFTAA) were administered to a sample of Missouri fourth and sixth graders. For each curricular area, Missouri…

  14. Computer-based programs on acquisition of reading skills in schoolchildren (review of contemporary foreign investigations

    Directory of Open Access Journals (Sweden)

    Prikhoda N.A.

    2015-03-01

    Full Text Available The article presents a description of 17 computer-based programs, which were used over the last 5 years (2008—2013 in 15 studies of computer-assisted reading instruction and intervention of schoolchildren. The article includes a description of specificity of various terms used in the above-mentioned studies and the contents of training sessions. The article also carries out a brief analysis of main characteristics of computer-based techniques — language of instruction, age and basic characteristics of students, duration and frequency of training sessions, dependent variables of education. Special attention is paid to efficiency of acquisition of different reading skills through computer-based programs in comparison to traditional school instruction.

  15. Expectations of Competency: The Mismatch between Employers' and Graduates' Views of End-User Computing Skills Requirements in the Workplace

    Science.gov (United States)

    Gibbs, Shirley; Steel, Gary; Kuiper, Alison

    2011-01-01

    The use of computers has become part of everyday life. The high prevalence of computer use appears to lead employers to assume that university graduates will have the good computing skills necessary in many graduate level jobs. This study investigates how well the expectations of employers match the perceptions of near-graduate students about the…

  16. Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

    Science.gov (United States)

    Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

    2016-12-11

    The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

  17. Customisation of an instrument to assess anaesthesiologists' non-technical skills.

    Science.gov (United States)

    Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

    2015-02-22

    The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

  18. Getting Skills Right: Assessing and Anticipating Changing Skill Needs

    Science.gov (United States)

    OECD Publishing, 2016

    2016-01-01

    Digitalisation, globalisation, demographic shifts and other changes in work organisation are constantly reshaping skill needs. This can lead to persistent skill shortages and mismatch which are costly for individuals, firms and society in terms of lost wages and lower productivity and growth. These costs can be reduced through better assessment…

  19. Assessing self-efficacy and college readiness level among new undergraduate students in computer science using metacognitive awareness inventory (MAI)

    Science.gov (United States)

    Othman, Wan Nor Afiqah Wan; Abdullah, Aziman

    2018-04-01

    This preliminary study was conducted to address the issue of academic planning skills among new university student. Due to lack of proper measurement mechanism for awareness and readiness among students, this study proposes Metacognitive Awareness Inventory (MAI) to assess the connection between student self-efficacy and college readiness. Qualitative and quantitative approach were used by provide an online self-assessment for new student of Faculty of Computer Systems & Software Engineering (FSKKP) and analyse the data respectively. The possible relationships between MAI and College Readiness Item (CRI) in self-assessment has been evaluated. The sample size of 368 respondents from UMP are responding to the online self-assessment. The initial finding shows most student (71%) of the respondent lack of skills in planning. We manage to use Pearson Product-moment correlation coefficient to find the significant relationship between MAI and CRI. Thus, we found that College Readiness provide sufficient evidence that there is a significant correlation with most of MAI items. The findings also indicated not much difference was found between gender in terms of self-efficacy level. This paper suggests the MAI and CRI is a reliable and valid scale to respond the planning skills issues among new university students.

  20. E-assessment for learning? Exploring the potential of computer-marked assessment and computer-generated feedback, from short-answer questions to assessment analytics.

    OpenAIRE

    Jordan, Sally

    2014-01-01

    This submission draws on research from twelve publications, all addressing some aspect of the broad research question: “Can interactive computer-marked assessment improve the effectiveness of assessment for learning?” \\ud \\ud The work starts from a consideration of the conditions under which assessment of any sort is predicted to best support learning, and reviews the broader literature of assessment and feedback before considering the potential of computer-based assessment, focusing on relat...

  1. Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

    Science.gov (United States)

    Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

    2016-01-01

    Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically

  2. The feasibility of a multi-format Web-based assessment of physicians' communication skills.

    Science.gov (United States)

    Kim, Sara; Brock, Douglas M; Hess, Brian J; Holmboe, Eric S; Gallagher, Thomas H; Lipner, Rebecca S; Mazor, Kathleen M

    2011-09-01

    Little is known about the best approaches and format for measuring physicians' communication skills in an online environment. This study examines the reliability and validity of scores from two Web-based communication skill assessment formats. We created two online communication skill assessment formats: (a) MCQ (multiple-choice questions) consisting of video-based multiple-choice questions; (b) multi-format including video-based multiple-choice questions with rationales, Likert-type scales, and free text responses of what physicians would say to a patient. We randomized 100 general internists to each test format. Peer and patient ratings collected via the American Board of Internal Medicine (ABIM) served as validity sources. Seventy-seven internists completed the tests (MCQ: 38; multi-format: 39). The adjusted reliability was 0.74 for both formats. Excellent communicators, as based on their peer and patient ratings, performed slightly better on both tests than adequate communicators, though this difference was not statistically significant. Physicians in both groups rated test format innovative (4.2 out of 5.0). The acceptable reliability and participants' overall positive experiences point to the value of ongoing research into rigorous Web-based communication skills assessment. With efficient and reliable scoring, the Web offers an important way to measure and potentially enhance physicians' communication skills. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  3. Teaching Topographic Map Skills and Geomorphology Concepts with Google Earth in a One-Computer Classroom

    Science.gov (United States)

    Hsu, Hsiao-Ping; Tsai, Bor-Wen; Chen, Che-Ming

    2018-01-01

    Teaching high-school geomorphological concepts and topographic map reading entails many challenges. This research reports the applicability and effectiveness of Google Earth in teaching topographic map skills and geomorphological concepts, by a single teacher, in a one-computer classroom. Compared to learning via a conventional instructional…

  4. Validity and reliability of a short questionnaire for assessing the impact of cooking skills interventions.

    Science.gov (United States)

    Barton, K L; Wrieden, W L; Anderson, A S

    2011-12-01

    Food skills programmes are widely used as a means to improve confidence in food preparation, the use of basic food skills and food selections amongst low income communities. However, the impact of such interventions are rarely evaluated as a result of a lack of validated assessment tools appropriate for use within this target group. A two-page questionnaire utilising a closed-question format was designed based on key domains known to be influenced by cooking skills programmes. Content validity was assessed by a panel of public health experts and face validity by individuals, typical of those who may attend cooking skills classes. Internal and repeat reliability were assessed with groups of adults attending community-based classes. The feasibility of using the tool in community settings was also assessed. The draft questionnaire was amended as appropriate subsequent to content and face validity testing. Cronbach's alpha for confidence and knowledge sections was 0.86 and 0.84, respectively, indicating good internal consistency. Spearman correlation coefficients for repeat reliability testing between time 1 and time 2 for each item were in the range 0.46-0.91 (all significant at P cooking skills interventions that could be utilised in the development and evaluation of multicentre cooking skills interventions. © 2011 The Authors. Journal of Human Nutrition and Dietetics © 2011 The British Dietetic Association Ltd.

  5. Parent assessment of medical student skills in ambulatory pediatrics

    Directory of Open Access Journals (Sweden)

    Erika Persson

    2013-09-01

    Full Text Available Background: Partnership with parents is a vital part of pediatric medical education, yet few studies have examined parent attitudes towards learners in pediatric settings. Methods: Questionnaires were used to determine parent and student assessment of professional and clinical skills (primary outcome and parent attitudes towards 3rd year medical students (secondary outcome at the University of Alberta. Chi Square, Kendall’s Tau and Kappa coefficients were calculated to compare parent and student responses in 8 areas: communication, respect, knowledge, listening, history taking, physical examination, supervision, and overall satisfaction. Results: Overall satisfaction with medical student involvement by parents was high: 56.7% of all parents ranked the encounter as ‘excellent’. Areas of lesser satisfaction included physician supervision of students. Compared to the parent assessment, students tended to underrate many of their skills, including communication, history taking and physical exam. There was no relationship between parent demographics and their attitude to rating any of the students’ skills. Conclusions: Parents were satisfied with medical student involvement in the care of their children. Areas identified for improvement included increased supervision of students in both history taking and physical examination. This is one of the largest studies examining parent attitudes towards pediatric students. The results may enhance undergraduate curriculum development and teaching in pediatric ambulatory clinics and strengthen the ongoing partnership between the community and teaching clinics.

  6. Network Analysis of Conversation Data for Engineering Professional Skills Assessment. Research Report. ETS RR-17-59

    Science.gov (United States)

    Zhu, Mengxiao; Zhang, Mo

    2017-01-01

    In this paper, we examine the student group discussion processes in a scenario-based assessment of engineering professional skills called Engineering Professional Skills Assessment (EPSA). In the assessment, the students were evaluated through a discussion on a scenario related to an engineering problem with no clear-cut solution. We applied…

  7. Assessment of communication, professionalism, and surgical skills in an objective structured performance-related examination (OSPRE): a psychometric study.

    Science.gov (United States)

    Ponton-Carss, Alicia; Hutchison, Carol; Violato, Claudio

    2011-10-01

    The purpose of this study was to investigate the reliability and validity of a performance assessment of communication, professionalism, and surgical skills competencies for surgery residents. Fourteen residents from the general surgery program of the University of Calgary were assessed in 7 surgical simulation stations that included communication and professionalism skills. The internal consistency reliability of the checklists and global rating scales combined was adequate for communication (α = .75-.92) and surgical skills (α = .86-.96), but not for professionalism (α = 0). There was evidence of validity as surgical skills performance improved as a function of postgraduate year level but not for the professionalism checklist. Surgical skills and communication correlated in the 2 stations assessed (r = .55 and .57; P communication skills. Further instrument development is required to assess professionalism in a structured examination context. Copyright © 2011 Elsevier Inc. All rights reserved.

  8. Guidelines for Assessing Job-Related Social Skills of Mildly Handicapped Students.

    Science.gov (United States)

    Bullis, Michael; Foss, Gilbert

    1986-01-01

    Effective assessment of job-related social skills of mildly handicapped workers should consider three components of social competence: context, cognition, and performance. A comprehensive profile of social competence is best obtained through use of several assessment tools, such as: rating scales; role play; problem-solving tests; applied…

  9. The teaching of physical assessment skills in pre-registration nursing programmes in Australia: issues for nursing education.

    Science.gov (United States)

    Birks, Melanie; James, Ainsley; Chung, Catherine; Cant, Robyn; Davis, Jenny

    2014-01-01

    Health assessment is a fundamental aspect of the professional nursing role. The teaching of skills in physical assessment is therefore a large component of pre-registration nursing programmes. As the nursing curriculum becomes more crowded with what is deemed to be essential content, there is a need to rationalise what is taught in preparatory nursing programmes to ensure readiness for practice. The study outlined in this paper, as part of a larger project, explored the teaching of physical assessment skills in pre-registration nursing programmes across Australia. Fifty-three academics completed the 121 item online survey, indicating whether each skill was taught with practice, taught with no practice or not taught at all. The results suggest that only half the skills were being taught by more than 80% of the academics and 23 skills (19%) were taught by more than 90%. Of the 121 skills commonly taught--69 skills (57%) were taught with student practice and 29 (24%) were taught with no student practice. The results of this study raise questions about the teaching of physical assessment in pre-registration nursing programmes. The suggestion is not that skills that are used regularly or infrequently should be removed from the curriculum, rather, the authors propose that consideration be given to whether the teaching of skills that are never likely to be used is occurring at the expense of comprehensive mastery of core skills.

  10. Self-assessment of intercultural communication skills: a survey of physicians and medical students in Geneva, Switzerland

    Directory of Open Access Journals (Sweden)

    Perneger Thomas

    2011-09-01

    Full Text Available Abstract Background Physicians working with multicultural populations need to know how to elicit the patient's understanding of the illness; determine the patient's sociocultural context and identify any issues that might affect care; communicate effectively across patient-provider social and cultural differences; and collaborate effectively with an interpreter. Skills self-assessment can contribute to identifying training needs and monitoring skills development in these areas. Methods As part of a larger study exploring the knowledge, attitudes and practices of Geneva physicians and medical students regarding the care of immigrant patients, we asked respondents to self-rate their ability to perform a range of common yet challenging intercultural communication tasks. Results Overall, respondents rated themselves less competent at intercultural tasks than at basic medical skills and less competent at specific intercultural communication skills than at general intercultural skills. Qualified doctors (as opposed to students, those with greater interest in caring for immigrants, and those who rarely encountered difficulties with immigrants rated themselves significantly more competent for all clinical tasks. Having a higher percentage of immigrant patients and previous cultural competence training predicted greater self-rated intercultural communication skills. Conclusion Our self-assessment results suggest that students and physicians should be provided with the opportunity to practice intercultural skills with immigrant patients as part of their cultural competence training. To strengthen the validity of self-assessment measures, they should ideally be combined with more objective methods to assess actual skills.

  11. Associations between skill perceptions and young children's actual fundamental movement skills.

    Science.gov (United States)

    Liong, Grace H E; Ridgers, Nicola D; Barnett, Lisa M

    2015-04-01

    Given that children with low movement skill competence engage in less physical activity, it is important to understand how children's perceptions relate to actual movement competence. This study examined relationships between (i) children's self-perception and objective assessments of their movement skills (object control and locomotor) and (ii) parents' perceptions of the children's movement skills and objective assessment. Children's skill perceptions were assessed using the Pictorial Scale of Perceived Movement Skill Competence for Young Children. Parent perceptions of their child's skills were assessed using a modified version of this instrument. The Test of Gross Motor Development-2nd edition assessed children's skills objectively. Participants were 136 Australian children (51% boys; M=6.5 yr., SD=1.1) and 133 parents. Regression analyses (by sex) examined the relationship between perceptions and children's scores for actual skilled performance. Boys' perceptions were associated with their actual object control ability. Parents accurately perceived boys' object control ability and girls' locomotor ability, but not the reverse. This suggests interventions aiming to improve children's movement skills could target parents and be designed to teach parents how to recognize good and poor skill performance in their children.

  12. The Effect of In-Service Training of Computer Science Teachers on Scratch Programming Language Skills Using an Electronic Learning Platform on Programming Skills and the Attitudes towards Teaching Programming

    Science.gov (United States)

    Alkaria, Ahmed; Alhassan, Riyadh

    2017-01-01

    This study was conducted to examine the effect of in-service training of computer science teachers in Scratch language using an electronic learning platform on acquiring programming skills and attitudes towards teaching programming. The sample of this study consisted of 40 middle school computer science teachers. They were assigned into two…

  13. Arthroscopic skills assessment and use of box model for training in arthroscopic surgery using Sawbones – “FAST” workstation

    Directory of Open Access Journals (Sweden)

    Goyal Saumitra

    2016-01-01

    Full Text Available Purpose: Arthroscopic skills training outside the operative room may decrease risks and errors by trainee surgeons. There is a need of simple objective method for evaluating proficiency and skill of arthroscopy trainees using simple bench model of arthroscopic simulator. The aim of this study is to correlate motor task performance to level of prior arthroscopic experience and establish benchmarks for training modules. Methods: Twenty orthopaedic surgeons performed a set of tasks to assess a arthroscopic triangulation, b navigation, c object handling and d meniscus trimming using SAWBONES “FAST” arthroscopy skills workstation. Time to completion and the errors were computed. The subjects were divided into four levels; “Novice”, “Beginner”, “Intermediate” and “Advanced” based on previous arthroscopy experience, for analyses of performance. Results: The task performance under transparent dome was not related to experience of the surgeon unlike opaque dome, highlighting the importance of hand-eye co-ordination required in arthroscopy. Median time to completion for each task improved as the level of experience increased and this was found to be statistically significant (p 85% of subjects across all the levels reported improvement in performance with sequential tasks. Conclusion: Use of the arthroscope requires visuo-spatial coordination which is a skill that develops with practice. This simple box model can reliably differentiate the arthroscopic skills based on experience and can be used to monitor progression of skills of trainees in institutions.

  14. Computer literacy: Where are nurse educators on the continuum?

    Science.gov (United States)

    Hanley, Elizabeth

    2006-01-01

    Computers are becoming ubiquitous in health and education, and it is expected that nurses from undergraduate nursing programmes are computer literate when they enter the workforce. Similarly nurse educators are expected to be computer literate to model the use of information technology in their workplace. They are expected to use email for communication and a range of computer applications for presentation of course materials and reports. Additionally, as more courses are delivered in flexible mode, educators require more comprehensive computing skills, including confidence and competence in a range of applications. A cohort of nurse educators from one tertiary institution was surveyed to assess their perceived computer literacy and how they attained this. A questionnaire that covered seven domains of computer literacy was used to assess this. The results were illuminating and identified specific training needs for this group. Their perceived lack of skill with Groupwise email and the student database program are of concern as these are essential tools for nurse educators at this polytechnic.

  15. Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

    Science.gov (United States)

    Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

    2015-01-01

    Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  16. Supporting Children with Special Needs in Learning Basic Computation Skills: The Case of Mia

    Science.gov (United States)

    Rottmann, Thomas; Peter-Koop, Andrea

    2016-01-01

    This paper introduces a revised model for the development of basic computation skills. The model draws on four key phases, which have proven to be important for the development of calculation strategies and stresses the use of gestures and the verbalisation of concrete and mental images. This seems to be of crucial importance for children with…

  17. Evaluating first-year nursing students' ability to self-assess psychomotor skills using videotape.

    Science.gov (United States)

    Watts, Wilda Ellen; Rush, Kathy; Wright, Marjorie

    2009-01-01

    Developing confidence in self-assessment is an important skill in becoming a self-regulated learner. This article describes the process undertaken by a group of educators of incorporating self-assessment in combination with psychomotor skill development with freshman students. Students were videotaped performing a wound-dressing change; the videotaping was immediately followed by a self-assessment of their performance using a faculty-generated checklist. Comparison of faculty and student ratings revealed the tendency for students to overrate their performance and identified discordance between students and faculty on several steps of the procedure. These evaluation findings are discussed and future directions explored.

  18. Mathematical Skills and Motor Life Skills in Toddlers: Do Differences in Mathematical Skills Reflect Differences in Motor Skills?

    Science.gov (United States)

    Reikerås, Elin; Moser, Thomas; Tønnessen, Finn Egil

    2017-01-01

    This study examines possible relations between early mathematical skills and motor life skills in 450 toddlers aged two years and nine months. The study employs baseline data from the longitudinal Stavanger Project--The Learning Child. The children's mathematical skills and motor life skills were assessed by structured observation in the natural…

  19. Self-confidence of medical students in performing clinical skills acquired during their surgical rotation. Assessing clinical skills education in Kuwait.

    Science.gov (United States)

    Karim, Jumanah A; Marwan, Yousef A; Dawas, Ahmed M; Akhtar, Saeed

    2012-12-01

    To assess the self-confidence of clinical years` medical students in performing clinical skills/procedures. A cross-sectional study was conducted in April 2011 at the Department of Surgery, Faculty of Medicine, Health Sciences Center, Kuwait University, Safat, Kuwait. A questionnaire was used to collect data from students who had completed their surgical rotation of their first clinical year. The students reported their level of self-confidence in performing specific skills/procedures related to that rotation. Data were presented using frequencies and percentages. A total score of confidence was calculated for each student. The Mann-Whitney and Kruskal-Wallis tests were used to assess the association between the students` sociodemographic characteristics and confidence score. Of the 122 students invited to participate in the study, only 15 (12.3%) declined to comply. Most students reported high confidence level (more than 75%) in performing 7 of the 13 history taking/physical examination skills, and 2 of the 39 diagnostic/treatment procedure skills. The highest confidence level was in performing abdominal examination, while the lowest level was in care of Jackson-Pratt drain site and emptying the drain bulb. The total confidence score was significantly higher among males (p=0.021), and students with higher monthly income (p=0.002). Medical students appeared to have poor self-confidence in performing clinical skills/procedures. Curriculum planners should explore potential reasons, and methods for the improvement of confidence level among medical students in performing skills/procedures they were expected to learn during their surgical rotation.

  20. Feedback Simulation for Acupressure Training and Skill Assessment.

    Science.gov (United States)

    Noll, Eric; Romeiser, Jamie; Shodhan, Shivam; Madariaga, Maria Cecilia; Guo, Xiaojun; Rizwan, Sabeen; Al-Bizri, Ehab; Bennett-Guerrero, Elliott

    2017-08-01

    Previous acupressure studies have yielded varying results. This could be due to differences in the amount of pressure applied to the acupressure point (acupoint) by study personnel within a study as well as between studies. Standardizing the level of pressure applied at an acupoint could improve clinical care and future research. As part of an ongoing randomized clinical trial of postoperative acupressure, five trainees were asked to perform 2 minutes of acupressure and light touch sessions on a simulator. The applied weight was recorded every minute. Individual skill assessment was performed using cumulative sum analysis. Six pretraining and 20 posttraining measurements in each acupressure and light touch group were compared with an expert's simulation values. Before training (baseline), there was significant difference in applied weight (grams) between the expert [5705 (636)] and five trainees [2998 (798), P = 0.004]. Four of the five trainees crossed the lower decision limit assessing proficiency in the acupressure group, and all five trainees were successful in the light touch group. The trainees' average number of measurements needed to cross the lower decision limit (H0), that is, defining that an individual failure rate does not statistically differ from the acceptable failure rate, was 21.3 measurements for acupressure. After this feedback simulation, trainees' scores showed no significant difference (P > 0.05) when assessed against the expert. Feedback simulation for acupressure training and skill assessment, evaluated by cumulative sum analysis, may help in improving the standardization of acupressure therapy performed during clinical practice or research.

  1. The Assessment of 21st Century Skills in Industrial and Organizational Psychology: Complex and Collaborative Problem Solving

    OpenAIRE

    Neubert, Jonas; Mainert, Jakob; Kretzschmar, André; Greiff, Samuel

    2015-01-01

    In the current paper, we highlight why and how industrial and organizational psychology can take advantage of research on 21st century skills and their assessment. We present vital theoretical perspectives, a suitable framework for assessment, and exemplary instruments with a focus on advances in the assessment of Human Capital. Specifically, Complex Problem Solving (CPS) and Collaborative Problem Solving (ColPS) are two transversal skills (i.e., skills that span multiple domains) that are...

  2. Automated social skills training with audiovisual information.

    Science.gov (United States)

    Tanaka, Hiroki; Sakti, Sakriani; Neubig, Graham; Negoro, Hideki; Iwasaka, Hidemi; Nakamura, Satoshi

    2016-08-01

    People with social communication difficulties tend to have superior skills using computers, and as a result computer-based social skills training systems are flourishing. Social skills training, performed by human trainers, is a well-established method to obtain appropriate skills in social interaction. Previous works have attempted to automate one or several parts of social skills training through human-computer interaction. However, while previous work on simulating social skills training considered only acoustic and linguistic features, human social skills trainers take into account visual features (e.g. facial expression, posture). In this paper, we create and evaluate a social skills training system that closes this gap by considering audiovisual features regarding ratio of smiling, yaw, and pitch. An experimental evaluation measures the difference in effectiveness of social skill training when using audio features and audiovisual features. Results showed that the visual features were effective to improve users' social skills.

  3. Designing an Automated Assessment of Public Speaking Skills Using Multimodal Cues

    Science.gov (United States)

    Chen, Lei; Feng, Gary; Leong, Chee Wee; Joe, Jilliam; Kitchen, Christopher; Lee, Chong Min

    2016-01-01

    Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and human rating were conducted according to standards in educational assessment. An initial corpus of…

  4. The Cognitive Correlates of Third-Grade Skill in Arithmetic, Algorithmic Computation, and Arithmetic Word Problems

    Science.gov (United States)

    Fuchs, Lynn S.; Fuchs, Douglas; Compton, Donald L.; Powell, Sarah R.; Seethaler, Pamela M.; Capizzi, Andrea M.; Schatschneider, Christopher; Fletcher, Jack M.

    2006-01-01

    The purpose of this study was to examine the cognitive correlates of RD-grade skill in arithmetic, algorithmic computation, and arithmetic word problems. Third graders (N = 312) were measured on language, nonverbal problem solving, concept formation, processing speed, long-term memory, working memory, phonological decoding, and sight word…

  5. The effectiveness of a computer-assisted instruction programme on communication skills of medical specialists in oncology.

    NARCIS (Netherlands)

    Hulsman, R.L.; Ros, W.J.G.; Winnubst, J.A.M.; Bensing, J.M.

    2002-01-01

    Although doctor-patient communication is important in health care, medical specialists are generally not well trained in communication skills. Conventional training programmes are generally time consuming and hard to fit into busy working schedules of medical specialists. A computer-assisted

  6. Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room.

    Science.gov (United States)

    Dedy, Nicolas J; Szasz, Peter; Louridas, Marisa; Bonrath, Esther M; Husslein, Heinrich; Grantcharov, Teodor P

    2015-06-01

    Nontechnical skills are critical for patient safety in the operating room (OR). As a result, regulatory bodies for accreditation and certification have mandated the integration of these competencies into postgraduate education. A generally accepted approach to the in-training assessment of nontechnical skills, however, is lacking. The goal of the present study was to develop an evidence-based and reliable tool for the in-training assessment of residents' nontechnical performance in the OR. The Objective Structured Assessment of Nontechnical Skills tool was designed as a 5-point global rating scale with descriptive anchors for each item, based on existing evidence-based frameworks of nontechnical skills, as well as resident training requirements. The tool was piloted on scripted videos and refined in an iterative process. The final version was used to rate residents' performance in recorded OR crisis simulations and during live observations in the OR. A total of 37 simulations and 10 live procedures were rated. Interrater agreement was good for total mean scores, both in simulation and in the real OR, with intraclass correlation coefficients >0.90 in all settings for average and single measures. Internal consistency of the scale was high (Cronbach's alpha = 0.80). The Objective Structured Assessment of Nontechnical Skills global rating scale was developed as an evidence-based tool for the in-training assessment of residents' nontechnical performance in the OR. Unique descriptive anchors allow for a criterion-referenced assessment of performance. Good reliability was demonstrated in different settings, supporting applications in research and education. Copyright © 2015 Elsevier Inc. All rights reserved.

  7. Information Literacy Follow-Through: Enhancing Preservice Teachers' Information Evaluation Skills through Formative Assessment

    Science.gov (United States)

    Seely, Sara Robertson; Fry, Sara Winstead; Ruppel, Margie

    2011-01-01

    An investigation into preservice teachers' information evaluation skills at a large university suggests that formative assessment can improve student achievement. Preservice teachers were asked to apply information evaluation skills in the areas of currency, relevancy, authority, accuracy, and purpose. The study used quantitative methods to assess…

  8. The Dutch motor skills assessment as tool for talent development in table tennis : a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, Irene R.; Nijhuis-Van der Sanden, Maria W. G.; Elferink-Gemser, Marije T.; Oosterveld, Frits G. J.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  9. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.G.; Elferink-Gemser, M.T.; Oosterveld, F.G.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  10. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.; Elferink-Gemser, M.T.; Oosterveld, F.G.J.

    2014-01-01

    Abstract A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in

  11. "Reflection-Before-Practice" Improves Self-Assessment and End-Performance in Laparoscopic Surgical Skills Training.

    Science.gov (United States)

    Ganni, Sandeep; Botden, Sanne M B I; Schaap, Dennis P; Verhoeven, Bas H; Goossens, Richard H M; Jakimowicz, Jack J

    To establish whether a systematized approach to self-assessment in a laparoscopic surgical skills course improves accordance between expert- and self-assessment. A systematic training course in self-assessment using Competency Assessment Tool was introduced into the normal course of evaluation within a Laparoscopic Surgical Skills training course for the test group (n = 30). Differences between these and a control group (n = 30) who did not receive the additional training were assessed. Catharina Hospital, Eindhoven, The Netherlands (n = 27), and GSL Medical College, Rajahmundry, India (n = 33). Sixty postgraduate year 2 and 3 surgical residents who attended the 2-day Laparoscopic Surgical Skills grade 1 level 1 curriculum were invited to participate. The test group (n = 30) showed better accordance between expert- and self-assessment (difference of 1.5, standard deviation [SD] = 0.2 versus 3.83, SD = 0.6, p = 0.009) as well as half the number (7 versus 14) of cases of overreporting. Furthermore, the test group also showed higher overall mean performance (mean = 38.1, SD = 0.7 versus mean = 31.8, SD = 1.0, p assessment can be viewed as responsible for this and can be seen as "reflection-before-practice" within the framework of reflective practice as defined by Donald Schon. Our results suggest that "reflection-before-practice" in implementing self-assessment is an important step in the development of surgical skills, yielding both better understanding of one's strengths and weaknesses and also improving overall performance. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  12. Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection.

    Science.gov (United States)

    Jaffer, U; Singh, P; Pandey, V A; Aslam, M; Standfield, N J

    2014-01-01

    Duplex ultrasound facilitates bedside diagnosis and hence timely patient care. Its uptake has been hampered by training and accreditation issues. We have developed an assessment tool for Duplex arterial stenosis measurement for both simulator and patient based training. A novel assessment tool: duplex ultrasound assessment of technical skills was developed. A modified duplex ultrasound assessment of technical skills was used for simulator training. Novice, intermediate experience and expert users of duplex ultrasound were invited to participate. Participants viewed an instructional video and were allowed ample time to familiarize with the equipment. Participants' attempts were recorded and independently assessed by four experts using the modified duplex ultrasound assessment of technical skills. 'Global' assessment was also done on a four point Likert scale. Content, construct and concurrent validity as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. The simulator had good satisfaction rating from participants: median 4; range 3-5. Receiver operator characteristic analysis has established a cut point of 22/ 34 and 25/ 40 were most appropriate for simulator and patient based assessment respectively. We have validated a novel assessment tool for duplex arterial stenosis detection. Further work is underway to establish transference validity of simulator training to improved skill in scanning patients. We have developed and validated duplex ultrasound assessment of technical skills for simulator training.

  13. Number sense or working memory? The effect of two computer-based trainings on mathematical skills in elementary school.

    Science.gov (United States)

    Kuhn, Jörg-Tobias; Holling, Heinz

    2014-01-01

    Research on the improvement of elementary school mathematics has shown that computer-based training of number sense (e.g., processing magnitudes or locating numbers on the number line) can lead to substantial achievement gains in arithmetic skills. Recent studies, however, have highlighted that training domain-general cognitive abilities (e.g., working memory [WM]) may also improve mathematical achievement. This study addressed the question of whether a training of domain-specific number sense skills or domain-general WM abilities is more appropriate for improving mathematical abilities in elementary school. Fifty-nine children (M age = 9 years, 32 girls and 27 boys) received either a computer-based, adaptive training of number sense (n = 20), WM skills (n = 19), or served as a control group (n = 20). The training duration was 20 min per day for 15 days. Before and after training, we measured mathematical ability using a curriculum-based math test, as well as spatial WM. For both training groups, we observed substantial increases in the math posttest compared to the control group (d = .54 for number sense skills training, d = .57 for WM training, respectively). Whereas the number sense group showed significant gains in arithmetical skills, the WM training group exhibited marginally significant gains in word problem solving. However, no training group showed significant posttest gains on the spatial WM task. Results indicate that a short training of either domain-specific or domain-general skills may result in reliable short-term training gains in math performance, although no stable training effects were found in the spatial WM task.

  14. Cloud computing assessing the risks

    CERN Document Server

    Carstensen, Jared; Golden, Bernard

    2012-01-01

    Cloud Computing: Assessing the risks answers these questions and many more. Using jargon-free language and relevant examples, analogies and diagrams, it is an up-to-date, clear and comprehensive guide the security, governance, risk, and compliance elements of Cloud Computing.

  15. Protocols for the Investigation of Information Processing in Human Assessment of Fundamental Movement Skills.

    Science.gov (United States)

    Ward, Brodie J; Thornton, Ashleigh; Lay, Brendan; Rosenberg, Michael

    2017-01-01

    Fundamental movement skill (FMS) assessment remains an important tool in classifying individuals' level of FMS proficiency. The collection of FMS performances for assessment and monitoring has remained unchanged over the last few decades, but new motion capture technologies offer opportunities to automate this process. To achieve this, a greater understanding of the human process of movement skill assessment is required. The authors present the rationale and protocols of a project in which they aim to investigate the visual search patterns and information extraction employed by human assessors during FMS assessment, as well as the implementation of the Kinect system for FMS capture.

  16. Incorporating computer-assisted assessment to Bachelor of Science ...

    African Journals Online (AJOL)

    The use of computers in education has already been established for decades. Computers have been used from lesson preparations, presentations, and student assessments. Many authors have studied the design, implementation, and impact of computer-assisted assessment (CAA) (also called computer-based testing, ...

  17. Teaching and assessing consultation skills: an evaluation of a South ...

    African Journals Online (AJOL)

    Teaching and assessing consultation skills: an evaluation of a South African workshop ... of this work is unsupervised consultations with patients suffering from new or ... Their attitudes to the LAP and the forms of teaching that its use promotes ...

  18. Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

    Science.gov (United States)

    Azizah, K. N.; Ibrahim, M.; Widodo, W.

    2018-01-01

    Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

  19. Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia

    Directory of Open Access Journals (Sweden)

    Alkhayal A

    2012-10-01

    Full Text Available Abdullah Alkhayal,1 Shahla Aldhukair,2 Nahar Alselaim,1 Salah Aldekhayel,1 Sultan Alhabdan,1 Waleed Altaweel,3 Mohi Elden Magzoub,4 Mohammed Zamakhshary1,21Department of Surgery, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia; 2Public Health Section, King Abdullah International Medical Research Center, Riyadh, Saudi Arabia; 3Urology Department, King Faisal Specialist Hospital and Research Center, Riyadh, Saudi Arabia; 4Department of Medical Education, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi ArabiaBackground: After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors’ perspective, and program directors’ attitudes toward the available objective tools to assess technical skills.Methods: This study was a cross-sectional survey of surgical program directors (PDs. The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs’ perspective and the PDs’ attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated.Results: Seventy-one (61% participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative

  20. Large-scale Assessment Yields Evidence of Minimal Use of Reasoning Skills in Traditionally Taught Classes

    Science.gov (United States)

    Thacker, Beth

    2017-01-01

    Large-scale assessment data from Texas Tech University yielded evidence that most students taught traditionally in large lecture classes with online homework and predominantly multiple choice question exams, when asked to answer free-response (FR) questions, did not support their answers with logical arguments grounded in physics concepts. In addition to a lack of conceptual understanding, incorrect and partially correct answers lacked evidence of the ability to apply even lower level reasoning skills in order to solve a problem. Correct answers, however, did show evidence of at least lower level thinking skills as coded using a rubric based on Bloom's taxonomy. With the introduction of evidence-based instruction into the labs and recitations of the large courses and in a small, completely laboratory-based, hands-on course, the percentage of correct answers with correct explanations increased. The FR format, unlike other assessment formats, allowed assessment of both conceptual understanding and the application of thinking skills, clearly pointing out weaknesses not revealed by other assessment instruments, and providing data on skills beyond conceptual understanding for course and program assessment. Supported by National Institutes of Health (NIH) Challenge grant #1RC1GM090897-01.

  1. Assessment and Teaching of Science Skills: Whole of Programme Perceptions of Graduating Students

    Science.gov (United States)

    Hodgson, Yvonne; Varsavsky, Cristina; Matthews, Kelly E.

    2014-01-01

    This study reports on science student perceptions of their skills (scientific knowledge, oral communication, scientific writing, quantitative skills, teamwork and ethical thinking) as they approach graduation. The focus is on which teaching activities and assessment tasks over the whole programme of study students thought utilised each of the six…

  2. Introducing computer-assisted training sessions in the clinical skills lab at the Faculty of Medicine, Suez Canal University.

    Science.gov (United States)

    Hosny, Somaya; Mishriky, Adel M; Youssef, Mirella

    2008-01-01

    The Faculty of Medicine, Suez Canal University clinical skills lab was established in 1981 as the first skills lab in Egypt to cope with innovation in medical education adopted since school inauguration in 1978. Students are trained using their peers or models. Training is done weekly, guided by checklists tested for validity and reliability and updated regularly. Students receive immediate feedback on their performance. Recently, the number of students has increased, leading to challenges in providing adequate supervision and training experiences. A project to design and implement a computer-assisted training (CAT) system seemed to be a plausible solution. To assess the quality of a newly developed CAT product, faculty and students' satisfaction with it, and its impact on the learning process. The project involved preparation of multimedia video-films with a web interface for links of different scientific materials. The project was implemented on second year students. A quality check was done to assess the product's scientific content, and technical quality using questionnaires filled by 84 faculty members (139 filled forms) and 175 students (924 filled forms). For assessment of impact, results of examinations after project implementation were compared with results of 2nd year students of previous 3 years. More faculty (96.3%) were satisfied with the product and considered its quality good to excellent, compared to 93.9% of students, p < 0.001. Most faculty (76.2%) have agreed on its suitability for self-learning, while most students considered the product would be suitable after modification. The percentage of students' failures was lower after project implementation, compared to previous 3 years, p < 0.05. CAT materials developed for training of second year students in skills lab proved to be of good scientific content and quality, and suitable for self-learning. Their use was associated with lower failure rates among students. A randomized trial is recommended

  3. EVALUATING A COMPUTER BASED SKILLS ACQUISITION TRAINER TO CLASSIFY BADMINTON PLAYERS

    Directory of Open Access Journals (Sweden)

    Minh Vu Huynh

    2011-09-01

    Full Text Available The aim of the present study was to compare the statistical ability of both neural networks and discriminant function analysis on the newly developed SATB program. Using these statistical tools, we identified the accuracy of the SATB in classifying badminton players into different skill level groups. Forty-one participants, classified as advanced, intermediate, or beginner skilled level, participated in this study. Results indicated neural networks are more effective in predicting group membership, and displayed higher predictive validity when compared to discriminant analysis. Using these outcomes, in conjunction with the physiological and biomechanical variables of the participants, we assessed the authenticity and accuracy of the SATB and commented on the overall effectiveness of the visual based training approach to training badminton athletes

  4. Developing a strategy for computational lab skills training through Software and Data Carpentry: Experiences from the ELIXIR Pilot action [version 1; referees: 3 approved

    Directory of Open Access Journals (Sweden)

    Aleksandra Pawlik

    2017-07-01

    Full Text Available Quality training in computational skills for life scientists is essential to allow them to deliver robust, reproducible and cutting-edge research. A pan-European bioinformatics programme, ELIXIR, has adopted a well-established and progressive programme of computational lab and data skills training from Software and Data Carpentry, aimed at increasing the number of skilled life scientists and building a sustainable training community in this field. This article describes the Pilot action, which introduced the Carpentry training model to the ELIXIR community.

  5. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study.

    Science.gov (United States)

    Faber, Irene R; Nijhuis-Van Der Sanden, Maria W G; Elferink-Gemser, Marije T; Oosterveld, Frits G J

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their talent development programme consisting of eight items measuring perceptuo-motor skills specific to table tennis under varying conditions. This study aimed to investigate this assessment regarding its reproducibility, internal consistency, underlying dimensions and concurrent validity in 113 young table tennis players (6-10 years). Intraclass correlation coefficients of six test items met the criteria of 0.7 with coefficients of variation between 3% and 8%. Cronbach's alpha valued 0.853 for internal consistency. The principal components analysis distinguished two conceptually meaningful factors: "ball control" and "gross motor function." Concurrent validity analyses demonstrated moderate associations between the motor skills assessment's results and national ranking; boys r = -0.53 (P motor skills assessment seems to be a reproducible, objective part of a talent development programme, more longitudinal studies are required to investigate its predictive validity.

  6. The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training

    DEFF Research Database (Denmark)

    Lladó Grove, Gabriela; Langager Høgh, Annette; Nielsen, Judith

    2015-01-01

    OBJECTIVE: The concept of the Objective Structured Assessment of Technical Skills (OSATS) is to quantify surgical skills in an objective way and, thereby, produce an additional procedure-specific assessment tool. Since 2005, a 2-day practical course for upcoming specialist registrars in vascular...... surgery has been obligatory. The aim of this study is to describe the results from a tailored OSATS test as a tool for the evaluation of practical skills during an intensive training session in a simple simulator box for vascular anastomoses. METHOD: Between 2005 and 2013, we registered the OSATS scores......, or the experience with vascular anastomoses and outcomes. CONCLUSION: OSATS is a valuable tool for evaluating the advancement of technical skills during an intensive practical course in performing vascular anastomoses. (C) 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights...

  7. Language Needs Analysis of Iranian Undergraduate Students of Computer Engineering: A Study of Reading Skill

    Science.gov (United States)

    Fard-Kashani, Alireza; Jahromi, Abdol Hossein Zahedi; Javadi, Ali; Fallahi, Ali Mohammad

    2015-01-01

    The current study aimed at diagnosing the language needs of Iranian undergraduate students of computer engineering in order to find out whether there is any significant difference in perceptions between the students and their ESAP (English for Specific Academic Purpose) teachers, concerning their Reading skill needs. To conduct the intended…

  8. The Effect of a Graph-Oriented Computer-Assisted Project-Based Learning Environment on Argumentation Skills

    Science.gov (United States)

    Hsu, P. -S.; Van Dyke, M.; Chen, Y.; Smith, T. J.

    2015-01-01

    The purpose of this quasi-experimental study was to explore how seventh graders in a suburban school in the United States developed argumentation skills and science knowledge in a project-based learning environment that incorporated a graph-oriented, computer-assisted application. A total of 54 students (three classes) comprised this treatment…

  9. Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

    Science.gov (United States)

    Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

    2016-11-01

    To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

  10. Assessment of Critical Business Skill Development by MBA Alumni

    Science.gov (United States)

    Glynn, Joseph G.; Wood, Gregory R.

    2008-01-01

    Six years of survey data were analyzed to assess, among other things, the degree to which an AACSB accredited graduate business program successfully developed student skills in a variety of areas deemed important for career success. The study illustrates a methodology institutions can use to respond to increasing demands for program evaluation and…

  11. The Language Factor in Elementary Mathematics Assessments: Computational Skills and Applied Problem Solving in a Multidimensional IRT Framework

    Science.gov (United States)

    Hickendorff, Marian

    2013-01-01

    The results of an exploratory study into measurement of elementary mathematics ability are presented. The focus is on the abilities involved in solving standard computation problems on the one hand and problems presented in a realistic context on the other. The objectives were to assess to what extent these abilities are shared or distinct, and…

  12. Development, initial reliability and validity testing of an observational tool for assessing technical skills of operating room nurses.

    Science.gov (United States)

    Sevdalis, Nick; Undre, Shabnam; Henry, Janet; Sydney, Elaine; Koutantji, Mary; Darzi, Ara; Vincent, Charles A

    2009-09-01

    The recent emergence of the Systems Approach to the safety and quality of surgical care has triggered individual and team skills training modules for surgeons and anaesthetists and relevant observational assessment tools have been developed. To develop an observational tool that captures operating room (OR) nurses' technical skill and can be used for assessment and training. The Imperial College Assessment of Technical Skills for Nurses (ICATS-N) assesses (i) gowning and gloving, (ii) setting up instrumentation, (iii) draping, and (iv) maintaining sterility. Three to five observable behaviours have been identified for each skill and are rated on 1-6 scales. Feasibility and aspects of reliability and validity were assessed in 20 simulation-based crisis management training modules for trainee nurses and doctors, carried out in a Simulated Operating Room. The tool was feasible to use in the context of simulation-based training. Satisfactory reliability (Cronbach alpha) was obtained across trainers' and trainees' scores (analysed jointly and separately). Moreover, trainer nurse's ratings of the four skills correlated positively, thus indicating adequate content validity. Trainer's and trainees' ratings did not correlate. Assessment of OR nurses' technical skill is becoming a training priority. The present evidence suggests that the ICATS-N could be considered for use as an assessment/training tool for junior OR nurses.

  13. Further validation of the Danish version of the McGill Ingestive Skills Assessment (MISA-DK)

    DEFF Research Database (Denmark)

    Hansen, Tina

    2014-01-01

    Background/aims The McGill Ingestive Skill Assessment (MISA) for measuring dysphagic patients' functional performance during meals has been previously translated into Danish — the Danish McGill Ingestive Skill Assessment (MISA-DK) and this translated version validated. However, issues about......-DK was then tested using 102 videorecordings of geriatric patients' ingestive skill performance, and the data from the scale were examined using a second Rasch analysis. Results Initially, two of the six proposed subscales of the original MISA-DK failed to fit the Rasch model, and were removed. It was also necessary...

  14. Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

    Science.gov (United States)

    Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

    2016-01-01

    Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed

  15. Self-assessment in laparoscopic surgical skills training: Is it reliable?

    Science.gov (United States)

    Ganni, Sandeep; Chmarra, Magdalena K; Goossens, Richard H M; Jakimowicz, Jack J

    2017-06-01

    The concept of self-assessment has been widely acclaimed for its role in the professional development cycle and self-regulation. In the field of medical education, self-assessment has been most used to evaluate the cognitive knowledge of students. The complexity of training and evaluation in laparoscopic surgery has previously acted as a barrier in determining the benefits self-assessment has to offer in comparison with other fields of medical education. Thirty-five surgical residents who attended the 2-day Laparoscopic Surgical Skills Grade 1 Level 1 curriculum were invited to participate from The Netherlands, India and Romania. The competency assessment tool (CAT) for laparoscopic cholecystectomy was used for self- and expert-assessment and the resulting distributions assessed. A comparison between the expert- and self-assessed aggregates of scores from the CAT agreed with previous studies. Uniquely to this study, the aggregates of individual sub-categories-'use of instruments'; 'tissue handling'; and errors 'within the component tasks' and the 'end product' from both self- and expert-assessments-were investigated. There was strong positive correlation (r s  > 0.5; p assessment in all categories with only the 'tissue handling' having a weaker correlation (r s  = 0.3; p = 0.04). The distribution of the mean of the differences between self-assessment and expert-assessment suggested no significant difference between the scores of experts and the residents in all categories except the 'end product' evaluation where the difference was significant (W = 119, p = 0.03). Self-assessment using the CAT form gives results that are consistently not different from expert-assessment when assessing one's proficiency in surgical skills. Areas where there was less agreement could be explained by variations in the level of training and understanding of the assessment criteria.

  16. What should be included in the assessment of laypersons' paediatric basic life support skills? Results from a Delphi consensus study.

    Science.gov (United States)

    Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim; Bohnstedt, Cathrine; Sønderskov, Claus; Østergaard, Doris; Tolsgaard, Martin Grønnebæk

    2018-01-18

    Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts completed a re-rating. Items with a score above 3 by more than 80% of the experts in the third round were included in an assessment instrument. In the first round, 19 and 15 items were identified to assess PBLS and FBAOM skills, respectively. The ratings and comments from the last two rounds resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify different stages of foreign body airway obstruction", "Identify consciousness", "Call for help", "Back blows", "Chest thrusts/abdominal thrusts according to age", "Identify loss of consciousness and change to CPR", "Assessment of breathing" and "Ventilation". For assessment of laypersons some PBLS and FBAOM skills described in guidelines are more important than others. Four out of nine of PBLS skills focus on airway and breathing skills, supporting the major importance of these skills for

  17. Condom-use skills checklist: a proxy for assessing condom-use knowledge and skills when direct observation is not possible.

    Science.gov (United States)

    Stanton, B; Deveaux, L; Lunn, S; Yu, S; Brathwaite, N; Li, X; Cottrell, L; Harris, C; Clemens, R; Marshall, S

    2009-06-01

    Because of the continued importance of correct condom-use in controlling the HIV epidemic and the limited availability of tools for assessing correct condom-use, methods for assessing condom-application skills, especially when direct observation is not feasible, are needed. Accordingly, in the context of a high-risk population (The Bahamas) for HIV, a 17-item scale--the Condom-use Skills Checklist (CUSC)--was developed for use among young adolescents and adults. The rationale and approach to developing the scale and some measures of internal consistency, construct validity, and criterion-related validity have been described. It is concluded that the scale offers a reasonable alternative to direct observation among older subjects and that further development may make it more useful among pre-adolescents.

  18. Educational Needs Assessment Highlights Several Areas of Emphasis in Teaching Evidence-Based Medicine Skills to Physician Assistant Students.

    Science.gov (United States)

    Kuntz, Susan; Ali, Syed Haris; Hahn, Emily

    2016-08-03

    An assessment of educational needs is essential for curricular reform in medical education. Using the conceptual framework of needs assessment, this study aimed to determine which content should be emphasized in teaching evidence-based medicine (EBM) skills to physician assistant (PA) students. Key content areas were identified from the published literature and objectives for previous courses. A questionnaire-type needs assessment instrument was created and given to a graduating class of PA students (n = 21) at the University of North Dakota. The response format had two 5-option scales, one to assess current skill levels and the other to assess ideal skill levels. Means for each category were calculated, and a mean difference analysis was performed. An average mean difference of 0.5 was noted in 3 domains (information retrieval skills, writing skills, and overall gains), and a mean difference of 0.7 was noted in one domain (statistical skills). Items with a mean difference of ≥ 0.7 were identified for prioritization for curricular reform. Open-ended input from respondents substantiated the need for greater emphasis on these content areas. Several content areas related to EBM skills can be identified and prioritized through a systematically conducted educational needs assessment. This method can be used to identify discrepancies between the existing and ideal states of affairs in PA education.

  19. Self-Assessment of Employability Skill Outcomes among Undergraduates and Alignment with Academic Ratings

    Science.gov (United States)

    Jackson, Denise

    2014-01-01

    Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in overrating and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in…

  20. The Assessment of Comunication and Interaction Skills in Psychotic Patiens

    Directory of Open Access Journals (Sweden)

    Katayoun Khoushabi

    2002-10-01

    Full Text Available Objective: The main objective at study was to assess the communication and interaction of psychotic patient above age of 18 in 2000. Materials & Methods: The study sample consist of 80 psychotic patients (38 female and 42 male from Razi and Imam Hossein Hospital and Raad and Sina outpatient clinic, selected based on occupational therapist using the Assessment of Communication and Interaction Skills Questionnaire (ACIS. Statistical analyses of information have done by spearman coefficient correlation, Mann Whitney and Wilcoxon tests. Results: Spearman of correlation, mann-and wilcoxon Findings indicate: 1-The average grade of ACIS test in the group of schizophrenic patients were significantly lower than the group schizoaffective patients (P<0.00l. 2-The average of ACIS test in the group of inpatient was lower than the group of outpatient (p<0.00l. 3-No significant difference was found for the average grade of ACIS test in the group of male & female. Conclusion: The obtained results show the weakness of communication and interaction skills in schizophrenic patient and also inpatients. The obtained results of this investigation give useful information about the communication and interaction skill of patient to the occupational therapists but application of this instrument needs more studies.

  1. Management of Radioactive Spills in Nuclear Medicine; Teaching and Assessing with Objectively Structured Assessment of Technical Skills

    International Nuclear Information System (INIS)

    Hussain, Riffat Parveen

    2015-01-01

    Routine work in nuclear medicine requires the careful elution of radioactivity and its subsequent, storage and handling. Though all effort is maintained to prevent any “spill” of this radioactivity, accidents are bound to happen. The response to this spill is a methodically worked out a plan that is written and adopted as a “standard operating procedure.” This protocol is taught to all involved in the area of working as a mock drill/apprenticeship model. No formal evaluation of learning is in place except for the mock drills. The objectively structured assessment of technical skills (OSATS) is a variation on the Objective Structured Clinical Examination, which is a form of workplace based assessment. The OSATS is cited in the Accreditation Council of Graduate Medical Education evaluation toolbox on the website as the most desirable evaluation tool for the patient care topics. It is the objective of this paper is to introduce the “OSATS” for teaching, and assessment of the learning, of the protocol for the management of radioactive spill. As a review of the literature on the subject failed to reveal any such teaching protocol/material/document for this important technical skill, we hope that it may act as a landmark for the development of teaching and assessment of other technical skills also

  2. Promoting Assessment Efficacy through an Integrated System for Online Clinical Assessment of Practical Skills

    Science.gov (United States)

    Hay, Peter J.; Engstrom, Craig; Green, Anita; Friis, Peter; Dickens, Sue; Macdonald, Doune

    2013-01-01

    This paper presents evaluation outcomes from an externally funded research project involving the online clinical assessment of practical skills (eCAPS) using web-based video technologies within a university medical programme. eCAPS was implemented to trial this web-based approach for promoting the efficacy of "practical" skills…

  3. Assessing Nurse Anaesthetists' Non-Technical Skills in the operating room.

    Science.gov (United States)

    Lyk-Jensen, H T; Jepsen, R M H G; Spanager, L; Dieckmann, P; Østergaard, D

    2014-08-01

    Incident reporting and fieldwork in operating rooms have shown that some of the errors that arise in anaesthesia relate to inadequate use of non-technical skills. To provide a tool for training and feedback on nurse anaesthetists' non-technical skills, this study aimed to adapt the Anaesthetists' Non-Technical Skills (ANTS) as a behavioural marker system for the formative assessment of nurse anaesthetists' non-technical skills in the operating room. A qualitative approach with focus group interviews was used to identify the non-technical skills of nurse anaesthetists in the operating room. The interview data were transcribed verbatim. Directed content analysis was used to code and sort data deductively into the ANTS categories: task management, team working, situation awareness and decision making. The prototype named Nurse Anaesthetists' Non-Technical Skills (N-ANTS) was presented and discussed in a group of subject matter experts to ensure face validity. The N-ANTS system consists of the same four categories as ANTS and 15 underlying elements. Three to five good and poor behavioural markers for each element were identified. The headings and definitions of the categories and elements were adjusted to encompass the behavioural markers in N-ANTS. The differences that emerged mainly reflected statements regarding the establishment of role, competence, and task delegation. A behavioural marker system, N-ANTS, for nurse anaesthetists was adapted from a behavioural marker system, ANTS, for anaesthesiologists. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

  4. Teaching Organizational Skills

    Science.gov (United States)

    Bakunas, Boris; Holley, William

    2004-01-01

    Kerr and Zigmond (1986) found that 67 percent of all high school teachers surveyed viewed organizational skills as crucial for student success in school. How can teachers get their students to agree? One way is to teach organizational skills just as they would teach writing or computation skills. Explain and demonstrate what students are to do,…

  5. Can the 'Assessment Drives Learning' effect be detected in clinical skills training? - Implications for curriculum design and resource planning

    Science.gov (United States)

    Buss, Beate; Krautter, Markus; Möltner, Andreas; Weyrich, Peter; Werner, Anne; Jünger, Jana; Nikendei, Christoph

    2012-01-01

    Purpose: The acquisition of clinical-technical skills is of particular importance for the doctors of tomorrow. Procedural skills are often trained for the first time in skills laboratories, which provide a sheltered learning environment. However, costs to implement and maintain skills laboratories are considerably high. Therefore, the purpose of the present study was to investigate students’ patterns of attendance of voluntary skills-lab training sessions and thereby answer the following question: Is it possible to measure an effect of the theoretical construct related to motivational psychology described in the literature – ‘Assessment drives learning’ – reflected in patterns of attendance at voluntary skills-lab training sessions? By answering this question, design recommendations for curriculum planning and resource management should be derived. Method: A retrospective, descriptive analysis of student skills-lab attendance related to voluntary basic and voluntary advanced skills-lab sessions was conducted. The attendance patterns of a total of 340 third-year medical students in different successive year groups from the Medical Faculty at the University of Heidelberg were assessed. Results: Students showed a preference for voluntary basic skills-lab training sessions, which were relevant to clinical skills assessment, especially at the beginning and at the end of the term. Voluntary advanced skills-lab training sessions without reference to clinical skills assessment were used especially at the beginning of the term, but declined towards the end of term. Conclusion: The results show a clear influence of assessments on students’ attendance at skills-lab training sessions. First recommendations for curriculum design and resource management will be described. Nevertheless, further prospective research studies will be necessary to gain a more comprehensive understanding of the motivational factors impacting students’ utilisation of voluntary skills

  6. Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

    Science.gov (United States)

    Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

    2017-01-01

    Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

  7. The Gain-Loss Model: A Probabilistic Skill Multimap Model for Assessing Learning Processes

    Science.gov (United States)

    Robusto, Egidio; Stefanutti, Luca; Anselmi, Pasquale

    2010-01-01

    Within the theoretical framework of knowledge space theory, a probabilistic skill multimap model for assessing learning processes is proposed. The learning process of a student is modeled as a function of the student's knowledge and of an educational intervention on the attainment of specific skills required to solve problems in a knowledge…

  8. Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review.

    Science.gov (United States)

    Jelovsek, J Eric; Kow, Nathan; Diwadkar, Gouri B

    2013-07-01

    The Accreditation Council for Graduate Medical Education (ACGME) Milestone Project mandates programmes to assess the attainment of training outcomes, including the psychomotor (surgical or procedural) skills of medical trainees. The objectives of this study were to determine which tools exist to directly assess psychomotor skills in medical trainees on live patients and to identify the data indicating their psychometric and edumetric properties. An electronic search was conducted for papers published from January 1948 to May 2011 using the PubMed, Education Resource Information Center (ERIC), Cumulative Index to Nursing and Allied Health Literature (CINAHL) and Web of Science electronic databases and the review of references in article bibliographies. A study was included if it described a tool or instrument designed for the direct observation of psychomotor skills in patient care settings by supervisors. Studies were excluded if they referred to tools that assessed only clinical or non-technical skills, involved non-medical health professionals, or assessed skills performed on a simulator. Overall, 4114 citations were screened, 168 (4.1%) articles were reviewed for eligibility and 51 (1.2%) manuscripts were identified as meeting the study inclusion criteria. Three authors abstracted and reviewed studies using a standardised form for the presence of key psychometric and edumetric elements as per ACGME and American Psychological Association (APA) recommendations, and also assigned an overall grade based on the ACGME Committee on Educational Outcome Assessment grading system. A total of 30 tools were identified. Construct validity based on associations between scores and training level was identified in 24 tools, internal consistency in 14, test-retest reliability in five and inter-rater reliability in 20. The modification of attitudes, knowledge or skills was reported using five tools. The seven-item Global Rating Scale and the Procedure-Based Assessment received an

  9. Development and validation of a new assessment tool for suturing skills in medical students.

    Science.gov (United States)

    Sundhagen, Henriette Pisani; Almeland, Stian Kreken; Hansson, Emma

    2018-01-01

    In recent years, emphasis has been put on that medical student should demonstrate pre-practice/pre-registration core procedural skills to ensure patient safety. Nonetheless, the formal teaching and training of basic suturing skills to medical students have received relatively little attention and there is no standard for what should be tested and how. The aim of this study was to develop and validate, using scientific methods, a tool for assessment of medical students' suturing skills, measuring both micro- and macrosurgical qualities. A tool was constructed and content, construct, concurrent validity, and inter-rater, inter-item, inter-test reliability were tested. Three groups were included: students with no training in suturing skills, students who have had training, plastic surgery. The results show promising reliability and validity when assessing novice medical students' suturing skills. Further studies are needed on implementation of the instrument. Moreover, how the instrument can be used to give formative feedback, evaluate if a required standard is met and for curriculum development needs further investigation.Level of Evidence: Not ratable.

  10. Assessing the Clinical Skills of Dental Students: A Review of the Literature

    Science.gov (United States)

    Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

    2013-01-01

    Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

  11. A Longitudinal Study Assessing the Microsoft Office Skills Course

    Science.gov (United States)

    Carpenter, Donald A.; McGinnis, Denise; Slauson, Gayla Jo; Snyder, Johnny

    2013-01-01

    This paper explains a four-year longitudinal study of the assessment process for a Microsoft Office skills course. It examines whether there is an increase in students' knowledge based on responses to pre- and post-surveys that asked students to evaluate how well they can do particular tasks. Classical classroom teaching methods were used in the…

  12. A mentor-based portfolio program to evaluate pharmacy students' self-assessment skills.

    Science.gov (United States)

    Kalata, Lindsay R; Abate, Marie A

    2013-05-13

    Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students.

  13. The reliability of a modified Kalamazoo Consensus Statement Checklist for assessing the communication skills of multidisciplinary clinicians in the simulated environment.

    Science.gov (United States)

    Peterson, Eleanor B; Calhoun, Aaron W; Rider, Elizabeth A

    2014-09-01

    With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  14. Contribution of Oral Language Skills, Linguistic Skills, and Transcription Skills to Chinese Written Composition among Fourth-Grade Students

    Science.gov (United States)

    Yeung, Pui-sze; Ho, Connie Suk-han; Chan, David Wai-ock; Chung, Kevin Kien-hoa

    2013-01-01

    The present study aimed to investigate the contribution of oral language skills, linguistic skills, and transcription skills to Chinese written composition among Grade 4 students in Hong Kong. Measures assessing verbal working memory, oral language skills, linguistic skills (i.e., syntactic skills and discourse skills), transcription skills (i.e.,…

  15. Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room

    DEFF Research Database (Denmark)

    Aggarwal, R.; Grantcharov, T.; Moorthy, K.

    2008-01-01

    .72). Conclusions: Video-based technical skills evaluation in the operating room is feasible, valid and reliable. Global rating scales hold promise for summative assessment, though further work is necessary to elucidate the value of procedural rating scales Udgivelsesdato: 2008/2......Objective: To determine the feasibility, validity, inter-rater, and intertest reliability of 4 previously published video-based rating scales, for technical skills assessment on a benchmark laparoscopic procedure. Summary Background Data: Assessment of technical skills is crucial...... to the demonstration and maintenance of competent healthcare practitioners. Traditional assessment methods are prone to subjectivity through a lack of proven validity and reliability. Methods: Nineteen surgeons (6 novice and 13 experienced) performed a median of 2 laparoscopic cholecystectomies each (range 1-5) on 53...

  16. Assessing basic life support skills without an instructor: is it possible?

    Directory of Open Access Journals (Sweden)

    Mpotos Nicolas

    2012-07-01

    Full Text Available Abstract Background Current methods to assess Basic Life Support skills (BLS; chest compressions and ventilations require the presence of an instructor. This is time-consuming and comports instructor bias. Since BLS skills testing is a routine activity, it is potentially suitable for automation. We developed a fully automated BLS testing station without instructor by using innovative software linked to a training manikin. The goal of our study was to investigate the feasibility of adequate testing (effectiveness within the shortest period of time (efficiency. Methods As part of a randomised controlled trial investigating different compression depth training strategies, 184 medicine students received an individual appointment for a retention test six months after training. An interactive FlashTM (Adobe Systems Inc., USA user interface was developed, to guide the students through the testing procedure after login, while Skills StationTM software (Laerdal Medical, Norway automatically recorded compressions and ventilations and their duration (“time on task”. In a subgroup of 29 students the room entrance and exit time was registered to assess efficiency. To obtain a qualitative insight of the effectiveness, student’s perceptions about the instructional organisation and about the usability of the fully automated testing station were surveyed. Results During testing there was incomplete data registration in two students and one student performed compressions only. The average time on task for the remaining 181 students was three minutes (SD 0.5. In the subgroup, the average overall time spent in the testing station was 7.5 minutes (SD 1.4. Mean scores were 5.3/6 (SD 0.5, range 4.0-6.0 for instructional organisation and 5.0/6 (SD 0.61, range 3.1-6.0 for usability. Students highly appreciated the automated testing procedure. Conclusions Our automated testing station was an effective and efficient method to assess BLS skills in medicine students

  17. Fostering Dental Students' Academic Achievements and Reflection Skills Through Clinical Peer Assessment and Feedback.

    Science.gov (United States)

    Tricio, Jorge A; Woolford, Mark J; Escudier, Michael P

    2016-08-01

    Peer assessment is increasingly being encouraged to enhance dental students' learning. The aim of this study was to evaluate the educational impact in terms of academic achievements and reflective thinking of a formative prospective peer assessment and feedback protocol. Volunteer final-year dental students at King's College London Dental Institute, UK, received training on peer assessment, peer feedback, and self-reflection. At the beginning (baseline) and end (resultant) of the 2012-13 academic year, 86 students (55% of the year group) completed a reflection questionnaire (RQ). Sixty-eight of those students used a modified Direct Observation of Procedural Skills (DOPS) as a framework for peer assessment and peer feedback during a complete academic year. End-of-year, high-stakes examination grades and RQ scores from the participants and nonparticipants were statistically compared. The participants completed 576 peer DOPS. Those 22 students who peer assessed each other ≥10 times exhibited highly statistically significant differences and powerful positive effect sizes in their high-stakes exam grades (p=0.0001, d=0.74) and critical reflection skills (p=0.005, d=1.41) when compared to those who did not assess one another. Furthermore, only the same 22 students showed a statistically significant increase and positive effect size in their critical reflection skills from baseline to resultant (p=0.003, d=1.04). The results of this study suggest that the protocol used has the potential to impact dental students' academic and reflection skills, provided it is practiced in ten or more peer encounters and ensuring peer feedback is provided followed by self-reflection.

  18. Assessing resident's knowledge and communication skills using four different evaluation tools.

    Science.gov (United States)

    Nuovo, Jim; Bertakis, Klea D; Azari, Rahman

    2006-07-01

    This study assesses the relationship between 4 Accreditation Council for Graduate Medical Education (ACGME) outcome project measures for interpersonal and communication skills and medical knowledge; specifically, monthly performance evaluations, objective structured clinical examinations (OSCEs), the American Board of Family Practice in-training examination (ABFP-ITE) and the Davis observation code (DOC) practice style profiles. Based on previous work, we have DOC scoring for 29 residents from the University of California, Davis Department of Family and Community Medicine. For all these residents we also had the results of monthly performance evaluations, 2 required OSCE exercises, and the results of 3 American Board of Family Medicine (ABFM) ITEs. Data for each of these measures were abstracted for each resident. The Pearson correlation coefficient was used to assess the presence or lack of correlation between each of these evaluation methods. There is little correlation between various evaluation methods used to assess medical knowledge, and there is also little correlation between various evaluation methods used to assess communication skills. The outcome project remains a 'work in progress', with the need for larger studies to assess the value of different assessment measures of resident competence. It is unlikely that DOC will become a useful evaluation tool.

  19. Model of practical skill performance as an instrument for supervision and formative assessment

    DEFF Research Database (Denmark)

    Nielsen, Carsten; Sommer, Irene; Larsen, Karin

    2012-01-01

    as during practice, performance and formative assessment of practical skills learning. It provided a common language about practical skills and enhanced the participants’ understanding of professionalism in practical nursing skill. In conclusion, the model helped to highlight the complexity in mastering......There are still weaknesses in the practical skills of newly graduated nurses. There is also an escalating pressure on existing clinical placements due to increasing student numbers and structural changes in health services. Innovative educational practices and the use of tools that might support...... learning are sparsely researched in the field of clinical education for nursing students. This paper reports on an action research study that promoted and investigated use of The Model of Practical Skill Performance as a learning tool during nursing students’ clinical placement. Clinical supervisors...

  20. The implementation of skill assessment by the educators on the mathematics learning process in senior high school

    Science.gov (United States)

    Lestariani, I.; Sujadi, I.; Pramudya, I.

    2018-03-01

    The purpose of research to describe and know the implementation of skill assessment on the mathematics learning process with the high school mathematics teacher as the subject because it is less fully implemented. This research is the type of the descriptive qualitative method. The data was collecting observation method, interview and documentation. The result showed that on the planning stage of the implementation of skill assessment, there were many teachers who had not prepared all the completeness with various assessment techniques through performance, project and portfolio. The teacher was prepared the list of questions. On the implementation stage, there were many teachers who had not understand the stage of completing the assessment with the appropriate instrument method and development. On the reporting stage, discovered that teachers faced the difficulty on preparing scoring report with the range value. Aside from that, the teachers had not prepared the assessment instrument very well on the planning stage. It can be concluded that the implementation of skill assessment has been implemented but not maximally because educators don’t understand about the skill assessment and the number of instrument that must be prepared before the assessment.

  1. Use of relaxation skills in differentially skilled athletes.

    OpenAIRE

    Kudlackova, K.; Eccles, D. W.; Dieffenbach, K.

    2013-01-01

    Objectives: To examine the use of relaxation skills by differentially skilled athletes in relation to the deliberate practice framework. Design: Differentially skilled athletes completed a survey about their use of relaxation skills. Method: 150 athletes representing three skill levels (recreational, college, and professional) completed the deliberate relaxation for sport survey, which assessed relaxation on three deliberate practice dimensions (relevancy, concentration, and ...

  2. International assessment of functional computer abilities

    OpenAIRE

    Anderson, Ronald E.; Collis, Betty

    1993-01-01

    After delineating the major rationale for computer education, data are presented from Stage 1 of the IEA Computers in Education Study showing international comparisons that may reflect differential priorities. Rapid technological change and the lack of consensus on goals of computer education impedes the establishment of stable curricula for ¿general computer education¿ or computer literacy. In this context the construction of instruments for student assessment remains a challenge. Seeking to...

  3. The Effects of Computer Assisted Instruction Materials on Approximate Number Skills of Students with Dyscalculia

    Science.gov (United States)

    Mutlu, Yilmaz; Akgün, Levent

    2017-01-01

    The aim of this study is to examine the effects of computer assisted instruction materials on approximate number skills of students with mathematics learning difficulties. The study was carried out with pretest-posttest quasi experimental method with a single subject. The participants of the study consist of a girl and two boys who attend 3rd…

  4. Multi-Institutional Validation of an OSATS for the Assessment of Cystoscopic and Ureteroscopic Skills.

    Science.gov (United States)

    Argun, Omer Burak; Chrouser, Kristin; Chauhan, Sanket; Monga, Manoj; Knudsen, Bodo; Box, Geoffrey N; Lee, David I; Gettman, Matthew T; Poniatowski, Lauren H; Wang, Qi; Reihsen, Troy E; Sweet, Robert M

    2015-10-01

    We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  5. Assessment of the potential forecasting skill of a global hydrological model in reproducing the occurrence of monthly flow extremes

    Directory of Open Access Journals (Sweden)

    N. Candogan Yossef

    2012-11-01

    Full Text Available As an initial step in assessing the prospect of using global hydrological models (GHMs for hydrological forecasting, this study investigates the skill of the GHM PCR-GLOBWB in reproducing the occurrence of past extremes in monthly discharge on a global scale. Global terrestrial hydrology from 1958 until 2001 is simulated by forcing PCR-GLOBWB with daily meteorological data obtained by downscaling the CRU dataset to daily fields using the ERA-40 reanalysis. Simulated discharge values are compared with observed monthly streamflow records for a selection of 20 large river basins that represent all continents and a wide range of climatic zones.

    We assess model skill in three ways all of which contribute different information on the potential forecasting skill of a GHM. First, the general skill of the model in reproducing hydrographs is evaluated. Second, model skill in reproducing significantly higher and lower flows than the monthly normals is assessed in terms of skill scores used for forecasts of categorical events. Third, model skill in reproducing flood and drought events is assessed by constructing binary contingency tables for floods and droughts for each basin. The skill is then compared to that of a simple estimation of discharge from the water balance (PE.

    The results show that the model has skill in all three types of assessments. After bias correction the model skill in simulating hydrographs is improved considerably. For most basins it is higher than that of the climatology. The skill is highest in reproducing monthly anomalies. The model also has skill in reproducing floods and droughts, with a markedly higher skill in floods. The model skill far exceeds that of the water balance estimate. We conclude that the prospect for using PCR-GLOBWB for monthly and seasonal forecasting of the occurrence of hydrological extremes is positive. We argue that this conclusion applies equally to other similar GHMs and

  6. Assessment and treatment of planning skills in adolescents with ADHD

    NARCIS (Netherlands)

    Boyer, B.E.

    2016-01-01

    Planning problems are described to be prominent in the daily lives of adolescents with ADHD (Barkley, 2004) and may cause comorbid conditions and impairments (Safren, 2006). Therefore the central aim of this thesis was to assess planning skills of adolescents with ADHD and to investigate whether

  7. Developing 21st Century Skills through Gameplay: To What Extent Are Young People Who Play the Online Computer Game Minecraft Acquiring and Developing Media Literacy and the Four Cs Skills?

    Science.gov (United States)

    Morgan, Mia Lynn

    2015-01-01

    Two questions drove this case study. 1) To what extent does playing the online computer game Minecraft at home in a multiplayer environment impact a player's media literacy skills of analysis, evaluation, and access? 2) To what extent does playing the online computer game Minecraft at home in a multiplayer environment impact a player's 21st…

  8. Quality Improvement Initiative on Pain Knowledge, Assessment, and Documentation Skills of Pediatric Nurses.

    Science.gov (United States)

    Margonary, Heather; Hannan, Margaret S; Schlenk, Elizabeth A

    2017-01-01

    Pain treatment begins with a nurse’s assessment, which relies on effective assessment skills. Hospital settings have implemented pain assessment education, but there is limited evidence in pediatric transitional care settings. The purpose of this quality improvement (QI) initiative was to develop, implement, and evaluate an evidence-based pain education session with 20 nurses in a pediatric specialty hospital that provides transitional care. Specific aims were to assess nurses’ knowledge and attitudes of pain, and evaluate assessment skills based on nurses’ documentation. A prospective pre-post design with three assessments (baseline, post-intervention, and one-month follow-up) was used. The Shriner’s Pediatric Nurses’ Knowledge and Attitudes Regarding Pain questionnaire and an electronic health record review were completed at each assessment. There was significant improvement in nurses’ knowledge and attitudes of pain after the education session (F[2,6] = 50.281, p nurses significantly increased from 43.1% at baseline to 64.8% at post-intervention, and 67.7% at follow-up (χ²[2] = 20.55, p Nursing interventions for pain increased significantly, from 33.3% at baseline to 84.0% at post-intervention, and stabilized at 80.0% at follow-up (χ²[2] = 8.91, p = 0.012). Frequency of pain reassessments did not show a statistically significant change, decreasing from 77.8% at baseline to 44.0% at post-intervention and 40.0% at follow-up (χ²[2]= 3.538, p = 0.171). Nurses’ pain knowledge and documentation of assessment skills were improved in this QI initiative.

  9. Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios.

    Science.gov (United States)

    Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter; Konge, Lars; Rosenberg, Jacob; Oestergaard, Doris

    2013-11-01

    Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training. A 1-day course was conducted for 15 general surgeons in which they rated surgeons' nontechnical skills in 9 video recordings of scenarios simulating real intraoperative situations. Data were gathered from 2 sessions separated by a 4-hour training session. Interrater reliability was high for both pretraining ratings (Cronbach's α = .97) and posttraining ratings (Cronbach's α = .98). There was no statistically significant development in assessment skills. The D study showed that 2 untrained raters or 1 trained rater was needed to obtain generalizability coefficients >.80. The high pretraining interrater reliability indicates that videos were easy to rate and Non-Technical Skills for Surgeons dk easy to use. This implies that Non-Technical Skills for Surgeons dk (NOTSSdk) could be an important tool in surgical training, potentially improving safety and quality for surgical patients. Copyright © 2013 Elsevier Inc. All rights reserved.

  10. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

    Science.gov (United States)

    Nmadu, Teresa M.

    2018-01-01

    Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business

  11. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria.

    Science.gov (United States)

    Asieba, Iyeseun O; Nmadu, Teresa M

    2018-01-01

    Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business performance with money skills, leadership skills and

  12. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

    Directory of Open Access Journals (Sweden)

    Asieba IO

    2018-03-01

    Full Text Available Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974/Herron (1990 Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90% still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03 and stock growth (P=0.04; while stock growth was significantly affected by leadership skills (P=0.002 and entrepreneurial skills (0.02. Net profit was significantly affected by industry skills (P=0.008. Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on

  13. Ophthalmic Skills Assessment of Primary Health Care Workers at ...

    African Journals Online (AJOL)

    Proficiency in the basic ophthalmic skills is a cri cal factor in the effec ve delivery of eye care services at the primary level of care. The aim of the study was to assess the ability of ... out visual acuity test and correctly iden fy cataract and conjunc vi s using pictures of eye condi ons and ..... Medical Laboratory Technician.

  14. TEACHERS’ BELIEFS AND PRACTICES IN ASSESSING THE VIEWING SKILL OF ESL LEARNERS

    Directory of Open Access Journals (Sweden)

    Mari Karen Lebumfacil Gabinete

    2017-05-01

    Full Text Available This study explored the English/Language Arts teachers’ beliefs and practices in teaching and assessing students’ viewing skills in secondary education in the Philippines. Three secondary teachers in three government-run institutions were surveyed, interviewed and observed regarding their conception of visual literacy. The study revealed that teacher belief is influenced by their early education. In addition, teachers’ ability to teach and assess viewing skills relies not only on teacher training but also on access to technology and availability instrutional materials.  The study suggests a call to strengthen school or government support in order to promote viewing comprehension in basic education to meet the demands of the 21st century.

  15. A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

    Science.gov (United States)

    Winkel, Abigail Ford; Lerner, Veronica; Zabar, Sondra R; Szyld, Demian

    2013-01-01

    Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  16. Evidence Regarding Teaching and Assessment of Record-Keeping Skills in Training of Dental Students.

    Science.gov (United States)

    Amos, Kate J; Bearman, Margaret; Palermo, Claire

    2015-10-01

    The aim of this study was to assess the literature on teaching and assessing dental students' record-keeping skills prior to qualification to practice independently as a dentist. A systematic literature review was performed using Ovid MEDLINE and SCOPUS. Keywords used in the search included dental, record, audit, education, and assessment. Electronic search results were screened for publications that targeted undergraduate dental training, related to a record-keeping education intervention, and were published in English and available in full text. Six studies met the inclusion and exclusion criteria. Data extraction and quality assessment were performed, and research findings were compared across the included studies. These six articles addressed the techniques used to teach and assess record-keeping skills in a pre-qualification context. The techniques included supervisor audits, peer audits, lectures, tutorials, research assignments, case reports, record-keeping templates, and checklists of required record components. The use of record audit as part of teaching and evaluation dominated these articles; it was used as the assessment method in five of the six studies. All methods of record-keeping training in studies published to date were found effective in improving student record-keeping skills. However, there was insufficient evidence to determine whether certain methods were more effective than others.

  17. Standardized Patients Provide a Reliable Assessment of Athletic Training Students' Clinical Skills

    Science.gov (United States)

    Armstrong, Kirk J.; Jarriel, Amanda J.

    2016-01-01

    Context: Providing students reliable objective feedback regarding their clinical performance is of great value for ongoing clinical skill assessment. Since a standardized patient (SP) is trained to consistently portray the case, students can be assessed and receive immediate feedback within the same clinical encounter; however, no research, to our…

  18. The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training.

    Science.gov (United States)

    Lladó Grove, Gabriela; Langager Høgh, Annette; Nielsen, Judith; Sandermann, Jes

    2015-01-01

    The concept of the Objective Structured Assessment of Technical Skills (OSATS) is to quantify surgical skills in an objective way and, thereby, produce an additional procedure-specific assessment tool. Since 2005, a 2-day practical course for upcoming specialist registrars in vascular surgery has been obligatory. The aim of this study is to describe the results from a tailored OSATS test as a tool for the evaluation of practical skills during an intensive training session in a simple simulator box for vascular anastomoses. Between 2005 and 2013, we registered the OSATS scores of all course participants. The following data were collected from the questionnaires: years as a candidate, months in vascular surgery or in another type of surgery, and the number of vascular anastomoses performed before the course. The assessment of surgical skills was conducted with an OSATS score template specifically made for this purpose. It consists of a 12-item table with a 5-point grading scale. OSATS score (points) and time for the procedure (OSATS time in min) were registered at baseline (OSATS I) and at the end of the course (OSATS II). OSATS scores were given in both OSATS I and OSATS II for the 83 trainees, and the mean difference was 8.1 points (95% CI: 6.7; 9.5, p technical skills during an intensive practical course in performing vascular anastomoses. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  19. Teaching nursing psychomotor skills in a fundamentals laboratory: a literature review.

    Science.gov (United States)

    McNett, Susan

    2012-01-01

    The aim of this article is to determine the most effective methods of teaching psychomotor skills. Research has pointed to a gap between nursing practice and nursing education. Due to a number of conditions, nursing students are learning basic skills in laboratories, rather than clinical settings. A literature review was conducted to evaluate studies published since 1995 that compared alternative and traditional methods of teaching skills to novice nursing students. Of the 13 studies found, most assessed computer-related methods. A few examined alternatives, such as the use of standardized patients, high-fidelity manikins, and a mental-imaging technique. Based on this limited evidence, it appears that teaching methods providing access to online interactive materials were significantly more effective than others.Three studies found that a combination of traditional lecture and demonstration methods plus computer use was more effective than either method alone.

  20. Customization of a tool to assess Danish surgeons´ non-technical skills in the operating room

    DEFF Research Database (Denmark)

    Spanager, Lene; Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter

    2012-01-01

    Errors in surgery often stem from failure related to non-technical skills such as communication and teamwork. Tools for training and assessment of non-technical skills are needed to ensure safe surgery. The aim of this study was to customize the Non-Technical Skills for Surgeons (NOTSS) rating...

  1. Development of Authentic Assessment instruments for Critical Thinking skills in Global Warming with a Scientific Approach

    Directory of Open Access Journals (Sweden)

    R. Surya Damayanti

    2017-12-01

    Full Text Available This study aims to develop an authentic assessment instrument to measure critical thinking skills in global warming learning and to describe the suitability, easiness, and usefulness of the use instruments which are developed base on the teacher’s opinion.   The development design is carried out by Borg & Gall (2003 development model, which is conducted with seven stages: information gathering stage, planning stage, product development stage, product test stage, product revision stage, field trial stage, and final product. The test subjects are students and teachers in SMA Lampung Tengah by using purposive sampling technique.  Global warming learning using authentic assessment consists of a series of learning activities, including observing, discussing, exploring, associating and communicating.  The results show the authentic assessment techniques global warming to measure and cultivate critical thinking skills consisting of written tests, performance, portfolios, projects, and attitudes.  The developed assessment model meets content and constructs validity, and effectively improves students' critical thinking skills and has a high level of suitability, easiness, and usefulness well-being. The assessment techniques are used in global warming learning are performance assessment techniques, portfolios, projects, products, and attitude that together contribute to the improvement of critical thinking skills on 97,4% of global warming learning.

  2. A multicentre observational study to evaluate a new tool to assess emergency physicians' non-technical skills.

    Science.gov (United States)

    Flowerdew, Lynsey; Gaunt, Arran; Spedding, Jessica; Bhargava, Ajay; Brown, Ruth; Vincent, Charles; Woloshynowych, Maria

    2013-06-01

    To evaluate a new tool to assess emergency physicians' non-technical skills. This was a multicentre observational study using data collected at four emergency departments in England. A proportion of observations used paired observers to obtain data for inter-rater reliability. Data were also collected for test-retest reliability, observability of skills, mean ratings and dispersion of ratings for each skill, as well as a comparison of skill level between hospitals. Qualitative data described the range of non-technical skills exhibited by trainees and identified sources of rater error. 96 assessments of 43 senior trainees were completed. At a scale level, intra-class coefficients were 0.575, 0.532 and 0.419 and using mean scores were 0.824, 0.702 and 0.519. Spearman's ρ for calculating test-retest reliability was 0.70 using mean scores. All skills were observed more than 60% of the time. The skill Maintenance of Standards received the lowest mean rating (4.8 on a nine-point scale) and the highest mean was calculated for Team Building (6.0). Two skills, Supervision & Feedback and Situational Awareness-Gathering Information, had significantly different distributions of ratings across the four hospitals (ptechnical skills, especially in relation to leadership. The framework of skills may be used to identify areas for development in individual trainees, as well as guide other patient safety interventions.

  3. Communication skills assessment in the final postgraduate years to established practice: a systematic review.

    Science.gov (United States)

    Gillis, Amy E; Morris, Marie C; Ridgway, Paul F

    2015-01-01

    Communication breakdown is a factor in the majority of all instances of medical error. Despite the importance, a relative paucity of time is invested in communication skills in postgraduate curricula. Our objective is to systematically review the literature to identify the current tools used to assess communication skills in postgraduate trainees in the latter 2 years of training and in established practice. Two reviewers independently reviewed the literature identifying communication skill assessment tools, for postgraduate trainees in the latter 2 years of training and in established practice following Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, and inclusion/exclusion criteria from January 1990 to 15 August 2014. PubMed/CINAHL/ERIC/EMBASE/PsycInfo/Psyc Articles/Cochrane. 222 articles were identified; after review, 34 articles fulfilled criteria for complete evaluation; the majority (26) had a high level of evidence scoring 3 or greater on the Best Evidence Medical Education guide. 22 articles used objective structured clinical examination/standardised patient (SP)-based formats in an assessment or training capacity. Evaluation tools included author-developed questionnaires and validated tools. Nineteen articles demonstrated an educational initiative. The reviewed literature is heterogeneous for objectives and measurement techniques for communication. Observed interactions, with patients or SPs, is the current favoured method of evaluation using author-developed questionnaires. The role of self-evaluation of skill level is questioned. The need for a validated assessment tool for communication skills is highlighted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  4. The primacy of vital signs--acute care nurses' and midwives' use of physical assessment skills: a cross sectional study.

    Science.gov (United States)

    Osborne, Sonya; Douglas, Clint; Reid, Carol; Jones, Lee; Gardner, Glenn

    2015-05-01

    Registered nurses and midwives play an essential role in detecting patients at risk of deterioration through ongoing assessment and action in response to changing health status. Yet, evidence suggests that clinical deterioration frequently goes unnoticed in hospitalised patients. While much attention has been paid to early warning and rapid response systems, little research has examined factors related to physical assessment skills. To determine a minimum data set of core skills used during nursing assessment of hospitalised patients and identify nurse and workplace predictors of the use of physical assessment to detect patient deterioration. The study used a single-centre, cross-sectional survey design. The study included 434 registered nurses and midwives (Grades 5-7) involved in clinical care of patients on acute care wards, including medicine, surgery, oncology, mental health and maternity service areas, at a 929-bed tertiary referral teaching hospital in Southeast Queensland, Australia. We conducted a hospital-wide survey of registered nurses and midwives using the 133-item Physical Assessment Skills Inventory and the 58-item Barriers to Registered Nurses' Use of Physical Assessment Scale. Median frequency for each physical assessment skill was calculated to determine core skills. To explore predictors of core skill utilisation, backward stepwise general linear modelling was conducted. Means and regression coefficients are reported with 95% confidence intervals. A p value skills used by most nurses every time they worked included assessment of temperature, oxygen saturation, blood pressure, breathing effort, skin, wound and mental status. Reliance on others and technology (F=35.77, pskill use. The increasing acuity of the acute care patient plausibly warrants more than vital signs assessment; however, our study confirms nurses' physical assessment core skill set is mainly comprised of vital signs. The focus on these endpoints of deterioration as dictated by

  5. Using standardized patients to assess communication skills in medical and nursing students.

    Science.gov (United States)

    Ryan, C Anthony; Walshe, Nuala; Gaffney, Robert; Shanks, Andrew; Burgoyne, Louise; Wiskin, Connie M

    2010-03-17

    A number of recent developments in medical and nursing education have highlighted the importance of communication and consultation skills (CCS). Although such skills are taught in all medical and nursing undergraduate curriculums, there is no comprehensive screening or assessment programme of CCS using professionally trained Standardized Patients Educators (SPE's) in Ireland. This study was designed to test the content, process and acceptability of a screening programme in CCS with Irish medical and nursing students using trained SPE's and a previously validated global rating scale for CCS. Eight tutors from the Schools of Nursing and Medicine at University College Cork were trained in the use of a validated communication skills and attitudes holistic assessment tool. A total of forty six medical students (Year 2 of 5) and sixty four nursing students (Year 2/3 of 4) were selected to under go individual CCS assessment by the tutors via an SPE led scenario. Immediate formative feedback was provided by the SPE's for the students. Students who did not pass the assessment were referred for remediation CCS learning. Almost three quarters of medical students (33/46; 72%) and 81% of nursing students (56/64) passed the CCS assessment in both communication and attitudes categories. All nursing students had English as their first language. Nine of thirteen medical students referred for enhanced learning in CCS did not have English as their first language. A significant proportion of both medical and nursing students required referral for enhanced training in CCS. Medical students requiring enhanced training were more likely not to have English as a first language.

  6. Using computer simulation to improve high order thinking skills of physics teacher candidate students in Compton effect

    Science.gov (United States)

    Supurwoko; Cari; Sarwanto; Sukarmin; Fauzi, Ahmad; Faradilla, Lisa; Summa Dewi, Tiarasita

    2017-11-01

    The process of learning and teaching in Physics is often confronted with abstract concepts. It makes difficulty for students to understand and teachers to teach the concept. One of the materials that has an abstract concept is Compton Effect. The purpose of this research is to evaluate computer simulation model on Compton Effect material which is used to improve high thinking ability of Physics teacher candidate students. This research is a case study. The subject is students at physics educations who have attended Modern Physics lectures. Data were obtained through essay test for measuring students’ high-order thinking skills and quisioners for measuring students’ responses. The results obtained indicate that computer simulation model can be used to improve students’ high order thinking skill and can be used to improve students’ responses. With this result it is suggested that the audiences use the simulation media in learning

  7. The assessment of social skills deficits in the elderly.

    Science.gov (United States)

    Furnham, A; Pendleton, D

    1983-01-01

    This paper tested the hypothesis that a sample of elderly people compared to a matched sample of younger people reports an increase in difficulty and social anxiety in dealing with a wide range of everyday social situations. The literature on assertiveness and social skills training with the elderly was first reviewed. Then an assertiveness and social difficulty scale was administered to a group of eighty participants divided by age and sex. It was found that older people experienced less discomfort in situations requiring assertiveness, yet were less likely to respond assertively. Older people reported higher incidence of social anxiety across forty everyday situations. In general females reported more difficulty than males, though there were no interaction effects. The results are discussed in terms of the assessment and training of social skills in the elderly.

  8. Crowd-sourced assessment of technical skills: an adjunct to urology resident surgical simulation training.

    Science.gov (United States)

    Holst, Daniel; Kowalewski, Timothy M; White, Lee W; Brand, Timothy C; Harper, Jonathan D; Sorenson, Mathew D; Kirsch, Sarah; Lendvay, Thomas S

    2015-05-01

    Crowdsourcing is the practice of obtaining services from a large group of people, typically an online community. Validated methods of evaluating surgical video are time-intensive, expensive, and involve participation of multiple expert surgeons. We sought to obtain valid performance scores of urologic trainees and faculty on a dry-laboratory robotic surgery task module by using crowdsourcing through a web-based grading tool called Crowd Sourced Assessment of Technical Skill (CSATS). IRB approval was granted to test the technical skills grading accuracy of Amazon.com Mechanical Turk™ crowd-workers compared to three expert faculty surgeon graders. The two groups assessed dry-laboratory robotic surgical suturing performances of three urology residents (PGY-2, -4, -5) and two faculty using three performance domains from the validated Global Evaluative Assessment of Robotic Skills assessment tool. After an average of 2 hours 50 minutes, each of the five videos received 50 crowd-worker assessments. The inter-rater reliability (IRR) between the surgeons and crowd was 0.91 using Cronbach's alpha statistic (confidence intervals=0.20-0.92), indicating an agreement level between the two groups of "excellent." The crowds were able to discriminate the surgical level, and both the crowds and the expert faculty surgeon graders scored one senior trainee's performance above a faculty's performance. Surgery-naive crowd-workers can rapidly assess varying levels of surgical skill accurately relative to a panel of faculty raters. The crowds provided rapid feedback and were inexpensive. CSATS may be a valuable adjunct to surgical simulation training as requirements for more granular and iterative performance tracking of trainees become mandated and commonplace.

  9. A Mentor-Based Portfolio Program to Evaluate Pharmacy Students’ Self-Assessment Skills

    Science.gov (United States)

    Kalata, Lindsay R.

    2013-01-01

    Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students. PMID:23716749

  10. Communication Skills Training in Ophthalmology: Results of a Needs Assessment and Pilot Training Program.

    Science.gov (United States)

    Mishra, Anuradha; Browning, David; Haviland, Miriam J; Jackson, Mary Lou; Luff, Donna; Meyer, Elaine C; Talcott, Katherine; Kloek, Carolyn E

    To conduct a needs assessment to identify gaps in communication skills training in ophthalmology residency programs and to use these results to pilot a communication workshop that prepares residents for difficult conversations. A mixed-methods design was used to perform the needs assessment. A pre-and postsurvey was administered to workshop participants. Mass Eye and Ear Infirmary, Harvard Medical School (HMS), Department of Ophthalmology. HMS ophthalmology residents from postgraduate years 2-4 participated in the needs assessment and the workshop. Ophthalmology residency program directors in the United States participated in national needs assessment. Ophthalmology program directors across the United States were queried on their perception of resident communication skills training through an online survey. A targeted needs assessment in the form of a narrative exercise captured resident perspectives on communication in ophthalmology from HMS residents. A group of HMS residents participated in the pilot workshop and a pre- and postsurvey was administered to participants to assess its effectiveness. The survey of program directors yielded a response rate of 40%. Ninety percent of respondents agreed that the communication skills training in their programs could be improved. Fifteen of 24 residents (62%) completed the needs assessment. Qualitative analysis of the narrative material revealed four themes; (1) differing expectations, (2) work role and environment, (3) challenges specific to ophthalmology, and (4) successful strategies adopted. Nine residents participated in the workshop. There was a significant improvement post-workshop in resident reported scores on their ability to manage their emotions during difficult conversations (p = 0.03). There is an opportunity to improve communication skills training in ophthalmology residency through formalized curriculum. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights

  11. Teaching and Assessing Manipulative Motor Skills in High School Physical Education

    Science.gov (United States)

    Bert, Greg

    2015-01-01

    This article provides new ways to teach and assess motor skills in various lifetime sports such as tennis, golf, badminton, and other sports that students are likely to play as adults by focusing on five basic biomechanical principles.

  12. Differences Between Japanese and U.S. Children's Performance on "Zoo U": A Game-Based Social Skills Assessment.

    Science.gov (United States)

    Craig, Ashley B; DeRosier, Melissa E; Watanabe, Yayoi

    2015-08-01

    The purpose of this study was to test whether and how performance on a digital game-based social skills assessment tool, "Zoo U" (3C Institute, Durham, NC), differed for children in the United States and Japan across six core social skills. "Zoo U" was administered to 497 third and fourth grade children from the United States and Japan (46 percent Japanese) by teachers and researchers, respectively. U.S. children received the original version of "Zoo U," and Japanese children received a fully translated Japanese version of the program. Scoring of each of the six social skills is built into the "Zoo U" software, with specific scoring algorithms for each grade level that provide both a continuous scale score and cutoffs for three distinct performance categories: high, average, and low. A multivariate analysis of variance (MANOVA) was conducted to assess differences by cultural group on each of the six continuous social skill scores, controlling for gender and grade level. Results revealed significant differences on four of the six skills in expected directions. Chi-squared and odds ratios analyses were then conducted on the assignment of children into each of the performance categories by cultural group, revealing additional nuance to the cultural differences identified in the MANOVA consistent with existing literature. We were able to replicate known cultural differences between U.S. and Japanese children with a simple direct translation of a Web-based social skills assessment game, "Zoo U." Our results provide preliminary support for the potential of game-based assessment methods to provide efficient and valid social skill assessments to children around the world.

  13. Using Oral Exams to Assess Communication Skills in Business Courses

    Science.gov (United States)

    Burke-Smalley, Lisa A.

    2014-01-01

    Business, like many other fields in higher education, continues to rely largely on conventional testing methods for assessing student learning. In the current article, another evaluation approach--the oral exam--is examined as a means for building and evaluating the professional communication and oral dialogue skills needed and utilized by…

  14. Alternative Assessment--Can Real-World Skills Be Tested? Policy Briefs.

    Science.gov (United States)

    Simon, Karen; Gregg, Soleil

    Many educators are shifting their teaching strategies and approaches to include more emphasis on critical thinking skills, the communication of ideas, a variety of approaches to content emphasizing varied student learning styles, and the need to draw explicit connections among topics for retention of learning. Real-world assessment measures, then,…

  15. Trait Based Assessment on Teaching Writing Skill for EFL Learners

    Science.gov (United States)

    Asrobi, Maman; Prasetyaningrum, Ari

    2017-01-01

    This study was conducted in order to investigate the effectiveness of trait based assessment on teaching writing skill for EFL learners. Designed as pre-experimental study with one group pretest and posttest design, it examined 20 students of the second semester of English Department of "Hamzanwadi University" in the academic year…

  16. Teaching Thinking Skills in Context-Based Learning: Teachers' Challenges and Assessment Knowledge

    Science.gov (United States)

    Avargil, Shirly; Herscovitz, Orit; Dori, Yehudit Judy

    2012-04-01

    For an educational reform to succeed, teachers need to adjust their perceptions to the reform's new curricula and strategies and cope with new content, as well as new teaching and assessment strategies. Developing students' scientific literacy through context-based chemistry and higher order thinking skills was the framework for establishing a new chemistry curriculum for Israeli high school students. As part of this endeavor, we developed the Taste of Chemistry module, which focuses on context-based chemistry, chemical understanding, and higher order thinking skills. Our research objectives were (a) to identify the challenges and difficulties chemistry teachers faced, as well as the advantages they found, while teaching and assessing the Taste of Chemistry module; and (b) to investigate how they coped with teaching and assessing thinking skills that include analyzing data from graphs and tables, transferring between multiple representations and, transferring between chemistry understanding levels. Research participants included eight teachers who taught the module. Research tools included interviews, classroom observations, teachers-designed students' assignments, and developers-designed students' assignments. We documented different challenges teachers had faced while teaching the module and found that the teachers developed different ways of coping with these challenges. Developing teachers' assessment knowledge (AK) was found to be the highest stage in teachers' professional growth, building on teachers' content knowledge (CK), pedagogy knowledge (PK), and pedagogical-content knowledge (PCK). We propose the use of assignments designed by teachers as an instrument for determining their professional growth.

  17. Computer-Based Phonological Skills Training for Primary Students with Mild to Moderate Dyslexia--A Pilot Study

    Science.gov (United States)

    Blythe, John M.

    2006-01-01

    This pilot study investigated the efficacy of "Phonics Alive 2: The Sound Blender", a computer-based phonological skills training program, delivered with both at-home and at-school components over a 10-week period, as a potential treatment of phonological dyslexia. Participants were 20 dyslexic primary students with an average delay of…

  18. Assessment of Preschool Early Literacy Skills: Linking Children's Educational Needs with Empirically Supported Instructional Activities.

    Science.gov (United States)

    Lonigan, Christopher J; Allan, Nicholas P; Lerner, Matthew D

    2011-05-01

    The importance of the preschool period for becoming a skilled reader is highlighted by a significant body of evidence that preschool children's development in the areas of oral language, phonological awareness, and print knowledge is predictive of how well they will learn to read once they are exposed to formal reading instruction in elementary school. Although there are now a number of empirically supported instructional activities for helping children who are at -risk of later reading difficulties acquire these early literacy skills, limitations in instructional time and opportunities in most preschool settings requires the use of valid assessment procedures to ensure that instructional resources are utilized efficiently. In this paper, we discuss the degree to which informal, diagnostic, screening, and progress-monitoring assessments of preschool early literacy skills can inform instructional decisions by considering the strengths and weaknesses of each approach to assessment.

  19. Fundamental movement skills and habitual physical activity in young children.

    Science.gov (United States)

    Fisher, Abigail; Reilly, John J; Kelly, Louise A; Montgomery, Colette; Williamson, Avril; Paton, James Y; Grant, Stan

    2005-04-01

    To test for relationships between objectively measured habitual physical activity and fundamental movement skills in a relatively large and representative sample of preschool children. Physical activity was measured over 6 d using the Computer Science and Applications (CSA) accelerometer in 394 boys and girls (mean age 4.2, SD 0.5 yr). Children were scored on 15 fundamental movement skills, based on the Movement Assessment Battery, by a single observer. Total physical activity (r=0.10, Pmovement skills score. Time spent in light-intensity physical activity was not significantly correlated with motor skills score (r=0.02, P>0.05). In this sample and setting, fundamental movement skills were significantly associated with habitual physical activity, but the association between the two variables was weak. The present study questions whether the widely assumed relationships between motor skills and habitual physical activity actually exist in young children.

  20. Improving oral hygiene skills by computer-based training: a randomized controlled comparison of the modified Bass and the Fones techniques.

    Directory of Open Access Journals (Sweden)

    Daniela Harnacke

    Full Text Available BACKGROUND: Gingivitis and other plaque-associated diseases have a high prevalence in western communities even though the majority of adults report daily oral hygiene. This indicates a lack of oral hygiene skills. Currently, there is no clear evidence as to which brushing technique would bring about the best oral hygiene skills. While the modified Bass technique is often recommended by dentists and in textbooks, the Fones technique is often recommended in patient brochures. Still, standardized comparisons of the effectiveness of teaching these techniques are lacking. METHODOLOGY/PRINCIPAL FINDINGS: In a final sample of n = 56 students, this multidisciplinary, randomized, examiner-blinded, controlled study compared the effects of parallel and standardized interactive computer presentations teaching either the Fones or the modified Bass technique. A control group was taught the basics of tooth brushing alone. Oral hygiene skills (remaining plaque after thorough oral hygiene and gingivitis were assessed at baseline and 6, 12, and 28 weeks after the intervention. We found a significant group×time interaction for gingivitis (F(4/102 = 3.267; p = 0.016; ε = 0.957; η(2 = 0.114 and a significant main effect of group for oral hygiene skills (F(2/51 = 7.088; p = 0.002; η(2 = 0.218. Fones was superior to Bass; Bass did not differ from the control group. Group differences were most prominent after 6 and 12 weeks. CONCLUSIONS/SIGNIFICANCE: The present trial indicates an advantage of teaching the Fones as compared to the modified Bass technique with respect to oral hygiene skills and gingivitis. Future studies are needed to analyze whether the disadvantage of teaching the Bass technique observed here is restricted to the teaching method employed. TRIAL REGISTRATION: German Clinical Trials Register DRKS00003488.