The assessment of practical skills

OpenAIRE

Reiss, M. J.; Abrahams, I.

2015-01-01

Major changes are currently afoot as to how practical work will be assessed in high status examinations (GCSEs for 16 year-olds and ‘A’ levels for 18 year-olds) in England. We explore here how practical skills might best be assessed in school science and introduce two terms: direct assessment of practical skills (DAPS) and indirect assessment of practical skills (IAPS). We conclude that both the direct and indirect assessment of practical skills have their place in effective assessment of sch...

Innovative integrative bedside teaching model improves tutors’ self-assessments of teaching skills and attitudes

Directory of Open Access Journals (Sweden)

Itai Gat

2016-02-01

Full Text Available Introduction: Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST practiced during tutor training workshop and its resulting effect on practitioners’ self assessment of teaching skills and perceptions. Methods: One-day tutor training workshop included theoretical knowledge supplementation regarding tutors’ roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Results: Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5 compared with pre-training (mean 2.6, SD 0.6; p<0.001 with significant increase in most examined parameters. Significantly improved tutor's roles internalization was demonstrated after training completion (mean 3.7, SD 0.3 compared with pre-workshop (mean 3.5 SD 0.5; p=0.002. Discussion: Successful BST involves combination of clinical and communication skills. BST model practiced during the workshop may contribute to improved teaching skills in this challenging environment.

Validation of a global assessment of arthroscopic skills in a cadaveric knee model.

Science.gov (United States)

Slade Shantz, Jesse A; Leiter, Jeff R; Collins, John B; MacDonald, Peter B

2013-01-01

The purpose of this study was to determine whether a global assessment of arthroscopic skills was valid for blinded assessment of cadaveric diagnostic knee arthroscopy. A global skills assessment for arthroscopy was created using a published theory of the development of expertise. Faculty surgeons, fellows, and residents were consented and enrolled in this institutional review board-approved validation study. All participants were oriented to the equipment and procedures for diagnostic arthroscopy of the knee. After reviewing the anatomic structures to be visualized, participants were allowed 10 minutes to complete a diagnostic arthroscopy of the knee. The hands and arthroscopic view were recorded during this attempt. Resident participants completed a second filmed diagnostic arthroscopy 1 week after the initial attempt. Five blinded reviewers watched the synchronized videos and assessed arthroscopic skills with a procedure-specific checklist and the newly developed global skills assessment. The agreement between reviewers was determined by intraclass correlation coefficient. Internal consistency was determined with Cronbach's α. Test-retest reliability was measured by correlating repeated arthroscopies by residents. The ability of the global assessment to discriminate skill levels was determined with between-group Mann-Whitney U tests. The agreement between global assessment scores was strong (I.C.C. = 0.80, 95% C.I. 0.68-0.92). The internal consistency of evaluations was excellent (Cronbach's α = 0.97), and the test-retest reliability was strong (r = 0.52). The global assessment score was shown to be able to discriminate between skill levels by an analysis of variance indicating the difference in means among the various levels of training (P Assessment of Arthroscopic Skills is a useful adjunct to arthroscopic educators and learners and could be used for in-training evaluations. The Objective Assessment of Arthroscopic Skills is an instrument that can be

The assessment of mindfulness skills: the "what" and the "how".

Science.gov (United States)

Iani, Luca; Lauriola, Marco; Cafaro, Valentina

2017-10-06

The five facets mindfulness questionnaire-short form (FFMQ-SF) is a new, brief measure for the assessment of mindfulness skills in clinical and nonclinical samples. The construct validity of the FFMQ-SF has not been previously assessed in community samples. The present study investigated the factor structure of the Italian version of the FFMQ-SF. Structured equation modeling was used to test the fit of three alternative models in a sample of highly educated adults (n = 211). A hierarchical model with a single second-order factor loaded by observing, describing, and acting with awareness (i.e. the mindfulness "what" skills) performed slightly better than both a five-factor model with correlated factors and a hierarchical model with a general second-order factor. The FFMQ-SF scores were significantly higher than those reported in both Dutch depressed patients and Australian undergraduate students for all facets (but nonreactivity for the Australian sample). Data support the multifaceted nature of mindfulness skills. Because of its brevity and simplicity of use, the FFMQ-SF is a promising questionnaire in longitudinal and clinical research. This questionnaire can serve as a guideline to help clinicians assess and monitor mindfulness skills acquisition, strengthening, and generalization, and prioritize mindfulness skills that need immediate attention.

Training and Assessment of Hysteroscopic Skills: A Systematic Review.

Science.gov (United States)

Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars; Tolsgaard, Martin G; Bjerrum, Flemming

2016-01-01

The aim of this systematic review was to identify studies on hysteroscopic training and assessment. PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%). This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Employability Skills Assessment: Measuring Work Ethic for Research and Learning

Science.gov (United States)

Park, HwaChoon; Hill, Roger B.

2016-01-01

The Employability Skills Assessment (ESA) was developed by Hill (1995) to provide an alternative measure of work ethic needed for success in employment. This study tested goodness-of-fit for a model used to interpret ESA results. The model had three factors: interpersonal skills, initiative, and dependability. Confirmatory factor analysis results…

Goodness of Fit of Skills Assessment Approaches: Insights from Patterns of Real vs. Synthetic Data Sets

Science.gov (United States)

Beheshti, Behzad; Desmarais, Michel C.

2015-01-01

This study investigates the issue of the goodness of fit of different skills assessment models using both synthetic and real data. Synthetic data is generated from the different skills assessment models. The results show wide differences of performances between the skills assessment models over synthetic data sets. The set of relative performances…

MOVEMENT SKILL ASSESSMENT OF TYPICALLY DEVELOPING PRESCHOOL CHILDREN: A REVIEW OF SEVEN MOVEMENT SKILL ASSESSMENT TOOLS

Directory of Open Access Journals (Sweden)

Wouter Cools

2009-06-01

Full Text Available The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children.

Employability Skills Assessment Tool Development

Science.gov (United States)

Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

2012-01-01

Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

Communication skills training: describing a new conceptual model.

Science.gov (United States)

Brown, Richard F; Bylund, Carma L

2008-01-01

Current research in communication in physician-patient consultations is multidisciplinary and multimethodological. As this research has progressed, a considerable body of evidence on the best practices in physician-patient communication has been amassed. This evidence provides a foundation for communication skills training (CST) at all levels of medical education. Although the CST literature has demonstrated that communication skills can be taught, one critique of this literature is that it is not always clear which skills are being taught and whether those skills are matched with those being assessed. The Memorial Sloan-Kettering Cancer Center Comskil Model for CST seeks to answer those critiques by explicitly defining the important components of a consultation, based on Goals, Plans, and Actions theories and sociolinguistic theory. Sequenced guidelines as a mechanism for teaching about particular communication challenges are adapted from these other methods. The authors propose that consultation communication can be guided by an overarching goal, which is achieved through the use of a set of predetermined strategies. Strategies are common in CST; however, strategies often contain embedded communication skills. These skills can exist across strategies, and the Comskil Model seeks to make them explicit in these contexts. Separate from the skills are process tasks and cognitive appraisals that need to be addressed in teaching. The authors also describe how assessment practices foster concordance between skills taught and those assessed through careful coding of trainees' communication encounters and direct feedback.

Two Reading Assessments for Youth in Alternative Basic Skills and Livelihood Skills Training Programs

Science.gov (United States)

Comings, John P.; Strucker, John; Bell, Brenda

2017-01-01

This article describes two assessment tools that have been used to assess the reading skills of youth participating in alternative basic skills and livelihood skills training programs. The Rapid Assessment of Reading Skills (RARS) was developed to identify potential participants who needed to improve their reading skills before beginning training…

Training Self-Regulated Learning Skills with Video Modeling Examples: Do Task-Selection Skills Transfer?

Science.gov (United States)

Raaijmakers, Steven F.; Baars, Martine; Schaap, Lydia; Paas, Fred; van Merriënboer, Jeroen; van Gog, Tamara

2018-01-01

Self-assessment and task-selection skills are crucial in self-regulated learning situations in which students can choose their own tasks. Prior research suggested that training with video modeling examples, in which another person (the model) demonstrates and explains the cyclical process of problem-solving task performance, self-assessment, and…

Clinical skills assessment of procedural and advanced communication skills: performance expectations of residency program directors

Science.gov (United States)

Langenau, Erik E.; Zhang, Xiuyuan; Roberts, William L.; DeChamplain, Andre F.; Boulet, John R.

2012-01-01

Background High stakes medical licensing programs are planning to augment and adapt current examinations to be relevant for a two-decision point model for licensure: entry into supervised practice and entry into unsupervised practice. Therefore, identifying which skills should be assessed at each decision point is critical for informing examination development, and gathering input from residency program directors is important. Methods Using data from previously developed surveys and expert panels, a web-delivered survey was distributed to 3,443 residency program directors. For each of the 28 procedural and 18 advanced communication skills, program directors were asked which clinical skills should be assessed, by whom, when, and how. Descriptive statistics were collected, and Intraclass Correlations (ICC) were conducted to determine consistency across different specialties. Results Among 347 respondents, program directors reported that all advanced communication and some procedural tasks are important to assess. The following procedures were considered ‘important’ or ‘extremely important’ to assess: sterile technique (93.8%), advanced cardiovascular life support (ACLS) (91.1%), basic life support (BLS) (90.0%), interpretation of electrocardiogram (89.4%) and blood gas (88.7%). Program directors reported that most clinical skills should be assessed at the end of the first year of residency (or later) and not before graduation from medical school. A minority were considered important to assess prior to the start of residency training: demonstration of respectfulness (64%), sterile technique (67.2%), BLS (68.9%), ACLS (65.9%) and phlebotomy (63.5%). Discussion Results from this study support that assessing procedural skills such as cardiac resuscitation, sterile technique, and phlebotomy would be amenable to assessment at the end of medical school, but most procedural and advanced communications skills would be amenable to assessment at the end of the first

Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

Science.gov (United States)

Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

2009-01-01

The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: K�

Self-perceived assessment skill of prospective physics teachers

Science.gov (United States)

Efendi, R.; Rustaman, N. Y.; Kaniawati, I.

2018-05-01

Assessment skills are an important component of assessment practice, without adequate assessment skills it is unlikely that teacher assessment practices will produce desired student learning outcomes. This study was conducted to reveal self-perceived assessment skills of prospective physics teachers by using quantitative descriptive analysis, and involving 92 prospective physics teachers who were experiencing teaching practice in junior high school and final project related to assessment. Data was collected by using Self-Perceived Assessment Science Skills Questionnaire consisted of 29 items related seven assessment competencies was developed and used in the study. Internal consistency reliability coefficient for the total scale scores was 0.87 as measured by Cronbach’s alpha. Determination of self-perceived assessment science skills detected from prospective physics teachers was carried out in descriptive statistics, in the form of respondent average values. Research findings show that self-perceived assessment skills of prospective physics teachers was categorized as transition.

Crowd-sourced assessment of technical skills: an opportunity for improvement in the assessment of laparoscopic surgical skills.

Science.gov (United States)

Deal, Shanley B; Lendvay, Thomas S; Haque, Mohamad I; Brand, Timothy; Comstock, Bryan; Warren, Justin; Alseidi, Adnan

2016-02-01

Objective, unbiased assessment of surgical skills remains a challenge in surgical education. We sought to evaluate the feasibility and reliability of Crowd-Sourced Assessment of Technical Skills. Seven volunteer general surgery interns were given time for training and then testing, on laparoscopic peg transfer, precision cutting, and intracorporeal knot-tying. Six faculty experts (FEs) and 203 Amazon.com Mechanical Turk crowd workers (CWs) evaluated 21 deidentified video clips using the Global Objective Assessment of Laparoscopic Skills validated rating instrument. Within 19 hours and 15 minutes we received 662 eligible ratings from 203 CWs and 126 ratings from 6 FEs over 10 days. FE video ratings were of borderline internal consistency (Krippendorff's alpha = .55). FE ratings were highly correlated with CW ratings (Pearson's correlation coefficient = .78, P Assessment of Technical Skills as a reliable, basic tool to standardize the evaluation of technical skills in general surgery. Copyright © 2016 Elsevier Inc. All rights reserved.

Following the Template: Transferring Modeling Skills to Nonstandard Problems

Science.gov (United States)

Tyumeneva, Yu. A.; Goncharova, M. V.

2017-01-01

This study seeks to analyze how students apply a mathematical modeling skill that was previously learned by solving standard word problems to the solution of word problems with nonstandard contexts. During the course of an experiment involving 106 freshmen, we assessed how well they were able to transfer the mathematical modeling skill that is…

Training self-assessment and task-selection skills to foster self-regulated learning: Do trained skills transfer across domains?

Science.gov (United States)

Raaijmakers, Steven F; Baars, Martine; Paas, Fred; van Merriënboer, Jeroen J G; van Gog, Tamara

2018-01-01

Students' ability to accurately self-assess their performance and select a suitable subsequent learning task in response is imperative for effective self-regulated learning. Video modeling examples have proven effective for training self-assessment and task-selection skills, and-importantly-such training fostered self-regulated learning outcomes. It is unclear, however, whether trained skills would transfer across domains. We investigated whether skills acquired from training with either a specific, algorithmic task-selection rule or a more general heuristic task-selection rule in biology would transfer to self-regulated learning in math. A manipulation check performed after the training confirmed that both algorithmic and heuristic training improved task-selection skills on the biology problems compared with the control condition. However, we found no evidence that students subsequently applied the acquired skills during self-regulated learning in math. Future research should investigate how to support transfer of task-selection skills across domains.

Development of a patient-doctor communication skills model for medical students.

Science.gov (United States)

Lee, Young Hee; Lee, Young-Mee

2010-09-01

Communication is a core clinical skill that can be taught and learned. The authors intended to develop a patient-doctor communication model for teaching and assessing undergraduate medical students in Korea. To develop a model, literature reviews and an iterative process of discussion between faculty members of a communication skills course for second year medical students were conducted. The authors extracted common communication skill competencies by comparing the Kalamazoo Consensus Statement, SEGUE framework communication skills, the Calgary Cambridge Observation Guides, and previous communication skills lists that have been used by the authors. The content validity, with regard to clinical importance and feasibility, was surveyed by both faculty physicians and students. The first version of the model consisted of 36 items under 7 categories: initiating the session (8 items), building a relationship (6), gathering information (8), understanding a patient's perspectives (4), sharing information (4), reaching an agreement (3), and closing the session (3). It was used as a guide for both students and teachers in an actual communication skills course. At the end of the course, student performance was assessed using two 7-minute standardized patient interviews with a 34-item checklist. This assessment tool was modified from the first version of the model to reflect the case specificity of the scenarios. A patient-doctor communication model, which can be taught to those with limited patient care experience, was finally developed. We recommended a patient-doctor communication skills model that can be used for teaching and evaluating preclinical and clinical students. Further studies are needed to verify its validity and reliability.

Automated surgical skill assessment in RMIS training.

Science.gov (United States)

Zia, Aneeq; Essa, Irfan

2018-05-01

Manual feedback in basic robot-assisted minimally invasive surgery (RMIS) training can consume a significant amount of time from expert surgeons' schedule and is prone to subjectivity. In this paper, we explore the usage of different holistic features for automated skill assessment using only robot kinematic data and propose a weighted feature fusion technique for improving score prediction performance. Moreover, we also propose a method for generating 'task highlights' which can give surgeons a more directed feedback regarding which segments had the most effect on the final skill score. We perform our experiments on the publicly available JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) and evaluate four different types of holistic features from robot kinematic data-sequential motion texture (SMT), discrete Fourier transform (DFT), discrete cosine transform (DCT) and approximate entropy (ApEn). The features are then used for skill classification and exact skill score prediction. Along with using these features individually, we also evaluate the performance using our proposed weighted combination technique. The task highlights are produced using DCT features. Our results demonstrate that these holistic features outperform all previous Hidden Markov Model (HMM)-based state-of-the-art methods for skill classification on the JIGSAWS dataset. Also, our proposed feature fusion strategy significantly improves performance for skill score predictions achieving up to 0.61 average spearman correlation coefficient. Moreover, we provide an analysis on how the proposed task highlights can relate to different surgical gestures within a task. Holistic features capturing global information from robot kinematic data can successfully be used for evaluating surgeon skill in basic surgical tasks on the da Vinci robot. Using the framework presented can potentially allow for real-time score feedback in RMIS training and help surgical trainees have more focused training.

Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

Science.gov (United States)

Schmidt, Jessica N; Kendall, John; Smalley, Courtney

2015-11-01

Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.

Assessment of Surgical Skills and Competency.

Science.gov (United States)

Bhatti, Nasir I

2017-10-01

Evaluation of surgical skills and competency are important aspects of the medical education process. Measurable and reproducible methods of assessment with objective feedback are essential components of surgical training. Objective Structured Assessment of Technical Skills (OSATS) is widely used across the medical specialties and otolaryngology-specific tools have been developed and validated for sinus and mastoid surgery. Although assessment of surgical skills can be time-consuming and requires human and financial resources, new evaluation methods and emerging technology may alleviate these barriers while also improving data collection practices. Copyright © 2017 Elsevier Inc. All rights reserved.

Improving visual skills: II-remote assessment via Internet.

Science.gov (United States)

Powers, Maureen K; Grisham, J David; Wurm, Janice K; Wurm, William C

2009-02-01

Even though poor readers often have poor visual skills, such as binocular coordination and oculomotor control, students' visual skills are rarely assessed. Computer assessments have the potential to assist in identifying students whose visual skills are deficient. This study compared assessments made by an Internet-based computer orthoptics program with those of an on-site vision therapist. Students (N = 41) in grades 1 through 8, reading at least 2 levels below grade, were assessed for visual skill dysfunction (including binocular fusion and tracking ability) by a vision therapist at their school in Wisconsin. The therapist determined whether the student had adequate visual skills based on clinical and behavioral observations. A "remote" investigator located in California determined the adequacy of accommodative facility, tracking, and vergence skills in the same students, based on quantitative progress through the modules of an Internet-based computer orthoptics training program during 3 assessment sessions. The on-site therapist made 33 referrals for possible visual skills training (80%). The remote investigator made 25 referrals (61%), all of which were consistent with referrals made by the on-site therapist; thus, no false-positives occurred when using the remote assessment technique. The 8 additional referrals by the therapist were attributed to the ability to observe student behavior during assessment. Remote assessment of visual skills via an Internet orthoptics program may provide a simple means to detect visual skill problems experienced by poor readers.

Assessing Trainee Surgeons’ Nontechnical Skills

DEFF Research Database (Denmark)

Spanager, Lene; Konge, Lars; Dieckmann, Peter

2015-01-01

BACKGROUND: Trainee surgeons would benefit from regular, formative assessments to ensure they learn the nontechnical aspects of surgical performance. Non-Technical Skills for Surgeons in Denmark (NOTSSdk) is a tool to assess surgeons' nontechnical skills (NTS) during an operation. The aims...... of this study were to explore which parts of NOTSSdk supervisors use to assess trainee surgeons' NTS, to determine the internal consistency reliability of NOTSSdk, and to estimate how many operations were needed to obtain reliable ratings of a trainee surgeon's NTS. METHODS: A total of 12 supervisors from 2...

Teacher Assessment of Practical Skills in A-Level Chemistry

Science.gov (United States)

Wood, R.; Ferguson, Carolyn M.

1975-01-01

Discusses a two-year assessment undertaken to evaluate the Nuffield A-Level chemistry course. Secondary teachers selected chemistry experiments for assessment purposes and assessed their students in manipulative skills, observational skills, interpretation skills, creative skills, and attitudes. (MLH)

Government services: sector skills assessment 2012

OpenAIRE

Parry, Jon; Ojo, Adegbola

2012-01-01

The aim of this report is to provide authoritative labour market intelligence (LMI) for the Government Services sector to inform the strategic decision making of national governments in the development of employment and skills policy. It is one of 15 UK Sector Skills Assessment (SSA) reports produced by Sector Skills Councils and the UK Commission for Employment and Skills.

Validation of the Danish version of the McGill Ingestive Skills Assessment using classical test theory and the Rasch model

DEFF Research Database (Denmark)

Hansen, Tina; Lambert, Heather C; Faber, Jens

2012-01-01

Purpose: The study aimed to validate the Danish version of the Canadian the "McGill Ingestive Skills Assessment" (MISA-DK) for measuring dysphagia in frail elders. Method: One-hundred and ten consecutive older medical patients were recruited to the study. Reliability was assessed by internal...... consistency (Chronbach's alpha). External construct validity (convergent and known-groups validity) was evaluated against theoretical constructs assessing the complex concept of ingestive skills. Internal construct validity was tested using Rasch analysis. Results: High internal consistency reliability...... with Chronbach's alpha of 0.77-0.95 was evident. External construct validity was supported by expected high correlations with most of the constructs related to ingestive skills (r(s)¿=¿0.53 to r(s)¿=¿0.66). The MISA-DK discriminated significantly between known-groups. Fit to the Rasch model (x(2) (df)¿=¿12 (12...

Enabling performance skills: Assessment in engineering education

Science.gov (United States)

Ferrone, Jenny Kristina

Current reform in engineering education is part of a national trend emphasizing student learning as well as accountability in instruction. Assessing student performance to demonstrate accountability has become a necessity in academia. In newly adopted criterion proposed by the Accreditation Board for Engineering and Technology (ABET), undergraduates are expected to demonstrate proficiency in outcomes considered essential for graduating engineers. The case study was designed as a formative evaluation of freshman engineering students to assess the perceived effectiveness of performance skills in a design laboratory environment. The mixed methodology used both quantitative and qualitative approaches to assess students' performance skills and congruency among the respondents, based on individual, team, and faculty perceptions of team effectiveness in three ABET areas: Communications Skills. Design Skills, and Teamwork. The findings of the research were used to address future use of the assessment tool and process. The results of the study found statistically significant differences in perceptions of Teamwork Skills (p performance skills, such as teamwork, among freshman engineering students; (2) incorporate feedback into the learning process; (3) strengthen the assessment process with a follow-up plan that specifically targets performance skill deficiencies, and (4) integrate the assessment instrument and practice with ongoing curriculum development. The findings generated by this study provides engineering departments engaged in assessment activity, opportunity to reflect, refine, and develop their programs as it continues. It also extends research on ABET competencies of engineering students in an under-investigated topic of factors correlated with team processes, behavior, and student learning.

Peer Assessment of Elementary Science Teaching Skills

Science.gov (United States)

Kilic, Gulsen Bagci; Cakan, Mehtap

2007-01-01

In this study, peer assessment was applied in assessing elementary science teaching skills. Preservice teachers taught a science topic as a team to their peers in an elementary science methods course. The peers participating in the science lesson assessed teacher-groups' elementary science teaching skills on an assessment form provided by the…

Clinical Skills Assessment in the Twenty-First Century.

Science.gov (United States)

Elder, Andrew

2018-05-01

Clinical skills remain fundamental to the practice of medicine and form a core component of the professional identity of the physician. However, evidence exists to suggest that the practice of some clinical skills is declining, particularly in the United States. A decline in practice of any skill can lead to a decline in its teaching and assessment, with further decline in practice as a result. Consequently, assessment not only drives learning of clinical skills, but their practice. This article summarizes contemporary approaches to clinical skills assessment that, if more widely adopted, could support the maintenance and reinvigoration of bedside clinical skills. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

Teaching and Assessing Engineering Professional Skills

Directory of Open Access Journals (Sweden)

Ali M. Al-Bahi

2013-05-01

Full Text Available Engineering students are required to have, by the time of graduation, a set of professional skills related to teamwork, oral and written communications, impact of engineering solutions, life-long learning, and knowledge of contemporary issues. Teaching and assessment of these skills, as part of ABET accreditation, remains problematic. A systematic methodology to integrate these skills and their assessment in the curriculum is described. The method was recently applied in several engineering programs and proved to be efficient in generating data and evidences for evaluation and continuous improvement of these outcomes.

PENGEMBANGAN MODEL PEMBELAJARAN SOFT SKILLS DAN HARD SKILLS UNTUK SISWA SMK

OpenAIRE

Widarto Noto Widodo, Pardjono

2013-01-01

Abstrak: Pengembangan Model Pembelajaran Soft Skills dan Hard Skills untuk Siswa SMK. Era global menuntut sumber daya manusia yang memiliki daya saing, adaptif dan antisipatif, mampu belajar, terampil, mudah beradaptasi dengan teknologi baru. Profil tenaga kerja yang dibutuhkan pasar adalah yang kuat pada aspek soft skills dan hard skills. Ada tiga alternatif model pendidikan yang memadukan hard skills dan soft skills, yaitu (1) aspek soft skills dan hard skills dilaksanakan di sekolah; (2) a...

Critical Emergency Medicine Procedural Skills: A Comparative Study of Methods for Teaching and Assessment.

Science.gov (United States)

Chapman, Dane M.; And Others

Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

Assessment of professional engineering skills - define, monitor and assess

DEFF Research Database (Denmark)

Andersson, Niclas; Andersson, Pernille Hammar

2012-01-01

, professional engineering skills need to be included in the syllabus of engineering courses and study programs, which in turn call for the implementation of learning objectives, teaching activities as well as methods for assessing the professional performance of the engineering students. The implicit...... life experience from industry and consequently, they might have limited knowledge about professional skills which of course delimits their ability to evaluate the students’ professional performance. The objective of this study is to design and test a method to assess professional skills...... in an engineering teaching context. A suggested approach, based on the three consecutive steps of Define – Monitor – Assess, was applied and tested in an engineering course in which the students and professional engineers from industry interacted in an extensive role play simulation. The students’ were actively...

Does Computer-Based Motor Skill Assessment Training Transfer to Live Assessing?

Science.gov (United States)

Kelly, Luke E.; Taliaferro, Andrea; Krause, Jennifer

2012-01-01

Developing competency in motor skill assessment has been identified as a critical need in physical educator preparation. We conducted this study to evaluate (a) the effectiveness of a web-based instructional program--Motor Skill Assessment Program (MSAP)--for developing assessment competency, and specifically (b) whether competency developed by…

Assessment of technical and nontechnical skills in surgical residents.

Science.gov (United States)

Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

2016-11-01

Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

Technical skills assessment toolbox: a review using the unitary framework of validity.

Science.gov (United States)

Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

2015-02-01

The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

Training and Assessment of Hysteroscopic Skills

DEFF Research Database (Denmark)

Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars

2016-01-01

OBJECTIVE: The aim of this systematic review was to identify studies on hysteroscopic training and assessment. DESIGN: PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies...... on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study...... outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. RESULTS: A total of 25 studies on hysteroscopy training were identified...

Accuracy of young male drivers’ self-assessments of driving skill

DEFF Research Database (Denmark)

Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

2017-01-01

Accurate self-assessment of skill is important because it creates an appropriate level of confidence and hence behaviour. Inaccurate self-assessment of driving ability has been linked to reckless driving and accidents. Inaccurate self-assessment of driving skills may be a contributing factor...... to the over-representation of young male drivers in accident statistics. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aims of this study were: (1) to test the accuracy of young male drivers’ self......-assessments of specific driving skills by comparing them with performance in a driving simulator; (2) to test whether self-assessment accuracy varied with driving skill, driving experience and sensation-seeking propensity. We found that young male drivers’ self-assessments were inconsistent with their driving performance...

Technical and Technological Skills Assessment in Laparoscopic Surgery

Science.gov (United States)

Chang, Avril; Vincent, Charles

2006-01-01

Objectives: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. Methods: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each operation blindly and independently on DVD. The technological skills were assessed in the operating room. Results: One hundred operations were analyzed. Eight trainees and 10 consultant surgeons were recruited. No adverse events occurred due to technical or technological skills. Mean interrater reliability was kappa=0.88, P=technical and technological skills between trainee and consultant surgeons were significant, Mann-Whitney P=technical and technological skills can be measured to assess performance of laparoscopic surgeons. This technical and technological assessment tool for laparoscopic surgery seems to have face, content, concurrent, and construct validities and could be modified and applied to any laparoscopic operation. The tool has the possibility of being used in surgical training and appraisal. We aim to modify and apply this tool to advanced laparoscopic operations. PMID:17212881

Basic Laparoscopic Skills Assessment Study: Validation and Standard Setting among Canadian Urology Trainees.

Science.gov (United States)

Lee, Jason Y; Andonian, Sero; Pace, Kenneth T; Grober, Ethan

2017-06-01

As urology training programs move to a competency based medical education model, iterative assessments with objective standards will be required. To develop a valid set of technical skills standards we initiated a national skills assessment study focusing initially on laparoscopic skills. Between February 2014 and March 2016 the basic laparoscopic skill of Canadian urology trainees and attending urologists was assessed using 4 standardized tasks from the AUA (American Urological Association) BLUS (Basic Laparoscopic Urological Surgery) curriculum, including peg transfer, pattern cutting, suturing and knot tying, and vascular clip applying. All performances were video recorded and assessed using 3 methods, including time and error based scoring, expert global rating scores and C-SATS (Crowd-Sourced Assessments of Technical Skill Global Rating Scale), a novel, crowd sourced assessment platform. Different methods of standard setting were used to develop pass-fail cut points. Six attending urologists and 99 trainees completed testing. Reported laparoscopic experience and training level correlated with performance (p standard setting methods to define pass-fail cut points for all 4 AUA BLUS tasks. The 4 AUA BLUS tasks demonstrated good construct validity evidence for use in assessing basic laparoscopic skill. Performance scores using the novel C-SATS platform correlated well with traditional time-consuming methods of assessment. Various standard setting methods were used to develop pass-fail cut points for educators to use when making formative and summative assessments of basic laparoscopic skill. Copyright © 2017 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

Science.gov (United States)

Zhao, Bin; Zhang, Bo

2018-02-01

Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called "double-penalty" problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.

Metrics for Objective Assessment of Surgical Skills Workshop

National Research Council Canada - National Science Library

Satava, Richard

2001-01-01

On 9-10 July, 2001 the Metrics for Objective Assessment of Surgical Skills Workshop convened an international assemblage of subject matter experts in objective assessment of surgical technical skills...

Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.

Science.gov (United States)

Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa

2017-04-01

The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

Non-technical skills assessment in surgery.

Science.gov (United States)

Sharma, Bharat; Mishra, Amit; Aggarwal, Rajesh; Grantcharov, Teodor P

2011-09-01

Adverse events in surgery have highlighted the importance of non-technical skills, such as communication, decision-making, teamwork, situational awareness and leadership, to effective organizational performance. These skills carry particular importance to surgical oncology, as members of a multidisciplinary team must work cohesively to formulate effective patient care plans. Several non-technical skills evaluation tools have been developed for use in surgery, without adequate comparison and consensus on which should be standard for training. Eleven articles describing the use of three non-technical evaluation tools related to surgery: NOTSS (Non Technical Skills for Surgeons), NOTECHS (Non Technical Skills) and OTAS (Observational Teamwork Assessment for Surgery) were analyzed with respect to scale formulation, validity, reliability and feasibility. Furthermore, their use in training thus far and the future of non-technical rating scales in surgical curricula was discussed. Future work should focus on incorporating these assessment tools into training and into a real operating room setting to provide formative evaluations for surgical residents. Copyright © 2010 Elsevier Ltd. All rights reserved.

The development and validation of measures to assess cooking skills and food skills.

Science.gov (United States)

Lavelle, Fiona; McGowan, Laura; Hollywood, Lynsey; Surgenor, Dawn; McCloat, Amanda; Mooney, Elaine; Caraher, Martin; Raats, Monique; Dean, Moira

2017-09-02

With the increase use of convenience food and eating outside the home environment being linked to the obesity epidemic, the need to assess and monitor individuals cooking and food skills is key to help intervene where necessary to promote the usage of these skills. Therefore, this research aimed to develop and validate a measure for cooking skills and one for food skills, that are clearly described, relatable, user-friendly, suitable for different types of studies, and applicable across all sociodemographic levels. Two measures were developed in light of the literature and expert opinion and piloted for clarity and ease of use. Following this, four studies were undertaken across different cohorts (including a sample of students, both 'Food preparation novices' and 'Experienced food preparers', and a nationally representative sample) to assess temporal stability, psychometrics, internal consistency reliability and construct validity of both measures. Analysis included T-tests, Pearson's correlations, factor analysis, and Cronbach's alphas, with a significance level of 0.05. Both measures were found to have a significant level of temporal stability (P cooking skills confidence measure ranged from 0.78 to 0.93 across all cohorts. The food skills confidence measure's Cronbach's alpha's ranged from 0.85 to 0.94. The two measures also showed a high discriminate validity as there were significant differences (P cooking skills confidence and P cooking skills confidence measure and the food skills confidence measure have been shown to have a very satisfactory reliability, validity and are consistent over time. Their user-friendly applicability make both measures highly suitable for large scale cross-sectional, longitudinal and intervention studies to assess or monitor cooking and food skills levels and confidence.

Assessing students' communication skills: validation of a global rating.

Science.gov (United States)

Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

2008-12-01

Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

Assessment of psychomotor skills acquisition during laparoscopic cholecystectomy courses.

Science.gov (United States)

Hance, Julian; Aggarwal, Rajesh; Moorthy, Krishna; Munz, Yaron; Undre, Shabnam; Darzi, Ara

2005-09-01

Standardized short courses in laparoscopic cholecystectomy aim to teach laparoscopic skills to surgical trainees, although end-of-course assessments of performance remain subjective. The current study aims to objectively assess psychomotor skills acquisition of trainees attending laparoscopic cholecystectomy courses. Thirty-seven junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate 2-day courses (A, B, and C), all with identical format. Assessments were comprised of a standardized simulated laparoscopic task, with performance measured using a valid electromagnetic hand-motion tracking device. Overall, trainees made significant improvements in path length (P=.006), number of movements (Ppsychomotor skills on courses. In addition to providing participants with an insight into their skills, these data can be used to demonstrate course efficacy.

Ability-versus skill-based assessment of emotional intelligence.

Science.gov (United States)

Bradberry, Travis R; Su, Lac D

2006-01-01

Emotional intelligence has received an intense amount of attention in leadership circles during the last decade and continuing debate exists concerning the best method for measuring this construct. This study analyzed leader emotional intelligence scores, measured via skill and ability methodologies, against leader job performance. Two hundred twelve employees from three organizations participated in this study. Scores on the Emotional Intelligence Appraisal, a skill-based assessment, were positively, though not significantly, correlated with scores on the MSCEIT, an ability-based assessment of emotional intelligence. Scores on the MSCEIT did not have a significant relationship with job performance in this study, whereas, scores on the Emotional Intelligence Appraisal had a strong link to leader job performance. The four subcomponents of the Emotional Intelligence Appraisal were examined against job performance. Relationship management was a stronger predictor of leader job performance than the other three subcomponents. Social awareness was the single emotional intelligence skill that did not have a significant link to leader job performance. Factor analyses yielded a two-component model of emotional intelligence encompassing personal and social competence, rather than confirmation of a four-part taxonomy.

Assessment of summer rainfall forecast skill in the Intra-Americas in GFDL high and low-resolution models

Science.gov (United States)

Krishnamurthy, Lakshmi; Muñoz, Ángel G.; Vecchi, Gabriel A.; Msadek, Rym; Wittenberg, Andrew T.; Stern, Bill; Gudgel, Rich; Zeng, Fanrong

2018-05-01

The Caribbean low-level jet (CLLJ) is an important component of the atmospheric circulation over the Intra-Americas Sea (IAS) which impacts the weather and climate both locally and remotely. It influences the rainfall variability in the Caribbean, Central America, northern South America, the tropical Pacific and the continental Unites States through the transport of moisture. We make use of high-resolution coupled and uncoupled models from the Geophysical Fluid Dynamics Laboratory (GFDL) to investigate the simulation of the CLLJ and its teleconnections and further compare with low-resolution models. The high-resolution coupled model FLOR shows improvements in the simulation of the CLLJ and its teleconnections with rainfall and SST over the IAS compared to the low-resolution coupled model CM2.1. The CLLJ is better represented in uncoupled models (AM2.1 and AM2.5) forced with observed sea-surface temperatures (SSTs), emphasizing the role of SSTs in the simulation of the CLLJ. Further, we determine the forecast skill for observed rainfall using both high- and low-resolution predictions of rainfall and SSTs for the July-August-September season. We determine the role of statistical correction of model biases, coupling and horizontal resolution on the forecast skill. Statistical correction dramatically improves area-averaged forecast skill. But the analysis of spatial distribution in skill indicates that the improvement in skill after statistical correction is region dependent. Forecast skill is sensitive to coupling in parts of the Caribbean, Central and northern South America, and it is mostly insensitive over North America. Comparison of forecast skill between high and low-resolution coupled models does not show any dramatic difference. However, uncoupled models show improvement in the area-averaged skill in the high-resolution atmospheric model compared to lower resolution model. Understanding and improving the forecast skill over the IAS has important implications

Challenge Course Facilitator Technical Skills Assessment Tool Mark

Science.gov (United States)

Wagstaff, William Quinn

2007-01-01

A study was conducted to develop a technical skills assessment tool for the training and development of challenge course facilitators. Researchers accessed two professional on-line listserves to collect a sample size of twenty-seven currently used technical skills assessment tools. The assessment tools were critically analysed by three independent…

Designing an Automated Assessment of Public Speaking Skills Using Multimodal Cues

Science.gov (United States)

Chen, Lei; Feng, Gary; Leong, Chee Wee; Joe, Jilliam; Kitchen, Christopher; Lee, Chong Min

2016-01-01

Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and human rating were conducted according to standards in educational assessment. An initial corpus of…

Brief Report: Suitability of the Social Skills Performance Assessment (SSPA) for the Assessment of Social Skills in Adults with Autism Spectrum Disorders

Science.gov (United States)

Verhoeven, E. W. M.; Smeekens, I.; Didden, R.

2013-01-01

The present study aims at examining whether the "Social Skills Performance Assessment" (SSPA; Patterson et al. in "Schizophr Res" 48(2-3):351-360, 2001) is a suitable performance-based measure to assess social skills in adults with autism spectrum disorders (ASD). For this purpose, social skills of individuals with ASD and…

Arthroscopic skills assessment and use of box model for training in arthroscopic surgery using Sawbones – “FAST” workstation

Directory of Open Access Journals (Sweden)

Goyal Saumitra

2016-01-01

Full Text Available Purpose: Arthroscopic skills training outside the operative room may decrease risks and errors by trainee surgeons. There is a need of simple objective method for evaluating proficiency and skill of arthroscopy trainees using simple bench model of arthroscopic simulator. The aim of this study is to correlate motor task performance to level of prior arthroscopic experience and establish benchmarks for training modules. Methods: Twenty orthopaedic surgeons performed a set of tasks to assess a arthroscopic triangulation, b navigation, c object handling and d meniscus trimming using SAWBONES “FAST” arthroscopy skills workstation. Time to completion and the errors were computed. The subjects were divided into four levels; “Novice”, “Beginner”, “Intermediate” and “Advanced” based on previous arthroscopy experience, for analyses of performance. Results: The task performance under transparent dome was not related to experience of the surgeon unlike opaque dome, highlighting the importance of hand-eye co-ordination required in arthroscopy. Median time to completion for each task improved as the level of experience increased and this was found to be statistically significant (p 85% of subjects across all the levels reported improvement in performance with sequential tasks. Conclusion: Use of the arthroscope requires visuo-spatial coordination which is a skill that develops with practice. This simple box model can reliably differentiate the arthroscopic skills based on experience and can be used to monitor progression of skills of trainees in institutions.

Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.

Science.gov (United States)

Guru, Khurshid A; Esfahani, Ehsan T; Raza, Syed J; Bhat, Rohit; Wang, Katy; Hammond, Yana; Wilding, Gregory; Peabody, James O; Chowriappa, Ashirwad J

2015-01-01

To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons. In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics. Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups. Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS. © 2014 The Authors. BJU International © 2014 BJU International.

Designing Cognitively Diagnostic Assessment for Algebraic Content Knowledge and Thinking Skills

Science.gov (United States)

Zhang, Zhidong

2018-01-01

This study explored a diagnostic assessment method that emphasized the cognitive process of algebra learning. The study utilized a design and a theory-driven model to examine the content knowledge. Using the theory driven model, the thinking skills of algebra learning was also examined. A Bayesian network model was applied to represent the theory…

Assessment of the critical thinking skills of student radiographers

Energy Technology Data Exchange (ETDEWEB)

Castle, Alan [University of Portsmouth, Centre for Radiography Education, St George' s Building, Portsmouth PO1 2HY (United Kingdom)]. E-mail: alan.castle@port.ac.uk

2006-05-15

Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills.

Assessment of the critical thinking skills of student radiographers

International Nuclear Information System (INIS)

Castle, Alan

2006-01-01

Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills

The effectiveness of the Geritalk communication skills course: a real-time assessment of skill acquisition and deliberate practice.

Science.gov (United States)

Gelfman, Laura P; Lindenberger, Elizabeth; Fernandez, Helen; Goldberg, Gabrielle R; Lim, Betty B; Litrivis, Evgenia; O'Neill, Lynn; Smith, Cardinale B; Kelley, Amy S

2014-10-01

Communication skills are critical in Geriatrics and Palliative Medicine because these patients confront complex clinical scenarios. We evaluated the effectiveness of the Geritalk communication skills course by comparing pre- and post-course real-time assessment of the participants leading family meetings. We also evaluated the participants' sustained skills practice. We compare the participants' skill acquisition before and after Geritalk using a direct observation Family Meeting Communication Assessment Tool and assess their deliberate practice at follow-up. First-year Geriatrics or Palliative Medicine fellows at Mount Sinai Medical Center and the James J. Peters Bronx VA Medical Center participated in Geritalk. Pre- and post-course family meeting assessments were compared. An average net gain of 6.8 skills represented a greater than 20% improvement in use of applicable skills. At two month follow-up, most participants reported deliberate practice of fundamental and advanced skills. This intensive training and family meeting assessment offers evidence-based communication skills training. Published by Elsevier Inc.

Teamwork Skills Assessment for Cooperative Learning

Science.gov (United States)

Strom, Paris S.; Strom, Robert D.

2011-01-01

Teamwork skills are required at work, but teacher efforts in many countries to track achievement within this context have been hindered by lack of assessment tools and input from students. The Teamwork Skills Inventory relies on peer and self-evaluation to establish accountability, identify competencies, and detect learning needs. Twenty-five…

Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

Science.gov (United States)

Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

2016-07-01

To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

Assessment of prediction skill in equatorial Pacific Ocean in high resolution model of CFS

Science.gov (United States)

Arora, Anika; Rao, Suryachandra A.; Pillai, Prasanth; Dhakate, Ashish; Salunke, Kiran; Srivastava, Ankur

2018-01-01

The effect of increasing atmospheric resolution on prediction skill of El Niño southern oscillation phenomenon in climate forecast system model is explored in this paper. Improvement in prediction skill for sea surface temperature (SST) and winds at all leads compared to low resolution model in the tropical Indo-Pacific basin is observed. High resolution model is able to capture extreme events reasonably well. As a result, the signal to noise ratio is improved in the high resolution model. However, spring predictability barrier (SPB) for summer months in Nino 3 and Nino 3.4 region is stronger in high resolution model, in spite of improvement in overall prediction skill and dynamics everywhere else. Anomaly correlation coefficient of SST in high resolution model with observations in Nino 3.4 region targeting boreal summer months when predicted at lead times of 3-8 months in advance decreased compared its lower resolution counterpart. It is noted that higher variance of winds predicted in spring season over central equatorial Pacific compared to observed variance of winds results in stronger than normal response on subsurface ocean, hence increases SPB for boreal summer months in high resolution model.

Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills

Science.gov (United States)

Rudd, James R.; Barnett, Lisa M.; Butson, Michael L.; Farrow, Damian; Berry, Jason; Polman, Remco C. J.

2015-01-01

Introduction In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children’s competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2). Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill. Method The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA) was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling. Results Three postural control tasks were selected (the log roll, rock and back support) because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p < .05). Inter rater reliability tests were excellent for all three skills (ICC = 0.81, 0.87, 0.87) as was test re-test reliability (ICC 0.87–0.95). CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88), object control (r = .76) and stability skills (r = .81). Discussion This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children’s fundamental movement skills. PMID:26468644

Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills.

Science.gov (United States)

Rudd, James R; Barnett, Lisa M; Butson, Michael L; Farrow, Damian; Berry, Jason; Polman, Remco C J

2015-01-01

In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children's competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2). Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill. The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA) was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling. Three postural control tasks were selected (the log roll, rock and back support) because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p skills (ICC = 0.81, 0.87, 0.87) as was test re-test reliability (ICC 0.87-0.95). CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88), object control (r = .76) and stability skills (r = .81). This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children's fundamental movement skills.

Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills.

Directory of Open Access Journals (Sweden)

James R Rudd

Full Text Available In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children's competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2. Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill.The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling.Three postural control tasks were selected (the log roll, rock and back support because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p < .05. Inter rater reliability tests were excellent for all three skills (ICC = 0.81, 0.87, 0.87 as was test re-test reliability (ICC 0.87-0.95. CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88, object control (r = .76 and stability skills (r = .81.This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children's fundamental movement skills.

Assessing Business Student Thinking Skills

Science.gov (United States)

Smith, Gerald F.

2014-01-01

The development of student thinking skills is a major goal of business education. As with other such goals, student outcomes assessment must be undertaken to measure goal achievement. Thinking is difficult to teach; it is also difficult to assess. The purpose of this article is to improve management educators' understanding of student thinking…

Implementing and Evaluating a National Certification Technical Skills Examination: The Colorectal Objective Structured Assessment of Technical Skill.

Science.gov (United States)

de Montbrun, Sandra; Roberts, Patricia L; Satterthwaite, Lisa; MacRae, Helen

2016-07-01

To implement the Colorectal Objective Structured Assessment of Technical skill (COSATS) into American Board of Colon and Rectal Surgery (ABCRS) certification and build evidence of validity for the interpretation of the scores of this high stakes assessment tool. Currently, technical skill assessment is not a formal component of board certification. With the technical demands of surgical specialties, documenting competence in technical skill at the time of certification with a valid tool is ideal. In September 2014, the COSATS was a mandatory component of ABCRS certification. Seventy candidates took the examination, with their performance evaluated by expert colorectal surgeons using a task-specific checklist, global rating scale, and overall performance scale. Passing scores were set and compared using 2 standard setting methodologies, using a compensatory and conjunctive model. Inter-rater reliability and the reliability of the pass/fail decision were calculated using Cronbach alpha and Subkoviak methodology, respectively. Overall COSATS scores and pass/fail status were compared with results on the ABCRS oral examination. The pass rate ranged from 85.7% to 90%. Inter-rater reliability (0.85) and reliability of the pass/fail decision (0.87 and 0.84) were high. A low positive correlation (r= 0.25) was seen between the COSATS and oral examination. All individuals who failed the COSATS passed the ABCRS oral examination. COSATS is the first technical skill examination used in national surgical board certification. This study suggests that the current certification process may be failing to identify individuals who have demonstrated technical deficiencies on this standardized assessment tool.

Uncovering the Best Skill Multimap by Constraining the Error Probabilities of the Gain-Loss Model

Science.gov (United States)

Anselmi, Pasquale; Robusto, Egidio; Stefanutti, Luca

2012-01-01

The Gain-Loss model is a probabilistic skill multimap model for assessing learning processes. In practical applications, more than one skill multimap could be plausible, while none corresponds to the true one. The article investigates whether constraining the error probabilities is a way of uncovering the best skill assignment among a number of…

Measurement Model of Reasoning Skills among Science Students Based on Socio Scientific Issues (SSI

Directory of Open Access Journals (Sweden)

MOHD AFIFI BAHURUDIN SETAMBAH

2018-05-01

Full Text Available The lack of reasoning skills has been recognized as one of the contributing factors to the declined achievement in the Trends in Mathematics and Science Studies (TIMSS and Programme for International Student Assessment (PISA assessments in Malaysia. The use of socio-scientific issues (SSI as a learning strategy offers the potential of improving the level of students' reasoning skills and consequently improves students’ achievement in science subjects. This study examined the development of a measurement model of reasoning skills among science students based on SSI using the analysis of moment structure (AMOS approach before going to second level to full structured equation modelling (SEM. A total of 450 respondents were selected using a stratified random sampling. Results showed a modified measurement model of reasoning skills consisting of the View Knowledge (VK was as a main construct. The items that measure the level of pre-reflection of students fulfilled the elements of unidimensionality, validity, and reliability. Although the level of student reasoning skills was still low but this development of measurement model could be identified and proposed teaching methods that could be adopted to improve students’ reasoning skills.

The use of advanced physical assessment skills by cardiac nurses.

Science.gov (United States)

Edmunds, Linda; Ward, Susan; Barnes, Rhian

To establish what advanced physical assessment skills are being used by cardiac nurses after they undertook a clinical patient assessment module; and to explore the factors that influence their use of these skills. A longitudinal descriptive approach using convenience sampling was employed. Qualitative data was obtained from individual interviews, non-participant observation within the participants' clinical environment and self-reported activity logs. Five key themes emerged: use of advanced physical assessment skills varied; use and development of skills was linked to personal characteristics; use influenced by perceptions of role boundaries, permission and cooperation; use influenced by participants' perception of nursing and the development of their own nursing practice; and use influenced by the physical environment and the human support within it. Cardiac nurses selectively use physical assessment skills, predominately related to the cardiorespiratory systems. Organisational structure, professional relationships and the professionalism of the individual nurse appear to play a significant part in the use of physical assessment skills. Although the findings from this qualitative study cannot be generalized, they concur with findings from recent research into physical assessment skills used by a variety of UK nurses. The implications identified are: first, for those who provide the education, in terms of what should be taught and facilitated; and second, for organizations, in ensuring staff have assessment skills relevant to their role and that systems are in place to enable the development of a supportive and progressive culture that embraces modernization congruent with healthcare policy.

Video-based intervention for children with autism: towards improved assessment of pre-requisite imitation skills.

Science.gov (United States)

Rayner, Christopher

2015-04-01

To explore the relationship between responses to imitation assessment and video-based intervention (VBI) in children with autism. Interview- and observation-based imitation assessments were conducted for five boys with autism prior to VBI across three studies. In two of the three studies, the boys' imitative responses to videos with an animated model and a human model were also compared. Participants who were assessed to have strong imitation skills were also those who responded more positively to VBI. No clear differences were reported in the boys' responses to the equivalent videos with the animated model and the human model. The level of imitation skills required for successful VBI is relative to the target behaviour. Revision of existing imitation assessment measures, as well as development and validation of more comprehensive measures is warranted for use in conjunction with VBI.

Comparison between young male drivers' self-assessed and objectively measured driving skills

DEFF Research Database (Denmark)

Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

2017-01-01

Self-assessment of skills is a self-generated feedback process that contributes to confidence in one's skills. The higher one's self-assessed skills, the more likely one is to feel competent a particular domain thereby influencing the related behaviors. Drivers' self-assessed driving skills...... are not always accurate, which may cause serious problems such as underestimation of risk, reckless driving and accidents. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aim of this study was to test the accuracy...

Meningkatkan Hard Skills dan Soft Skills Siswa melalui Model Pembelajaran Koooperatif Tipe Stad

OpenAIRE

Alfiansyah, Muhammad; Jamal, M. Arifuddin; An'nur, Syubhan

2014-01-01

Penelitian ini secara umum bertujuan untuk mendeskripsikan keefektifan model pembelajaran kooperatif tipe STAD dalam meningkatkan hard skills dan soft skills siswa SMAN 8 Barabai pada pokok bahasan fluida statis. Secara khusus untuk mendeskripsikan keterlaksanaan RPP model kooperatif tipe STAD, hard skills siswa, soft skills siswa dan respon siswa. Metode penelitian yang digunakan merupakan penelitian tindakan kelas model Kemmis dan Mc Taggart. Hasil penelitian menunjukkan bahwa terjadi pen...

A Procedural Skills OSCE: Assessing Technical and Non-Technical Skills of Internal Medicine Residents

Science.gov (United States)

Pugh, Debra; Hamstra, Stanley J.; Wood, Timothy J.; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

2015-01-01

Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

Further validation of the Danish version of the McGill Ingestive Skills Assessment (MISA-DK)

DEFF Research Database (Denmark)

Hansen, Tina

2014-01-01

Background/aims The McGill Ingestive Skill Assessment (MISA) for measuring dysphagic patients' functional performance during meals has been previously translated into Danish — the Danish McGill Ingestive Skill Assessment (MISA-DK) and this translated version validated. However, issues about......-DK was then tested using 102 videorecordings of geriatric patients' ingestive skill performance, and the data from the scale were examined using a second Rasch analysis. Results Initially, two of the six proposed subscales of the original MISA-DK failed to fit the Rasch model, and were removed. It was also necessary...

A Preliminary Investigation of General and Technique-specific Assessments for the Evaluation of Laparoscopic Technical Skills.

Science.gov (United States)

Vergis, Ashley; Steigerwald, Sarah

2017-10-07

Background  Both general and technique-specific assessments of technical skill have been validated in surgical education. The purpose of this study was to assess the correlation between the objective structured assessment of technical skills (OSATS) and the global operative assessment of laparoscopic skills (GOALS) rating scales using a high-fidelity porcine laparoscopic cholecystectomy model. Methods Post-graduate year-one general surgery and urology residents (n=14) performed a live laparoscopic porcine cholecystectomy. Trained surgeons rated their performance using OSATS and GOALS assessment scales. Results Pearson's correlation coefficient between OSATS and GOALS was 0.96 for overall scores. It ranged from 0.78 - 0.89 for domains that overlapped between the two scales. Conclusion There is a very high correlation between OSATS and GOALS. This implies that they likely measure similar constructs and that either may be used for summative-type assessments of trainee skill. However, further investigation is needed to determine if technique-specific assessments may provide more useful feedback in formative evaluation.

Prerequisite Skills That Support Learning through Video Modeling

Science.gov (United States)

MacDonald, Rebecca P. F.; Dickson, Chata A.; Martineau, Meaghan; Ahearn, William H.

2015-01-01

The purpose of this study was to evaluate the relationship between tasks that require delayed discriminations such as delayed imitation and delayed matching to sample on acquisition of skills using video modeling. Twenty-nine participants with an ASD diagnosis were assessed on a battery of tasks including both immediate and delayed imitation and…

Development of Authentic Assessment instruments for Critical Thinking skills in Global Warming with a Scientific Approach

Directory of Open Access Journals (Sweden)

R. Surya Damayanti

2017-12-01

Full Text Available This study aims to develop an authentic assessment instrument to measure critical thinking skills in global warming learning and to describe the suitability, easiness, and usefulness of the use instruments which are developed base on the teacher’s opinion.   The development design is carried out by Borg & Gall (2003 development model, which is conducted with seven stages: information gathering stage, planning stage, product development stage, product test stage, product revision stage, field trial stage, and final product. The test subjects are students and teachers in SMA Lampung Tengah by using purposive sampling technique.  Global warming learning using authentic assessment consists of a series of learning activities, including observing, discussing, exploring, associating and communicating.  The results show the authentic assessment techniques global warming to measure and cultivate critical thinking skills consisting of written tests, performance, portfolios, projects, and attitudes.  The developed assessment model meets content and constructs validity, and effectively improves students' critical thinking skills and has a high level of suitability, easiness, and usefulness well-being. The assessment techniques are used in global warming learning are performance assessment techniques, portfolios, projects, products, and attitude that together contribute to the improvement of critical thinking skills on 97,4% of global warming learning.

Cross-platform digital assessment forms for evaluating surgical skills

Directory of Open Access Journals (Sweden)

Steven Arild Wuyts Andersen

2015-04-01

Full Text Available A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database containing the digital assessment forms, because this software has cross-platform functionality on both desktop computers and handheld devices. The database is hosted online, and the rating forms can therefore also be accessed through most modern web browsers. Cross-platform digital assessment forms were developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion, digital assessment forms can be used for the structured rating of surgical skills and have the potential to be especially useful in complex assessment situations with multiple raters, repeated assessments in various times and locations, and situations requiring substantial subsequent data processing or complex score calculations.

Setting pass scores for clinical skills assessment.

Science.gov (United States)

Liu, Min; Liu, Keh-Min

2008-12-01

In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

A comparison of students' self-assessments with faculty evaluations of their communication skills.

Science.gov (United States)

Lundquist, Lisa M; Shogbon, Angela O; Momary, Kathryn M; Rogers, Hannah K

2013-05-13

To compare students' self-assessment of their communication skills with faculty members' formal evaluation of their skills in a therapeutics course. Over a 3-year period, faculty members evaluated second-year pharmacy students' communication skills as part of a requirement in a therapeutics course. Immediately following an individual oral assessment and again following a group oral assessment, students self-assessed their communication skills using the same rubric the faculty members had used. Students' self-assessments were then compared with faculty members' evaluation of students' communication skills. Four hundred one (97.3%) students consented to participate in this study. Faculty evaluation scores of students for both the individual and group oral assessments were significantly higher than students' self-assessment scores. Students' self-assessment scores of their communication skills increased from the individual to the group oral assessment. Students' self-assessments of communication skills were consistently lower than faculty members' evaluations. Greater use of oral assessments throughout the pharmacy curriculum may help to improve students' confidence in and self-assessment of their communication skills.

Reliability of the ECHOWS Tool for Assessment of Patient Interviewing Skills.

Science.gov (United States)

Boissonnault, Jill S; Evans, Kerrie; Tuttle, Neil; Hetzel, Scott J; Boissonnault, William G

2016-04-01

History taking is an important component of patient/client management. Assessment of student history-taking competency can be achieved via a standardized tool. The ECHOWS tool has been shown to be valid with modest intrarater reliability in a previous study but did not demonstrate sufficient power to definitively prove its stability. The purposes of this study were: (1) to assess the reliability of the ECHOWS tool for student assessment of patient interviewing skills and (2) to determine whether the tool discerns between novice and experienced skill levels. A reliability and construct validity assessment was conducted. Three faculty members from the United States and Australia scored videotaped histories from standardized patients taken by students and experienced clinicians from each of these countries. The tapes were scored twice, 3 to 6 weeks apart. Reliability was assessed using interclass correlation coefficients (ICCs) and repeated measures. Analysis of variance models assessed the ability of the tool to discern between novice and experienced skill levels. The ECHOWS tool showed excellent intrarater reliability (ICC [3,1]=.74-.89) and good interrater reliability (ICC [2,1]=.55) as a whole. The summary of performance (S) section showed poor interrater reliability (ICC [2,1]=.27). There was no statistical difference in performance on the tool between novice and experienced clinicians. A possible ceiling effect may occur when standardized patients are not coached to provide complex and obtuse responses to interviewer questions. Variation in familiarity with the ECHOWS tool and in use of the online training may have influenced scoring of the S section. The ECHOWS tool demonstrates excellent intrarater reliability and moderate interrater reliability. Sufficient training with the tool prior to student assessment is recommended. The S section must evolve in order to provide a more discerning measure of interviewing skills. © 2016 American Physical Therapy

Cross-platform digital assessment forms for evaluating surgical skills

DEFF Research Database (Denmark)

Andersen, Steven Arild Wuyts

2015-01-01

developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion......A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex...... assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database...

A standardized patient model to teach and assess professionalism and communication skills: the effect of personality type on performance.

Science.gov (United States)

Lifchez, Scott D; Redett, Richard J

2014-01-01

Teaching and assessing professionalism and interpersonal communication skills can be more difficult for surgical residency programs than teaching medical knowledge or patient care, for which many structured educational curricula and assessment tools exist. Residents often learn these skills indirectly, by observing the behavior of their attendings when communicating with patients and colleagues. The purpose of this study was to assess the results of an educational curriculum we created to teach and assess our residents in professionalism and communication. We assessed resident and faculty prior education in delivering bad news to patients. Residents then participated in a standardized patient (SP) encounter to deliver bad news to a patient's family regarding a severe burn injury. Residents received feedback from the encounter and participated in an education curriculum on communication skills and professionalism. As a part of this curriculum, residents underwent assessment of communication style using the Myers-Briggs type inventory. The residents then participated in a second SP encounter discussing a severe pulmonary embolus with a patient's family. Resident performance on the SP evaluation correlated with an increased comfort in delivering bad news. Comfort in delivering bad news did not correlate with the amount of prior education on the topic for either residents or attendings. Most of our residents demonstrated an intuitive thinking style (NT) on the Myers-Briggs type inventory, very different from population norms. The lack of correlation between comfort in delivering bad news and prior education on the subject may indicate the difficulty in imparting communication and professionalism skills to residents effectively. Understanding communication style differences between our residents and the general population can help us teach professionalism and communication skills more effectively. With the next accreditation system, residency programs would need to

Comparing the self-assessed and examiner-assessed driving skills of Japanese driving school students

Directory of Open Access Journals (Sweden)

Hiroshi Nakai

2012-03-01

A sample of Japanese driving test candidates (n=2021 completed a self-assessment using a 5-point scale applied to 19 items. The candidates completed the assessment shortly after passing their practical driving test conducted at a driving school. Their performance was also assessed by an examiner who used the same scale. The comparison between self-assessment and examiner-assessment revealed that around 40% of Japanese driving school students made a realistic assessment of their skills. With regard to the gender differences, although males displayed higher levels of overconfidence than females did, the differences were not as large as earlier studies with questionnaires had suggested. Furthermore, the effect of age on the accuracy of novice drivers' skill assessment was found to be relatively small. Our findings, which are based on a comparison of subjective assessments of driving skills between examiners and novices, instead of a questionable method which relies on a comparison with a hypothetical average driver, suggest that the majority of candidates in fact do not overrate their own skills. These results were discussed from the viewpoint of the driver education system and compared to other European research using the same framework.

Setting Pass Scores for Clinical Skills Assessment

Directory of Open Access Journals (Sweden)

Min Liu

2008-12-01

Full Text Available In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

A qualitative study of advanced nurse practitioners' use of physical assessment skills in the community: shifting skills across professional boundaries.

Science.gov (United States)

Raleigh, Mary; Allan, Helen

2017-07-01

To explore multiple perspectives on the use of physical assessment skills by advanced nurse practitioners in the UK. Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by advanced nurse practitioners in the community. Case study. A qualitative interpretative single-embedded case study of 22 participants from South of England. A framework method analysed interview data collected by the researcher between March-August 2013. Participants included nurses, doctors, nurse educators and managers. Physical assessment skills education at universities is part of a policy shift to develop a flexible workforce in the UK. Shared physical assessment practices are less to do with role substitution and more about preparing practitioners with skills that are fit for purpose. Competence, capability and performance with physical assessment skills are an expectation of advanced nursing practice. These skills are used successfully by community advanced nurse practitioners to deliver a wide range of services in response to changing patient need. The introduction of physical assessment skills education to undergraduate professional preparation would create a firm foundation to develop these skills in postgraduate education. Physical assessment education prepares nurses with the clinical competencies to carry out healthcare reforms in the UK. Shared sets of clinical assessment competencies between disciplines have better outcomes for patients. Levels of assessment competence can depend on the professional attributes of individual practitioners. Unsupportive learning cultures can hinder professional development of advanced nursing practice. © 2016 John Wiley & Sons Ltd.

Fuzzy Logic as a Tool for Assessing Students’ Knowledge and Skills

Directory of Open Access Journals (Sweden)

Michael Gr. Voskoglou

2013-05-01

Full Text Available Fuzzy logic, which is based on fuzzy sets theory introduced by Zadeh in 1965, provides a rich and meaningful addition to standard logic. The applications which may be generated from or adapted to fuzzy logic are wide-ranging and provide the opportunity for modeling under conditions which are imprecisely defined. In this article we develop a fuzzy model for assessing student groups’ knowledge and skills. In this model the students’ characteristics under assessment (knowledge of the subject matter, problem solving skills and analogical reasoning abilities are represented as fuzzy subsets of a set of linguistic labels characterizing their performance, and the possibilities of all student profiles are calculated. In this way, a detailed quantitative/qualitative study of the students’ group performance is obtained. The centroid method and the group’s total possibilistic uncertainty are used as defuzzification methods in converting our fuzzy outputs to a crisp number. According to the centroid method, the coordinates of the center of gravity of the graph of the membership function involved provide a measure of the students’ performance. Techniques of assessing the individual students’ abilities are also studied and examples are presented to illustrate the use of our results in practice.

How Effective Are Self- and Peer Assessment of Oral Presentation Skills Compared with Teachers' Assessments?

Science.gov (United States)

De Grez, Luc; Valcke, Martin; Roozen, Irene

2012-01-01

Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the…

Defining and assessing critical thinking skills for student radiographers

International Nuclear Information System (INIS)

Castle, Alan

2009-01-01

Developing critical thinking skills is a key aim of higher education and is important in preparing student radiographers for their future careers in clinical practice. The aim of this paper was to attempt to devise and assess six key components of critical thinking appropriate for radiographic practice. Each of the six components was divided into three dimensions and a Critical Thinking Skills Scoring Chart (CTSSC) devised to assess students' written performance against each dimension. Scores revealed that approximately 30% of students were rated as good and approximately 10% of students were rated as poor in each component, although there was some variability between different dimensions. It is suggested that educators need to encourage and support students to develop their critical thinking skills by reviewing their curriculum to clearly define specific skills and ensure that they are appropriately taught and assessed

Helpers' Self-Assessment Biases Before and after Helping Skills Training

Science.gov (United States)

Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L.; Van Broeck, Nady; Mikolajczak, Moïra

2017-01-01

Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

Helpers' Self-Assessment Biases Before and after Helping Skills Training.

Science.gov (United States)

Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L; Van Broeck, Nady; Mikolajczak, Moïra

2017-01-01

Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

Objective assessment of technical skills in surgery

OpenAIRE

Moorthy, Krishna; Munz, Yaron; Sarker, Sudip K; Darzi, Ara

2003-01-01

In the past few years, considerable developments have been made in the objective assessment of technical proficiency of surgeons. Technical skills should be assessed during training, and various methods have been developed for this purpose

Rubric Authoring Tool Supporting Cognitive Skills Assessment across an Institution

Science.gov (United States)

Simper, Natalie

2018-01-01

This paper explores a method to support instructors in assessing cognitive skills in their course, designed to enable aggregation of data across an institution. A rubric authoring tool, "BASICS" (Building Assessment Scaffolds for Intellectual Cognitive Skills) was built as part of the Queen's University Learning Outcomes Assessment (LOA)…

Medical and psychology students' self-assessed communication skills: A pilot study.

Science.gov (United States)

Tiuraniemi, Juhani; Läärä, Riitta; Kyrö, Tuuli; Lindeman, Sari

2011-05-01

The purpose of this study was to describe how psychology and medical students assess their own competency and skills before and after training, in which role-play was used to teach interpersonal and communication skills. Interpersonal and communication skills were assessed with a semi-structured questionnaire before and after the training. The students of both medicine and psychology estimated their skill levels to be higher after the course. The psychology students estimated their skills for communication, motivating interviewing, empathy and reflection, and change orientation to be better at the end of the course. Medical students estimated their communication skills, motivating interviewing skills, and change orientation skills to be better at the end of the course. Even a short period of training in interpersonal and communication skills can positively affect the self-assessed skills of the medical students. In the future, it would be worthwhile to pay attention to reflective teaching practices in the training of both medical and psychology students. The cognitive and emotional components of these practices help students to develop their own communication skills. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Crowd-sourced assessment of surgical skills in cricothyrotomy procedure.

Science.gov (United States)

Aghdasi, Nava; Bly, Randall; White, Lee W; Hannaford, Blake; Moe, Kris; Lendvay, Thomas S

2015-06-15

Objective assessment of surgical skills is resource intensive and requires valuable time of expert surgeons. The goal of this study was to assess the ability of a large group of laypersons using a crowd-sourcing tool to grade a surgical procedure (cricothyrotomy) performed on a simulator. The grading included an assessment of the entire procedure by completing an objective assessment of technical skills survey. Two groups of graders were recruited as follows: (1) Amazon Mechanical Turk users and (2) three expert surgeons from University of Washington Department of Otolaryngology. Graders were presented with a video of participants performing the procedure on the simulator and were asked to grade the video using the objective assessment of technical skills questions. Mechanical Turk users were paid $0.50 for each completed survey. It took 10 h to obtain all responses from 30 Mechanical Turk users for 26 training participants (26 videos/tasks), whereas it took 60 d for three expert surgeons to complete the same 26 tasks. The assessment of surgical performance by a group (n = 30) of laypersons matched the assessment by a group (n = 3) of expert surgeons with a good level of agreement determined by Cronbach alpha coefficient = 0.83. We found crowd sourcing was an efficient, accurate, and inexpensive method for skills assessment with a good level of agreement to experts' grading. Copyright © 2015 Elsevier Inc. All rights reserved.

The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students.

Science.gov (United States)

Hastie, Carolyn; Fahy, Kathleen; Parratt, Jenny

2014-09-01

Poor teamwork is cited as one of the major root causes of adverse events in healthcare. Bullying, resulting in illness for staff, is an expression of poor teamwork skills. Despite this knowledge, poor teamwork persists in healthcare and teamwork skills are rarely the focus of teaching and assessment in undergraduate health courses. To develop and implement an assessment tool for use in facilitating midwifery students' learning of teamwork skills. This paper describes how the TeamUP rubric tool was developed. A review of the literature found no research reports on how to teach and assess health students' teamwork skills in standing teams. The literature, however, gives guidance about how university educators should evaluate individual students using peer assessment. The developmental processes of the rubric were grounded in the theoretical literature and feminist collaborative conversations. The rubric incorporates five domains of teamwork skills: Fostering a Team Climate; Project Planning; Facilitating Teams; Managing Conflict and Quality Individual Contribution. The process and outcomes of student and academic content validation are described. The TeamUP rubric is useful for articulating, teaching and assessing teamwork skills for health professional students. The TeamUP rubric is a robust, theoretically grounded model that defines and details effective teamwork skills and related behaviours. If these skills are mastered, we predict that graduates will be more effective in teams. Our assumption is that graduates, empowered by having these skills, are more likely to manage conflict effectively and less likely to engage in bullying behaviours. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

The role of multimedia in surgical skills training and assessment.

Science.gov (United States)

Shariff, Umar; Seretis, Charalampos; Lee, Doreen; Balasubramanian, Saba P

2016-06-01

Multimedia is an educational resource that can be used to supplement surgical skills training. The aim of this review was to determine the role of multimedia in surgical training and assessment by performing a systematic review of the literature. A systematic review for published articles was conducted on the following databases: PubMed/MEDLINE (1992 to November 2014), SCOPUS (1992 to November 2014) and EMBASE (1992 to November 2014). For each study the educational content, study design, surgical skill assessed and outcomes were recorded. A standard data extraction form was created to ensure systematic retrieval of relevant information. 21 studies were included; 14 randomized controlled trials (RCTs) and 7 non-randomized controlled trials (Non-RCTs). Technical skills were assessed in 7 RCTs and 3 non-RCTs; cognitive skills were assessed in 9 RCTs and 4 non-RCTs. In controlled studies, multimedia was associated with significant improvement in technical skills (4 studies; 4 RCTs) and cognitive skills (7 studies; 6 RCTs). In two studies multimedia was inferior in comparison to conventional teaching. Evaluation of multimedia (9 studies) demonstrated strongly favourable results. This review suggests that multimedia effectively facilitates both technical and cognitive skills acquisition and is well accepted as an educational resource. Copyright © 2015 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

Zoo U: A Stealth Approach to Social Skills Assessment in Schools

Directory of Open Access Journals (Sweden)

Melissa E. DeRosier

2012-01-01

Full Text Available This paper describes the design and evaluation of Zoo U, a novel computer game to assess children’s social skills development. Zoo U is an innovative product that combines theory-driven content and customized game mechanics. The game-like play creates the opportunity for stealth assessment, in which dynamic evidence of social skills is collected in real time and players’ choices during gameplay provide the needed data. To ensure the development of an engaging and valid game, we utilized an iterative data-driven validation process in which the game was created, tested, revised based on student performance and feedback, and retested until game play was statistically matched to independent ratings of social skills. We first investigated whether the data collected through extensive logging of student actions provided information that could be used to improve the assessment. We found that detailed game logs of socially relevant player behavior combined with external measures of player social skills provided an efficient vector to incrementally improve the accuracy of the embedded assessments. Next, we investigated whether the game performance correlated with teachers’ assessments of students’ social skills competencies. An evaluation of the final game showed (a significant correlations between in-game social skills assessments and independently obtained standard psychological assessments of the same students and (b high levels of engagement and likeability for students. These findings support the use of the interactive and engaging computer game format for the stealth assessment of children’s social skills. The created innovative design methodologies should prove useful in the design and improvement of computer games in education.

An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

Science.gov (United States)

Nmadu, Teresa M.

2018-01-01

Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business

An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria.

Science.gov (United States)

Asieba, Iyeseun O; Nmadu, Teresa M

2018-01-01

Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business performance with money skills, leadership skills and

An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

Directory of Open Access Journals (Sweden)

Asieba IO

2018-03-01

Full Text Available Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974/Herron (1990 Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90% still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03 and stock growth (P=0.04; while stock growth was significantly affected by leadership skills (P=0.002 and entrepreneurial skills (0.02. Net profit was significantly affected by industry skills (P=0.008. Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on

The Role of Crowdsourcing in Assessing Surgical Skills.

Science.gov (United States)

Katz, Andrew J

2016-08-01

Assessing surgical skill is critical in improving patient care while reducing medical errors, length of stay, and readmission rates. Crowdsourcing provides 1 potential method for accurately assessing this; only recently has crowdsourcing been studied as a valid way to provide feedback to surgeons. The results of such studies are explored. A systematic literature search was performed on PubMed to identify studies that have attempted to validate crowdsourcing as a method for assessing surgical skill. Through a combination of abstract screening and full-length review, 9 studies that met the inclusion criteria were reviewed. Crowdsourcing has been validated as an important way to provide feedback for surgical skill. It has been demonstrated to be effective in both dry-lab and live surgery, for a variety of tasks and methods. However, more studies must be performed to ensure that crowdsourcing can provide quality feedback in a wider variety of scenarios.

Teaching and Assessing Teamwork Skills in Engineering and Computer Science

Directory of Open Access Journals (Sweden)

Robert W. Lingard

2010-02-01

Full Text Available To be successful in today's workplace, engineering and computer science students must possess high levels of teamwork skills. Unfortunately, most engineering programs provide little or no specific instruction in this area. This paper outlines an assessment-driven approach toward teaching teamwork skills. Working with the Industrial Advisory Board for the College, a set of performance criteria for teamwork was developed. This set of criteria was used to build an assessment instrument to measure the extent to which students are able to achieve the necessary skills. This set of criteria provides a clear basis for the development of an approach toward teaching teamwork skills. Furthermore, the results from the assessment can be used to adjust the teaching techniques to address the particular skills where students show some weaknesses. Although this effort is in the early stages, the approach seems promising and will be improved over time.

Video and accelerometer-based motion analysis for automated surgical skills assessment.

Science.gov (United States)

Zia, Aneeq; Sharma, Yachna; Bettadapura, Vinay; Sarin, Eric L; Essa, Irfan

2018-03-01

Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

Assessing Students' Technical Skill Attainment

Science.gov (United States)

Jorgensen, Haley

2010-01-01

The Wisconsin Technical College System (WTCS) is working to comply with the Carl D. Perkins Career and Technical Education Improvement Act of 2006 (Perkins) to ensure that its graduates have mastered the technical skills needed by business and industry. The legislation requires that each state identify and approve program assessment strategies…

Innovative learning model for improving students’ argumentation skill and concept understanding on science

Science.gov (United States)

Nafsiati Astuti, Rini

2018-04-01

Argumentation skill is the ability to compose and maintain arguments consisting of claims, supports for evidence, and strengthened-reasons. Argumentation is an important skill student needs to face the challenges of globalization in the 21st century. It is not an ability that can be developed by itself along with the physical development of human, but it must be developed under nerve like process, giving stimulus so as to require a person to be able to argue. Therefore, teachers should develop students’ skill of arguing in science learning in the classroom. The purpose of this study is to obtain an innovative learning model that are valid in terms of content and construct in improving the skills of argumentation and concept understanding of junior high school students. The assessment of content validity and construct validity was done through Focus Group Discussion (FGD), using the content and construct validation sheet, book model, learning video, and a set of learning aids for one meeting. Assessment results from 3 (three) experts showed that the learning model developed in the category was valid. The validity itself shows that the developed learning model has met the content requirement, the student needs, state of the art, strong theoretical and empirical foundation and construct validity, which has a connection of syntax stages and components of learning model so that it can be applied in the classroom activities

Soft Skills Assessment: Theory Development and the Research Agenda

Science.gov (United States)

Gibb, Stephen

2014-01-01

Soft skills have become a subject of increasing interest in lifelong learning. Soft skills development is intended to enable and enhance personal development, participation in learning and success in employment. The assessment of soft skill is therefore widely practised, but there is little in the way of research or evidence on how well this…

The development of aerobic and skill assessment in soccer.

Science.gov (United States)

O'Reilly, John; Wong, Stephen H S

2012-12-01

Methods of assessing soccer players' performance have developed significantly in recent times. The fitness profiles and skill levels of a prospective elite soccer player is a valuable resource for coaches in the process of identifying talent. Traditional means to measure aerobic fitness have centred on the 'aerobic capacity' or '&OV0312;O(2max)' test (also known as the maximal oxygen consumption test) but, over time, this has been shown not to be a sensitive measure for specific aspects of soccer in a match situation. Therefore, numerous soccer-specific simulations have been designed to re-create exercise patterns similar to those experienced during a match. Some of these studies have yet to be validated, while others have been shown to result in a similar physiological load to that encountered during regular match play. Further developments have led to specifically designed intermittent sprint tests, which are used as a sensitive tool to accurately measure the fluctuations in players' ability both between and within soccer seasons. Testing procedures have also been developed that incorporate elements of both skill and physical ability. Soccer-specific field tests have been designed, incorporating skill and dynamic movements, and this opens up the possibility of teams testing the aerobic capacity of their elite players using soccer-specific movements. Valid studies assessing soccer-specific skills in an ecologically sound environment have been quite rare until recently. Some test protocols have been deemed largely irrelevant to soccer match play, while others have had limited impact on scientific literature. More recently, skill tests have been developed and shown to be valid and reliable methods of assessing soccer skill performance. Many new skill tests continue to be developed, and some have been shown to be highly reliable, but further study of these relatively novel concepts is required before a more solid recommendation can be made. Overall, while significant

Attitudes to proposed assessment of pharmacy skills in Korean pharmacist licensure examination.

Science.gov (United States)

Kim, Joo Hee; Lee, Ju-Yeun; Lee, Young Sook; Yong, Chul-Soon; Han, Nayoung; Gwak, Hye Sun; Oh, Jungmi; Lee, Byung Koo; Lee, Sukhyang

2017-01-01

The survey aimed to obtain opinions about a proposed implementation of pharmacy skills assessment in Korean pharmacist licensure examination (KPLE). A 16-question survey was distributed electronically to 2,738 people including 570 pharmacy professors of 35 pharmacy schools, 550 preceptors from 865 practice sites and 1,618 students who graduated in 2015. The survey solicited responses concerning the adequacy of the current KPLE in assessing pharmacy knowledge/skills/attitudes, deficiencies of pharmacy skills testing in assessing the professional competencies necessary for pharmacists, plans for pharmacy skills tests in the current KPLE, and subject areas of pharmacy practice. A total of 466 surveys were returned. The current exam is not adequate for assessing skills and attitudes according to 42%-48% of respondents. Sixty percent felt that skills test is necessary to assess qualifications and professional competencies. Almost two-thirds of participants stated that testing should be implemented within 5 years. More than 60% agreed that candidates should be graduates and that written and skills test scores can be combined for pass-fail decisions. About 70% of respondents felt that the test should be less than 2 hours in duration. Over half of the respondents thought that the assessor should be a pharmacy faculty member with at least 5 years of clinical experience. Up to 70% stated that activities related to patient care were appropriate and practical for the scope of skills test. Pharmacy skills assessment was supported by the majority of respondents.

Enhancing Student Communication Skills Through Arabic Language Competency and Simulated Patient Assessments.

Science.gov (United States)

Hasan, Sanah; Tarazi, Hamadeh M Khier; Halim Hilal, Dana Abdel

2017-05-01

Objective. To assess student communication and patient management skill with introduction of Arabic and use of simulated patient assessments to a communication and counseling course. Design. Five, 3-hour tutorials (clinical skill laboratory) were added to the course covering: listening and empathic responding, non-verbal communications, interviewing skills, assertiveness, counseling in special situations: conflict, anger, worry or rushed situations, and professional decision making. Arabic content was introduced to the course to enhance Arabic communications and competence among students. Simulated patient assessment was used to evaluate student skills. Students' feedback about course changes was evaluated. Assessment. The course now covers a wider content and Arabic language. Students' scores were similar in the assessment and other assessments within the course and between Arabic and English groups. Students favorably rated the changes in the course and provided constructive feedback on content usefulness and adequacy. Conclusion. Expanding the course to include Arabic language and content and simulated patient assessments enhanced student communication skills.

Development of performance assessment instrument based contextual learning for measuring students laboratory skills

Science.gov (United States)

Susilaningsih, E.; Khotimah, K.; Nurhayati, S.

2018-04-01

The assessment of laboratory skill in general hasn’t specific guideline in assessment, while the individual assessment of students during a performance and skill in performing laboratory is still not been observed and measured properly. Alternative assessment that can be used to measure student laboratory skill is use performance assessment. The purpose of this study was to determine whether the performance assessment instrument that the result of research can be used to assess basic skills student laboratory. This research was conducted by the Research and Development. The result of the data analysis performance assessment instruments developed feasible to implement and validation result 62.5 with very good categories for observation sheets laboratory skills and all of the components with the very good category. The procedure is the preliminary stages of research and development stages. Preliminary stages are divided in two, namely the field studies and literature studies. The development stages are divided into several parts, namely 1) development of the type instrument, 2) validation by an expert, 3) a limited scale trial, 4) large-scale trials and 5) implementation of the product. The instrument included in the category of effective because 26 from 29 students have very high laboratory skill and high laboratory skill. The research of performance assessment instrument is standard and can be used to assess basic skill student laboratory.

Developing Employability Skills: Peer Assessment in Higher Education

Science.gov (United States)

Cassidy, Simon

2006-01-01

Purpose: Reports examining graduate employment issues suggest that employers are concerned by the lack of employability skills exhibited by entry-level job applications. It is also suggested that employers consider it the responsibility of educational institutions to develop such skills. The current study seeks to identify peer assessment as a…

Defining and Assessing Team Skills of Business and Accountancy Students

Science.gov (United States)

Alghalith, Nabil; Blum, Michael; Medlock, Amanda; Weber, Sandy

2004-01-01

The objectives of the project are (1) to define the skills necessary for students to work effectively with others to achieve common goals, and (2) to develop an assessment instrument to measure student progress toward achieving these skills. The defined skill set will form a basis for common expectations related to team skills that will be shared…

A Model for Evaluating Student Clinical Psychomotor Skills.

Science.gov (United States)

And Others; Fiel, Nicholas J.

1979-01-01

A long-range plan to evaluate medical students' physical examination skills was undertaken at the Ingham Family Medical Clinic at Michigan State University. The development of the psychomotor skills evaluation model to evaluate the skill of blood pressure measurement, tests of the model's reliability, and the use of the model are described. (JMD)

Accuracy and reliability of peer assessment of athletic training psychomotor laboratory skills.

Science.gov (United States)

Marty, Melissa C; Henning, Jolene M; Willse, John T

2010-01-01

Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Cross-sectional study. Entry-level master's athletic training education program. First-year (n  =  5) and second-year (n  =  8) students. Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the φ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (φ  =  0.79) for the Faber test, with 1 participant on 2 occasions (φ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (φ  =  0.72). Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills

Non-technical skills assessment for prelicensure nursing students: An integrative review.

Science.gov (United States)

Pires, Sara; Monteiro, Sara; Pereira, Anabela; Chaló, Daniela; Melo, Elsa; Rodrigues, Alexandre

2017-11-01

In nursing, non-technical skills are recognized as playing an important role to increase patient safety and successful clinical outcomes (Pearson and McLafferty, 2011). Non-technical skills are cognitive and social resource skills that complement technical skills and contribute to safe and efficient task performance (Flin et al., 2008). In order to effectively provide non-technical skills training, it is essential to have an instrument to measure these skills. An online search was conducted. Articles were selected if they referred to and/or described instruments assessing non-technical skills for nurses and/or prelicensure nursing students in educational, clinical and/or simulated settings with validation evidence (inclusion criteria). Of the 53 articles located, 26 met the inclusion criteria. Those referred to and/or described 16 instruments with validation evidence developed to assess non-technical skills in multidisciplinary teams including nurses. Although articles have shown 16 valid and reliable instruments, to our knowledge, no instrument has been published or developed and validated for the assessment of non-technical skills of only nurses in general, relevant for use in high-fidelity simulation-based training for prelicensure nursing students. Therefore, there is a need for the development of such an instrument. Copyright © 2017 Elsevier Ltd. All rights reserved.

Leveraging Educational Data Mining for Real-Time Performance Assessment of Scientific Inquiry Skills within Microworlds

Science.gov (United States)

Gobert, Janice D.; Sao Pedro, Michael A.; Baker, Ryan S. J. D.; Toto, Ermal; Montalvo, Orlando

2012-01-01

We present "Science Assistments," an interactive environment, which assesses students' inquiry skills as they engage in inquiry using science microworlds. We frame our variables, tasks, assessments, and methods of analyzing data in terms of "evidence-centered design." Specifically, we focus on the "student model," the…

A Two-Stage Multi-Agent Based Assessment Approach to Enhance Students' Learning Motivation through Negotiated Skills Assessment

Science.gov (United States)

Chadli, Abdelhafid; Bendella, Fatima; Tranvouez, Erwan

2015-01-01

In this paper we present an Agent-based evaluation approach in a context of Multi-agent simulation learning systems. Our evaluation model is based on a two stage assessment approach: (1) a Distributed skill evaluation combining agents and fuzzy sets theory; and (2) a Negotiation based evaluation of students' performance during a training…

Management of Radioactive Spills in Nuclear Medicine; Teaching and Assessing with Objectively Structured Assessment of Technical Skills

International Nuclear Information System (INIS)

Hussain, Riffat Parveen

2015-01-01

Routine work in nuclear medicine requires the careful elution of radioactivity and its subsequent, storage and handling. Though all effort is maintained to prevent any “spill” of this radioactivity, accidents are bound to happen. The response to this spill is a methodically worked out a plan that is written and adopted as a “standard operating procedure.” This protocol is taught to all involved in the area of working as a mock drill/apprenticeship model. No formal evaluation of learning is in place except for the mock drills. The objectively structured assessment of technical skills (OSATS) is a variation on the Objective Structured Clinical Examination, which is a form of workplace based assessment. The OSATS is cited in the Accreditation Council of Graduate Medical Education evaluation toolbox on the website as the most desirable evaluation tool for the patient care topics. It is the objective of this paper is to introduce the “OSATS” for teaching, and assessment of the learning, of the protocol for the management of radioactive spill. As a review of the literature on the subject failed to reveal any such teaching protocol/material/document for this important technical skill, we hope that it may act as a landmark for the development of teaching and assessment of other technical skills also

Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

Science.gov (United States)

Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

2016-11-01

To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

How to Assess Creative Thinking Skill in Making Products of Liquid Pressure?

Science.gov (United States)

Chasanah, L.; Kaniawati, I.; Hernani, H.

2017-09-01

The primary skills that must be possessed in the 21st century curriculum are learning and innovation skills. One of the learning strategies that can train students to innovate and improve creative thinking skills is by applying Science, Technology, Engineering and Mathematics (STEM) in learning. Based on an interview to one of the science teachers that learning that aims to train learning and innovation skills has not been applied to learning in the classroom because there is not enough time, learning materials and assessment instruments used. This study aims to determine the results of the implementation of performance assessment of creative thinking skills on STEM-based learning in junior high school for the material of liquid pressure. This research uses descriptive method. Participants in this study were junior high school students 8th in Kudus area. The research instrument consists of observation sheet, performance assessment and documentation. The result showed that creative thinking skills performance assessment can assess student’s creativity in making products of STEM-based learning for junior high school.

A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

NARCIS (Netherlands)

Ackermans, Kevin; Rusman, Ellen; Brand-Gruwel, Saskia; Specht, Marcus

2016-01-01

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of

Instructional Model and Thinking Skill in Chemistry Class

Science.gov (United States)

Langkudi, H. H.

2018-02-01

Chemistry course are considered a difficult lesson for students as evidenced by low learning outcomes on daily tests, mid-semester tests as well as final semester tests. This research intended to investigate the effect of instructional model, thinking skill and the interaction of these variables on students’ achievement in chemistry. Experimental method was applying used 2 x 2 factorial design. The results showed that the use of instructional model with thinking skill influences student’s learning outcomes, so that the chemistry teacher is recommended to pay attention to the learning model, and adjusted to the student’s skill thinking on the chemistry material being taught. The conclusion of this research is that discovery model is suitable for students who have formal thinking skill and conventional model is fit for the students that have concrete thinking skill.

Does a Rater's Professional Background Influence Communication Skills Assessment?

Science.gov (United States)

Artemiou, Elpida; Hecker, Kent G; Adams, Cindy L; Coe, Jason B

2015-01-01

There is increasing pressure in veterinary education to teach and assess communication skills, with the Objective Structured Clinical Examination (OSCE) being the most common assessment method. Previous research reveals that raters are a large source of variance in OSCEs. This study focused on examining the effect of raters' professional background as a source of variance when assessing students' communication skills. Twenty-three raters were categorized according to their professional background: clinical sciences (n=11), basic sciences (n=4), clinical communication (n=5), or hospital administrator/clinical skills technicians (n=3). Raters from each professional background were assigned to the same station and assessed the same students during two four-station OSCEs. Students were in year 2 of their pre-clinical program. Repeated-measures ANOVA results showed that OSCE scores awarded by the rater groups differed significantly: (F(matched_station_1) [2,91]=6.97, p=.002), (F(matched_station_2) [3,90]=13.95, p=.001), (F(matched_station_3) [3,90]=8.76, p=.001), and ((Fmatched_station_4) [2,91]=30.60, p=.001). A significant time effect between the two OSCEs was calculated for matched stations 1, 2, and 4, indicating improved student performances. Raters with a clinical communication skills background assigned scores that were significantly lower compared to the other rater groups. Analysis of written feedback provided by the clinical sciences raters showed that they were influenced by the students' clinical knowledge of the case and that they did not rely solely on the communication checklist items. This study shows that it is important to consider rater background both in recruitment and training programs for communication skills' assessment.

Structured assessment of microsurgery skills in the clinical setting.

Science.gov (United States)

Chan, WoanYi; Niranjan, Niri; Ramakrishnan, Venkat

2010-08-01

Microsurgery is an essential component in plastic surgery training. Competence has become an important issue in current surgical practice and training. The complexity of microsurgery requires detailed assessment and feedback on skills components. This article proposes a method of Structured Assessment of Microsurgery Skills (SAMS) in a clinical setting. Three types of assessment (i.e., modified Global Rating Score, errors list and summative rating) were incorporated to develop the SAMS method. Clinical anastomoses were recorded on videos using a digital microscope system and were rated by three consultants independently and in a blinded fashion. Fifteen clinical cases of microvascular anastomoses performed by trainees and a consultant microsurgeon were assessed using SAMS. The consultant had consistently the highest scores. Construct validity was also demonstrated by improvement of SAMS scores of microsurgery trainees. The overall inter-rater reliability was strong (alpha=0.78). The SAMS method provides both formative and summative assessment of microsurgery skills. It is demonstrated to be a valid, reliable and feasible assessment tool of operating room performance to provide systematic and comprehensive feedback as part of the learning cycle. Copyright 2009 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

Approaching time is important for assessment of endoscopic surgical skills.

Science.gov (United States)

Tokunaga, Masakazu; Egi, Hiroyuki; Hattori, Minoru; Yoshimitsu, Masanori; Sumitani, Daisuke; Kawahara, Tomohiro; Okajima, Masazumi; Ohdan, Hideki

2012-05-01

This study aimed to verify whether the approaching time (the time taken to reach the target point from another point, a short distance apart, during point-to-point movement in endoscopic surgery), assessed using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), could distinguish the skill level of surgeons. Expert surgeons (who had performed more than 50 endoscopic surgeries) and novice surgeons (who had no experience in performing endoscopic surgery) were tested using the HUESAD. The approaching time, total time, and intermediate time (total time--approaching time) were measured and analyzed using the trajectory of the tip of the instrument. The approaching time and total time were significantly shorter in the expert group than in the novice group (p time did not significantly differ between the groups (p > 0.05). The approaching time, which is a component of the total time, is very mportant in the measurement of the total time to assess endoscopic surgical skills. Further, the approaching time was useful for skill assessment by the HUESAD for evaluating the skill of surgeons performing endoscopic surgery.

Effects of video modeling with video feedback on vocational skills of adults with autism spectrum disorder.

Science.gov (United States)

English, Derek L; Gounden, Sadhana; Dagher, Richard E; Chan, Shu Fen; Furlonger, Brett E; Anderson, Angelika; Moore, Dennis W

2017-11-01

To examine the effectiveness of a video modeling (VM) with video feedback (VFB) intervention to teach vocational gardening skills to three adults with autism spectrum disorder (ASD). A multiple probe design across skills was used to assess the effects of the intervention on the three participants' ability to perform skills accurately. The use of VM with VFB led to improvements across skills for two of the participants. The third participant required video prompting (VP) for successful skill acquisition. Skill performance generalized across personnel and settings for two of the participants, but it was not assessed for the third. Skill performance maintained at follow-up for all three participants. Social validity data gathered from participants, parents, and co-workers were positive. These findings suggest that VM with VFB and VP with VFB were effective and socially acceptable interventions for teaching vocational gardening skills to young adults with ASD.

Accuracy and Reliability of Peer Assessment of Athletic Training Psychomotor Laboratory Skills

Science.gov (United States)

Marty, Melissa C.; Henning, Jolene M.; Willse, John T.

2010-01-01

Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was

Educational Assessment Knowledge and Skills for Teachers

Science.gov (United States)

Brookhart, Susan M.

2011-01-01

The 1990 Standards for Teacher Competence in Educational Assessment of Students (AFT, NCME, & NEA, 1990) made a documentable contribution to the field. However, the Standards have become a bit dated, most notably in two ways: (1) the Standards do not consider current conceptions of formative assessment knowledge and skills, and (2) the Standards…

Assessment Training Effects on Student Assessment Skills and Task Performance in a Technology-Facilitated Peer Assessment

Science.gov (United States)

Liu, Xiongyi; Li, Lan

2014-01-01

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the…

Assessment of medical communication skills by computer: assessment method and student experiences

NARCIS (Netherlands)

Hulsman, R. L.; Mollema, E. D.; Hoos, A. M.; de Haes, J. C. J. M.; Donnison-Speijer, J. D.

2004-01-01

BACKGROUND A computer-assisted assessment (CAA) program for communication skills designated ACT was developed using the objective structured video examination (OSVE) format. This method features assessment of cognitive scripts underlying communication behaviour, a broad range of communication

Interpersonal Skills in MBA Admissions: How Are They Conceptualized and Assessed?

Science.gov (United States)

Beenen, Gerard; Pichler, Shaun; Davoudpour, Shahin

2018-01-01

Employers and students concur that soft skills or interpersonal skills are critical to managerial success, yet we know little about how MBA program admissions professionals conceptualize and assess these skills in the context of global management education. Such practices have key implications for interpersonal skills curriculum and training in…

Energy-Based Metrics for Arthroscopic Skills Assessment.

Science.gov (United States)

Poursartip, Behnaz; LeBel, Marie-Eve; McCracken, Laura C; Escoto, Abelardo; Patel, Rajni V; Naish, Michael D; Trejos, Ana Luisa

2017-08-05

Minimally invasive skills assessment methods are essential in developing efficient surgical simulators and implementing consistent skills evaluation. Although numerous methods have been investigated in the literature, there is still a need to further improve the accuracy of surgical skills assessment. Energy expenditure can be an indication of motor skills proficiency. The goals of this study are to develop objective metrics based on energy expenditure, normalize these metrics, and investigate classifying trainees using these metrics. To this end, different forms of energy consisting of mechanical energy and work were considered and their values were divided by the related value of an ideal performance to develop normalized metrics. These metrics were used as inputs for various machine learning algorithms including support vector machines (SVM) and neural networks (NNs) for classification. The accuracy of the combination of the normalized energy-based metrics with these classifiers was evaluated through a leave-one-subject-out cross-validation. The proposed method was validated using 26 subjects at two experience levels (novices and experts) in three arthroscopic tasks. The results showed that there are statistically significant differences between novices and experts for almost all of the normalized energy-based metrics. The accuracy of classification using SVM and NN methods was between 70% and 95% for the various tasks. The results show that the normalized energy-based metrics and their combination with SVM and NN classifiers are capable of providing accurate classification of trainees. The assessment method proposed in this study can enhance surgical training by providing appropriate feedback to trainees about their level of expertise and can be used in the evaluation of proficiency.

The Differential Effects of Task Complexity on Domain-Specific and Peer Assessment Skills

Science.gov (United States)

van Zundert, Marjo J.; Sluijsmans, Dominique M. A.; Konings, Karen D.; van Merrienboer, Jeroen J. G.

2012-01-01

In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial…

Observational assessment of fundamental movement skill proficiency in preschool children

OpenAIRE

佐々木, 玲子; 石沢, 順子

2014-01-01

Fundamental movement skill competency in children has been declining in recent years. Early childhood is a sensitive period for the development of fundamental movement skills ; the mastery of certain of these skills is a prerequisite for daily functioning and participation in later physical or sport-specific activities. Although quantitative methods have been developed for assessing movement development in children, it is also important to qualitatively evaluate such skills in developing chil...

Objective assessment of technical surgical skills

NARCIS (Netherlands)

van Hove, P. D.; Tuijthof, G. J. M.; Verdaasdonk, E. G. G.; Stassen, L. P. S.; Dankelman, J.

2010-01-01

Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice. A systematic search was

Reliable and valid assessment of Lichtenstein hernia repair skills

DEFF Research Database (Denmark)

Carlsen, C G; Lindorff Larsen, Karen; Funch-Jensen, P

2014-01-01

PURPOSE: Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity...... of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. METHODS: Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia...... a significant difference between the three groups which indicates construct validity, p skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment...

Nurses' Evaluation of Their Use and Mastery in Health Assessment Skills: Selected Iran's Hospitals.

Science.gov (United States)

Adib-Hajbaghery, Mohsen; Safa, Azade

2013-09-01

Health assessment skills are of the most important skills which nurses require. The more precise assessment, the better results would be obtained and the quality of patient care would be improved. However, in Iran, few studies have investigated nurses' assessment skills. This study was aimed to assessnurses' evaluation of the learned skills of health assessment and their use. This cross-sectional study was conducted on 200 nurses in Isfahan province hospitals. Data was collected by a questionnaire including demographic data and 120 health assessment skills. Nurses scored their frequency of using and proficiency in skills. Statistical analysis was conducted by ANOVA, Tukey test and independent sample T-tests. The highest level of using and proficiency in skills was related to taking history. Nurses received 87.25% of score in this field. The lowest level of application was in assessment of the urogenital system so that nurses received 16.37% of score in this area. Also the lowest proficiency was in assessment of the nervous system and nurses received 34.58% of score in this area. The level of nurses' proficiency in the health assessment skills was not satisfactory. Modifying the curriculum and cooperating of nurse managers and nursing schools can help to improve the situation.

Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment.

Science.gov (United States)

Barnett, Lisa M; Morgan, Philip J; van Beurden, Eric; Beard, John R

2008-08-08

The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile), physical activity (Adolescent Physical Activity Recall Questionnaire) and cardiorespiratory fitness (Multistage Fitness Test). Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw), and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Of 928 original intervention participants, 481 were located in 28 schools and 276 (57%) were assessed with at least one follow-up measure. Slightly more than half were female (52.4%) with a mean age of 16.4 years (range 14.2 to 18.3 yrs). Relevant assessments were completed by 250 (90.6%) students for the Physical Activity Model and 227 (82.3%) for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18) of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30) of fitness variance. Sex did not act as a moderator in either model. Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth.

Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment

Directory of Open Access Journals (Sweden)

van Beurden Eric

2008-08-01

Full Text Available Abstract Background The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. Methods In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile, physical activity (Adolescent Physical Activity Recall Questionnaire and cardiorespiratory fitness (Multistage Fitness Test. Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw, and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Results Of 928 original intervention participants, 481 were located in 28 schools and 276 (57% were assessed with at least one follow-up measure. Slightly more than half were female (52.4% with a mean age of 16.4 years (range 14.2 to 18.3 yrs. Relevant assessments were completed by 250 (90.6% students for the Physical Activity Model and 227 (82.3% for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18 of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30 of fitness variance. Sex did not act as a moderator in either model. Conclusion Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth.

Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment

Science.gov (United States)

Barnett, Lisa M; Morgan, Philip J; van Beurden, Eric; Beard, John R

2008-01-01

Background The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. Methods In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile), physical activity (Adolescent Physical Activity Recall Questionnaire) and cardiorespiratory fitness (Multistage Fitness Test). Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw), and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Results Of 928 original intervention participants, 481 were located in 28 schools and 276 (57%) were assessed with at least one follow-up measure. Slightly more than half were female (52.4%) with a mean age of 16.4 years (range 14.2 to 18.3 yrs). Relevant assessments were completed by 250 (90.6%) students for the Physical Activity Model and 227 (82.3%) for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18) of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30) of fitness variance. Sex did not act as a moderator in either model. Conclusion Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth. PMID:18687148

Teaching and Assessing Communication Skills in Medical Undergraduate Training.

Science.gov (United States)

Modi, Jyoti Nath; Anshu, -; Chhatwal, Jugesh; Gupta, Piyush; Singh, Tejinder

2016-06-08

Good communication skills are essential for an optimal doctor-patient relationship, and also contribute to improved health outcomes. Although the need for training in communication skills is stated as a requirement in the 1997 Graduate Medical Education Regulations of the Medical Council of India, formal training in these skills has been fragmentary and non-uniform in most Indian curricula. The Vision 2015 document of the Medical Council of India reaffirms the need to include training in communication skills in the MBBS curriculum. Training in communication skills needs approaches which are different from that of teaching other clinical subjects. It is also a challenge to ensure that students not only imbibe the nuances of communication and interpersonal skills, but adhere to them throughout their careers. This article addresses the possible ways of standardizing teaching and assessment of communication skills and integrating them into the existing curriculum.

Attention to gender in communication skills assessment instruments in medical education: a review.

Science.gov (United States)

Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

2011-03-01

Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

Assessing the skills of home care workers in helping older people take their prescribed medications.

Science.gov (United States)

Smyth, Elizabeth E J

2015-08-01

The Southern Health and Social Care Trust in Northern Ireland applied a modified version of the Objective Structured Clinical Examination (OSCE) to assess the skills of home care workers in assisting older people taking prescribed medications. In Northern Ireland, home care workers are care workers employed by health and social care trusts or private agencies. The application of the model has developed the skills of this staff group, improved the relationship between the commissioner and provider, significantly reduced the time spent by community nurses in individual training and assessment, and enhanced the patient experience for those taking medication. Overall, the application of this model has provided assurances to the Trust board, the executive director of nursing, and operational directors that home care workers are competent in assisting older people in this high-risk activity.

Reliability and Validity of the Research Methods Skills Assessment

Science.gov (United States)

Smith, Tamarah; Smith, Samantha

2018-01-01

The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

Identifying and Assessing Gaps in Subseasonal to Seasonal Prediction Skill using the North American Multi-model Ensemble

Science.gov (United States)

Pegion, K.; DelSole, T. M.; Becker, E.; Cicerone, T.

2016-12-01

Predictability represents the upper limit of prediction skill if we had an infinite member ensemble and a perfect model. It is an intrinsic limit of the climate system associated with the chaotic nature of the atmosphere. Producing a forecast system that can make predictions very near to this limit is the ultimate goal of forecast system development. Estimates of predictability together with calculations of current prediction skill are often used to define the gaps in our prediction capabilities on subseasonal to seasonal timescales and to inform the scientific issues that must be addressed to build the next forecast system. Quantification of the predictability is also important for providing a scientific basis for relaying to stakeholders what kind of climate information can be provided to inform decision-making and what kind of information is not possible given the intrinsic predictability of the climate system. One challenge with predictability estimates is that different prediction systems can give different estimates of the upper limit of skill. How do we know which estimate of predictability is most representative of the true predictability of the climate system? Previous studies have used the spread-error relationship and the autocorrelation to evaluate the fidelity of the signal and noise estimates. Using a multi-model ensemble prediction system, we can quantify whether these metrics accurately indicate an individual model's ability to properly estimate the signal, noise, and predictability. We use this information to identify the best estimates of predictability for 2-meter temperature, precipitation, and sea surface temperature from the North American Multi-model Ensemble and compare with current skill to indicate the regions with potential for improving skill.

Analysis of Student Service-Learning Reflections for the Assessment of Transferable-Skills Development

Science.gov (United States)

Rizzo, D. M.; Dewoolkar, M.; Hayden, N.; Oka, L.; Pearce, A. R.

2010-12-01

The civil and environmental engineering (CEE) programs at the University of Vermont (UVM) incorporate systems thinking and a systems approach to sustainable engineering problem solving. A systems approach considers long-term social, environmental and economic factors within the context of the engineering problem solution and encompasses sustainable engineering solutions. Our goal is to prepare students to become leaders in their chosen field who can anticipate co-products associated with forecasted solutions. As a way of practicing the systems approach, we include service-learning projects in many of our undergraduate engineering courses, culminating with the senior capstone design course. We use a variety of formative and summative assessment methods to gage student understanding and attitudes including student surveys, focus groups, assessment of student projects, and student reflections. Student reflections from two courses -Modeling Environmental and Transportation Systems (31 juniors) and Senior Design Project (30 seniors) are compared. Of these, 25 students were common to both courses. The focus of the systems modeling service-learning project involved mentoring home-schooled children (11-14 yrs old) to solve problems of mobility, using the fun and inspiration of biomimicry. Students were required to invent innovative methods to move people or goods that improve associated constraints (i.e., minimize congestion, reduce pollution, increase safety), or reduce the need for transportation altogether. The capstone design project required a comprehensive engineering design involving two or more CEE sub-disciplines. Both service-learning projects were intended to enhance students’ academic learning experience, attain civic engagement and reinforce transferable skills (written and oral communication, teamwork, leadership and mentoring skills). The student course reflections were not guided; yet they provided valuable data to assess commonalities and differences in

The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

Science.gov (United States)

Barnett, Lisa M.; Hardy, Louise L.; Brian, Ali S.; Robertson, Sam

2015-01-01

The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key points Golf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level, and talent identification in beginner young golf players. Process rather than product oriented outcomes better identify areas of skill deficit in young children. The proposed swing and putt instrument can reliably identify skill deficits in children of elementary school age who are new to golf and can be used by a range

Self- and rater-assessed effectiveness of "thinking-aloud" and "regular" morning report to intensify young physicians' clinical skills.

Science.gov (United States)

Hsu, Hui-Chi; Lee, Fa-Yauh; Yang, Ying-Ying; Tsao, Yen-Po; Lee, Wen-Shin; Chuang, Chiao-Lin; Chang, Ching-Chih; Huang, Chia-Chang; Huang, Chin-Chou; Ho, Shung-Tai

2015-09-01

This study compared the effects of the "thinking aloud" (TA) morning report (MR), which is characterized by sequential and interactive case discussion by all participants, with "regular" MR for clinical skill training of young physicians. Between February 2011 and February 2014, young physicians [including postgraduate year-1 (PGY1) residents, interns, and clerks) from our hospital were sequentially enrolled and followed for 3 months. The self- and rater-assessed educational values of two MR models for building up clinical skills of young physicians were compared. The junior (intern and clerk) attendees had higher self-assessed educational values scores and reported post-training application frequency of skills trained by TA MR compared with the senior (PGY1 resident) attendees. Higher average and percentage of increased overall rater-assessed OSCE scores were noted among the regular MR senior attendees and TA MR junior attendees than in their corresponding control groups (regular MR junior attendees and TA MR senior attendees). Interestingly, regular MRs provided additional beneficial effects for establishing the "professionalism, consulting skills and organization efficiency" aspects of clinical skills of senior/junior attendees. Moreover, senior and junior attendees benefited the most by participating in seven sessions of regular MR and TA MR each month, respectively. TA MR effectively trains junior attendees in basic clinical skills, whereas regular MR enhances senior attendees' "work reports, professionalism, organizational efficiency, skills in dealing with controversial and professional issues." Undoubtedly, all elements of the two MR models should be integrated together to ensure patient safety and good discipline among young physicians. Copyright © 2015. Published by Elsevier Taiwan.

Assessing Thinking Skills in Astro 101: Do We Make an Impact?

Science.gov (United States)

Bruning, D.

2005-12-01

Most instructors agree that a major goal of "Astronomy 101" is to develop thinking skills in our students (Partridge and Greenstein, AER 2, 46, 2003). Much educational research in astronomy has initially concentrated on "best practices" for improving student learning (development of "think-pair-share", lecture tutorials, peer tutoring, etc.). Little has been done to date to assess our efforts to improve student thinking skills and students' desire to think more deeply about the cognitively rich ideas offered in the typical astronomy class. This study surveys several astronomy and physics courses to determine whether general analytical thinking skills increase because of the science course and whether students' attitudes toward cognition improve. Cacioppo, Petty and Kao's "Need for Cognition" scale is used for the latter assessment (J. Personality Assessment 48, 306, 1984). A shortened version of Whimbey and Lochhead's ASI skills instrument is used to assess analytical skills ("Problem Solving and Comprehension," 1986). Preliminary results suggest that students need for cognition does not change in general, although there may be a correlation between increasing need for cognition and improvement in grades through the semester. There is a suggestion that need for cognition is slightly predictive of course performance, but a greater correlation exists between the post-course survey and grades. Gains in general analytical skills have been seen in initial surveys, but correlations with course performance appear elusive.

Formative assessment of GP trainees' clinical skills.

Science.gov (United States)

Wiener-Ogilvie, Sharon; Begg, Drummond

2012-03-01

Clinical skill assessment (CSA) has been an integral part of the Royal College of General Practitioners' membership examination (MRCGP) since 2008. It is an expensive, high-stakes examination with first time pass rates ranging from 76.4 to 81.3. In this paper we describe the South East Scotland Deanery, NHS Education Scotland, pilot of a formative clinical skills assessment (fCSA) using the principles of formative assessment and OSCE. The purpose of the study was to assess the acceptability of the fCSA and to examine whether trainees, identified during the fCSA as 'at risk of failing the MRCGP CSA exam', are more likely to fail the MRCGP CSA exam later on in the year. Trainees were assessed in four clinical skills stations under exam conditions. After each station they were given verbal feedback and subsequently both trainee and their trainer received written feedback. We assessed the value of the exercise through written feedback from trainees and trainers. Each trainee's performance in fCSA was triangulated with trainer assessment to identify 'flagged trainees'. We compared flagged and non-flagged trainees' performance in MRCGP CSA. Both trainees and trainers highly rated the fCSA. Overall 97% of non-flagged trainees have passed the RCGP CSA exam by May of that year in comparison to 80% of flagged trainees who have passed the RCGP CSA (P = 0.005). Trainers and trainees rated the fCSA as excellent and useful. We were able to demonstrate that the fCSA can be used to identify those trainees likely to fail the RCGP CSA. Contrary to reservations about the potential to demoralise trainees, the fCSA was viewed as a useful and a positive experience by both trainees and trainers. In addition, we suggest that feedback from fCSA was useful in triggering appropriate educational interventions. Early intervention with trainees who are predicted to fail the CSA has the potential to reduce deaneries overall fail rate. Preventing one trainee failure could save over £30 000.

Development of assessment instruments to measure critical thinking skills

Science.gov (United States)

Sumarni, W.; Supardi, K. I.; Widiarti, N.

2018-04-01

Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

The development and validation of a golf swing and putt skill assessment for children.

Science.gov (United States)

Barnett, Lisa M; Hardy, Louise L; Brian, Ali S; Robertson, Sam

2015-03-01

The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument's discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p < 0.001). The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90) and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82), although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key pointsGolf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level

Are general surgeons able to accurately self-assess their level of technical skills?

Science.gov (United States)

Rizan, C; Ansell, J; Tilston, T W; Warren, N; Torkington, J

2015-11-01

Self-assessment is a way of improving technical capabilities without the need for trainer feedback. It can identify areas for improvement and promote professional medical development. The aim of this review was to identify whether self-assessment is an accurate form of technical skills appraisal in general surgery. The PubMed, MEDLINE(®), Embase(™) and Cochrane databases were searched for studies assessing the reliability of self-assessment of technical skills in general surgery. For each study, we recorded the skills assessed and the evaluation methods used. Common endpoints between studies were compared to provide recommendations based on the levels of evidence. Twelve studies met the inclusion criteria from 22,292 initial papers. There was no level 1 evidence published. All papers compared the correlation between self-appraisal versus an expert score but differed in the technical skills assessment and the evaluation tools used. The accuracy of self-assessment improved with increasing experience (level 2 recommendation), age (level 3 recommendation) and the use of video playback (level 3 recommendation). Accuracy was reduced by stressful learning environments (level 2 recommendation), lack of familiarity with assessment tools (level 3 recommendation) and in advanced surgical procedures (level 3 recommendation). Evidence exists to support the reliability of self-assessment of technical skills in general surgery. Several variables have been shown to affect the accuracy of self-assessment of technical skills. Future work should focus on evaluating the reliability of self-assessment during live operating procedures.

Multi-Institutional Validation of an OSATS for the Assessment of Cystoscopic and Ureteroscopic Skills.

Science.gov (United States)

Argun, Omer Burak; Chrouser, Kristin; Chauhan, Sanket; Monga, Manoj; Knudsen, Bodo; Box, Geoffrey N; Lee, David I; Gettman, Matthew T; Poniatowski, Lauren H; Wang, Qi; Reihsen, Troy E; Sweet, Robert M

2015-10-01

We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Design and Assessment of Online, Interactive Tutorials That Teach Science Process Skills.

Science.gov (United States)

Kramer, Maxwell; Olson, Dalay; Walker, J D

2018-06-01

Explicit emphasis on teaching science process skills leads to both gains in the skills themselves and, strikingly, deeper understanding of content. Here, we created and tested a series of online, interactive tutorials with the goal of helping undergraduate students develop science process skills. We designed the tutorials in accordance with evidence-based multimedia design principles and student feedback from usability testing. We then tested the efficacy of the tutorials in an introductory undergraduate biology class. On the basis of a multivariate ordinary least-squares regression model, students who received the tutorials are predicted to score 0.82 points higher on a 15-point science process skill assessment than their peers who received traditional textbook instruction on the same topic. This moderate but significant impact indicates that well-designed online tutorials can be more effective than traditional ways of teaching science process skills to undergraduate students. We also found trends that suggest the tutorials are especially effective for nonnative English-speaking students. However, due to a limited sample size, we were unable to confirm that these trends occurred due to more than just variation in the student group sampled.

A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

Science.gov (United States)

Winkel, Abigail Ford; Lerner, Veronica; Zabar, Sondra R; Szyld, Demian

2013-01-01

Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Assessing computer skills in Tanzanian medical students: an elective experience

Directory of Open Access Journals (Sweden)

Melvin Rob

2004-08-01

Full Text Available Abstract Background One estimate suggests that by 2010 more than 30% of a physician's time will be spent using information technology tools. The aim of this study is to assess the information and communication technologies (ICT skills of medical students in Tanzania. We also report a pilot intervention of peer mentoring training in ICT by medical students from the UK tutoring students in Tanzania. Methods Design: Cross sectional study and pilot intervention study. Participants: Fourth year medical students (n = 92 attending Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania. Main outcome measures: Self-reported assessment of competence on ICT-related topics and ability to perform specific ICT tasks. Further information related to frequency of computer use (hours per week, years of computer use, reasons for use and access to computers. Skills at specific tasks were reassessed for 12 students following 4 to 6 hours of peer mentoring training. Results The highest levels of competence in generic ICT areas were for email, Internet and file management. For other skills such as word processing most respondents reported low levels of competence. The abilities to perform specific ICT skills were low – less than 60% of the participants were able to perform the core specific skills assessed. A period of approximately 5 hours of peer mentoring training produced an approximate doubling of competence scores for these skills. Conclusion Our study has found a low level of ability to use ICT facilities among medical students in a leading university in sub-Saharan Africa. A pilot scheme utilising UK elective students to tutor basic skills showed potential. Attention is required to develop interventions that can improve ICT skills, as well as computer access, in order to bridge the digital divide.

Self vs expert assessment of technical and non-technical skills in high fidelity simulation.

Science.gov (United States)

Arora, Sonal; Miskovic, Danilo; Hull, Louise; Moorthy, Krishna; Aggarwal, Rajesh; Johannsson, Helgi; Gautama, Sanjay; Kneebone, Roger; Sevdalis, Nick

2011-10-01

Accurate assessment is imperative for learning, feedback and progression. The aim of this study was to examine whether surgeons can accurately self-assess their technical and nontechnical skills compared with expert faculty members' assessments. Twenty-five surgeons performed a laparoscopic cholecystectomy (LC) in a simulated operating room. Technical and nontechnical performance was assessed by participants and faculty members using the validated Objective Structured Assessment of Technical Skills (OSATS) and the Non-Technical Skills for Surgeons scale (NOTSS). Assessment of technical performance correlated between self and faculty members' ratings for experienced (median score, 30.0 vs 31.0; ρ = .831; P = .001) and inexperienced (median score, 22.0 vs 28.0; ρ = .761; P = .003) surgeons. Assessment of nontechnical skills between self and faculty members did not correlate for experienced surgeons (median score, 8.0 vs 10.5; ρ = -.375; P = .229) or their more inexperienced counterparts (median score, 9.0 vs 7.0; ρ = -.018; P = .953). Surgeons can accurately self-assess their technical skills in virtual reality LC. Conversely, formal assessment with faculty members' input is required for nontechnical skills, for which surgeons lack insight into their behaviours. Copyright © 2011 Elsevier Inc. All rights reserved.

Developing Enterprise Skills through Peer-Assessed Pitch Presentations

Science.gov (United States)

Faherty, Anna

2015-01-01

Purpose: The purpose of this paper is to investigate the impact of using summative peer assessment to develop enterprise skills within higher education. Design/methodology/approach: An empirical investigation analysing students own perceptions of the peer assessment process to evaluate its impact. Findings: Participating students indicate that…

Investigating Secondary School Students' Unmediated Peer Assessment Skills

Science.gov (United States)

Tsivitanidou, Olia E.; Zacharia, Zacharias C.; Hovardas, Tasos

2011-01-01

The purpose of this study was to investigate secondary school students' unmediated peer assessment skills. Specifically, 36 seventh graders, without receiving any kind of support, were anonymously assigned to reciprocally assess their peers' science web-portfolios. Additionally, students' attitudes towards and intentions about the use of…

Developing model-making and model-breaking skills using direct measurement video-based activities

Science.gov (United States)

Vonk, Matthew; Bohacek, Peter; Militello, Cheryl; Iverson, Ellen

2017-12-01

This study focuses on student development of two important laboratory skills in the context of introductory college-level physics. The first skill, which we call model making, is the ability to analyze a phenomenon in a way that produces a quantitative multimodal model. The second skill, which we call model breaking, is the ability to critically evaluate if the behavior of a system is consistent with a given model. This study involved 116 introductory physics students in four different sections, each taught by a different instructor. All of the students within a given class section participated in the same instruction (including labs) with the exception of five activities performed throughout the semester. For those five activities, each class section was split into two groups; one group was scaffolded to focus on model-making skills and the other was scaffolded to focus on model-breaking skills. Both conditions involved direct measurement videos. In some cases, students could vary important experimental parameters within the video like mass, frequency, and tension. Data collected at the end of the semester indicate that students in the model-making treatment group significantly outperformed the other group on the model-making skill despite the fact that both groups shared a common physical lab experience. Likewise, the model-breaking treatment group significantly outperformed the other group on the model-breaking skill. This is important because it shows that direct measurement video-based instruction can help students acquire science-process skills, which are critical for scientists, and which are a key part of current science education approaches such as the Next Generation Science Standards and the Advanced Placement Physics 1 course.

A contextual approach to social skills assessment in the peer group: who is the best judge?

Science.gov (United States)

Kwon, Kyongboon; Kim, Elizabeth Moorman; Sheridan, Susan M

2012-09-01

Using a contextual approach to social skills assessment in the peer group, this study examined the criterion-related validity of contextually relevant social skills and the incremental validity of peers and teachers as judges of children's social skills. Study participants included 342 (180 male and 162 female) students and their classroom teachers (N = 22) from rural communities. As expected, contextually relevant social skills were significantly related to a variety of social status indicators (i.e., likability, peer- and teacher-assessed popularity, reciprocated friendships, clique centrality) and positive school functioning (i.e., school liking and academic competence). Peer-assessed social skills, not teacher-assessed social skills, demonstrated consistent incremental validity in predicting various indicators of social status outcomes; peer- and teacher-assessed social skills alike showed incremental validity in predicting positive school functioning. The relation between contextually relevant social skills and study outcomes did not vary by child gender. Findings are discussed in terms of the significance of peers in the assessment of children's social skills in the peer group as well as the usefulness of a contextual approach to social skills assessment.

Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality.

Science.gov (United States)

Gallagher, A G; Richie, K; McClure, N; McGuigan, J

2001-11-01

Objective assessment of psychomotor skills in surgery is now a priority; however, this assessment is difficult to achieve because of measurement difficulties associated with the reliability and validity of assessing surgical skills in vivo and in the laboratory. In this study virtual reality (VR) was used to overcome these problems in the objective psychomotor assessment of senior, junior, and novice laparoscopists. Twelve experienced laparoscopic surgeons (performed >50 Minimal Access Surgery (MAS) procedures), 12 inexperienced laparoscopic surgeons (psychomotor skills for laparoscopic surgery.

Instructor and Dental Student Perceptions of Clinical Communication Skills via Structured Assessments.

Science.gov (United States)

McKenzie, Carly T

2016-05-01

The aim of this study was to use structured assessments to assess dental students' clinical communication skills exhibited during patient appointments. Fourth-year dental students (n=55) at the University of Alabama at Birmingham evaluated their own interpersonal skills in a clinical setting utilizing the Four Habits Coding Scheme. An instructor also assessed student-patient clinical communication. These assessments were used to identify perceived strengths and weaknesses in students' clinical communication. Both instructor assessments and student self-assessments pinpointed the following clinical communication skills as effective the most often: patient greeting, avoidance of jargon, and non-verbal behavior. There was also relative agreement between instructor assessments and student self-assessments regarding clinical communication skills that were rated as not effective most frequently: ensuring patient comprehension, identification of patient feelings, and exploration of barriers to treatment. These resulted pointed to strengths and weaknesses in the portion of the curriculum designed to prepare students for effective provider-patient communication. These results may suggest a need for the school's current behavioral science curriculum to better address discussion of potential treatment barriers and patient feelings as well as techniques to ensure patient comprehension.

[Use of physical assessment skills and education needs of advanced practice nurses and nurse specialists].

Science.gov (United States)

Shin, Hyunsook; Kim, Bog-Ja; Kang, Hee Sun

2009-10-01

The study was done to investigate physical assessment skills used by, and educational needs of, advanced practice nurses (APNs) and nurse specialists in Korea. A total of 123 APNs and nurse specialists working in five major hospitals in Seoul were surveyed from July 15 to August 20, 2007. Fourteen skills out of 126 items were reported as being performed on a regular basis by participants. The majority of these skills involved general observation. Forty-six skills were rarely used. Some participants showed a lack of confidence in certain assessment skills, such as in doing a rectal or pelvic exam, and the use of some assessment equipment. Over 90% of participants required in-depth education on health assessment provided by specialists or nursing professional organizations. More educational opportunities in physical assessment should be provided including education programs based on the nurses' skill levels and needs. This effort will help to increase confidence of APNs and nurse specialists in physical assessment skills, ultimately resulting in better nursing outcomes.

Preliminary Analysis of Assessment Instrument Design to Reveal Science Generic Skill and Chemistry Literacy

Science.gov (United States)

Sumarni, Woro; Sudarmin; Supartono, Wiyanto

2016-01-01

The purpose of this research is to design assessment instrument to evaluate science generic skill (SGS) achievement and chemistry literacy in ethnoscience-integrated chemistry learning. The steps of tool designing refers to Plomp models including 1) Investigation Phase (Prelimenary Investigation); 2) Designing Phase (Design); 3)…

Objective structured assessment of technical skills evaluation of theoretical compared with hands-on training of shoulder dystocia management: a randomized controlled trial.

Science.gov (United States)

Buerkle, Bernd; Pueth, Julia; Hefler, Lukas A; Tempfer-Bentz, Eva-Katrin; Tempfer, Clemens B

2012-10-01

To compare the skills of performing a shoulder dystocia management algorithm after hands-on training compared with demonstration. We randomized medical students to a 30-minute hands-on (group 1) and a 30-minute demonstration (group 2) training session teaching a standardized shoulder dystocia management scheme on a pelvic training model. Participants were tested with a 22-item Objective Structured Assessment of Technical Skills scoring system after training and 72 hours thereafter. Objective Structured Assessment of Technical Skills scores were the primary outcome. Performance time, self-assessment, confidence, and global rating scale were the secondary outcomes. Statistics were performed using Mann-Whitney U test, χ test, and multiple linear regression analysis. Two hundred three participants were randomized. Objective Structured Assessment of Technical Skills scores were significantly higher in group 1 (n=103) compared with group 2 (n=100) (17.95±3.14 compared with 15.67±3.18, respectively; PTechnical Skills scores were still significantly higher in group 1 (n=67) compared with group 2 (n=60) (18.17±2.76 compared with 14.98±3.03, respectively; PTechnical Skills scores. Hands-on training helps to achieve a significant improvement of shoulder dystocia management on a pelvic training model. www.ClinicalTrials.gov, NCT01618565. I.

A qualitative study of advanced nurse practitioners’ use of physical assessment skills in the community: shifting skills across professional boundaries

OpenAIRE

Raleigh, Mary; Allan, Helen T.

2017-01-01

Aim\\ud To explore multiple perspectives on the use of physical assessment skills by Advanced Nurse Practitioners in the UK\\ud Background \\ud Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by Advanced Nurse Practitioners' on the community.\\ud Design \\ud Case study\\ud Methodology and methods. \\ud A qualitative interpretative single-embedded case study of 22 participants from South of England. ...

Assessing Change in High School Student Information Literacy Using the Tool for Real-Time Assessment of Information Literacy Skills

Science.gov (United States)

Kovalik, Cindy L.; Yutzey, Susan D.; Piazza, Laura M.

2012-01-01

Change in high school student information literacy (IL) knowledge and skills, from freshman year to senior year in high school was the focus of this quasi-experimental research project. Researchers used a free information literacy skills assessment tool entitled TRAILS (Tool for Real-time Assessment of Information Literacy Skills) to measure…

The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

Directory of Open Access Journals (Sweden)

Lisa M. Barnett, Louise L. Hardy, Ali S. Brian

2015-03-01

Full Text Available The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test. A Delphi consultation (with golf industry professionals and researchers in movement skill assessment was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24. Children (n = 43 aged 6-10 years (M = 7.8 years, SD = 1.3 were assessed in both skills live in the field by one rater at Time 1(T1. A subset of children (n = 28 had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3. An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years. Intraclass correlations (ICC assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3. Paired t-tests assessed any systematic differences between live and video assessments (T1 and between T2 and T3. Older children were more skilled (F (2, 40 = 11.18, p < 0.001. The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90 and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82, although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback.

Peer-assisted learning model enhances clinical clerk's procedural skills.

Science.gov (United States)

Huang, Chia-Chang; Hsu, Hui-Chi; Yang, Ling-Yu; Chen, Chen-Huan; Yang, Ying-Ying; Chang, Ching-Chih; Chuang, Chiao-Lin; Lee, Wei-Shin; Lee, Fa-Yauh; Hwang, Shinn-Jang

2018-05-17

Failure to transfer procedural skills learned in a laboratory to the bedside is commonly due to a lack of peer support/stimulation. A digital platform (Facebook) allows new clinical clerks to share experiences and tips that help augment their procedural skills in a peer-assisted learning/teaching method. This study aims to investigate the effectiveness of the innovation of using the digital platform to support the transfer of laboratory-trained procedural skills in the clinical units. Volunteer clinical clerks (n = 44) were enrolled into the peer-assisted learning (PAL) group, which was characterized by the peer-assisted learning of procedural skills during their final 3-month clinical clerkship block. Other clerks (n = 51) did not join the procedural skills-specific Facebook group and served as the self-directed learning regular group. The participants in both the PAL and regular groups completed pre- and post-intervention self-assessments for general self-assessed efficiency ratings (GSER) and skills specific self-assessed efficiency ratings (SSSER) for performing vein puncture, intravenous (IV) catheter and nasogastric (NG) tube insertion. Finally, all clerks received the post-intervention 3-station Objective Structured Clinical Skills Examination (OSCE) to test their proficiency for the abovementioned three procedural skills. Higher cumulative numbers of vein punctures, IV catheter insertions and NG tube insertions at the bedside were carried out by the PAL group than the regular group. A greater improvement in GSERs and SSSERs for medical procedures was found in the PAL group than in the regular group. The PAL group obtained higher procedural skills scores in the post-intervention OSCEs than the regular group. Our study suggested that the implementation of a procedural skill-specific digital platform effectively helps clerks to transfer laboratory-trained procedural skills into the clinical units. In comparison with the regular self-directed learning

Nursing assessment of older people who are in hospital: exploring registered nurses' understanding of their assessment skills.

Science.gov (United States)

Penney, Wendy; Poulter, Nola; Cole, Clare; Wellard, Sally

2016-01-01

Nurses worldwide are expected to take a leading role in caring for older people. Considerable literature dedicated to the range and application of assessment skills used by nurses vary. There is limited knowledge of registered nurses' (RNs) views of their assessment of older adults. The aim of this project was to explore RNs current perceptions of nursing assessment, and the core skills they identified as necessary. A qualitative descriptive design study was conducted in three inpatient units in one regional hospital in Victoria. Date were collected through participant observation of RNs (n = 13) followed by 1:1 semi-structured interviews. Data were analysed thematically. This research has illuminated that an ill-defined repertoire of skills was used by RNs when assessing older persons. Skills identified appeared to be based on years of personal-professional experience. Differences were noted between the descriptions nurses gave and what was observed during interactions with older persons.

Impact of tailored feedback in assessment of communication skills for medical students.

Science.gov (United States)

Uhm, Seilin; Lee, Gui H; Jin, Jeong K; Bak, Yong I; Jeoung, Yeon O; Kim, Chan W

2015-01-01

Finding out the effective ways of teaching and assessing communication skills remain a challenging part of medication education. This study aims at exploring the usefulness and effectiveness of having additional feedback using qualitative analysis in assessment of communication skills in undergraduate medical training. We also determined the possibilities of using qualitative analysis in developing tailored strategies for improvement in communication skills training. This study was carried out on medical students (n=87) undergoing their final year clinical performance examination on communication skills using standardized patient by video-recording and transcribing their performances. Video-recordings of 26 students were randomly selected for qualitative analysis, and additional feedback was provided. We assessed the level of acceptance of communication skills scores between the study and nonstudy group and within the study group, before and after receiving feedback based on qualitative analysis. There was a statistically significant increase in the level of acceptance of feedback after delivering additional feedback using qualitative analysis, where the percentage of agreement with feedback increased from 15.4 to 80.8% (pskills assessment gives essential information for medical students to learn and self-reflect, which could potentially lead to improved communication skills. As evident from our study, feedback becomes more meaningful and effective with additional feedback using qualitative analysis.

Assessment of HIV/AIDS and Life Skills Delivery in Primary Schools in Tanzania

Science.gov (United States)

Rushahu, Bernadetha Gabriel

2015-01-01

This study was conducted to assess the effectiveness of HIV/AIDS and the Life Skills Education delivery in primary schools in Tanzania. Specifically the study investigated pupils' views about the effect of HIV/AIDS and Life Skills teaching in primary schools in Tanzania; assessed pupils' knowledge related to HIV/AIDS and Life Skills education, and…

The primacy of vital signs--acute care nurses' and midwives' use of physical assessment skills: a cross sectional study.

Science.gov (United States)

Osborne, Sonya; Douglas, Clint; Reid, Carol; Jones, Lee; Gardner, Glenn

2015-05-01

Registered nurses and midwives play an essential role in detecting patients at risk of deterioration through ongoing assessment and action in response to changing health status. Yet, evidence suggests that clinical deterioration frequently goes unnoticed in hospitalised patients. While much attention has been paid to early warning and rapid response systems, little research has examined factors related to physical assessment skills. To determine a minimum data set of core skills used during nursing assessment of hospitalised patients and identify nurse and workplace predictors of the use of physical assessment to detect patient deterioration. The study used a single-centre, cross-sectional survey design. The study included 434 registered nurses and midwives (Grades 5-7) involved in clinical care of patients on acute care wards, including medicine, surgery, oncology, mental health and maternity service areas, at a 929-bed tertiary referral teaching hospital in Southeast Queensland, Australia. We conducted a hospital-wide survey of registered nurses and midwives using the 133-item Physical Assessment Skills Inventory and the 58-item Barriers to Registered Nurses' Use of Physical Assessment Scale. Median frequency for each physical assessment skill was calculated to determine core skills. To explore predictors of core skill utilisation, backward stepwise general linear modelling was conducted. Means and regression coefficients are reported with 95% confidence intervals. A p value skills used by most nurses every time they worked included assessment of temperature, oxygen saturation, blood pressure, breathing effort, skin, wound and mental status. Reliance on others and technology (F=35.77, pskill use. The increasing acuity of the acute care patient plausibly warrants more than vital signs assessment; however, our study confirms nurses' physical assessment core skill set is mainly comprised of vital signs. The focus on these endpoints of deterioration as dictated by

Assessing maths literacy skills in type 1 diabetic children and their ...

African Journals Online (AJOL)

Background: It is essential that children have adequate numeracy and literacy skills in order to manage their diabetes effectively. The objective was to undertake a pilot study to assess the level of numeracy skills in type 1 diabetic children and their caregivers, and to ascertain if there was a deficit in these skills.

Concrete Steps for Assessing the "Soft Skills" in an MBA Program

Science.gov (United States)

Ingols, Cynthia; Shapiro, Mary

2014-01-01

In 2006, our School of Management began the serious path of assessing both the "hard skills" (such as accounting, finance, and strategy) and the "soft skills" (such as leadership, team work, and ethics) of our MBA Program. The data generated from examining the "soft skills" that we want students to learn within our…

A Guttman scale for assessing condom use skills among college students.

Science.gov (United States)

Lindemann, Dana F; Brigham, Thomas A

2003-03-01

HIV risk-reduction interventions frequently teach correct condom use skills, yet few researchers actually measure those skills. Without measuring condom use skills, it is not possible to evaluate the effectiveness of condom use interventions, or determine what variables may be related to those skills. The Measure of Observed Condom Use Skills (MOCUS) was developed using standard Guttman scaling procedures, and administered to 106 female and 71 male undergraduates. The MOCUS was administered by the primary investigator to each participant individually. Guttman scale analyses demonstrated the MOCUS has acceptable reproducibility. These findings support future use of the MOCUS to assess condom use skills.

21st Century Skills: What Are They and How Do We Assess Them?

Science.gov (United States)

Geisinger, Kurt F.

2016-01-01

One of the "hottest" topics in the educational measurement community in the past decade has been the assessment of 21st century skills. This special issue demonstrates work being performed in this realm. The present article provides a context for the four primary articles that follow and a brief but broad view of some models of 21st…

Ocean forecasting in terrain-following coordinates: Formulation and skill assessment of the Regional Ocean Modeling System

Science.gov (United States)

Haidvogel, D.B.; Arango, H.; Budgell, W.P.; Cornuelle, B.D.; Curchitser, E.; Di, Lorenzo E.; Fennel, K.; Geyer, W.R.; Hermann, A.J.; Lanerolle, L.; Levin, J.; McWilliams, J.C.; Miller, A.J.; Moore, A.M.; Powell, T.M.; Shchepetkin, A.F.; Sherwood, C.R.; Signell, R.P.; Warner, J.C.; Wilkin, J.

2008-01-01

Systematic improvements in algorithmic design of regional ocean circulation models have led to significant enhancement in simulation ability across a wide range of space/time scales and marine system types. As an example, we briefly review the Regional Ocean Modeling System, a member of a general class of three-dimensional, free-surface, terrain-following numerical models. Noteworthy characteristics of the ROMS computational kernel include: consistent temporal averaging of the barotropic mode to guarantee both exact conservation and constancy preservation properties for tracers; redefined barotropic pressure-gradient terms to account for local variations in the density field; vertical interpolation performed using conservative parabolic splines; and higher-order, quasi-monotone advection algorithms. Examples of quantitative skill assessment are shown for a tidally driven estuary, an ice-covered high-latitude sea, a wind- and buoyancy-forced continental shelf, and a mid-latitude ocean basin. The combination of moderate-order spatial approximations, enhanced conservation properties, and quasi-monotone advection produces both more robust and accurate, and less diffusive, solutions than those produced in earlier terrain-following ocean models. Together with advanced methods of data assimilation and novel observing system technologies, these capabilities constitute the necessary ingredients for multi-purpose regional ocean prediction systems. 

Evaluating structured assessment of anaesthesiologists' non-technical skills

DEFF Research Database (Denmark)

Jepsen, R M H G; Dieckmann, P; Spanager, L

2016-01-01

BACKGROUND: Non-technical skills (NTS) are essential for safe and efficient anaesthesia. Assessment instruments with appropriate validity evidence can be used to ensure that anaesthesiologists possess the NTS necessary to deliver high-standard patient care. The aims were to collect validity...... evidence using a contemporary validity framework for the assessment instrument Anaesthesiologists' Non-Technical Skills in Denmark (ANTSdk) regarding response process and internal structure (including reliability), and to investigate the effect of rater training on these properties. METHODS: An explorative...... study was undertaken at the Danish Institute for Medical Simulation, Copenhagen, Denmark. In a 1-day session, using ANTSdk, a convenience sample of 19 anaesthesiologists rated trainee anaesthesiologists' NTS in nine video-recorded simulation scenarios before and after a 3-h training session. RESULTS...

The IDEA Assessment Tool: Assessing the Reporting, Diagnostic Reasoning, and Decision-Making Skills Demonstrated in Medical Students' Hospital Admission Notes.

Science.gov (United States)

Baker, Elizabeth A; Ledford, Cynthia H; Fogg, Louis; Way, David P; Park, Yoon Soo

2015-01-01

Construct: Clinical skills are used in the care of patients, including reporting, diagnostic reasoning, and decision-making skills. Written comprehensive new patient admission notes (H&Ps) are a ubiquitous part of student education but are underutilized in the assessment of clinical skills. The interpretive summary, differential diagnosis, explanation of reasoning, and alternatives (IDEA) assessment tool was developed to assess students' clinical skills using written comprehensive new patient admission notes. The validity evidence for assessment of clinical skills using clinical documentation following authentic patient encounters has not been well documented. Diagnostic justification tools and postencounter notes are described in the literature (1,2) but are based on standardized patient encounters. To our knowledge, the IDEA assessment tool is the first published tool that uses medical students' H&Ps to rate students' clinical skills. The IDEA assessment tool is a 15-item instrument that asks evaluators to rate students' reporting, diagnostic reasoning, and decision-making skills based on medical students' new patient admission notes. This study presents validity evidence in support of the IDEA assessment tool using Messick's unified framework, including content (theoretical framework), response process (interrater reliability), internal structure (factor analysis and internal-consistency reliability), and relationship to other variables. Validity evidence is based on results from four studies conducted between 2010 and 2013. First, the factor analysis (2010, n = 216) yielded a three-factor solution, measuring patient story, IDEA, and completeness, with reliabilities of .79, .88, and .79, respectively. Second, an initial interrater reliability study (2010) involving two raters demonstrated fair to moderate consensus (κ = .21-.56, ρ =.42-.79). Third, a second interrater reliability study (2011) with 22 trained raters also demonstrated fair to moderate agreement

STUDENTS’ COMMUNICATION SKILLS ASSESSMENT BY EXTERNAL LECTURERS AND INDUSTRY REPRESENTATIVES

Directory of Open Access Journals (Sweden)

NOORFAZILA KAMAL

2016-11-01

Full Text Available Soft skills, especially communication skills, are important skills which each graduate must possess. Accordingly, several courses and approaches have been carried out in universities to train students in communication skills. The skills are normally evaluated by course lecturers. However, assessments by a third party from outside the university are valuable so that the students’ ahievements may be weighed against external evaluators’ point of views. In the Department of Electrical, Electronic and Systems Engineering (DEESE, Universiti Kebangsaan Malaysia (UKM, communication skills assessment by external lecturers and industry representatives are performed on Hari Poster JKEES, where students present their final year project poster. There are two categories of evaluation, namely project and communication skills. The project evaluation covers content, result and impact, while communication skills evaluation covers poster layout and design, and delivery. This study only analyse the students’ communication skills achievement. The participants of this study consists of 109 final year students from two batches, of which 51 students are from year 2014 and the other 58 students from year 2015. The results show that for the year 2014 students, the mean mark given by external lecturers in layout and design category is 6.7, while the mean mark from industry evaluators is 6.5. For the 2015 batch, the mean mark in the layout and design category is 6.3 from external lecturers and 5.9 from industry evaluators. In the delivery category, the mean marks for the 2014 batch are 7.1 and 6.6 from external lecturers and industry evaluators, espectively. Meanwhile, for the 2015 batch, the mean marks by external lecturers and industry evaluators are 6.3 and 5.8, respectively. The results show that both external lecturers and industry representatives judged DEESE students’ communication skills to be good.

Modeling attacking of high skills volleyball players

Directory of Open Access Journals (Sweden)

Vladimir Gamaliy

2014-12-01

Full Text Available Purpose: to determine the model indicators of technical and tactical actions in the attack highly skilled volleyball players. Material and Methods: the study used statistical data of major international competitions: Olympic Games – 2012 World Championships – 2010, World League – 2010–2014 European Championship – 2010–2014. A total of 130 analyzed games. Methods were used: analysis and generalization of scientific and methodological literature, analysis of competitive activity highly skilled volleyball players, teacher observation, modeling technical and tactical actions in attacking highly skilled volleyball players. Results: it was found that the largest volume application of technical and tactical actions in the attack belongs to the group tactics «supple movement», whose indicator is 21,3%. The smallest amount of application belongs to the group tactics «flight level» model whose indicators is 5,4%, the efficiency of 3,4%, respectively. It is found that the power service in the jump from model parameters used in 51,6% of cases, the planning targets – 21,7% and 4,4% planning to reduce. Attacks performed with the back line, on model parameters used in the amount of 20,8% efficiency –13,7%. Conclusions: we prove that the performance of technical and tactical actions in the attack can be used as model in the control system of training and competitive process highly skilled volleyball players

Cognitive skills training in digital era: A paradigm shift in surgical education using the TaTME model.

Science.gov (United States)

Knol, Joep; Keller, Deborah S

2018-04-30

Surgical competence is a complex, multifactorial process, requiring ample time and training. Optimal training is based on acquiring knowledge and psychomotor and cognitive skills. Practicing surgical skills is one of the most crucial tasks for both the novice surgeon learning new procedures and surgeons already in practice learning new techniques. Focus is placed on teaching traditional technical skills, but the importance of cognitive skills cannot be underestimated. Cognitive skills allow recognizing environmental cues to improve technical performance including situational awareness, mental readiness, risk assessment, anticipating problems, decision-making, adaptation, and flexibility, and may also accelerate the trainee's understanding of a procedure, formalize the steps being practiced, and reduce the overall training time to become technically proficient. The introduction and implementation of the transanal total mesorectal excision (TaTME) into practice may be the best demonstration of this new model of teaching and training, including pre-training, course attendance, and post-course guidance on technical and cognitive skills. To date, the TaTME framework has been the ideal model for structured training to ensure safe implementation. Further development of metrics to grade successful learning and assessment of long term outcomes with the new pathway will confirm the success of this training model. Copyright © 2018 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. All rights reserved.

Certified Basic Life Support Instructors Assess Cardiopulmonary Resuscitation Skills Poorly

DEFF Research Database (Denmark)

Hansen, Camilla; Rasmussen, Stinne E; Kristensen, Mette Amalie

2016-01-01

Introduction: High-quality cardiopulmonary resuscitation (CPR) improves survival from cardiac arrest. During basic life support (BLS) training, instructors assess CPR skills to enhance learning outcome. Emergency department staff and senior residents have been shown to assess chest compression...... quality poorly. Currently no studies have evaluated CPR assessment among certified BLS instructors. The aim of this study was to investigate certified BLS instructors’ assessment of chest compressions and rescue breathing.Methods: Data were collected at BLS courses for medical students at Aarhus...... of CPR skills may be beneficial to ensure high-quality learning outcome.Author Disclosures: C. Hansen: None. S.E. Rasmussen: None. M.A. Nebsbjerg: None. M. Stærk: None. B. Løfgren: None....

Self-Assessment of Video-Recorded Presentations: Does It Improve Skills?

Science.gov (United States)

Ritchie, Sian M.

2016-01-01

The opportunity to give oral presentations is important because it helps develop skills that are necessary for many aspects of professional careers. Competencies for oral presentations include appropriate content, design and organization of the presentation, and delivery skills. Self-assessment has been shown to help students develop…

Fostering the development of effective person-centered healthcare communication skills: an interprofessional shared learning model.

Science.gov (United States)

Cavanaugh, James T; Konrad, Shelley Cohen

2012-01-01

To describe the implementation of an interprofessional shared learning model designed to promote the development of person-centered healthcare communication skills. Master of social work (MSW) and doctor of physical therapy (DPT) degree students. The model used evidence-based principles of effective healthcare communication and shared learning methods; it was aligned with student learning outcomes contained in MSW and DPT curricula. Students engaged in 3 learning sessions over 2 days. Sessions involved interactive reflective learning, simulated role-modeling with peer assessment, and context-specific practice of communication skills. The perspective of patients/clients was included in each learning activity. Activities were evaluated through narrative feedback. Students valued opportunities to learn directly from each other and from healthcare consumers. Important insights and directions for future interprofessional learning experiences were gleaned from model implementation. The interprofessional shared learning model shows promise as an effective method for developing person-centered communication skills.

Assessing Gross Motor Skills of Kosovar Preschool Children

Science.gov (United States)

Shala, Merita

2009-01-01

In the light of the new developments in preschool education in Kosovo, this study attempts to carry out an assessment of the development of gross motor skills of preschool children attending institutional education. The emphasis is on creating a set of tests to measure the motor attainments of these children by conducting assessments of the…

The perceived impact of the group practice model on enhancing interpersonal skills of predoctoral dental students.

Science.gov (United States)

Errante, Margaret R; Gill, Gurjinder S; Rodriguez, Tobias E

2018-01-01

The purpose of this study was to assess if a clinical group practice model has an impact on enhancing the interpersonal skills of predoctoral dental students, what factors may influence the development of these skills, and what, if any, are innovative and technological solutions that can potentially influence interpersonal skills in predoctoral dental students. This study surveyed the faculty responsible for teaching the dental students in a recently developed group practice model. Out of 18 eligible group practice leaders at one US dental school, 17 respondents (94.4%) completed the survey. In addition, this study asked the faculty to provide qualitative response and recommendations to improve interpersonal skills. Based on the feedback, a focus group was conducted to explore opportunities to further enhance the skills. The results of the study suggest that the group practice model has a positive and distinct impact on the development of overall interpersonal skills for students. Further research suggests that the greatest impacted areas of personal development are critical thinking skills and teamwork. However, as a way to make the model more effectual, most faculty suggested the need for additional time, for both students and faculty. To some extent, using technology and innovative teaching pedagogies could potentially address the challenge of limited time. Based on the results of the survey, one may conclude that with adequate design and conditions, the group practice model can have a positive effect on the interpersonal skills of its students.

The perceived impact of the group practice model on enhancing interpersonal skills of predoctoral dental students

Science.gov (United States)

Errante, Margaret R; Gill, Gurjinder S; Rodriguez, Tobias E

2018-01-01

Purpose The purpose of this study was to assess if a clinical group practice model has an impact on enhancing the interpersonal skills of predoctoral dental students, what factors may influence the development of these skills, and what, if any, are innovative and technological solutions that can potentially influence interpersonal skills in predoctoral dental students. Methods This study surveyed the faculty responsible for teaching the dental students in a recently developed group practice model. Out of 18 eligible group practice leaders at one US dental school, 17 respondents (94.4%) completed the survey. In addition, this study asked the faculty to provide qualitative response and recommendations to improve interpersonal skills. Based on the feedback, a focus group was conducted to explore opportunities to further enhance the skills. Results The results of the study suggest that the group practice model has a positive and distinct impact on the development of overall interpersonal skills for students. Further research suggests that the greatest impacted areas of personal development are critical thinking skills and teamwork. However, as a way to make the model more effectual, most faculty suggested the need for additional time, for both students and faculty. To some extent, using technology and innovative teaching pedagogies could potentially address the challenge of limited time. Conclusion Based on the results of the survey, one may conclude that with adequate design and conditions, the group practice model can have a positive effect on the interpersonal skills of its students. PMID:29720884

Assessment Work: Examining the Prevalence and Nature of Assessment Competencies and Skills in Student Affairs Job Postings

Science.gov (United States)

Hoffman, John L.; Bresciani, Marilee J.

2010-01-01

This mixed method study explored the assessment-related skills and job duties that student affairs administrators expect from new employees as reflected in 1,759 job openings posted in 2008, of which seven job postings were specialist positions in outcomes-based assessment. The skills and duties required of these seven positions were primarily…

Retrospectively Assessed Early Motor and Current Pragmatic Language Skills in Autistic and Neurotypical Children.

Science.gov (United States)

Stevenson, Jennifer L; Lindley, Caitlin E; Murlo, Nicole

2017-08-01

Autistic individuals often struggle developmentally, even in areas that are not explicit diagnostic criteria, such as motor skills. This study explored the relation between early motor skills, assessed retrospectively, and current pragmatic language skills. Caregivers of neurotypical and autistic children, matched on gender and age, completed assessments of their child's early motor development and current language abilities. Early motor skills were correlated with later pragmatic language skills, and autistic children exhibited fewer motor skills than neurotypical children. In fact, motor skills were a better predictor of an autism spectrum diagnosis than were scores on a measure of current pragmatic language. These results highlight the important role of motor skills in autism spectrum disorders.

Assessment of validity of an OSATS for cystoscopic and ureteroscopic cognitive and psychomotor skills.

Science.gov (United States)

Kishore, Thekke Adiyat; Pedro, Renato N; Monga, Manoj; Sweet, Robert M

2008-12-01

The purpose of the study was to assess the construct validity of an Objective Structured Assessment of Technical Skills (OSATS) developed for cystoscopic and ureteroscopic cognitive and psychomotor skills. An OSATS was designed based on a 14-point comprehensive curriculum prepared by two experts that targeted both cognitive and psychomotor cystoscopic and ureteroscopic skills. Ten urology residents from a single institution with different levels of training were assessed on a series of stations that targeted these skills. Evaluation of cognitive skills was done via a written examination, and psychomotor skills assessment was done by experts using both subjective and objective metrics. Twelve of 15 cognitive tasks and 5 of 5 psychomotor tasks demonstrated construct validity with correlation coefficient (r) more than .75. All three of the cognitive tasks that failed to initially demonstrate validity did so on editorial revision and restructuring of the questions. Our cystoscopic and ureteroscopic OSATS showed excellent construct validity for our population of residents, and we have incorporated it into our urologic skills curriculum.

Construct validation of teacher portfolio assessment : Procedures for improving teacher competence assessment illustrated by teaching students research skills

NARCIS (Netherlands)

Schaaf, M.F. van der

2005-01-01

The study aims to design and test procedures for teacher portfolio assessments. What are suitable procedures to assess teachers' competencies in developing students' research skills? We first searched into the tasks teachers have in teaching students research skills and the competencies needed to

Teacher Compliance and Accuracy in State Assessment of Student Motor Skill Performance

Science.gov (United States)

Hall, Tina J.; Hicklin, Lori K.; French, Karen E.

2015-01-01

Purpose: The purpose of this study was to investigate teacher compliance with state mandated assessment protocols and teacher accuracy in assessing student motor skill performance. Method: Middle school teachers (N = 116) submitted eighth grade student motor skill performance data from 318 physical education classes to a trained monitoring…

Cultural consultation as a model for training multidisciplinary mental healthcare professionals in cultural competence skills: preliminary results.

Science.gov (United States)

Owiti, J A; Ajaz, A; Ascoli, M; de Jongh, B; Palinski, A; Bhui, K S

2014-01-01

Lack of cultural competence in care contributes to poor experiences and outcomes from care for migrants and racial and ethnic minorities. As a result, health and social care organizations currently promote cultural competence of their workforce as a means of addressing persistent poor experiences and outcomes. At present, there are unsystematic and diverse ways of promoting cultural competence, and their impact on clinician skills and patient outcomes is unknown. We developed and implemented an innovative model, cultural consultation service (CCS), to promote cultural competence of clinicians and directly improve on patient experiences and outcomes from care. CCS model is an adaptation of the McGill model, which uses ethnographic methodology and medical anthropological knowledge. The method and approach not only contributes both to a broader conceptual and dynamic understanding of culture, but also to learning of cultural competence skills by healthcare professionals. The CCS model demonstrates that multidisciplinary workforce can acquire cultural competence skills better through the clinical encounter, as this promotes integration of learning into day-to-day practice. Results indicate that clinicians developed a broader and patient-centred understanding of culture, and gained skills in narrative-based assessment method, management of complexity of care, competing assumptions and expectations, and clinical cultural formulation. Cultural competence is defined as a set of skills, attitudes and practices that enable the healthcare professionals to deliver high-quality interventions to patients from diverse cultural backgrounds. Improving on the cultural competence skills of the workforce has been promoted as a way of reducing ethnic and racial inequalities in service outcomes. Currently, diverse models for training in cultural competence exist, mostly with no evidence of effect. We established an innovative narrative-based cultural consultation service in an inner

Multi-informant assessment of transition-related skills and skill importance in adolescents with autism spectrum disorder.

Science.gov (United States)

Hume, Kara; Dykstra Steinbrenner, Jessica; Sideris, John; Smith, Leann; Kucharczyk, Suzanne; Szidon, Kate

2018-01-01

Adolescents with autism spectrum disorder have limited participation in the transition planning process, despite the link between active participation and an improvement in postsecondary education and employment outcomes. The Secondary School Success Checklist was designed to support transition planning for adolescents with autism spectrum disorder by incorporating their own assessments of strengths, skill deficits, and prioritization for instruction along with those of their parents and teachers across multiple skill domains. Findings from more than 500 adolescents with autism spectrum disorder across the United States indicate discrepancies between adolescent, teacher, and parent ratings of skills highlighting the importance of the inclusion of multiple perspectives in transition planning. Although ratings varied, agreement between adolescents with autism spectrum disorder, parents, and teachers across the highest and lowest rated skills suggests the need to broaden the focus on critical transition skills to include problem-solving, planning for life after high school, and self-advocacy.

An Assessment of the Employability Skills Needed by Graduates in the College of Agriculture, Food and Natural Resources at the University of Missouri

Science.gov (United States)

Robinson, J. Shane; Garton, Bryan L.

2008-01-01

The purposes of this descriptive study were to assess graduates' perception of the importance and competence levels of performing identified transferable skills in the workplace and use the Borich (1980) needs assessment model to identify the skills most in need to enhance the curriculum. The findings revealed that solving problems, working…

Assessing study skills among university students: an Iranian survey.

Science.gov (United States)

Didarloo, Alireza; Khalkhali, Hamid Reza

2014-05-05

Numerous studies have revealed that study skills have a constructive role on the academic performance of students, in addition to educational quality, student' intelligence, and their affective characteristics. This study aims to examine study skills and the factors influencing them among the health sciences students of Urmia University of Medical Sciences in Iran. This was a cross-sectional study carried out from May to November 2013. A total of 340 Urmia health sciences students were selected using a simple sampling method. Data were collected using the Study Skills Assessment Questionnaire of Counseling Center of Houston University and analyzed with descriptive and analytical statistics. The mean and standard deviation of the students' study skills were 172.5±23.2, out of a total score of 240. Around 1.2% of the study skills were weak; 86.8%, moderate; and 12%, good. Among the study skills, the scores of time management, and memory and concentration were better than the others. Also, there was a significant positive correlation between study skills scores and the students' family housing status and academic level (Pstudy skills, these were not sufficient and far from good. Improving and promoting the study skills of university students require the designing and implementing of education programs for study strategies. Therefore, decision makers and planners in the educational areas of universities should consider the topic described above.

Assessment of structured physical examination skills training using a retro-pre-questionnaire.

Science.gov (United States)

Piryani, Rano Mal; Shankar, P Ravi; Piryani, Suneel; Thapa, Trilok Pati; Karki, Balmansingh; Khakurel, Mahesh Prasad; Bhandary, Shital

2013-01-01

The effectiveness of physical examination skills (PES) training is very rarely assessed using the "post-then-pre" approach. In this study, a retro-pre-questionnaire was used to study the effect of structured physical examination skills training (SPEST) imparted to second-year undergraduate medical students. KIST Medical College (KISTMC) affiliated to Tribhuvan University Nepal admitted its first batch of MBBS students in November 2008. The university curriculum recommends the involvement of Medicine and Surgery Departments in PES training, but the methods for teaching and assessment are not well defined. KISTMC has made training more structured and involved the Medicine, Surgery, Gynaecology and Obstetrics, Orthopaedics, ENT, Ophthalmology, Paediatrics, and Family Medicine Departments. SPEST includes the teaching/learning of basic PES for 210 minutes once a week for 28 weeks. Self-assessment is done by using a retro-pre-questionnaire at the end of the last session of training, and these data are analysed using SPSS. Out of 100 students, 98 participated in the objective structured clinical examination (OSCE); 82 completed the retro-pre-questionnaire. Forty-six skills representing various systems were selected for inclusion in the retro-pre-questionnaire from among the many skills taught in different departments. The average perceived skills score (maximum score, 46×4=184) before training was 15.9 and increased to 116.5 after training. The increase was statistically significant upon the application of a paired t-test. The students perceived that their level of skills improved after the training. The retro-pre- instrument seems to be useful for assessing the learners' self-reported changes in PES after training if a large number of skills need to be assessed. However, it should be noted that although a retro-pre-questionnaire may reveal valuable information, it is not a substitute for an objective measure or gold standard.

Assessing the Development of Medical Students' Personal and Professional Skills by Portfolio.

Science.gov (United States)

Yielder, Jill; Moir, Fiona

2016-01-01

The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program.

Assessing the Development of Medical Students’ Personal and Professional Skills by Portfolio

Science.gov (United States)

Yielder, Jill; Moir, Fiona

2016-01-01

The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program. PMID:29349315

Aligning CASAS Competencies and Assessments to Basic Skills Content Standards. Second Edition

Science.gov (United States)

CASAS - Comprehensive Adult Student Assessment Systems (NJ1), 2009

2009-01-01

Since its inception, the Comprehensive Adult Student Assessment System (CASAS) has focused on teaching and assessing basic skills in contexts that are relevant and important to adult learners. CASAS has developed and continues to refine a highly formalized hierarchy of competencies, the application of basic skills that adults need to be fully…

THE EFFECT OF INQUIRY TRAINING MODEL USE THE MEDIA PHET AGAINST SCIENCE PROCESS SKILLS AND LOGICAL THINKING SKILLS STUDENTS

Directory of Open Access Journals (Sweden)

Fajrul Wahdi Ginting

2015-12-01

Full Text Available The Purpose of The study: science process skills and logical thinking ability of students who use inquiry learning model training using PhET media; science process skills and logical thinking ability of students who use conventional learning model; and the difference science process skills and logical thinking ability of students to use learning model Inquiry Training using PhET media and conventional learning models. This research is a quasi experimental. Sample selection is done by cluster random sampling are two classes of classes VIII-E and class VIII-B, where the class VIII-E is taught by inquiry training model using media PhET and VIII-B with conventional learning model. The instrument used consisted of tests science process skills such as essay tests and tests of the ability to think logically in the form of multiple-choice tests. The data were analyzed using t test. The results showed that physics science process skills use Inquiry Training models using PhET media is different and showed better results compared with conventional learning model, and logical thinking skills students use Inquiry Training model using PhET media is different and show better results compared with conventional learning, and there is a difference between the ability to think logically and science process skills of students who use Inquiry Training model using PhET media and conventional learning models.

Extended score interval in the assessment of basic surgical skills.

Science.gov (United States)

Acosta, Stefan; Sevonius, Dan; Beckman, Anders

2015-01-01

The Basic Surgical Skills course uses an assessment score interval of 0-3. An extended score interval, 1-6, was proposed by the Swedish steering committee of the course. The aim of this study was to analyze the trainee scores in the current 0-3 scored version compared to a proposed 1-6 scored version. Sixteen participants, seven females and nine males, were evaluated in the current and proposed assessment forms by instructors, observers, and learners themselves during the first and second day. In each assessment form, 17 tasks were assessed. The inter-rater reliability between the current and the proposed score sheets were evaluated with intraclass correlation (ICC) with 95% confidence intervals (CI). The distribution of scores for 'knot tying' at the last time point and 'bowel anastomosis side to side' given by the instructors in the current assessment form showed that the highest score was given in 31 and 62%, respectively. No ceiling effects were found in the proposed assessment form. The overall ICC between the current and proposed score sheets after assessment by the instructors increased from 0.38 (95% CI 0.77-0.78) on Day 1 to 0.83 (95% CI 0.51-0.94) on Day 2. A clear ceiling effect of scores was demonstrated in the current assessment form, questioning its validity. The proposed score sheet provides more accurate scores and seems to be a better feedback instrument for learning technical surgical skills in the Basic Surgical Skills course.

MOJECT: MOTION ANALYSIS TO SUPPORT ASSESSMENT OF SURGICAL SKILLS

NARCIS (Netherlands)

Uineken, Ruben; Groot Jebbink, Erik; Halfwerk, F.R.; Bulten, Anne; Knoben, Peter; Roux, Moritz; Wicik, Ola; Groenier, Marleen

2018-01-01

Assessment of surgical skills is usually performed through direct observation by experts. This is subjective, expensive and requires assessor training. Motion analysis can support objective and cost-effective assessment. The aim of the current study is to design a low-cost, unobtrusive system for

Assessing problem-solving skills in construction education with the virtual construction simulator

Science.gov (United States)

Castronovo, Fadi

problem-solving skills, a new version of the VCS(4) was developed, with new building modules and assessment framework. The design and development of the VCS4 leveraged research in educational psychology, multimedia learning, human-computer interaction, and Building Information Modeling. In this dissertation the researcher aimed to evaluate the pedagogical value of the VCS4 in fostering problem-solving skills. To answer the research questions, a crossover repeated measures quasi-experiment was designed to assess the educational gains that the VCS can provide to construction education. A group of 34 students, attending a fourth-year construction course at a university in the United States was chosen to participate in the experiment. The three learning modules of the VCS were used, which challenged the students to plan and manage the construction process of a wooden pavilion, the steel erection of a dormitory, and the concrete placement of the same dormitory. Based on the results the researcher was able to provide evidence supporting the hypothesis that the chosen sample of construction students were able to gain and retain problem-solving skills necessary to solve complex construction simulation problems, no matter what the sequence with which these modules were played. In conclusion, the presented results provide evidence supporting the theory that educational simulation games can help the learning and retention of transferable problem-solving skills, which are necessary to solve complex construction problems.

Assessment of time management skills: psychometric properties of the Swedish version.

Science.gov (United States)

Janeslätt, Gunnel Kristina; Holmqvist, Kajsa Lidström; White, Suzanne; Holmefur, Marie

2018-05-01

Persons with impaired time management skills are often in need of occupational therapy. Valid and reliable instruments to assess time management and organizational skills are needed for the evaluation of intervention. The purpose of this study was to evaluate the psychometric properties of a Swedish version of the Assessment of Time Management Skills (ATMS-S) for persons with and without impaired time management skills. A total of 238 persons participated in the study, of whom 94 had self-reported impaired time management skills due to mental disorders such as schizophrenic spectrum or neurodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and mild intellectual disabilities, and 144 persons had no reported impaired time management skills. Rasch analysis was used to analyze data. Three subscales were detected: the time management subscale with 11 items, the organization & planning subscale with 11 items, and the subscale of regulation of emotions with 5 items, with excellent to acceptable psychometric properties. The conclusions were that: ATMS-S is a valid instrument for self-rating of time management, organization & planning and for the regulation of emotions. ATMS-S can be useful for persons with mental disorders including mild neurodevelopmental disorders.

Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

Science.gov (United States)

Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

2015-07-01

Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures.

Science.gov (United States)

Gallagher, Anthony G; Smith, C Daniel; Bowers, Steven P; Seymour, Neal E; Pearson, Adam; McNatt, Steven; Hananel, David; Satava, Richard M

2003-09-01

Minimally invasive surgery (MIS) has introduced a new and unique set of psychomotor skills for a surgeon to acquire and master. Although assessment technologies have been proposed, precise and objective psychomotor skills assessment of surgeons performing laparoscopic procedures has not been detailed. Two hundred ten surgeons attending the 2001 annual meeting of the American College of Surgeons in New Orleans who reported having completed more than 50 laparoscopic procedures participated. Subjects were required to complete one box-trainer laparoscopic cutting task and a similar virtual reality task. These tasks were specifically designed to test only psychomotor and not cognitive skills. Both tasks were completed twice. Performance of tasks was assessed and analyzed. Demographic and laparoscopic experience data were also collected. Complete data were available on 195 surgeons. In this group, surgeons performed the box-trainer task better with their dominant hand (p psychomotor skills is now possible. Surgeons who had performed more than 50 laparoscopic procedures showed considerable variability in their performance on a simple laparoscopic and virtual reality task. Approximately 10% of surgeons tested performed the task significantly worse than the group's average performance. Studies such as this may form the methodology for establishing criteria levels and performance objectives in objective assessment of the technical skills component of determining surgical competence.

Assessing the Nontechnical Skills of Surgical Trainees: Views of the Theater Team.

Science.gov (United States)

Al-Jundi, Wissam; Wild, Jonathan; Ritchie, Judith; Daniels, Sarah; Robertson, Eleanor; Beard, Jonathan

2016-01-01

This study aims to explore the views of members of theater teams regarding the proposed introduction of a workplace-based assessment of nontechnical skills of surgeons (NOTSS) into the Intercollegiate Surgical Curriculum Programme in the United Kingdom. In addition, the previous training and familiarity of the members of the surgical theater team with the concept and assessment of NOTSS would be evaluated. A regional survey of members of theater teams (consultant surgeons, anesthetists, scrub nurses, and trainees) was performed at 1 teaching and 2 district general hospitals in South Yorkshire. There were 160 respondents corresponding to a response rate of 81%. The majority (77%) were not aware of the NOTSS assessment tool with only 9% of respondents reporting to have previously used the NOTSS tool and just 3% having received training in NOTSS assessment. Overall, 81% stated that assessing NOTSS was as important as assessing technical skills. Trainees attributed less importance to nontechnical skills than the other groups (p ≤ 0.016). Although opinion appears divided as to whether the presence of a consultant surgeon in theater could potentially make it difficult to assess a trainee's leadership skills and decision-making capabilities, overall 60% agree that the routine use of NOTSS assessment would enhance safety in the operating theater and 80% agree that the NOTSS tool should be introduced to assess the nontechnical skills of trainees in theater. However, a significantly lower proportion of trainees (45%) agreed on the latter compared with the other groups (p = 0.001). Our survey demonstrates acceptability among the theater team for the introduction of the NOTSS tool into the surgical curriculum. However, lack of familiarity highlights the importance of faculty training for assessors before such an introduction. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A Comparison of Assessment Tools: Is Direct Observation an Improvement Over Objective Structured Clinical Examinations for Communications Skills Evaluation?

Science.gov (United States)

Goch, Abraham M; Karia, Raj; Taormina, David; Kalet, Adina; Zuckerman, Joseph; Egol, Kenneth A; Phillips, Donna

2018-04-01

Evaluation of resident physicians' communications skills is a challenging task and is increasingly accomplished with standardized examinations. There exists a need to identify the effective, efficient methods for assessment of communications skills. We compared objective structured clinical examination (OSCE) and direct observation as approaches for assessing resident communications skills. We conducted a retrospective cohort analysis of orthopaedic surgery resident physicians at a single tertiary care academic institution, using the Institute for Healthcare Communication "4 Es" model for effective communication. Data were collected between 2011 and 2015. A total of 28 residents, each with OSCE and complete direct observation assessment checklists, were included in the analysis. Residents were included if they had 1 OSCE assessment and 2 or more complete direct observation assessments. There were 28 of a possible 59 residents (47%) included. A total of 89% (25 of 28) of residents passed the communications skills OSCE; only 54% (15 of 28) of residents passed the direct observation communications assessment. There was a positive, moderate correlation between OSCE and direct observation scores overall ( r  = 0.415, P  = .028). There was no agreement between OSCE and direct observation in categorizing residents into passing and failing scores (κ = 0.205, P  = .16), after adjusting for chance agreement. Our results suggest that OSCE and direct observation tools provide different insights into resident communications skills (simulation of rare and challenging situations versus real-life daily encounters), and may provide useful perspectives on resident communications skills in different contexts.

Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood.

Science.gov (United States)

Logan, Samuel W; Barnett, Lisa M; Goodway, Jacqueline D; Stodden, David F

2017-04-01

Process-oriented motor competence (MC) assessments evaluate how a movement is performed. Product-oriented assessments evaluate the outcome of a movement. Determining the concurrent validity of process and product assessments is important to address the predictive utility of motor competence for health. The current study aimed to: (1) compare process and product assessments of the standing long jump, hop and throw across age groups and (2) determine the capacity of process assessments to classify levels of MC. Participants included 170 children classified into three age groups: 4-5, 7-8 and 10-11 years old. Participants' skills were examined concurrently using three process assessments ((Test of Gross Motor Development-2nd edition [TGMD-2]), Get Skilled; Get Active, and developmental sequences) and one product measure (throw speed, jump and hop distance). Results indicate moderate to strong correlations between (1) process assessments across skills and age groups (r range = .37-70) and (2) process and product assessments across skills and age groups (r range = .26-.88). In general, sensitivity to detect advanced skill level is lowest for TGMD-2 and highest for developmental sequences for all three skills. The use of process and product assessments is suggested to comprehensively capture levels of MC in human movement.

The Effects of Performance-Based Assessment Criteria on Student Performance and Self-Assessment Skills

Science.gov (United States)

Fastre, Greet Mia Jos; van der Klink, Marcel R.; van Merrienboer, Jeroen J. G.

2010-01-01

This study investigated the effect of performance-based versus competence-based assessment criteria on task performance and self-assessment skills among 39 novice secondary vocational education students in the domain of nursing and care. In a performance-based assessment group students are provided with a preset list of performance-based…

The assessment of surgical skills as a complement to the training method. Revision.

Science.gov (United States)

Sánchez-Fernández, J; Bachiller-Burgos, J; Serrano-Pascual, Á; Cózar-Olmo, J M; Díaz-Güemes Martín-Portugués, I; Pérez-Duarte, F J; Hernández-Hurtado, L; Álvarez-Ossorio, J L; Sánchez-Margallo, F M

2016-01-01

The acquisition and improvement of surgical skills constitute a fundamental element in the training of any practitioner. At present, however, the assessment of these skills is a scarcely developed area of research. The aim of this study was to analyse the peculiarities of the various assessment systems and establish the minimum criteria that a skills and knowledge assessment system should meet as a method for assessing surgical skills in urological surgery. Scientific literature review aimed at the various currently available assessment systems for skills and competencies (technical and nontechnical), with a special focus on the systematic reviews and prospective studies. After conducting the review, we found that the various assessment systems for surgical competence have, in our opinion, a number of shortcomings. There is a certain degree of subjectivity in the assessment of surgeons by the evaluators. The assessment of nontechnical competencies is not formally recorded. There is no description of a follow-up assessment or any basic parameters associated with healthcare quality. There is no registration of associated competencies associated with the various surgical techniques. There is also no ranking of these competencies and the specific peculiarities for their application. We believe that the development of a new assessment system for surgical competencies (technical and nontechnical) aimed at assessing urologists in the various surgical techniques is necessary. To this end, our team has worked on developing the Evaluation System for Surgical Competencies on Laparoscopy, which is based on the definition, ranking and assessment of competencies demonstrated by surgeons. Copyright © 2015 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

The predictive skill of species distribution models for plankton in a changing climate

DEFF Research Database (Denmark)

Brun, Philipp Georg; Kiørboe, Thomas; Licandro, Priscilla

2016-01-01

Statistical species distribution models (SDMs) are increasingly used to project spatial relocations of marine taxa under future climate change scenarios. However, tests of their predictive skill in the real-world are rare. Here, we use data from the Continuous Plankton Recorder program, one...... null models, is essential to assess the robustness of projections of marine planktonic species under climate change...

The effects of performance-based assessment criteria on student performance and self-assessment skills

NARCIS (Netherlands)

Fastré, Greet; Van der Klink, Marcel; Van Merriënboer, Jeroen

2010-01-01

Fastré, G. M. J., Van der Klink, M. R., & Van Merriënboer, J. J. G. (2010). The effects of performance-based assessment criteria on student performance and self-assessment skills. Advances in Health Science Education, 15(4), 517-532.

What should be included in the assessment of laypersons' paediatric basic life support skills?

DEFF Research Database (Denmark)

Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim

2018-01-01

BACKGROUND: Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign...... body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. METHODS: A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts...... suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts...

An information-motivation-behavioral skills (IMB) model-based intervention for CABG patients.

Science.gov (United States)

Zarani, Fariba; Besharat, Mohammad Ali; Sarami, Gholamreza; Sadeghian, Saeed

2012-12-01

In order to benefit from a coronary artery bypass graft (CABG) surgery, patients must adhere to medical recommendations and health advices. Despite the importance of adherence in CABG patients, adherence rates are disappointingly low. Despite the low adherence rates, very few articles regarding adherence-enhancing intervention among heart patients have been published. The goal of this study was to assess the effects of the Information-Motivation-Behavioral Skills (IMB) model-based intervention on the IMB model constructs among patients undergoing CABG and to evaluate the relationship of information, motivation, and behavioral skills with adherence. A total of 152 CABG patients were randomly assigned to either an intervention group or to a standard care control group. Participants completed pretest measures and were reassessed 1 month later. Findings showed mixed support for the effectiveness of the intervention. There was a significant effect of IMB intervention on information and motivation of patients, but no significant effect on behavioral skills. Furthermore, the results revealed that intervention constructs (information, motivation, and behavioral skills) were significantly related to patients' adherence. Findings provided initial evidence for the effectiveness of IMB-based interventions on the IMB constructs and supported the importance of these constructs to improve adherence; however, there are additional factors that need to be identified in order to improve behavioral skills more effectively.

Systematic Observation: Relevance of This Approach in Preschool Executive Function Assessment and Association with Later Academic Skills.

Science.gov (United States)

Escolano-Pérez, Elena; Herrero-Nivela, Maria Luisa; Blanco-Villaseñor, Angel; Anguera, M Teresa

2017-01-01

Executive functions (EFs) are high-level cognitive processes that allow us to coordinate our actions, thoughts, and emotions, enabling us to perform complex tasks. An increasing number of studies have highlighted the role of EFs in building a solid foundation for subsequent development and learning and shown that EFs are associated with good adjustment and academic skills. The main objective of this study was to analyze whether EF levels in 44 Spanish children in the last year of preschool were associated with levels of literacy and math skills the following year, that is, in the first year of compulsory education. We used a multi-method design, which consisted of systematic observation to observe preschool children during play and selective methodology to assess their reading, writing, and math skills in the first year of compulsory primary education. General linear modeling was used to estimate the percentage of variability in academic skills in the first year of primary school that was explained by preschool EF abilities. The results showed that preschool EF level, together with participants and the instrument used to assess academic skills, explained 99% of the variance of subsequent academic performance. Another objective was to determine whether our findings were generalizable to the reference population. To make this determination, we estimated the optimal sample size for assessing preschool EFs. To do this, we performed a generalizability analysis. The resulting generalizability coefficient showed that our sample of 44 students was sufficient for assessing preschool EFs. Therefore, our results are generalizable to the reference population. Our results are consistent with previous reports that preschool EF abilities may be associated with subsequent literacy and math skills. Early assessment of EFs may therefore contribute to identifying children who are likely to experience later learning difficulties and guide the design of suitable interventions for the

Employability Skills among Students and Employers’ Perceptions: An Assessment of Levels of Employability Skills Acquired by Business Students at Ishik University

Directory of Open Access Journals (Sweden)

Fayeq Ali Ali

2017-01-01

Full Text Available Skills are prerequisite for managers and employees success, especially for newly graduate students. This study is to evaluate the employability skills of business students at Ishik University and to assess how employability skills are perceived by potential employers. Three sets of employability skills have been used in this study such as basic academic skills, high-order thinking, and personal qualities. A questionnaire has been developed which included above dimensions and was distributed among students in the faculty of administrative sciences and economics at Ishik University, Kurdistan Region. Respondents’ opinions were assessed using a Likert scale analysis that shows divergent opinions between two extremes of levels of agreement and disagreement. Another technique of an open-ended questionnaire was used when conducting interviews with a few of the potential employers in some private sector companies. Study focuses on the common employability skills of business graduates by evaluating the faculty of administrative sciences and economics courses. Study find out that communication skills, team working skills, computer skills, and critical thinking were among the employability skills which are expected by potential employers. The paper concludes that business graduates have developed an adequate level of employability skill through their years of academic training at business department in Ishik University. Thus, the curriculum of business department at Ishik University is adequately developed to prompt the employability skills that are sought by potential employers that every business student should acquire to stand out in the aggressively competitive job market.

Assessing the Effectiveness of Holistic Multidimensional Treatment Model (Hojjati Model on Receptive and Expressive Language Skills in Autistic Children

Directory of Open Access Journals (Sweden)

Maryam Hojjati

2017-05-01

Full Text Available Background: Autism as part of the category called Autism spectrum disorder (ASD, is caused by disorders in brain and nervous network and characterized by defect in social behavior, language and cognition. This study aimed to investigate receptive and expressive language performance and the severity of the disorder in 30 children with autism aged 2-8 years who speak in Persian language. Materials and Methods In this cross-sectional study 30 children with autism were selected using random sampling method. The study tools included "The Childhood Autism Rating Scale (CARS", and "Newsha Developmental Scale (NDS" for assessing the receptive - expressive language skills. In order to assess the level of language impairment in subjects, the participants were divided into 5 groups with 6 people (considering the speaking ability including sign language and speech, with equal number of boys and girls (3 girls and 3 boys in each group. All of these children were evaluated by pediatric psychiatry, pediatric neurologist and pediatrician and were assessed according to the criteria for autism based on the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-V. Eventually, the data were analyzed using descriptive and inferential statistics in SPSS version 16.0 software. Results The results showed that there was a significant difference between the mean (standard deviation and scores of receptive – expressive language skills in autistic subjects in each of the groups (P

Developing learning community model with soft skill integration for the building engineering apprenticeship programme in vocational high school

Science.gov (United States)

Sutrisno, Dardiri, Ahmad; Sugandi, R. Machmud

2017-09-01

This study aimed to address the procedure, effectiveness, and problems in the implementation of learning model for Building Engineering Apprenticeship Training Programme. This study was carried out through survey method and experiment. The data were collected using questionnaire, test, and assessment sheet. The collected data were examined through description, t-test, and covariance analysis. The results of the study showed that (1) the model's procedure covered preparation course, readiness assessment, assignment distribution, handing over students to apprenticeship instructors, task completion, assisting, field assessment, report writing, and follow-up examination, (2) the Learning Community model could significantly improve students' active learning, but not improve students' hard skills and soft skills, and (3) the problems emerging in the implementation of the model were (1) students' difficulties in finding apprenticeship places and qualified instructors, and asking for relevant tasks, (2) teachers' difficulties in determining relevant tasks and monitoring students, and (3) apprenticeship instructors' difficulties in assigning, monitoring, and assessing students.

Simulation-based rhomboid flap skills training during medical education: comparing low- and high-fidelity bench models.

Science.gov (United States)

Denadai, Rafael; Saad-Hossne, Rogerio; Raposo-Amaral, Cassio Eduardo

2014-11-01

To assess if the bench model fidelity interferes in the acquisition of rhomboid flap skills by medical students. Sixty novice medical students were randomly assigned to 5 practice conditions with instructor-directed Limberg rhomboid flap skills training: didactic materials (control group 1), low-fidelity rubberized line (group 2) or ethylene-vinyl acetate (group 3) bench models; high-fidelity chicken leg skin (group 4) or pig foot skin (group 5) bench models. Pretests and posttests were applied, and Global Rating Scale, effect size, and self-perceived confidence were used to evaluate all flap performances. Medical students from groups 2 to 5 showed better flap performances based on the Global Rating Scale (all P 0.05). The magnitude of the effect was considered large (>0.80) in all measurements. There was acquisition of rhomboid flap skills regardless of bench model fidelity.

Conceptual Models and Guidelines for Clinical Assessment of Financial Capacity.

Science.gov (United States)

Marson, Daniel

2016-09-01

The ability to manage financial affairs is a life skill of critical importance, and neuropsychologists are increasingly asked to assess financial capacity across a variety of settings. Sound clinical assessment of financial capacity requires knowledge and appreciation of applicable clinical conceptual models and principles. However, the literature has presented relatively little conceptual guidance for clinicians concerning financial capacity and its assessment. This article seeks to address this gap. The article presents six clinical models of financial capacity : (1) the early gerontological IADL model of Lawton, (2) the clinical skills model and (3) related cognitive psychological model developed by Marson and colleagues, (4) a financial decision-making model adapting earlier decisional capacity work of Appelbaum and Grisso, (5) a person-centered model of financial decision-making developed by Lichtenberg and colleagues, and (6) a recent model of financial capacity in the real world developed through the Institute of Medicine. Accompanying presentation of the models is discussion of conceptual and practical perspectives they represent for clinician assessment. Based on the models, the article concludes by presenting a series of conceptually oriented guidelines for clinical assessment of financial capacity. In summary, sound assessment of financial capacity requires knowledge and appreciation of clinical conceptual models and principles. Awareness of such models, principles and guidelines will strengthen and advance clinical assessment of financial capacity. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Measurement Properties of the Assessing Math Concepts' Assessments of Primary Students' Number Sense Skills.

Science.gov (United States)

Martin, Christie; Lambert, Richard; Polly, Drew; Wang, Chuang; Pugalee, David

The purpose of this study was to examine the measurement properties of the Assessing Math Concepts AMC Anywhere Hiding and Ten Frame Assessments, formative assessments of primary students' number sense skills. Each assessment has two parts, where Part 1 is intended to be foundational skills for part two. Part 1 includes manipulatives whereas Part 2 does not. Student data from 228 kindergarten through second grade teachers with a total of 3,666 students was analyzed using Rasch scaling. Data analyses indicated that when the two assessments were examined separately the intended order of item difficulty was clear. When the parts of both assessments were analyzed together, the items in Part 2 were not consistently more difficult that the items in Part 1. This suggests an alternative sequence of tasks in that students may progress from working with a specific number with manipulatives then without manipulatives rather than working with a variety of numbers with manipulatives before moving onto assessments without manipulatives.

Development of an instrument to assess the impact of an enhanced experiential model on pharmacy students' learning opportunities, skills and attitudes: A retrospective comparative-experimentalist study

Directory of Open Access Journals (Sweden)

Collins John B

2008-04-01

Full Text Available Abstract Background Pharmacy schools across North America have been charged to ensure their students are adequately skilled in the principles and practices of pharmaceutical care. Despite this mandate, a large percentage of students experience insufficient opportunities to practice the activities, tasks and processes essential to pharmaceutical care. The objective of this retrospective study of pharmacy students was to: (1 as "proof of concept", test the overall educational impact of an enhanced advanced pharmacy practice experiential (APPE model on student competencies; (2 develop an instrument to measure students' and preceptors' experiences; and (3 assess the psychometric properties of the instrument. Methods A comparative-experimental design, using student and preceptor surveys, was used to evaluate the impact of the enhanced community-based APPE over the traditional APPE model. The study was grounded in a 5-stage learning model: (1 an enhanced learning climate leads to (2 better utilization of learning opportunities, including (3 more frequent student/patient consultation, then to (4 improved skills acquisition, thence to (5 more favorable attitudes toward pharmaceutical care practice. The intervention included a one-day preceptor workshop, a comprehensive on-site student orientation and extending the experience from two four-week experiences in different pharmacies to one eight-week in one pharmacy. Results The 35 student and 38 preceptor survey results favored the enhanced model; with students conducting many more patient consultations and reporting greater skills improvement. In addition, the student self-assessment suggested changes in attitudes favoring pharmaceutical care principles. Psychometric testing showed the instrument to be sensitive, valid and reliable in ascertaining differences between the enhanced and traditional arms. Conclusion The enhanced experiential model positively affects learning opportunities and competency

Performance and Cognitive Assessment in 3-D Modeling

Science.gov (United States)

Fahrer, Nolan E.; Ernst, Jeremy V.; Branoff, Theodore J.; Clark, Aaron C.

2011-01-01

The purpose of this study was to investigate identifiable differences between performance and cognitive assessment scores in a 3-D modeling unit of an engineering drafting course curriculum. The study aimed to provide further investigation of the need of skill-based assessments in engineering/technical graphics courses to potentially increase…

Assessing family planning service-delivery skills in Kenya.

Science.gov (United States)

Valadez, J J; Transgrud, R; Mbugua, M; Smith, T

1997-06-01

This report demonstrates the use of Lot Quality Assurance Sampling (LQAS) to evaluate the technical competence of two cohorts of family planning service providers in Kenya trained with a new curriculum. One cohort had just finished training within two months of the study. The other cohort was the first group trained with the new curriculum about one year before the study. LQAS was adapted from industrial and other public health applications to assess both the individual competence of 30 service providers and the competence of each cohort. Results show that Cohorts One and Two did not differ markedly in the number of tasks needing improvement. However, both cohorts exhibited more tasks needing improvement in counseling skills as compared with physical examination skills or with all other skills. Care-givers who were not currently providing services accounted for most service-delivery problems. This result suggests that providers' use of their skills explains their ability to retain service-delivery skills learned in training to a greater degree than does the amount of time elapsed since they were trained. LQAS proved to be a rapid, easy-to-use empirical method for management decisionmaking for improvement of a family planning training curriculum and services.

Assessment of email communication skills of rheumatology fellows: a pilot study

Science.gov (United States)

Dhuper, Sonal; Siva, Chokkalingam; Fresen, John L; Petruc, Marius; Velázquez, Celso R

2010-01-01

Physician–patient email communication is gaining popularity. However, a formal assessment of physicians' email communication skills has not been described. We hypothesized that the email communication skills of rheumatology fellows can be measured in an objective structured clinical examination (OSCE) setting using a novel email content analysis instrument which has 18 items. During an OSCE, we asked 50 rheumatology fellows to respond to a simulated patient email. The content of the responses was assessed using our instrument. The majority of rheumatology fellows wrote appropriate responses scoring a mean (±SD) of 10.6 (±2.6) points (maximum score 18), with high inter-rater reliability (0.86). Most fellows were concise (74%) and courteous (68%) but not formal (22%). Ninety-two percent of fellows acknowledged that the patient's condition required urgent medical attention, but only 30% took active measures to contact the patient. No one encrypted their messages. The objective assessment of email communication skills is possible using simulated emails in an OSCE setting. The variable email communication scores and incidental patient safety gaps identified, suggest a need for further training and defined proficiency standards for physicians' email communication skills. PMID:20962134

Validation of Modified Soft Skills Assessment Instrument (MOSSAI) for Use in Nigeria

Science.gov (United States)

Aworanti, O. A.; Taiwo, M. B.; Iluobe, O. I.

2015-01-01

Currently, it has become an accepted norm nearly all over the globe to teach and assess soft skills. However, in Nigeria, it is an emerging area of interest that needs to be addressed squarely. In the light of the fore-going, this study validated a modified version of Measuring and Assessment Soft Skills (MASS) (an instrument developed and used by…

Rubric Assessment on Science and Creative Thinking Skills of Students

Science.gov (United States)

Ratnasusanti, H.; Ana, A.; Nurafiati, P.; Umusyaadah, L.

2018-02-01

The result of the monitoring and evaluation of the latest Indonesian curriculum (the 2013 curriculum) implementation at junior high school level year of 2014 showed that one of the difficult things that learners had in implementation 2013 curriculum is doing the result. The characteristic of applying the 2013 curriculum is to emphasize the modern pedagogic dimension of learning, which is using scientific approach, which requires learners to have highlevel thinking skills, one of which is creative thinking skills. The aims of this research is to implement performance assessment in measuring the creative thinking of junior high school students on subject Prakarya. The form of the main performance assessment is the task and assessment criteria. The experimental method that been used is the Quasi Experiment with Non-Equivalent Design Group Research. Population in this study is the students of VIII class of junior high school in Bandung, Indonesia which consists of six classes. And two classes are selected for the sample from that six classes and VIII A class were chosen, while VIII F class has been chosen as control class. The result of this research showed that the rubics of performance assessment can be measure or identify the creative thinking skill, its prove by the result of pre-test dan post-test are more dominant. In material of identification student’s creative thinking skills are reached an average 85 compare 79 with the control class. while in the presentation the experimental class got an average of 85 bigger than the control class which only reached 79.

Patients' assessment of professionalism and communication skills of medical graduates.

Science.gov (United States)

Abadel, Fatima T; Hattab, Abdulla S

2014-02-11

Professionalism and communication skills constitute important components of the integral formation of physicians which has repercussion on the quality of health care and medical education. The objective of this study was to assess medical graduates' professionalism and communication skills from the patients' perspective and to examine its association with patients' socio-demographic variables. This is a hospital based cross-sectional study. It involved 315 patients and 105 medical graduates selected by convenient sampling method. A modified and validated version of the American Board of Internal Medicine's (ABIM) Patient Assessment survey questionnaire was used for data collection through a face to face interview. Data processing and analysis were performed using the Statistical Package for Social Science (SPSS) 16.0. Mean, frequency distribution, and percentage of the variables were calculated. A non-parametric Kruskal Wallis test was applied to verify whether the patients' assessment was influenced by variables such as age, gender, education, at a level of significance, p ≤ 0.05. Female patients constituted 46% of the sample, whereas males constituted 54%. The mean age was 36 ± 16. Patients' scoring of the graduate's skills ranged from 3.29 to 3.83 with a mean of 3.64 on a five-point Likert scale. Items assessing the "patient involvement in decision-making" were assigned the minimum mean values, while items dealing with "establishing adequate communication with patient" assigned the maximum mean values. Patients, who were older than 45 years, gave higher scores than younger ones (p communication skills at a good level. Patients' age and educational level were significantly associated with the rating level.

Facilitating the implementation of the American College of Surgeons/Association of Program Directors in Surgery phase III skills curriculum: training faculty in the assessment of team skills.

Science.gov (United States)

Hull, Louise; Arora, Sonal; Stefanidis, Dimitrios; Sevdalis, Nick

2015-11-01

Effective teamwork is critical to safety in the operating room; however, implementation of phase III of the American College of Surgeons (ACS) and Association of Program Directors in Surgery (APDS) Curriculum that focuses on team-based skills remains worryingly low. Training and assessing the complexities of teamwork is challenging. The objective of this study was to establish guidelines and recommendations for training faculty in assessing/debriefing team skills. A multistage survey-based consensus study was completed by 108 experts responsible for training and assessing surgical residents from the ACS Accredited Educational Institutes. Experts agreed that a program to teach faculty to assess team-based skills should include training in the recognition of teamwork skills, practice rating these skills, and training in the provision of feedback/debriefing. Agreement was reached that faculty responsible for conducting team-based skills assessment should be revalidated every 2 years and stringent proficiency criteria should be met. Faculty development is critical to ensure high-quality, standardized training and assessment. Training faculty to assess team-based skills has the potential to facilitate the effective implementation of phase III of the ACS and APDS Curriculum. Copyright © 2015 Elsevier Inc. All rights reserved.

Efficiency of Motivation Development Models for Hygienic Skills

Directory of Open Access Journals (Sweden)

Alexander V. Tscymbalystov

2017-09-01

Full Text Available The combined influence of a family and a state plays an important role in the development of an individual. This study is aimed at the model effectiveness evaluation concerning the development of oral hygiene skills among children living in families (n = 218 and being under the care of a state (n = 229. The groups were created among the children who took part in the study: the preschoolers of 5-7 years, schoolchildren of 8-11 years and adolescents of 12-15 years. During the initial examination, the hygienic status of the oral cavity before and after tooth brushing was evaluated. After that, subgroups were formed in each age group according to three models of hygienic skills training: 1 computer presentation lesson; 2 one of the students acted as a demonstrator of the skill; 3 an individual training by a hygienist. During the next 48 hours children did not take hygienic measures. Then the children were invited for a control session to demonstrate the acquired skills of oral care and evaluate the effectiveness of a model developing the skills of individual oral hygiene. During the control examination, the hygienic status was determined before and after the tooth cleaning, which allowed to determine the regimes of hygienic measure performance for children with different social status and the effectiveness of hygiene training models.

Retrofitting Non-Cognitive-Diagnostic Reading Assessment under the Generalized DINA Model Framework

Science.gov (United States)

Chen, Huilin; Chen, Jinsong

2016-01-01

Cognitive diagnosis models (CDMs) are psychometric models developed mainly to assess examinees' specific strengths and weaknesses in a set of skills or attributes within a domain. By adopting the Generalized-DINA model framework, the recently developed general modeling framework, we attempted to retrofit the PISA reading assessments, a…

Laparoscopic skills assessment: an additional modality for pediatric surgery fellowship selection.

Science.gov (United States)

Hazboun, Rajaie; Rodriguez, Samuel; Thirumoorthi, Arul; Baerg, Joanne; Moores, Donald; Tagge, Edward P

2017-12-01

The Pediatric Surgery fellow selection is a multi-layered process which has not included assessment of surgical dexterity. Data was collected prospectively as part of the 2016 Pediatric Surgery Match interview process. Applicants completed a questionnaire to document laparoscopic experience and fine motor skills activities. Actual laparoscopic skills were assessed using a simulator. Time to complete an intracorporeal knot was tabulated. An initial rank list was formulated based only on the ERAS application and interview scores. The rank list was re-formulated following the laparoscopic assessment. Un-paired T-test and regression were utilized to analyze the data. Forty applicants were interviewed with 18 matched (45%). The mean knot tying time was 201.31s for matched and 202.35s for unmatched applicants. Playing a musical instrument correlated with faster knot tying (p=0.03). No correlation was identified between knot tying time and either video game experience (p=0.4) or passing the FLS exam (p=0.78). Laparoscopic skills assessment lead to significant reordering of rank list (p=0.01). Laparoscopic skills performance significantly impacted ranking. Playing a musical instrument correlated with faster knot tying. No correlation was identified between laparoscopic performance and passing the FLS exam or other activities traditionally believed to improve technical ability. Prospective study. Level II. Copyright © 2017 Elsevier Inc. All rights reserved.

Social Validation of the New England Center for Children-Core Skills Assessment

Science.gov (United States)

Dickson, Chata A.; MacDonald, Rebecca P. F.; Mansfield, Renee; Guilhardi, Paulo; Johnson, Cammarie; Ahearn, William H.

2014-01-01

We investigated the social validity of the NECC Core Skills Assessment (NECC-CSA) with parents and professionals as participants. The NECC-CSA is a measurement tool consisting of direct and indirect measures of skills important to all individuals with autism, across the lifespan. Participants (N = 245) were provided with a list of 66 skills, 47 of…

Can Perceptuo-Motor Skills Assessment Outcomes in Young Table Tennis Players (7-11 years) Predict Future Competition Participation and Performance? An Observational Prospective Study.

Science.gov (United States)

Faber, Irene R; Elferink-Gemser, Marije T; Faber, Niels R; Oosterveld, Frits G J; Nijhuis-Van der Sanden, Maria W G

2016-01-01

Forecasting future performance in youth table tennis players based on current performance is complex due to, among other things, differences between youth players in growth, development, maturity, context and table tennis experience. Talent development programmes might benefit from an assessment of underlying perceptuo-motor skills for table tennis, which is hypothesized to determine the players' potential concerning the perceptuo-motor domain. The Dutch perceptuo-motor skills assessment intends to measure the perceptuo-motor potential for table tennis in youth players by assessing the underlying skills crucial for developing technical and tactical qualities. Untrained perceptuo-motor tasks are used as these are suggested to represent a player's future potential better than specific sport skills themselves as the latter depend on exposure to the sport itself. This study evaluated the value of the perceptuo-motor skills assessment for a talent developmental programme by evaluating its predictive validity for competition participation and performance in 48 young table tennis players (7-11 years). Players were tested on their perceptuo-motor skills once during a regional talent day, and the subsequent competition results were recorded half-yearly over a period of 2.5 years. Logistic regression analysis showed that test scores did not predict future competition participation (p >0.05). Yet, the Generalized Estimating Equations analysis, including the test items 'aiming at target', 'throwing a ball', and 'eye-hand coordination' in the best fitting model, revealed that the outcomes of the perceptuo-motor skills assessment were significant predictors for future competition results (R2 = 51%). Since the test age influences the perceptuo-motor skills assessment's outcome, another multivariable model was proposed including test age as a covariate (R2 = 53%). This evaluation demonstrates promising prospects for the perceptuo-motor skills assessment to be included in a talent

Can Perceptuo-Motor Skills Assessment Outcomes in Young Table Tennis Players (7-11 years Predict Future Competition Participation and Performance? An Observational Prospective Study.

Directory of Open Access Journals (Sweden)

Irene R Faber

Full Text Available Forecasting future performance in youth table tennis players based on current performance is complex due to, among other things, differences between youth players in growth, development, maturity, context and table tennis experience. Talent development programmes might benefit from an assessment of underlying perceptuo-motor skills for table tennis, which is hypothesized to determine the players' potential concerning the perceptuo-motor domain. The Dutch perceptuo-motor skills assessment intends to measure the perceptuo-motor potential for table tennis in youth players by assessing the underlying skills crucial for developing technical and tactical qualities. Untrained perceptuo-motor tasks are used as these are suggested to represent a player's future potential better than specific sport skills themselves as the latter depend on exposure to the sport itself. This study evaluated the value of the perceptuo-motor skills assessment for a talent developmental programme by evaluating its predictive validity for competition participation and performance in 48 young table tennis players (7-11 years. Players were tested on their perceptuo-motor skills once during a regional talent day, and the subsequent competition results were recorded half-yearly over a period of 2.5 years. Logistic regression analysis showed that test scores did not predict future competition participation (p >0.05. Yet, the Generalized Estimating Equations analysis, including the test items 'aiming at target', 'throwing a ball', and 'eye-hand coordination' in the best fitting model, revealed that the outcomes of the perceptuo-motor skills assessment were significant predictors for future competition results (R2 = 51%. Since the test age influences the perceptuo-motor skills assessment's outcome, another multivariable model was proposed including test age as a covariate (R2 = 53%. This evaluation demonstrates promising prospects for the perceptuo-motor skills assessment to be

Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

Science.gov (United States)

Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

2012-04-01

The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

Self-assessment and goal-setting is associated with an improvement in interviewing skills.

Science.gov (United States)

Hanley, Kathleen; Zabar, Sondra; Charap, Joseph; Nicholson, Joseph; Disney, Lindsey; Kalet, Adina; Gillespie, Colleen

2014-01-01

Describe the relationship between medical students' self-assessment and goal-setting (SAGS) skills and development of interviewing skills during the first-year doctoring course. 157 first-year medical students completed three two-case standardized patient (SP) interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. SAGS improved over time (37% good week 1 vs. 61% good week 10). Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills - those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024). For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1-10 and then increased significantly at week 17. For those whose SAGS remained 'poor' in weeks 1-10, interviewing skills declined in weeks 10-17. In general, the quality of students' SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

How Do Trading Firms Upgrade Skills and Technology: A Theoretical Model

Directory of Open Access Journals (Sweden)

Mojca Lindic

2015-12-01

Full Text Available This paper studies the mechanisms of skill upgrading in trading firms by developing a theoretical model that relates the individual’s incentives for acquiring higher skills to the profit-maximizing behaviour of trading firms. The model shows that only the high ability individuals have incentives for acquiring higher skills, as long as they are compensated with higher wages after entering employment. Furthermore, high-productive firms have incentives for investing in higher technology, to employ high-skilled labour, and to engage in international trade. The decisions for technology dress-up and skill upgrading coincide with firm’s decisions to start importing and exporting as the latter requires higher technology and high-skilled labour. Contributions of the paper are twofold: gaining new insights by combining fragments of models on individual’s and firm’s behaviours, and broadening the content of the Melitz (2003 model by introducing importers and controlling for skilled and unskilled labour.

Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

Science.gov (United States)

Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

2017-11-01

In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is

Does a perceptuomotor skills assessment have added value to detect talent for table tennis in primary school children?

Science.gov (United States)

Faber, Irene R; Pion, Johan; Munivrana, Goran; Faber, Niels R; Nijhuis-Van der Sanden, Maria W G

2017-04-18

Talent detection intends to support lifelong sports participation, reduce dropouts and stimulate sports at the elite level. For this purpose it is important to reveal the specific profile which directs children to the sports that connect to their strengths and preferences. This study evaluated a perceptuomotor skills assessment as part of talent detection for table tennis, a sport in which perceptuomotor skills are considered essential to cope with the difficult technical aspects. Primary school children (n = 121) and gifted young table tennis players (n = 146) were assessed using the Dutch perceptuomotor skills assessment measuring "ball control" and "gross motor function". A discriminant function analysis confirmed the added value by identifying primary school children fitting the table tennis perceptuomotor profile of the young gifted table tennis players (28%). General linear model analyses for the assessment's individual test items showed that the table tennis players outperformed their primary school peers on all "ball control" items (P talent detection in table tennis at this young age. Longitudinal studies need to reveal the predictive value for sports participation and elite sports.

The Promotion of Critical Thinking Skills in School-Based Assessment (SBA)

Science.gov (United States)

Kamarulzaman, Wirawani; Kamarulzaman, Wirawahida

2016-01-01

The new curriculum introduced in the Malaysian primary students; the Primary School Standard Curriculum (Kurikulum Standard Sekolah Rendah-KSSR) together with the school-based assessment (SBA) is a step taken by the Malaysian government to encourage thinking skills to students, specifically critical thinking skills. The study explores teachers'…

Predictive model for early math skills based on structural equations.

Science.gov (United States)

Aragón, Estíbaliz; Navarro, José I; Aguilar, Manuel; Cerda, Gamal; García-Sedeño, Manuel

2016-12-01

Early math skills are determined by higher cognitive processes that are particularly important for acquiring and developing skills during a child's early education. Such processes could be a critical target for identifying students at risk for math learning difficulties. Few studies have considered the use of a structural equation method to rationalize these relations. Participating in this study were 207 preschool students ages 59 to 72 months, 108 boys and 99 girls. Performance with respect to early math skills, early literacy, general intelligence, working memory, and short-term memory was assessed. A structural equation model explaining 64.3% of the variance in early math skills was applied. Early literacy exhibited the highest statistical significance (β = 0.443, p < 0.05), followed by intelligence (β = 0.286, p < 0.05), working memory (β = 0.220, p < 0.05), and short-term memory (β = 0.213, p < 0.05). Correlations between the independent variables were also significant (p < 0.05). According to the results, cognitive variables should be included in remedial intervention programs. © 2016 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

The use of physical assessment skills by registered nurses in Australia: issues for nursing education.

Science.gov (United States)

Birks, Melanie; Cant, Robyn; James, Ainsley; Chung, Catherine; Davis, Jenny

2013-01-01

The purpose of pre-service nursing education programs is to prepare competent graduates who are able to function as safe, professional registered nurses. An extensive element of these programs is the teaching of physical assessment skills, with most programs educating students to perform over 120 such skills. Previous research from North America suggests that the majority of skills taught to nurses in their pre-service programs are not used in practice. As part of a larger study, an online survey was used to explore use of 121 physical assessment skills by Australian nurses. Recruitment occurred via mailed invitation to members of the Australian Nursing Federation. Data were extracted from 1220 completed questionnaires returned by nurses who were mostly employed in New South Wales, were female and experienced nurses. Respondents indicated that they used only 34% of skills routinely. Results reinforce evidence found in the literature that many of the skills taught to nurses are either not used at all (35.5%) or are used rarely (31%). These findings have implications for the teaching of physical assessment skills in pre-service nursing programs, and raise questions about the value of extensive skills teaching in the context of contemporary health care. Further research into barriers to the use of physical assessment skills in nursing and the need for comprehensive skills preparation for the generalist nurse is likely to offer some solutions to these questions.

Designing Standardized Patient Assessments to Measure SBIRT Skills

Science.gov (United States)

Wamsley, Maria A.; Julian, Katherine A.; O'Sullivan, Patricia; Satterfield, Jason M.; Satre, Derek D.; McCance-Katz, Elinore; Batki, Steven L.

2013-01-01

Objectives: Resident physicians report insufficient experience caring for patients with substance use disorders (SUDs). Resident training in Screening, Brief Intervention, and Referral to Treatment (SBIRT) has been recommended. We describe the development of a standardized patient (SP) assessment to measure SBIRT skills, resident perceptions of…

Procedural Skills Education – Colonoscopy as a Model

Directory of Open Access Journals (Sweden)

Maitreyi Raman

2008-01-01

Full Text Available Traditionally, surgical and procedural apprenticeship has been an assumed activity of students, without a formal educational context. With increasing barriers to patient and operating room access such as shorter work week hours for residents, and operating room and endoscopy time at a premium, alternate strategies to maximizing procedural skill development are being considered. Recently, the traditional surgical apprenticeship model has been challenged, with greater emphasis on the need for surgical and procedural skills training to be more transparent and for alternatives to patient-based training to be considered. Colonoscopy performance is a complex psychomotor skill requiring practioners to integrate multiple sensory inputs, and involves higher cortical centres for optimal performance. Colonoscopy skills involve mastery in the cognitive, technical and process domains. In the present review, we propose a model for teaching colonoscopy to the novice trainee based on educational theory.

Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

DEFF Research Database (Denmark)

Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter

2013-01-01

Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training.......Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training....

Drawing students' attention to relevant assessment criteria: effects on self-assessment skills and performance

NARCIS (Netherlands)

Fastré, Greet; Van der Klink, Marcel; Sluijsmans, Dominique; Van Merriënboer, Jeroen

2012-01-01

Fastré, G. M. J., Van der Klink, M. R., Sluijsmans, D., & Van Merriënboer, J. J. G. (2012). Drawing students’ attention to relevant assessment criteria: effects on self-assessment skills and performance. Journal of Vocational Education & Training, 64(2), 185-198. doi:10.1080/13636820.2011.630537

The consequences of using advanced physical assessment skills in medical and surgical nursing: A hermeneutic pragmatic study.

Science.gov (United States)

Zambas, Shelaine I; Smythe, Elizabeth A; Koziol-Mclain, Jane

2016-01-01

The aim of this study was to explore the consequences of the nurse's use of advanced assessment skills on medical and surgical wards. Appropriate, accurate, and timely assessment by nurses is the cornerstone of maintaining patient safety in hospitals. The inclusion of "advanced" physical assessment skills such as auscultation, palpation, and percussion is thought to better prepare nurses for complex patient presentations within a wide range of clinical situations. This qualitative study used a hermeneutic pragmatic approach. Unstructured interviews were conducted with five experienced medical and surgical nurses to obtain 13 detailed narratives of assessment practice. Narratives were analyzed using Van Manen's six-step approach to identify the consequences of the nurse's use of advanced assessment skills. The consequences of using advanced assessment skills include looking for more, challenging interpretations, and perseverance. The use of advanced assessment skills directs what the nurse looks for, what she sees, interpretation of the findings, and her response. It is the interpretation of what is seen, heard, or felt within the full context of the patient situation, which is the advanced skill. Advanced assessment skill is the means to an accurate interpretation of the clinical situation and contributes to appropriate diagnosis and medical management in complex patient situations. The nurse's use of advanced assessment skills enables her to contribute to diagnostic reasoning within the acute medical and surgical setting.

Taxonomy of Trauma Leadership Skills: A Framework for Leadership Training and Assessment.

Science.gov (United States)

Leenstra, Nico F; Jung, Oliver C; Johnson, Addie; Wendt, Klaus W; Tulleken, Jaap E

2016-02-01

Good leadership is essential for optimal trauma team performance, and targeted training of leadership skills is necessary to achieve such leadership proficiency. To address the need for a taxonomy of leadership skills that specifies the skill components to be learned and the behaviors by which they can be assessed across the five phases of trauma care, the authors developed the Taxonomy of Trauma Leadership Skills (TTLS). Critical incident interviews were conducted with trauma team leaders and members from different specialties-emergency physicians, trauma surgeons, anesthesiologists, and emergency ward nurses-at three teaching hospitals in the Netherlands during January-June 2013. Data were iteratively analyzed for examples of excellent leadership skills at each phase of trauma care. Using the grounded theory approach, elements of excellent leadership skills were identified and classified. Elements and behavioral markers were sorted and categorized using multiple raters. In a two-round verification process in late 2013, the taxonomy was reviewed and rated by trauma team leaders and members from the multiple specialties for its coverage of essential items. Data were gathered from 28 interviews and 14 raters. The TTLS details 5 skill categories (information coordination, decision making, action coordination, communication management, and coaching and team development) and 37 skill elements. The skill elements are captured by 67 behavioral markers. The three-level taxonomy is presented according to five phases of trauma care. The TTLS provides a framework for teaching, learning, and assessing team leadership skills in trauma care and other complex, acute care situations.

E-learning and nursing assessment skills and knowledge - An integrative review.

Science.gov (United States)

McDonald, Ewan W; Boulton, Jessica L; Davis, Jacqueline L

2018-07-01

This review examines the current evidence on the effectiveness of digital technologies or e-based learning for enhancing the skills and knowledge of nursing students in nursing assessment. This integrative review identifies themes emerging from e-learning and 'nursing assessment' literature. Literature reviews have been undertaken in relation to digital learning and nursing education, including clinical skills, clinical case studies and the nurse-educator role. Whilst perceptions of digital learning are well covered, a gap in knowledge persists for understanding the effectiveness of e-learning on nursing assessment skills and knowledge. This is important as comprehensive assessment skills and knowledge are a key competency for newly qualified nurses. The MEDLINE, CINAHL, Cochrane Library and ProQuest Nursing and Allied Health Source electronic databases were searched for the period 2006 to 2016. Hand searching in bibliographies was also undertaken. Selection criteria for this review included: FINDINGS: Twenty articles met the selection criteria for this review, and five major themes for e-based learning were identified (a) students become self-evaluators; (b) blend and scaffold learning; (c) measurement of clinical reasoning; (d) mobile technology and Facebook are effective; and (e) training and preparation is vital. Although e-based learning programs provide a flexible teaching method, evidence suggests e-based learning alone does not exceed face-to-face patient simulation. This is particularly the case where nursing assessment learning is not scaffolded. This review demonstrates that e-based learning and traditional teaching methods used in conjunction with each other create a superior learning style. Copyright © 2018 Elsevier Ltd. All rights reserved.

Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery.

Science.gov (United States)

Liu, May; Purohit, Shreya; Mazanetz, Joshua; Allen, Whitney; Kreaden, Usha S; Curet, Myriam

2018-01-01

Skill assessment during robotically assisted surgery remains challenging. While the popularity of the Global Evaluative Assessment of Robotics Skills (GEARS) has grown, its lack of discrimination between independent console skills limits its usefulness. The purpose of this study was to evaluate construct validity and interrater reliability of a novel assessment designed to overcome this limitation. We created the Assessment of Robotic Console Skills (ARCS), a global rating scale with six console skill domains. Fifteen volunteers who were console surgeons for 0 ("novice"), 1-100 ("intermediate"), or >100 ("experienced") robotically assisted procedures performed three standardized tasks. Three blinded raters scored the task videos using ARCS, with a 5-point Likert scale for each skill domain. Scores were analyzed for evidence of construct validity and interrater reliability. Group demographics were indistinguishable except for the number of robotically assisted procedures performed (p = 0.001). The mean scores of experienced subjects exceeded those of novices in dexterity (3.8 > 1.4, p  1.8, p  2.2, p  1.9, p = 0.001), and force sensitivity (4.3 > 2.6, p  1.4, p = 0.002), field of view (2.8 > 1.8, p = 0.021), instrument visualization (3.2 > 2.2, p = 0.045), manipulator workspace (3.1 > 1.9, p = 0.004), and force sensitivity (3.7 > 2.6, p = 0.033). The mean scores of experienced subjects exceeded those of intermediates in dexterity (3.8 > 2.8, p = 0.003), field of view (4.1 > 2.8, p  3.2, p = 0.044). Rater agreement in each domain demonstrated statistically significant concordance (p skills plateau faster than others. Therefore, ARCS may be more useful than GEARS to evaluate distinct console skills. Future studies will examine why some domains did not adequately differentiate between subjects and applications for intraoperative use.

Peer Assessment of Soft Skills and Hard Skills

Science.gov (United States)

Zhang, Aimao

2012-01-01

Both the information technology (IT) industry and the Accreditation Board for Engineering and Technology (ABET) demand soft-skill training in higher education and require IT graduates to demonstrate competence in interpersonal communication, teamwork, and conflict management. Group projects provide teamwork environment for soft-skill training, but…

Framework of Assessment for the Evaluation of Thinking Skills of Tertiary Level Students

Directory of Open Access Journals (Sweden)

Chan Swee Heng

2015-10-01

Full Text Available In the 21st century, students are required to master thinking skills in order to deal with many situations that arise in the tertiary environment which later would translate into the workplace. Nowadays, thinking skills play a vital role in tertiary education. To provide an approach for teachers, this paper identifies a 4-step model that can be implemented in test design with reference to Bloom’s Taxonomy for thinking skills. This model illustrates a feasible procedure of test construction built upon existing resource. The procedures can easily be applied to different fields of study. It provides an appropriate way for teachers who may want to add more ideas to their repertoire skills in addressing the learning of HOT (higher-order thinking skills. Keywords: thinking skills, Bloom’s Taxonomy, 4-step model

Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator

DEFF Research Database (Denmark)

Larsen, C R; Grantcharov, Teodor; Aggarwal, R

2006-01-01

Safe realistic training and unbiased quantitative assessment of technical skills are required for laparoscopy. Virtual reality (VR) simulators may be useful tools for training and assessing basic and advanced surgical skills and procedures. This study aimed to investigate the construct validity...

Assessing competence in communication and interpersonal skills: the Kalamazoo II report.

Science.gov (United States)

Duffy, F Daniel; Gordon, Geoffrey H; Whelan, Gerald; Cole-Kelly, Kathy; Frankel, Richard; Buffone, Natalie; Lofton, Stephanie; Wallace, MaryAnne; Goode, Leslie; Langdon, Lynn

2004-06-01

Accreditation of residency programs and certification of physicians requires assessment of competence in communication and interpersonal skills. Residency and continuing medical education program directors seek ways to teach and evaluate these competencies. This report summarizes the methods and tools used by educators, evaluators, and researchers in the field of physician-patient communication as determined by the participants in the "Kalamazoo II" conference held in April 2002. Communication and interpersonal skills form an integrated competence with two distinct parts. Communication skills are the performance of specific tasks and behaviors such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills are inherently relational and process oriented; they are the effect communication has on another person such as relieving anxiety or establishing a trusting relationship. This report reviews three methods for assessment of communication and interpersonal skills: (1) checklists of observed behaviors during interactions with real or simulated patients; (2) surveys of patients' experience in clinical interactions; and (3) examinations using oral, essay, or multiple-choice response questions. These methods are incorporated into educational programs to assess learning needs, create learning opportunities, or guide feedback for learning. The same assessment tools, when administered in a standardized way, rated by an evaluator other than the teacher, and using a predetermined passing score, become a summative evaluation. The report summarizes the experience of using these methods in a variety of educational and evaluation programs and presents an extensive bibliography of literature on the topic. Professional conversation between patients and doctors shapes diagnosis, initiates therapy, and establishes a caring relationship. The degree to which these activities are successful depends, in

Comparison of Parent Report and Direct Assessment of Child Skills in Toddlers.

Science.gov (United States)

Miller, Lauren E; Perkins, Kayla A; Dai, Yael G; Fein, Deborah A

2017-09-01

There are unique challenges associated with measuring development in early childhood. Two primary sources of information are used: parent report and direct assessment. Each approach has strengths and weaknesses, particularly when used to identify and diagnose developmental delays. The present study aimed to evaluate consistency between parent report and direct assessment of child skills in toddlers with and without Autism Spectrum Disorder (ASD) across receptive language, expressive language, and fine motor domains. 109 children were evaluated at an average age of two years; data on child skills were collected via parent report and direct assessment. Children were classified into three groups (i.e., ASD, Other Developmental Disorder, or Typical Development) based on DSM-IV-TR diagnosis. Mixed design ANOVAs, with data source as a within subjects factor and diagnostic group as a between subjects factor, were used to assess agreement. Chi square tests of agreement were then used to examine correspondence at the item level. Results suggested that parent report of language and fine motor skills did not significantly differ from direct assessment, and this finding held across diagnostic groups. Item level analyses revealed that, in most cases of significant disagreement, parents reported a skill as present, but it was not seen on direct testing. Results indicate that parents are generally reliable reporters of child language and fine motor abilities in toddlerhood, even when their children have developmental disorders such as ASD. However, the fullest picture may be obtained by using both parent report and direct assessment.

Impact of teaching and assessment format on electrocardiogram interpretation skills.

Science.gov (United States)

Raupach, Tobias; Hanneforth, Nathalie; Anders, Sven; Pukrop, Tobias; Th J ten Cate, Olle; Harendza, Sigrid

2010-07-01

Interpretation of the electrocardiogram (ECG) is a core clinical skill that should be developed in undergraduate medical education. This study assessed whether small-group peer teaching is more effective than lectures in enhancing medical students' ECG interpretation skills. In addition, the impact of assessment format on study outcome was analysed. Two consecutive cohorts of Year 4 medical students (n=335) were randomised to receive either traditional ECG lectures or the same amount of small-group, near-peer teaching during a 6-week cardiorespiratory course. Before and after the course, written assessments of ECG interpretation skills were undertaken. Whereas this final assessment yielded a considerable amount of credit points for students in the first cohort, it was merely formative in nature for the second cohort. An unannounced retention test was applied 8 weeks after the end of the cardiovascular course. A significant advantage of near-peer teaching over lectures (effect size 0.33) was noted only in the second cohort, whereas, in the setting of a summative assessment, both teaching formats appeared to be equally effective. A summative instead of a formative assessment doubled the performance increase (Cohen's d 4.9 versus 2.4), mitigating any difference between teaching formats. Within the second cohort, the significant difference between the two teaching formats was maintained in the retention test (p=0.017). However, in both cohorts, a significant decrease in student performance was detected during the 8 weeks following the cardiovascular course. Assessment format appeared to be more powerful than choice of instructional method in enhancing student learning. The effect observed in the second cohort was masked by an overriding incentive generated by the summative assessment in the first cohort. This masking effect should be considered in studies assessing the effectiveness of different teaching methods.

Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery.

Science.gov (United States)

Oropesa, Ignacio; Sánchez-González, Patricia; Lamata, Pablo; Chmarra, Magdalena K; Pagador, José B; Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Gómez, Enrique J

2011-11-01

Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor-trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons' psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules. Copyright © 2011 Elsevier Inc. All rights reserved.

Self-assessment and goal-setting is associated with an improvement in interviewing skills

Directory of Open Access Journals (Sweden)

Kathleen Hanley

2014-07-01

Full Text Available Purpose: Describe the relationship between medical students’ self-assessment and goal-setting (SAGS skills and development of interviewing skills during the first-year doctoring course. Method: 157 first-year medical students completed three two-case standardized patient (SP interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. Results: SAGS improved over time (37% good week 1 vs. 61% good week 10. Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills – those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024. For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1–10 and then increased significantly at week 17. For those whose SAGS remained ‘poor’ in weeks 1–10, interviewing skills declined in weeks 10–17. Conclusions: In general, the quality of students’ SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

A Clinic-Based Assessment for Evaluating Job-Related Social Skills in Adolescents and Adults with Autism.

Science.gov (United States)

Lerman, Dorothea C; White, Bridgette; Grob, Carolyn; Laudont, Courtney

2017-12-01

Many individuals with autism spectrum disorder (ASD) have difficulties obtaining and maintaining employment, yet little research has evaluated methods for assessing and improving critical vocational skills. In this study, we evaluated an assessment of job-related social skills for individuals with ASD by arranging conditions that simulated on-the-job experiences in a clinic setting. The experimenter contrived situations to assess a variety of social skills, including asking for help, asking for more materials, and responding to corrective feedback. A total of eight individuals, aged 16 to 32 years, participated. Results suggested that the assessment was useful for identifying specific social skills that could be targeted for intervention to increase success in the work environment. These findings add to the current literature by demonstrating an objective method for assessing a variety of job-related social skills under controlled, naturalistic conditions.

The Computerized Perceptual Motor Skills Assessment: A new visual perceptual motor skills evaluation tool for children in early elementary grades.

Science.gov (United States)

Howe, Tsu-Hsin; Chen, Hao-Ling; Lee, Candy Chieh; Chen, Ying-Dar; Wang, Tien-Ni

2017-10-01

Visual perceptual motor skills have been proposed as underlying courses of handwriting difficulties. However, there is no evaluation tool currently available to assess these skills comprehensively and to serve as a sensitive measure. The purpose of this study was to validate the Computerized Perceptual Motor Skills Assessment (CPMSA), a newly developed evaluation tool for children in early elementary grades. Its test-retest reliability, concurrent validity, discriminant validity, and responsiveness were examined in 43 typically developing children and 26 children with handwriting difficulty. The CPMSA demonstrated excellent reliability across all subtests with intra-class correlation coefficients (ICCs)≥0.80. Significant moderate correlations between the domains of the CPMSA and corresponding gold standards including Beery VMI, the TVPS-3, and the eye-hand coordination subtest of the DTVP-2 demonstrated good concurrent validity. In addition, the CPMSA showed evidence of discriminant validity in samples of children with and without handwriting difficulty. This article provides evidence in support of the CPMSA. The CPMSA is a reliable, valid, and promising measure of visual perceptual motor skills for children in early elementary grades. Directions for future study and improvements to the assessment are discussed. Copyright © 2017. Published by Elsevier Ltd.

Development and validation of an instrument to assess and improve clinical consultation skills

OpenAIRE

Lefroy, JE; Gay, SP; Gibson, S; Williams, S; McKinley, RK

2011-01-01

Context: Development of medical students’ consultation skills with patients is at the core of the UK General Medical Council’s 'Tomorrow’s Doctors' guide (2009). Teaching and assessment of these skills must therefore be a core component of the medical undergraduate curriculum. The Calgary Cambridge guide to the medical interview and the Leicester Assessment Package (LAP) provide a foundation for teaching and assessment, but both have different strengths. Objective: To develop and validate a c...

Use of human patient simulation and the situation awareness global assessment technique in practical trauma skills assessment.

Science.gov (United States)

Hogan, Michael P; Pace, David E; Hapgood, Joanne; Boone, Darrell C

2006-11-01

Situation awareness (SA) is defined as the perception of elements in the environment within a volume of time and space, the comprehension of their meaning, and the projection of their status in the near future. This construct is vital to decision making in intense, dynamic environments. It has been used in aviation as it relates to pilot performance, but has not been applied to medical education. The most widely used objective tool for measuring trainee SA is the Situation Awareness Global Assessment Technique (SAGAT). The purpose of this study was to design and validate SAGAT for assessment of practical trauma skills, and to compare SAGAT results to traditional checklist style scoring. Using the Human Patient Simulator, we designed SAGAT for practical trauma skills assessment based on Advanced Trauma Life Support objectives. Sixteen subjects (four staff surgeons, four senior residents, four junior residents, and four medical students) participated in three scenarios each. They were assessed using SAGAT and traditional checklist assessment. A questionnaire was used to assess possible confounding factors in attaining SA and overall trainee satisfaction. SAGAT was found to show significant difference (analysis of variance; p level of training lending statistical support to construct validity. SAGAT was likewise found to display reliability (Cronbach's alpha 0.767), and significant scoring correlation with traditional checklist performance measures (Pearson's coefficient 0.806). The questionnaire revealed no confounding factors and universal satisfaction with the human patient simulator and SAGAT. SAGAT is a valid, reliable assessment tool for trauma trainees in the dynamic clinical environment created by human patient simulation. Information provided by SAGAT could provide specific feedback, direct individualized teaching, and support curriculum change. Introduction of SAGAT could improve the current assessment model for practical trauma education.

The Impact of Adaptive Complex Assessment on the HOT Skill Development of Students

Science.gov (United States)

Raiyn, Jamal; Tilchin, Oleg

2016-01-01

In this paper we propose a method for the adaptive complex assessment (ACA) of the higher-order thinking (HOT) skills needed by students for problem solving, and we examine the impact of the method on the development of HOT skills in a problem-based learning (PBL) environment. Complexity in the assessment is provided by initial, formative, and…

Cinemeducation: teaching family assessment skills using full-length movies.

Science.gov (United States)

Wilson, Astrid H; Blake, Barbara J; Taylor, Gloria A; Hannings, Glenda

2013-05-01

A thorough family assessment provides a foundation for the nursing process when working with families. Therefore, nurses, along with other health care providers must develop expertise in conducting family assessments to provide the best possible care within the community. This article describes an innovative educational strategy using movies to teach family assessment skills and puts forth recommendations for future research to provide evidence to support this teaching modality. © 2013 Wiley Periodicals, Inc.

Using the Interpersonal Skills tool to assess interpersonal skills of internationally educated nurses.

Science.gov (United States)

Shen, Jay J; Xu, Yu; Staples, Shelley; Bolstad, Anne L

2014-07-01

To assess interpersonal skills of internationally educated nurses (IEN) while interacting with standardized patients. Participants included 52 IEN at two community hospitals in the southwestern region of the USA. Standardized patients were used to create patient-nurse encounter. Seventeen items in four domains ("skills in interviewing and collecting information"; "skills in counseling and delivering information"; "rapport"; and "personal manner") in an Interpersonal Skills (IPS) instrument were measured by a Likert scale 1-4 with 4 indicating the best performance. The average composite score per domain and scores of the 17 items were compared across the domains. On 10 of the 17 items, the nurses received scores under 3. Counseling with an average score of 2.10 and closure with an average score of 2.44 in domain 2, small talk with an average score of 2.06 in domain 3, and physical exam with average score of 2.21 in domain 4 were below 2.5. The average composite score of domain 1 was 3.54, significantly higher than those of domains 2-4 (2.77, 2.81, and 2.71, respectively). Age was moderately related to the average score per domain with every 10 year increase in age resulting in a 0.1 increase in the average score. Sex and country of origin showed mixed results. The interpersonal skills of IEN in three of the four domains need improvement. Well-designed educational programs may facilitate the improvement, especially in areas of small talk, counseling, closure, and physical exam. Future research should examine relationships between the IPS and demographics factors. © 2013 The Authors. Japan Journal of Nursing Science © 2013 Japan Academy of Nursing Science.

Reliability and Validity of 3 Methods of Assessing Orthopedic Resident Skill in Shoulder Surgery.

Science.gov (United States)

Bernard, Johnathan A; Dattilo, Jonathan R; Srikumaran, Uma; Zikria, Bashir A; Jain, Amit; LaPorte, Dawn M

Traditional measures for evaluating resident surgical technical skills (e.g., case logs) assess operative volume but not level of surgical proficiency. Our goal was to compare the reliability and validity of 3 tools for measuring surgical skill among orthopedic residents when performing 3 open surgical approaches to the shoulder. A total of 23 residents at different stages of their surgical training were tested for technical skill pertaining to 3 shoulder surgical approaches using the following measures: Objective Structured Assessment of Technical Skills (OSATS) checklists, the Global Rating Scale (GRS), and a final pass/fail assessment determined by 3 upper extremity surgeons. Adverse events were recorded. The Cronbach α coefficient was used to assess reliability of the OSATS checklists and GRS scores. Interrater reliability was calculated with intraclass correlation coefficients. Correlations among OSATS checklist scores, GRS scores, and pass/fail assessment were calculated with Spearman ρ. Validity of OSATS checklists was determined using analysis of variance with postgraduate year (PGY) as a between-subjects factor. Significance was set at p shoulder approaches. Checklist scores showed superior interrater reliability compared with GRS and subjective pass/fail measurements. GRS scores were positively correlated across training years. The incidence of adverse events was significantly higher among PGY-1 and PGY-2 residents compared with more experienced residents. OSATS checklists are a valid and reliable assessment of technical skills across 3 surgical shoulder approaches. However, checklist scores do not measure quality of technique. Documenting adverse events is necessary to assess quality of technique and ultimate pass/fail status. Multiple methods of assessing surgical skill should be considered when evaluating orthopedic resident surgical performance. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights

E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

Science.gov (United States)

Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

2018-04-01

Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure

Skill assessment of the coupled physical-biogeochemical operational Mediterranean Forecasting System

Science.gov (United States)

Cossarini, Gianpiero; Clementi, Emanuela; Salon, Stefano; Grandi, Alessandro; Bolzon, Giorgio; Solidoro, Cosimo

2016-04-01

The Mediterranean Monitoring and Forecasting Centre (Med-MFC) is one of the regional production centres of the European Marine Environment Monitoring Service (CMEMS-Copernicus). Med-MFC operatively manages a suite of numerical model systems (3DVAR-NEMO-WW3 and 3DVAR-OGSTM-BFM) that provides gridded datasets of physical and biogeochemical variables for the Mediterranean marine environment with a horizontal resolution of about 6.5 km. At the present stage, the operational Med-MFC produces ten-day forecast: daily for physical parameters and bi-weekly for biogeochemical variables. The validation of the coupled model system and the estimate of the accuracy of model products are key issues to ensure reliable information to the users and the downstream services. Product quality activities at Med-MFC consist of two levels of validation and skill analysis procedures. Pre-operational qualification activities focus on testing the improvement of the quality of a new release of the model system and relays on past simulation and historical data. Then, near real time (NRT) validation activities aim at the routinely and on-line skill assessment of the model forecast and relays on the NRT available observations. Med-MFC validation framework uses both independent (i.e. Bio-Argo float data, in-situ mooring and vessel data of oxygen, nutrients and chlorophyll, moored buoys, tide-gauges and ADCP of temperature, salinity, sea level and velocity) and semi-independent data (i.e. data already used for assimilation, such as satellite chlorophyll, Satellite SLA and SST and in situ vertical profiles of temperature and salinity from XBT, Argo and Gliders) We give evidence that different variables (e.g. CMEMS-products) can be validated at different levels (i.e. at the forecast level or at the level of model consistency) and at different spatial and temporal scales. The fundamental physical parameters temperature, salinity and sea level are routinely validated on daily, weekly and quarterly base

Video observation of procedural skills for assessment of trabeculectomy performed by residents.

Science.gov (United States)

Hassanpour, Narges; Chen, Rebecca; Baikpour, Masoud; Moghimi, Sasan

2016-06-01

The efficacy and sufficiency of a healthcare system is directly related to the knowledge and skills of graduates working in the system. In this regard, many different assessment methods have been proposed to evaluate various skills of the learners. Video Observation of Procedural Skills (VOPS) is one newly-proposed method. In this study we aimed to compare the results of the VOPS method with the more commonly used Direct Observation of Procedural Skills (DOPS). In this prospective study conducted in 2012, all 10 ophthalmology residents of post graduate year 4 were selected for participation. Three months into training in the glaucoma ward, these residents performed trabeculectomy surgery on patients, and their procedural skills were assessed in real time by an expert via the DOPS method. All surgeries were also recorded and later evaluated via the VOPS method by an expert. Bland-Altman plot also was used to compare the two methods and calculating the mean and 95% limit of agreement. Residents have been done a mean of 14.9 ± 3.5 (range 10-20) independent trabeculectomy before the assessments. DOPS grade was positively associated with number of independent trabeculectomy during glaucoma rotation (β=0.227, p = 0.004). The intra-observer reproducibility of VOPS measurements was 0.847 (95% CI: 0.634, 0.961). The mean VOPS grade was significantly lower than the mean DOPS grade (8.4 vs. 8.9, p = 0.02). However, a good correlation was observed between the grades of VOPS and DOPS (r = 0.89, p = 0.001). Bland-Altman analysis demonstrated that all data points fell within the 95% limits of agreement (-1.46, 0.46). The present study showed that VOPS might be considered a feasible, valid, and reliable assessment method for procedural skills of medical students and residents that can be used as an alternative to the DOPS method. However, VOPS might underestimate DOPS in evaluating surgical skills of residents.

How can teachers assess reading skills of generation z learners in German language class?

Science.gov (United States)

Dirga, R. N.; Wijayati, P. H.

2018-01-01

Generation Z is a digital native generation who has unique characteristics on the daily basis includes reading. In order to assess their reading skills correctly, teachers need to take these characteristics into consideration. This paper aims to describe the process in developing an instrument to assess reading skills of Generation Z learners in German language class. This study used developmental method. The developed instrument has not only good quality but also consists of texts that are suitable for German learners of Generation Z. This instrument can be used as an example in assessing German learners’ reading skills in the 21st century.

Development and Application of a Stepwise Assessment Process for Rational Redesign of Sequential Skills-Based Courses.

Science.gov (United States)

Gallimore, Casey E; Porter, Andrea L; Barnett, Susanne G

2016-10-25

Objective. To develop and apply a stepwise process to assess achievement of course learning objectives related to advanced pharmacy practice experiences (APPEs) preparedness and inform redesign of sequential skills-based courses. Design. Four steps comprised the assessment and redesign process: (1) identify skills critical for APPE preparedness; (2) utilize focus groups and course evaluations to determine student competence in skill performance; (3) apply course mapping to identify course deficits contributing to suboptimal skill performance; and (4) initiate course redesign to target exposed deficits. Assessment. Focus group participants perceived students were least prepared for skills within the Accreditation Council for Pharmacy Education's pre-APPE core domains of Identification and Assessment of Drug-related Problems and General Communication Abilities. Course mapping identified gaps in instruction, performance, and assessment of skills within aforementioned domains. Conclusions. A stepwise process that identified strengths and weaknesses of a course, was used to facilitate structured course redesign. Strengths of the process included input and corroboration from both preceptors and students. Limitations included feedback from a small number of pharmacy preceptors and increased workload on course coordinators.

Students’ performance in the different clinical skills assessed in OSCE: what does it reveal?

Directory of Open Access Journals (Sweden)

Joong Hiong Sim

2015-02-01

Full Text Available Introduction: The purpose of this study was to compare students’ performance in the different clinical skills (CSs assessed in the objective structured clinical examination. Methods: Data for this study were obtained from final year medical students’ exit examination (n=185. Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Results: Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs, procedural skills (PSs, and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332=20.253, p<0.001]. Pairwise multiple comparisons revealed significant differences between the means of the eight pairs of CSs assessed, at p<0.05. Conclusions: CRSs appeared to be the weakest while PSs were the strongest, among the six CSs assessed. Students’ unsatisfactory performance in CRS needs to be addressed as CRS is one of the core competencies in medical education and a critical skill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students’ clinical reasoning development.

Haptic feedback can provide an objective assessment of arthroscopic skills.

Science.gov (United States)

Chami, George; Ward, James W; Phillips, Roger; Sherman, Kevin P

2008-04-01

The outcome of arthroscopic procedures is related to the surgeon's skills in arthroscopy. Currently, evaluation of such skills relies on direct observation by a surgeon trainer. This type of assessment, by its nature, is subjective and time-consuming. The aim of our study was to identify whether haptic information generated from arthroscopic tools could distinguish between skilled and less skilled surgeons. A standard arthroscopic probe was fitted with a force/torque sensor. The probe was used by five surgeons with different levels of experience in knee arthroscopy performing 11 different tasks in 10 standard knee arthroscopies. The force/torque data from the hand and tool interface were recorded and synchronized with a video recording of the procedure. The torque magnitude and patterns generated were analyzed and compared. A computerized system was used to analyze the force/torque signature based on general principles for quality of performance using such measures as economy in movement, time efficiency, and consistency in performance. The results showed a considerable correlation between three haptic parameters and the surgeon's experience, which could be used in an automated objective assessment system for arthroscopic surgery. Level II, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.

Gender-fair assessment of young gifted students' scientific thinking skills

Science.gov (United States)

Dori, Y. J.; Zohar, A.; Fischer-Shachor, D.; Kohan-Mass, J.; Carmi, M.

2018-04-01

This paper describes an Israeli national-level research examining the extent to which admissions of elementary school students to the gifted programmes based on standardised tests are gender-fair. In the research, the gifted students consisted of 275 boys, 128 girls, and additional 80 girls who were admitted to the gifted programme through affirmative action (AA). To assess these young students' scientific thinking skills, also referred to as science practices, open-ended questions of case-based questionnaires were developed. The investigated scientific thinking skills were question posing, explanation, graphing, inquiry, and metacognition. Analysis of the students' responses revealed that gifted girls who entered the programmes through AA performed at the same level as the other gifted students. We found significant differences between the three research groups in question posing and graphing skills. We suggest increasing gender-fairness by revising the standard national testing system to include case-based narratives followed by open-ended questions that assess gifted students' scientific thinking skills. This may diminish the gender inequity expressed by the different number of girls and boys accepted to the gifted programmes. We show that open-ended tools for analysing students' scientific thinking might better serve both research and practice by identifying gifted girls and boys equally well.

OSCE vs. TEM: Different approaches to assess clinical skills of nursing students

Directory of Open Access Journals (Sweden)

Prasuna Jelly

2017-01-01

Full Text Available Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001. The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM.

Increasing Skills in Writing Literature Study on Research-Based Learning Through Authentical Assessment Lecturing in Innovation Class of Social Science Learning

Directory of Open Access Journals (Sweden)

Naniek Sulistya Wardani

2017-08-01

Full Text Available The purpose of this study is to determine whether the improvement of literature review skills on research-based learning can be pursued through the authentic assessment of the lectures of the Innovation of Learning IPS of PGSD students. This type of research is a classroom action research, using a spiral model of C. Kemmis and Robin Mc. Taggart. The research procedure uses 2 cycles, each cycle consists of 3 stages namely, 1 action planning 2 implementation of action and observation, 3 reflection. The subjects of the study were all students of PGSD Class 2014 E of the subjects of Innovation of IPS Learning as much as 27 students consisting of 7 male students and 20 female students. Data collection techniques use observation and product assessment. Data analysis technique is a percentage technique that compares literacy review writing skills through authentic assessment in IPS lectures between cycles. The result of the research shows that there is an improvement of writing skill of study lecture study of IPS learning innovation, which is pursued through authentic assessment. This is evident from the improvement of writing skills worthy of achievement from cycle 1 to cycle 2 ie from 62.14% of 27 students increased to 72.60% of all students in cycle 2. Writing skills in research-based learning is a skill to express the idea of the problem , Organizing facts, concepts and principles, use of EYD grammar and grammar. Authentic assessment is an assessment consisting of connection aspects, reflection aspects, and feedback aspects

Developing Learning Model P3E to Improve Students’ Critical Thinking Skills of Islamic Senior High School

Science.gov (United States)

Bahtiar; Rahayu, Y. S.; Wasis

2018-01-01

This research aims to produce P3E learning model to improve students’ critical thinking skills. The developed model is named P3E, consisting of 4 (four) stages namely; organization, inquiry, presentation, and evaluation. This development research refers to the development stage by Kemp. The design of the wide scale try-out used pretest-posttest group design. The wide scale try-out was conducted in grade X of 2016/2017 academic year. The analysis of the results of this development research inludes three aspects, namely: validity, practicality, and effectiveness of the model developed. The research results showed; (1) the P3E learning model was valid, according to experts with an average value of 3.7; (2) The completion of the syntax of the learning model developed obtained 98.09% and 94.39% for two schools based on the assessment of the observers. This shows that the developed model is practical to be implemented; (3) the developed model is effective for improving students’ critical thinking skills, although the n-gain of the students’ critical thinking skills was 0.54 with moderate category. Based on the results of the research above, it can be concluded that the developed P3E learning model is suitable to be used to improve students’ critical thinking skills.

Feedforward self-modeling enhances skill acquisition in children learning trampoline skills.

Science.gov (United States)

Ste-Marie, Diane M; Vertes, Kelly; Rymal, Amanda M; Martini, Rose

2011-01-01

The purpose of this research was to examine whether children would benefit from a feedforward self-modeling (FSM) video and to explore possible explanatory mechanisms for the potential benefits, using a self-regulation framework. To this end, children were involved in learning two five-skill trampoline routines. For one of the routines, a FSM video was provided during acquisition, whereas only verbal instructions were provided for the alternate routine. The FSM involved editing video footage such that it showed the learner performing the trampoline routine at a higher skill level than their current capability. Analyses of the data showed that while physical performance benefits were observed for the routine that was learned with the FSM video, no differences were obtained in relation to the self-regulatory measures. Thus, the FSM video enhanced motor skill acquisition, but this could not be explained by changes to the varied self-regulatory processes examined.

Assessing 21st Century Skills: A Guide to Evaluating Mastery and Authentic Learning

Science.gov (United States)

Greenstein, Laura

2012-01-01

The Common Core State Standards clearly define the skills students need for success in college and the 21st century workplace. The question is, how can you measure student mastery of skills like creativity, problem solving, and use of technology? Laura Greenstein demonstrates how teachers can teach and assess 21st century skills using authentic…

Teaching and assessment of communication skills in undergraduate dental education - a survey in German-speaking countries.

Science.gov (United States)

Rüttermann, S; Sobotta, A; Hahn, P; Kiessling, C; Härtl, A

2017-08-01

Teaching communication is perceived to be of importance in dental education. Several reports have been published worldwide in the educational literature describing modifications of the dental curriculum by implementing the teaching of communication skills. Surveys which evaluate the current state of training and assessment of communication skills in dental education in different countries exist already in some countries, but little information is available about German-speaking countries. In a cross-sectional study with the aim of a census, all 36 dental schools in Germany (30), Austria (3), and Switzerland (3) were surveyed. The present survey revealed that at 26 of the 34 dental schools (76%), communication skills training has been implemented. Training of communication skills mainly takes place between the 6th and the 9th semester. Ten schools were able to implement a partly longitudinal curriculum, while the other sites only offer stand-alone courses. Of the 34 dental schools, six assess communication skills in a summative way. Three of those schools also use formative assessments for their students. Another seven sites only use formative assessment. From the various formats of assessment, OSCE is mentioned most frequently. The necessity to train and assess communication skills has reached German-speaking dental schools. The present survey allows an overview of the training and assessment of communication skills in undergraduate dental education in German-speaking Europe. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Are We Teaching Them Anything?: A Model for Measuring Methodology Skills in the Political Science Major

Science.gov (United States)

Siver, Christi; Greenfest, Seth W.; Haeg, G. Claire

2016-01-01

While the literature emphasizes the importance of teaching political science students methods skills, there currently exists little guidance for how to assess student learning over the course of their time in the major. To address this gap, we develop a model set of assessment tools that may be adopted and adapted by political science departments…

Individualized Special Education with Cognitive Skill Assessment.

Science.gov (United States)

Kurhila, Jaakko; Laine, Tei

2000-01-01

Describes AHMED (Adaptive and Assistive Hypermedia in Education), a computer learning environment which supports the evaluation of disabled children's cognitive skills in addition to supporting openness in learning materials and adaptivity in learning events. Discusses cognitive modeling and compares it to previous intelligent tutoring systems.…

ASK Standards: Assessment, Skills, and Knowledge Content Standards for Student Affairs Practitioners and Scholars

Science.gov (United States)

ACPA College Student Educators International, 2011

2011-01-01

The Assessment Skills and Knowledge (ASK) standards seek to articulate the areas of content knowledge, skill and dispositions that student affairs professionals need in order to perform as practitioner-scholars to assess the degree to which students are mastering the learning and development outcomes the professionals intend. Consistent with…

Can Perceptuo-Motor Skills Assessment Outcomes in Young Table Tennis Players (7–11 years) Predict Future Competition Participation and Performance? An Observational Prospective Study

Science.gov (United States)

2016-01-01

Forecasting future performance in youth table tennis players based on current performance is complex due to, among other things, differences between youth players in growth, development, maturity, context and table tennis experience. Talent development programmes might benefit from an assessment of underlying perceptuo-motor skills for table tennis, which is hypothesized to determine the players’ potential concerning the perceptuo-motor domain. The Dutch perceptuo-motor skills assessment intends to measure the perceptuo-motor potential for table tennis in youth players by assessing the underlying skills crucial for developing technical and tactical qualities. Untrained perceptuo-motor tasks are used as these are suggested to represent a player’s future potential better than specific sport skills themselves as the latter depend on exposure to the sport itself. This study evaluated the value of the perceptuo-motor skills assessment for a talent developmental programme by evaluating its predictive validity for competition participation and performance in 48 young table tennis players (7–11 years). Players were tested on their perceptuo-motor skills once during a regional talent day, and the subsequent competition results were recorded half-yearly over a period of 2.5 years. Logistic regression analysis showed that test scores did not predict future competition participation (p >0.05). Yet, the Generalized Estimating Equations analysis, including the test items ‘aiming at target’, ‘throwing a ball’, and ‘eye-hand coordination’ in the best fitting model, revealed that the outcomes of the perceptuo-motor skills assessment were significant predictors for future competition results (R2 = 51%). Since the test age influences the perceptuo-motor skills assessment’s outcome, another multivariable model was proposed including test age as a covariate (R2 = 53%). This evaluation demonstrates promising prospects for the perceptuo-motor skills assessment to be

Skills in clinical communication: Are we correctly assessing them at undergraduate level?

Directory of Open Access Journals (Sweden)

Alberto Zamora Cervantes

2014-07-01

Full Text Available Communicating with the patient in clinical practice refers to the way in which the doctor and the patient interact both verbally and nonverbally, in order to achieve a shared understanding of problems and solutions. Traditional learning and assessment systems are overwhelmed when it comes to addressing the complex and multi-dimensional problems of professional practice. Problem Based Learning (PBL has been put forward as an alternative to the mere reproduction of knowledge and pre-established patterns, enabling students to develop their own learning strategies to overcome problems in their future professional practice. The challenge is to determine how to assess the acquisition of clinical communication skills. The authors have recommended a summative assessment of clinical communication skills based on the combination of different methods. It highlights the importance of feedback-based formative assessment. This raises the need to develop and validate assessment scales in clinical communication at an undergraduate level. Based on this work, the authors put forward a "fanned out" assessment in terms of clinical communication skills in Medicine degrees, with the use of different instruments in a "spiraled" manner, where the greater the contact with clinical practice in the various degree and integral courses, the greater difficulty experienced, with the participation of all the stakeholders involved (self, hetero and peer assessment without precluding the involvement of patients (real or simulated in the design of assessment instruments.

The Dreyfus model of clinical problem-solving skills acquisition: a critical perspective.

Science.gov (United States)

Peña, Adolfo

2010-06-14

The Dreyfus model describes how individuals progress through various levels in their acquisition of skills and subsumes ideas with regard to how individuals learn. Such a model is being accepted almost without debate from physicians to explain the 'acquisition' of clinical skills. This paper reviews such a model, discusses several controversial points, clarifies what kind of knowledge the model is about, and examines its coherence in terms of problem-solving skills. Dreyfus' main idea that intuition is a major aspect of expertise is also discussed in some detail. Relevant scientific evidence from cognitive science, psychology, and neuroscience is reviewed to accomplish these aims. Although the Dreyfus model may partially explain the 'acquisition' of some skills, it is debatable if it can explain the acquisition of clinical skills. The complex nature of clinical problem-solving skills and the rich interplay between the implicit and explicit forms of knowledge must be taken into consideration when we want to explain 'acquisition' of clinical skills. The idea that experts work from intuition, not from reason, should be evaluated carefully.

Using systematically observed clinical encounters (SOCEs to assess medical students’ skills in clinical settings

Directory of Open Access Journals (Sweden)

George R Bergus

2010-11-01

Full Text Available George R Bergus1–3, Jerold C Woodhead4, Clarence D Kreiter2,51Performance Based Assessment Program, Office of Student Affairs and Curriculum, 2Department of Family Medicine, 3Department of Psychiatry, 4Department of Pediatrics, 5Office of Consultation and Research in Medical Education, Roy J and Lucille A Carver College of Medicine, The University of Iowa, Iowa City, IA, USAIntroduction: The Objective Structured Clinical Examination (OSCE is widely used to assess the clinical performance of medical students. However, concerns related to cost, availability, and validity, have led educators to investigate alternatives to the OSCE. Some alternatives involve assessing students while they provide care to patients – the mini-CEX (mini-Clinical Evaluation Exercise and the Long Case are examples. We investigated the psychometrics of systematically observed clinical encounters (SOCEs, in which physicians are supplemented by lay trained observers, as a means of assessing the clinical performances of medical students.Methods: During the pediatrics clerkship at the University of Iowa, trained lay observers assessed the communication skills of third-year medical students using a communication checklist while the students interviewed and examined pediatric patients. Students then verbally presented their findings to faculty, who assessed students’ clinical skills using a standardized form. The reliability of the combined communication and clinical skills scores was calculated using generalizability theory.Results: Fifty-one medical students completed 199 observed patient encounters. The mean combined clinical and communication skills score (out of a maximum 45 points was 40.8 (standard deviation 3.3. The calculated reliability of the SOCE scores, using generalizability theory, from 10 observed patient encounters was 0.81. Students reported receiving helpful feedback from faculty after 97% of their observed clinical encounters.Conclusion: The SOCE can

The effect of video review of resident laparoscopic surgical skills measured by self- and external assessment.

Science.gov (United States)

Herrera-Almario, Gabriel E; Kirk, Katherine; Guerrero, Veronica T; Jeong, Kwonho; Kim, Sara; Hamad, Giselle G

2016-02-01

Video review of surgical skills is an educational modality that allows trainees to reflect on self-performance. The purpose of this study was to determine whether resident and attending assessments of a resident's laparoscopic performance differ and whether video review changes assessments. Third-year surgery residents were invited to participate. Elective laparoscopic procedures were video recorded. The Global Operative Assessment of Laparoscopic Skills evaluation was completed immediately after the procedure and again 7 to 10 days later by both resident and attending. Scores were compared using t tests. Nine residents participated and 76 video reviews were completed. Residents scored themselves significantly lower than the faculty scores both before and after video review. Resident scores did not change significantly after video review. Attending and resident self-assessment of laparoscopic skills differs and subsequent video review does not significantly affect Global Operative Assessment of Laparoscopic Skills scores. Further studies should evaluate the impact of video review combined with verbal feedback on skill acquisition and assessment. Copyright © 2016 Elsevier Inc. All rights reserved.

Project RAILS: Lessons Learned about Rubric Assessment of Information Literacy Skills

Science.gov (United States)

Belanger, Jackie; Zou, Ning; Mills, Jenny Rushing; Holmes, Claire; Oakleaf, Megan

2015-01-01

Rubric assessment of information literacy is an important tool for librarians seeking to show evidence of student learning. The authors, who collaborated on the Rubric Assessment of Informational Literacy Skills (RAILS) research project, draw from their shared experience to present practical recommendations for implementing rubric assessment in a…

Development of a Social Skills Assessment Screening Scale for Psychiatric Rehabilitation Settings: A Pilot Study.

Science.gov (United States)

Bhola, Poornima; Basavarajappa, Chethan; Guruprasad, Deepti; Hegde, Gayatri; Khanam, Fatema; Thirthalli, Jagadisha; Chaturvedi, Santosh K

2016-01-01

Deficits in social skills may present in a range of psychiatric disorders, particularly in the more serious and persistent conditions, and have an influence on functioning across various domains. This pilot study aimed at developing a brief measure, for structured evaluation and screening for social skills deficits, which can be easily integrated into routine clinical practice. The sample consisted of 380 inpatients and their accompanying caregivers, referred to Psychiatric Rehabilitation Services at a tertiary care government psychiatric hospital. The evaluation included an Inpatient intake Proforma and the 20-item Social Skills Assessment Screening Scale (SSASS). Disability was assessed using the Indian Disability Evaluation and Assessment Scale (IDEAS) for a subset of 94 inpatients. The analysis included means and standard deviations, frequency and percentages, Cronbach's alpha to assess internal consistency, t -tests to assess differences in social skills deficits between select subgroups, and correlation between SSASS and IDEAS scores. The results indicated the profile of social skills deficits assessed among the inpatients with varied psychiatric diagnoses. The "psychosis" group exhibited significantly higher deficits than the "mood disorder" group. Results indicated high internal consistency of the SSASS and adequate criterion validity demonstrated by correlations with select IDEAS domains. Modifications were made to the SSASS following the pilot study. The SSASS has potential value as a measure for screening and individualised intervention plans for social skills training in mental health and rehabilitation settings. The implications for future work on the psychometric properties and clinical applications are discussed.

The Impact of Diagnosing Skill Deficiencies and Assessment-Based Communication Training on Managerial Performance.

Science.gov (United States)

Papa, Michael J.; Graham, Elizabeth E.

1991-01-01

Evaluates an organizational diagnosis program that assesses managerial communication skills and provides the frame for follow-up training programs. Finds that managers participating in follow-up communication skills training performed significantly higher on interpersonal skills, problem-solving ability, and productivity over three long-term…

Models for Delivering Written Business Communication Skills: Improving the Process

Science.gov (United States)

Penrod, Catherine B.; Tucker, Mary; Hartman, Katherine B.

2017-01-01

Employers, higher education faculty, and accrediting bodies value communication as an important entry-level job skill. Unfortunately, research indicates that college graduates have inadequate communication skills and, in particular, lack strong business writing acumen. The ways business communication is taught, integrated, and assessed varies by…

Experiential learning model on entrepreneurship subject for improving students’ soft skills

Directory of Open Access Journals (Sweden)

Lina Rifda Naufalin

2017-01-01

Full Text Available The objective of the research was to improve students’ soft skills on entrepreneurship subject by using experiential learning model. It was expected that the learning model could upgrade students’ soft skills which were indicated by the higher confidence, result and job oriented, being courageous to take risks, leadership, originality, and future-oriented. It was a class action research using Kemmis and Mc Tagart’s design model. The research was conducted for two cycles. The subject of the study was economics education students in 2015/2016.  The result of the research showed that the experiential learning model could improve students’ soft skills. The research showed that there were increases at the dimension of confidence, (52.1%, result-oriented (22.9%, being courageous to take risks (10.4%, leadership (12.5%, originality (10.4%, and future-oriented (18.8%. It could be concluded that the experiential learning model was effective to improve students’ soft skills on entrepreneurship subject. It also showed that the dimension of confidence had the highest rise. Students’ soft skills were shaped through the continuous stimulus when they got involved at the implementation.Penelitian ini bertujuan untuk meningkatkan soft skills mahasiswa dalam mata kuliah kewirausahaan dengan menggunakan model experietial learning. Diharapkan dengan model pembelajaran ini terjadi peningkatan soft skills mahasiswa yang ditandai dengan peningkatan rasa percaya diri, berorientasi tugas dan hasil, berani mengambil resiko, kepemimpinan, keorisinilan, dan berorientasi masa depan. Penelitian ini menggunakan metode penelitian tindakan kelas dengan menggunakan model desain menurut Kemmis dan Mc Tagart. Penelitian ini dilakukan dalam dua siklus, yaitu siklus I dan siklus II. Penelitian ini dilaksanakan di kelas pendidikan ekonomi angkatan 2015/2016. Hasil penelitian ini menunjukkan bahwa penggunaan model experiential learning dapat meningkatkan soft skills

Development of a tool to support holistic generic assessment of clinical procedure skills.

Science.gov (United States)

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

Feedforward self-modeling enhances skill acquisition in children learning trampoline skills

Directory of Open Access Journals (Sweden)

Diane M. Ste-Marie

2011-07-01

Full Text Available The purpose of this research was to examine whether children would benefit from a feedforward self-modeling (FSM video and to explore possible explanatory mechanisms for the potential benefits, using a self-regulation framework. To this end, children were involved in learning two five-skill trampoline routines. For one of the routines, a FSM video was provided during acquisition, whereas only verbal instructions were provided for the alternate routine. The FSM involved editing video footage such that it showed the learner performing the trampoline routine at a higher skill level than their current capability. Analyses of the data showed that while physical performance benefits were observed for the routine that was learned with the FSM video, no differences were obtained in relation to the self-regulatory measures. Thus, the FSM video enhanced motor skill acquisition, but this could not be explained by changes to the varied self-regulatory processes examined.

Students' performance in the different clinical skills assessed in OSCE: what does it reveal?

Science.gov (United States)

Sim, Joong Hiong; Abdul Aziz, Yang Faridah; Mansor, Azura; Vijayananthan, Anushya; Foong, Chan Choong; Vadivelu, Jamuna

2015-01-01

The purpose of this study was to compare students' performance in the different clinical skills (CSs) assessed in the objective structured clinical examination. Data for this study were obtained from final year medical students' exit examination (n=185). Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs), procedural skills (PSs), and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332)=20.253, pskill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students' clinical reasoning development.

Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists

DEFF Research Database (Denmark)

Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter; Konge, Lars

2016-01-01

Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N......-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse...... nontechnical skills of nurse anesthetists....

Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills.

Science.gov (United States)

Gustin, Jillian L; Way, David P; Wells-Di Gregorio, Sharla; McCallister, Jennifer W

2016-08-01

Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings. We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC. We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity. Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC

Novel real-time feedback and integrated simulation model for teaching and evaluating ultrasound-guided regional anesthesia skills in pediatric anesthesia trainees.

Science.gov (United States)

Moore, David L; Ding, Lili; Sadhasivam, Senthilkumar

2012-09-01

To assess, teach, and improve core competencies and skills sets associated with ultrasound-guided regional anesthesia (UGRA) of pediatric anesthesia trainees. To effectively assess and improve UGRA-associated cognitive and technical skills and proficiency of pediatric anesthesia trainees using simulators and real-time feedback. Ultrasound usage has been increasingly adopted by anesthesiologists to perform regional anesthesia. Pediatric UGRA performance significantly lags behind adult UGRA practice. Lack of effective UGRA training is the major reason for this unfortunate lag. Integration of ultrasound imaging, target location, and needling skills are crucial in safely performing UGRA. However, there are no standards to ensure proficiency in practice, nor in training. We implemented an UGRA instructional program for all trainees, in two parts. First, we used a unique training model for initial assessment and training of technical skills. Second, we used an instructional program that encompasses UGRA and equipment-associated cognitive skills. After baseline assessment at 0 months, we retested these trainees at 6 and 12 months to identify progression of proficiency over time. Cognitive and technical UGRA skills of trainees improved significantly over the course of time. UGRA performance average accuracy improved to 79% at 12 months from the baseline accuracy of 57%. Cognitive UGRA-related skills of trainees improved from baseline results of 52.5-79.2% at 12 months. Implementing a multifaceted assessment and real-time feedback-based training has significantly improved UGRA-related cognitive and technical skills and proficiency of pediatric anesthesia trainees. © 2012 Blackwell Publishing Ltd.

An Assessment of the Skill of GEOS-5 Seasonal Forecasts

Science.gov (United States)

Ham, Yoo-Geun; Schubert, Siegfried D.; Rienecker, Michele M.

2013-01-01

The seasonal forecast skill of the NASA Global Modeling and Assimilation Office coupled global climate model (CGCM) is evaluated based on an ensemble of 9-month lead forecasts for the period 1993 to 2010. The results from the current version (V2) of the CGCM consisting of the GEOS-5 AGM coupled to the MOM4 ocean model are compared with those from an earlier version (V1) in which the AGCM (the NSIPP model) was coupled to the Poseidon Ocean Model. It was found that the correlation skill of the Sea Surface Temperature (SST) forecasts is generally better in V2, especially over the sub-tropical and tropical central and eastern Pacific, Atlantic, and Indian Ocean. Furthermore, the improvement in skill in V2 mainly comes from better forecasts of the developing phase of ENSO from boreal spring to summer. The skill of ENSO forecasts initiated during the boreal winter season, however, shows no improvement in terms of correlation skill, and is in fact slightly worse in terms of root mean square error (RMSE). The degradation of skill is found to be due to an excessive ENSO amplitude. For V1, the ENSO amplitude is too strong in forecasts starting in boreal spring and summer, which causes large RMSE in the forecast. For V2, the ENSO amplitude is slightly stronger than that in observations and V1 for forecasts starting in boreal winter season. An analysis of the terms in the SST tendency equation, shows that this is mainly due to an excessive zonal advective feedback. In addition, V2 forecasts that are initiated during boreal winter season, exhibit a slower phase transition of El Nino, which is consistent with larger amplitude of ENSO after the ENSO peak season. It is found that this is due to weak discharge of equatorial Warm Water Volume (WWV). In both observations and V1, the discharge of equatorial WWV leads the equatorial geostrophic easterly current so as to damp the El Nino starting in January. This process is delayed by about 2 months in V2 due to the slower phase

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

Science.gov (United States)

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in

Teachers' Perceptions of a Fundamental Movement Skill (FMS) Assessment Battery in a School Setting

Science.gov (United States)

Lander, Natalie; Morgan, Philip J.; Salmon, Jo; Barnett, Lisa M.

2016-01-01

Fundamental movement skills (FMS) competence is low in adolescent girls. An assessment tool for teachers is needed to monitor FMS in this demographic. The present study explored whether the Canadian Agility and Movement Skill Assessment (CAMSA) is feasible for use by physical education (PE) teachers of Australian Year 7 girls in a school setting.…

Assessing Leadership and Problem-Solving Skills and Their Impacts in the Community.

Science.gov (United States)

Rohs, F. Richard; Langone, Christine A.

1993-01-01

A pretest-posttest control group design was used to assess the leadership and problem-solving skills of 281 participants and 110 controls in a statewide community leadership development program. Quantitative and qualitative data demonstrate that the program has been a catalyst to influence leadership and problem-solving skills for community…

Assessing neurosurgical non-technical skills: an exploratory study of a new behavioural marker system.

Science.gov (United States)

Michinov, Estelle; Jamet, Eric; Dodeler, Virginie; Haegelen, Claire; Jannin, Pierre

2014-10-01

The management of non-technical skills is a major factor affecting teamwork quality and patient safety. This article presents a behavioural marker system for assessing neurosurgical non-technical skills (BMS-NNTS). We tested the BMS during deep brain stimulation surgery. We developed the BMS in three stages. First, we drew up a provisional assessment tool based on the literature and observation tools developed for other surgical specialties. We then analysed videos made in an operating room (OR) during deep brain stimulation operations in order to ensure there were no significant omissions from the skills list. Finally, we used five videos of operations to identify the behavioural markers of non-technical skills in verbal communications. Analyses of more than six hours of observations revealed 3515 behaviours from which we determined the neurosurgeon's non-technical skills behaviour pattern. The neurosurgeon frequently engaged in explicit coordination, situation awareness and leadership behaviours. In addition, the neurosurgeon's behaviours differed according to the stage of the operation and the OR staff members with whom she was communicating. Our behavioural marker system provides a structured approach to assessing non-technical skills in the field of neurosurgery. It can also be transferred to other surgical specialties and used in surgeon training curricula. © 2014 John Wiley & Sons, Ltd.

Description of the Assessment of Basic Language and Learning Skills Revisited (ABLLS-R

Directory of Open Access Journals (Sweden)

Semenovich M.L.

2015-12-01

Full Text Available Diagnostics and assessment of the functional skills of children with disabilities and autism spectrum disorders are to be conducted to develop comprehensive remedial educational programmes. The described Methodology of the Assessment of Basic Language and Learning Skills — Revisited (ABLLS-R allows to simplify and make the diagnostics more efficient, to conduct a comprehensive examination of the child in different areas of development, detect the formed and deficit skills. The second and final part of the description of the methodology offers recommendations on the filling of the Table of the Results of Initial and Repeated Testing and on the choice of goals of correctional work with a child on the basis of performance of individual test scales. The pattern of the table filled after the initial and repeated testing is given. In drawing up of the programme of individual development the willingness of the child to the development of that skill should be considered. Regular practice of selected skills in various situations and the preventive measures against the regression of skills are also important. Conclusive part. Beginning in № 3 (48, 2015

Using the learning management evaluation model for advancing to life skills of lower secondary students in the 21st century

Science.gov (United States)

Kansaart, Preecha; Suikraduang, Arun; Panya, Piyatida

2018-01-01

The aims of this research study were to develop the Learning Management Evaluation Model (LMEM) for advancing to lower secondary students of their life skills in the 21st century with the Research & Development process technique. The research procedures were administered of four steps that composed of analyze, the synthetic indicator to assess learning to advance to their life skills in the 21st century by the 4-educational experts were interviewed. The LMEM model was developed by the information from the first draft format and the educational experts to check a suitability and feasibility of the draft assessment form with a technical symposium multipath characteristics to find consensus dimensional (Multi-Attribute Consensus Reaching: MACR) by 12 specialists who provided the instruction in the form of Assessment and Evaluation Guide (AEG) was brought to five the number of professionals who ensure the proper coverage, a clear assessment of the manual before using the AEG. The LMEM model was to trial at an experiment with different schools in the Secondary Educational Office Area 26 (Maha Sarakham) whereas taught at the upper secondary educational school with the sample consisted of 7 schools with the purposive sampling was selected. Assessing the LMEM model was evaluated the based on the evaluation criteria of the educational development. The assessor was related to the trial consisted of 35 evaluators. Using the interview form with the rubric score and a five rating scale level was analyzed; the qualitative and quantitative data were used. It has found that: The LMEM evaluation model of learning to advance to life skills of students in the 21st century was a chart structure that ties together of 6 relevant components of the evaluation such as; the purpose of the assessment, the evaluation focused assessment methods, the evaluator, the evaluation technique, and the evaluation criteria. The evaluation targets were to assess the management of learning, the factors

Development and assessment of key skills in undergraduate students: An action-research experience

Directory of Open Access Journals (Sweden)

Ana Fernández-Santander

2012-03-01

Full Text Available Employers look for professionals able to work in a team, able to approach problems, with the capacity to analyze and resolve problems, under the constant renewal of knowledge and competencies. In this paper, a group of University teachers from different areas of knowledge presents an experience to introduce key employability skills in the higher education students’ curricula. This work has been developed under the action research scope. The first goal was to make an analysis of terms referred to key skills, generating an integrated denomination for each competency. The elaboration of general templates for key skills is proposed here as a useful tool that provides information about development, assessment and marking of each skill. Different types of rubrics and assessment templates, used during this experience, are presented. DOI: 10.18870/hlrc.v2i1.37

Assessing Writing Skills

Science.gov (United States)

Narayanan, M.

2013-12-01

This is an encore presentation of what was presented at the 2012 AGU International Conference. It was entitled: 'ASSESSING CORE COMPETENCIES.' The poster presentation, however, has been redesigned and reorganized with new, revised perspectives. The importance of ASSESSMENT principles has been emphasized. Catherine Palomba and Trudy Banta offer the following definition of assessment, adapted from one provided by Marchese in 1987. Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development. (Palomba and Banta 1999). Educational institutions are committing substantial resources to the establishment of dedicated technology-based laboratories, so that they will be able to accommodate and fulfill students' desire to master certain of these specific skills. This type of technology-based instruction may raise some fundamental questions about the core competencies of the student learner. Some of the most important questions are : 1. Is the utilization of these fast high-powered computers and user-friendly software programs creating a totally non-challenging instructional environment for the student learner ? 2. Can technology itself all too easily overshadow the learning outcomes intended ? 3. Are the educational institutions simply training students how to use technology rather than educating them in the appropriate field ? 4. Are we still teaching content-driven courses and analysis oriented subject matter ? 5. Are these sophisticated modern era technologies contributing to a decline in the Critical Thinking Capabilities of the 21st century technology-savvy students ? The author tries to focus on technology as a tool and not on the technology itself. He further argues that students must demonstrate that they have the have the ability to think critically before they make an attempt to use technology in a chosen application-specific environment. The author further

Self-assessment of intercultural communication skills: a survey of physicians and medical students in Geneva, Switzerland.

Science.gov (United States)

Hudelson, Patricia; Perron, Noelle Junod; Perneger, Thomas

2011-09-01

Physicians working with multicultural populations need to know how to elicit the patient's understanding of the illness; determine the patient's sociocultural context and identify any issues that might affect care; communicate effectively across patient-provider social and cultural differences; and collaborate effectively with an interpreter. Skills self-assessment can contribute to identifying training needs and monitoring skills development in these areas. As part of a larger study exploring the knowledge, attitudes and practices of Geneva physicians and medical students regarding the care of immigrant patients, we asked respondents to self-rate their ability to perform a range of common yet challenging intercultural communication tasks. Overall, respondents rated themselves less competent at intercultural tasks than at basic medical skills and less competent at specific intercultural communication skills than at general intercultural skills. Qualified doctors (as opposed to students), those with greater interest in caring for immigrants, and those who rarely encountered difficulties with immigrants rated themselves significantly more competent for all clinical tasks. Having a higher percentage of immigrant patients and previous cultural competence training predicted greater self-rated intercultural communication skills. Our self-assessment results suggest that students and physicians should be provided with the opportunity to practice intercultural skills with immigrant patients as part of their cultural competence training. To strengthen the validity of self-assessment measures, they should ideally be combined with more objective methods to assess actual skills.

Experiential Learning Model on Entrepreneurship Subject to Improve Students’ Soft Skills

Directory of Open Access Journals (Sweden)

Lina Rifda Naufalin

2016-06-01

Full Text Available This research aims to improve students’ soft skills on entrepreneurship subject by using experiential learning model. It was expected that the learning model could upgrade students’ soft skills which were indicated by the higher confidence, result and job oriented, being courageous to take risks, leadership, originality, and future-oriented. It was a class action research using Kemmis and Mc Tagart’s design model. The research was conducted for two cycles. The subject of the study was economics education students in the year of 2015/2016.  Findings show that the experiential learning model could improve students’ soft skills. The research showed that there is increased at the dimension of confidence by 52.1%, result-oriented by 22.9%, being courageous to take risks by 10.4%, leadership by 12.5%, originality by 10.4%, and future-oriented by 18.8%. It could be concluded that the experiential learning model is effective model to improve students’ soft skills on entrepreneurship subject. Dimension of confidence has the highest rise. Students’ soft skills are shaped through the continuous stimulus when they get involved at the implementation.

Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills

DEFF Research Database (Denmark)

Jensen, Jesper Kørup; Dyre, Liv; Jørgensen, Mattis Enggaard

2017-01-01

OBJECTIVES: The aim of this study was to examine the validity of a simulator test designed to evaluate focused assessment with sonography for trauma (FAST) skills. METHODS: Participants included a group of ultrasound novices (n = 25) and ultrasound experts (n = 10). All participants had their FAST...... skills assessed using a virtual reality ultrasound simulator. Procedural performance on the 4 FAST windows was assessed by automated simulator metrics, which received a passing or failing score. The validity evidence for these simulator metrics was examined by a stepwise approach according...

A Summary of an Assessment of Fourth and Sixth Grade Basic Skills.

Science.gov (United States)

CTB / McGraw-Hill, Monterey, CA.

A comprehensive assessment was made of the status of elementary education in Missouri in reading, mathematics, language, and study skills. The Comprehensive Tests of Basic Skills (CTBS) and the Short Form Test of Academic Aptitude (SFTAA) were administered to a sample of Missouri fourth and sixth graders. For each curricular area, Missouri…

Development and Assessment of Modules to Integrate Quantitative Skills in Introductory Biology Courses.

Science.gov (United States)

Hoffman, Kathleen; Leupen, Sarah; Dowell, Kathy; Kephart, Kerrie; Leips, Jeff

2016-01-01

Redesigning undergraduate biology courses to integrate quantitative reasoning and skill development is critical to prepare students for careers in modern medicine and scientific research. In this paper, we report on the development, implementation, and assessment of stand-alone modules that integrate quantitative reasoning into introductory biology courses. Modules are designed to improve skills in quantitative numeracy, interpreting data sets using visual tools, and making inferences about biological phenomena using mathematical/statistical models. We also examine demographic/background data that predict student improvement in these skills through exposure to these modules. We carried out pre/postassessment tests across four semesters and used student interviews in one semester to examine how students at different levels approached quantitative problems. We found that students improved in all skills in most semesters, although there was variation in the degree of improvement among skills from semester to semester. One demographic variable, transfer status, stood out as a major predictor of the degree to which students improved (transfer students achieved much lower gains every semester, despite the fact that pretest scores in each focus area were similar between transfer and nontransfer students). We propose that increased exposure to quantitative skill development in biology courses is effective at building competency in quantitative reasoning. © 2016 K. Hoffman, S. Leupen, et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

Science.gov (United States)

Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

2016-12-11

The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

Cognitive mechanisms underlying third graders' arithmetic skills: Expanding the pathways to mathematics model.

Science.gov (United States)

Träff, Ulf; Olsson, Linda; Skagerlund, Kenny; Östergren, Rickard

2018-03-01

A modified pathways to mathematics model was used to examine the cognitive mechanisms underlying arithmetic skills in third graders. A total of 269 children were assessed on tasks tapping the four pathways and arithmetic skills. A path analysis showed that symbolic number processing was directly supported by the linguistic and approximate quantitative pathways. The direct contribution from the four pathways to arithmetic proficiency varied; the linguistic pathway supported single-digit arithmetic and word problem solving, whereas the approximate quantitative pathway supported only multi-digit calculation. The spatial processing and verbal working memory pathways supported only arithmetic word problem solving. The notion of hierarchical levels of arithmetic was supported by the results, and the different levels were supported by different constellations of pathways. However, the strongest support to the hierarchical levels of arithmetic were provided by the proximal arithmetic skills. Copyright © 2017 Elsevier Inc. All rights reserved.

Customisation of an instrument to assess anaesthesiologists' non-technical skills.

Science.gov (United States)

Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

2015-02-22

The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

Getting Skills Right: Assessing and Anticipating Changing Skill Needs

Science.gov (United States)

OECD Publishing, 2016

2016-01-01