WorldWideScience

Sample records for model skill assessment

  1. Ecosystem Model Skill Assessment. Yes We Can!

    Science.gov (United States)

    Olsen, Erik; Fay, Gavin; Gaichas, Sarah; Gamble, Robert; Lucey, Sean; Link, Jason S

    2016-01-01

    Accelerated changes to global ecosystems call for holistic and integrated analyses of past, present and future states under various pressures to adequately understand current and projected future system states. Ecosystem models can inform management of human activities in a complex and changing environment, but are these models reliable? Ensuring that models are reliable for addressing management questions requires evaluating their skill in representing real-world processes and dynamics. Skill has been evaluated for just a limited set of some biophysical models. A range of skill assessment methods have been reviewed but skill assessment of full marine ecosystem models has not yet been attempted. We assessed the skill of the Northeast U.S. (NEUS) Atlantis marine ecosystem model by comparing 10-year model forecasts with observed data. Model forecast performance was compared to that obtained from a 40-year hindcast. Multiple metrics (average absolute error, root mean squared error, modeling efficiency, and Spearman rank correlation), and a suite of time-series (species biomass, fisheries landings, and ecosystem indicators) were used to adequately measure model skill. Overall, the NEUS model performed above average and thus better than expected for the key species that had been the focus of the model tuning. Model forecast skill was comparable to the hindcast skill, showing that model performance does not degenerate in a 10-year forecast mode, an important characteristic for an end-to-end ecosystem model to be useful for strategic management purposes. We identify best-practice approaches for end-to-end ecosystem model skill assessment that would improve both operational use of other ecosystem models and future model development. We show that it is possible to not only assess the skill of a complicated marine ecosystem model, but that it is necessary do so to instill confidence in model results and encourage their use for strategic management. Our methods are applicable

  2. Discussion of skill improvement in marine ecosystem dynamic models based on parameter optimization and skill assessment

    Science.gov (United States)

    Shen, Chengcheng; Shi, Honghua; Liu, Yongzhi; Li, Fen; Ding, Dewen

    2016-07-01

    Marine ecosystem dynamic models (MEDMs) are important tools for the simulation and prediction of marine ecosystems. This article summarizes the methods and strategies used for the improvement and assessment of MEDM skill, and it attempts to establish a technical framework to inspire further ideas concerning MEDM skill improvement. The skill of MEDMs can be improved by parameter optimization (PO), which is an important step in model calibration. An efficient approach to solve the problem of PO constrained by MEDMs is the global treatment of both sensitivity analysis and PO. Model validation is an essential step following PO, which validates the efficiency of model calibration by analyzing and estimating the goodness-of-fit of the optimized model. Additionally, by focusing on the degree of impact of various factors on model skill, model uncertainty analysis can supply model users with a quantitative assessment of model confidence. Research on MEDMs is ongoing; however, improvement in model skill still lacks global treatments and its assessment is not integrated. Thus, the predictive performance of MEDMs is not strong and model uncertainties lack quantitative descriptions, limiting their application. Therefore, a large number of case studies concerning model skill should be performed to promote the development of a scientific and normative technical framework for the improvement of MEDM skill.

  3. Skill and independence weighting for multi-model assessments

    International Nuclear Information System (INIS)

    Sanderson, Benjamin M.; Wehner, Michael; Knutti, Reto

    2017-01-01

    We present a weighting strategy for use with the CMIP5 multi-model archive in the fourth National Climate Assessment, which considers both skill in the climatological performance of models over North America as well as the inter-dependency of models arising from common parameterizations or tuning practices. The method exploits information relating to the climatological mean state of a number of projection-relevant variables as well as metrics representing long-term statistics of weather extremes. The weights, once computed can be used to simply compute weighted means and significance information from an ensemble containing multiple initial condition members from potentially co-dependent models of varying skill. Two parameters in the algorithm determine the degree to which model climatological skill and model uniqueness are rewarded; these parameters are explored and final values are defended for the assessment. The influence of model weighting on projected temperature and precipitation changes is found to be moderate, partly due to a compensating effect between model skill and uniqueness. However, more aggressive skill weighting and weighting by targeted metrics is found to have a more significant effect on inferred ensemble confidence in future patterns of change for a given projection.

  4. Towards an Integrated Model for Developing Sustainable Assessment Skills

    Science.gov (United States)

    Fastre, Greet M. J.; van der Klink, Marcel R.; Sluijsmans, Dominique; van Merrienboer, Jeroen J. G.

    2013-01-01

    One of the goals of current education is to ensure that graduates can act as independent lifelong learners. Graduates need to be able to assess their own learning and interpret assessment results. The central question in this article is how to acquire sustainable assessment skills, enabling students to assess their performance and learning…

  5. The Gain-Loss Model: A Probabilistic Skill Multimap Model for Assessing Learning Processes

    Science.gov (United States)

    Robusto, Egidio; Stefanutti, Luca; Anselmi, Pasquale

    2010-01-01

    Within the theoretical framework of knowledge space theory, a probabilistic skill multimap model for assessing learning processes is proposed. The learning process of a student is modeled as a function of the student's knowledge and of an educational intervention on the attainment of specific skills required to solve problems in a knowledge…

  6. Assessment of Teacher Perceived Skill in Classroom Assessment Practices Using IRT Models

    Science.gov (United States)

    Koloi-Keaikitse, Setlhomo

    2017-01-01

    The purpose of this study was to assess teacher perceived skill in classroom assessment practices. Data were collected from a sample of (N = 691) teachers selected from government primary, junior secondary, and senior secondary schools in Botswana. Item response theory models were used to identify teacher response on items that measured their…

  7. MODEL AUTHENTIC SELF-ASSESSMENT DALAM PENGEMBANGAN EMPLOYABILITY SKILLS MAHASISWA PENDIDIKAN TINGGI VOKASI

    Directory of Open Access Journals (Sweden)

    I Made Suarta

    2015-06-01

    ______________________________________________________________ AUTHENTIC SELF-ASSESSMENT MODEL FOR DEVELOPING EMPLOYABILITY SKILLS STUDENT IN HIGHER VOCATIONAL EDUCATION Abstract The purpose of this research is to develop assessment tools to evaluate achievement of employability skills which are integrated in the learning database applications. The assessment model developed is a combination of self-assessment and authentic assessment, proposed as models of authentic self-assessment. The steps of developing authentic self-assessment models include: identifying the standards, selecting an authentic task, identifying the criteria for the task, and creating the rubric. The results of development assessment tools include: (1 problem solving skills assessment model, (2 self-management skills assessment model, and (3 competence database applications assessment model. This model can be used to assess the cognitive, affective, and psychomotor achievement. The results indicate: achievement of problem solving and self-management ability was in good category, and competencies in designing conceptual and logical database was in high category. This model also has met the basic principles of assessment, i.e.: validity, reliability, focused on competencies, comprehen-sive, objectivity, and the principle of educating. Keywords: authentic assessment, self-assessment, problem solving skills, self-management skills, vocational education

  8. Using the Dynamic Model to Identify Stages of Teacher Skills in Assessment

    Science.gov (United States)

    Christoforidou, Margarita; Xirafidou, Elisavet

    2014-01-01

    The article presents the results of two cross-sectional studies that investigate teachers' skills in using various techniques of assessment in mathematics by taking into account the four phases of assessment. The five dimensions of the dynamic model are also taken into account in proposing a framework for measuring teacher skills in assessment.…

  9. Moving beyond Assessment to Improving Students' Critical Thinking Skills: A Model for Implementing Change

    Science.gov (United States)

    Haynes, Ada; Lisic, Elizabeth; Goltz, Michele; Stein, Barry; Harris, Kevin

    2016-01-01

    This research examines how the use of the CAT (Critical thinking Assessment Test) and involvement in CAT-Apps (CAT Applications within the discipline) training can serve as an important part of a faculty development model that assists faculty in the assessment of students' critical thinking skills and in the development of these skills within…

  10. Are revised models better models? A skill score assessment of regional interannual variability

    Science.gov (United States)

    Sperber, Kenneth R.; Participating AMIP Modelling Groups

    1999-05-01

    Various skill scores are used to assess the performance of revised models relative to their original configurations. The interannual variability of all-India, Sahel and Nordeste rainfall and summer monsoon windshear is examined in integrations performed under the experimental design of the Atmospheric Model Intercomparison Project. For the indices considered, the revised models exhibit greater fidelity at simulating the observed interannual variability. Interannual variability of all-India rainfall is better simulated by models that have a more realistic rainfall climatology in the vicinity of India, indicating the beneficial effect of reducing systematic model error.

  11. Multi-model global assessment of subseasonal prediction skill of atmospheric rivers

    Science.gov (United States)

    Deflorio, M. J.

    2017-12-01

    Atmospheric rivers (ARs) are global phenomena that are characterized by long, narrow plumes of water vapor transport. They are most often observed in the midlatitudes near climatologically active storm track regions. Because of their frequent association with floods, landslides, and other hydrological impacts on society, there is significant incentive at the intersection of academic research, water management, and policymaking to understand the skill with which state-of-the-art operational weather models can predict ARs weeks-to-months in advance. We use the newly assembled Subseasonal-to-Seasonal (S2S) database, which includes extensive hindcast records of eleven operational weather models, to assess global prediction skill of atmospheric rivers on S2S timescales. We develop a metric to assess AR skill that is suitable for S2S timescales by counting the total number of AR days which occur over each model and observational grid cell during a 2-week time window. This "2-week AR occurrence" metric is suitable for S2S prediction skill assessment because it does not consider discrete hourly or daily AR objects, but rather a smoothed representation of AR occurrence over a longer period of time. Our results indicate that several of the S2S models, especially the ECMWF model, show useful prediction skill in the 2-week forecast window, with significant interannual variation in some regions. We also present results from an experimental forecast of S2S AR prediction skill using the ECMWF and NCEP models.

  12. Model of practical skill performance as an instrument for supervision and formative assessment

    DEFF Research Database (Denmark)

    Nielsen, Carsten; Sommer, Irene; Larsen, Karin

    2012-01-01

    as during practice, performance and formative assessment of practical skills learning. It provided a common language about practical skills and enhanced the participants’ understanding of professionalism in practical nursing skill. In conclusion, the model helped to highlight the complexity in mastering......There are still weaknesses in the practical skills of newly graduated nurses. There is also an escalating pressure on existing clinical placements due to increasing student numbers and structural changes in health services. Innovative educational practices and the use of tools that might support...... learning are sparsely researched in the field of clinical education for nursing students. This paper reports on an action research study that promoted and investigated use of The Model of Practical Skill Performance as a learning tool during nursing students’ clinical placement. Clinical supervisors...

  13. Numerical modeling of an estuary: A comprehensive skill assessment

    Science.gov (United States)

    Warner, J.C.; Geyer, W.R.; Lerczak, J.A.

    2005-01-01

    Numerical simulations of the Hudson River estuary using a terrain-following, three-dimensional model (Regional Ocean Modeling System (ROMS)) are compared with an extensive set of time series and spatially resolved measurements over a 43 day period with large variations in tidal forcing and river discharge. The model is particularly effective at reproducing the observed temporal variations in both the salinity and current structure, including tidal, spring neap, and river discharge-induced variability. Large observed variations in stratification between neap and spring tides are captured qualitatively and quantitatively by the model. The observed structure and variations of the longitudinal salinity gradient are also well reproduced. The most notable discrepancy between the model and the data is in the vertical salinity structure. While the surface-to-bottom salinity difference is well reproduced, the stratification in the model tends to extend all the way to the water surface, whereas the observations indicate a distinct pycnocline and a surface mixed layer. Because the southern boundary coindition is located near the mouth the estuary, the salinity within the domain is particularly sensitive to the specification of salinity at the boundary. A boundary condition for the horizontal salinity gradient, based on the local value of salinity, is developed to incorporate physical processes beyond the open boundary not resolved by the model. Model results are sensitive to the specification of the bottom roughness length and vertical stability functions, insofar as they influence the intensity of vertical mixing. The results only varied slightly between different turbulence closure methods of k-??, k-??, and k-kl. Copyright 2005 by the American Geophysical Union.

  14. Skill Assessment of a Spectral Ocean-Atmosphere Radiative Model

    Science.gov (United States)

    Gregg, Watson, W.; Casey, Nancy W.

    2009-01-01

    Ocean phytoplankton, detrital material, and water absorb and scatter light spectrally. The Ocean- Atmosphere Spectral Irradiance Model (OASIM) is intended to provide surface irradiance over the oceans with sufficient spectral resolution to support ocean ecology, biogeochemistry, and heat exchange investigations, and of sufficient duration to support inter-annual and decadal investigations. OASIM total surface irradiance (integrated 200 nm to 4 microns) was compared to in situ data and three publicly available global data products at monthly 1-degree resolution. OASIM spectrally-integrated surface irradiance had root mean square (RMS) difference= 20.1 W/sq m (about 11%), bias=1.6 W/sq m (about 0.8%), regression slope= 1.01 and correlation coefficient= 0.89, when compared to 2322 in situ observations. OASIM had the lowest bias of any of the global data products evaluated (ISCCP-FD, NCEP, and ISLSCP 11), and the best slope (nearest to unity). It had the second best RMS, and the third best correlation coefficient. OASIM total surface irradiance compared well with ISCCP-FD (RMS= 20.7 W/sq m; bias=-11.4 W/sq m, r=0.98) and ISLSCP II (RMS =25.2 W/sq m; bias= -13.8 W/sq m; r=0.97), but less well with NCEP (RMS =43.0 W/sq m ;bias=-22.6 W/sq m; x=0.91). Comparisons of OASIM photosynthetically available radiation (PAR) with PAR derived from SeaWiFS showed low bias (-1.8 mol photons /sq m/d, or about 5%), RMS (4.25 mol photons /sq m/d ' or about 12%), near unity slope (1.03) and high correlation coefficient (0.97). Coupled with previous estimates of clear sky spectral irradiance in OASIM (6.6% RMS at 1 nm resolution), these results suggest that OASIM provides reasonable estimates of surface broadband and spectral irradiance in the oceans, and can support studies on ocean ecosystems, carbon cycling, and heat exchange.

  15. Innovative integrative bedside teaching model improves tutors’ self-assessments of teaching skills and attitudes

    Directory of Open Access Journals (Sweden)

    Itai Gat

    2016-02-01

    Full Text Available Introduction: Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST practiced during tutor training workshop and its resulting effect on practitioners’ self assessment of teaching skills and perceptions. Methods: One-day tutor training workshop included theoretical knowledge supplementation regarding tutors’ roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Results: Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5 compared with pre-training (mean 2.6, SD 0.6; p<0.001 with significant increase in most examined parameters. Significantly improved tutor's roles internalization was demonstrated after training completion (mean 3.7, SD 0.3 compared with pre-workshop (mean 3.5 SD 0.5; p=0.002. Discussion: Successful BST involves combination of clinical and communication skills. BST model practiced during the workshop may contribute to improved teaching skills in this challenging environment.

  16. Surgical ergonomics. Analysis of technical skills, simulation models and assessment methods.

    Science.gov (United States)

    Papaspyros, Sotiris C; Kar, Ashok; O'Regan, David

    2015-06-01

    Over the past two centuries the surgical profession has undergone a profound evolution in terms of efficiency and outcomes. Societal concerns in relation to quality assurance, patient safety and cost reduction have highlighted the issue of training expert surgeons. The core elements of a training model build on the basic foundations of gross and fine motor skills. In this paper we provide an analysis of the ergonomic principles involved and propose relevant training techniques. We have endeavored to provide both the trainer and trainee perspectives. This paper is structured into four sections: 1) Pre-operative preparation issues, 2) technical skills and instrument handling, 3) low fidelity simulation models and 4) discussion of current concepts in crew resource management, deliberate practice and assessment. Rehearsal, warm-up and motivation-enhancing techniques aid concentration and focus. Appropriate posture, comprehension of ergonomic principles in relation to surgical instruments and utilisation of the non-dominant hand are essential skills to master. Low fidelity models can be used to achieve significant progress through the early stages of the learning curve. Deliberate practice and innate ability are complementary to each other and may be considered useful adjuncts to surgical skills development. Safe medical care requires that complex patient interventions be performed by highly skilled operators supported by reliable teams. Surgical ergonomics lie at the heart of any training model that aims to produce professionals able to function as leaders of a patient safety oriented culture. Copyright © 2015 IJS Publishing Group Limited. Published by Elsevier Ltd. All rights reserved.

  17. Innovative integrative bedside teaching model improves tutors' self-assessments of teaching skills and attitudes.

    Science.gov (United States)

    Gat, Itai; Pessach-Gelblum, Liat; Givati, Gili; Haim, Nadav; Paluch-Shimon, Shani; Unterman, Avraham; Bar-Shavit, Yochay; Grabler, Galit; Sagi, Doron; Achiron, Anat; Ziv, Amitai

    2016-01-01

    Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST) practiced during tutor training workshop and its resulting effect on practitioners' self assessment of teaching skills and perceptions. One-day tutor training workshop included theoretical knowledge supplementation regarding tutors' roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5) compared with pre-training (mean 2.6, SD 0.6; pteaching skills in this challenging environment.

  18. Assessment of the potential forecasting skill of a global hydrological model in reproducing the occurrence of monthly flow extremes

    Directory of Open Access Journals (Sweden)

    N. Candogan Yossef

    2012-11-01

    Full Text Available As an initial step in assessing the prospect of using global hydrological models (GHMs for hydrological forecasting, this study investigates the skill of the GHM PCR-GLOBWB in reproducing the occurrence of past extremes in monthly discharge on a global scale. Global terrestrial hydrology from 1958 until 2001 is simulated by forcing PCR-GLOBWB with daily meteorological data obtained by downscaling the CRU dataset to daily fields using the ERA-40 reanalysis. Simulated discharge values are compared with observed monthly streamflow records for a selection of 20 large river basins that represent all continents and a wide range of climatic zones.

    We assess model skill in three ways all of which contribute different information on the potential forecasting skill of a GHM. First, the general skill of the model in reproducing hydrographs is evaluated. Second, model skill in reproducing significantly higher and lower flows than the monthly normals is assessed in terms of skill scores used for forecasts of categorical events. Third, model skill in reproducing flood and drought events is assessed by constructing binary contingency tables for floods and droughts for each basin. The skill is then compared to that of a simple estimation of discharge from the water balance (PE.

    The results show that the model has skill in all three types of assessments. After bias correction the model skill in simulating hydrographs is improved considerably. For most basins it is higher than that of the climatology. The skill is highest in reproducing monthly anomalies. The model also has skill in reproducing floods and droughts, with a markedly higher skill in floods. The model skill far exceeds that of the water balance estimate. We conclude that the prospect for using PCR-GLOBWB for monthly and seasonal forecasting of the occurrence of hydrological extremes is positive. We argue that this conclusion applies equally to other similar GHMs and

  19. The assessment of knowledge and learning in competence spaces: The gain-loss model for dependent skills.

    Science.gov (United States)

    Anselmi, Pasquale; Stefanutti, Luca; de Chiusole, Debora; Robusto, Egidio

    2017-11-01

    The gain-loss model (GaLoM) is a formal model for assessing knowledge and learning. In its original formulation, the GaLoM assumes independence among the skills. Such an assumption is not reasonable in several domains, in which some preliminary knowledge is the foundation for other knowledge. This paper presents an extension of the GaLoM to the case in which the skills are not independent, and the dependence relation among them is described by a well-graded competence space. The probability of mastering skill s at the pretest is conditional on the presence of all skills on which s depends. The probabilities of gaining or losing skill s when moving from pretest to posttest are conditional on the mastery of s at the pretest, and on the presence at the posttest of all skills on which s depends. Two formulations of the model are presented, in which the learning path is allowed to change from pretest to posttest or not. A simulation study shows that models based on the true competence space obtain a better fit than models based on false competence spaces, and are also characterized by a higher assessment accuracy. An empirical application shows that models based on pedagogically sound assumptions about the dependencies among the skills obtain a better fit than models assuming independence among the skills. © 2017 The British Psychological Society.

  20. Employability Skills Assessment Tool Development

    Science.gov (United States)

    Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

    2012-01-01

    Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

  1. Validation of a global assessment of arthroscopic skills in a cadaveric knee model.

    Science.gov (United States)

    Slade Shantz, Jesse A; Leiter, Jeff R; Collins, John B; MacDonald, Peter B

    2013-01-01

    The purpose of this study was to determine whether a global assessment of arthroscopic skills was valid for blinded assessment of cadaveric diagnostic knee arthroscopy. A global skills assessment for arthroscopy was created using a published theory of the development of expertise. Faculty surgeons, fellows, and residents were consented and enrolled in this institutional review board-approved validation study. All participants were oriented to the equipment and procedures for diagnostic arthroscopy of the knee. After reviewing the anatomic structures to be visualized, participants were allowed 10 minutes to complete a diagnostic arthroscopy of the knee. The hands and arthroscopic view were recorded during this attempt. Resident participants completed a second filmed diagnostic arthroscopy 1 week after the initial attempt. Five blinded reviewers watched the synchronized videos and assessed arthroscopic skills with a procedure-specific checklist and the newly developed global skills assessment. The agreement between reviewers was determined by intraclass correlation coefficient. Internal consistency was determined with Cronbach's α. Test-retest reliability was measured by correlating repeated arthroscopies by residents. The ability of the global assessment to discriminate skill levels was determined with between-group Mann-Whitney U tests. The agreement between global assessment scores was strong (I.C.C. = 0.80, 95% C.I. 0.68-0.92). The internal consistency of evaluations was excellent (Cronbach's α = 0.97), and the test-retest reliability was strong (r = 0.52). The global assessment score was shown to be able to discriminate between skill levels by an analysis of variance indicating the difference in means among the various levels of training (P Assessment of Arthroscopic Skills is a useful adjunct to arthroscopic educators and learners and could be used for in-training evaluations. The Objective Assessment of Arthroscopic Skills is an instrument that can be

  2. The assessment of practical skills

    OpenAIRE

    Reiss, M. J.; Abrahams, I.

    2015-01-01

    Major changes are currently afoot as to how practical work will be assessed in high status examinations (GCSEs for 16 year-olds and ‘A’ levels for 18 year-olds) in England. We explore here how practical skills might best be assessed in school science and introduce two terms: direct assessment of practical skills (DAPS) and indirect assessment of practical skills (IAPS). We conclude that both the direct and indirect assessment of practical skills have their place in effective assessment of sch...

  3. Competencies, skills and assessment

    DEFF Research Database (Denmark)

    Højgaard, Tomas

    2009-01-01

    This paper is an analysis of the challenge of assessing student learning and how that is affected by using descriptions of competencies as a core element when describing the aims of the learning process. Assessment is modelled as a three step process; characterising, identifying and judging, to a...

  4. Assessment of prediction skill in equatorial Pacific Ocean in high resolution model of CFS

    Science.gov (United States)

    Arora, Anika; Rao, Suryachandra A.; Pillai, Prasanth; Dhakate, Ashish; Salunke, Kiran; Srivastava, Ankur

    2018-01-01

    The effect of increasing atmospheric resolution on prediction skill of El Niño southern oscillation phenomenon in climate forecast system model is explored in this paper. Improvement in prediction skill for sea surface temperature (SST) and winds at all leads compared to low resolution model in the tropical Indo-Pacific basin is observed. High resolution model is able to capture extreme events reasonably well. As a result, the signal to noise ratio is improved in the high resolution model. However, spring predictability barrier (SPB) for summer months in Nino 3 and Nino 3.4 region is stronger in high resolution model, in spite of improvement in overall prediction skill and dynamics everywhere else. Anomaly correlation coefficient of SST in high resolution model with observations in Nino 3.4 region targeting boreal summer months when predicted at lead times of 3-8 months in advance decreased compared its lower resolution counterpart. It is noted that higher variance of winds predicted in spring season over central equatorial Pacific compared to observed variance of winds results in stronger than normal response on subsurface ocean, hence increases SPB for boreal summer months in high resolution model.

  5. Assessing Writing Skills

    Science.gov (United States)

    Narayanan, M.

    2013-12-01

    This is an encore presentation of what was presented at the 2012 AGU International Conference. It was entitled: 'ASSESSING CORE COMPETENCIES.' The poster presentation, however, has been redesigned and reorganized with new, revised perspectives. The importance of ASSESSMENT principles has been emphasized. Catherine Palomba and Trudy Banta offer the following definition of assessment, adapted from one provided by Marchese in 1987. Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development. (Palomba and Banta 1999). Educational institutions are committing substantial resources to the establishment of dedicated technology-based laboratories, so that they will be able to accommodate and fulfill students' desire to master certain of these specific skills. This type of technology-based instruction may raise some fundamental questions about the core competencies of the student learner. Some of the most important questions are : 1. Is the utilization of these fast high-powered computers and user-friendly software programs creating a totally non-challenging instructional environment for the student learner ? 2. Can technology itself all too easily overshadow the learning outcomes intended ? 3. Are the educational institutions simply training students how to use technology rather than educating them in the appropriate field ? 4. Are we still teaching content-driven courses and analysis oriented subject matter ? 5. Are these sophisticated modern era technologies contributing to a decline in the Critical Thinking Capabilities of the 21st century technology-savvy students ? The author tries to focus on technology as a tool and not on the technology itself. He further argues that students must demonstrate that they have the have the ability to think critically before they make an attempt to use technology in a chosen application-specific environment. The author further

  6. Arthroscopic skills assessment and use of box model for training in arthroscopic surgery using Sawbones – “FAST” workstation

    Directory of Open Access Journals (Sweden)

    Goyal Saumitra

    2016-01-01

    Full Text Available Purpose: Arthroscopic skills training outside the operative room may decrease risks and errors by trainee surgeons. There is a need of simple objective method for evaluating proficiency and skill of arthroscopy trainees using simple bench model of arthroscopic simulator. The aim of this study is to correlate motor task performance to level of prior arthroscopic experience and establish benchmarks for training modules. Methods: Twenty orthopaedic surgeons performed a set of tasks to assess a arthroscopic triangulation, b navigation, c object handling and d meniscus trimming using SAWBONES “FAST” arthroscopy skills workstation. Time to completion and the errors were computed. The subjects were divided into four levels; “Novice”, “Beginner”, “Intermediate” and “Advanced” based on previous arthroscopy experience, for analyses of performance. Results: The task performance under transparent dome was not related to experience of the surgeon unlike opaque dome, highlighting the importance of hand-eye co-ordination required in arthroscopy. Median time to completion for each task improved as the level of experience increased and this was found to be statistically significant (p 85% of subjects across all the levels reported improvement in performance with sequential tasks. Conclusion: Use of the arthroscope requires visuo-spatial coordination which is a skill that develops with practice. This simple box model can reliably differentiate the arthroscopic skills based on experience and can be used to monitor progression of skills of trainees in institutions.

  7. Two Thinking Skills Assessment Approaches: "Assessment of Pupils' Thinking Skills" and "Individual Thinking Skills Assessments"

    Science.gov (United States)

    Burke, Lynsey A.; Williams, Joanne M.

    2012-01-01

    This paper is linked to a previous paper outlining an evaluation of a thinking skills intervention (Burke & Williams, 2008). Following extensive requests for the assessment tools used in the intervention, this short paper presents the development and potential uses of two thinking skills assessment tools. The aim of the paper is simply to make…

  8. Developing Technical Skill Assessments

    Science.gov (United States)

    Hyslop, Alisha

    2009-01-01

    One of the biggest challenges facing the career and technical education (CTE) community as it works to implement the 2006 Perkins Act is responding to more rigorous requirements for reporting on CTE students' technical skill attainment. The U.S. Department of Education suggested in non-regulatory guidance that states and locals use the number of…

  9. Numerical Modeling Study of the Gulf of Mexico Basin: Skill Assessment

    National Research Council Canada - National Science Library

    Kirwan, A

    1997-01-01

    This report contains the results of an assessment of a three dimensional primitive equation model simulation of the Gulf of Mexico, using surface drifter observations collected as part of the Sculp program...

  10. Assessing Trainee Surgeons’ Nontechnical Skills

    DEFF Research Database (Denmark)

    Spanager, Lene; Konge, Lars; Dieckmann, Peter

    2015-01-01

    BACKGROUND: Trainee surgeons would benefit from regular, formative assessments to ensure they learn the nontechnical aspects of surgical performance. Non-Technical Skills for Surgeons in Denmark (NOTSSdk) is a tool to assess surgeons' nontechnical skills (NTS) during an operation. The aims...... of this study were to explore which parts of NOTSSdk supervisors use to assess trainee surgeons' NTS, to determine the internal consistency reliability of NOTSSdk, and to estimate how many operations were needed to obtain reliable ratings of a trainee surgeon's NTS. METHODS: A total of 12 supervisors from 2...

  11. Assessing Business Student Thinking Skills

    Science.gov (United States)

    Smith, Gerald F.

    2014-01-01

    The development of student thinking skills is a major goal of business education. As with other such goals, student outcomes assessment must be undertaken to measure goal achievement. Thinking is difficult to teach; it is also difficult to assess. The purpose of this article is to improve management educators' understanding of student thinking…

  12. Open knot-tying skills: residents skills assessed

    NARCIS (Netherlands)

    van Empel, P.J.; Verdam, M.G.E.; Huirne, J.A.; Bonjer, H.J.; Meijerink, W.J.; Scheele, F.

    2013-01-01

    Aim: Open knot-tying and suturing skills are fundamental surgical skills, founding many alternative knot-tying techniques. It is therefore mandatory for residents to possess adequate basic open knot-tying skills. The aim of this study was to compare an objective assessment of open knot-tying skills

  13. Skill Assessment in Ocean Biological Data Assimilation

    Science.gov (United States)

    Gregg, Watson W.; Friedrichs, Marjorie A. M.; Robinson, Allan R.; Rose, Kenneth A.; Schlitzer, Reiner; Thompson, Keith R.; Doney, Scott C.

    2008-01-01

    There is growing recognition that rigorous skill assessment is required to understand the ability of ocean biological models to represent ocean processes and distributions. Statistical analysis of model results with observations represents the most quantitative form of skill assessment, and this principle serves as well for data assimilation models. However, skill assessment for data assimilation requires special consideration. This is because there are three sets of information in the free-run model, data, and the assimilation model, which uses Data assimilation information from both the flee-run model and the data. Intercom parison of results among the three sets of information is important and useful for assessment, but is not conclusive since the three information sets are intertwined. An independent data set is necessary for an objective determination. Other useful measures of ocean biological data assimilation assessment include responses of unassimilated variables to the data assimilation, performance outside the prescribed region/time of interest, forecasting, and trend analysis. Examples of each approach from the literature are provided. A comprehensive list of ocean biological data assimilation and their applications of skill assessment, in both ecosystem/biogeochemical and fisheries efforts, is summarized.

  14. Assessing Students' Technical Skill Attainment

    Science.gov (United States)

    Jorgensen, Haley

    2010-01-01

    The Wisconsin Technical College System (WTCS) is working to comply with the Carl D. Perkins Career and Technical Education Improvement Act of 2006 (Perkins) to ensure that its graduates have mastered the technical skills needed by business and industry. The legislation requires that each state identify and approve program assessment strategies…

  15. Assessing the Effectiveness of Holistic Multidimensional Treatment Model (Hojjati Model on Receptive and Expressive Language Skills in Autistic Children

    Directory of Open Access Journals (Sweden)

    Maryam Hojjati

    2017-05-01

    Full Text Available Background: Autism as part of the category called Autism spectrum disorder (ASD, is caused by disorders in brain and nervous network and characterized by defect in social behavior, language and cognition. This study aimed to investigate receptive and expressive language performance and the severity of the disorder in 30 children with autism aged 2-8 years who speak in Persian language. Materials and Methods In this cross-sectional study 30 children with autism were selected using random sampling method. The study tools included "The Childhood Autism Rating Scale (CARS", and "Newsha Developmental Scale (NDS" for assessing the receptive - expressive language skills. In order to assess the level of language impairment in subjects, the participants were divided into 5 groups with 6 people (considering the speaking ability including sign language and speech, with equal number of boys and girls (3 girls and 3 boys in each group. All of these children were evaluated by pediatric psychiatry, pediatric neurologist and pediatrician and were assessed according to the criteria for autism based on the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-V. Eventually, the data were analyzed using descriptive and inferential statistics in SPSS version 16.0 software. Results The results showed that there was a significant difference between the mean (standard deviation and scores of receptive – expressive language skills in autistic subjects in each of the groups (P

  16. Assessing Inquiry Process Skills in the Lab Using a Fast, Simple, Inexpensive Fermentation Model System

    Science.gov (United States)

    Knabb, Maureen T.; Misquith, Geraldine

    2006-01-01

    Incorporating inquiry-based learning in the college-level introductory biology laboratory is challenging because the labs serve the dual purpose of providing a hands-on opportunity to explore content while also emphasizing the development of scientific process skills. Time limitations and variations in student preparedness for college further…

  17. Assessment of summer rainfall forecast skill in the Intra-Americas in GFDL high and low-resolution models

    Science.gov (United States)

    Krishnamurthy, Lakshmi; Muñoz, Ángel G.; Vecchi, Gabriel A.; Msadek, Rym; Wittenberg, Andrew T.; Stern, Bill; Gudgel, Rich; Zeng, Fanrong

    2018-05-01

    The Caribbean low-level jet (CLLJ) is an important component of the atmospheric circulation over the Intra-Americas Sea (IAS) which impacts the weather and climate both locally and remotely. It influences the rainfall variability in the Caribbean, Central America, northern South America, the tropical Pacific and the continental Unites States through the transport of moisture. We make use of high-resolution coupled and uncoupled models from the Geophysical Fluid Dynamics Laboratory (GFDL) to investigate the simulation of the CLLJ and its teleconnections and further compare with low-resolution models. The high-resolution coupled model FLOR shows improvements in the simulation of the CLLJ and its teleconnections with rainfall and SST over the IAS compared to the low-resolution coupled model CM2.1. The CLLJ is better represented in uncoupled models (AM2.1 and AM2.5) forced with observed sea-surface temperatures (SSTs), emphasizing the role of SSTs in the simulation of the CLLJ. Further, we determine the forecast skill for observed rainfall using both high- and low-resolution predictions of rainfall and SSTs for the July-August-September season. We determine the role of statistical correction of model biases, coupling and horizontal resolution on the forecast skill. Statistical correction dramatically improves area-averaged forecast skill. But the analysis of spatial distribution in skill indicates that the improvement in skill after statistical correction is region dependent. Forecast skill is sensitive to coupling in parts of the Caribbean, Central and northern South America, and it is mostly insensitive over North America. Comparison of forecast skill between high and low-resolution coupled models does not show any dramatic difference. However, uncoupled models show improvement in the area-averaged skill in the high-resolution atmospheric model compared to lower resolution model. Understanding and improving the forecast skill over the IAS has important implications

  18. A standardized patient model to teach and assess professionalism and communication skills: the effect of personality type on performance.

    Science.gov (United States)

    Lifchez, Scott D; Redett, Richard J

    2014-01-01

    Teaching and assessing professionalism and interpersonal communication skills can be more difficult for surgical residency programs than teaching medical knowledge or patient care, for which many structured educational curricula and assessment tools exist. Residents often learn these skills indirectly, by observing the behavior of their attendings when communicating with patients and colleagues. The purpose of this study was to assess the results of an educational curriculum we created to teach and assess our residents in professionalism and communication. We assessed resident and faculty prior education in delivering bad news to patients. Residents then participated in a standardized patient (SP) encounter to deliver bad news to a patient's family regarding a severe burn injury. Residents received feedback from the encounter and participated in an education curriculum on communication skills and professionalism. As a part of this curriculum, residents underwent assessment of communication style using the Myers-Briggs type inventory. The residents then participated in a second SP encounter discussing a severe pulmonary embolus with a patient's family. Resident performance on the SP evaluation correlated with an increased comfort in delivering bad news. Comfort in delivering bad news did not correlate with the amount of prior education on the topic for either residents or attendings. Most of our residents demonstrated an intuitive thinking style (NT) on the Myers-Briggs type inventory, very different from population norms. The lack of correlation between comfort in delivering bad news and prior education on the subject may indicate the difficulty in imparting communication and professionalism skills to residents effectively. Understanding communication style differences between our residents and the general population can help us teach professionalism and communication skills more effectively. With the next accreditation system, residency programs would need to

  19. Automated surgical skill assessment in RMIS training.

    Science.gov (United States)

    Zia, Aneeq; Essa, Irfan

    2018-05-01

    Manual feedback in basic robot-assisted minimally invasive surgery (RMIS) training can consume a significant amount of time from expert surgeons' schedule and is prone to subjectivity. In this paper, we explore the usage of different holistic features for automated skill assessment using only robot kinematic data and propose a weighted feature fusion technique for improving score prediction performance. Moreover, we also propose a method for generating 'task highlights' which can give surgeons a more directed feedback regarding which segments had the most effect on the final skill score. We perform our experiments on the publicly available JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) and evaluate four different types of holistic features from robot kinematic data-sequential motion texture (SMT), discrete Fourier transform (DFT), discrete cosine transform (DCT) and approximate entropy (ApEn). The features are then used for skill classification and exact skill score prediction. Along with using these features individually, we also evaluate the performance using our proposed weighted combination technique. The task highlights are produced using DCT features. Our results demonstrate that these holistic features outperform all previous Hidden Markov Model (HMM)-based state-of-the-art methods for skill classification on the JIGSAWS dataset. Also, our proposed feature fusion strategy significantly improves performance for skill score predictions achieving up to 0.61 average spearman correlation coefficient. Moreover, we provide an analysis on how the proposed task highlights can relate to different surgical gestures within a task. Holistic features capturing global information from robot kinematic data can successfully be used for evaluating surgeon skill in basic surgical tasks on the da Vinci robot. Using the framework presented can potentially allow for real-time score feedback in RMIS training and help surgical trainees have more focused training.

  20. Government services: sector skills assessment 2012

    OpenAIRE

    Parry, Jon; Ojo, Adegbola

    2012-01-01

    The aim of this report is to provide authoritative labour market intelligence (LMI) for the Government Services sector to inform the strategic decision making of national governments in the development of employment and skills policy. It is one of 15 UK Sector Skills Assessment (SSA) reports produced by Sector Skills Councils and the UK Commission for Employment and Skills.

  1. Ocean forecasting in terrain-following coordinates: Formulation and skill assessment of the Regional Ocean Modeling System

    Science.gov (United States)

    Haidvogel, D.B.; Arango, H.; Budgell, W.P.; Cornuelle, B.D.; Curchitser, E.; Di, Lorenzo E.; Fennel, K.; Geyer, W.R.; Hermann, A.J.; Lanerolle, L.; Levin, J.; McWilliams, J.C.; Miller, A.J.; Moore, A.M.; Powell, T.M.; Shchepetkin, A.F.; Sherwood, C.R.; Signell, R.P.; Warner, J.C.; Wilkin, J.

    2008-01-01

    Systematic improvements in algorithmic design of regional ocean circulation models have led to significant enhancement in simulation ability across a wide range of space/time scales and marine system types. As an example, we briefly review the Regional Ocean Modeling System, a member of a general class of three-dimensional, free-surface, terrain-following numerical models. Noteworthy characteristics of the ROMS computational kernel include: consistent temporal averaging of the barotropic mode to guarantee both exact conservation and constancy preservation properties for tracers; redefined barotropic pressure-gradient terms to account for local variations in the density field; vertical interpolation performed using conservative parabolic splines; and higher-order, quasi-monotone advection algorithms. Examples of quantitative skill assessment are shown for a tidally driven estuary, an ice-covered high-latitude sea, a wind- and buoyancy-forced continental shelf, and a mid-latitude ocean basin. The combination of moderate-order spatial approximations, enhanced conservation properties, and quasi-monotone advection produces both more robust and accurate, and less diffusive, solutions than those produced in earlier terrain-following ocean models. Together with advanced methods of data assimilation and novel observing system technologies, these capabilities constitute the necessary ingredients for multi-purpose regional ocean prediction systems. 

  2. Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

    Science.gov (United States)

    Zhao, Bin; Zhang, Bo

    2018-02-01

    Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called "double-penalty" problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.

  3. Distortion Representation of Forecast Errors for Model Skill Assessment and Objective Analysis

    Science.gov (United States)

    Hoffman, Ross N.

    2001-01-01

    We completed the formulation of the smoothness penalty functional this past quarter. We used a simplified procedure for estimating the statistics of the FCA solution spectral coefficients from the results of the unconstrained, low-truncation FCA (stopping criterion) solutions. During the current reporting period we have completed the calculation of GEOS-2 model-equivalent brightness temperatures for the 6.7 micron and 11 micron window channels used in the GOES imagery for all 10 cases from August 1999. These were simulated using the AER-developed Optimal Spectral Sampling (OSS) model.

  4. Peer Assessment of Elementary Science Teaching Skills

    Science.gov (United States)

    Kilic, Gulsen Bagci; Cakan, Mehtap

    2007-01-01

    In this study, peer assessment was applied in assessing elementary science teaching skills. Preservice teachers taught a science topic as a team to their peers in an elementary science methods course. The peers participating in the science lesson assessed teacher-groups' elementary science teaching skills on an assessment form provided by the…

  5. Validation of the Danish version of the McGill Ingestive Skills Assessment using classical test theory and the Rasch model

    DEFF Research Database (Denmark)

    Hansen, Tina; Lambert, Heather C; Faber, Jens

    2012-01-01

    Purpose: The study aimed to validate the Danish version of the Canadian the "McGill Ingestive Skills Assessment" (MISA-DK) for measuring dysphagia in frail elders. Method: One-hundred and ten consecutive older medical patients were recruited to the study. Reliability was assessed by internal...... consistency (Chronbach's alpha). External construct validity (convergent and known-groups validity) was evaluated against theoretical constructs assessing the complex concept of ingestive skills. Internal construct validity was tested using Rasch analysis. Results: High internal consistency reliability...... with Chronbach's alpha of 0.77-0.95 was evident. External construct validity was supported by expected high correlations with most of the constructs related to ingestive skills (r(s)¿=¿0.53 to r(s)¿=¿0.66). The MISA-DK discriminated significantly between known-groups. Fit to the Rasch model (x(2) (df)¿=¿12 (12...

  6. A Perkins Challenge: Assessing Technical Skills in CTE

    Science.gov (United States)

    Stone, James R., III

    2009-01-01

    Federal law requires state to develop performance measures and data-collection systems for secondary and postsecondary technical-skill attainment. This poses many challenges, such as defining a technical skills, measurement and when to assess students. In this article, the author outlines various assessment models and looks at the challenges…

  7. Identifying and Assessing Gaps in Subseasonal to Seasonal Prediction Skill using the North American Multi-model Ensemble

    Science.gov (United States)

    Pegion, K.; DelSole, T. M.; Becker, E.; Cicerone, T.

    2016-12-01

    Predictability represents the upper limit of prediction skill if we had an infinite member ensemble and a perfect model. It is an intrinsic limit of the climate system associated with the chaotic nature of the atmosphere. Producing a forecast system that can make predictions very near to this limit is the ultimate goal of forecast system development. Estimates of predictability together with calculations of current prediction skill are often used to define the gaps in our prediction capabilities on subseasonal to seasonal timescales and to inform the scientific issues that must be addressed to build the next forecast system. Quantification of the predictability is also important for providing a scientific basis for relaying to stakeholders what kind of climate information can be provided to inform decision-making and what kind of information is not possible given the intrinsic predictability of the climate system. One challenge with predictability estimates is that different prediction systems can give different estimates of the upper limit of skill. How do we know which estimate of predictability is most representative of the true predictability of the climate system? Previous studies have used the spread-error relationship and the autocorrelation to evaluate the fidelity of the signal and noise estimates. Using a multi-model ensemble prediction system, we can quantify whether these metrics accurately indicate an individual model's ability to properly estimate the signal, noise, and predictability. We use this information to identify the best estimates of predictability for 2-meter temperature, precipitation, and sea surface temperature from the North American Multi-model Ensemble and compare with current skill to indicate the regions with potential for improving skill.

  8. Employability Skills Assessment: Measuring Work Ethic for Research and Learning

    Science.gov (United States)

    Park, HwaChoon; Hill, Roger B.

    2016-01-01

    The Employability Skills Assessment (ESA) was developed by Hill (1995) to provide an alternative measure of work ethic needed for success in employment. This study tested goodness-of-fit for a model used to interpret ESA results. The model had three factors: interpersonal skills, initiative, and dependability. Confirmatory factor analysis results…

  9. Teacher Assessment of Practical Skills in A-Level Chemistry

    Science.gov (United States)

    Wood, R.; Ferguson, Carolyn M.

    1975-01-01

    Discusses a two-year assessment undertaken to evaluate the Nuffield A-Level chemistry course. Secondary teachers selected chemistry experiments for assessment purposes and assessed their students in manipulative skills, observational skills, interpretation skills, creative skills, and attitudes. (MLH)

  10. Objective assessment of technical skills in surgery

    OpenAIRE

    Moorthy, Krishna; Munz, Yaron; Sarker, Sudip K; Darzi, Ara

    2003-01-01

    In the past few years, considerable developments have been made in the objective assessment of technical proficiency of surgeons. Technical skills should be assessed during training, and various methods have been developed for this purpose

  11. A teaching skills assessment tool inspired by the Calgary-Cambridge model and the patient-centered approach.

    Science.gov (United States)

    Sommer, Johanna; Lanier, Cédric; Perron, Noelle Junod; Nendaz, Mathieu; Clavet, Diane; Audétat, Marie-Claude

    2016-04-01

    The aim of this study was to develop a descriptive tool for peer review of clinical teaching skills. Two analogies framed our research: (1) between the patient-centered and the learner-centered approach; (2) between the structures of clinical encounters (Calgary-Cambridge communication model) and teaching sessions. During the course of one year, each step of the action research was carried out in collaboration with twelve clinical teachers from an outpatient general internal medicine clinic and with three experts in medical education. The content validation consisted of a literature review, expert opinion and the participatory research process. Interrater reliability was evaluated by three clinical teachers coding thirty audiotaped standardized learner-teacher interactions. This tool contains sixteen items covering the process and content of clinical supervisions. Descriptors define the expected teaching behaviors for three levels of competence. Interrater reliability was significant for eleven items (Kendall's coefficient pteaching skills. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

  12. Training and Assessment of Hysteroscopic Skills

    DEFF Research Database (Denmark)

    Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars

    2016-01-01

    OBJECTIVE: The aim of this systematic review was to identify studies on hysteroscopic training and assessment. DESIGN: PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies...... on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study...... outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. RESULTS: A total of 25 studies on hysteroscopy training were identified...

  13. Enabling performance skills: Assessment in engineering education

    Science.gov (United States)

    Ferrone, Jenny Kristina

    Current reform in engineering education is part of a national trend emphasizing student learning as well as accountability in instruction. Assessing student performance to demonstrate accountability has become a necessity in academia. In newly adopted criterion proposed by the Accreditation Board for Engineering and Technology (ABET), undergraduates are expected to demonstrate proficiency in outcomes considered essential for graduating engineers. The case study was designed as a formative evaluation of freshman engineering students to assess the perceived effectiveness of performance skills in a design laboratory environment. The mixed methodology used both quantitative and qualitative approaches to assess students' performance skills and congruency among the respondents, based on individual, team, and faculty perceptions of team effectiveness in three ABET areas: Communications Skills. Design Skills, and Teamwork. The findings of the research were used to address future use of the assessment tool and process. The results of the study found statistically significant differences in perceptions of Teamwork Skills (p performance skills, such as teamwork, among freshman engineering students; (2) incorporate feedback into the learning process; (3) strengthen the assessment process with a follow-up plan that specifically targets performance skill deficiencies, and (4) integrate the assessment instrument and practice with ongoing curriculum development. The findings generated by this study provides engineering departments engaged in assessment activity, opportunity to reflect, refine, and develop their programs as it continues. It also extends research on ABET competencies of engineering students in an under-investigated topic of factors correlated with team processes, behavior, and student learning.

  14. Assessment of Surgical Skills and Competency.

    Science.gov (United States)

    Bhatti, Nasir I

    2017-10-01

    Evaluation of surgical skills and competency are important aspects of the medical education process. Measurable and reproducible methods of assessment with objective feedback are essential components of surgical training. Objective Structured Assessment of Technical Skills (OSATS) is widely used across the medical specialties and otolaryngology-specific tools have been developed and validated for sinus and mastoid surgery. Although assessment of surgical skills can be time-consuming and requires human and financial resources, new evaluation methods and emerging technology may alleviate these barriers while also improving data collection practices. Copyright © 2017 Elsevier Inc. All rights reserved.

  15. Teamwork Skills Assessment for Cooperative Learning

    Science.gov (United States)

    Strom, Paris S.; Strom, Robert D.

    2011-01-01

    Teamwork skills are required at work, but teacher efforts in many countries to track achievement within this context have been hindered by lack of assessment tools and input from students. The Teamwork Skills Inventory relies on peer and self-evaluation to establish accountability, identify competencies, and detect learning needs. Twenty-five…

  16. Goodness of Fit of Skills Assessment Approaches: Insights from Patterns of Real vs. Synthetic Data Sets

    Science.gov (United States)

    Beheshti, Behzad; Desmarais, Michel C.

    2015-01-01

    This study investigates the issue of the goodness of fit of different skills assessment models using both synthetic and real data. Synthetic data is generated from the different skills assessment models. The results show wide differences of performances between the skills assessment models over synthetic data sets. The set of relative performances…

  17. Teaching and Assessing Engineering Professional Skills

    Directory of Open Access Journals (Sweden)

    Ali M. Al-Bahi

    2013-05-01

    Full Text Available Engineering students are required to have, by the time of graduation, a set of professional skills related to teamwork, oral and written communications, impact of engineering solutions, life-long learning, and knowledge of contemporary issues. Teaching and assessment of these skills, as part of ABET accreditation, remains problematic. A systematic methodology to integrate these skills and their assessment in the curriculum is described. The method was recently applied in several engineering programs and proved to be efficient in generating data and evidences for evaluation and continuous improvement of these outcomes.

  18. Two Reading Assessments for Youth in Alternative Basic Skills and Livelihood Skills Training Programs

    Science.gov (United States)

    Comings, John P.; Strucker, John; Bell, Brenda

    2017-01-01

    This article describes two assessment tools that have been used to assess the reading skills of youth participating in alternative basic skills and livelihood skills training programs. The Rapid Assessment of Reading Skills (RARS) was developed to identify potential participants who needed to improve their reading skills before beginning training…

  19. Educational Assessment Knowledge and Skills for Teachers

    Science.gov (United States)

    Brookhart, Susan M.

    2011-01-01

    The 1990 Standards for Teacher Competence in Educational Assessment of Students (AFT, NCME, & NEA, 1990) made a documentable contribution to the field. However, the Standards have become a bit dated, most notably in two ways: (1) the Standards do not consider current conceptions of formative assessment knowledge and skills, and (2) the Standards…

  20. Development of an instrument to assess the impact of an enhanced experiential model on pharmacy students' learning opportunities, skills and attitudes: A retrospective comparative-experimentalist study

    Directory of Open Access Journals (Sweden)

    Collins John B

    2008-04-01

    Full Text Available Abstract Background Pharmacy schools across North America have been charged to ensure their students are adequately skilled in the principles and practices of pharmaceutical care. Despite this mandate, a large percentage of students experience insufficient opportunities to practice the activities, tasks and processes essential to pharmaceutical care. The objective of this retrospective study of pharmacy students was to: (1 as "proof of concept", test the overall educational impact of an enhanced advanced pharmacy practice experiential (APPE model on student competencies; (2 develop an instrument to measure students' and preceptors' experiences; and (3 assess the psychometric properties of the instrument. Methods A comparative-experimental design, using student and preceptor surveys, was used to evaluate the impact of the enhanced community-based APPE over the traditional APPE model. The study was grounded in a 5-stage learning model: (1 an enhanced learning climate leads to (2 better utilization of learning opportunities, including (3 more frequent student/patient consultation, then to (4 improved skills acquisition, thence to (5 more favorable attitudes toward pharmaceutical care practice. The intervention included a one-day preceptor workshop, a comprehensive on-site student orientation and extending the experience from two four-week experiences in different pharmacies to one eight-week in one pharmacy. Results The 35 student and 38 preceptor survey results favored the enhanced model; with students conducting many more patient consultations and reporting greater skills improvement. In addition, the student self-assessment suggested changes in attitudes favoring pharmaceutical care principles. Psychometric testing showed the instrument to be sensitive, valid and reliable in ascertaining differences between the enhanced and traditional arms. Conclusion The enhanced experiential model positively affects learning opportunities and competency

  1. Setting pass scores for clinical skills assessment.

    Science.gov (United States)

    Liu, Min; Liu, Keh-Min

    2008-12-01

    In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  2. Setting Pass Scores for Clinical Skills Assessment

    Directory of Open Access Journals (Sweden)

    Min Liu

    2008-12-01

    Full Text Available In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  3. Following the Template: Transferring Modeling Skills to Nonstandard Problems

    Science.gov (United States)

    Tyumeneva, Yu. A.; Goncharova, M. V.

    2017-01-01

    This study seeks to analyze how students apply a mathematical modeling skill that was previously learned by solving standard word problems to the solution of word problems with nonstandard contexts. During the course of an experiment involving 106 freshmen, we assessed how well they were able to transfer the mathematical modeling skill that is…

  4. Clinical skills assessment of procedural and advanced communication skills: performance expectations of residency program directors

    Science.gov (United States)

    Langenau, Erik E.; Zhang, Xiuyuan; Roberts, William L.; DeChamplain, Andre F.; Boulet, John R.

    2012-01-01

    Background High stakes medical licensing programs are planning to augment and adapt current examinations to be relevant for a two-decision point model for licensure: entry into supervised practice and entry into unsupervised practice. Therefore, identifying which skills should be assessed at each decision point is critical for informing examination development, and gathering input from residency program directors is important. Methods Using data from previously developed surveys and expert panels, a web-delivered survey was distributed to 3,443 residency program directors. For each of the 28 procedural and 18 advanced communication skills, program directors were asked which clinical skills should be assessed, by whom, when, and how. Descriptive statistics were collected, and Intraclass Correlations (ICC) were conducted to determine consistency across different specialties. Results Among 347 respondents, program directors reported that all advanced communication and some procedural tasks are important to assess. The following procedures were considered ‘important’ or ‘extremely important’ to assess: sterile technique (93.8%), advanced cardiovascular life support (ACLS) (91.1%), basic life support (BLS) (90.0%), interpretation of electrocardiogram (89.4%) and blood gas (88.7%). Program directors reported that most clinical skills should be assessed at the end of the first year of residency (or later) and not before graduation from medical school. A minority were considered important to assess prior to the start of residency training: demonstration of respectfulness (64%), sterile technique (67.2%), BLS (68.9%), ACLS (65.9%) and phlebotomy (63.5%). Discussion Results from this study support that assessing procedural skills such as cardiac resuscitation, sterile technique, and phlebotomy would be amenable to assessment at the end of medical school, but most procedural and advanced communications skills would be amenable to assessment at the end of the first

  5. Non-technical skills assessment in surgery.

    Science.gov (United States)

    Sharma, Bharat; Mishra, Amit; Aggarwal, Rajesh; Grantcharov, Teodor P

    2011-09-01

    Adverse events in surgery have highlighted the importance of non-technical skills, such as communication, decision-making, teamwork, situational awareness and leadership, to effective organizational performance. These skills carry particular importance to surgical oncology, as members of a multidisciplinary team must work cohesively to formulate effective patient care plans. Several non-technical skills evaluation tools have been developed for use in surgery, without adequate comparison and consensus on which should be standard for training. Eleven articles describing the use of three non-technical evaluation tools related to surgery: NOTSS (Non Technical Skills for Surgeons), NOTECHS (Non Technical Skills) and OTAS (Observational Teamwork Assessment for Surgery) were analyzed with respect to scale formulation, validity, reliability and feasibility. Furthermore, their use in training thus far and the future of non-technical rating scales in surgical curricula was discussed. Future work should focus on incorporating these assessment tools into training and into a real operating room setting to provide formative evaluations for surgical residents. Copyright © 2010 Elsevier Ltd. All rights reserved.

  6. Objective assessment of technical surgical skills

    NARCIS (Netherlands)

    van Hove, P. D.; Tuijthof, G. J. M.; Verdaasdonk, E. G. G.; Stassen, L. P. S.; Dankelman, J.

    2010-01-01

    Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice. A systematic search was

  7. The assessment of mindfulness skills: the "what" and the "how".

    Science.gov (United States)

    Iani, Luca; Lauriola, Marco; Cafaro, Valentina

    2017-10-06

    The five facets mindfulness questionnaire-short form (FFMQ-SF) is a new, brief measure for the assessment of mindfulness skills in clinical and nonclinical samples. The construct validity of the FFMQ-SF has not been previously assessed in community samples. The present study investigated the factor structure of the Italian version of the FFMQ-SF. Structured equation modeling was used to test the fit of three alternative models in a sample of highly educated adults (n = 211). A hierarchical model with a single second-order factor loaded by observing, describing, and acting with awareness (i.e. the mindfulness "what" skills) performed slightly better than both a five-factor model with correlated factors and a hierarchical model with a general second-order factor. The FFMQ-SF scores were significantly higher than those reported in both Dutch depressed patients and Australian undergraduate students for all facets (but nonreactivity for the Australian sample). Data support the multifaceted nature of mindfulness skills. Because of its brevity and simplicity of use, the FFMQ-SF is a promising questionnaire in longitudinal and clinical research. This questionnaire can serve as a guideline to help clinicians assess and monitor mindfulness skills acquisition, strengthening, and generalization, and prioritize mindfulness skills that need immediate attention.

  8. Inter-rater reliability of healthcare professional skills' portfolio assessments: The Andalusian Agency for Healthcare Quality model

    Directory of Open Access Journals (Sweden)

    Antonio Almuedo-Paz

    2014-07-01

    Full Text Available This study aims to determine the reliability of assessment criteria used for a portfolio at the Andalusian Agency for Healthcare Quality (ACSA. Data: all competences certification processes, regardless of their discipline. Period: 2010-2011. Three types of tests are used: 368 certificates, 17,895 reports and 22,642 clinical practice reports (N = 3,010 candidates. The tests were evaluated in pairs by the ACSA team of raters using two categories: valid and invalid. Results: The percentage agreement in assessments of certificates was 89,9%, while for the reports of clinical practice was 85,1 % and for clinical practice reports was 81,7%. The inter-rater agreement coefficients (kappa ranged from 0,468 to 0,711. Discussion: The results of this study show that the inter-rater reliability of assessments varies from fair to good. Compared with other similar studies, the results put the reliability of the model in a comfortable position. Among the improvements incorporated, progressive automation of evaluations must be highlighted.

  9. Training Self-Regulated Learning Skills with Video Modeling Examples: Do Task-Selection Skills Transfer?

    Science.gov (United States)

    Raaijmakers, Steven F.; Baars, Martine; Schaap, Lydia; Paas, Fred; van Merriënboer, Jeroen; van Gog, Tamara

    2018-01-01

    Self-assessment and task-selection skills are crucial in self-regulated learning situations in which students can choose their own tasks. Prior research suggested that training with video modeling examples, in which another person (the model) demonstrates and explains the cyclical process of problem-solving task performance, self-assessment, and…

  10. Individualized Special Education with Cognitive Skill Assessment.

    Science.gov (United States)

    Kurhila, Jaakko; Laine, Tei

    2000-01-01

    Describes AHMED (Adaptive and Assistive Hypermedia in Education), a computer learning environment which supports the evaluation of disabled children's cognitive skills in addition to supporting openness in learning materials and adaptivity in learning events. Discusses cognitive modeling and compares it to previous intelligent tutoring systems.…

  11. Training and Assessment of Hysteroscopic Skills: A Systematic Review.

    Science.gov (United States)

    Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars; Tolsgaard, Martin G; Bjerrum, Flemming

    2016-01-01

    The aim of this systematic review was to identify studies on hysteroscopic training and assessment. PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%). This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  12. Assessing the skill of hydrology models at simulating the water cycle in the HJ Andrews LTER: Assumptions, strengths and weaknesses

    Science.gov (United States)

    Simulated impacts of climate on hydrology can vary greatly as a function of the scale of the input data, model assumptions, and model structure. Four models are commonly used to simulate streamflow in model assumptions, and model structure. Four models are commonly used to simu...

  13. PENGEMBANGAN MODEL PEMBELAJARAN SOFT SKILLS DAN HARD SKILLS UNTUK SISWA SMK

    OpenAIRE

    Widarto Noto Widodo, Pardjono

    2013-01-01

    Abstrak: Pengembangan Model Pembelajaran Soft Skills dan Hard Skills untuk Siswa SMK. Era global menuntut sumber daya manusia yang memiliki daya saing, adaptif dan antisipatif, mampu belajar, terampil, mudah beradaptasi dengan teknologi baru. Profil tenaga kerja yang dibutuhkan pasar adalah yang kuat pada aspek soft skills dan hard skills. Ada tiga alternatif model pendidikan yang memadukan hard skills dan soft skills, yaitu (1) aspek soft skills dan hard skills dilaksanakan di sekolah; (2) a...

  14. Getting Skills Right: Assessing and Anticipating Changing Skill Needs

    Science.gov (United States)

    OECD Publishing, 2016

    2016-01-01

    Digitalisation, globalisation, demographic shifts and other changes in work organisation are constantly reshaping skill needs. This can lead to persistent skill shortages and mismatch which are costly for individuals, firms and society in terms of lost wages and lower productivity and growth. These costs can be reduced through better assessment…

  15. Peer Assessment of Soft Skills and Hard Skills

    Science.gov (United States)

    Zhang, Aimao

    2012-01-01

    Both the information technology (IT) industry and the Accreditation Board for Engineering and Technology (ABET) demand soft-skill training in higher education and require IT graduates to demonstrate competence in interpersonal communication, teamwork, and conflict management. Group projects provide teamwork environment for soft-skill training, but…

  16. MOVEMENT SKILL ASSESSMENT OF TYPICALLY DEVELOPING PRESCHOOL CHILDREN: A REVIEW OF SEVEN MOVEMENT SKILL ASSESSMENT TOOLS

    Directory of Open Access Journals (Sweden)

    Wouter Cools

    2009-06-01

    Full Text Available The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children.

  17. Metrics for Objective Assessment of Surgical Skills Workshop

    National Research Council Canada - National Science Library

    Satava, Richard

    2001-01-01

    On 9-10 July, 2001 the Metrics for Objective Assessment of Surgical Skills Workshop convened an international assemblage of subject matter experts in objective assessment of surgical technical skills...

  18. Assessment of professional engineering skills - define, monitor and assess

    DEFF Research Database (Denmark)

    Andersson, Niclas; Andersson, Pernille Hammar

    2012-01-01

    , professional engineering skills need to be included in the syllabus of engineering courses and study programs, which in turn call for the implementation of learning objectives, teaching activities as well as methods for assessing the professional performance of the engineering students. The implicit...... life experience from industry and consequently, they might have limited knowledge about professional skills which of course delimits their ability to evaluate the students’ professional performance. The objective of this study is to design and test a method to assess professional skills...... in an engineering teaching context. A suggested approach, based on the three consecutive steps of Define – Monitor – Assess, was applied and tested in an engineering course in which the students and professional engineers from industry interacted in an extensive role play simulation. The students’ were actively...

  19. Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

    Science.gov (United States)

    Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

    2009-01-01

    The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: K

  20. Defining and Assessing Team Skills of Business and Accountancy Students

    Science.gov (United States)

    Alghalith, Nabil; Blum, Michael; Medlock, Amanda; Weber, Sandy

    2004-01-01

    The objectives of the project are (1) to define the skills necessary for students to work effectively with others to achieve common goals, and (2) to develop an assessment instrument to measure student progress toward achieving these skills. The defined skill set will form a basis for common expectations related to team skills that will be shared…

  1. Communication skills training: describing a new conceptual model.

    Science.gov (United States)

    Brown, Richard F; Bylund, Carma L

    2008-01-01

    Current research in communication in physician-patient consultations is multidisciplinary and multimethodological. As this research has progressed, a considerable body of evidence on the best practices in physician-patient communication has been amassed. This evidence provides a foundation for communication skills training (CST) at all levels of medical education. Although the CST literature has demonstrated that communication skills can be taught, one critique of this literature is that it is not always clear which skills are being taught and whether those skills are matched with those being assessed. The Memorial Sloan-Kettering Cancer Center Comskil Model for CST seeks to answer those critiques by explicitly defining the important components of a consultation, based on Goals, Plans, and Actions theories and sociolinguistic theory. Sequenced guidelines as a mechanism for teaching about particular communication challenges are adapted from these other methods. The authors propose that consultation communication can be guided by an overarching goal, which is achieved through the use of a set of predetermined strategies. Strategies are common in CST; however, strategies often contain embedded communication skills. These skills can exist across strategies, and the Comskil Model seeks to make them explicit in these contexts. Separate from the skills are process tasks and cognitive appraisals that need to be addressed in teaching. The authors also describe how assessment practices foster concordance between skills taught and those assessed through careful coding of trainees' communication encounters and direct feedback.

  2. Formative assessment of GP trainees' clinical skills.

    Science.gov (United States)

    Wiener-Ogilvie, Sharon; Begg, Drummond

    2012-03-01

    Clinical skill assessment (CSA) has been an integral part of the Royal College of General Practitioners' membership examination (MRCGP) since 2008. It is an expensive, high-stakes examination with first time pass rates ranging from 76.4 to 81.3. In this paper we describe the South East Scotland Deanery, NHS Education Scotland, pilot of a formative clinical skills assessment (fCSA) using the principles of formative assessment and OSCE. The purpose of the study was to assess the acceptability of the fCSA and to examine whether trainees, identified during the fCSA as 'at risk of failing the MRCGP CSA exam', are more likely to fail the MRCGP CSA exam later on in the year. Trainees were assessed in four clinical skills stations under exam conditions. After each station they were given verbal feedback and subsequently both trainee and their trainer received written feedback. We assessed the value of the exercise through written feedback from trainees and trainers. Each trainee's performance in fCSA was triangulated with trainer assessment to identify 'flagged trainees'. We compared flagged and non-flagged trainees' performance in MRCGP CSA. Both trainees and trainers highly rated the fCSA. Overall 97% of non-flagged trainees have passed the RCGP CSA exam by May of that year in comparison to 80% of flagged trainees who have passed the RCGP CSA (P = 0.005). Trainers and trainees rated the fCSA as excellent and useful. We were able to demonstrate that the fCSA can be used to identify those trainees likely to fail the RCGP CSA. Contrary to reservations about the potential to demoralise trainees, the fCSA was viewed as a useful and a positive experience by both trainees and trainers. In addition, we suggest that feedback from fCSA was useful in triggering appropriate educational interventions. Early intervention with trainees who are predicted to fail the CSA has the potential to reduce deaneries overall fail rate. Preventing one trainee failure could save over £30 000.

  3. Clinical Skills Assessment in the Twenty-First Century.

    Science.gov (United States)

    Elder, Andrew

    2018-05-01

    Clinical skills remain fundamental to the practice of medicine and form a core component of the professional identity of the physician. However, evidence exists to suggest that the practice of some clinical skills is declining, particularly in the United States. A decline in practice of any skill can lead to a decline in its teaching and assessment, with further decline in practice as a result. Consequently, assessment not only drives learning of clinical skills, but their practice. This article summarizes contemporary approaches to clinical skills assessment that, if more widely adopted, could support the maintenance and reinvigoration of bedside clinical skills. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

  4. Self-perceived assessment skill of prospective physics teachers

    Science.gov (United States)

    Efendi, R.; Rustaman, N. Y.; Kaniawati, I.

    2018-05-01

    Assessment skills are an important component of assessment practice, without adequate assessment skills it is unlikely that teacher assessment practices will produce desired student learning outcomes. This study was conducted to reveal self-perceived assessment skills of prospective physics teachers by using quantitative descriptive analysis, and involving 92 prospective physics teachers who were experiencing teaching practice in junior high school and final project related to assessment. Data was collected by using Self-Perceived Assessment Science Skills Questionnaire consisted of 29 items related seven assessment competencies was developed and used in the study. Internal consistency reliability coefficient for the total scale scores was 0.87 as measured by Cronbach’s alpha. Determination of self-perceived assessment science skills detected from prospective physics teachers was carried out in descriptive statistics, in the form of respondent average values. Research findings show that self-perceived assessment skills of prospective physics teachers was categorized as transition.

  5. Assessment of technical and nontechnical skills in surgical residents.

    Science.gov (United States)

    Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

    2016-11-01

    Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

  6. A Procedural Skills OSCE: Assessing Technical and Non-Technical Skills of Internal Medicine Residents

    Science.gov (United States)

    Pugh, Debra; Hamstra, Stanley J.; Wood, Timothy J.; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

    2015-01-01

    Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

  7. Assessing Topographical Orientation Skills in Cannabis Users

    Directory of Open Access Journals (Sweden)

    Liana Palermo

    2012-01-01

    Full Text Available The long-term effects of cannabis on human cognition are still unclear, but, considering that cannabis is a widely used substance and, overall, its potential use in therapeutic interventions, it is important to evaluate them. We hypothesize that the discrepancies among studies could be attributed to the specific cognitive function investigated and that skills subserved by the hippocampus, such as the spatial orientation abilities and, specifically, the ability to form and use cognitive maps, should be more compromised than others. Indeed it has been showed that cannabis users have a reduced hippocampus and that the hippocampus is the brain region in which cannabis has the greatest effect since it contains the highest concentration of cannabinoid receptors. To test this hypothesis we asked 15 heavy cannabis users and 19 nonusers to perform a virtual navigational test, the CMT, that assesses the ability to form and use cognitive maps. We found that using cannabis has no effect on these hippocampus-dependent orientation skills. We discuss the implications of our findings and how they relate to evidence reported in the literature that the intervention of functional reorganization mechanisms in cannabis user allows them to cope with the cognitive demands of navigational tasks.

  8. Patient Assessment Skills Pertinent to Practicing Pharmacists

    Directory of Open Access Journals (Sweden)

    Jennifer A. Wilson

    2015-01-01

    Full Text Available Objectives: To describe pharmacists’ opinions regarding which patient assessment skills are necessary to understand and/or perform to provide optimal patient care in pharmacy practice. Methods: An online questionnaire was distributed to pharmacists licensed in North Carolina (n=14,167, as identified by the Board of Pharmacy. The 80 patient assessment items in the questionnaire were derived from a course text book and faculty experience. Participants indicated whether they “need to understand and be able to perform”, “need to understand only”, or “not need to understand or be able to perform” each item in their current practice setting. Descriptive statistics were used to describe background demographics and perceived need for each item. Post-hoc chi-square analyses were performed to determine differences in need based on practice setting and Pharm.D. degree completion. Results: Of 1036 responses received, 770 were used in data analysis; incomplete questionnaires and non-practicing pharmacist responses were excluded. Fifty-nine percent of respondents held a Pharm.D. degree. Participants identified their practice site(s as inpatient (29%, outpatient (16%, community/retail (50%, long term care (5%, and other (8%. The top five patient assessment items respondents identified as important to understand and perform included automatic blood pressure measurement (63%, point of care testing (57%, manual blood pressure measurement (53%, heart rate measurement (52%, and peak flow meter use (47%. Post-hoc analyses showed a significant difference among those with a Pharm.D. versus those without for the response “need to understand and be able to perform” for 20 patient assessment items; a significant difference was also noted among practice settings for 29 items. Conclusions: The top items pharmacists identified they need to both understand and perform could be applied in various practice settings. The study results may guide which patient

  9. Soft Skills Assessment: Theory Development and the Research Agenda

    Science.gov (United States)

    Gibb, Stephen

    2014-01-01

    Soft skills have become a subject of increasing interest in lifelong learning. Soft skills development is intended to enable and enhance personal development, participation in learning and success in employment. The assessment of soft skill is therefore widely practised, but there is little in the way of research or evidence on how well this…

  10. Critical Emergency Medicine Procedural Skills: A Comparative Study of Methods for Teaching and Assessment.

    Science.gov (United States)

    Chapman, Dane M.; And Others

    Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

  11. Challenge Course Facilitator Technical Skills Assessment Tool Mark

    Science.gov (United States)

    Wagstaff, William Quinn

    2007-01-01

    A study was conducted to develop a technical skills assessment tool for the training and development of challenge course facilitators. Researchers accessed two professional on-line listserves to collect a sample size of twenty-seven currently used technical skills assessment tools. The assessment tools were critically analysed by three independent…

  12. Rubric Authoring Tool Supporting Cognitive Skills Assessment across an Institution

    Science.gov (United States)

    Simper, Natalie

    2018-01-01

    This paper explores a method to support instructors in assessing cognitive skills in their course, designed to enable aggregation of data across an institution. A rubric authoring tool, "BASICS" (Building Assessment Scaffolds for Intellectual Cognitive Skills) was built as part of the Queen's University Learning Outcomes Assessment (LOA)…

  13. Observational assessment of fundamental movement skill proficiency in preschool children

    OpenAIRE

    佐々木, 玲子; 石沢, 順子

    2014-01-01

    Fundamental movement skill competency in children has been declining in recent years. Early childhood is a sensitive period for the development of fundamental movement skills ; the mastery of certain of these skills is a prerequisite for daily functioning and participation in later physical or sport-specific activities. Although quantitative methods have been developed for assessing movement development in children, it is also important to qualitatively evaluate such skills in developing chil...

  14. Uncovering the Best Skill Multimap by Constraining the Error Probabilities of the Gain-Loss Model

    Science.gov (United States)

    Anselmi, Pasquale; Robusto, Egidio; Stefanutti, Luca

    2012-01-01

    The Gain-Loss model is a probabilistic skill multimap model for assessing learning processes. In practical applications, more than one skill multimap could be plausible, while none corresponds to the true one. The article investigates whether constraining the error probabilities is a way of uncovering the best skill assignment among a number of…

  15. Improving visual skills: II-remote assessment via Internet.

    Science.gov (United States)

    Powers, Maureen K; Grisham, J David; Wurm, Janice K; Wurm, William C

    2009-02-01

    Even though poor readers often have poor visual skills, such as binocular coordination and oculomotor control, students' visual skills are rarely assessed. Computer assessments have the potential to assist in identifying students whose visual skills are deficient. This study compared assessments made by an Internet-based computer orthoptics program with those of an on-site vision therapist. Students (N = 41) in grades 1 through 8, reading at least 2 levels below grade, were assessed for visual skill dysfunction (including binocular fusion and tracking ability) by a vision therapist at their school in Wisconsin. The therapist determined whether the student had adequate visual skills based on clinical and behavioral observations. A "remote" investigator located in California determined the adequacy of accommodative facility, tracking, and vergence skills in the same students, based on quantitative progress through the modules of an Internet-based computer orthoptics training program during 3 assessment sessions. The on-site therapist made 33 referrals for possible visual skills training (80%). The remote investigator made 25 referrals (61%), all of which were consistent with referrals made by the on-site therapist; thus, no false-positives occurred when using the remote assessment technique. The 8 additional referrals by the therapist were attributed to the ability to observe student behavior during assessment. Remote assessment of visual skills via an Internet orthoptics program may provide a simple means to detect visual skill problems experienced by poor readers.

  16. Modeling attacking of high skills volleyball players

    Directory of Open Access Journals (Sweden)

    Vladimir Gamaliy

    2014-12-01

    Full Text Available Purpose: to determine the model indicators of technical and tactical actions in the attack highly skilled volleyball players. Material and Methods: the study used statistical data of major international competitions: Olympic Games – 2012 World Championships – 2010, World League – 2010–2014 European Championship – 2010–2014. A total of 130 analyzed games. Methods were used: analysis and generalization of scientific and methodological literature, analysis of competitive activity highly skilled volleyball players, teacher observation, modeling technical and tactical actions in attacking highly skilled volleyball players. Results: it was found that the largest volume application of technical and tactical actions in the attack belongs to the group tactics «supple movement», whose indicator is 21,3%. The smallest amount of application belongs to the group tactics «flight level» model whose indicators is 5,4%, the efficiency of 3,4%, respectively. It is found that the power service in the jump from model parameters used in 51,6% of cases, the planning targets – 21,7% and 4,4% planning to reduce. Attacks performed with the back line, on model parameters used in the amount of 20,8% efficiency –13,7%. Conclusions: we prove that the performance of technical and tactical actions in the attack can be used as model in the control system of training and competitive process highly skilled volleyball players

  17. Prerequisite Skills That Support Learning through Video Modeling

    Science.gov (United States)

    MacDonald, Rebecca P. F.; Dickson, Chata A.; Martineau, Meaghan; Ahearn, William H.

    2015-01-01

    The purpose of this study was to evaluate the relationship between tasks that require delayed discriminations such as delayed imitation and delayed matching to sample on acquisition of skills using video modeling. Twenty-nine participants with an ASD diagnosis were assessed on a battery of tasks including both immediate and delayed imitation and…

  18. Unexpected pathological findings in skills training and assessing skills

    NARCIS (Netherlands)

    Boendermaker, PM; Pols, J; Scherpbier, AJJA

    This article draws attention to unexpected pathological findings encountered by students and teachers when examining one another and/or simulated patients in skips training and assessment sessions. Although no literature on the subject was found it appears to be not uncommon far students and

  19. Ability-versus skill-based assessment of emotional intelligence.

    Science.gov (United States)

    Bradberry, Travis R; Su, Lac D

    2006-01-01

    Emotional intelligence has received an intense amount of attention in leadership circles during the last decade and continuing debate exists concerning the best method for measuring this construct. This study analyzed leader emotional intelligence scores, measured via skill and ability methodologies, against leader job performance. Two hundred twelve employees from three organizations participated in this study. Scores on the Emotional Intelligence Appraisal, a skill-based assessment, were positively, though not significantly, correlated with scores on the MSCEIT, an ability-based assessment of emotional intelligence. Scores on the MSCEIT did not have a significant relationship with job performance in this study, whereas, scores on the Emotional Intelligence Appraisal had a strong link to leader job performance. The four subcomponents of the Emotional Intelligence Appraisal were examined against job performance. Relationship management was a stronger predictor of leader job performance than the other three subcomponents. Social awareness was the single emotional intelligence skill that did not have a significant link to leader job performance. Factor analyses yielded a two-component model of emotional intelligence encompassing personal and social competence, rather than confirmation of a four-part taxonomy.

  20. The use of advanced physical assessment skills by cardiac nurses.

    Science.gov (United States)

    Edmunds, Linda; Ward, Susan; Barnes, Rhian

    To establish what advanced physical assessment skills are being used by cardiac nurses after they undertook a clinical patient assessment module; and to explore the factors that influence their use of these skills. A longitudinal descriptive approach using convenience sampling was employed. Qualitative data was obtained from individual interviews, non-participant observation within the participants' clinical environment and self-reported activity logs. Five key themes emerged: use of advanced physical assessment skills varied; use and development of skills was linked to personal characteristics; use influenced by perceptions of role boundaries, permission and cooperation; use influenced by participants' perception of nursing and the development of their own nursing practice; and use influenced by the physical environment and the human support within it. Cardiac nurses selectively use physical assessment skills, predominately related to the cardiorespiratory systems. Organisational structure, professional relationships and the professionalism of the individual nurse appear to play a significant part in the use of physical assessment skills. Although the findings from this qualitative study cannot be generalized, they concur with findings from recent research into physical assessment skills used by a variety of UK nurses. The implications identified are: first, for those who provide the education, in terms of what should be taught and facilitated; and second, for organizations, in ensuring staff have assessment skills relevant to their role and that systems are in place to enable the development of a supportive and progressive culture that embraces modernization congruent with healthcare policy.

  1. Teaching and Assessing Communication Skills in Medical Undergraduate Training.

    Science.gov (United States)

    Modi, Jyoti Nath; Anshu, -; Chhatwal, Jugesh; Gupta, Piyush; Singh, Tejinder

    2016-06-08

    Good communication skills are essential for an optimal doctor-patient relationship, and also contribute to improved health outcomes. Although the need for training in communication skills is stated as a requirement in the 1997 Graduate Medical Education Regulations of the Medical Council of India, formal training in these skills has been fragmentary and non-uniform in most Indian curricula. The Vision 2015 document of the Medical Council of India reaffirms the need to include training in communication skills in the MBBS curriculum. Training in communication skills needs approaches which are different from that of teaching other clinical subjects. It is also a challenge to ensure that students not only imbibe the nuances of communication and interpersonal skills, but adhere to them throughout their careers. This article addresses the possible ways of standardizing teaching and assessment of communication skills and integrating them into the existing curriculum.

  2. Assessment of psychomotor skills acquisition during laparoscopic cholecystectomy courses.

    Science.gov (United States)

    Hance, Julian; Aggarwal, Rajesh; Moorthy, Krishna; Munz, Yaron; Undre, Shabnam; Darzi, Ara

    2005-09-01

    Standardized short courses in laparoscopic cholecystectomy aim to teach laparoscopic skills to surgical trainees, although end-of-course assessments of performance remain subjective. The current study aims to objectively assess psychomotor skills acquisition of trainees attending laparoscopic cholecystectomy courses. Thirty-seven junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate 2-day courses (A, B, and C), all with identical format. Assessments were comprised of a standardized simulated laparoscopic task, with performance measured using a valid electromagnetic hand-motion tracking device. Overall, trainees made significant improvements in path length (P=.006), number of movements (Ppsychomotor skills on courses. In addition to providing participants with an insight into their skills, these data can be used to demonstrate course efficacy.

  3. Meningkatkan Hard Skills dan Soft Skills Siswa melalui Model Pembelajaran Koooperatif Tipe Stad

    OpenAIRE

    Alfiansyah, Muhammad; Jamal, M. Arifuddin; An'nur, Syubhan

    2014-01-01

    Penelitian ini secara umum bertujuan untuk mendeskripsikan keefektifan model pembelajaran kooperatif tipe STAD dalam meningkatkan hard skills dan soft skills siswa SMAN 8 Barabai pada pokok bahasan fluida statis. Secara khusus untuk mendeskripsikan keterlaksanaan RPP model kooperatif tipe STAD, hard skills siswa, soft skills siswa dan respon siswa. Metode penelitian yang digunakan merupakan penelitian tindakan kelas model Kemmis dan Mc Taggart. Hasil penelitian menunjukkan bahwa terjadi pen...

  4. Assessment of the critical thinking skills of student radiographers

    Energy Technology Data Exchange (ETDEWEB)

    Castle, Alan [University of Portsmouth, Centre for Radiography Education, St George' s Building, Portsmouth PO1 2HY (United Kingdom)]. E-mail: alan.castle@port.ac.uk

    2006-05-15

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills.

  5. Assessment of the critical thinking skills of student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2006-01-01

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills

  6. Assessing the reliability of skilled performance

    International Nuclear Information System (INIS)

    Dougherty, E.M.; Collins, E.P.

    1996-01-01

    In some high-hazard military tasks, precision of motor skills is crucial to avoid a risk-sensitive drop or other mishap. Sparse data supports a basic level of reliability for this activity seemingly much lower than typical, individual action, slip-mode errors would yield. A typical occurrence failure rate seems to be of the order of 1 x 10 -5 per opportunity. A speculation is tendered that this represents a difference in kind; that the reliability of skills is a different taxon than previously called out in the typical scheme of human reliability

  7. Crowd-sourced assessment of technical skills: an opportunity for improvement in the assessment of laparoscopic surgical skills.

    Science.gov (United States)

    Deal, Shanley B; Lendvay, Thomas S; Haque, Mohamad I; Brand, Timothy; Comstock, Bryan; Warren, Justin; Alseidi, Adnan

    2016-02-01

    Objective, unbiased assessment of surgical skills remains a challenge in surgical education. We sought to evaluate the feasibility and reliability of Crowd-Sourced Assessment of Technical Skills. Seven volunteer general surgery interns were given time for training and then testing, on laparoscopic peg transfer, precision cutting, and intracorporeal knot-tying. Six faculty experts (FEs) and 203 Amazon.com Mechanical Turk crowd workers (CWs) evaluated 21 deidentified video clips using the Global Objective Assessment of Laparoscopic Skills validated rating instrument. Within 19 hours and 15 minutes we received 662 eligible ratings from 203 CWs and 126 ratings from 6 FEs over 10 days. FE video ratings were of borderline internal consistency (Krippendorff's alpha = .55). FE ratings were highly correlated with CW ratings (Pearson's correlation coefficient = .78, P Assessment of Technical Skills as a reliable, basic tool to standardize the evaluation of technical skills in general surgery. Copyright © 2016 Elsevier Inc. All rights reserved.

  8. Teaching and Assessing Teamwork Skills in Engineering and Computer Science

    Directory of Open Access Journals (Sweden)

    Robert W. Lingard

    2010-02-01

    Full Text Available To be successful in today's workplace, engineering and computer science students must possess high levels of teamwork skills. Unfortunately, most engineering programs provide little or no specific instruction in this area. This paper outlines an assessment-driven approach toward teaching teamwork skills. Working with the Industrial Advisory Board for the College, a set of performance criteria for teamwork was developed. This set of criteria was used to build an assessment instrument to measure the extent to which students are able to achieve the necessary skills. This set of criteria provides a clear basis for the development of an approach toward teaching teamwork skills. Furthermore, the results from the assessment can be used to adjust the teaching techniques to address the particular skills where students show some weaknesses. Although this effort is in the early stages, the approach seems promising and will be improved over time.

  9. Sibling Conflict Resolution Skills: Assessment and Training

    Science.gov (United States)

    Thomas, Brett W.; Roberts, Mark W.

    2009-01-01

    Sibling conflict can rise to the level of a clinical problem. In Phase 1 a lengthy behavioral role-play analog sampling child reactions to normal sibling conflicts was successfully shortened. In Phase 2 normal children who lacked sibling conflict resolution skills were randomly assigned to a Training or Measurement Only condition. Training…

  10. Developing and Assessing College Student Teamwork Skills

    Science.gov (United States)

    Hughes, Richard L.; Jones, Steven K.

    2011-01-01

    Some form of team-oriented work is employed in most, if not all, organizations today. It would seem, then, that an important role for higher education should involve developing critical teamwork skills among students so as to prepare them for success in life. This very point was highlighted in a 2009 poll conducted on behalf of the Association of…

  11. Developing Employability Skills: Peer Assessment in Higher Education

    Science.gov (United States)

    Cassidy, Simon

    2006-01-01

    Purpose: Reports examining graduate employment issues suggest that employers are concerned by the lack of employability skills exhibited by entry-level job applications. It is also suggested that employers consider it the responsibility of educational institutions to develop such skills. The current study seeks to identify peer assessment as a…

  12. Reliability and Validity of the Research Methods Skills Assessment

    Science.gov (United States)

    Smith, Tamarah; Smith, Samantha

    2018-01-01

    The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

  13. The development and validation of measures to assess cooking skills and food skills.

    Science.gov (United States)

    Lavelle, Fiona; McGowan, Laura; Hollywood, Lynsey; Surgenor, Dawn; McCloat, Amanda; Mooney, Elaine; Caraher, Martin; Raats, Monique; Dean, Moira

    2017-09-02

    With the increase use of convenience food and eating outside the home environment being linked to the obesity epidemic, the need to assess and monitor individuals cooking and food skills is key to help intervene where necessary to promote the usage of these skills. Therefore, this research aimed to develop and validate a measure for cooking skills and one for food skills, that are clearly described, relatable, user-friendly, suitable for different types of studies, and applicable across all sociodemographic levels. Two measures were developed in light of the literature and expert opinion and piloted for clarity and ease of use. Following this, four studies were undertaken across different cohorts (including a sample of students, both 'Food preparation novices' and 'Experienced food preparers', and a nationally representative sample) to assess temporal stability, psychometrics, internal consistency reliability and construct validity of both measures. Analysis included T-tests, Pearson's correlations, factor analysis, and Cronbach's alphas, with a significance level of 0.05. Both measures were found to have a significant level of temporal stability (P cooking skills confidence measure ranged from 0.78 to 0.93 across all cohorts. The food skills confidence measure's Cronbach's alpha's ranged from 0.85 to 0.94. The two measures also showed a high discriminate validity as there were significant differences (P cooking skills confidence and P cooking skills confidence measure and the food skills confidence measure have been shown to have a very satisfactory reliability, validity and are consistent over time. Their user-friendly applicability make both measures highly suitable for large scale cross-sectional, longitudinal and intervention studies to assess or monitor cooking and food skills levels and confidence.

  14. Assessing the Impact of Surface and Upper-Air Observations on the Forecast Skill of the ACCESS Numerical Weather Prediction Model over Australia

    Directory of Open Access Journals (Sweden)

    Sergei Soldatenko

    2018-01-01

    Full Text Available The impact of the Australian Bureau of Meteorology’s in situ observations (land and sea surface observations, upper air observations by radiosondes, pilot balloons, wind profilers, and aircraft observations on the short-term forecast skill provided by the ACCESS (Australian Community Climate and Earth-System Simulator global numerical weather prediction (NWP system is evaluated using an adjoint-based method. This technique makes use of the adjoint perturbation forecast model utilized within the 4D-Var assimilation system, and is able to calculate the individual impact of each assimilated observation in a cycling NWP system. The results obtained show that synoptic observations account for about 60% of the 24-h forecast error reduction, with the remainder accounted for by aircraft (12.8%, radiosondes (10.5%, wind profilers (3.9%, pilot balloons (2.8%, buoys (1.7% and ships (1.2%. In contrast, the largest impact per observation is from buoys and aircraft. Overall, all observation types have a positive impact on the 24-h forecast skill. Such results help to support the decision-making process regarding the evolution of the observing network, particularly at the national level. Consequently, this 4D-Var-based approach has great potential as a tool to assist the design and running of an efficient and effective observing network.

  15. Core skills assessment to improve mathematical competency

    Science.gov (United States)

    Carr, Michael; Bowe, Brian; Fhloinn, Eabhnat Ní

    2013-12-01

    Many engineering undergraduates begin third-level education with significant deficiencies in their core mathematical skills. Every year, in the Dublin Institute of Technology, a diagnostic test is given to incoming first-year students, consistently revealing problems in basic mathematics. It is difficult to motivate students to address these problems; instead, they struggle through their degree, carrying a serious handicap of poor core mathematical skills, as confirmed by exploratory testing of final year students. In order to improve these skills, a pilot project was set up in which a 'module' in core mathematics was developed. The course material was basic, but 90% or higher was required to pass. Students were allowed to repeat this module throughout the year by completing an automated examination on WebCT populated by a question bank. Subsequent to the success of this pilot with third-year mechanical engineering students, the project was extended to five different engineering programmes, across three different year-groups. Full results and analysis of this project are presented, including responses to interviews carried out with a selection of the students involved.

  16. Teaching and assessing consultation skills: an evaluation of a South ...

    African Journals Online (AJOL)

    Teaching and assessing consultation skills: an evaluation of a South African workshop ... of this work is unsupervised consultations with patients suffering from new or ... Their attitudes to the LAP and the forms of teaching that its use promotes ...

  17. The role of multimedia in surgical skills training and assessment.

    Science.gov (United States)

    Shariff, Umar; Seretis, Charalampos; Lee, Doreen; Balasubramanian, Saba P

    2016-06-01

    Multimedia is an educational resource that can be used to supplement surgical skills training. The aim of this review was to determine the role of multimedia in surgical training and assessment by performing a systematic review of the literature. A systematic review for published articles was conducted on the following databases: PubMed/MEDLINE (1992 to November 2014), SCOPUS (1992 to November 2014) and EMBASE (1992 to November 2014). For each study the educational content, study design, surgical skill assessed and outcomes were recorded. A standard data extraction form was created to ensure systematic retrieval of relevant information. 21 studies were included; 14 randomized controlled trials (RCTs) and 7 non-randomized controlled trials (Non-RCTs). Technical skills were assessed in 7 RCTs and 3 non-RCTs; cognitive skills were assessed in 9 RCTs and 4 non-RCTs. In controlled studies, multimedia was associated with significant improvement in technical skills (4 studies; 4 RCTs) and cognitive skills (7 studies; 6 RCTs). In two studies multimedia was inferior in comparison to conventional teaching. Evaluation of multimedia (9 studies) demonstrated strongly favourable results. This review suggests that multimedia effectively facilitates both technical and cognitive skills acquisition and is well accepted as an educational resource. Copyright © 2015 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

  18. Assessing students' communication skills: validation of a global rating.

    Science.gov (United States)

    Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

    2008-12-01

    Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

  19. Assessing study skills among university students: an Iranian survey.

    Science.gov (United States)

    Didarloo, Alireza; Khalkhali, Hamid Reza

    2014-05-05

    Numerous studies have revealed that study skills have a constructive role on the academic performance of students, in addition to educational quality, student' intelligence, and their affective characteristics. This study aims to examine study skills and the factors influencing them among the health sciences students of Urmia University of Medical Sciences in Iran. This was a cross-sectional study carried out from May to November 2013. A total of 340 Urmia health sciences students were selected using a simple sampling method. Data were collected using the Study Skills Assessment Questionnaire of Counseling Center of Houston University and analyzed with descriptive and analytical statistics. The mean and standard deviation of the students' study skills were 172.5±23.2, out of a total score of 240. Around 1.2% of the study skills were weak; 86.8%, moderate; and 12%, good. Among the study skills, the scores of time management, and memory and concentration were better than the others. Also, there was a significant positive correlation between study skills scores and the students' family housing status and academic level (Pstudy skills, these were not sufficient and far from good. Improving and promoting the study skills of university students require the designing and implementing of education programs for study strategies. Therefore, decision makers and planners in the educational areas of universities should consider the topic described above.

  20. A Model for Evaluating Student Clinical Psychomotor Skills.

    Science.gov (United States)

    And Others; Fiel, Nicholas J.

    1979-01-01

    A long-range plan to evaluate medical students' physical examination skills was undertaken at the Ingham Family Medical Clinic at Michigan State University. The development of the psychomotor skills evaluation model to evaluate the skill of blood pressure measurement, tests of the model's reliability, and the use of the model are described. (JMD)

  1. Cross-platform digital assessment forms for evaluating surgical skills

    DEFF Research Database (Denmark)

    Andersen, Steven Arild Wuyts

    2015-01-01

    developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion......A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex...... assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database...

  2. Effects of video modeling with video feedback on vocational skills of adults with autism spectrum disorder.

    Science.gov (United States)

    English, Derek L; Gounden, Sadhana; Dagher, Richard E; Chan, Shu Fen; Furlonger, Brett E; Anderson, Angelika; Moore, Dennis W

    2017-11-01

    To examine the effectiveness of a video modeling (VM) with video feedback (VFB) intervention to teach vocational gardening skills to three adults with autism spectrum disorder (ASD). A multiple probe design across skills was used to assess the effects of the intervention on the three participants' ability to perform skills accurately. The use of VM with VFB led to improvements across skills for two of the participants. The third participant required video prompting (VP) for successful skill acquisition. Skill performance generalized across personnel and settings for two of the participants, but it was not assessed for the third. Skill performance maintained at follow-up for all three participants. Social validity data gathered from participants, parents, and co-workers were positive. These findings suggest that VM with VFB and VP with VFB were effective and socially acceptable interventions for teaching vocational gardening skills to young adults with ASD.

  3. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

    Science.gov (United States)

    Nmadu, Teresa M.

    2018-01-01

    Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business

  4. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria.

    Science.gov (United States)

    Asieba, Iyeseun O; Nmadu, Teresa M

    2018-01-01

    Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business performance with money skills, leadership skills and

  5. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

    Directory of Open Access Journals (Sweden)

    Asieba IO

    2018-03-01

    Full Text Available Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974/Herron (1990 Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90% still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03 and stock growth (P=0.04; while stock growth was significantly affected by leadership skills (P=0.002 and entrepreneurial skills (0.02. Net profit was significantly affected by industry skills (P=0.008. Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on

  6. Defining and assessing critical thinking skills for student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2009-01-01

    Developing critical thinking skills is a key aim of higher education and is important in preparing student radiographers for their future careers in clinical practice. The aim of this paper was to attempt to devise and assess six key components of critical thinking appropriate for radiographic practice. Each of the six components was divided into three dimensions and a Critical Thinking Skills Scoring Chart (CTSSC) devised to assess students' written performance against each dimension. Scores revealed that approximately 30% of students were rated as good and approximately 10% of students were rated as poor in each component, although there was some variability between different dimensions. It is suggested that educators need to encourage and support students to develop their critical thinking skills by reviewing their curriculum to clearly define specific skills and ensure that they are appropriately taught and assessed

  7. Technical and Technological Skills Assessment in Laparoscopic Surgery

    Science.gov (United States)

    Chang, Avril; Vincent, Charles

    2006-01-01

    Objectives: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. Methods: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each operation blindly and independently on DVD. The technological skills were assessed in the operating room. Results: One hundred operations were analyzed. Eight trainees and 10 consultant surgeons were recruited. No adverse events occurred due to technical or technological skills. Mean interrater reliability was kappa=0.88, P=technical and technological skills between trainee and consultant surgeons were significant, Mann-Whitney P=technical and technological skills can be measured to assess performance of laparoscopic surgeons. This technical and technological assessment tool for laparoscopic surgery seems to have face, content, concurrent, and construct validities and could be modified and applied to any laparoscopic operation. The tool has the possibility of being used in surgical training and appraisal. We aim to modify and apply this tool to advanced laparoscopic operations. PMID:17212881

  8. Cross-platform digital assessment forms for evaluating surgical skills

    Directory of Open Access Journals (Sweden)

    Steven Arild Wuyts Andersen

    2015-04-01

    Full Text Available A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database containing the digital assessment forms, because this software has cross-platform functionality on both desktop computers and handheld devices. The database is hosted online, and the rating forms can therefore also be accessed through most modern web browsers. Cross-platform digital assessment forms were developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion, digital assessment forms can be used for the structured rating of surgical skills and have the potential to be especially useful in complex assessment situations with multiple raters, repeated assessments in various times and locations, and situations requiring substantial subsequent data processing or complex score calculations.

  9. How Effective Are Self- and Peer Assessment of Oral Presentation Skills Compared with Teachers' Assessments?

    Science.gov (United States)

    De Grez, Luc; Valcke, Martin; Roozen, Irene

    2012-01-01

    Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the…

  10. STUDENTS’ COMMUNICATION SKILLS ASSESSMENT BY EXTERNAL LECTURERS AND INDUSTRY REPRESENTATIVES

    Directory of Open Access Journals (Sweden)

    NOORFAZILA KAMAL

    2016-11-01

    Full Text Available Soft skills, especially communication skills, are important skills which each graduate must possess. Accordingly, several courses and approaches have been carried out in universities to train students in communication skills. The skills are normally evaluated by course lecturers. However, assessments by a third party from outside the university are valuable so that the students’ ahievements may be weighed against external evaluators’ point of views. In the Department of Electrical, Electronic and Systems Engineering (DEESE, Universiti Kebangsaan Malaysia (UKM, communication skills assessment by external lecturers and industry representatives are performed on Hari Poster JKEES, where students present their final year project poster. There are two categories of evaluation, namely project and communication skills. The project evaluation covers content, result and impact, while communication skills evaluation covers poster layout and design, and delivery. This study only analyse the students’ communication skills achievement. The participants of this study consists of 109 final year students from two batches, of which 51 students are from year 2014 and the other 58 students from year 2015. The results show that for the year 2014 students, the mean mark given by external lecturers in layout and design category is 6.7, while the mean mark from industry evaluators is 6.5. For the 2015 batch, the mean mark in the layout and design category is 6.3 from external lecturers and 5.9 from industry evaluators. In the delivery category, the mean marks for the 2014 batch are 7.1 and 6.6 from external lecturers and industry evaluators, espectively. Meanwhile, for the 2015 batch, the mean marks by external lecturers and industry evaluators are 6.3 and 5.8, respectively. The results show that both external lecturers and industry representatives judged DEESE students’ communication skills to be good.

  11. Development of assessment instruments to measure critical thinking skills

    Science.gov (United States)

    Sumarni, W.; Supardi, K. I.; Widiarti, N.

    2018-04-01

    Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

  12. Designing Cognitively Diagnostic Assessment for Algebraic Content Knowledge and Thinking Skills

    Science.gov (United States)

    Zhang, Zhidong

    2018-01-01

    This study explored a diagnostic assessment method that emphasized the cognitive process of algebra learning. The study utilized a design and a theory-driven model to examine the content knowledge. Using the theory driven model, the thinking skills of algebra learning was also examined. A Bayesian network model was applied to represent the theory…

  13. Developing Enterprise Skills through Peer-Assessed Pitch Presentations

    Science.gov (United States)

    Faherty, Anna

    2015-01-01

    Purpose: The purpose of this paper is to investigate the impact of using summative peer assessment to develop enterprise skills within higher education. Design/methodology/approach: An empirical investigation analysing students own perceptions of the peer assessment process to evaluate its impact. Findings: Participating students indicate that…

  14. Crowd-sourced assessment of surgical skills in cricothyrotomy procedure.

    Science.gov (United States)

    Aghdasi, Nava; Bly, Randall; White, Lee W; Hannaford, Blake; Moe, Kris; Lendvay, Thomas S

    2015-06-15

    Objective assessment of surgical skills is resource intensive and requires valuable time of expert surgeons. The goal of this study was to assess the ability of a large group of laypersons using a crowd-sourcing tool to grade a surgical procedure (cricothyrotomy) performed on a simulator. The grading included an assessment of the entire procedure by completing an objective assessment of technical skills survey. Two groups of graders were recruited as follows: (1) Amazon Mechanical Turk users and (2) three expert surgeons from University of Washington Department of Otolaryngology. Graders were presented with a video of participants performing the procedure on the simulator and were asked to grade the video using the objective assessment of technical skills questions. Mechanical Turk users were paid $0.50 for each completed survey. It took 10 h to obtain all responses from 30 Mechanical Turk users for 26 training participants (26 videos/tasks), whereas it took 60 d for three expert surgeons to complete the same 26 tasks. The assessment of surgical performance by a group (n = 30) of laypersons matched the assessment by a group (n = 3) of expert surgeons with a good level of agreement determined by Cronbach alpha coefficient = 0.83. We found crowd sourcing was an efficient, accurate, and inexpensive method for skills assessment with a good level of agreement to experts' grading. Copyright © 2015 Elsevier Inc. All rights reserved.

  15. MOJECT: MOTION ANALYSIS TO SUPPORT ASSESSMENT OF SURGICAL SKILLS

    NARCIS (Netherlands)

    Uineken, Ruben; Groot Jebbink, Erik; Halfwerk, F.R.; Bulten, Anne; Knoben, Peter; Roux, Moritz; Wicik, Ola; Groenier, Marleen

    2018-01-01

    Assessment of surgical skills is usually performed through direct observation by experts. This is subjective, expensive and requires assessor training. Motion analysis can support objective and cost-effective assessment. The aim of the current study is to design a low-cost, unobtrusive system for

  16. Investigating Secondary School Students' Unmediated Peer Assessment Skills

    Science.gov (United States)

    Tsivitanidou, Olia E.; Zacharia, Zacharias C.; Hovardas, Tasos

    2011-01-01

    The purpose of this study was to investigate secondary school students' unmediated peer assessment skills. Specifically, 36 seventh graders, without receiving any kind of support, were anonymously assigned to reciprocally assess their peers' science web-portfolios. Additionally, students' attitudes towards and intentions about the use of…

  17. Assessing Gross Motor Skills of Kosovar Preschool Children

    Science.gov (United States)

    Shala, Merita

    2009-01-01

    In the light of the new developments in preschool education in Kosovo, this study attempts to carry out an assessment of the development of gross motor skills of preschool children attending institutional education. The emphasis is on creating a set of tests to measure the motor attainments of these children by conducting assessments of the…

  18. Does Computer-Based Motor Skill Assessment Training Transfer to Live Assessing?

    Science.gov (United States)

    Kelly, Luke E.; Taliaferro, Andrea; Krause, Jennifer

    2012-01-01

    Developing competency in motor skill assessment has been identified as a critical need in physical educator preparation. We conducted this study to evaluate (a) the effectiveness of a web-based instructional program--Motor Skill Assessment Program (MSAP)--for developing assessment competency, and specifically (b) whether competency developed by…

  19. Assessing computer skills in Tanzanian medical students: an elective experience

    Directory of Open Access Journals (Sweden)

    Melvin Rob

    2004-08-01

    Full Text Available Abstract Background One estimate suggests that by 2010 more than 30% of a physician's time will be spent using information technology tools. The aim of this study is to assess the information and communication technologies (ICT skills of medical students in Tanzania. We also report a pilot intervention of peer mentoring training in ICT by medical students from the UK tutoring students in Tanzania. Methods Design: Cross sectional study and pilot intervention study. Participants: Fourth year medical students (n = 92 attending Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania. Main outcome measures: Self-reported assessment of competence on ICT-related topics and ability to perform specific ICT tasks. Further information related to frequency of computer use (hours per week, years of computer use, reasons for use and access to computers. Skills at specific tasks were reassessed for 12 students following 4 to 6 hours of peer mentoring training. Results The highest levels of competence in generic ICT areas were for email, Internet and file management. For other skills such as word processing most respondents reported low levels of competence. The abilities to perform specific ICT skills were low – less than 60% of the participants were able to perform the core specific skills assessed. A period of approximately 5 hours of peer mentoring training produced an approximate doubling of competence scores for these skills. Conclusion Our study has found a low level of ability to use ICT facilities among medical students in a leading university in sub-Saharan Africa. A pilot scheme utilising UK elective students to tutor basic skills showed potential. Attention is required to develop interventions that can improve ICT skills, as well as computer access, in order to bridge the digital divide.

  20. Training self-assessment and task-selection skills to foster self-regulated learning: Do trained skills transfer across domains?

    Science.gov (United States)

    Raaijmakers, Steven F; Baars, Martine; Paas, Fred; van Merriënboer, Jeroen J G; van Gog, Tamara

    2018-01-01

    Students' ability to accurately self-assess their performance and select a suitable subsequent learning task in response is imperative for effective self-regulated learning. Video modeling examples have proven effective for training self-assessment and task-selection skills, and-importantly-such training fostered self-regulated learning outcomes. It is unclear, however, whether trained skills would transfer across domains. We investigated whether skills acquired from training with either a specific, algorithmic task-selection rule or a more general heuristic task-selection rule in biology would transfer to self-regulated learning in math. A manipulation check performed after the training confirmed that both algorithmic and heuristic training improved task-selection skills on the biology problems compared with the control condition. However, we found no evidence that students subsequently applied the acquired skills during self-regulated learning in math. Future research should investigate how to support transfer of task-selection skills across domains.

  1. Materials for Assessing the Writing Skill

    Science.gov (United States)

    Nimehchisalem, Vahid

    2010-01-01

    This paper reviews the issues of concern in writing scale development in English as Second Language (ESL) settings with an intention to provide a useful guide for researchers or writing teachers who wish to develop or adapt valid, reliable and efficient writing scales considering their present assessment situations. With a brief discussion on the…

  2. The Role of Crowdsourcing in Assessing Surgical Skills.

    Science.gov (United States)

    Katz, Andrew J

    2016-08-01

    Assessing surgical skill is critical in improving patient care while reducing medical errors, length of stay, and readmission rates. Crowdsourcing provides 1 potential method for accurately assessing this; only recently has crowdsourcing been studied as a valid way to provide feedback to surgeons. The results of such studies are explored. A systematic literature search was performed on PubMed to identify studies that have attempted to validate crowdsourcing as a method for assessing surgical skill. Through a combination of abstract screening and full-length review, 9 studies that met the inclusion criteria were reviewed. Crowdsourcing has been validated as an important way to provide feedback for surgical skill. It has been demonstrated to be effective in both dry-lab and live surgery, for a variety of tasks and methods. However, more studies must be performed to ensure that crowdsourcing can provide quality feedback in a wider variety of scenarios.

  3. Enhancing Systems-Thinking Skills with Modelling

    Science.gov (United States)

    Hung, Woei

    2008-01-01

    Systems thinking is an essential cognitive skill that enables individuals to develop an integrative understanding of a given subject at the conceptual and systemic level. Yet, systems thinking is not usually an innate skill. Helping students develop systems-thinking skills warrants attention from educators. This paper describes a study examining…

  4. Reliable and valid assessment of Lichtenstein hernia repair skills

    DEFF Research Database (Denmark)

    Carlsen, C G; Lindorff Larsen, Karen; Funch-Jensen, P

    2014-01-01

    PURPOSE: Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity...... of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. METHODS: Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia...... a significant difference between the three groups which indicates construct validity, p skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment...

  5. Leveraging Educational Data Mining for Real-Time Performance Assessment of Scientific Inquiry Skills within Microworlds

    Science.gov (United States)

    Gobert, Janice D.; Sao Pedro, Michael A.; Baker, Ryan S. J. D.; Toto, Ermal; Montalvo, Orlando

    2012-01-01

    We present "Science Assistments," an interactive environment, which assesses students' inquiry skills as they engage in inquiry using science microworlds. We frame our variables, tasks, assessments, and methods of analyzing data in terms of "evidence-centered design." Specifically, we focus on the "student model," the…

  6. Designing an Automated Assessment of Public Speaking Skills Using Multimodal Cues

    Science.gov (United States)

    Chen, Lei; Feng, Gary; Leong, Chee Wee; Joe, Jilliam; Kitchen, Christopher; Lee, Chong Min

    2016-01-01

    Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and human rating were conducted according to standards in educational assessment. An initial corpus of…

  7. Cinemeducation: teaching family assessment skills using full-length movies.

    Science.gov (United States)

    Wilson, Astrid H; Blake, Barbara J; Taylor, Gloria A; Hannings, Glenda

    2013-05-01

    A thorough family assessment provides a foundation for the nursing process when working with families. Therefore, nurses, along with other health care providers must develop expertise in conducting family assessments to provide the best possible care within the community. This article describes an innovative educational strategy using movies to teach family assessment skills and puts forth recommendations for future research to provide evidence to support this teaching modality. © 2013 Wiley Periodicals, Inc.

  8. Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.

    Science.gov (United States)

    Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa

    2017-04-01

    The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

  9. Predictive model for early math skills based on structural equations.

    Science.gov (United States)

    Aragón, Estíbaliz; Navarro, José I; Aguilar, Manuel; Cerda, Gamal; García-Sedeño, Manuel

    2016-12-01

    Early math skills are determined by higher cognitive processes that are particularly important for acquiring and developing skills during a child's early education. Such processes could be a critical target for identifying students at risk for math learning difficulties. Few studies have considered the use of a structural equation method to rationalize these relations. Participating in this study were 207 preschool students ages 59 to 72 months, 108 boys and 99 girls. Performance with respect to early math skills, early literacy, general intelligence, working memory, and short-term memory was assessed. A structural equation model explaining 64.3% of the variance in early math skills was applied. Early literacy exhibited the highest statistical significance (β = 0.443, p < 0.05), followed by intelligence (β = 0.286, p < 0.05), working memory (β = 0.220, p < 0.05), and short-term memory (β = 0.213, p < 0.05). Correlations between the independent variables were also significant (p < 0.05). According to the results, cognitive variables should be included in remedial intervention programs. © 2016 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

  10. Materials for Assessing the Writing Skill

    Directory of Open Access Journals (Sweden)

    Vahid Nimehchisalem

    2010-07-01

    Full Text Available This paper reviews the issues of concern in writing scale development in English as Second Language (ESL settings with an intention to provide a useful guide for researchers or writing teachers who wish to develop or adapt valid, reliable and efficient writing scales considering their present assessment situations. With a brief discussion on the rationale behind writing scales, the author considers the process of scale development by breaking it into three phases of design, operationalization and administration. The issues discussed in the first phase include analyzing the samples, deciding on the type of scale and ensuring the validity of its design. Phase two encompasses setting the scale criteria, operationalization of definitions, setting a numerical value, assigning an appropriate weight for each trait, accounting for validity and reliability. The final phase comprises recommendations on how a writing scale should be used.

  11. The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students.

    Science.gov (United States)

    Hastie, Carolyn; Fahy, Kathleen; Parratt, Jenny

    2014-09-01

    Poor teamwork is cited as one of the major root causes of adverse events in healthcare. Bullying, resulting in illness for staff, is an expression of poor teamwork skills. Despite this knowledge, poor teamwork persists in healthcare and teamwork skills are rarely the focus of teaching and assessment in undergraduate health courses. To develop and implement an assessment tool for use in facilitating midwifery students' learning of teamwork skills. This paper describes how the TeamUP rubric tool was developed. A review of the literature found no research reports on how to teach and assess health students' teamwork skills in standing teams. The literature, however, gives guidance about how university educators should evaluate individual students using peer assessment. The developmental processes of the rubric were grounded in the theoretical literature and feminist collaborative conversations. The rubric incorporates five domains of teamwork skills: Fostering a Team Climate; Project Planning; Facilitating Teams; Managing Conflict and Quality Individual Contribution. The process and outcomes of student and academic content validation are described. The TeamUP rubric is useful for articulating, teaching and assessing teamwork skills for health professional students. The TeamUP rubric is a robust, theoretically grounded model that defines and details effective teamwork skills and related behaviours. If these skills are mastered, we predict that graduates will be more effective in teams. Our assumption is that graduates, empowered by having these skills, are more likely to manage conflict effectively and less likely to engage in bullying behaviours. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

  12. Extended score interval in the assessment of basic surgical skills.

    Science.gov (United States)

    Acosta, Stefan; Sevonius, Dan; Beckman, Anders

    2015-01-01

    The Basic Surgical Skills course uses an assessment score interval of 0-3. An extended score interval, 1-6, was proposed by the Swedish steering committee of the course. The aim of this study was to analyze the trainee scores in the current 0-3 scored version compared to a proposed 1-6 scored version. Sixteen participants, seven females and nine males, were evaluated in the current and proposed assessment forms by instructors, observers, and learners themselves during the first and second day. In each assessment form, 17 tasks were assessed. The inter-rater reliability between the current and the proposed score sheets were evaluated with intraclass correlation (ICC) with 95% confidence intervals (CI). The distribution of scores for 'knot tying' at the last time point and 'bowel anastomosis side to side' given by the instructors in the current assessment form showed that the highest score was given in 31 and 62%, respectively. No ceiling effects were found in the proposed assessment form. The overall ICC between the current and proposed score sheets after assessment by the instructors increased from 0.38 (95% CI 0.77-0.78) on Day 1 to 0.83 (95% CI 0.51-0.94) on Day 2. A clear ceiling effect of scores was demonstrated in the current assessment form, questioning its validity. The proposed score sheet provides more accurate scores and seems to be a better feedback instrument for learning technical surgical skills in the Basic Surgical Skills course.

  13. A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

    NARCIS (Netherlands)

    Ackermans, Kevin; Rusman, Ellen; Brand-Gruwel, Saskia; Specht, Marcus

    2016-01-01

    Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of

  14. Technical skills assessment toolbox: a review using the unitary framework of validity.

    Science.gov (United States)

    Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

    2015-02-01

    The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

  15. Basic Laparoscopic Skills Assessment Study: Validation and Standard Setting among Canadian Urology Trainees.

    Science.gov (United States)

    Lee, Jason Y; Andonian, Sero; Pace, Kenneth T; Grober, Ethan

    2017-06-01

    As urology training programs move to a competency based medical education model, iterative assessments with objective standards will be required. To develop a valid set of technical skills standards we initiated a national skills assessment study focusing initially on laparoscopic skills. Between February 2014 and March 2016 the basic laparoscopic skill of Canadian urology trainees and attending urologists was assessed using 4 standardized tasks from the AUA (American Urological Association) BLUS (Basic Laparoscopic Urological Surgery) curriculum, including peg transfer, pattern cutting, suturing and knot tying, and vascular clip applying. All performances were video recorded and assessed using 3 methods, including time and error based scoring, expert global rating scores and C-SATS (Crowd-Sourced Assessments of Technical Skill Global Rating Scale), a novel, crowd sourced assessment platform. Different methods of standard setting were used to develop pass-fail cut points. Six attending urologists and 99 trainees completed testing. Reported laparoscopic experience and training level correlated with performance (p standard setting methods to define pass-fail cut points for all 4 AUA BLUS tasks. The 4 AUA BLUS tasks demonstrated good construct validity evidence for use in assessing basic laparoscopic skill. Performance scores using the novel C-SATS platform correlated well with traditional time-consuming methods of assessment. Various standard setting methods were used to develop pass-fail cut points for educators to use when making formative and summative assessments of basic laparoscopic skill. Copyright © 2017 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  16. Assessment of medical communication skills by computer: assessment method and student experiences

    NARCIS (Netherlands)

    Hulsman, R. L.; Mollema, E. D.; Hoos, A. M.; de Haes, J. C. J. M.; Donnison-Speijer, J. D.

    2004-01-01

    BACKGROUND A computer-assisted assessment (CAA) program for communication skills designated ACT was developed using the objective structured video examination (OSVE) format. This method features assessment of cognitive scripts underlying communication behaviour, a broad range of communication

  17. Using Oral Exams to Assess Communication Skills in Business Courses

    Science.gov (United States)

    Burke-Smalley, Lisa A.

    2014-01-01

    Business, like many other fields in higher education, continues to rely largely on conventional testing methods for assessing student learning. In the current article, another evaluation approach--the oral exam--is examined as a means for building and evaluating the professional communication and oral dialogue skills needed and utilized by…

  18. Approaching time is important for assessment of endoscopic surgical skills.

    Science.gov (United States)

    Tokunaga, Masakazu; Egi, Hiroyuki; Hattori, Minoru; Yoshimitsu, Masanori; Sumitani, Daisuke; Kawahara, Tomohiro; Okajima, Masazumi; Ohdan, Hideki

    2012-05-01

    This study aimed to verify whether the approaching time (the time taken to reach the target point from another point, a short distance apart, during point-to-point movement in endoscopic surgery), assessed using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), could distinguish the skill level of surgeons. Expert surgeons (who had performed more than 50 endoscopic surgeries) and novice surgeons (who had no experience in performing endoscopic surgery) were tested using the HUESAD. The approaching time, total time, and intermediate time (total time--approaching time) were measured and analyzed using the trajectory of the tip of the instrument. The approaching time and total time were significantly shorter in the expert group than in the novice group (p time did not significantly differ between the groups (p > 0.05). The approaching time, which is a component of the total time, is very mportant in the measurement of the total time to assess endoscopic surgical skills. Further, the approaching time was useful for skill assessment by the HUESAD for evaluating the skill of surgeons performing endoscopic surgery.

  19. A Longitudinal Study Assessing the Microsoft Office Skills Course

    Science.gov (United States)

    Carpenter, Donald A.; McGinnis, Denise; Slauson, Gayla Jo; Snyder, Johnny

    2013-01-01

    This paper explains a four-year longitudinal study of the assessment process for a Microsoft Office skills course. It examines whether there is an increase in students' knowledge based on responses to pre- and post-surveys that asked students to evaluate how well they can do particular tasks. Classical classroom teaching methods were used in the…

  20. Assessment and treatment of planning skills in adolescents with ADHD

    NARCIS (Netherlands)

    Boyer, B.E.

    2016-01-01

    Planning problems are described to be prominent in the daily lives of adolescents with ADHD (Barkley, 2004) and may cause comorbid conditions and impairments (Safren, 2006). Therefore the central aim of this thesis was to assess planning skills of adolescents with ADHD and to investigate whether

  1. Trait Based Assessment on Teaching Writing Skill for EFL Learners

    Science.gov (United States)

    Asrobi, Maman; Prasetyaningrum, Ari

    2017-01-01

    This study was conducted in order to investigate the effectiveness of trait based assessment on teaching writing skill for EFL learners. Designed as pre-experimental study with one group pretest and posttest design, it examined 20 students of the second semester of English Department of "Hamzanwadi University" in the academic year…

  2. Designing Standardized Patient Assessments to Measure SBIRT Skills

    Science.gov (United States)

    Wamsley, Maria A.; Julian, Katherine A.; O'Sullivan, Patricia; Satterfield, Jason M.; Satre, Derek D.; McCance-Katz, Elinore; Batki, Steven L.

    2013-01-01

    Objectives: Resident physicians report insufficient experience caring for patients with substance use disorders (SUDs). Resident training in Screening, Brief Intervention, and Referral to Treatment (SBIRT) has been recommended. We describe the development of a standardized patient (SP) assessment to measure SBIRT skills, resident perceptions of…

  3. Assessment of Critical Business Skill Development by MBA Alumni

    Science.gov (United States)

    Glynn, Joseph G.; Wood, Gregory R.

    2008-01-01

    Six years of survey data were analyzed to assess, among other things, the degree to which an AACSB accredited graduate business program successfully developed student skills in a variety of areas deemed important for career success. The study illustrates a methodology institutions can use to respond to increasing demands for program evaluation and…

  4. Ophthalmic Skills Assessment of Primary Health Care Workers at ...

    African Journals Online (AJOL)

    Proficiency in the basic ophthalmic skills is a cri cal factor in the effec ve delivery of eye care services at the primary level of care. The aim of the study was to assess the ability of ... out visual acuity test and correctly iden fy cataract and conjunc vi s using pictures of eye condi ons and ..... Medical Laboratory Technician.

  5. The development of aerobic and skill assessment in soccer.

    Science.gov (United States)

    O'Reilly, John; Wong, Stephen H S

    2012-12-01

    Methods of assessing soccer players' performance have developed significantly in recent times. The fitness profiles and skill levels of a prospective elite soccer player is a valuable resource for coaches in the process of identifying talent. Traditional means to measure aerobic fitness have centred on the 'aerobic capacity' or '&OV0312;O(2max)' test (also known as the maximal oxygen consumption test) but, over time, this has been shown not to be a sensitive measure for specific aspects of soccer in a match situation. Therefore, numerous soccer-specific simulations have been designed to re-create exercise patterns similar to those experienced during a match. Some of these studies have yet to be validated, while others have been shown to result in a similar physiological load to that encountered during regular match play. Further developments have led to specifically designed intermittent sprint tests, which are used as a sensitive tool to accurately measure the fluctuations in players' ability both between and within soccer seasons. Testing procedures have also been developed that incorporate elements of both skill and physical ability. Soccer-specific field tests have been designed, incorporating skill and dynamic movements, and this opens up the possibility of teams testing the aerobic capacity of their elite players using soccer-specific movements. Valid studies assessing soccer-specific skills in an ecologically sound environment have been quite rare until recently. Some test protocols have been deemed largely irrelevant to soccer match play, while others have had limited impact on scientific literature. More recently, skill tests have been developed and shown to be valid and reliable methods of assessing soccer skill performance. Many new skill tests continue to be developed, and some have been shown to be highly reliable, but further study of these relatively novel concepts is required before a more solid recommendation can be made. Overall, while significant

  6. Certified Basic Life Support Instructors Assess Cardiopulmonary Resuscitation Skills Poorly

    DEFF Research Database (Denmark)

    Hansen, Camilla; Rasmussen, Stinne E; Kristensen, Mette Amalie

    2016-01-01

    Introduction: High-quality cardiopulmonary resuscitation (CPR) improves survival from cardiac arrest. During basic life support (BLS) training, instructors assess CPR skills to enhance learning outcome. Emergency department staff and senior residents have been shown to assess chest compression...... quality poorly. Currently no studies have evaluated CPR assessment among certified BLS instructors. The aim of this study was to investigate certified BLS instructors’ assessment of chest compressions and rescue breathing.Methods: Data were collected at BLS courses for medical students at Aarhus...... of CPR skills may be beneficial to ensure high-quality learning outcome.Author Disclosures: C. Hansen: None. S.E. Rasmussen: None. M.A. Nebsbjerg: None. M. Stærk: None. B. Løfgren: None....

  7. Does a Rater's Professional Background Influence Communication Skills Assessment?

    Science.gov (United States)

    Artemiou, Elpida; Hecker, Kent G; Adams, Cindy L; Coe, Jason B

    2015-01-01

    There is increasing pressure in veterinary education to teach and assess communication skills, with the Objective Structured Clinical Examination (OSCE) being the most common assessment method. Previous research reveals that raters are a large source of variance in OSCEs. This study focused on examining the effect of raters' professional background as a source of variance when assessing students' communication skills. Twenty-three raters were categorized according to their professional background: clinical sciences (n=11), basic sciences (n=4), clinical communication (n=5), or hospital administrator/clinical skills technicians (n=3). Raters from each professional background were assigned to the same station and assessed the same students during two four-station OSCEs. Students were in year 2 of their pre-clinical program. Repeated-measures ANOVA results showed that OSCE scores awarded by the rater groups differed significantly: (F(matched_station_1) [2,91]=6.97, p=.002), (F(matched_station_2) [3,90]=13.95, p=.001), (F(matched_station_3) [3,90]=8.76, p=.001), and ((Fmatched_station_4) [2,91]=30.60, p=.001). A significant time effect between the two OSCEs was calculated for matched stations 1, 2, and 4, indicating improved student performances. Raters with a clinical communication skills background assigned scores that were significantly lower compared to the other rater groups. Analysis of written feedback provided by the clinical sciences raters showed that they were influenced by the students' clinical knowledge of the case and that they did not rely solely on the communication checklist items. This study shows that it is important to consider rater background both in recruitment and training programs for communication skills' assessment.

  8. A qualitative study of advanced nurse practitioners' use of physical assessment skills in the community: shifting skills across professional boundaries.

    Science.gov (United States)

    Raleigh, Mary; Allan, Helen

    2017-07-01

    To explore multiple perspectives on the use of physical assessment skills by advanced nurse practitioners in the UK. Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by advanced nurse practitioners in the community. Case study. A qualitative interpretative single-embedded case study of 22 participants from South of England. A framework method analysed interview data collected by the researcher between March-August 2013. Participants included nurses, doctors, nurse educators and managers. Physical assessment skills education at universities is part of a policy shift to develop a flexible workforce in the UK. Shared physical assessment practices are less to do with role substitution and more about preparing practitioners with skills that are fit for purpose. Competence, capability and performance with physical assessment skills are an expectation of advanced nursing practice. These skills are used successfully by community advanced nurse practitioners to deliver a wide range of services in response to changing patient need. The introduction of physical assessment skills education to undergraduate professional preparation would create a firm foundation to develop these skills in postgraduate education. Physical assessment education prepares nurses with the clinical competencies to carry out healthcare reforms in the UK. Shared sets of clinical assessment competencies between disciplines have better outcomes for patients. Levels of assessment competence can depend on the professional attributes of individual practitioners. Unsupportive learning cultures can hinder professional development of advanced nursing practice. © 2016 John Wiley & Sons Ltd.

  9. Structured assessment of microsurgery skills in the clinical setting.

    Science.gov (United States)

    Chan, WoanYi; Niranjan, Niri; Ramakrishnan, Venkat

    2010-08-01

    Microsurgery is an essential component in plastic surgery training. Competence has become an important issue in current surgical practice and training. The complexity of microsurgery requires detailed assessment and feedback on skills components. This article proposes a method of Structured Assessment of Microsurgery Skills (SAMS) in a clinical setting. Three types of assessment (i.e., modified Global Rating Score, errors list and summative rating) were incorporated to develop the SAMS method. Clinical anastomoses were recorded on videos using a digital microscope system and were rated by three consultants independently and in a blinded fashion. Fifteen clinical cases of microvascular anastomoses performed by trainees and a consultant microsurgeon were assessed using SAMS. The consultant had consistently the highest scores. Construct validity was also demonstrated by improvement of SAMS scores of microsurgery trainees. The overall inter-rater reliability was strong (alpha=0.78). The SAMS method provides both formative and summative assessment of microsurgery skills. It is demonstrated to be a valid, reliable and feasible assessment tool of operating room performance to provide systematic and comprehensive feedback as part of the learning cycle. Copyright 2009 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

  10. Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

    Science.gov (United States)

    Schmidt, Jessica N; Kendall, John; Smalley, Courtney

    2015-11-01

    Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.

  11. Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.

    Science.gov (United States)

    Guru, Khurshid A; Esfahani, Ehsan T; Raza, Syed J; Bhat, Rohit; Wang, Katy; Hammond, Yana; Wilding, Gregory; Peabody, James O; Chowriappa, Ashirwad J

    2015-01-01

    To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons. In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics. Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups. Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS. © 2014 The Authors. BJU International © 2014 BJU International.

  12. Assessing family planning service-delivery skills in Kenya.

    Science.gov (United States)

    Valadez, J J; Transgrud, R; Mbugua, M; Smith, T

    1997-06-01

    This report demonstrates the use of Lot Quality Assurance Sampling (LQAS) to evaluate the technical competence of two cohorts of family planning service providers in Kenya trained with a new curriculum. One cohort had just finished training within two months of the study. The other cohort was the first group trained with the new curriculum about one year before the study. LQAS was adapted from industrial and other public health applications to assess both the individual competence of 30 service providers and the competence of each cohort. Results show that Cohorts One and Two did not differ markedly in the number of tasks needing improvement. However, both cohorts exhibited more tasks needing improvement in counseling skills as compared with physical examination skills or with all other skills. Care-givers who were not currently providing services accounted for most service-delivery problems. This result suggests that providers' use of their skills explains their ability to retain service-delivery skills learned in training to a greater degree than does the amount of time elapsed since they were trained. LQAS proved to be a rapid, easy-to-use empirical method for management decisionmaking for improvement of a family planning training curriculum and services.

  13. Implementing and Evaluating a National Certification Technical Skills Examination: The Colorectal Objective Structured Assessment of Technical Skill.

    Science.gov (United States)

    de Montbrun, Sandra; Roberts, Patricia L; Satterthwaite, Lisa; MacRae, Helen

    2016-07-01

    To implement the Colorectal Objective Structured Assessment of Technical skill (COSATS) into American Board of Colon and Rectal Surgery (ABCRS) certification and build evidence of validity for the interpretation of the scores of this high stakes assessment tool. Currently, technical skill assessment is not a formal component of board certification. With the technical demands of surgical specialties, documenting competence in technical skill at the time of certification with a valid tool is ideal. In September 2014, the COSATS was a mandatory component of ABCRS certification. Seventy candidates took the examination, with their performance evaluated by expert colorectal surgeons using a task-specific checklist, global rating scale, and overall performance scale. Passing scores were set and compared using 2 standard setting methodologies, using a compensatory and conjunctive model. Inter-rater reliability and the reliability of the pass/fail decision were calculated using Cronbach alpha and Subkoviak methodology, respectively. Overall COSATS scores and pass/fail status were compared with results on the ABCRS oral examination. The pass rate ranged from 85.7% to 90%. Inter-rater reliability (0.85) and reliability of the pass/fail decision (0.87 and 0.84) were high. A low positive correlation (r= 0.25) was seen between the COSATS and oral examination. All individuals who failed the COSATS passed the ABCRS oral examination. COSATS is the first technical skill examination used in national surgical board certification. This study suggests that the current certification process may be failing to identify individuals who have demonstrated technical deficiencies on this standardized assessment tool.

  14. Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

    Science.gov (United States)

    Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

    2016-07-01

    To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

  15. Brief Report: Suitability of the Social Skills Performance Assessment (SSPA) for the Assessment of Social Skills in Adults with Autism Spectrum Disorders

    Science.gov (United States)

    Verhoeven, E. W. M.; Smeekens, I.; Didden, R.

    2013-01-01

    The present study aims at examining whether the "Social Skills Performance Assessment" (SSPA; Patterson et al. in "Schizophr Res" 48(2-3):351-360, 2001) is a suitable performance-based measure to assess social skills in adults with autism spectrum disorders (ASD). For this purpose, social skills of individuals with ASD and…

  16. Impact of teaching and assessment format on electrocardiogram interpretation skills.

    Science.gov (United States)

    Raupach, Tobias; Hanneforth, Nathalie; Anders, Sven; Pukrop, Tobias; Th J ten Cate, Olle; Harendza, Sigrid

    2010-07-01

    Interpretation of the electrocardiogram (ECG) is a core clinical skill that should be developed in undergraduate medical education. This study assessed whether small-group peer teaching is more effective than lectures in enhancing medical students' ECG interpretation skills. In addition, the impact of assessment format on study outcome was analysed. Two consecutive cohorts of Year 4 medical students (n=335) were randomised to receive either traditional ECG lectures or the same amount of small-group, near-peer teaching during a 6-week cardiorespiratory course. Before and after the course, written assessments of ECG interpretation skills were undertaken. Whereas this final assessment yielded a considerable amount of credit points for students in the first cohort, it was merely formative in nature for the second cohort. An unannounced retention test was applied 8 weeks after the end of the cardiovascular course. A significant advantage of near-peer teaching over lectures (effect size 0.33) was noted only in the second cohort, whereas, in the setting of a summative assessment, both teaching formats appeared to be equally effective. A summative instead of a formative assessment doubled the performance increase (Cohen's d 4.9 versus 2.4), mitigating any difference between teaching formats. Within the second cohort, the significant difference between the two teaching formats was maintained in the retention test (p=0.017). However, in both cohorts, a significant decrease in student performance was detected during the 8 weeks following the cardiovascular course. Assessment format appeared to be more powerful than choice of instructional method in enhancing student learning. The effect observed in the second cohort was masked by an overriding incentive generated by the summative assessment in the first cohort. This masking effect should be considered in studies assessing the effectiveness of different teaching methods.

  17. Haptic feedback can provide an objective assessment of arthroscopic skills.

    Science.gov (United States)

    Chami, George; Ward, James W; Phillips, Roger; Sherman, Kevin P

    2008-04-01

    The outcome of arthroscopic procedures is related to the surgeon's skills in arthroscopy. Currently, evaluation of such skills relies on direct observation by a surgeon trainer. This type of assessment, by its nature, is subjective and time-consuming. The aim of our study was to identify whether haptic information generated from arthroscopic tools could distinguish between skilled and less skilled surgeons. A standard arthroscopic probe was fitted with a force/torque sensor. The probe was used by five surgeons with different levels of experience in knee arthroscopy performing 11 different tasks in 10 standard knee arthroscopies. The force/torque data from the hand and tool interface were recorded and synchronized with a video recording of the procedure. The torque magnitude and patterns generated were analyzed and compared. A computerized system was used to analyze the force/torque signature based on general principles for quality of performance using such measures as economy in movement, time efficiency, and consistency in performance. The results showed a considerable correlation between three haptic parameters and the surgeon's experience, which could be used in an automated objective assessment system for arthroscopic surgery. Level II, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.

  18. A qualitative study of advanced nurse practitioners’ use of physical assessment skills in the community: shifting skills across professional boundaries

    OpenAIRE

    Raleigh, Mary; Allan, Helen T.

    2017-01-01

    Aim\\ud To explore multiple perspectives on the use of physical assessment skills by Advanced Nurse Practitioners in the UK\\ud Background \\ud Physical assessment skills practices are embedded in advanced nursing practice roles in the UK. There is little evidence on how these skills are used by Advanced Nurse Practitioners' on the community.\\ud Design \\ud Case study\\ud Methodology and methods. \\ud A qualitative interpretative single-embedded case study of 22 participants from South of England. ...

  19. Comparison between young male drivers' self-assessed and objectively measured driving skills

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Self-assessment of skills is a self-generated feedback process that contributes to confidence in one's skills. The higher one's self-assessed skills, the more likely one is to feel competent a particular domain thereby influencing the related behaviors. Drivers' self-assessed driving skills...... are not always accurate, which may cause serious problems such as underestimation of risk, reckless driving and accidents. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aim of this study was to test the accuracy...

  20. Instructional Model and Thinking Skill in Chemistry Class

    Science.gov (United States)

    Langkudi, H. H.

    2018-02-01

    Chemistry course are considered a difficult lesson for students as evidenced by low learning outcomes on daily tests, mid-semester tests as well as final semester tests. This research intended to investigate the effect of instructional model, thinking skill and the interaction of these variables on students’ achievement in chemistry. Experimental method was applying used 2 x 2 factorial design. The results showed that the use of instructional model with thinking skill influences student’s learning outcomes, so that the chemistry teacher is recommended to pay attention to the learning model, and adjusted to the student’s skill thinking on the chemistry material being taught. The conclusion of this research is that discovery model is suitable for students who have formal thinking skill and conventional model is fit for the students that have concrete thinking skill.

  1. Using the Interpersonal Skills tool to assess interpersonal skills of internationally educated nurses.

    Science.gov (United States)

    Shen, Jay J; Xu, Yu; Staples, Shelley; Bolstad, Anne L

    2014-07-01

    To assess interpersonal skills of internationally educated nurses (IEN) while interacting with standardized patients. Participants included 52 IEN at two community hospitals in the southwestern region of the USA. Standardized patients were used to create patient-nurse encounter. Seventeen items in four domains ("skills in interviewing and collecting information"; "skills in counseling and delivering information"; "rapport"; and "personal manner") in an Interpersonal Skills (IPS) instrument were measured by a Likert scale 1-4 with 4 indicating the best performance. The average composite score per domain and scores of the 17 items were compared across the domains. On 10 of the 17 items, the nurses received scores under 3. Counseling with an average score of 2.10 and closure with an average score of 2.44 in domain 2, small talk with an average score of 2.06 in domain 3, and physical exam with average score of 2.21 in domain 4 were below 2.5. The average composite score of domain 1 was 3.54, significantly higher than those of domains 2-4 (2.77, 2.81, and 2.71, respectively). Age was moderately related to the average score per domain with every 10 year increase in age resulting in a 0.1 increase in the average score. Sex and country of origin showed mixed results. The interpersonal skills of IEN in three of the four domains need improvement. Well-designed educational programs may facilitate the improvement, especially in areas of small talk, counseling, closure, and physical exam. Future research should examine relationships between the IPS and demographics factors. © 2013 The Authors. Japan Journal of Nursing Science © 2013 Japan Academy of Nursing Science.

  2. A Two-Stage Multi-Agent Based Assessment Approach to Enhance Students' Learning Motivation through Negotiated Skills Assessment

    Science.gov (United States)

    Chadli, Abdelhafid; Bendella, Fatima; Tranvouez, Erwan

    2015-01-01

    In this paper we present an Agent-based evaluation approach in a context of Multi-agent simulation learning systems. Our evaluation model is based on a two stage assessment approach: (1) a Distributed skill evaluation combining agents and fuzzy sets theory; and (2) a Negotiation based evaluation of students' performance during a training…

  3. Models for Delivering Written Business Communication Skills: Improving the Process

    Science.gov (United States)

    Penrod, Catherine B.; Tucker, Mary; Hartman, Katherine B.

    2017-01-01

    Employers, higher education faculty, and accrediting bodies value communication as an important entry-level job skill. Unfortunately, research indicates that college graduates have inadequate communication skills and, in particular, lack strong business writing acumen. The ways business communication is taught, integrated, and assessed varies by…

  4. The Differential Effects of Task Complexity on Domain-Specific and Peer Assessment Skills

    Science.gov (United States)

    van Zundert, Marjo J.; Sluijsmans, Dominique M. A.; Konings, Karen D.; van Merrienboer, Jeroen J. G.

    2012-01-01

    In this study the relationship between domain-specific skills and peer assessment skills as a function of task complexity is investigated. We hypothesised that peer assessment skills were superposed on domain-specific skills and will therefore suffer more when higher cognitive load is induced by increased task complexity. In a mixed factorial…

  5. 21st Century Skills: What Are They and How Do We Assess Them?

    Science.gov (United States)

    Geisinger, Kurt F.

    2016-01-01

    One of the "hottest" topics in the educational measurement community in the past decade has been the assessment of 21st century skills. This special issue demonstrates work being performed in this realm. The present article provides a context for the four primary articles that follow and a brief but broad view of some models of 21st…

  6. Preliminary Analysis of Assessment Instrument Design to Reveal Science Generic Skill and Chemistry Literacy

    Science.gov (United States)

    Sumarni, Woro; Sudarmin; Supartono, Wiyanto

    2016-01-01

    The purpose of this research is to design assessment instrument to evaluate science generic skill (SGS) achievement and chemistry literacy in ethnoscience-integrated chemistry learning. The steps of tool designing refers to Plomp models including 1) Investigation Phase (Prelimenary Investigation); 2) Designing Phase (Design); 3)…

  7. Development of Authentic Assessment instruments for Critical Thinking skills in Global Warming with a Scientific Approach

    Directory of Open Access Journals (Sweden)

    R. Surya Damayanti

    2017-12-01

    Full Text Available This study aims to develop an authentic assessment instrument to measure critical thinking skills in global warming learning and to describe the suitability, easiness, and usefulness of the use instruments which are developed base on the teacher’s opinion.   The development design is carried out by Borg & Gall (2003 development model, which is conducted with seven stages: information gathering stage, planning stage, product development stage, product test stage, product revision stage, field trial stage, and final product. The test subjects are students and teachers in SMA Lampung Tengah by using purposive sampling technique.  Global warming learning using authentic assessment consists of a series of learning activities, including observing, discussing, exploring, associating and communicating.  The results show the authentic assessment techniques global warming to measure and cultivate critical thinking skills consisting of written tests, performance, portfolios, projects, and attitudes.  The developed assessment model meets content and constructs validity, and effectively improves students' critical thinking skills and has a high level of suitability, easiness, and usefulness well-being. The assessment techniques are used in global warming learning are performance assessment techniques, portfolios, projects, products, and attitude that together contribute to the improvement of critical thinking skills on 97,4% of global warming learning.

  8. Evaluating structured assessment of anaesthesiologists' non-technical skills

    DEFF Research Database (Denmark)

    Jepsen, R M H G; Dieckmann, P; Spanager, L

    2016-01-01

    BACKGROUND: Non-technical skills (NTS) are essential for safe and efficient anaesthesia. Assessment instruments with appropriate validity evidence can be used to ensure that anaesthesiologists possess the NTS necessary to deliver high-standard patient care. The aims were to collect validity...... evidence using a contemporary validity framework for the assessment instrument Anaesthesiologists' Non-Technical Skills in Denmark (ANTSdk) regarding response process and internal structure (including reliability), and to investigate the effect of rater training on these properties. METHODS: An explorative...... study was undertaken at the Danish Institute for Medical Simulation, Copenhagen, Denmark. In a 1-day session, using ANTSdk, a convenience sample of 19 anaesthesiologists rated trainee anaesthesiologists' NTS in nine video-recorded simulation scenarios before and after a 3-h training session. RESULTS...

  9. Parent assessment of medical student skills in ambulatory pediatrics

    OpenAIRE

    Erika Persson; Christina Haines; Mia Lang

    2013-01-01

    Background: Partnership with parents is a vital part of pediatric medical education, yet few studies have examined parent attitudes towards learners in pediatric settings. Methods: Questionnaires were used to determine parent and student assessment of professional and clinical skills (primary outcome) and parent attitudes towards 3rd year medical students (secondary outcome) at the University of Alberta. Chi Square, Kendall’s Tau and Kappa coefficients were calculated to compare parent an...

  10. Rubric Assessment on Science and Creative Thinking Skills of Students

    Science.gov (United States)

    Ratnasusanti, H.; Ana, A.; Nurafiati, P.; Umusyaadah, L.

    2018-02-01

    The result of the monitoring and evaluation of the latest Indonesian curriculum (the 2013 curriculum) implementation at junior high school level year of 2014 showed that one of the difficult things that learners had in implementation 2013 curriculum is doing the result. The characteristic of applying the 2013 curriculum is to emphasize the modern pedagogic dimension of learning, which is using scientific approach, which requires learners to have highlevel thinking skills, one of which is creative thinking skills. The aims of this research is to implement performance assessment in measuring the creative thinking of junior high school students on subject Prakarya. The form of the main performance assessment is the task and assessment criteria. The experimental method that been used is the Quasi Experiment with Non-Equivalent Design Group Research. Population in this study is the students of VIII class of junior high school in Bandung, Indonesia which consists of six classes. And two classes are selected for the sample from that six classes and VIII A class were chosen, while VIII F class has been chosen as control class. The result of this research showed that the rubics of performance assessment can be measure or identify the creative thinking skill, its prove by the result of pre-test dan post-test are more dominant. In material of identification student’s creative thinking skills are reached an average 85 compare 79 with the control class. while in the presentation the experimental class got an average of 85 bigger than the control class which only reached 79.

  11. Patients' assessment of professionalism and communication skills of medical graduates.

    Science.gov (United States)

    Abadel, Fatima T; Hattab, Abdulla S

    2014-02-11

    Professionalism and communication skills constitute important components of the integral formation of physicians which has repercussion on the quality of health care and medical education. The objective of this study was to assess medical graduates' professionalism and communication skills from the patients' perspective and to examine its association with patients' socio-demographic variables. This is a hospital based cross-sectional study. It involved 315 patients and 105 medical graduates selected by convenient sampling method. A modified and validated version of the American Board of Internal Medicine's (ABIM) Patient Assessment survey questionnaire was used for data collection through a face to face interview. Data processing and analysis were performed using the Statistical Package for Social Science (SPSS) 16.0. Mean, frequency distribution, and percentage of the variables were calculated. A non-parametric Kruskal Wallis test was applied to verify whether the patients' assessment was influenced by variables such as age, gender, education, at a level of significance, p ≤ 0.05. Female patients constituted 46% of the sample, whereas males constituted 54%. The mean age was 36 ± 16. Patients' scoring of the graduate's skills ranged from 3.29 to 3.83 with a mean of 3.64 on a five-point Likert scale. Items assessing the "patient involvement in decision-making" were assigned the minimum mean values, while items dealing with "establishing adequate communication with patient" assigned the maximum mean values. Patients, who were older than 45 years, gave higher scores than younger ones (p communication skills at a good level. Patients' age and educational level were significantly associated with the rating level.

  12. Retrospectively Assessed Early Motor and Current Pragmatic Language Skills in Autistic and Neurotypical Children.

    Science.gov (United States)

    Stevenson, Jennifer L; Lindley, Caitlin E; Murlo, Nicole

    2017-08-01

    Autistic individuals often struggle developmentally, even in areas that are not explicit diagnostic criteria, such as motor skills. This study explored the relation between early motor skills, assessed retrospectively, and current pragmatic language skills. Caregivers of neurotypical and autistic children, matched on gender and age, completed assessments of their child's early motor development and current language abilities. Early motor skills were correlated with later pragmatic language skills, and autistic children exhibited fewer motor skills than neurotypical children. In fact, motor skills were a better predictor of an autism spectrum diagnosis than were scores on a measure of current pragmatic language. These results highlight the important role of motor skills in autism spectrum disorders.

  13. Energy-Based Metrics for Arthroscopic Skills Assessment.

    Science.gov (United States)

    Poursartip, Behnaz; LeBel, Marie-Eve; McCracken, Laura C; Escoto, Abelardo; Patel, Rajni V; Naish, Michael D; Trejos, Ana Luisa

    2017-08-05

    Minimally invasive skills assessment methods are essential in developing efficient surgical simulators and implementing consistent skills evaluation. Although numerous methods have been investigated in the literature, there is still a need to further improve the accuracy of surgical skills assessment. Energy expenditure can be an indication of motor skills proficiency. The goals of this study are to develop objective metrics based on energy expenditure, normalize these metrics, and investigate classifying trainees using these metrics. To this end, different forms of energy consisting of mechanical energy and work were considered and their values were divided by the related value of an ideal performance to develop normalized metrics. These metrics were used as inputs for various machine learning algorithms including support vector machines (SVM) and neural networks (NNs) for classification. The accuracy of the combination of the normalized energy-based metrics with these classifiers was evaluated through a leave-one-subject-out cross-validation. The proposed method was validated using 26 subjects at two experience levels (novices and experts) in three arthroscopic tasks. The results showed that there are statistically significant differences between novices and experts for almost all of the normalized energy-based metrics. The accuracy of classification using SVM and NN methods was between 70% and 95% for the various tasks. The results show that the normalized energy-based metrics and their combination with SVM and NN classifiers are capable of providing accurate classification of trainees. The assessment method proposed in this study can enhance surgical training by providing appropriate feedback to trainees about their level of expertise and can be used in the evaluation of proficiency.

  14. An Assessment of the Skill of GEOS-5 Seasonal Forecasts

    Science.gov (United States)

    Ham, Yoo-Geun; Schubert, Siegfried D.; Rienecker, Michele M.

    2013-01-01

    The seasonal forecast skill of the NASA Global Modeling and Assimilation Office coupled global climate model (CGCM) is evaluated based on an ensemble of 9-month lead forecasts for the period 1993 to 2010. The results from the current version (V2) of the CGCM consisting of the GEOS-5 AGM coupled to the MOM4 ocean model are compared with those from an earlier version (V1) in which the AGCM (the NSIPP model) was coupled to the Poseidon Ocean Model. It was found that the correlation skill of the Sea Surface Temperature (SST) forecasts is generally better in V2, especially over the sub-tropical and tropical central and eastern Pacific, Atlantic, and Indian Ocean. Furthermore, the improvement in skill in V2 mainly comes from better forecasts of the developing phase of ENSO from boreal spring to summer. The skill of ENSO forecasts initiated during the boreal winter season, however, shows no improvement in terms of correlation skill, and is in fact slightly worse in terms of root mean square error (RMSE). The degradation of skill is found to be due to an excessive ENSO amplitude. For V1, the ENSO amplitude is too strong in forecasts starting in boreal spring and summer, which causes large RMSE in the forecast. For V2, the ENSO amplitude is slightly stronger than that in observations and V1 for forecasts starting in boreal winter season. An analysis of the terms in the SST tendency equation, shows that this is mainly due to an excessive zonal advective feedback. In addition, V2 forecasts that are initiated during boreal winter season, exhibit a slower phase transition of El Nino, which is consistent with larger amplitude of ENSO after the ENSO peak season. It is found that this is due to weak discharge of equatorial Warm Water Volume (WWV). In both observations and V1, the discharge of equatorial WWV leads the equatorial geostrophic easterly current so as to damp the El Nino starting in January. This process is delayed by about 2 months in V2 due to the slower phase

  15. The perceived impact of the group practice model on enhancing interpersonal skills of predoctoral dental students.

    Science.gov (United States)

    Errante, Margaret R; Gill, Gurjinder S; Rodriguez, Tobias E

    2018-01-01

    The purpose of this study was to assess if a clinical group practice model has an impact on enhancing the interpersonal skills of predoctoral dental students, what factors may influence the development of these skills, and what, if any, are innovative and technological solutions that can potentially influence interpersonal skills in predoctoral dental students. This study surveyed the faculty responsible for teaching the dental students in a recently developed group practice model. Out of 18 eligible group practice leaders at one US dental school, 17 respondents (94.4%) completed the survey. In addition, this study asked the faculty to provide qualitative response and recommendations to improve interpersonal skills. Based on the feedback, a focus group was conducted to explore opportunities to further enhance the skills. The results of the study suggest that the group practice model has a positive and distinct impact on the development of overall interpersonal skills for students. Further research suggests that the greatest impacted areas of personal development are critical thinking skills and teamwork. However, as a way to make the model more effectual, most faculty suggested the need for additional time, for both students and faculty. To some extent, using technology and innovative teaching pedagogies could potentially address the challenge of limited time. Based on the results of the survey, one may conclude that with adequate design and conditions, the group practice model can have a positive effect on the interpersonal skills of its students.

  16. The perceived impact of the group practice model on enhancing interpersonal skills of predoctoral dental students

    Science.gov (United States)

    Errante, Margaret R; Gill, Gurjinder S; Rodriguez, Tobias E

    2018-01-01

    Purpose The purpose of this study was to assess if a clinical group practice model has an impact on enhancing the interpersonal skills of predoctoral dental students, what factors may influence the development of these skills, and what, if any, are innovative and technological solutions that can potentially influence interpersonal skills in predoctoral dental students. Methods This study surveyed the faculty responsible for teaching the dental students in a recently developed group practice model. Out of 18 eligible group practice leaders at one US dental school, 17 respondents (94.4%) completed the survey. In addition, this study asked the faculty to provide qualitative response and recommendations to improve interpersonal skills. Based on the feedback, a focus group was conducted to explore opportunities to further enhance the skills. Results The results of the study suggest that the group practice model has a positive and distinct impact on the development of overall interpersonal skills for students. Further research suggests that the greatest impacted areas of personal development are critical thinking skills and teamwork. However, as a way to make the model more effectual, most faculty suggested the need for additional time, for both students and faculty. To some extent, using technology and innovative teaching pedagogies could potentially address the challenge of limited time. Conclusion Based on the results of the survey, one may conclude that with adequate design and conditions, the group practice model can have a positive effect on the interpersonal skills of its students. PMID:29720884

  17. Parent assessment of medical student skills in ambulatory pediatrics

    Directory of Open Access Journals (Sweden)

    Erika Persson

    2013-09-01

    Full Text Available Background: Partnership with parents is a vital part of pediatric medical education, yet few studies have examined parent attitudes towards learners in pediatric settings. Methods: Questionnaires were used to determine parent and student assessment of professional and clinical skills (primary outcome and parent attitudes towards 3rd year medical students (secondary outcome at the University of Alberta. Chi Square, Kendall’s Tau and Kappa coefficients were calculated to compare parent and student responses in 8 areas: communication, respect, knowledge, listening, history taking, physical examination, supervision, and overall satisfaction. Results: Overall satisfaction with medical student involvement by parents was high: 56.7% of all parents ranked the encounter as ‘excellent’. Areas of lesser satisfaction included physician supervision of students. Compared to the parent assessment, students tended to underrate many of their skills, including communication, history taking and physical exam. There was no relationship between parent demographics and their attitude to rating any of the students’ skills. Conclusions: Parents were satisfied with medical student involvement in the care of their children. Areas identified for improvement included increased supervision of students in both history taking and physical examination. This is one of the largest studies examining parent attitudes towards pediatric students. The results may enhance undergraduate curriculum development and teaching in pediatric ambulatory clinics and strengthen the ongoing partnership between the community and teaching clinics.

  18. The Assessment of Comunication and Interaction Skills in Psychotic Patiens

    Directory of Open Access Journals (Sweden)

    Katayoun Khoushabi

    2002-10-01

    Full Text Available Objective: The main objective at study was to assess the communication and interaction of psychotic patient above age of 18 in 2000. Materials & Methods: The study sample consist of 80 psychotic patients (38 female and 42 male from Razi and Imam Hossein Hospital and Raad and Sina outpatient clinic, selected based on occupational therapist using the Assessment of Communication and Interaction Skills Questionnaire (ACIS. Statistical analyses of information have done by spearman coefficient correlation, Mann Whitney and Wilcoxon tests. Results: Spearman of correlation, mann-and wilcoxon Findings indicate: 1-The average grade of ACIS test in the group of schizophrenic patients were significantly lower than the group schizoaffective patients (P<0.00l. 2-The average of ACIS test in the group of inpatient was lower than the group of outpatient (p<0.00l. 3-No significant difference was found for the average grade of ACIS test in the group of male & female. Conclusion: The obtained results show the weakness of communication and interaction skills in schizophrenic patient and also inpatients. The obtained results of this investigation give useful information about the communication and interaction skill of patient to the occupational therapists but application of this instrument needs more studies.

  19. The Effects of Performance-Based Assessment Criteria on Student Performance and Self-Assessment Skills

    Science.gov (United States)

    Fastre, Greet Mia Jos; van der Klink, Marcel R.; van Merrienboer, Jeroen J. G.

    2010-01-01

    This study investigated the effect of performance-based versus competence-based assessment criteria on task performance and self-assessment skills among 39 novice secondary vocational education students in the domain of nursing and care. In a performance-based assessment group students are provided with a preset list of performance-based…

  20. The assessment of social skills deficits in the elderly.

    Science.gov (United States)

    Furnham, A; Pendleton, D

    1983-01-01

    This paper tested the hypothesis that a sample of elderly people compared to a matched sample of younger people reports an increase in difficulty and social anxiety in dealing with a wide range of everyday social situations. The literature on assertiveness and social skills training with the elderly was first reviewed. Then an assertiveness and social difficulty scale was administered to a group of eighty participants divided by age and sex. It was found that older people experienced less discomfort in situations requiring assertiveness, yet were less likely to respond assertively. Older people reported higher incidence of social anxiety across forty everyday situations. In general females reported more difficulty than males, though there were no interaction effects. The results are discussed in terms of the assessment and training of social skills in the elderly.

  1. The effectiveness of the Geritalk communication skills course: a real-time assessment of skill acquisition and deliberate practice.

    Science.gov (United States)

    Gelfman, Laura P; Lindenberger, Elizabeth; Fernandez, Helen; Goldberg, Gabrielle R; Lim, Betty B; Litrivis, Evgenia; O'Neill, Lynn; Smith, Cardinale B; Kelley, Amy S

    2014-10-01

    Communication skills are critical in Geriatrics and Palliative Medicine because these patients confront complex clinical scenarios. We evaluated the effectiveness of the Geritalk communication skills course by comparing pre- and post-course real-time assessment of the participants leading family meetings. We also evaluated the participants' sustained skills practice. We compare the participants' skill acquisition before and after Geritalk using a direct observation Family Meeting Communication Assessment Tool and assess their deliberate practice at follow-up. First-year Geriatrics or Palliative Medicine fellows at Mount Sinai Medical Center and the James J. Peters Bronx VA Medical Center participated in Geritalk. Pre- and post-course family meeting assessments were compared. An average net gain of 6.8 skills represented a greater than 20% improvement in use of applicable skills. At two month follow-up, most participants reported deliberate practice of fundamental and advanced skills. This intensive training and family meeting assessment offers evidence-based communication skills training. Published by Elsevier Inc.

  2. Feedback Simulation for Acupressure Training and Skill Assessment.

    Science.gov (United States)

    Noll, Eric; Romeiser, Jamie; Shodhan, Shivam; Madariaga, Maria Cecilia; Guo, Xiaojun; Rizwan, Sabeen; Al-Bizri, Ehab; Bennett-Guerrero, Elliott

    2017-08-01

    Previous acupressure studies have yielded varying results. This could be due to differences in the amount of pressure applied to the acupressure point (acupoint) by study personnel within a study as well as between studies. Standardizing the level of pressure applied at an acupoint could improve clinical care and future research. As part of an ongoing randomized clinical trial of postoperative acupressure, five trainees were asked to perform 2 minutes of acupressure and light touch sessions on a simulator. The applied weight was recorded every minute. Individual skill assessment was performed using cumulative sum analysis. Six pretraining and 20 posttraining measurements in each acupressure and light touch group were compared with an expert's simulation values. Before training (baseline), there was significant difference in applied weight (grams) between the expert [5705 (636)] and five trainees [2998 (798), P = 0.004]. Four of the five trainees crossed the lower decision limit assessing proficiency in the acupressure group, and all five trainees were successful in the light touch group. The trainees' average number of measurements needed to cross the lower decision limit (H0), that is, defining that an individual failure rate does not statistically differ from the acceptable failure rate, was 21.3 measurements for acupressure. After this feedback simulation, trainees' scores showed no significant difference (P > 0.05) when assessed against the expert. Feedback simulation for acupressure training and skill assessment, evaluated by cumulative sum analysis, may help in improving the standardization of acupressure therapy performed during clinical practice or research.

  3. Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

    Science.gov (United States)

    Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

    2016-11-01

    To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

  4. Assessment Training Effects on Student Assessment Skills and Task Performance in a Technology-Facilitated Peer Assessment

    Science.gov (United States)

    Liu, Xiongyi; Li, Lan

    2014-01-01

    This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the…

  5. Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills.

    Science.gov (United States)

    Gustin, Jillian L; Way, David P; Wells-Di Gregorio, Sharla; McCallister, Jennifer W

    2016-08-01

    Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings. We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC. We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity. Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC

  6. Interpersonal Skills in MBA Admissions: How Are They Conceptualized and Assessed?

    Science.gov (United States)

    Beenen, Gerard; Pichler, Shaun; Davoudpour, Shahin

    2018-01-01

    Employers and students concur that soft skills or interpersonal skills are critical to managerial success, yet we know little about how MBA program admissions professionals conceptualize and assess these skills in the context of global management education. Such practices have key implications for interpersonal skills curriculum and training in…

  7. Multi-Institutional Validation of an OSATS for the Assessment of Cystoscopic and Ureteroscopic Skills.

    Science.gov (United States)

    Argun, Omer Burak; Chrouser, Kristin; Chauhan, Sanket; Monga, Manoj; Knudsen, Bodo; Box, Geoffrey N; Lee, David I; Gettman, Matthew T; Poniatowski, Lauren H; Wang, Qi; Reihsen, Troy E; Sweet, Robert M

    2015-10-01

    We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  8. Skills development programme: The UNISA/CSIR model

    CSIR Research Space (South Africa)

    Sparrow, RW

    2010-09-01

    Full Text Available development programmes and industry. A key component will be the use of Information Learning Technology. The skills development programmes are vocational and centred on research and industrial requirements. This programme is modelled on vocational...

  9. Reliable and valid assessment of Lichtenstein hernia repair skills.

    Science.gov (United States)

    Carlsen, C G; Lindorff-Larsen, K; Funch-Jensen, P; Lund, L; Charles, P; Konge, L

    2014-08-01

    Lichtenstein hernia repair is a common surgical procedure and one of the first procedures performed by a surgical trainee. However, formal assessment tools developed for this procedure are few and sparsely validated. The aim of this study was to determine the reliability and validity of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. The internal consistency of the items was high (Cronbach's alpha = 0.97). The inter-rater reliability was very good with an intra-class correlation coefficient (ICC) = 0.93. Generalizability analysis showed a coefficient above 0.8 even with one rater. The coefficient improved to 0.92 if three raters were used. One-way analysis of variance found a significant difference between the three groups which indicates construct validity, p fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment of trainees performing Lichtenstein hernia repair to ensure that the objectives of competency-based surgical training are met.

  10. Assessing interpersonal and communication skills in emergency medicine.

    Science.gov (United States)

    Chan, Teresa M; Wallner, Clare; Swoboda, Thomas K; Leone, Katrina A; Kessler, Chad

    2012-12-01

    Interpersonal and communication skills (ICS) are a key component of several competency-based schemata and key competency in the set of six Accreditation Council for Graduate Medical Education (ACGME) core competencies. With the shift toward a competency-based educational framework, the importance of robust learner assessment becomes paramount. The journal Academic Emergency Medicine (AEM) hosted a consensus conference to discuss education research in emergency medicine (EM). This article summarizes the initial preparatory research that was conducted to brief consensus conference attendees and reports the results of the consensus conference breakout session as it pertains to ICS assessment of learners. The goals of this consensus conference session were to twofold: 1) to determine the state of assessment of observable learner performance and 2) to determine a research agenda within the ICS field for medical educators. The working group identified six key recommendations for medical educators and researchers. © 2012 by the Society for Academic Emergency Medicine.

  11. Nonspecialist Raters Can Provide Reliable Assessments of Procedural Skills

    DEFF Research Database (Denmark)

    Mahmood, Oria; Dagnæs, Julia; Bube, Sarah

    2018-01-01

    was significant (p Pearson's correlation of 0.77 for the nonspecialists and 0.75 for the specialists. The test-retest reliability showed the biggest difference between the 2 groups, 0.59 and 0.38 for the nonspecialist raters and the specialist raters, respectively (p ... was chosen as it is a simple procedural skill that is crucial to master in a resident urology program. RESULTS: The internal consistency of assessments was high, Cronbach's α = 0.93 and 0.95 for nonspecialist and specialist raters, respectively (p correlations). The interrater reliability...

  12. Are We Teaching Them Anything?: A Model for Measuring Methodology Skills in the Political Science Major

    Science.gov (United States)

    Siver, Christi; Greenfest, Seth W.; Haeg, G. Claire

    2016-01-01

    While the literature emphasizes the importance of teaching political science students methods skills, there currently exists little guidance for how to assess student learning over the course of their time in the major. To address this gap, we develop a model set of assessment tools that may be adopted and adapted by political science departments…

  13. Comparing the self-assessed and examiner-assessed driving skills of Japanese driving school students

    Directory of Open Access Journals (Sweden)

    Hiroshi Nakai

    2012-03-01

    A sample of Japanese driving test candidates (n=2021 completed a self-assessment using a 5-point scale applied to 19 items. The candidates completed the assessment shortly after passing their practical driving test conducted at a driving school. Their performance was also assessed by an examiner who used the same scale. The comparison between self-assessment and examiner-assessment revealed that around 40% of Japanese driving school students made a realistic assessment of their skills. With regard to the gender differences, although males displayed higher levels of overconfidence than females did, the differences were not as large as earlier studies with questionnaires had suggested. Furthermore, the effect of age on the accuracy of novice drivers' skill assessment was found to be relatively small. Our findings, which are based on a comparison of subjective assessments of driving skills between examiners and novices, instead of a questionable method which relies on a comparison with a hypothetical average driver, suggest that the majority of candidates in fact do not overrate their own skills. These results were discussed from the viewpoint of the driver education system and compared to other European research using the same framework.

  14. Drawing students' attention to relevant assessment criteria: effects on self-assessment skills and performance

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Sluijsmans, Dominique; Van Merriënboer, Jeroen

    2012-01-01

    Fastré, G. M. J., Van der Klink, M. R., Sluijsmans, D., & Van Merriënboer, J. J. G. (2012). Drawing students’ attention to relevant assessment criteria: effects on self-assessment skills and performance. Journal of Vocational Education & Training, 64(2), 185-198. doi:10.1080/13636820.2011.630537

  15. The effects of performance-based assessment criteria on student performance and self-assessment skills

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Van Merriënboer, Jeroen

    2010-01-01

    Fastré, G. M. J., Van der Klink, M. R., & Van Merriënboer, J. J. G. (2010). The effects of performance-based assessment criteria on student performance and self-assessment skills. Advances in Health Science Education, 15(4), 517-532.

  16. Accuracy of young male drivers’ self-assessments of driving skill

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Accurate self-assessment of skill is important because it creates an appropriate level of confidence and hence behaviour. Inaccurate self-assessment of driving ability has been linked to reckless driving and accidents. Inaccurate self-assessment of driving skills may be a contributing factor...... to the over-representation of young male drivers in accident statistics. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aims of this study were: (1) to test the accuracy of young male drivers’ self......-assessments of specific driving skills by comparing them with performance in a driving simulator; (2) to test whether self-assessment accuracy varied with driving skill, driving experience and sensation-seeking propensity. We found that young male drivers’ self-assessments were inconsistent with their driving performance...

  17. Peer-assisted learning model enhances clinical clerk's procedural skills.

    Science.gov (United States)

    Huang, Chia-Chang; Hsu, Hui-Chi; Yang, Ling-Yu; Chen, Chen-Huan; Yang, Ying-Ying; Chang, Ching-Chih; Chuang, Chiao-Lin; Lee, Wei-Shin; Lee, Fa-Yauh; Hwang, Shinn-Jang

    2018-05-17

    Failure to transfer procedural skills learned in a laboratory to the bedside is commonly due to a lack of peer support/stimulation. A digital platform (Facebook) allows new clinical clerks to share experiences and tips that help augment their procedural skills in a peer-assisted learning/teaching method. This study aims to investigate the effectiveness of the innovation of using the digital platform to support the transfer of laboratory-trained procedural skills in the clinical units. Volunteer clinical clerks (n = 44) were enrolled into the peer-assisted learning (PAL) group, which was characterized by the peer-assisted learning of procedural skills during their final 3-month clinical clerkship block. Other clerks (n = 51) did not join the procedural skills-specific Facebook group and served as the self-directed learning regular group. The participants in both the PAL and regular groups completed pre- and post-intervention self-assessments for general self-assessed efficiency ratings (GSER) and skills specific self-assessed efficiency ratings (SSSER) for performing vein puncture, intravenous (IV) catheter and nasogastric (NG) tube insertion. Finally, all clerks received the post-intervention 3-station Objective Structured Clinical Skills Examination (OSCE) to test their proficiency for the abovementioned three procedural skills. Higher cumulative numbers of vein punctures, IV catheter insertions and NG tube insertions at the bedside were carried out by the PAL group than the regular group. A greater improvement in GSERs and SSSERs for medical procedures was found in the PAL group than in the regular group. The PAL group obtained higher procedural skills scores in the post-intervention OSCEs than the regular group. Our study suggested that the implementation of a procedural skill-specific digital platform effectively helps clerks to transfer laboratory-trained procedural skills into the clinical units. In comparison with the regular self-directed learning

  18. The Measurement Properties of the Assessing Math Concepts' Assessments of Primary Students' Number Sense Skills.

    Science.gov (United States)

    Martin, Christie; Lambert, Richard; Polly, Drew; Wang, Chuang; Pugalee, David

    The purpose of this study was to examine the measurement properties of the Assessing Math Concepts AMC Anywhere Hiding and Ten Frame Assessments, formative assessments of primary students' number sense skills. Each assessment has two parts, where Part 1 is intended to be foundational skills for part two. Part 1 includes manipulatives whereas Part 2 does not. Student data from 228 kindergarten through second grade teachers with a total of 3,666 students was analyzed using Rasch scaling. Data analyses indicated that when the two assessments were examined separately the intended order of item difficulty was clear. When the parts of both assessments were analyzed together, the items in Part 2 were not consistently more difficult that the items in Part 1. This suggests an alternative sequence of tasks in that students may progress from working with a specific number with manipulatives then without manipulatives rather than working with a variety of numbers with manipulatives before moving onto assessments without manipulatives.

  19. Assessing Change in High School Student Information Literacy Using the Tool for Real-Time Assessment of Information Literacy Skills

    Science.gov (United States)

    Kovalik, Cindy L.; Yutzey, Susan D.; Piazza, Laura M.

    2012-01-01

    Change in high school student information literacy (IL) knowledge and skills, from freshman year to senior year in high school was the focus of this quasi-experimental research project. Researchers used a free information literacy skills assessment tool entitled TRAILS (Tool for Real-time Assessment of Information Literacy Skills) to measure…

  20. The predictive skill of species distribution models for plankton in a changing climate

    DEFF Research Database (Denmark)

    Brun, Philipp Georg; Kiørboe, Thomas; Licandro, Priscilla

    2016-01-01

    Statistical species distribution models (SDMs) are increasingly used to project spatial relocations of marine taxa under future climate change scenarios. However, tests of their predictive skill in the real-world are rare. Here, we use data from the Continuous Plankton Recorder program, one...... null models, is essential to assess the robustness of projections of marine planktonic species under climate change...

  1. Assessment of HIV/AIDS and Life Skills Delivery in Primary Schools in Tanzania

    Science.gov (United States)

    Rushahu, Bernadetha Gabriel

    2015-01-01

    This study was conducted to assess the effectiveness of HIV/AIDS and the Life Skills Education delivery in primary schools in Tanzania. Specifically the study investigated pupils' views about the effect of HIV/AIDS and Life Skills teaching in primary schools in Tanzania; assessed pupils' knowledge related to HIV/AIDS and Life Skills education, and…

  2. Communication Skills Training in Pediatric Oncology: Moving Beyond Role Modeling

    Science.gov (United States)

    Feraco, Angela M.; Brand, Sarah R.; Mack, Jennifer W.; Kesselheim, Jennifer C.; Block, Susan D.; Wolfe, Joanne

    2018-01-01

    Communication is central to pediatric oncology care. Pediatric oncologists disclose life-threatening diagnoses, explain complicated treatment options, and endeavor to give honest prognoses, to maintain hope, to describe treatment complications, and to support families in difficult circumstances ranging from loss of function and fertility to treatment-related or disease-related death. However, parents, patients, and providers report substantial communication deficits. Poor communication outcomes may stem, in part, from insufficient communication skills training, overreliance on role modeling, and failure to utilize best practices. This review summarizes evidence for existing methods to enhance communication skills and calls for revitalizing communication skills training within pediatric oncology. PMID:26822066

  3. Communication Skills Training in Pediatric Oncology: Moving Beyond Role Modeling.

    Science.gov (United States)

    Feraco, Angela M; Brand, Sarah R; Mack, Jennifer W; Kesselheim, Jennifer C; Block, Susan D; Wolfe, Joanne

    2016-06-01

    Communication is central to pediatric oncology care. Pediatric oncologists disclose life-threatening diagnoses, explain complicated treatment options, and endeavor to give honest prognoses, to maintain hope, to describe treatment complications, and to support families in difficult circumstances ranging from loss of function and fertility to treatment-related or disease-related death. However, parents, patients, and providers report substantial communication deficits. Poor communication outcomes may stem, in part, from insufficient communication skills training, overreliance on role modeling, and failure to utilize best practices. This review summarizes evidence for existing methods to enhance communication skills and calls for revitalizing communication skills training within pediatric oncology. © 2016 Wiley Periodicals, Inc.

  4. Procedural Skills Education – Colonoscopy as a Model

    Directory of Open Access Journals (Sweden)

    Maitreyi Raman

    2008-01-01

    Full Text Available Traditionally, surgical and procedural apprenticeship has been an assumed activity of students, without a formal educational context. With increasing barriers to patient and operating room access such as shorter work week hours for residents, and operating room and endoscopy time at a premium, alternate strategies to maximizing procedural skill development are being considered. Recently, the traditional surgical apprenticeship model has been challenged, with greater emphasis on the need for surgical and procedural skills training to be more transparent and for alternatives to patient-based training to be considered. Colonoscopy performance is a complex psychomotor skill requiring practioners to integrate multiple sensory inputs, and involves higher cortical centres for optimal performance. Colonoscopy skills involve mastery in the cognitive, technical and process domains. In the present review, we propose a model for teaching colonoscopy to the novice trainee based on educational theory.

  5. Further validation of the Danish version of the McGill Ingestive Skills Assessment (MISA-DK)

    DEFF Research Database (Denmark)

    Hansen, Tina

    2014-01-01

    Background/aims The McGill Ingestive Skill Assessment (MISA) for measuring dysphagic patients' functional performance during meals has been previously translated into Danish — the Danish McGill Ingestive Skill Assessment (MISA-DK) and this translated version validated. However, issues about......-DK was then tested using 102 videorecordings of geriatric patients' ingestive skill performance, and the data from the scale were examined using a second Rasch analysis. Results Initially, two of the six proposed subscales of the original MISA-DK failed to fit the Rasch model, and were removed. It was also necessary...

  6. Measurement Model of Reasoning Skills among Science Students Based on Socio Scientific Issues (SSI

    Directory of Open Access Journals (Sweden)

    MOHD AFIFI BAHURUDIN SETAMBAH

    2018-05-01

    Full Text Available The lack of reasoning skills has been recognized as one of the contributing factors to the declined achievement in the Trends in Mathematics and Science Studies (TIMSS and Programme for International Student Assessment (PISA assessments in Malaysia. The use of socio-scientific issues (SSI as a learning strategy offers the potential of improving the level of students' reasoning skills and consequently improves students’ achievement in science subjects. This study examined the development of a measurement model of reasoning skills among science students based on SSI using the analysis of moment structure (AMOS approach before going to second level to full structured equation modelling (SEM. A total of 450 respondents were selected using a stratified random sampling. Results showed a modified measurement model of reasoning skills consisting of the View Knowledge (VK was as a main construct. The items that measure the level of pre-reflection of students fulfilled the elements of unidimensionality, validity, and reliability. Although the level of student reasoning skills was still low but this development of measurement model could be identified and proposed teaching methods that could be adopted to improve students’ reasoning skills.

  7. The primacy of vital signs--acute care nurses' and midwives' use of physical assessment skills: a cross sectional study.

    Science.gov (United States)

    Osborne, Sonya; Douglas, Clint; Reid, Carol; Jones, Lee; Gardner, Glenn

    2015-05-01

    Registered nurses and midwives play an essential role in detecting patients at risk of deterioration through ongoing assessment and action in response to changing health status. Yet, evidence suggests that clinical deterioration frequently goes unnoticed in hospitalised patients. While much attention has been paid to early warning and rapid response systems, little research has examined factors related to physical assessment skills. To determine a minimum data set of core skills used during nursing assessment of hospitalised patients and identify nurse and workplace predictors of the use of physical assessment to detect patient deterioration. The study used a single-centre, cross-sectional survey design. The study included 434 registered nurses and midwives (Grades 5-7) involved in clinical care of patients on acute care wards, including medicine, surgery, oncology, mental health and maternity service areas, at a 929-bed tertiary referral teaching hospital in Southeast Queensland, Australia. We conducted a hospital-wide survey of registered nurses and midwives using the 133-item Physical Assessment Skills Inventory and the 58-item Barriers to Registered Nurses' Use of Physical Assessment Scale. Median frequency for each physical assessment skill was calculated to determine core skills. To explore predictors of core skill utilisation, backward stepwise general linear modelling was conducted. Means and regression coefficients are reported with 95% confidence intervals. A p value skills used by most nurses every time they worked included assessment of temperature, oxygen saturation, blood pressure, breathing effort, skin, wound and mental status. Reliance on others and technology (F=35.77, pskill use. The increasing acuity of the acute care patient plausibly warrants more than vital signs assessment; however, our study confirms nurses' physical assessment core skill set is mainly comprised of vital signs. The focus on these endpoints of deterioration as dictated by

  8. Assessing the skills of home care workers in helping older people take their prescribed medications.

    Science.gov (United States)

    Smyth, Elizabeth E J

    2015-08-01

    The Southern Health and Social Care Trust in Northern Ireland applied a modified version of the Objective Structured Clinical Examination (OSCE) to assess the skills of home care workers in assisting older people taking prescribed medications. In Northern Ireland, home care workers are care workers employed by health and social care trusts or private agencies. The application of the model has developed the skills of this staff group, improved the relationship between the commissioner and provider, significantly reduced the time spent by community nurses in individual training and assessment, and enhanced the patient experience for those taking medication. Overall, the application of this model has provided assurances to the Trust board, the executive director of nursing, and operational directors that home care workers are competent in assisting older people in this high-risk activity.

  9. Feedforward self-modeling enhances skill acquisition in children learning trampoline skills.

    Science.gov (United States)

    Ste-Marie, Diane M; Vertes, Kelly; Rymal, Amanda M; Martini, Rose

    2011-01-01

    The purpose of this research was to examine whether children would benefit from a feedforward self-modeling (FSM) video and to explore possible explanatory mechanisms for the potential benefits, using a self-regulation framework. To this end, children were involved in learning two five-skill trampoline routines. For one of the routines, a FSM video was provided during acquisition, whereas only verbal instructions were provided for the alternate routine. The FSM involved editing video footage such that it showed the learner performing the trampoline routine at a higher skill level than their current capability. Analyses of the data showed that while physical performance benefits were observed for the routine that was learned with the FSM video, no differences were obtained in relation to the self-regulatory measures. Thus, the FSM video enhanced motor skill acquisition, but this could not be explained by changes to the varied self-regulatory processes examined.

  10. Feedforward self-modeling enhances skill acquisition in children learning trampoline skills

    Directory of Open Access Journals (Sweden)

    Diane M. Ste-Marie

    2011-07-01

    Full Text Available The purpose of this research was to examine whether children would benefit from a feedforward self-modeling (FSM video and to explore possible explanatory mechanisms for the potential benefits, using a self-regulation framework. To this end, children were involved in learning two five-skill trampoline routines. For one of the routines, a FSM video was provided during acquisition, whereas only verbal instructions were provided for the alternate routine. The FSM involved editing video footage such that it showed the learner performing the trampoline routine at a higher skill level than their current capability. Analyses of the data showed that while physical performance benefits were observed for the routine that was learned with the FSM video, no differences were obtained in relation to the self-regulatory measures. Thus, the FSM video enhanced motor skill acquisition, but this could not be explained by changes to the varied self-regulatory processes examined.

  11. Norming a VALUE rubric to assess graduate information literacy skills.

    Science.gov (United States)

    Turbow, David J; Evener, Julie

    2016-07-01

    The study evaluated whether a modified version of the information literacy Valid Assessment of Learning in Undergraduate Education (VALUE) rubric would be useful for assessing the information literacy skills of graduate health sciences students. Through facilitated calibration workshops, an interdepartmental six-person team of librarians and faculty engaged in guided discussion about the meaning of the rubric criteria. They applied the rubric to score student work for a peer-review essay assignment in the "Information Literacy for Evidence-Based Practice" course. To determine inter-rater reliability, the raters participated in a follow-up exercise in which they independently applied the rubric to ten samples of work from a research project in the doctor of physical therapy program: the patient case report assignment. For the peer-review essay, a high level of consistency in scoring was achieved for the second workshop, with statistically significant intra-class correlation coefficients above 0.8 for 3 criteria: "Determine the extent of evidence needed," "Use evidence effectively to accomplish a specific purpose," and "Access the needed evidence." Participants concurred that the essay prompt and rubric criteria adequately discriminated the quality of student work for the peer-review essay assignment. When raters independently scored the patient case report assignment, inter-rater agreement was low and statistically insignificant for all rubric criteria (kappa=-0.16, p>0.05-kappa=0.12, p>0.05). While the peer-review essay assignment lent itself well to rubric calibration, scorers had a difficult time with the patient case report. Lack of familiarity among some raters with the specifics of the patient case report assignment and subject matter might have accounted for low inter-rater reliability. When norming, it is important to hold conversations about search strategies and expectations of performance. Overall, the authors found the rubric to be appropriate for

  12. Multi-informant assessment of transition-related skills and skill importance in adolescents with autism spectrum disorder.

    Science.gov (United States)

    Hume, Kara; Dykstra Steinbrenner, Jessica; Sideris, John; Smith, Leann; Kucharczyk, Suzanne; Szidon, Kate

    2018-01-01

    Adolescents with autism spectrum disorder have limited participation in the transition planning process, despite the link between active participation and an improvement in postsecondary education and employment outcomes. The Secondary School Success Checklist was designed to support transition planning for adolescents with autism spectrum disorder by incorporating their own assessments of strengths, skill deficits, and prioritization for instruction along with those of their parents and teachers across multiple skill domains. Findings from more than 500 adolescents with autism spectrum disorder across the United States indicate discrepancies between adolescent, teacher, and parent ratings of skills highlighting the importance of the inclusion of multiple perspectives in transition planning. Although ratings varied, agreement between adolescents with autism spectrum disorder, parents, and teachers across the highest and lowest rated skills suggests the need to broaden the focus on critical transition skills to include problem-solving, planning for life after high school, and self-advocacy.

  13. Development of a patient-doctor communication skills model for medical students.

    Science.gov (United States)

    Lee, Young Hee; Lee, Young-Mee

    2010-09-01

    Communication is a core clinical skill that can be taught and learned. The authors intended to develop a patient-doctor communication model for teaching and assessing undergraduate medical students in Korea. To develop a model, literature reviews and an iterative process of discussion between faculty members of a communication skills course for second year medical students were conducted. The authors extracted common communication skill competencies by comparing the Kalamazoo Consensus Statement, SEGUE framework communication skills, the Calgary Cambridge Observation Guides, and previous communication skills lists that have been used by the authors. The content validity, with regard to clinical importance and feasibility, was surveyed by both faculty physicians and students. The first version of the model consisted of 36 items under 7 categories: initiating the session (8 items), building a relationship (6), gathering information (8), understanding a patient's perspectives (4), sharing information (4), reaching an agreement (3), and closing the session (3). It was used as a guide for both students and teachers in an actual communication skills course. At the end of the course, student performance was assessed using two 7-minute standardized patient interviews with a 34-item checklist. This assessment tool was modified from the first version of the model to reflect the case specificity of the scenarios. A patient-doctor communication model, which can be taught to those with limited patient care experience, was finally developed. We recommended a patient-doctor communication skills model that can be used for teaching and evaluating preclinical and clinical students. Further studies are needed to verify its validity and reliability.

  14. Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

    Science.gov (United States)

    Granite, Guinevere; Pugh, Kristy; Chen, Hegang; Longinaker, Nyaradzo; Garofalo, Evan; Shackelford, Stacy; Shalin, Valerie; Puche, Adam; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin

    2018-03-01

    Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

  15. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality.

    Science.gov (United States)

    Gallagher, A G; Richie, K; McClure, N; McGuigan, J

    2001-11-01

    Objective assessment of psychomotor skills in surgery is now a priority; however, this assessment is difficult to achieve because of measurement difficulties associated with the reliability and validity of assessing surgical skills in vivo and in the laboratory. In this study virtual reality (VR) was used to overcome these problems in the objective psychomotor assessment of senior, junior, and novice laparoscopists. Twelve experienced laparoscopic surgeons (performed >50 Minimal Access Surgery (MAS) procedures), 12 inexperienced laparoscopic surgeons (psychomotor skills for laparoscopic surgery.

  16. Reliability of the ECHOWS Tool for Assessment of Patient Interviewing Skills.

    Science.gov (United States)

    Boissonnault, Jill S; Evans, Kerrie; Tuttle, Neil; Hetzel, Scott J; Boissonnault, William G

    2016-04-01

    History taking is an important component of patient/client management. Assessment of student history-taking competency can be achieved via a standardized tool. The ECHOWS tool has been shown to be valid with modest intrarater reliability in a previous study but did not demonstrate sufficient power to definitively prove its stability. The purposes of this study were: (1) to assess the reliability of the ECHOWS tool for student assessment of patient interviewing skills and (2) to determine whether the tool discerns between novice and experienced skill levels. A reliability and construct validity assessment was conducted. Three faculty members from the United States and Australia scored videotaped histories from standardized patients taken by students and experienced clinicians from each of these countries. The tapes were scored twice, 3 to 6 weeks apart. Reliability was assessed using interclass correlation coefficients (ICCs) and repeated measures. Analysis of variance models assessed the ability of the tool to discern between novice and experienced skill levels. The ECHOWS tool showed excellent intrarater reliability (ICC [3,1]=.74-.89) and good interrater reliability (ICC [2,1]=.55) as a whole. The summary of performance (S) section showed poor interrater reliability (ICC [2,1]=.27). There was no statistical difference in performance on the tool between novice and experienced clinicians. A possible ceiling effect may occur when standardized patients are not coached to provide complex and obtuse responses to interviewer questions. Variation in familiarity with the ECHOWS tool and in use of the online training may have influenced scoring of the S section. The ECHOWS tool demonstrates excellent intrarater reliability and moderate interrater reliability. Sufficient training with the tool prior to student assessment is recommended. The S section must evolve in order to provide a more discerning measure of interviewing skills. © 2016 American Physical Therapy

  17. Design and Assessment of Online, Interactive Tutorials That Teach Science Process Skills.

    Science.gov (United States)

    Kramer, Maxwell; Olson, Dalay; Walker, J D

    2018-06-01

    Explicit emphasis on teaching science process skills leads to both gains in the skills themselves and, strikingly, deeper understanding of content. Here, we created and tested a series of online, interactive tutorials with the goal of helping undergraduate students develop science process skills. We designed the tutorials in accordance with evidence-based multimedia design principles and student feedback from usability testing. We then tested the efficacy of the tutorials in an introductory undergraduate biology class. On the basis of a multivariate ordinary least-squares regression model, students who received the tutorials are predicted to score 0.82 points higher on a 15-point science process skill assessment than their peers who received traditional textbook instruction on the same topic. This moderate but significant impact indicates that well-designed online tutorials can be more effective than traditional ways of teaching science process skills to undergraduate students. We also found trends that suggest the tutorials are especially effective for nonnative English-speaking students. However, due to a limited sample size, we were unable to confirm that these trends occurred due to more than just variation in the student group sampled.

  18. Fostering the development of effective person-centered healthcare communication skills: an interprofessional shared learning model.

    Science.gov (United States)

    Cavanaugh, James T; Konrad, Shelley Cohen

    2012-01-01

    To describe the implementation of an interprofessional shared learning model designed to promote the development of person-centered healthcare communication skills. Master of social work (MSW) and doctor of physical therapy (DPT) degree students. The model used evidence-based principles of effective healthcare communication and shared learning methods; it was aligned with student learning outcomes contained in MSW and DPT curricula. Students engaged in 3 learning sessions over 2 days. Sessions involved interactive reflective learning, simulated role-modeling with peer assessment, and context-specific practice of communication skills. The perspective of patients/clients was included in each learning activity. Activities were evaluated through narrative feedback. Students valued opportunities to learn directly from each other and from healthcare consumers. Important insights and directions for future interprofessional learning experiences were gleaned from model implementation. The interprofessional shared learning model shows promise as an effective method for developing person-centered communication skills.

  19. Role modelling in medical education: the importance of teaching skills.

    Science.gov (United States)

    Burgess, Annette; Oates, Kim; Goulston, Kerry

    2016-04-01

    By observation of role models, and participation in activities, students develop their attitudes, values and professional competencies. Literature suggests that clinical skills and knowledge, personality, and teaching skills are three main areas that students consider central to the identification of positive role models. The aim of this study was to explore junior medical students' opinions of the ideal attributes of a good role model in clinical tutors. The study was conducted with one cohort (n = 301) of students who had completed year 1 of the medical programme in 2013. All students were asked to complete a questionnaire regarding the ideal attributes of a good role model in a clinical tutor. The questionnaire consisted of seven closed items and one open-ended question. The response rate to the questionnaire was 265/301 (88%). Although students found all three key areas important in a good role model, students emphasised the importance of excellence in teaching skills. Specifically, students see good role models as being able to provide a constructive learning environment, a good understanding of the curriculum and an ability to cater to the learning needs of all students. Students see good role models as being able to provide a constructive learning environment While acknowledging the importance of a patient-centred approach, as well as clinical knowledge and skills, our findings reinforce the importance of the actual teaching abilities of role models within medical education. © 2015 John Wiley & Sons Ltd.

  20. MODERN METHODOLOGICAL TOOLS FOR STUDENTS’ LANGUAGE SKILLS SELF-ASSESSMENT

    Directory of Open Access Journals (Sweden)

    A. N. Astanina

    2017-01-01

    Full Text Available Introduction. Nowadays, the problem of standardization of foreign language training at the higher school is becoming currently topical. With regard to the processes of globalization, the international educational projects and students exchange programs gain greater international recognition. Such international programmes involve foreign language knowledge graded as not only high certified academic levels but also as basic language skills. The lack of foreign language competence becomes the obstacle for successful training, depriving a future graduate of a part of chances to become the competitive and popular expert in the chosen profession. The success of a foreign language course completion among students depends on many factors; the most important factor is motivation which can affect self-assessment of training results. The aim of the study is to describe possibilities of the CanDos tools implementation for the organization of students self-consciousness and self-assessment of own achievements in order to influence the motivation for mastering a foreign language.Methodology and research methods. The research is based on competencybased approach. The methods involve comparative analysis, synthesis, and generalization.Results and scientific novelty. The questionnaire developed for the experiment helped to collect the data concerning the effectiveness of the CanDos software implementation for self-assessment of students’ foreign language skills. The corresponding self-assessment helps students to carry out a self-reflection of own knowledge and abilities, and to find “weak points” in language proficiency which need additional practice and improvement. By regularly using CanDos software as self-assessment tools, students learn to identify the correspondence of their language competence to the external requirements and standards of education. Orientation to training results will help future experts to create self-motivation that positively

  1. Efficiency of Motivation Development Models for Hygienic Skills

    Directory of Open Access Journals (Sweden)

    Alexander V. Tscymbalystov

    2017-09-01

    Full Text Available The combined influence of a family and a state plays an important role in the development of an individual. This study is aimed at the model effectiveness evaluation concerning the development of oral hygiene skills among children living in families (n = 218 and being under the care of a state (n = 229. The groups were created among the children who took part in the study: the preschoolers of 5-7 years, schoolchildren of 8-11 years and adolescents of 12-15 years. During the initial examination, the hygienic status of the oral cavity before and after tooth brushing was evaluated. After that, subgroups were formed in each age group according to three models of hygienic skills training: 1 computer presentation lesson; 2 one of the students acted as a demonstrator of the skill; 3 an individual training by a hygienist. During the next 48 hours children did not take hygienic measures. Then the children were invited for a control session to demonstrate the acquired skills of oral care and evaluate the effectiveness of a model developing the skills of individual oral hygiene. During the control examination, the hygienic status was determined before and after the tooth cleaning, which allowed to determine the regimes of hygienic measure performance for children with different social status and the effectiveness of hygiene training models.

  2. Promoting Assessment Efficacy through an Integrated System for Online Clinical Assessment of Practical Skills

    Science.gov (United States)

    Hay, Peter J.; Engstrom, Craig; Green, Anita; Friis, Peter; Dickens, Sue; Macdonald, Doune

    2013-01-01

    This paper presents evaluation outcomes from an externally funded research project involving the online clinical assessment of practical skills (eCAPS) using web-based video technologies within a university medical programme. eCAPS was implemented to trial this web-based approach for promoting the efficacy of "practical" skills…

  3. Management of Radioactive Spills in Nuclear Medicine; Teaching and Assessing with Objectively Structured Assessment of Technical Skills

    International Nuclear Information System (INIS)

    Hussain, Riffat Parveen

    2015-01-01

    Routine work in nuclear medicine requires the careful elution of radioactivity and its subsequent, storage and handling. Though all effort is maintained to prevent any “spill” of this radioactivity, accidents are bound to happen. The response to this spill is a methodically worked out a plan that is written and adopted as a “standard operating procedure.” This protocol is taught to all involved in the area of working as a mock drill/apprenticeship model. No formal evaluation of learning is in place except for the mock drills. The objectively structured assessment of technical skills (OSATS) is a variation on the Objective Structured Clinical Examination, which is a form of workplace based assessment. The OSATS is cited in the Accreditation Council of Graduate Medical Education evaluation toolbox on the website as the most desirable evaluation tool for the patient care topics. It is the objective of this paper is to introduce the “OSATS” for teaching, and assessment of the learning, of the protocol for the management of radioactive spill. As a review of the literature on the subject failed to reveal any such teaching protocol/material/document for this important technical skill, we hope that it may act as a landmark for the development of teaching and assessment of other technical skills also

  4. A Guttman scale for assessing condom use skills among college students.

    Science.gov (United States)

    Lindemann, Dana F; Brigham, Thomas A

    2003-03-01

    HIV risk-reduction interventions frequently teach correct condom use skills, yet few researchers actually measure those skills. Without measuring condom use skills, it is not possible to evaluate the effectiveness of condom use interventions, or determine what variables may be related to those skills. The Measure of Observed Condom Use Skills (MOCUS) was developed using standard Guttman scaling procedures, and administered to 106 female and 71 male undergraduates. The MOCUS was administered by the primary investigator to each participant individually. Guttman scale analyses demonstrated the MOCUS has acceptable reproducibility. These findings support future use of the MOCUS to assess condom use skills.

  5. Assessing 21st Century Skills: A Guide to Evaluating Mastery and Authentic Learning

    Science.gov (United States)

    Greenstein, Laura

    2012-01-01

    The Common Core State Standards clearly define the skills students need for success in college and the 21st century workplace. The question is, how can you measure student mastery of skills like creativity, problem solving, and use of technology? Laura Greenstein demonstrates how teachers can teach and assess 21st century skills using authentic…

  6. Assessing maths literacy skills in type 1 diabetic children and their ...

    African Journals Online (AJOL)

    Background: It is essential that children have adequate numeracy and literacy skills in order to manage their diabetes effectively. The objective was to undertake a pilot study to assess the level of numeracy skills in type 1 diabetic children and their caregivers, and to ascertain if there was a deficit in these skills.

  7. Social Validation of the New England Center for Children-Core Skills Assessment

    Science.gov (United States)

    Dickson, Chata A.; MacDonald, Rebecca P. F.; Mansfield, Renee; Guilhardi, Paulo; Johnson, Cammarie; Ahearn, William H.

    2014-01-01

    We investigated the social validity of the NECC Core Skills Assessment (NECC-CSA) with parents and professionals as participants. The NECC-CSA is a measurement tool consisting of direct and indirect measures of skills important to all individuals with autism, across the lifespan. Participants (N = 245) were provided with a list of 66 skills, 47 of…

  8. Concrete Steps for Assessing the "Soft Skills" in an MBA Program

    Science.gov (United States)

    Ingols, Cynthia; Shapiro, Mary

    2014-01-01

    In 2006, our School of Management began the serious path of assessing both the "hard skills" (such as accounting, finance, and strategy) and the "soft skills" (such as leadership, team work, and ethics) of our MBA Program. The data generated from examining the "soft skills" that we want students to learn within our…

  9. The Impact of Diagnosing Skill Deficiencies and Assessment-Based Communication Training on Managerial Performance.

    Science.gov (United States)

    Papa, Michael J.; Graham, Elizabeth E.

    1991-01-01

    Evaluates an organizational diagnosis program that assesses managerial communication skills and provides the frame for follow-up training programs. Finds that managers participating in follow-up communication skills training performed significantly higher on interpersonal skills, problem-solving ability, and productivity over three long-term…

  10. Analysis of Student Service-Learning Reflections for the Assessment of Transferable-Skills Development

    Science.gov (United States)

    Rizzo, D. M.; Dewoolkar, M.; Hayden, N.; Oka, L.; Pearce, A. R.

    2010-12-01

    The civil and environmental engineering (CEE) programs at the University of Vermont (UVM) incorporate systems thinking and a systems approach to sustainable engineering problem solving. A systems approach considers long-term social, environmental and economic factors within the context of the engineering problem solution and encompasses sustainable engineering solutions. Our goal is to prepare students to become leaders in their chosen field who can anticipate co-products associated with forecasted solutions. As a way of practicing the systems approach, we include service-learning projects in many of our undergraduate engineering courses, culminating with the senior capstone design course. We use a variety of formative and summative assessment methods to gage student understanding and attitudes including student surveys, focus groups, assessment of student projects, and student reflections. Student reflections from two courses -Modeling Environmental and Transportation Systems (31 juniors) and Senior Design Project (30 seniors) are compared. Of these, 25 students were common to both courses. The focus of the systems modeling service-learning project involved mentoring home-schooled children (11-14 yrs old) to solve problems of mobility, using the fun and inspiration of biomimicry. Students were required to invent innovative methods to move people or goods that improve associated constraints (i.e., minimize congestion, reduce pollution, increase safety), or reduce the need for transportation altogether. The capstone design project required a comprehensive engineering design involving two or more CEE sub-disciplines. Both service-learning projects were intended to enhance students’ academic learning experience, attain civic engagement and reinforce transferable skills (written and oral communication, teamwork, leadership and mentoring skills). The student course reflections were not guided; yet they provided valuable data to assess commonalities and differences in

  11. Information as a Measure of Model Skill

    Science.gov (United States)

    Roulston, M. S.; Smith, L. A.

    2002-12-01

    Physicist Paul Davies has suggested that rather than the quest for laws that approximate ever more closely to "truth", science should be regarded as the quest for compressibility. The goodness of a model can be judged by the degree to which it allows us to compress data describing the real world. The "logarithmic scoring rule" is a method for evaluating probabilistic predictions of reality that turns this philosophical position into a practical means of model evaluation. This scoring rule measures the information deficit or "ignorance" of someone in possession of the prediction. A more applied viewpoint is that the goodness of a model is determined by its value to a user who must make decisions based upon its predictions. Any form of decision making under uncertainty can be reduced to a gambling scenario. Kelly showed that the value of a probabilistic prediction to a gambler pursuing the maximum return on their bets depends on their "ignorance", as determined from the logarithmic scoring rule, thus demonstrating a one-to-one correspondence between data compression and gambling returns. Thus information theory provides a way to think about model evaluation, that is both philosophically satisfying and practically oriented. P.C.W. Davies, in "Complexity, Entropy and the Physics of Information", Proceedings of the Santa Fe Institute, Addison-Wesley 1990 J. Kelly, Bell Sys. Tech. Journal, 35, 916-926, 1956.

  12. A contextual approach to social skills assessment in the peer group: who is the best judge?

    Science.gov (United States)

    Kwon, Kyongboon; Kim, Elizabeth Moorman; Sheridan, Susan M

    2012-09-01

    Using a contextual approach to social skills assessment in the peer group, this study examined the criterion-related validity of contextually relevant social skills and the incremental validity of peers and teachers as judges of children's social skills. Study participants included 342 (180 male and 162 female) students and their classroom teachers (N = 22) from rural communities. As expected, contextually relevant social skills were significantly related to a variety of social status indicators (i.e., likability, peer- and teacher-assessed popularity, reciprocated friendships, clique centrality) and positive school functioning (i.e., school liking and academic competence). Peer-assessed social skills, not teacher-assessed social skills, demonstrated consistent incremental validity in predicting various indicators of social status outcomes; peer- and teacher-assessed social skills alike showed incremental validity in predicting positive school functioning. The relation between contextually relevant social skills and study outcomes did not vary by child gender. Findings are discussed in terms of the significance of peers in the assessment of children's social skills in the peer group as well as the usefulness of a contextual approach to social skills assessment.

  13. An Assessment of the Employability Skills Needed by Graduates in the College of Agriculture, Food and Natural Resources at the University of Missouri

    Science.gov (United States)

    Robinson, J. Shane; Garton, Bryan L.

    2008-01-01

    The purposes of this descriptive study were to assess graduates' perception of the importance and competence levels of performing identified transferable skills in the workplace and use the Borich (1980) needs assessment model to identify the skills most in need to enhance the curriculum. The findings revealed that solving problems, working…

  14. A comparison of students' self-assessments with faculty evaluations of their communication skills.

    Science.gov (United States)

    Lundquist, Lisa M; Shogbon, Angela O; Momary, Kathryn M; Rogers, Hannah K

    2013-05-13

    To compare students' self-assessment of their communication skills with faculty members' formal evaluation of their skills in a therapeutics course. Over a 3-year period, faculty members evaluated second-year pharmacy students' communication skills as part of a requirement in a therapeutics course. Immediately following an individual oral assessment and again following a group oral assessment, students self-assessed their communication skills using the same rubric the faculty members had used. Students' self-assessments were then compared with faculty members' evaluation of students' communication skills. Four hundred one (97.3%) students consented to participate in this study. Faculty evaluation scores of students for both the individual and group oral assessments were significantly higher than students' self-assessment scores. Students' self-assessment scores of their communication skills increased from the individual to the group oral assessment. Students' self-assessments of communication skills were consistently lower than faculty members' evaluations. Greater use of oral assessments throughout the pharmacy curriculum may help to improve students' confidence in and self-assessment of their communication skills.

  15. Assessing problem-solving skills in construction education with the virtual construction simulator

    Science.gov (United States)

    Castronovo, Fadi

    problem-solving skills, a new version of the VCS(4) was developed, with new building modules and assessment framework. The design and development of the VCS4 leveraged research in educational psychology, multimedia learning, human-computer interaction, and Building Information Modeling. In this dissertation the researcher aimed to evaluate the pedagogical value of the VCS4 in fostering problem-solving skills. To answer the research questions, a crossover repeated measures quasi-experiment was designed to assess the educational gains that the VCS can provide to construction education. A group of 34 students, attending a fourth-year construction course at a university in the United States was chosen to participate in the experiment. The three learning modules of the VCS were used, which challenged the students to plan and manage the construction process of a wooden pavilion, the steel erection of a dormitory, and the concrete placement of the same dormitory. Based on the results the researcher was able to provide evidence supporting the hypothesis that the chosen sample of construction students were able to gain and retain problem-solving skills necessary to solve complex construction simulation problems, no matter what the sequence with which these modules were played. In conclusion, the presented results provide evidence supporting the theory that educational simulation games can help the learning and retention of transferable problem-solving skills, which are necessary to solve complex construction problems.

  16. Development and Assessment of Modules to Integrate Quantitative Skills in Introductory Biology Courses.

    Science.gov (United States)

    Hoffman, Kathleen; Leupen, Sarah; Dowell, Kathy; Kephart, Kerrie; Leips, Jeff

    2016-01-01

    Redesigning undergraduate biology courses to integrate quantitative reasoning and skill development is critical to prepare students for careers in modern medicine and scientific research. In this paper, we report on the development, implementation, and assessment of stand-alone modules that integrate quantitative reasoning into introductory biology courses. Modules are designed to improve skills in quantitative numeracy, interpreting data sets using visual tools, and making inferences about biological phenomena using mathematical/statistical models. We also examine demographic/background data that predict student improvement in these skills through exposure to these modules. We carried out pre/postassessment tests across four semesters and used student interviews in one semester to examine how students at different levels approached quantitative problems. We found that students improved in all skills in most semesters, although there was variation in the degree of improvement among skills from semester to semester. One demographic variable, transfer status, stood out as a major predictor of the degree to which students improved (transfer students achieved much lower gains every semester, despite the fact that pretest scores in each focus area were similar between transfer and nontransfer students). We propose that increased exposure to quantitative skill development in biology courses is effective at building competency in quantitative reasoning. © 2016 K. Hoffman, S. Leupen, et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

  17. Enhancing Students' Communication Skills through Treffinger Teaching Model

    Science.gov (United States)

    Alhaddad, Idrus; Kusumah, Yaya S.; Sabandar, Jozua; Dahlan, Jarnawi A.

    2015-01-01

    This research aims to investigate, compare, and describe the achievement and enhancement of students' mathematical communication skills (MCS). It based on the prior mathematical knowledge (PMK) category (high, medium and low) by using Treffinger models (TM) and conventional learning (CL). This research is an experimental study with the population…

  18. Mentoring Model for Lecturers' Research Skills Development: Case ...

    African Journals Online (AJOL)

    The informal group mentoring model for research skills development begins with desk research for qualities of a publishable paper. Five dummy papers were reviewed by participants for quality. Participants conducted new studies and wrote research articles. These articles were peer reviewed by participants and submitted ...

  19. Generic skills requirements (KSA model) towards future mechanical ...

    African Journals Online (AJOL)

    ... Statistics and Discriminant Analysis (DA) as required to achieve the objective of the study. This study will guide all future engineers, especially in the field of Mechanical Engineering in Malaysia to penetrate the job market according to the current market needs. Keywords: generic skills; KSA model; mechanical engineers; ...

  20. Production compilation : A simple mechanism to model complex skill acquisition

    NARCIS (Netherlands)

    Taatgen, N.A.; Lee, F.J.

    2003-01-01

    In this article we describe production compilation, a mechanism for modeling skill acquisition. Production compilation has been developed within the ACT-Rational (ACT-R; J. R. Anderson, D. Bothell, M. D. Byrne, & C. Lebiere, 2002) cognitive architecture and consists of combining and specializing

  1. The Flipped Classroom Model: When Technology Enhances Professional Skills

    Science.gov (United States)

    Baytiyeh, Hoda

    2017-01-01

    Purpose: The purpose of this paper is to investigate the effectiveness of the flipped classroom model in teaching and learning as well as the skills that can be acquired by students after being exposed to this learning style. Design/methodology/approach: This paper uses a qualitative case study design. In total, 20 students, from various majors,…

  2. Video Modeling and Prompting in Practice: Teaching Cooking Skills

    Science.gov (United States)

    Kellems, Ryan O.; Mourra, Kjerstin; Morgan, Robert L.; Riesen, Tim; Glasgow, Malinda; Huddleston, Robin

    2016-01-01

    This article discusses the creation of video modeling (VM) and video prompting (VP) interventions for teaching novel multi-step tasks to individuals with disabilities. This article reviews factors to consider when selecting skills to teach, and students for whom VM/VP may be successful, as well as the difference between VM and VP and circumstances…

  3. Enhancing Student Communication Skills Through Arabic Language Competency and Simulated Patient Assessments.

    Science.gov (United States)

    Hasan, Sanah; Tarazi, Hamadeh M Khier; Halim Hilal, Dana Abdel

    2017-05-01

    Objective. To assess student communication and patient management skill with introduction of Arabic and use of simulated patient assessments to a communication and counseling course. Design. Five, 3-hour tutorials (clinical skill laboratory) were added to the course covering: listening and empathic responding, non-verbal communications, interviewing skills, assertiveness, counseling in special situations: conflict, anger, worry or rushed situations, and professional decision making. Arabic content was introduced to the course to enhance Arabic communications and competence among students. Simulated patient assessment was used to evaluate student skills. Students' feedback about course changes was evaluated. Assessment. The course now covers a wider content and Arabic language. Students' scores were similar in the assessment and other assessments within the course and between Arabic and English groups. Students favorably rated the changes in the course and provided constructive feedback on content usefulness and adequacy. Conclusion. Expanding the course to include Arabic language and content and simulated patient assessments enhanced student communication skills.

  4. Development of performance assessment instrument based contextual learning for measuring students laboratory skills

    Science.gov (United States)

    Susilaningsih, E.; Khotimah, K.; Nurhayati, S.

    2018-04-01

    The assessment of laboratory skill in general hasn’t specific guideline in assessment, while the individual assessment of students during a performance and skill in performing laboratory is still not been observed and measured properly. Alternative assessment that can be used to measure student laboratory skill is use performance assessment. The purpose of this study was to determine whether the performance assessment instrument that the result of research can be used to assess basic skills student laboratory. This research was conducted by the Research and Development. The result of the data analysis performance assessment instruments developed feasible to implement and validation result 62.5 with very good categories for observation sheets laboratory skills and all of the components with the very good category. The procedure is the preliminary stages of research and development stages. Preliminary stages are divided in two, namely the field studies and literature studies. The development stages are divided into several parts, namely 1) development of the type instrument, 2) validation by an expert, 3) a limited scale trial, 4) large-scale trials and 5) implementation of the product. The instrument included in the category of effective because 26 from 29 students have very high laboratory skill and high laboratory skill. The research of performance assessment instrument is standard and can be used to assess basic skill student laboratory.

  5. Developing Critical Thinking Skills: Assessing the Effectiveness of Workbook Exercises

    Science.gov (United States)

    Wallace, Elise D.; Jefferson, Renee N.

    2015-01-01

    To address the challenge of developing critical thinking skills in college students, this empirical study examines the effectiveness of cognitive exercises in developing those skills. The study uses Critical Thinking: Building the Basics by Walter, Knudsvig, and Smith (2003). This workbook is specifically designed to exercise and develop critical…

  6. ASSESSMENT OF PHYSICAL SKILLS TO THE STUDENT FITNESS INDEX

    Directory of Open Access Journals (Sweden)

    Ratko Pavlović

    2011-09-01

    Full Text Available A very common way of assessing the state of physical abilities is to determine on the basis of diagnostic tests, and they give us the necessary information when it comes to general skills defined population. This evaluation is usually performed diagnostic tests in the laboratory. However, reliable data are available on the performance of some field tests. Depending on field conditions, very often is done using estimates of general ability test, 2km walking UKK. To perform this test shall include data on body height, weight, BMI-in, values, heart rate, time walking. Based on the formula and application of these data are obtained fitness value of the index by which to define the overall physical condition of patients. Also based on the formula to obtain indicators on maximum oxygen consumption. The study comprised third-year students East Sarajevo, who held classes in subjects walking sports athletics, in order to determine their state of physical fitness index based on fitness.

  7. Assessment of Fundamental Movement Skills in Childhood Cancer Patients.

    Science.gov (United States)

    Naumann, Fiona L; Hunt, Mitchell; Hunt, Mitchel; Ali, Dulfikar; Wakefield, Claire E; Moultrie, Kevin; Cohn, Richard J

    2015-12-01

    The improved treatment protocols and subsequent improved survival rates among childhood cancer patients have shifted the focus toward the long-term consequences arising from cancer treatment. Children who have completed cancer treatment are at a greater risk of delayed development, diminished functioning, disability, compromised fundamental movement skill (FMS) attainment, and long-term chronic health conditions. The aim of the study was to compare FMS of childhood cancer patients with an aged matched healthy reference group. Pediatric cancer patients aged 5-8 years (n = 26; median age 6.91 years), who completed cancer treatment (<5 years) at the Sydney Children's Hospital, were assessed performing seven key FMS: sprint, side gallop, vertical jump, catch, over-arm throw, kick, and leap. Results were compared to the reference group (n = 430; 6.56 years). Childhood cancer patients scored significantly lower on three out of seven FMS tests when compared to the reference group. These results equated to a significantly lower overall score for FMS. This study highlighted the significant deficits in FMS within pediatric patients having completed cancer treatment. In order to reduce the occurrence of significant FMS deficits in this population, FMS interventions may be warranted to assist in recovery from childhood cancer, prevent late effects, and improve the quality of life in survivors of childhood cancer. © 2015 Wiley Periodicals, Inc.

  8. Development of a virtual reality assessment of everyday living skills.

    Science.gov (United States)

    Ruse, Stacy A; Davis, Vicki G; Atkins, Alexandra S; Krishnan, K Ranga R; Fox, Kolleen H; Harvey, Philip D; Keefe, Richard S E

    2014-04-23

    Cognitive impairments affect the majority of patients with schizophrenia and these impairments predict poor long term psychosocial outcomes.  Treatment studies aimed at cognitive impairment in patients with schizophrenia not only require demonstration of improvements on cognitive tests, but also evidence that any cognitive changes lead to clinically meaningful improvements.  Measures of "functional capacity" index the extent to which individuals have the potential to perform skills required for real world functioning.  Current data do not support the recommendation of any single instrument for measurement of functional capacity.  The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) is a novel, interactive gaming based measure of functional capacity that uses a realistic simulated environment to recreate routine activities of daily living. Studies are currently underway to evaluate and establish the VRFCAT's sensitivity, reliability, validity, and practicality. This new measure of functional capacity is practical, relevant, easy to use, and has several features that improve validity and sensitivity of measurement of function in clinical trials of patients with CNS disorders.

  9. THE EFFECT OF INQUIRY TRAINING MODEL USE THE MEDIA PHET AGAINST SCIENCE PROCESS SKILLS AND LOGICAL THINKING SKILLS STUDENTS

    Directory of Open Access Journals (Sweden)

    Fajrul Wahdi Ginting

    2015-12-01

    Full Text Available The Purpose of The study: science process skills and logical thinking ability of students who use inquiry learning model training using PhET media; science process skills and logical thinking ability of students who use conventional learning model; and the difference science process skills and logical thinking ability of students to use learning model Inquiry Training using PhET media and conventional learning models. This research is a quasi experimental. Sample selection is done by cluster random sampling are two classes of classes VIII-E and class VIII-B, where the class VIII-E is taught by inquiry training model using media PhET and VIII-B with conventional learning model. The instrument used consisted of tests science process skills such as essay tests and tests of the ability to think logically in the form of multiple-choice tests. The data were analyzed using t test. The results showed that physics science process skills use Inquiry Training models using PhET media is different and showed better results compared with conventional learning model, and logical thinking skills students use Inquiry Training model using PhET media is different and show better results compared with conventional learning, and there is a difference between the ability to think logically and science process skills of students who use Inquiry Training model using PhET media and conventional learning models.

  10. Medical and psychology students' self-assessed communication skills: A pilot study.

    Science.gov (United States)

    Tiuraniemi, Juhani; Läärä, Riitta; Kyrö, Tuuli; Lindeman, Sari

    2011-05-01

    The purpose of this study was to describe how psychology and medical students assess their own competency and skills before and after training, in which role-play was used to teach interpersonal and communication skills. Interpersonal and communication skills were assessed with a semi-structured questionnaire before and after the training. The students of both medicine and psychology estimated their skill levels to be higher after the course. The psychology students estimated their skills for communication, motivating interviewing, empathy and reflection, and change orientation to be better at the end of the course. Medical students estimated their communication skills, motivating interviewing skills, and change orientation skills to be better at the end of the course. Even a short period of training in interpersonal and communication skills can positively affect the self-assessed skills of the medical students. In the future, it would be worthwhile to pay attention to reflective teaching practices in the training of both medical and psychology students. The cognitive and emotional components of these practices help students to develop their own communication skills. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

  11. Video-based intervention for children with autism: towards improved assessment of pre-requisite imitation skills.

    Science.gov (United States)

    Rayner, Christopher

    2015-04-01

    To explore the relationship between responses to imitation assessment and video-based intervention (VBI) in children with autism. Interview- and observation-based imitation assessments were conducted for five boys with autism prior to VBI across three studies. In two of the three studies, the boys' imitative responses to videos with an animated model and a human model were also compared. Participants who were assessed to have strong imitation skills were also those who responded more positively to VBI. No clear differences were reported in the boys' responses to the equivalent videos with the animated model and the human model. The level of imitation skills required for successful VBI is relative to the target behaviour. Revision of existing imitation assessment measures, as well as development and validation of more comprehensive measures is warranted for use in conjunction with VBI.

  12. Attitudes to proposed assessment of pharmacy skills in Korean pharmacist licensure examination.

    Science.gov (United States)

    Kim, Joo Hee; Lee, Ju-Yeun; Lee, Young Sook; Yong, Chul-Soon; Han, Nayoung; Gwak, Hye Sun; Oh, Jungmi; Lee, Byung Koo; Lee, Sukhyang

    2017-01-01

    The survey aimed to obtain opinions about a proposed implementation of pharmacy skills assessment in Korean pharmacist licensure examination (KPLE). A 16-question survey was distributed electronically to 2,738 people including 570 pharmacy professors of 35 pharmacy schools, 550 preceptors from 865 practice sites and 1,618 students who graduated in 2015. The survey solicited responses concerning the adequacy of the current KPLE in assessing pharmacy knowledge/skills/attitudes, deficiencies of pharmacy skills testing in assessing the professional competencies necessary for pharmacists, plans for pharmacy skills tests in the current KPLE, and subject areas of pharmacy practice. A total of 466 surveys were returned. The current exam is not adequate for assessing skills and attitudes according to 42%-48% of respondents. Sixty percent felt that skills test is necessary to assess qualifications and professional competencies. Almost two-thirds of participants stated that testing should be implemented within 5 years. More than 60% agreed that candidates should be graduates and that written and skills test scores can be combined for pass-fail decisions. About 70% of respondents felt that the test should be less than 2 hours in duration. Over half of the respondents thought that the assessor should be a pharmacy faculty member with at least 5 years of clinical experience. Up to 70% stated that activities related to patient care were appropriate and practical for the scope of skills test. Pharmacy skills assessment was supported by the majority of respondents.

  13. Construct validation of teacher portfolio assessment : Procedures for improving teacher competence assessment illustrated by teaching students research skills

    NARCIS (Netherlands)

    Schaaf, M.F. van der

    2005-01-01

    The study aims to design and test procedures for teacher portfolio assessments. What are suitable procedures to assess teachers' competencies in developing students' research skills? We first searched into the tasks teachers have in teaching students research skills and the competencies needed to

  14. Assessment Work: Examining the Prevalence and Nature of Assessment Competencies and Skills in Student Affairs Job Postings

    Science.gov (United States)

    Hoffman, John L.; Bresciani, Marilee J.

    2010-01-01

    This mixed method study explored the assessment-related skills and job duties that student affairs administrators expect from new employees as reflected in 1,759 job openings posted in 2008, of which seven job postings were specialist positions in outcomes-based assessment. The skills and duties required of these seven positions were primarily…

  15. Helpers' Self-Assessment Biases Before and after Helping Skills Training

    Science.gov (United States)

    Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L.; Van Broeck, Nady; Mikolajczak, Moïra

    2017-01-01

    Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

  16. Helpers' Self-Assessment Biases Before and after Helping Skills Training.

    Science.gov (United States)

    Jaeken, Marine; Zech, Emmanuelle; Brison, Céline; Verhofstadt, Lesley L; Van Broeck, Nady; Mikolajczak, Moïra

    2017-01-01

    Several studies have shown that therapists are generally biased concerning their performed helping skills, as compared to judges' ratings. As clients' ratings of therapists' performance are better predictors of psychotherapy effectiveness than judges' ratings, this study examined the validity and effectiveness of a helping skills training program at reducing novice helpers' self-enhancement biases concerning their helping skills, in comparison to their clients' ratings. Helping skills were assessed by three objective measures (a knowledge multiple choice test, a video test and a role play), as well as by a self- and peer-reported questionnaire. In addition, some performed helping skills' correlates (relationship quality, session quality, and helpers' therapeutic attitudes) were assessed both by helpers and their simulated helpees. Seventy-two sophomores in psychology participated to this study, 37 being assigned to a 12-h helping skills training program, and 35 to a control group. Helpers were expected to assess the aforementioned performed helping skills and correlates as being better than their helpees' assessments at pretest, thus revealing a self-enhancement bias. At posttest, we expected that trained helpers would objectively exhibit better helping skills than untrained helpers while beginning to underestimate their performance, thus indexing a self-diminishment bias. In contrast, we hypothesized that untrained helpers would continue to overestimate their performance. Our hypotheses were only partly confirmed but results reflected a skilled-unaware pattern among trainees. Trained helpers went either from a pretest overestimation to a posttest equivalence (performed helping skills and performed therapeutic attitudes), or from a pretest equivalence to a posttest underestimation (performed session quality and performed therapeutic relationship), as compared to helpees' ratings. Results showed that trained helpers improved on all helping skills objective measures

  17. Innovative learning model for improving students’ argumentation skill and concept understanding on science

    Science.gov (United States)

    Nafsiati Astuti, Rini

    2018-04-01

    Argumentation skill is the ability to compose and maintain arguments consisting of claims, supports for evidence, and strengthened-reasons. Argumentation is an important skill student needs to face the challenges of globalization in the 21st century. It is not an ability that can be developed by itself along with the physical development of human, but it must be developed under nerve like process, giving stimulus so as to require a person to be able to argue. Therefore, teachers should develop students’ skill of arguing in science learning in the classroom. The purpose of this study is to obtain an innovative learning model that are valid in terms of content and construct in improving the skills of argumentation and concept understanding of junior high school students. The assessment of content validity and construct validity was done through Focus Group Discussion (FGD), using the content and construct validation sheet, book model, learning video, and a set of learning aids for one meeting. Assessment results from 3 (three) experts showed that the learning model developed in the category was valid. The validity itself shows that the developed learning model has met the content requirement, the student needs, state of the art, strong theoretical and empirical foundation and construct validity, which has a connection of syntax stages and components of learning model so that it can be applied in the classroom activities

  18. The use of physical assessment skills by registered nurses in Australia: issues for nursing education.

    Science.gov (United States)

    Birks, Melanie; Cant, Robyn; James, Ainsley; Chung, Catherine; Davis, Jenny

    2013-01-01

    The purpose of pre-service nursing education programs is to prepare competent graduates who are able to function as safe, professional registered nurses. An extensive element of these programs is the teaching of physical assessment skills, with most programs educating students to perform over 120 such skills. Previous research from North America suggests that the majority of skills taught to nurses in their pre-service programs are not used in practice. As part of a larger study, an online survey was used to explore use of 121 physical assessment skills by Australian nurses. Recruitment occurred via mailed invitation to members of the Australian Nursing Federation. Data were extracted from 1220 completed questionnaires returned by nurses who were mostly employed in New South Wales, were female and experienced nurses. Respondents indicated that they used only 34% of skills routinely. Results reinforce evidence found in the literature that many of the skills taught to nurses are either not used at all (35.5%) or are used rarely (31%). These findings have implications for the teaching of physical assessment skills in pre-service nursing programs, and raise questions about the value of extensive skills teaching in the context of contemporary health care. Further research into barriers to the use of physical assessment skills in nursing and the need for comprehensive skills preparation for the generalist nurse is likely to offer some solutions to these questions.

  19. Fuzzy Logic as a Tool for Assessing Students’ Knowledge and Skills

    Directory of Open Access Journals (Sweden)

    Michael Gr. Voskoglou

    2013-05-01

    Full Text Available Fuzzy logic, which is based on fuzzy sets theory introduced by Zadeh in 1965, provides a rich and meaningful addition to standard logic. The applications which may be generated from or adapted to fuzzy logic are wide-ranging and provide the opportunity for modeling under conditions which are imprecisely defined. In this article we develop a fuzzy model for assessing student groups’ knowledge and skills. In this model the students’ characteristics under assessment (knowledge of the subject matter, problem solving skills and analogical reasoning abilities are represented as fuzzy subsets of a set of linguistic labels characterizing their performance, and the possibilities of all student profiles are calculated. In this way, a detailed quantitative/qualitative study of the students’ group performance is obtained. The centroid method and the group’s total possibilistic uncertainty are used as defuzzification methods in converting our fuzzy outputs to a crisp number. According to the centroid method, the coordinates of the center of gravity of the graph of the membership function involved provide a measure of the students’ performance. Techniques of assessing the individual students’ abilities are also studied and examples are presented to illustrate the use of our results in practice.

  20. Effectiveness of Video Modeling Provided by Mothers in Teaching Play Skills to Children with Autism

    Science.gov (United States)

    Besler, Fatma; Kurt, Onur

    2016-01-01

    Video modeling is an evidence-based practice that can be used to provide instruction to individuals with autism. Studies show that this instructional practice is effective in teaching many types of skills such as self-help skills, social skills, and academic skills. However, in previous studies, videos used in the video modeling process were…

  1. Nurses' Evaluation of Their Use and Mastery in Health Assessment Skills: Selected Iran's Hospitals.

    Science.gov (United States)

    Adib-Hajbaghery, Mohsen; Safa, Azade

    2013-09-01

    Health assessment skills are of the most important skills which nurses require. The more precise assessment, the better results would be obtained and the quality of patient care would be improved. However, in Iran, few studies have investigated nurses' assessment skills. This study was aimed to assessnurses' evaluation of the learned skills of health assessment and their use. This cross-sectional study was conducted on 200 nurses in Isfahan province hospitals. Data was collected by a questionnaire including demographic data and 120 health assessment skills. Nurses scored their frequency of using and proficiency in skills. Statistical analysis was conducted by ANOVA, Tukey test and independent sample T-tests. The highest level of using and proficiency in skills was related to taking history. Nurses received 87.25% of score in this field. The lowest level of application was in assessment of the urogenital system so that nurses received 16.37% of score in this area. Also the lowest proficiency was in assessment of the nervous system and nurses received 34.58% of score in this area. The level of nurses' proficiency in the health assessment skills was not satisfactory. Modifying the curriculum and cooperating of nurse managers and nursing schools can help to improve the situation.

  2. Teachers' Perceptions of a Fundamental Movement Skill (FMS) Assessment Battery in a School Setting

    Science.gov (United States)

    Lander, Natalie; Morgan, Philip J.; Salmon, Jo; Barnett, Lisa M.

    2016-01-01

    Fundamental movement skills (FMS) competence is low in adolescent girls. An assessment tool for teachers is needed to monitor FMS in this demographic. The present study explored whether the Canadian Agility and Movement Skill Assessment (CAMSA) is feasible for use by physical education (PE) teachers of Australian Year 7 girls in a school setting.…

  3. Teacher Compliance and Accuracy in State Assessment of Student Motor Skill Performance

    Science.gov (United States)

    Hall, Tina J.; Hicklin, Lori K.; French, Karen E.

    2015-01-01

    Purpose: The purpose of this study was to investigate teacher compliance with state mandated assessment protocols and teacher accuracy in assessing student motor skill performance. Method: Middle school teachers (N = 116) submitted eighth grade student motor skill performance data from 318 physical education classes to a trained monitoring…

  4. ASK Standards: Assessment, Skills, and Knowledge Content Standards for Student Affairs Practitioners and Scholars

    Science.gov (United States)

    ACPA College Student Educators International, 2011

    2011-01-01

    The Assessment Skills and Knowledge (ASK) standards seek to articulate the areas of content knowledge, skill and dispositions that student affairs professionals need in order to perform as practitioner-scholars to assess the degree to which students are mastering the learning and development outcomes the professionals intend. Consistent with…

  5. The Impact of Adaptive Complex Assessment on the HOT Skill Development of Students

    Science.gov (United States)

    Raiyn, Jamal; Tilchin, Oleg

    2016-01-01

    In this paper we propose a method for the adaptive complex assessment (ACA) of the higher-order thinking (HOT) skills needed by students for problem solving, and we examine the impact of the method on the development of HOT skills in a problem-based learning (PBL) environment. Complexity in the assessment is provided by initial, formative, and…

  6. Aligning CASAS Competencies and Assessments to Basic Skills Content Standards. Second Edition

    Science.gov (United States)

    CASAS - Comprehensive Adult Student Assessment Systems (NJ1), 2009

    2009-01-01

    Since its inception, the Comprehensive Adult Student Assessment System (CASAS) has focused on teaching and assessing basic skills in contexts that are relevant and important to adult learners. CASAS has developed and continues to refine a highly formalized hierarchy of competencies, the application of basic skills that adults need to be fully…

  7. Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator

    DEFF Research Database (Denmark)

    Larsen, C R; Grantcharov, Teodor; Aggarwal, R

    2006-01-01

    Safe realistic training and unbiased quantitative assessment of technical skills are required for laparoscopy. Virtual reality (VR) simulators may be useful tools for training and assessing basic and advanced surgical skills and procedures. This study aimed to investigate the construct validity...

  8. Validation of Modified Soft Skills Assessment Instrument (MOSSAI) for Use in Nigeria

    Science.gov (United States)

    Aworanti, O. A.; Taiwo, M. B.; Iluobe, O. I.

    2015-01-01

    Currently, it has become an accepted norm nearly all over the globe to teach and assess soft skills. However, in Nigeria, it is an emerging area of interest that needs to be addressed squarely. In the light of the fore-going, this study validated a modified version of Measuring and Assessment Soft Skills (MASS) (an instrument developed and used by…

  9. A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

    Science.gov (United States)

    Winkel, Abigail Ford; Lerner, Veronica; Zabar, Sondra R; Szyld, Demian

    2013-01-01

    Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  10. Clinical skills temporal degradation assessment in undergraduate medical education.

    Science.gov (United States)

    Fisher, Joseph; Viscusi, Rebecca; Ratesic, Adam; Johnstone, Cameron; Kelley, Ross; Tegethoff, Angela M; Bates, Jessica; Situ-Lacasse, Elaine H; Adamas-Rappaport, William J; Amini, Richard

    2018-01-01

    Medical students' ability to learn clinical procedures and competently apply these skills is an essential component of medical education. Complex skills with limited opportunity for practice have been shown to degrade without continued refresher training. To our knowledge there is no evidence that objectively evaluates temporal degradation of clinical skills in undergraduate medical education. The purpose of this study was to evaluate temporal retention of clinical skills among third year medical students. This was a cross-sectional study conducted at four separate time intervals in the cadaver laboratory at a public medical school. Forty-five novice third year medical students were evaluated for retention of skills in the following three procedures: pigtail thoracostomy, femoral line placement, and endotracheal intubation. Prior to the start of third-year medical clerkships, medical students participated in a two-hour didactic session designed to teach clinically relevant materials including the procedures. Prior to the start of their respective surgery clerkships, students were asked to perform the same three procedures and were evaluated by trained emergency medicine and surgery faculty for retention rates, using three validated checklists. Students were then reassessed at six week intervals in four separate groups based on the start date of their respective surgical clerkships. We compared the evaluation results between students tested one week after training and those tested at three later dates for statistically significant differences in score distribution using a one-tailed Wilcoxon Mann-Whitney U-test for non-parametric rank-sum analysis. Retention rates were shown to have a statistically significant decline between six and 12 weeks for all three procedural skills. In the instruction of medical students, skill degradation should be considered when teaching complex technical skills. Based on the statistically significant decline in procedural skills noted

  11. Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

    DEFF Research Database (Denmark)

    Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter

    2013-01-01

    Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training.......Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training....

  12. Measuring Life Skills: Standardizing the Assessment of Youth Development Indicators

    Directory of Open Access Journals (Sweden)

    Mat D. Duerden

    2012-03-01

    Full Text Available While the development of life skills (e.g., communication, problem solving, etc. is a commonly targeted youth program outcome, the lack of standardized conceptualizations and instrumentation make it difficult to compare impacts across programs and develop validated best practices. In order to promote a more unified approach to life skill development, literature reviews were conducted for 10 life skill domains to identify common definitions and, if available, appropriate outcome measures. Data were then collected from an ethnically diverse sample (N = 758 of elementary, middle, and high school aged youth for the 10 identified instruments. Analyses were conducted to ascertain the psychometric qualities of each measure, the interrelationships among measures, and the measures’ relationships with gender, ethnicity, and school level. Results are discussed in terms of their relevance to life skill theory and measurement.

  13. Assessment of Production Skill Acquisition and Strategy for Capacity ...

    African Journals Online (AJOL)

    First Lady

    The study was a survey research which investigated the production skills possessed by .... like creative thinking, decision making, marketing etc. (Olutoyin ... difficult to get teaching jobs or set up and handle their own businesses which resulted ...

  14. Self-assessment and goal-setting is associated with an improvement in interviewing skills.

    Science.gov (United States)

    Hanley, Kathleen; Zabar, Sondra; Charap, Joseph; Nicholson, Joseph; Disney, Lindsey; Kalet, Adina; Gillespie, Colleen

    2014-01-01

    Describe the relationship between medical students' self-assessment and goal-setting (SAGS) skills and development of interviewing skills during the first-year doctoring course. 157 first-year medical students completed three two-case standardized patient (SP) interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. SAGS improved over time (37% good week 1 vs. 61% good week 10). Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills - those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024). For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1-10 and then increased significantly at week 17. For those whose SAGS remained 'poor' in weeks 1-10, interviewing skills declined in weeks 10-17. In general, the quality of students' SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  15. Self-assessment and goal-setting is associated with an improvement in interviewing skills

    Directory of Open Access Journals (Sweden)

    Kathleen Hanley

    2014-07-01

    Full Text Available Purpose: Describe the relationship between medical students’ self-assessment and goal-setting (SAGS skills and development of interviewing skills during the first-year doctoring course. Method: 157 first-year medical students completed three two-case standardized patient (SP interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. Results: SAGS improved over time (37% good week 1 vs. 61% good week 10. Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills – those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024. For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1–10 and then increased significantly at week 17. For those whose SAGS remained ‘poor’ in weeks 1–10, interviewing skills declined in weeks 10–17. Conclusions: In general, the quality of students’ SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  16. The Computerized Perceptual Motor Skills Assessment: A new visual perceptual motor skills evaluation tool for children in early elementary grades.

    Science.gov (United States)

    Howe, Tsu-Hsin; Chen, Hao-Ling; Lee, Candy Chieh; Chen, Ying-Dar; Wang, Tien-Ni

    2017-10-01

    Visual perceptual motor skills have been proposed as underlying courses of handwriting difficulties. However, there is no evaluation tool currently available to assess these skills comprehensively and to serve as a sensitive measure. The purpose of this study was to validate the Computerized Perceptual Motor Skills Assessment (CPMSA), a newly developed evaluation tool for children in early elementary grades. Its test-retest reliability, concurrent validity, discriminant validity, and responsiveness were examined in 43 typically developing children and 26 children with handwriting difficulty. The CPMSA demonstrated excellent reliability across all subtests with intra-class correlation coefficients (ICCs)≥0.80. Significant moderate correlations between the domains of the CPMSA and corresponding gold standards including Beery VMI, the TVPS-3, and the eye-hand coordination subtest of the DTVP-2 demonstrated good concurrent validity. In addition, the CPMSA showed evidence of discriminant validity in samples of children with and without handwriting difficulty. This article provides evidence in support of the CPMSA. The CPMSA is a reliable, valid, and promising measure of visual perceptual motor skills for children in early elementary grades. Directions for future study and improvements to the assessment are discussed. Copyright © 2017. Published by Elsevier Ltd.

  17. Developing thinking skill system for modelling creative thinking and critical thinking of vocational high school student

    Science.gov (United States)

    Dewanto, W. K.; Agustianto, K.; Sari, B. E.

    2018-01-01

    Vocational students must have practical skills in accordance with the purpose of vocational school that creating the skilled graduates according to their field. Graduates of vocational education are required not just as users, but be able to create. Thus requiring critical and creative thinking skills to assist students in generating ideas, analyzing and creating a product of value. Based on this, then this research aims to develop a system to know the level of ability to think critically and creative students, that resulted students can do self-reflection in improving the ability to think critically and creatively as a supporter of practical ability. The system testing using Naïve Bayes Correlation shown an average accuracy of 93.617% in assessing the students’ critical and creative thinking ability. By using modeling with this system will be known level of students’ critical and creative thinking ability, then the output of the system is used to determine the type of innovation in the learning process to improve the critical and creative thinking skills to support the practical skills of students as skilled vocational students.

  18. What should be included in the assessment of laypersons' paediatric basic life support skills?

    DEFF Research Database (Denmark)

    Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim

    2018-01-01

    BACKGROUND: Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign...... body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. METHODS: A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts...... suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts...

  19. Assessing the Development of Medical Students' Personal and Professional Skills by Portfolio.

    Science.gov (United States)

    Yielder, Jill; Moir, Fiona

    2016-01-01

    The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program.

  20. Assessing the Development of Medical Students’ Personal and Professional Skills by Portfolio

    Science.gov (United States)

    Yielder, Jill; Moir, Fiona

    2016-01-01

    The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program. PMID:29349315

  1. Are general surgeons able to accurately self-assess their level of technical skills?

    Science.gov (United States)

    Rizan, C; Ansell, J; Tilston, T W; Warren, N; Torkington, J

    2015-11-01

    Self-assessment is a way of improving technical capabilities without the need for trainer feedback. It can identify areas for improvement and promote professional medical development. The aim of this review was to identify whether self-assessment is an accurate form of technical skills appraisal in general surgery. The PubMed, MEDLINE(®), Embase(™) and Cochrane databases were searched for studies assessing the reliability of self-assessment of technical skills in general surgery. For each study, we recorded the skills assessed and the evaluation methods used. Common endpoints between studies were compared to provide recommendations based on the levels of evidence. Twelve studies met the inclusion criteria from 22,292 initial papers. There was no level 1 evidence published. All papers compared the correlation between self-appraisal versus an expert score but differed in the technical skills assessment and the evaluation tools used. The accuracy of self-assessment improved with increasing experience (level 2 recommendation), age (level 3 recommendation) and the use of video playback (level 3 recommendation). Accuracy was reduced by stressful learning environments (level 2 recommendation), lack of familiarity with assessment tools (level 3 recommendation) and in advanced surgical procedures (level 3 recommendation). Evidence exists to support the reliability of self-assessment of technical skills in general surgery. Several variables have been shown to affect the accuracy of self-assessment of technical skills. Future work should focus on evaluating the reliability of self-assessment during live operating procedures.

  2. Use of human patient simulation and the situation awareness global assessment technique in practical trauma skills assessment.

    Science.gov (United States)

    Hogan, Michael P; Pace, David E; Hapgood, Joanne; Boone, Darrell C

    2006-11-01

    Situation awareness (SA) is defined as the perception of elements in the environment within a volume of time and space, the comprehension of their meaning, and the projection of their status in the near future. This construct is vital to decision making in intense, dynamic environments. It has been used in aviation as it relates to pilot performance, but has not been applied to medical education. The most widely used objective tool for measuring trainee SA is the Situation Awareness Global Assessment Technique (SAGAT). The purpose of this study was to design and validate SAGAT for assessment of practical trauma skills, and to compare SAGAT results to traditional checklist style scoring. Using the Human Patient Simulator, we designed SAGAT for practical trauma skills assessment based on Advanced Trauma Life Support objectives. Sixteen subjects (four staff surgeons, four senior residents, four junior residents, and four medical students) participated in three scenarios each. They were assessed using SAGAT and traditional checklist assessment. A questionnaire was used to assess possible confounding factors in attaining SA and overall trainee satisfaction. SAGAT was found to show significant difference (analysis of variance; p level of training lending statistical support to construct validity. SAGAT was likewise found to display reliability (Cronbach's alpha 0.767), and significant scoring correlation with traditional checklist performance measures (Pearson's coefficient 0.806). The questionnaire revealed no confounding factors and universal satisfaction with the human patient simulator and SAGAT. SAGAT is a valid, reliable assessment tool for trauma trainees in the dynamic clinical environment created by human patient simulation. Information provided by SAGAT could provide specific feedback, direct individualized teaching, and support curriculum change. Introduction of SAGAT could improve the current assessment model for practical trauma education.

  3. Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment.

    Science.gov (United States)

    Barnett, Lisa M; Morgan, Philip J; van Beurden, Eric; Beard, John R

    2008-08-08

    The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile), physical activity (Adolescent Physical Activity Recall Questionnaire) and cardiorespiratory fitness (Multistage Fitness Test). Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw), and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Of 928 original intervention participants, 481 were located in 28 schools and 276 (57%) were assessed with at least one follow-up measure. Slightly more than half were female (52.4%) with a mean age of 16.4 years (range 14.2 to 18.3 yrs). Relevant assessments were completed by 250 (90.6%) students for the Physical Activity Model and 227 (82.3%) for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18) of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30) of fitness variance. Sex did not act as a moderator in either model. Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth.

  4. Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment

    Directory of Open Access Journals (Sweden)

    van Beurden Eric

    2008-08-01

    Full Text Available Abstract Background The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. Methods In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile, physical activity (Adolescent Physical Activity Recall Questionnaire and cardiorespiratory fitness (Multistage Fitness Test. Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw, and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Results Of 928 original intervention participants, 481 were located in 28 schools and 276 (57% were assessed with at least one follow-up measure. Slightly more than half were female (52.4% with a mean age of 16.4 years (range 14.2 to 18.3 yrs. Relevant assessments were completed by 250 (90.6% students for the Physical Activity Model and 227 (82.3% for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18 of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30 of fitness variance. Sex did not act as a moderator in either model. Conclusion Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth.

  5. Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness: a longitudinal assessment

    Science.gov (United States)

    Barnett, Lisa M; Morgan, Philip J; van Beurden, Eric; Beard, John R

    2008-01-01

    Background The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness. Methods In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile), physical activity (Adolescent Physical Activity Recall Questionnaire) and cardiorespiratory fitness (Multistage Fitness Test). Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw), and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness. Results Of 928 original intervention participants, 481 were located in 28 schools and 276 (57%) were assessed with at least one follow-up measure. Slightly more than half were female (52.4%) with a mean age of 16.4 years (range 14.2 to 18.3 yrs). Relevant assessments were completed by 250 (90.6%) students for the Physical Activity Model and 227 (82.3%) for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18) of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30) of fitness variance. Sex did not act as a moderator in either model. Conclusion Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth. PMID:18687148

  6. A Preliminary Investigation of General and Technique-specific Assessments for the Evaluation of Laparoscopic Technical Skills.

    Science.gov (United States)

    Vergis, Ashley; Steigerwald, Sarah

    2017-10-07

    Background  Both general and technique-specific assessments of technical skill have been validated in surgical education. The purpose of this study was to assess the correlation between the objective structured assessment of technical skills (OSATS) and the global operative assessment of laparoscopic skills (GOALS) rating scales using a high-fidelity porcine laparoscopic cholecystectomy model. Methods Post-graduate year-one general surgery and urology residents (n=14) performed a live laparoscopic porcine cholecystectomy. Trained surgeons rated their performance using OSATS and GOALS assessment scales. Results Pearson's correlation coefficient between OSATS and GOALS was 0.96 for overall scores. It ranged from 0.78 - 0.89 for domains that overlapped between the two scales. Conclusion There is a very high correlation between OSATS and GOALS. This implies that they likely measure similar constructs and that either may be used for summative-type assessments of trainee skill. However, further investigation is needed to determine if technique-specific assessments may provide more useful feedback in formative evaluation.

  7. Taxonomy of Trauma Leadership Skills: A Framework for Leadership Training and Assessment.

    Science.gov (United States)

    Leenstra, Nico F; Jung, Oliver C; Johnson, Addie; Wendt, Klaus W; Tulleken, Jaap E

    2016-02-01

    Good leadership is essential for optimal trauma team performance, and targeted training of leadership skills is necessary to achieve such leadership proficiency. To address the need for a taxonomy of leadership skills that specifies the skill components to be learned and the behaviors by which they can be assessed across the five phases of trauma care, the authors developed the Taxonomy of Trauma Leadership Skills (TTLS). Critical incident interviews were conducted with trauma team leaders and members from different specialties-emergency physicians, trauma surgeons, anesthesiologists, and emergency ward nurses-at three teaching hospitals in the Netherlands during January-June 2013. Data were iteratively analyzed for examples of excellent leadership skills at each phase of trauma care. Using the grounded theory approach, elements of excellent leadership skills were identified and classified. Elements and behavioral markers were sorted and categorized using multiple raters. In a two-round verification process in late 2013, the taxonomy was reviewed and rated by trauma team leaders and members from the multiple specialties for its coverage of essential items. Data were gathered from 28 interviews and 14 raters. The TTLS details 5 skill categories (information coordination, decision making, action coordination, communication management, and coaching and team development) and 37 skill elements. The skill elements are captured by 67 behavioral markers. The three-level taxonomy is presented according to five phases of trauma care. The TTLS provides a framework for teaching, learning, and assessing team leadership skills in trauma care and other complex, acute care situations.

  8. Framework of Assessment for the Evaluation of Thinking Skills of Tertiary Level Students

    Directory of Open Access Journals (Sweden)

    Chan Swee Heng

    2015-10-01

    Full Text Available In the 21st century, students are required to master thinking skills in order to deal with many situations that arise in the tertiary environment which later would translate into the workplace. Nowadays, thinking skills play a vital role in tertiary education. To provide an approach for teachers, this paper identifies a 4-step model that can be implemented in test design with reference to Bloom’s Taxonomy for thinking skills. This model illustrates a feasible procedure of test construction built upon existing resource. The procedures can easily be applied to different fields of study. It provides an appropriate way for teachers who may want to add more ideas to their repertoire skills in addressing the learning of HOT (higher-order thinking skills. Keywords: thinking skills, Bloom’s Taxonomy, 4-step model

  9. Assessing musical skills in autistic children who are not savants.

    Science.gov (United States)

    Heaton, Pamela

    2009-05-27

    Descriptions of autistic musical savants suggest that they possess extraordinary skills within the domain. However, until recently little was known about the musical skills and potential of individuals with autism who are not savants. The results from these more recent studies investigating music perception, cognition and learning in musically untrained children with autism have revealed a pattern of abilities that are either enhanced or spared. For example, increased sensitivity to musical pitch and timbre is frequently observed, and studies investigating perception of musical structure and emotions have consistently failed to reveal deficits in autism. While the phenomenon of the savant syndrome is of considerable theoretical interest, it may have led to an under-consideration of the potential talents and skills of that vast majority of autistic individuals, who do not meet savant criteria. Data from empirical studies show that many autistic children possess musical potential that can and should be developed.

  10. The development and validation of a golf swing and putt skill assessment for children.

    Science.gov (United States)

    Barnett, Lisa M; Hardy, Louise L; Brian, Ali S; Robertson, Sam

    2015-03-01

    The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument's discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p < 0.001). The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90) and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82), although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key pointsGolf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level

  11. Attention to gender in communication skills assessment instruments in medical education: a review.

    Science.gov (United States)

    Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

    2011-03-01

    Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

  12. An information-motivation-behavioral skills (IMB) model-based intervention for CABG patients.

    Science.gov (United States)

    Zarani, Fariba; Besharat, Mohammad Ali; Sarami, Gholamreza; Sadeghian, Saeed

    2012-12-01

    In order to benefit from a coronary artery bypass graft (CABG) surgery, patients must adhere to medical recommendations and health advices. Despite the importance of adherence in CABG patients, adherence rates are disappointingly low. Despite the low adherence rates, very few articles regarding adherence-enhancing intervention among heart patients have been published. The goal of this study was to assess the effects of the Information-Motivation-Behavioral Skills (IMB) model-based intervention on the IMB model constructs among patients undergoing CABG and to evaluate the relationship of information, motivation, and behavioral skills with adherence. A total of 152 CABG patients were randomly assigned to either an intervention group or to a standard care control group. Participants completed pretest measures and were reassessed 1 month later. Findings showed mixed support for the effectiveness of the intervention. There was a significant effect of IMB intervention on information and motivation of patients, but no significant effect on behavioral skills. Furthermore, the results revealed that intervention constructs (information, motivation, and behavioral skills) were significantly related to patients' adherence. Findings provided initial evidence for the effectiveness of IMB-based interventions on the IMB constructs and supported the importance of these constructs to improve adherence; however, there are additional factors that need to be identified in order to improve behavioral skills more effectively.

  13. Non-technical skills assessment for prelicensure nursing students: An integrative review.

    Science.gov (United States)

    Pires, Sara; Monteiro, Sara; Pereira, Anabela; Chaló, Daniela; Melo, Elsa; Rodrigues, Alexandre

    2017-11-01

    In nursing, non-technical skills are recognized as playing an important role to increase patient safety and successful clinical outcomes (Pearson and McLafferty, 2011). Non-technical skills are cognitive and social resource skills that complement technical skills and contribute to safe and efficient task performance (Flin et al., 2008). In order to effectively provide non-technical skills training, it is essential to have an instrument to measure these skills. An online search was conducted. Articles were selected if they referred to and/or described instruments assessing non-technical skills for nurses and/or prelicensure nursing students in educational, clinical and/or simulated settings with validation evidence (inclusion criteria). Of the 53 articles located, 26 met the inclusion criteria. Those referred to and/or described 16 instruments with validation evidence developed to assess non-technical skills in multidisciplinary teams including nurses. Although articles have shown 16 valid and reliable instruments, to our knowledge, no instrument has been published or developed and validated for the assessment of non-technical skills of only nurses in general, relevant for use in high-fidelity simulation-based training for prelicensure nursing students. Therefore, there is a need for the development of such an instrument. Copyright © 2017 Elsevier Ltd. All rights reserved.

  14. Development and validation of an instrument to assess and improve clinical consultation skills

    OpenAIRE

    Lefroy, JE; Gay, SP; Gibson, S; Williams, S; McKinley, RK

    2011-01-01

    Context: Development of medical students’ consultation skills with patients is at the core of the UK General Medical Council’s 'Tomorrow’s Doctors' guide (2009). Teaching and assessment of these skills must therefore be a core component of the medical undergraduate curriculum. The Calgary Cambridge guide to the medical interview and the Leicester Assessment Package (LAP) provide a foundation for teaching and assessment, but both have different strengths. Objective: To develop and validate a c...

  15. Cognitive mechanisms underlying third graders' arithmetic skills: Expanding the pathways to mathematics model.

    Science.gov (United States)

    Träff, Ulf; Olsson, Linda; Skagerlund, Kenny; Östergren, Rickard

    2018-03-01

    A modified pathways to mathematics model was used to examine the cognitive mechanisms underlying arithmetic skills in third graders. A total of 269 children were assessed on tasks tapping the four pathways and arithmetic skills. A path analysis showed that symbolic number processing was directly supported by the linguistic and approximate quantitative pathways. The direct contribution from the four pathways to arithmetic proficiency varied; the linguistic pathway supported single-digit arithmetic and word problem solving, whereas the approximate quantitative pathway supported only multi-digit calculation. The spatial processing and verbal working memory pathways supported only arithmetic word problem solving. The notion of hierarchical levels of arithmetic was supported by the results, and the different levels were supported by different constellations of pathways. However, the strongest support to the hierarchical levels of arithmetic were provided by the proximal arithmetic skills. Copyright © 2017 Elsevier Inc. All rights reserved.

  16. MEMFASILITASI HIGHER ORDER TIHINKING SKILLS DALAM PERKULIAHAN BIOLOGI SEL MELALUI MODEL INTEGRASI ATRIBUT ASESMEN FORMATIF

    Directory of Open Access Journals (Sweden)

    Sigit Saptono

    2017-10-01

    Full Text Available ABSTRACTHigher order thinking skills are needed to understand the problem and the essence of the lecture material Biology Sel. Study design Research and Development aims to develop reasoning skills and analytic thinking biology student teachers through the application of learning models Integration Attributes Formative Assessment (IAAF. Some 61 students of Biology Education Semarang State University who is doing his third semester courses Cell Biology is the subject of research. Analytical reasoning and  thinking ability of students is measured through individual assignments, group assignments concept map creation and preparation of the Review articles, and 30 items about the shape of the selected response and constructed response questions, validated questions. The result showed that the ability of reasoning and analytical thinking of students can be expanded significantly, although the development of the ability of argumentation, one category of analytic thinking skills, they need serious attention.

  17. Self vs expert assessment of technical and non-technical skills in high fidelity simulation.

    Science.gov (United States)

    Arora, Sonal; Miskovic, Danilo; Hull, Louise; Moorthy, Krishna; Aggarwal, Rajesh; Johannsson, Helgi; Gautama, Sanjay; Kneebone, Roger; Sevdalis, Nick

    2011-10-01

    Accurate assessment is imperative for learning, feedback and progression. The aim of this study was to examine whether surgeons can accurately self-assess their technical and nontechnical skills compared with expert faculty members' assessments. Twenty-five surgeons performed a laparoscopic cholecystectomy (LC) in a simulated operating room. Technical and nontechnical performance was assessed by participants and faculty members using the validated Objective Structured Assessment of Technical Skills (OSATS) and the Non-Technical Skills for Surgeons scale (NOTSS). Assessment of technical performance correlated between self and faculty members' ratings for experienced (median score, 30.0 vs 31.0; ρ = .831; P = .001) and inexperienced (median score, 22.0 vs 28.0; ρ = .761; P = .003) surgeons. Assessment of nontechnical skills between self and faculty members did not correlate for experienced surgeons (median score, 8.0 vs 10.5; ρ = -.375; P = .229) or their more inexperienced counterparts (median score, 9.0 vs 7.0; ρ = -.018; P = .953). Surgeons can accurately self-assess their technical skills in virtual reality LC. Conversely, formal assessment with faculty members' input is required for nontechnical skills, for which surgeons lack insight into their behaviours. Copyright © 2011 Elsevier Inc. All rights reserved.

  18. Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood.

    Science.gov (United States)

    Logan, Samuel W; Barnett, Lisa M; Goodway, Jacqueline D; Stodden, David F

    2017-04-01

    Process-oriented motor competence (MC) assessments evaluate how a movement is performed. Product-oriented assessments evaluate the outcome of a movement. Determining the concurrent validity of process and product assessments is important to address the predictive utility of motor competence for health. The current study aimed to: (1) compare process and product assessments of the standing long jump, hop and throw across age groups and (2) determine the capacity of process assessments to classify levels of MC. Participants included 170 children classified into three age groups: 4-5, 7-8 and 10-11 years old. Participants' skills were examined concurrently using three process assessments ((Test of Gross Motor Development-2nd edition [TGMD-2]), Get Skilled; Get Active, and developmental sequences) and one product measure (throw speed, jump and hop distance). Results indicate moderate to strong correlations between (1) process assessments across skills and age groups (r range = .37-70) and (2) process and product assessments across skills and age groups (r range = .26-.88). In general, sensitivity to detect advanced skill level is lowest for TGMD-2 and highest for developmental sequences for all three skills. The use of process and product assessments is suggested to comprehensively capture levels of MC in human movement.

  19. Assessing Progress in Mastery of Counseling Communication Skills

    NARCIS (Netherlands)

    A.J. Kuntze (Jeroen)

    2009-01-01

    textabstractDuring the last century the attention paid in higher education to the development of professional skills has progressively increased. In the first half of the last century the term ‘skill’ mainly referred to motor or technical actions, for instance driving a car or operating a machine

  20. Assessment of Library Instruction and Library Literacy Skills of First ...

    African Journals Online (AJOL)

    This study investigated the effectiveness and impact of library instruction (GST 111 – the use of library) course on library literacy skills of first year undergraduate students. The study adopted the descriptive survey research method and questionnaire was used as the research instrument. First year undergraduate students of ...

  1. Assessing Aptitude and Attitude Development in a Translation Skills Course

    Science.gov (United States)

    Mekheimer, Mohamed Amin A.

    2012-01-01

    This study investigates the effects on EFL students of using Blackboard technology and online dictionaries in developing translating skills and building positive attitudes towards translation in male Saudi college students. The study compares two groups of students in a translation course; one in a traditional, face-to-face setting (control) and…

  2. The Use of Rubrics in Benchmarking and Assessing Employability Skills

    Science.gov (United States)

    Riebe, Linda; Jackson, Denise

    2014-01-01

    Calls for employability skill development in undergraduates now extend across many culturally similar developed economies. Government initiatives, industry professional accreditation criteria, and the development of academic teaching and learning standards increasingly drive the employability agenda, further cementing the need for skill…

  3. Assessing Practical Skills in Physics Using Computer Simulations

    Science.gov (United States)

    Walsh, Kevin

    2018-01-01

    Computer simulations have been used very effectively for many years in the teaching of science but the focus has been on cognitive development. This study, however, is an investigation into the possibility that a student's experimental skills in the real-world environment can be judged via the undertaking of a suitably chosen computer simulation…

  4. Assessing 21st Century Skills: Summary of a Workshop

    Science.gov (United States)

    Koenig, Judith Anderson

    2011-01-01

    The routine jobs of yesterday are being replaced by technology and/or shipped off-shore. In their place, job categories that require knowledge management, abstract reasoning, and personal services seem to be growing. The modern workplace requires workers to have broad cognitive and affective skills. Often referred to as "21st century…

  5. Effect of simulated emergency skills training and assessments on ...

    African Journals Online (AJOL)

    ... of emergency skills in simulation was highly effective in enhancing the competence and confidence of medical students when managing a clinical emergency. However, students appeared to be overconfident, which could be ascribed to ignorance, and possibly indicates that feedback during training should be improved.

  6. Pain assessment and medications use among daily paid skilled ...

    African Journals Online (AJOL)

    Paracetamol 186(46.5%) was the most commonly used analgesic followed by Ibuprofen 100(25%). The pain experienced by daily paid skilled workers was found to be work- related musculoskeletal disorder. There is a need for establishment of intervention programs to reduce the risk of work - related musculoskeletal ...

  7. Measuring patient-provider communication skills in Rwanda: Selection, adaptation and assessment of psychometric properties of the Communication Assessment Tool.

    Science.gov (United States)

    Cubaka, Vincent Kalumire; Schriver, Michael; Vedsted, Peter; Makoul, Gregory; Kallestrup, Per

    2018-04-23

    To identify, adapt and validate a measure for providers' communication and interpersonal skills in Rwanda. After selection, translation and piloting of the measure, structural validity, test-retest reliability, and differential item functioning were assessed. Identification and adaptation: The 14-item Communication Assessment Tool (CAT) was selected and adapted. Content validation found all items highly relevant in the local context except two, which were retained upon understanding the reasoning applied by patients. Eleven providers and 291 patients were involved in the field-testing. Confirmatory factor analysis showed a good fit for the original one factor model. Test-retest reliability assessment revealed a mean quadratic weighted Kappa = 0.81 (range: 0.69-0.89, N = 57). The average proportion of excellent scores was 15.7% (SD: 24.7, range: 9.9-21.8%, N = 180). Differential item functioning was not observed except for item 1, which focuses on greetings, for age groups (p = 0.02, N = 180). The Kinyarwanda version of CAT (K-CAT) is a reliable and valid patient-reported measure of providers' communication and interpersonal skills. K-CAT was validated on nurses and its use on other types of providers may require further validation. K-CAT is expected to be a valuable feedback tool for providers in practice and in training. Copyright © 2018 Elsevier B.V. All rights reserved.

  8. How can teachers assess reading skills of generation z learners in German language class?

    Science.gov (United States)

    Dirga, R. N.; Wijayati, P. H.

    2018-01-01

    Generation Z is a digital native generation who has unique characteristics on the daily basis includes reading. In order to assess their reading skills correctly, teachers need to take these characteristics into consideration. This paper aims to describe the process in developing an instrument to assess reading skills of Generation Z learners in German language class. This study used developmental method. The developed instrument has not only good quality but also consists of texts that are suitable for German learners of Generation Z. This instrument can be used as an example in assessing German learners’ reading skills in the 21st century.

  9. Comparison of the Effectiveness of a Virtual Simulator With a Plastic Arm Model in Teaching Intravenous Catheter Insertion Skills.

    Science.gov (United States)

    Günay İsmailoğlu, Elif; Zaybak, Ayten

    2018-02-01

    The objective of this study was to compare the effectiveness of a virtual intravenous simulator with a plastic arm model in teaching intravenous catheter insertion skills to nursing students. We used a randomized controlled quasi-experimental trial design and recruited 65 students who were assigned to the experimental (n = 33) and control (n = 32) groups using the simple random sampling method. The experimental group received intravenous catheterization skills training on the virtual intravenous simulator, and the control group received the same training on a plastic model of a human arm. Data were collected using the personal information form, intravenous catheterization knowledge assessment form, Intravenous Catheterization Skill Test, Self-Confidence and Satisfaction Scale, and Fear Symptoms Scale. In the study, the mean scores in the control group were 20.44 for psychomotor skills, 15.62 for clinical psychomotor skills, 31.78 for self-confidence, and 21.77 for satisfaction. The mean scores in the experimental group were 45.18 for psychomotor skills, 16.28 for clinical psychomotor skills, 34.18 for self-confidence, and 43.89 for satisfaction. The results indicated that psychomotor skills and satisfaction scores were higher in the experimental group, while the clinical psychomotor skills and self-confidence scores were similar in both groups. More students in the control group reported experiencing symptoms such as cold and sweaty hands, significant restlessness, and tense muscles than those in the experimental group.

  10. Self- and rater-assessed effectiveness of "thinking-aloud" and "regular" morning report to intensify young physicians' clinical skills.

    Science.gov (United States)

    Hsu, Hui-Chi; Lee, Fa-Yauh; Yang, Ying-Ying; Tsao, Yen-Po; Lee, Wen-Shin; Chuang, Chiao-Lin; Chang, Ching-Chih; Huang, Chia-Chang; Huang, Chin-Chou; Ho, Shung-Tai

    2015-09-01

    This study compared the effects of the "thinking aloud" (TA) morning report (MR), which is characterized by sequential and interactive case discussion by all participants, with "regular" MR for clinical skill training of young physicians. Between February 2011 and February 2014, young physicians [including postgraduate year-1 (PGY1) residents, interns, and clerks) from our hospital were sequentially enrolled and followed for 3 months. The self- and rater-assessed educational values of two MR models for building up clinical skills of young physicians were compared. The junior (intern and clerk) attendees had higher self-assessed educational values scores and reported post-training application frequency of skills trained by TA MR compared with the senior (PGY1 resident) attendees. Higher average and percentage of increased overall rater-assessed OSCE scores were noted among the regular MR senior attendees and TA MR junior attendees than in their corresponding control groups (regular MR junior attendees and TA MR senior attendees). Interestingly, regular MRs provided additional beneficial effects for establishing the "professionalism, consulting skills and organization efficiency" aspects of clinical skills of senior/junior attendees. Moreover, senior and junior attendees benefited the most by participating in seven sessions of regular MR and TA MR each month, respectively. TA MR effectively trains junior attendees in basic clinical skills, whereas regular MR enhances senior attendees' "work reports, professionalism, organizational efficiency, skills in dealing with controversial and professional issues." Undoubtedly, all elements of the two MR models should be integrated together to ensure patient safety and good discipline among young physicians. Copyright © 2015. Published by Elsevier Taiwan.

  11. Assessing Leadership and Problem-Solving Skills and Their Impacts in the Community.

    Science.gov (United States)

    Rohs, F. Richard; Langone, Christine A.

    1993-01-01

    A pretest-posttest control group design was used to assess the leadership and problem-solving skills of 281 participants and 110 controls in a statewide community leadership development program. Quantitative and qualitative data demonstrate that the program has been a catalyst to influence leadership and problem-solving skills for community…

  12. Information Literacy Follow-Through: Enhancing Preservice Teachers' Information Evaluation Skills through Formative Assessment

    Science.gov (United States)

    Seely, Sara Robertson; Fry, Sara Winstead; Ruppel, Margie

    2011-01-01

    An investigation into preservice teachers' information evaluation skills at a large university suggests that formative assessment can improve student achievement. Preservice teachers were asked to apply information evaluation skills in the areas of currency, relevancy, authority, accuracy, and purpose. The study used quantitative methods to assess…

  13. A Summary of an Assessment of Fourth and Sixth Grade Basic Skills.

    Science.gov (United States)

    CTB / McGraw-Hill, Monterey, CA.

    A comprehensive assessment was made of the status of elementary education in Missouri in reading, mathematics, language, and study skills. The Comprehensive Tests of Basic Skills (CTBS) and the Short Form Test of Academic Aptitude (SFTAA) were administered to a sample of Missouri fourth and sixth graders. For each curricular area, Missouri…

  14. Self-Assessment of Video-Recorded Presentations: Does It Improve Skills?

    Science.gov (United States)

    Ritchie, Sian M.

    2016-01-01

    The opportunity to give oral presentations is important because it helps develop skills that are necessary for many aspects of professional careers. Competencies for oral presentations include appropriate content, design and organization of the presentation, and delivery skills. Self-assessment has been shown to help students develop…

  15. Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

    Science.gov (United States)

    Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

    2017-01-01

    Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

  16. Assessment and Teaching of Science Skills: Whole of Programme Perceptions of Graduating Students

    Science.gov (United States)

    Hodgson, Yvonne; Varsavsky, Cristina; Matthews, Kelly E.

    2014-01-01

    This study reports on science student perceptions of their skills (scientific knowledge, oral communication, scientific writing, quantitative skills, teamwork and ethical thinking) as they approach graduation. The focus is on which teaching activities and assessment tasks over the whole programme of study students thought utilised each of the six…

  17. The Promotion of Critical Thinking Skills in School-Based Assessment (SBA)

    Science.gov (United States)

    Kamarulzaman, Wirawani; Kamarulzaman, Wirawahida

    2016-01-01

    The new curriculum introduced in the Malaysian primary students; the Primary School Standard Curriculum (Kurikulum Standard Sekolah Rendah-KSSR) together with the school-based assessment (SBA) is a step taken by the Malaysian government to encourage thinking skills to students, specifically critical thinking skills. The study explores teachers'…

  18. [Use of physical assessment skills and education needs of advanced practice nurses and nurse specialists].

    Science.gov (United States)

    Shin, Hyunsook; Kim, Bog-Ja; Kang, Hee Sun

    2009-10-01

    The study was done to investigate physical assessment skills used by, and educational needs of, advanced practice nurses (APNs) and nurse specialists in Korea. A total of 123 APNs and nurse specialists working in five major hospitals in Seoul were surveyed from July 15 to August 20, 2007. Fourteen skills out of 126 items were reported as being performed on a regular basis by participants. The majority of these skills involved general observation. Forty-six skills were rarely used. Some participants showed a lack of confidence in certain assessment skills, such as in doing a rectal or pelvic exam, and the use of some assessment equipment. Over 90% of participants required in-depth education on health assessment provided by specialists or nursing professional organizations. More educational opportunities in physical assessment should be provided including education programs based on the nurses' skill levels and needs. This effort will help to increase confidence of APNs and nurse specialists in physical assessment skills, ultimately resulting in better nursing outcomes.

  19. Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

    Science.gov (United States)

    Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

    2015-07-01

    Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

  20. The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

    Science.gov (United States)

    Barnett, Lisa M.; Hardy, Louise L.; Brian, Ali S.; Robertson, Sam

    2015-01-01

    The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p golf coaches and physical education teachers as part of systematic early player assessment and feedback. Key points Golf is becoming an increasingly popular sport among young children, however there is no standard protocol available to assess and identify skill deficits, mastery level, and talent identification in beginner young golf players. Process rather than product oriented outcomes better identify areas of skill deficit in young children. The proposed swing and putt instrument can reliably identify skill deficits in children of elementary school age who are new to golf and can be used by a range

  1. Self-Assessment of Employability Skill Outcomes among Undergraduates and Alignment with Academic Ratings

    Science.gov (United States)

    Jackson, Denise

    2014-01-01

    Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in overrating and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in…

  2. Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists

    DEFF Research Database (Denmark)

    Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter; Konge, Lars

    2016-01-01

    Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N......-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse...... nontechnical skills of nurse anesthetists....

  3. A Comparison of Assessment Tools: Is Direct Observation an Improvement Over Objective Structured Clinical Examinations for Communications Skills Evaluation?

    Science.gov (United States)

    Goch, Abraham M; Karia, Raj; Taormina, David; Kalet, Adina; Zuckerman, Joseph; Egol, Kenneth A; Phillips, Donna

    2018-04-01

    Evaluation of resident physicians' communications skills is a challenging task and is increasingly accomplished with standardized examinations. There exists a need to identify the effective, efficient methods for assessment of communications skills. We compared objective structured clinical examination (OSCE) and direct observation as approaches for assessing resident communications skills. We conducted a retrospective cohort analysis of orthopaedic surgery resident physicians at a single tertiary care academic institution, using the Institute for Healthcare Communication "4 Es" model for effective communication. Data were collected between 2011 and 2015. A total of 28 residents, each with OSCE and complete direct observation assessment checklists, were included in the analysis. Residents were included if they had 1 OSCE assessment and 2 or more complete direct observation assessments. There were 28 of a possible 59 residents (47%) included. A total of 89% (25 of 28) of residents passed the communications skills OSCE; only 54% (15 of 28) of residents passed the direct observation communications assessment. There was a positive, moderate correlation between OSCE and direct observation scores overall ( r  = 0.415, P  = .028). There was no agreement between OSCE and direct observation in categorizing residents into passing and failing scores (κ = 0.205, P  = .16), after adjusting for chance agreement. Our results suggest that OSCE and direct observation tools provide different insights into resident communications skills (simulation of rare and challenging situations versus real-life daily encounters), and may provide useful perspectives on resident communications skills in different contexts.

  4. Developing model-making and model-breaking skills using direct measurement video-based activities

    Science.gov (United States)

    Vonk, Matthew; Bohacek, Peter; Militello, Cheryl; Iverson, Ellen

    2017-12-01

    This study focuses on student development of two important laboratory skills in the context of introductory college-level physics. The first skill, which we call model making, is the ability to analyze a phenomenon in a way that produces a quantitative multimodal model. The second skill, which we call model breaking, is the ability to critically evaluate if the behavior of a system is consistent with a given model. This study involved 116 introductory physics students in four different sections, each taught by a different instructor. All of the students within a given class section participated in the same instruction (including labs) with the exception of five activities performed throughout the semester. For those five activities, each class section was split into two groups; one group was scaffolded to focus on model-making skills and the other was scaffolded to focus on model-breaking skills. Both conditions involved direct measurement videos. In some cases, students could vary important experimental parameters within the video like mass, frequency, and tension. Data collected at the end of the semester indicate that students in the model-making treatment group significantly outperformed the other group on the model-making skill despite the fact that both groups shared a common physical lab experience. Likewise, the model-breaking treatment group significantly outperformed the other group on the model-breaking skill. This is important because it shows that direct measurement video-based instruction can help students acquire science-process skills, which are critical for scientists, and which are a key part of current science education approaches such as the Next Generation Science Standards and the Advanced Placement Physics 1 course.

  5. Integrated Assessment Model Evaluation

    Science.gov (United States)

    Smith, S. J.; Clarke, L.; Edmonds, J. A.; Weyant, J. P.

    2012-12-01

    Integrated assessment models of climate change (IAMs) are widely used to provide insights into the dynamics of the coupled human and socio-economic system, including emission mitigation analysis and the generation of future emission scenarios. Similar to the climate modeling community, the integrated assessment community has a two decade history of model inter-comparison, which has served as one of the primary venues for model evaluation and confirmation. While analysis of historical trends in the socio-economic system has long played a key role in diagnostics of future scenarios from IAMs, formal hindcast experiments are just now being contemplated as evaluation exercises. Some initial thoughts on setting up such IAM evaluation experiments are discussed. Socio-economic systems do not follow strict physical laws, which means that evaluation needs to take place in a context, unlike that of physical system models, in which there are few fixed, unchanging relationships. Of course strict validation of even earth system models is not possible (Oreskes etal 2004), a fact borne out by the inability of models to constrain the climate sensitivity. Energy-system models have also been grappling with some of the same questions over the last quarter century. For example, one of "the many questions in the energy field that are waiting for answers in the next 20 years" identified by Hans Landsberg in 1985 was "Will the price of oil resume its upward movement?" Of course we are still asking this question today. While, arguably, even fewer constraints apply to socio-economic systems, numerous historical trends and patterns have been identified, although often only in broad terms, that are used to guide the development of model components, parameter ranges, and scenario assumptions. IAM evaluation exercises are expected to provide useful information for interpreting model results and improving model behavior. A key step is the recognition of model boundaries, that is, what is inside

  6. Employability Skills among Students and Employers’ Perceptions: An Assessment of Levels of Employability Skills Acquired by Business Students at Ishik University

    Directory of Open Access Journals (Sweden)

    Fayeq Ali Ali

    2017-01-01

    Full Text Available Skills are prerequisite for managers and employees success, especially for newly graduate students. This study is to evaluate the employability skills of business students at Ishik University and to assess how employability skills are perceived by potential employers. Three sets of employability skills have been used in this study such as basic academic skills, high-order thinking, and personal qualities. A questionnaire has been developed which included above dimensions and was distributed among students in the faculty of administrative sciences and economics at Ishik University, Kurdistan Region. Respondents’ opinions were assessed using a Likert scale analysis that shows divergent opinions between two extremes of levels of agreement and disagreement. Another technique of an open-ended questionnaire was used when conducting interviews with a few of the potential employers in some private sector companies. Study focuses on the common employability skills of business graduates by evaluating the faculty of administrative sciences and economics courses. Study find out that communication skills, team working skills, computer skills, and critical thinking were among the employability skills which are expected by potential employers. The paper concludes that business graduates have developed an adequate level of employability skill through their years of academic training at business department in Ishik University. Thus, the curriculum of business department at Ishik University is adequately developed to prompt the employability skills that are sought by potential employers that every business student should acquire to stand out in the aggressively competitive job market.

  7. Nursing assessment of older people who are in hospital: exploring registered nurses' understanding of their assessment skills.

    Science.gov (United States)

    Penney, Wendy; Poulter, Nola; Cole, Clare; Wellard, Sally

    2016-01-01

    Nurses worldwide are expected to take a leading role in caring for older people. Considerable literature dedicated to the range and application of assessment skills used by nurses vary. There is limited knowledge of registered nurses' (RNs) views of their assessment of older adults. The aim of this project was to explore RNs current perceptions of nursing assessment, and the core skills they identified as necessary. A qualitative descriptive design study was conducted in three inpatient units in one regional hospital in Victoria. Date were collected through participant observation of RNs (n = 13) followed by 1:1 semi-structured interviews. Data were analysed thematically. This research has illuminated that an ill-defined repertoire of skills was used by RNs when assessing older persons. Skills identified appeared to be based on years of personal-professional experience. Differences were noted between the descriptions nurses gave and what was observed during interactions with older persons.

  8. Teaching and Assessing Manipulative Motor Skills in High School Physical Education

    Science.gov (United States)

    Bert, Greg

    2015-01-01

    This article provides new ways to teach and assess motor skills in various lifetime sports such as tennis, golf, badminton, and other sports that students are likely to play as adults by focusing on five basic biomechanical principles.

  9. Systematic Observation: Relevance of This Approach in Preschool Executive Function Assessment and Association with Later Academic Skills.

    Science.gov (United States)

    Escolano-Pérez, Elena; Herrero-Nivela, Maria Luisa; Blanco-Villaseñor, Angel; Anguera, M Teresa

    2017-01-01

    Executive functions (EFs) are high-level cognitive processes that allow us to coordinate our actions, thoughts, and emotions, enabling us to perform complex tasks. An increasing number of studies have highlighted the role of EFs in building a solid foundation for subsequent development and learning and shown that EFs are associated with good adjustment and academic skills. The main objective of this study was to analyze whether EF levels in 44 Spanish children in the last year of preschool were associated with levels of literacy and math skills the following year, that is, in the first year of compulsory education. We used a multi-method design, which consisted of systematic observation to observe preschool children during play and selective methodology to assess their reading, writing, and math skills in the first year of compulsory primary education. General linear modeling was used to estimate the percentage of variability in academic skills in the first year of primary school that was explained by preschool EF abilities. The results showed that preschool EF level, together with participants and the instrument used to assess academic skills, explained 99% of the variance of subsequent academic performance. Another objective was to determine whether our findings were generalizable to the reference population. To make this determination, we estimated the optimal sample size for assessing preschool EFs. To do this, we performed a generalizability analysis. The resulting generalizability coefficient showed that our sample of 44 students was sufficient for assessing preschool EFs. Therefore, our results are generalizable to the reference population. Our results are consistent with previous reports that preschool EF abilities may be associated with subsequent literacy and math skills. Early assessment of EFs may therefore contribute to identifying children who are likely to experience later learning difficulties and guide the design of suitable interventions for the

  10. Curriculum learning designs: teaching health assessment skills for advanced nursing practitioners through sustainable flexible learning.

    Science.gov (United States)

    Fitzgerald, Les; Wong, Pauline; Hannon, John; Solberg Tokerud, Marte; Lyons, Judith

    2013-10-01

    Innovative curriculum designs are vital for effective learning in contemporary nursing education where traditional modes of delivery are not adequate to meet the learning needs of postgraduate students. This instance of postgraduate teaching in a distributed learning environment offered the opportunity to design a flexible learning model for teaching advanced clinical skills. To present a sustainable model for flexible learning that enables specialist nurses to gain postgraduate qualifications without on-campus class attendance by teaching and assessing clinical health care skills in an authentic workplace setting. An action research methodology was used to gather evidence and report on the process of curriculum development of a core unit, Comprehensive Health Assessment (CHA), within 13 different postgraduate speciality courses. Qualitative data was collected from 27 teaching academics, 21 clinical specialist staff, and 7 hospital managers via interviews, focus groups and journal reflections. Evaluations from the initial iteration of CHA from 36 students were obtained. Data was analyzed to develop and evaluate the curriculum design of CHA. The key factors indicated by participants in the curriculum design process were coordination and structuring of teaching and assessment; integration of content development; working with technologies, balancing specialities and core knowledge; and managing induction and expectations. A set of recommendations emerged as a result of the action research process. These included: a constructive alignment approach to curriculum design; the production of a facilitator's guide that specifies expectations and unit information for academic and clinical education staff; an agreed template for content authors; and the inclusion of synchronous communication for real-time online tutoring. The highlight of the project was that it built curriculum design capabilities of clinicians and students which can sustain this alternative model of online

  11. OSCE vs. TEM: Different approaches to assess clinical skills of nursing students

    Directory of Open Access Journals (Sweden)

    Prasuna Jelly

    2017-01-01

    Full Text Available Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001. The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM.

  12. Assessment of validity of an OSATS for cystoscopic and ureteroscopic cognitive and psychomotor skills.

    Science.gov (United States)

    Kishore, Thekke Adiyat; Pedro, Renato N; Monga, Manoj; Sweet, Robert M

    2008-12-01

    The purpose of the study was to assess the construct validity of an Objective Structured Assessment of Technical Skills (OSATS) developed for cystoscopic and ureteroscopic cognitive and psychomotor skills. An OSATS was designed based on a 14-point comprehensive curriculum prepared by two experts that targeted both cognitive and psychomotor cystoscopic and ureteroscopic skills. Ten urology residents from a single institution with different levels of training were assessed on a series of stations that targeted these skills. Evaluation of cognitive skills was done via a written examination, and psychomotor skills assessment was done by experts using both subjective and objective metrics. Twelve of 15 cognitive tasks and 5 of 5 psychomotor tasks demonstrated construct validity with correlation coefficient (r) more than .75. All three of the cognitive tasks that failed to initially demonstrate validity did so on editorial revision and restructuring of the questions. Our cystoscopic and ureteroscopic OSATS showed excellent construct validity for our population of residents, and we have incorporated it into our urologic skills curriculum.

  13. Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

    NARCIS (Netherlands)

    Rusman, Ellen; Nadolski, Rob; Boon, Jo; Ackermans, Kevin

    2016-01-01

    To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities.

  14. Framework of Assessment for the Evaluation of Thinking Skills of Tertiary Level Students

    Science.gov (United States)

    Heng, Chan Swee; Ziguang, Yan

    2015-01-01

    In the 21st century, students are required to master thinking skills in order to deal with many situations that arise in the tertiary environment which later would translate into the workplace. Nowadays, thinking skills play a vital role in tertiary education. To provide an approach for teachers, this paper identifies a 4-step model that can be…

  15. Psychomotor skills assessment by motion analysis in minimally invasive surgery on an animal organ.

    Science.gov (United States)

    Hofstad, Erlend Fagertun; Våpenstad, Cecilie; Bø, Lars Eirik; Langø, Thomas; Kuhry, Esther; Mårvik, Ronald

    2017-08-01

    A high level of psychomotor skills is required to perform minimally invasive surgery (MIS) safely. To be able to measure these skills is important in the assessment of surgeons, as it enables constructive feedback during training. The aim of this study was to test the validity of an objective and automatic assessment method using motion analysis during a laparoscopic procedure on an animal organ. Experienced surgeons in laparoscopy (experts) and medical students (novices) performed a cholecystectomy on a porcine liver box model. The motions of the surgical tools were acquired and analyzed by 11 different motion-related metrics, i.e., a total of 19 metrics as eight of them were measured separately for each hand. We identified for which of the metrics the experts outperformed the novices. In total, two experts and 28 novices were included. The experts achieved significantly better results for 13 of the 19 instrument motion metrics. Expert performance is characterized by a low time to complete the cholecystectomy, high bimanual dexterity (instrument coordination), a limited amount of movement and low measurement of motion smoothness of the dissection instrument, and relatively high usage of the grasper to optimize tissue positioning for dissection.

  16. Development of a Social Skills Assessment Screening Scale for Psychiatric Rehabilitation Settings: A Pilot Study.

    Science.gov (United States)

    Bhola, Poornima; Basavarajappa, Chethan; Guruprasad, Deepti; Hegde, Gayatri; Khanam, Fatema; Thirthalli, Jagadisha; Chaturvedi, Santosh K

    2016-01-01

    Deficits in social skills may present in a range of psychiatric disorders, particularly in the more serious and persistent conditions, and have an influence on functioning across various domains. This pilot study aimed at developing a brief measure, for structured evaluation and screening for social skills deficits, which can be easily integrated into routine clinical practice. The sample consisted of 380 inpatients and their accompanying caregivers, referred to Psychiatric Rehabilitation Services at a tertiary care government psychiatric hospital. The evaluation included an Inpatient intake Proforma and the 20-item Social Skills Assessment Screening Scale (SSASS). Disability was assessed using the Indian Disability Evaluation and Assessment Scale (IDEAS) for a subset of 94 inpatients. The analysis included means and standard deviations, frequency and percentages, Cronbach's alpha to assess internal consistency, t -tests to assess differences in social skills deficits between select subgroups, and correlation between SSASS and IDEAS scores. The results indicated the profile of social skills deficits assessed among the inpatients with varied psychiatric diagnoses. The "psychosis" group exhibited significantly higher deficits than the "mood disorder" group. Results indicated high internal consistency of the SSASS and adequate criterion validity demonstrated by correlations with select IDEAS domains. Modifications were made to the SSASS following the pilot study. The SSASS has potential value as a measure for screening and individualised intervention plans for social skills training in mental health and rehabilitation settings. The implications for future work on the psychometric properties and clinical applications are discussed.

  17. Improving Critical Thinking Skills of College Students through RMS Model for Learning Basic Concepts in Science

    Science.gov (United States)

    Muhlisin, Ahmad; Susilo, Herawati; Amin, Mohamad; Rohman, Fatchur

    2016-01-01

    The purposes of this study were to: 1) Examine the effect of RMS learning model towards critical thinking skills. 2) Examine the effect of different academic abilities against critical thinking skills. 3) Examine the effect of the interaction between RMS learning model and different academic abilities against critical thinking skills. The research…

  18. A new approach to assessing skill needs of senior managers.

    Science.gov (United States)

    Griffith, John R; Warden, Gail L; Neighbors, Kamilah; Shim, Beth

    2002-01-01

    Management of health care organizations must improve to meet the well-documented challenges of quality improvement and cost control. Other industries have developed the tools--entry education, mentoring, planned mid-career formal education and experience, and special programs for senior management. The purpose of this paper is to pilot test an alternative method to identify competencies and performance of health care executives. We propose using formal lists of technical, interpersonal, and strategic competencies and specific real events chosen by the respondent to identify and prioritize competencies. Results of a trial with 30 large health care system CEOs and 15 early careerists demonstrate that the method reveals useful depth and detail about managers' educational needs. The results suggest that current thinking about managerial education and learning patterns may be seriously inadequate in several respects. The continued improvement of U.S. health care is a pressing national concern. Quality of care is highly variable and substantially deficient in many institutions (Chassin and Galvin 1998; Committee on Quality of Health Care in America 2001). "Quality improvement should be the essential business strategy for healthcare in the 21st century (Kizer 2001)." Productivity improvements will be essential to balance cost pressures from an aging population and growing technology (Heffler, et al. 2002). Skillful management is necessary to improve quality and productivity. Teams of dozens of caregivers are often required to improve a patient's health. The organizations that provide care have grown larger in response to the greater cost, complexity of operation and finance, and evidence of the success of scale in other industries. While many small professional practices, hospitals, and nursing homes remain, consolidation has created a few dozen provider and intermediary organizations exceeding a billion dollars a year in expenditures. These large health care

  19. [Assessment of clinical observation skills of last year medical students].

    Science.gov (United States)

    Steichen, O; Georgin-Lavialle, S; Grateau, G; Ranque, B

    2015-05-01

    Clinical examination skills are poorly evaluated by theoretical tests. We observed the clinical examination of real patients by 6th year medical students. Four internists involved in teaching activities defined 11 clinical examination items, with two objective performance criteria each. The students were evaluated in two internal medicine departments during the rotation preceding or following their national graduation test. Scores by item and by criterion and an overall score were calculated and correlated with their rank at the national graduation test. Thirty-two students were evaluated in one department and 18 in the other; each evaluation lasted approximately 30 minutes. The results were similar in both departments. Only 2 items got a score over 75% in this students' sample (acute respiratory failure, peripheral pulses); 4 items were satisfied at less than 50% (lymph nodes, right heart failure, liver failure, and attention). The mean overall score was 6.5/11 (standard deviation 1.5). National rankings were good (median 1605/8001, interquartile 453-3036) but uncorrelated with the global score (Spearman coefficient -0.13; P=0.39). Bedside evaluation of the students reveals substantial deficiencies, a few months or weeks before taking their position as residents. Several elementary skills are mastered by a minority of them (search for an asterixis, distended jugular veins, deep tendon reflexes), even among those successful at the national graduation test. Bedside evaluation of clinical examination skills should be more systematically performed. Copyright © 2014 Société nationale française de médecine interne (SNFMI). Published by Elsevier SAS. All rights reserved.

  20. Video and accelerometer-based motion analysis for automated surgical skills assessment.

    Science.gov (United States)

    Zia, Aneeq; Sharma, Yachna; Bettadapura, Vinay; Sarin, Eric L; Essa, Irfan

    2018-03-01

    Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

  1. Assessment of collaborative problem solving skills in Undergraduate Medical Students at Ziauddin College of Medicine, Karachi.

    Science.gov (United States)

    Mughal, Arsalan Manzoor; Shaikh, Sirajul Haque

    2018-01-01

    Collaborative Problem Solving Empirical Progressions from the Assessment and Teaching of 21st Century Skills (ATC21S) framework were used to determine the level of collaborative problem solving skills (CPS) in first, second and third year MBBS students at Ziauddin College of Medicine during Problem-Based Learning (PBL) sessions. Variations based on gender and roles were studied. It is an analytical comparative cross-sectional study in which seven PBL groups were selected per year by non-probability convenient sampling. Data was collected using the Collaborative Problem Solving Five Strands Empirical Progressions by the primary investigator through observation of the students during PBL sessions. Duration of study was six months. We found that in our students, development of social dimension skills is facilitated to a greater extent than the development of cognitive dimension skills through the process of PBL. These skills are generally better developed in the leader compared to the scribe and members in a group. They are also more developed in females compared to males. Modification in them is also observed as the year's progress. Although PBLs facilitate development of CPS skills' progression however in our curriculum, PBLs mainly focus on social skills development and have less emphasis on cognitive skill development. Thus, hybrid instructional strategies with components from TBL and mentorship are recommended for better development of CPS skills.

  2. Assessment of collaborative problem solving skills in Undergraduate Medical Students at Ziauddin College of Medicine, Karachi

    Science.gov (United States)

    Mughal, Arsalan Manzoor; Shaikh, Sirajul Haque

    2018-01-01

    Objective: Collaborative Problem Solving Empirical Progressions from the Assessment and Teaching of 21st Century Skills (ATC21S) framework were used to determine the level of collaborative problem solving skills (CPS) in first, second and third year MBBS students at Ziauddin College of Medicine during Problem-Based Learning (PBL) sessions. Variations based on gender and roles were studied. Methods: It is an analytical comparative cross-sectional study in which seven PBL groups were selected per year by non-probability convenient sampling. Data was collected using the Collaborative Problem Solving Five Strands Empirical Progressions by the primary investigator through observation of the students during PBL sessions. Duration of study was six months. Results: We found that in our students, development of social dimension skills is facilitated to a greater extent than the development of cognitive dimension skills through the process of PBL. These skills are generally better developed in the leader compared to the scribe and members in a group. They are also more developed in females compared to males. Modification in them is also observed as the year's progress. Conclusion: Although PBLs facilitate development of CPS skills' progression however in our curriculum, PBLs mainly focus on social skills development and have less emphasis on cognitive skill development. Thus, hybrid instructional strategies with components from TBL and mentorship are recommended for better development of CPS skills. PMID:29643904

  3. Identifying and assessing the factors affecting skill gap in digital marketing in communication industry companies

    Directory of Open Access Journals (Sweden)

    Fereshteh Ghotbifar

    2017-03-01

    Full Text Available As far as new communication channels are concerned, there have been extensive developments in communications and marketing in digital era. Today, therefore, companies try to take advantage of digital marketing channels to provide suitable services to customers to improve their satisfaction level. However, this study aimed to identify and assess factors affecting skill gap in digital marketing. This was descriptive correlation study. The population consisted of experts in communications industry to identify most important skill gaps in digital marketing and factors affecting them; also, managers and specialists of these companies were investigated to determine the role of identified factors in reducing skills gaps. Using localized questionnaire and interviewing with ten experts who were selected by Delphi snowball method, the skill gaps in marketing and factors affecting them were identified. Also, a researcher made questionnaire with 32 questions was distributed among 226 employees to investigate the identified factors role in reducing skills gap in digital marketing. The results showed that from four identified factors, the components including operational strategic factors and environmental factors had direct and positive impact on creating skill gap in digital marketing of studied companies. The environmental factors such as social and cultural conditions, religion, technology, and economy had more proactive impact on skills gap in digital marketing. Also, the results showed that among skills gaps in digital marketing of studied companies, the skills (Principles of Communication and (Predicting Future had the highest and lowest gaps, respectively.

  4. Using Portfolio to Assess Rural Young Learners' Writing Skills in English Language Classroom

    Science.gov (United States)

    Aziz, Muhammad Noor Abdul; Yusoff, Nurahimah Mohd.

    2015-01-01

    This study aimed at discussing the benefits of portfolio assessment in assessing students' writing skills. The study explores the use of authentic assessment in the classroom. Eleven primary school children from Year 4 in a rural school in Sabah participated in this study. Data were collected by observing them during the English Language lessons…

  5. Physical Education Teacher Training in Fundamental Movement Skills Makes a Difference to Instruction and Assessment Practices

    Science.gov (United States)

    Lander, Natalie Jayne; Barnett, Lisa M.; Brown, Helen; Telford, Amanda

    2015-01-01

    The purpose of this study was to investigate instruction and assessment of fundamental movement skills (FMSs) by Physical Education (PE) teachers of Year 7 girls. Of 168 secondary school PE teachers, many had received little FMSs professional development, and although most assessed student FMSs proficiency, the quality of assessment was variable.…

  6. Project RAILS: Lessons Learned about Rubric Assessment of Information Literacy Skills

    Science.gov (United States)

    Belanger, Jackie; Zou, Ning; Mills, Jenny Rushing; Holmes, Claire; Oakleaf, Megan

    2015-01-01

    Rubric assessment of information literacy is an important tool for librarians seeking to show evidence of student learning. The authors, who collaborated on the Rubric Assessment of Informational Literacy Skills (RAILS) research project, draw from their shared experience to present practical recommendations for implementing rubric assessment in a…

  7. Assessing the Clinical Skills of Dental Students: A Review of the Literature

    Science.gov (United States)

    Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

    2013-01-01

    Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

  8. Construct and face validity of the educational computer-based environment (ECE) assessment scenarios for basic endoneurosurgery skills.

    Science.gov (United States)

    Cagiltay, Nergiz Ercil; Ozcelik, Erol; Sengul, Gokhan; Berker, Mustafa

    2017-11-01

    In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is

  9. Assessing soft skills of undergraduate students: framework for improving competitiveness, innovation and competence of higher education graduates

    Directory of Open Access Journals (Sweden)

    Ansar

    2018-04-01

    Full Text Available Research shows that soft skills, such as teamwork capability, creativity, time management, problem solving skills, communication skills, conflict management, leadership skills, cultural awareness, information management skills and work ethic, are the affective skills most demanded by industries/companies of today's entry-level employees. However, it is this same set of skills that industries claim are still not adequately teaching to the students in the higher education. The research was aimed at identifying life skill formation based teaching and learning model and concept by integrating and synergizing hard skills and soft skills. The research results in the mapped soft skill mastery profile of the students that was at the high category of 72,24%. The mapping will be used as the basic reference for the teaching and learning model developed in this research.

  10. MJO simulation in CMIP5 climate models: MJO skill metrics and process-oriented diagnosis

    Science.gov (United States)

    Ahn, Min-Seop; Kim, Daehyun; Sperber, Kenneth R.; Kang, In-Sik; Maloney, Eric; Waliser, Duane; Hendon, Harry

    2017-12-01

    The Madden-Julian Oscillation (MJO) simulation diagnostics developed by MJO Working Group and the process-oriented MJO simulation diagnostics developed by MJO Task Force are applied to 37 Coupled Model Intercomparison Project phase 5 (CMIP5) models in order to assess model skill in representing amplitude, period, and coherent eastward propagation of the MJO, and to establish a link between MJO simulation skill and parameterized physical processes. Process-oriented diagnostics include the Relative Humidity Composite based on Precipitation (RHCP), Normalized Gross Moist Stability (NGMS), and the Greenhouse Enhancement Factor (GEF). Numerous scalar metrics are developed to quantify the results. Most CMIP5 models underestimate MJO amplitude, especially when outgoing longwave radiation (OLR) is used in the evaluation, and exhibit too fast phase speed while lacking coherence between eastward propagation of precipitation/convection and the wind field. The RHCP-metric, indicative of the sensitivity of simulated convection to low-level environmental moisture, and the NGMS-metric, indicative of the efficiency of a convective atmosphere for exporting moist static energy out of the column, show robust correlations with a large number of MJO skill metrics. The GEF-metric, indicative of the strength of the column-integrated longwave radiative heating due to cloud-radiation interaction, is also correlated with the MJO skill metrics, but shows relatively lower correlations compared to the RHCP- and NGMS-metrics. Our results suggest that modifications to processes associated with moisture-convection coupling and the gross moist stability might be the most fruitful for improving simulations of the MJO. Though the GEF-metric exhibits lower correlations with the MJO skill metrics, the longwave radiation feedback is highly relevant for simulating the weak precipitation anomaly regime that may be important for the establishment of shallow convection and the transition to deep convection.

  11. ENHANCING STUDENTS’ COMMUNICATION SKILLS THROUGH TREFFINGER TEACHING MODEL

    Directory of Open Access Journals (Sweden)

    Idrus Alhaddad

    2015-01-01

    Full Text Available This research aims to  investigate, compare, and describe the achievement and enhancement of students’ mathematical communication skills (MCS.  It based on the prior mathematical knowledge (PMK category (high, medium and low by using Treffinger models (TM and conventional learning (CL. This research is an experimental study with the population of all students of Mathematics Education Department who took Discrete Mathematics subject matter of one university in the city of Ternate. The results show that (1 the achievement and enhancement of MCS  students that used  TM are higher than the students learning using CL; (2 Based on the categories of PMK, the achievement and enhancement of MCS of students using TM are also higher than those learning with CL; and  (3 There was no interaction effect between learning (TM and CL and PMK to the achievement and enhancement of MCS of the students.Keyword: Communication Skills, Prior Mathematical Knowledge, Treffinger Model DOI: dx.doi.org/10.22342/jme.61.31

  12. A comprehensive model for diagnosing the causes of individual medical performance problems: skills, knowledge, internal, past and external factors (SKIPE).

    Science.gov (United States)

    Norfolk, Tim; Siriwardena, A Niroshan

    2013-01-01

    This discussion paper describes a new and comprehensive model for diagnosing the causes of individual medical performance problems: SKIPE (skills, knowledge, internal, past and external factors). This builds on a previous paper describing a unifying theory of clinical practice, the RDM-p model, which captures the primary skill sets required for effective medical performance (relationship, diagnostics and management), and the professionalism that needs to underpin them. The SKIPE model is currently being used, in conjunction with the RDM-p model, for the in-depth assessment and management of doctors whose performance is a cause for concern.

  13. Assessing elders using the functional health pattern assessment model.

    Science.gov (United States)

    Beyea, S; Matzo, M

    1989-01-01

    The impact of older Americans on the health care system requires we increase our students' awareness of their unique needs. The authors discuss strategies to develop skills using Gordon's Functional Health Patterns Assessment for assessing older clients.

  14. Students’ performance in the different clinical skills assessed in OSCE: what does it reveal?

    Directory of Open Access Journals (Sweden)

    Joong Hiong Sim

    2015-02-01

    Full Text Available Introduction: The purpose of this study was to compare students’ performance in the different clinical skills (CSs assessed in the objective structured clinical examination. Methods: Data for this study were obtained from final year medical students’ exit examination (n=185. Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Results: Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs, procedural skills (PSs, and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332=20.253, p<0.001]. Pairwise multiple comparisons revealed significant differences between the means of the eight pairs of CSs assessed, at p<0.05. Conclusions: CRSs appeared to be the weakest while PSs were the strongest, among the six CSs assessed. Students’ unsatisfactory performance in CRS needs to be addressed as CRS is one of the core competencies in medical education and a critical skill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students’ clinical reasoning development.

  15. How to Assess Creative Thinking Skill in Making Products of Liquid Pressure?

    Science.gov (United States)

    Chasanah, L.; Kaniawati, I.; Hernani, H.

    2017-09-01

    The primary skills that must be possessed in the 21st century curriculum are learning and innovation skills. One of the learning strategies that can train students to innovate and improve creative thinking skills is by applying Science, Technology, Engineering and Mathematics (STEM) in learning. Based on an interview to one of the science teachers that learning that aims to train learning and innovation skills has not been applied to learning in the classroom because there is not enough time, learning materials and assessment instruments used. This study aims to determine the results of the implementation of performance assessment of creative thinking skills on STEM-based learning in junior high school for the material of liquid pressure. This research uses descriptive method. Participants in this study were junior high school students 8th in Kudus area. The research instrument consists of observation sheet, performance assessment and documentation. The result showed that creative thinking skills performance assessment can assess student’s creativity in making products of STEM-based learning for junior high school.

  16. Motor Skill Assessment in Autism Spectrum Disorder: A Case Study

    Science.gov (United States)

    Liu, Ting; Breslin, Casey M.; ElGarhy, Sayed

    2017-01-01

    Without proper motor assessment, children with autism spectrum disorder may be placed in educational settings that are inappropriate for their motor abilities. However, many practitioners find it challenging to choose which assessment to use to assess these children, especially with the number of instruments available. The purpose of this study…

  17. The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

    Directory of Open Access Journals (Sweden)

    Lisa M. Barnett, Louise L. Hardy, Ali S. Brian

    2015-03-01

    Full Text Available The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test. A Delphi consultation (with golf industry professionals and researchers in movement skill assessment was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24. Children (n = 43 aged 6-10 years (M = 7.8 years, SD = 1.3 were assessed in both skills live in the field by one rater at Time 1(T1. A subset of children (n = 28 had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3. An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years. Intraclass correlations (ICC assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3. Paired t-tests assessed any systematic differences between live and video assessments (T1 and between T2 and T3. Older children were more skilled (F (2, 40 = 11.18, p < 0.001. The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90 and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82, although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback.

  18. Protocols for the Investigation of Information Processing in Human Assessment of Fundamental Movement Skills.

    Science.gov (United States)

    Ward, Brodie J; Thornton, Ashleigh; Lay, Brendan; Rosenberg, Michael

    2017-01-01

    Fundamental movement skill (FMS) assessment remains an important tool in classifying individuals' level of FMS proficiency. The collection of FMS performances for assessment and monitoring has remained unchanged over the last few decades, but new motion capture technologies offer opportunities to automate this process. To achieve this, a greater understanding of the human process of movement skill assessment is required. The authors present the rationale and protocols of a project in which they aim to investigate the visual search patterns and information extraction employed by human assessors during FMS assessment, as well as the implementation of the Kinect system for FMS capture.

  19. Zoo U: A Stealth Approach to Social Skills Assessment in Schools

    Directory of Open Access Journals (Sweden)

    Melissa E. DeRosier

    2012-01-01

    Full Text Available This paper describes the design and evaluation of Zoo U, a novel computer game to assess children’s social skills development. Zoo U is an innovative product that combines theory-driven content and customized game mechanics. The game-like play creates the opportunity for stealth assessment, in which dynamic evidence of social skills is collected in real time and players’ choices during gameplay provide the needed data. To ensure the development of an engaging and valid game, we utilized an iterative data-driven validation process in which the game was created, tested, revised based on student performance and feedback, and retested until game play was statistically matched to independent ratings of social skills. We first investigated whether the data collected through extensive logging of student actions provided information that could be used to improve the assessment. We found that detailed game logs of socially relevant player behavior combined with external measures of player social skills provided an efficient vector to incrementally improve the accuracy of the embedded assessments. Next, we investigated whether the game performance correlated with teachers’ assessments of students’ social skills competencies. An evaluation of the final game showed (a significant correlations between in-game social skills assessments and independently obtained standard psychological assessments of the same students and (b high levels of engagement and likeability for students. These findings support the use of the interactive and engaging computer game format for the stealth assessment of children’s social skills. The created innovative design methodologies should prove useful in the design and improvement of computer games in education.

  20. Assessing Patients’ Cognitive Therapy Skills: Initial Evaluation of the Competencies of Cognitive Therapy Scale

    Science.gov (United States)

    Strunk, Daniel R.; Hollars, Shannon N.; Adler, Abby D.; Goldstein, Lizabeth A.; Braun, Justin D.

    2014-01-01

    In Cognitive Therapy (CT), therapists work to help patients develop skills to cope with negative affect. Most current methods of assessing patients’ skills are cumbersome and impractical for clinical use. To address this issue, we developed and conducted an initial psychometric evaluation of self and therapist reported versions of a new measure of CT skills: the Competencies of Cognitive Therapy Scale (CCTS). We evaluated the CCTS at intake and post-treatment in a sample of 67 patients participating in CT. The CCTS correlated with a preexisting measure of CT skills (the Ways of Responding Questionnaire) and was also related to concurrent depressive symptoms. Across CT, self-reported improvements in CT competencies were associated with greater changes in depressive symptoms. These findings offer initial evidence for the validity of the CCTS. We discuss the CCTS in comparison with other measures of CT skills and suggest future research directions. PMID:25408560

  1. The Dutch motor skills assessment as tool for talent development in table tennis : a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, Irene R.; Nijhuis-Van der Sanden, Maria W. G.; Elferink-Gemser, Marije T.; Oosterveld, Frits G. J.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  2. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.G.; Elferink-Gemser, M.T.; Oosterveld, F.G.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  3. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.; Elferink-Gemser, M.T.; Oosterveld, F.G.J.

    2014-01-01

    Abstract A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in

  4. Digital Games as Tools for Stimulating and Assessing Reasoning Skills

    Directory of Open Access Journals (Sweden)

    Rosa Maria Bottino

    2016-04-01

    Full Text Available This paper offers some thoughts on the use of educational digital logic games. Specifically refers to a number of research experiments conducted by ITD-CNR, which have highlighted the significant potential of digital games to help develop and/or consolidation of logical thinking and reasoning skills in students of primary and secondary school level. It offers a brief overview of four research experiences carried out by multidisciplinary teams coordinated by ITD-CNR since the early 2000s These experiences have highlighted the high potential of digital games to develop and strengthen logical thinking skills and have shown the positive impact of their use even on school performance. Verificare e stimolare le abilità di ragionamento con i giochi digitaliQuesto contributo propone alcune riflessioni sull’uso educativo dei giochi logici digitali. In particolare fa riferimento ad alcune esperienze di ricerca condotte dall’Istituto di Tecnologie Didattiche - Consiglio Nazionale delle Ricerche (ITD-CNR che hanno evidenziato le interessanti potenzialità dei giochi digitali per contribuire allo sviluppo e/o al consolidamento del pensiero logico e delle abilità di ragionamento in studenti di scuola primaria e secondaria di primo grado. Si propone un breve excursus su quattro esperienze di ricerca svolte da equipe multidisciplinari coordinate da ITD-CNR a partire dai primi anni Duemila. Tali esperienze hanno messo in luce l’alto potenziale dei giochi digitali per sviluppare e potenziare abilità di pensiero logico ed hanno evidenziato il positivo impatto del loro uso anche sul rendimento scolastico.

  5. Can Perceptuo-Motor Skills Assessment Outcomes in Young Table Tennis Players (7-11 years) Predict Future Competition Participation and Performance? An Observational Prospective Study.

    Science.gov (United States)

    Faber, Irene R; Elferink-Gemser, Marije T; Faber, Niels R; Oosterveld, Frits G J; Nijhuis-Van der Sanden, Maria W G

    2016-01-01

    Forecasting future performance in youth table tennis players based on current performance is complex due to, among other things, differences between youth players in growth, development, maturity, context and table tennis experience. Talent development programmes might benefit from an assessment of underlying perceptuo-motor skills for table tennis, which is hypothesized to determine the players' potential concerning the perceptuo-motor domain. The Dutch perceptuo-motor skills assessment intends to measure the perceptuo-motor potential for table tennis in youth players by assessing the underlying skills crucial for developing technical and tactical qualities. Untrained perceptuo-motor tasks are used as these are suggested to represent a player's future potential better than specific sport skills themselves as the latter depend on exposure to the sport itself. This study evaluated the value of the perceptuo-motor skills assessment for a talent developmental programme by evaluating its predictive validity for competition participation and performance in 48 young table tennis players (7-11 years). Players were tested on their perceptuo-motor skills once during a regional talent day, and the subsequent competition results were recorded half-yearly over a period of 2.5 years. Logistic regression analysis showed that test scores did not predict future competition participation (p >0.05). Yet, the Generalized Estimating Equations analysis, including the test items 'aiming at target', 'throwing a ball', and 'eye-hand coordination' in the best fitting model, revealed that the outcomes of the perceptuo-motor skills assessment were significant predictors for future competition results (R2 = 51%). Since the test age influences the perceptuo-motor skills assessment's outcome, another multivariable model was proposed including test age as a covariate (R2 = 53%). This evaluation demonstrates promising prospects for the perceptuo-motor skills assessment to be included in a talent

  6. Teaching Domain-Specific Skills before Peer Assessment Skills Is Superior to Teaching Them Simultaneously

    Science.gov (United States)

    van Zundert, M. J.; Konings, K. D.; Sluijsmans, D. M. A.; van Merrienboer, J.J.G.

    2012-01-01

    Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students (mean age 14.0 years; 45.2% male) with the…

  7. Teaching domain-specific skills before peer assessment skills is superior to teaching them simultaneously

    NARCIS (Netherlands)

    J.J.G. van Merriënboer; Marjo van Zundert; Dominique Sluijsmans; K. Könings

    2012-01-01

    Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students

  8. Impact of tailored feedback in assessment of communication skills for medical students.

    Science.gov (United States)

    Uhm, Seilin; Lee, Gui H; Jin, Jeong K; Bak, Yong I; Jeoung, Yeon O; Kim, Chan W

    2015-01-01

    Finding out the effective ways of teaching and assessing communication skills remain a challenging part of medication education. This study aims at exploring the usefulness and effectiveness of having additional feedback using qualitative analysis in assessment of communication skills in undergraduate medical training. We also determined the possibilities of using qualitative analysis in developing tailored strategies for improvement in communication skills training. This study was carried out on medical students (n=87) undergoing their final year clinical performance examination on communication skills using standardized patient by video-recording and transcribing their performances. Video-recordings of 26 students were randomly selected for qualitative analysis, and additional feedback was provided. We assessed the level of acceptance of communication skills scores between the study and nonstudy group and within the study group, before and after receiving feedback based on qualitative analysis. There was a statistically significant increase in the level of acceptance of feedback after delivering additional feedback using qualitative analysis, where the percentage of agreement with feedback increased from 15.4 to 80.8% (pskills assessment gives essential information for medical students to learn and self-reflect, which could potentially lead to improved communication skills. As evident from our study, feedback becomes more meaningful and effective with additional feedback using qualitative analysis.

  9. Validity and reliability of a short questionnaire for assessing the impact of cooking skills interventions.

    Science.gov (United States)

    Barton, K L; Wrieden, W L; Anderson, A S

    2011-12-01

    Food skills programmes are widely used as a means to improve confidence in food preparation, the use of basic food skills and food selections amongst low income communities. However, the impact of such interventions are rarely evaluated as a result of a lack of validated assessment tools appropriate for use within this target group. A two-page questionnaire utilising a closed-question format was designed based on key domains known to be influenced by cooking skills programmes. Content validity was assessed by a panel of public health experts and face validity by individuals, typical of those who may attend cooking skills classes. Internal and repeat reliability were assessed with groups of adults attending community-based classes. The feasibility of using the tool in community settings was also assessed. The draft questionnaire was amended as appropriate subsequent to content and face validity testing. Cronbach's alpha for confidence and knowledge sections was 0.86 and 0.84, respectively, indicating good internal consistency. Spearman correlation coefficients for repeat reliability testing between time 1 and time 2 for each item were in the range 0.46-0.91 (all significant at P cooking skills interventions that could be utilised in the development and evaluation of multicentre cooking skills interventions. © 2011 The Authors. Journal of Human Nutrition and Dietetics © 2011 The British Dietetic Association Ltd.

  10. Assessing Thinking Skills in Astro 101: Do We Make an Impact?

    Science.gov (United States)

    Bruning, D.

    2005-12-01

    Most instructors agree that a major goal of "Astronomy 101" is to develop thinking skills in our students (Partridge and Greenstein, AER 2, 46, 2003). Much educational research in astronomy has initially concentrated on "best practices" for improving student learning (development of "think-pair-share", lecture tutorials, peer tutoring, etc.). Little has been done to date to assess our efforts to improve student thinking skills and students' desire to think more deeply about the cognitively rich ideas offered in the typical astronomy class. This study surveys several astronomy and physics courses to determine whether general analytical thinking skills increase because of the science course and whether students' attitudes toward cognition improve. Cacioppo, Petty and Kao's "Need for Cognition" scale is used for the latter assessment (J. Personality Assessment 48, 306, 1984). A shortened version of Whimbey and Lochhead's ASI skills instrument is used to assess analytical skills ("Problem Solving and Comprehension," 1986). Preliminary results suggest that students need for cognition does not change in general, although there may be a correlation between increasing need for cognition and improvement in grades through the semester. There is a suggestion that need for cognition is slightly predictive of course performance, but a greater correlation exists between the post-course survey and grades. Gains in general analytical skills have been seen in initial surveys, but correlations with course performance appear elusive.

  11. Accuracy and Reliability of Peer Assessment of Athletic Training Psychomotor Laboratory Skills

    Science.gov (United States)

    Marty, Melissa C.; Henning, Jolene M.; Willse, John T.

    2010-01-01

    Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was

  12. Accuracy and reliability of peer assessment of athletic training psychomotor laboratory skills.

    Science.gov (United States)

    Marty, Melissa C; Henning, Jolene M; Willse, John T

    2010-01-01

    Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Cross-sectional study. Entry-level master's athletic training education program. First-year (n  =  5) and second-year (n  =  8) students. Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the φ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (φ  =  0.79) for the Faber test, with 1 participant on 2 occasions (φ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (φ  =  0.72). Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills

  13. Modelling Graduate Skill Transfer from University to the Workplace

    Science.gov (United States)

    Jackson, Denise

    2016-01-01

    This study explores skill transfer in graduates as they transition from university to the workplace. Graduate employability continues to dominate higher education agendas yet the transfer of acquired skills is often assumed. The study is prompted by documented concern with graduate performance in certain employability skills, and prevalent skill…

  14. Ready for OR or not? Human reader supplements Eyesi scoring in cataract surgical skills assessment

    Directory of Open Access Journals (Sweden)

    Selvander M

    2013-10-01

    Full Text Available Madeleine Selvander,1,2 Peter Åsman11Department of Clinical Sciences, Malmö: Ophthalmology, Lund University, Malmö, Sweden; 2Practicum Clinical Skills Centre, Skåne University Hospital, Malmö, SwedenPurpose: To compare the internal computer-based scoring with human-based video scoring of cataract modules in the Eyesi virtual reality intraocular surgical simulator, a comparative case series was conducted at the Department of Clinical Sciences – Ophthalmology, Lund University, Skåne University Hospital, Malmö, Sweden.Methods: Seven cataract surgeons and 17 medical students performed one video-recorded trial with each of the capsulorhexis, hydromaneuvers, and phacoemulsification divide-and-conquer modules. For each module, the simulator calculated an overall score for the performance ranging from 0 to 100. Two experienced masked cataract surgeons analyzed each video using the Objective Structured Assessment of Cataract Surgical Skill (OSACSS for individual models and modified Objective Structured Assessment of Surgical Skills (OSATS for all three modules together. The average of the two assessors' scores for each tool was used as the video-based performance score. The ability to discriminate surgeons from naive individuals using the simulator score and the video score, respectively, was compared using receiver operating characteristic (ROC curves.Results: The ROC areas for simulator score did not differ from 0.5 (random for hydromaneuvers and phacoemulsification modules, yielding unacceptably poor discrimination. OSACSS video scores all showed good ROC areas significantly different from 0.5. The OSACSS video score was also superior compared to the simulator score for the phacoemulsification procedure: ROC area 0.945 vs 0.664 for simulator score (P = 0.010. Corresponding values for capsulorhexis were 0.887 vs 0.761 (P = 0.056 and for hydromaneuvers 0.817 vs 0.571 (P = 0.052 for the video scores and simulator scores, respectively.The ROC

  15. Neurosurgical Skills Assessment: Measuring Technical Proficiency in Neurosurgery Residents Through Intraoperative Video Evaluations.

    Science.gov (United States)

    Sarkiss, Christopher A; Philemond, Steven; Lee, James; Sobotka, Stanislaw; Holloway, Terrell D; Moore, Maximillian M; Costa, Anthony B; Gordon, Errol L; Bederson, Joshua B

    2016-05-01

    Although technical skills are fundamental in neurosurgery, there is little agreement on how to describe, measure, or compare skills among surgeons. The primary goal of this study was to develop a quantitative grading scale for technical surgical performance that distinguishes operator skill when graded by domain experts (residents, attendings, and nonsurgeons). Scores provided by raters should be highly reliable with respect to scores from other observers. Neurosurgery residents were fitted with a head-mounted video camera while performing craniotomies under attending supervision. Seven videos, 1 from each postgraduate year (PGY) level (1-7), were anonymized and scored by 16 attendings, 8 residents, and 7 nonsurgeons using a grading scale. Seven skills were graded: incision, efficiency of instrument use, cauterization, tissue handling, drilling/craniotomy, confidence, and training level. A strong correlation was found between skills score and PGY year (P Technical skills of neurosurgery residents recorded during craniotomy can be measured with high interrater reliability. Surgeons and nonsurgeons alike readily distinguish different skill levels. This type of assessment could be used to coach residents, to track performance over time, and potentially to compare skill levels. Developing an objective tool to evaluate surgical performance would be useful in several areas of neurosurgery education. Copyright © 2016 Elsevier Inc. All rights reserved.

  16. The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training

    DEFF Research Database (Denmark)

    Lladó Grove, Gabriela; Langager Høgh, Annette; Nielsen, Judith

    2015-01-01

    OBJECTIVE: The concept of the Objective Structured Assessment of Technical Skills (OSATS) is to quantify surgical skills in an objective way and, thereby, produce an additional procedure-specific assessment tool. Since 2005, a 2-day practical course for upcoming specialist registrars in vascular...... surgery has been obligatory. The aim of this study is to describe the results from a tailored OSATS test as a tool for the evaluation of practical skills during an intensive training session in a simple simulator box for vascular anastomoses. METHOD: Between 2005 and 2013, we registered the OSATS scores......, or the experience with vascular anastomoses and outcomes. CONCLUSION: OSATS is a valuable tool for evaluating the advancement of technical skills during an intensive practical course in performing vascular anastomoses. (C) 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights...

  17. The effect of video review of resident laparoscopic surgical skills measured by self- and external assessment.

    Science.gov (United States)

    Herrera-Almario, Gabriel E; Kirk, Katherine; Guerrero, Veronica T; Jeong, Kwonho; Kim, Sara; Hamad, Giselle G

    2016-02-01

    Video review of surgical skills is an educational modality that allows trainees to reflect on self-performance. The purpose of this study was to determine whether resident and attending assessments of a resident's laparoscopic performance differ and whether video review changes assessments. Third-year surgery residents were invited to participate. Elective laparoscopic procedures were video recorded. The Global Operative Assessment of Laparoscopic Skills evaluation was completed immediately after the procedure and again 7 to 10 days later by both resident and attending. Scores were compared using t tests. Nine residents participated and 76 video reviews were completed. Residents scored themselves significantly lower than the faculty scores both before and after video review. Resident scores did not change significantly after video review. Attending and resident self-assessment of laparoscopic skills differs and subsequent video review does not significantly affect Global Operative Assessment of Laparoscopic Skills scores. Further studies should evaluate the impact of video review combined with verbal feedback on skill acquisition and assessment. Copyright © 2016 Elsevier Inc. All rights reserved.

  18. Can both residents and chief physicians assess surgical skills?

    DEFF Research Database (Denmark)

    Oestergaard, Jeanett; Larsen, Christian Rifbjerg; Maagaard, Mathilde

    2012-01-01

    It is known that structured assessment of an operation can provide trainees with useful knowledge and potentially shorten their learning curve. However, methods for objective assessment have not been widely adopted into the clinical setting. This might be because of a lack of expertise using an a...

  19. Development and assessment of key skills in undergraduate students: An action-research experience

    Directory of Open Access Journals (Sweden)

    Ana Fernández-Santander

    2012-03-01

    Full Text Available Employers look for professionals able to work in a team, able to approach problems, with the capacity to analyze and resolve problems, under the constant renewal of knowledge and competencies. In this paper, a group of University teachers from different areas of knowledge presents an experience to introduce key employability skills in the higher education students’ curricula. This work has been developed under the action research scope. The first goal was to make an analysis of terms referred to key skills, generating an integrated denomination for each competency. The elaboration of general templates for key skills is proposed here as a useful tool that provides information about development, assessment and marking of each skill. Different types of rubrics and assessment templates, used during this experience, are presented. DOI: 10.18870/hlrc.v2i1.37

  20. Cognitive skills training in digital era: A paradigm shift in surgical education using the TaTME model.

    Science.gov (United States)

    Knol, Joep; Keller, Deborah S

    2018-04-30

    Surgical competence is a complex, multifactorial process, requiring ample time and training. Optimal training is based on acquiring knowledge and psychomotor and cognitive skills. Practicing surgical skills is one of the most crucial tasks for both the novice surgeon learning new procedures and surgeons already in practice learning new techniques. Focus is placed on teaching traditional technical skills, but the importance of cognitive skills cannot be underestimated. Cognitive skills allow recognizing environmental cues to improve technical performance including situational awareness, mental readiness, risk assessment, anticipating problems, decision-making, adaptation, and flexibility, and may also accelerate the trainee's understanding of a procedure, formalize the steps being practiced, and reduce the overall training time to become technically proficient. The introduction and implementation of the transanal total mesorectal excision (TaTME) into practice may be the best demonstration of this new model of teaching and training, including pre-training, course attendance, and post-course guidance on technical and cognitive skills. To date, the TaTME framework has been the ideal model for structured training to ensure safe implementation. Further development of metrics to grade successful learning and assessment of long term outcomes with the new pathway will confirm the success of this training model. Copyright © 2018 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. All rights reserved.

  1. Facilitating the implementation of the American College of Surgeons/Association of Program Directors in Surgery phase III skills curriculum: training faculty in the assessment of team skills.

    Science.gov (United States)

    Hull, Louise; Arora, Sonal; Stefanidis, Dimitrios; Sevdalis, Nick

    2015-11-01

    Effective teamwork is critical to safety in the operating room; however, implementation of phase III of the American College of Surgeons (ACS) and Association of Program Directors in Surgery (APDS) Curriculum that focuses on team-based skills remains worryingly low. Training and assessing the complexities of teamwork is challenging. The objective of this study was to establish guidelines and recommendations for training faculty in assessing/debriefing team skills. A multistage survey-based consensus study was completed by 108 experts responsible for training and assessing surgical residents from the ACS Accredited Educational Institutes. Experts agreed that a program to teach faculty to assess team-based skills should include training in the recognition of teamwork skills, practice rating these skills, and training in the provision of feedback/debriefing. Agreement was reached that faculty responsible for conducting team-based skills assessment should be revalidated every 2 years and stringent proficiency criteria should be met. Faculty development is critical to ensure high-quality, standardized training and assessment. Training faculty to assess team-based skills has the potential to facilitate the effective implementation of phase III of the ACS and APDS Curriculum. Copyright © 2015 Elsevier Inc. All rights reserved.

  2. Developing learning community model with soft skill integration for the building engineering apprenticeship programme in vocational high school

    Science.gov (United States)

    Sutrisno, Dardiri, Ahmad; Sugandi, R. Machmud

    2017-09-01

    This study aimed to address the procedure, effectiveness, and problems in the implementation of learning model for Building Engineering Apprenticeship Training Programme. This study was carried out through survey method and experiment. The data were collected using questionnaire, test, and assessment sheet. The collected data were examined through description, t-test, and covariance analysis. The results of the study showed that (1) the model's procedure covered preparation course, readiness assessment, assignment distribution, handing over students to apprenticeship instructors, task completion, assisting, field assessment, report writing, and follow-up examination, (2) the Learning Community model could significantly improve students' active learning, but not improve students' hard skills and soft skills, and (3) the problems emerging in the implementation of the model were (1) students' difficulties in finding apprenticeship places and qualified instructors, and asking for relevant tasks, (2) teachers' difficulties in determining relevant tasks and monitoring students, and (3) apprenticeship instructors' difficulties in assigning, monitoring, and assessing students.

  3. Manual Skill Acquisition During Transesophageal Echocardiography Simulator Training of Cardiology Fellows: A Kinematic Assessment.

    Science.gov (United States)

    Matyal, Robina; Montealegre-Gallegos, Mario; Mitchell, John D; Kim, Han; Bergman, Remco; Hawthorne, Katie M; O'Halloran, David; Wong, Vanessa; Hess, Phillip E; Mahmood, Feroze

    2015-12-01

    To investigate whether a transesophageal echocardiography (TEE) simulator with motion analysis can be used to impart proficiency in TEE in an integrated curriculum-based model. A prospective cohort study. A tertiary-care university hospital. TEE-naïve cardiology fellows. Participants underwent an 8-session multimodal TEE training program. Manual skills were assessed at the end of sessions 2 and 8 using motion analysis of the TEE simulator's probe. At the end of the course, participants performed an intraoperative TEE; their examinations were video captured, and a blinded investigator evaluated the total time and image transitions needed for each view. Results are reported as mean±standard deviation, or median (interquartile range) where appropriate. Eleven fellows completed the knowledge and kinematic portions of the study. Five participants were excluded from the evaluation in the clinical setting because of interim exposure to TEE or having participated in a TEE rotation after the training course. An increase of 12.95% in post-test knowledge scores was observed. From the start to the end of the course, there was a significant reduction (pcardiology fellows can be complemented with kinematic analyses to objectify acquisition of manual skills during simulator-based training. Copyright © 2015 Elsevier Inc. All rights reserved.

  4. Assessment of Future Skills Requirements in the Hospitality Sector in Ireland, 2015-2020

    OpenAIRE

    2015-01-01

    The hospitality sector is one of the most important employment services sectors in the Irish economy, and there is significant potential for future expansion. The objective of this study is to assess the skills demand needs arising within the Hospitality sector in Ireland – hotels, restaurants, bars, canteens and catering – over the period to 2020. The aim is to ensure that there will be the right supply of skills to help drive domestic hospitality sector business and employment growth.

  5. Assessing Video Games to Improve Driving Skills: A Literature Review and Observational Study

    OpenAIRE

    Sue, Damian; Ray, Pradeep; Talaei-Khoei, Amir; Jonnagaddala, Jitendra; Vichitvanichphong, Suchada

    2014-01-01

    Background For individuals, especially older adults, playing video games is a promising tool for improving their driving skills. The ease of use, wide availability, and interactivity of gaming consoles make them an attractive simulation tool. Objective The objective of this study was to look at the feasibility and effects of installing video game consoles in the homes of individuals looking to improve their driving skills. Methods A systematic literature review was conducted to assess the eff...

  6. Soft Skills assessment through virtual environments in the university sector : A narrative review

    OpenAIRE

    Ruiz Morales, Yovanni; Biencinto López, Chantal; García García, Mercedes; Carpintero Molina, Elvira

    2017-01-01

    The paper presents a narrative on the state of the question about the teaching and assessment of generic soft skills through Virtual Environments (VEs) in universities, based on consultation of scientific journals in electronic and printed format published between 2000 and 2014, as well as research projects focused on the development of generic skills through VEs. The paper summarises the theoretical and empirical contributions as a way of providing a greater insight into a line of research t...

  7. The assessment of surgical skills as a complement to the training method. Revision.

    Science.gov (United States)

    Sánchez-Fernández, J; Bachiller-Burgos, J; Serrano-Pascual, Á; Cózar-Olmo, J M; Díaz-Güemes Martín-Portugués, I; Pérez-Duarte, F J; Hernández-Hurtado, L; Álvarez-Ossorio, J L; Sánchez-Margallo, F M

    2016-01-01

    The acquisition and improvement of surgical skills constitute a fundamental element in the training of any practitioner. At present, however, the assessment of these skills is a scarcely developed area of research. The aim of this study was to analyse the peculiarities of the various assessment systems and establish the minimum criteria that a skills and knowledge assessment system should meet as a method for assessing surgical skills in urological surgery. Scientific literature review aimed at the various currently available assessment systems for skills and competencies (technical and nontechnical), with a special focus on the systematic reviews and prospective studies. After conducting the review, we found that the various assessment systems for surgical competence have, in our opinion, a number of shortcomings. There is a certain degree of subjectivity in the assessment of surgeons by the evaluators. The assessment of nontechnical competencies is not formally recorded. There is no description of a follow-up assessment or any basic parameters associated with healthcare quality. There is no registration of associated competencies associated with the various surgical techniques. There is also no ranking of these competencies and the specific peculiarities for their application. We believe that the development of a new assessment system for surgical competencies (technical and nontechnical) aimed at assessing urologists in the various surgical techniques is necessary. To this end, our team has worked on developing the Evaluation System for Surgical Competencies on Laparoscopy, which is based on the definition, ranking and assessment of competencies demonstrated by surgeons. Copyright © 2015 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

  8. Testing a Model of Undergraduate Competence in Employability Skills and Its Implications for Stakeholders

    Science.gov (United States)

    Jackson, Denise

    2014-01-01

    Despite the development of employability skills being firmly entrenched in higher education's strategic agenda worldwide; recent graduates' standards in certain skills are not meeting industry expectations. This paper presents and tests a model of undergraduate competence in employability skills. It highlights those factors which impact on…

  9. Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills

    DEFF Research Database (Denmark)

    Jensen, Jesper Kørup; Dyre, Liv; Jørgensen, Mattis Enggaard

    2017-01-01

    OBJECTIVES: The aim of this study was to examine the validity of a simulator test designed to evaluate focused assessment with sonography for trauma (FAST) skills. METHODS: Participants included a group of ultrasound novices (n = 25) and ultrasound experts (n = 10). All participants had their FAST...... skills assessed using a virtual reality ultrasound simulator. Procedural performance on the 4 FAST windows was assessed by automated simulator metrics, which received a passing or failing score. The validity evidence for these simulator metrics was examined by a stepwise approach according...

  10. Evaluating first-year nursing students' ability to self-assess psychomotor skills using videotape.

    Science.gov (United States)

    Watts, Wilda Ellen; Rush, Kathy; Wright, Marjorie

    2009-01-01

    Developing confidence in self-assessment is an important skill in becoming a self-regulated learner. This article describes the process undertaken by a group of educators of incorporating self-assessment in combination with psychomotor skill development with freshman students. Students were videotaped performing a wound-dressing change; the videotaping was immediately followed by a self-assessment of their performance using a faculty-generated checklist. Comparison of faculty and student ratings revealed the tendency for students to overrate their performance and identified discordance between students and faculty on several steps of the procedure. These evaluation findings are discussed and future directions explored.

  11. Assessing and Increasing Descriptive Communication Skills in Retarded Children

    Science.gov (United States)

    Longhurst, Thomas M.

    1972-01-01

    The purpose of the paper was to review the impact of recent developments in research methodology with specific reference to the assessment and habilitation of communication problems in retarded children. (Author)

  12. assessment of the implementation of the secondary school skill ...

    African Journals Online (AJOL)

    Engr E. Egbochukwu

    This study was conducted to assess how the Nigerian secondary school vocational and technical ... challenges of changing economic and social structure of modern society. (National Policy on ..... International Journal of. Educational Studies ...

  13. Enhancing Students’ Communication Skills Through Treffinger Teaching Model

    Directory of Open Access Journals (Sweden)

    Idrus Alhaddad

    2015-10-01

    Full Text Available This research aims to investigate, compare, and describe the achievement and enhancement of students’ mathematical communication skills (MCS. It based on the prior mathematical knowledge (PMK category (high, medium and low by using Treffinger models (TM and conventional learning (CL. This research is an experimental study with the population of all students of Mathematics Education Department who took Discrete Mathematics subject matter of one university in the city of Ternate. The results show that (1 the achievement and enhancement of MCS students that used TM are higher than the students learning using CL; (2 Based on the categories of PMK, the achievement and enhancement of MCS of students using TM are also higher than those learning with CL; and (3 There was no interaction effect between learning (TM and CL and PMK to the achievement and enhancement of MCS of the students

  14. Better Care Teams: A Stepwise Skill Reinforcement Model.

    Science.gov (United States)

    Christopher, Beth-Anne; Grantner, Mary; Coke, Lola A; Wideman, Marilyn; Kwakwa, Francis

    2016-06-01

    The Building Healthy Urban Communities initiative presents a path for organizations partnering to improve patient outcomes with continuing education (CE) as a key component. Components of the CE initiative included traditional CE delivery formats with an essential element of adaptability and new methods, with rigorous evaluation over time that included evaluation prior to the course, immediately following the CE session, 6 to 8 weeks after the CE session, and then subsequent monthly "testlets." Outcome measures were designed to allow for ongoing adaptation of content, reinforcement of key learning objectives, and use of innovative concordant testing and retrieval practice techniques. The results after 1 year of programming suggest the stepwise skill reinforcement model is effective for learning and is an efficient use of financial and human resources. More important, its design is one that could be adopted at low cost by organizations willing to work in close partnership. J Contin Educ Nurs. 2016;47(6):283-288. Copyright 2016, SLACK Incorporated.

  15. Assessing neurosurgical non-technical skills: an exploratory study of a new behavioural marker system.

    Science.gov (United States)

    Michinov, Estelle; Jamet, Eric; Dodeler, Virginie; Haegelen, Claire; Jannin, Pierre

    2014-10-01

    The management of non-technical skills is a major factor affecting teamwork quality and patient safety. This article presents a behavioural marker system for assessing neurosurgical non-technical skills (BMS-NNTS). We tested the BMS during deep brain stimulation surgery. We developed the BMS in three stages. First, we drew up a provisional assessment tool based on the literature and observation tools developed for other surgical specialties. We then analysed videos made in an operating room (OR) during deep brain stimulation operations in order to ensure there were no significant omissions from the skills list. Finally, we used five videos of operations to identify the behavioural markers of non-technical skills in verbal communications. Analyses of more than six hours of observations revealed 3515 behaviours from which we determined the neurosurgeon's non-technical skills behaviour pattern. The neurosurgeon frequently engaged in explicit coordination, situation awareness and leadership behaviours. In addition, the neurosurgeon's behaviours differed according to the stage of the operation and the OR staff members with whom she was communicating. Our behavioural marker system provides a structured approach to assessing non-technical skills in the field of neurosurgery. It can also be transferred to other surgical specialties and used in surgeon training curricula. © 2014 John Wiley & Sons, Ltd.

  16. Performance and Cognitive Assessment in 3-D Modeling

    Science.gov (United States)

    Fahrer, Nolan E.; Ernst, Jeremy V.; Branoff, Theodore J.; Clark, Aaron C.

    2011-01-01

    The purpose of this study was to investigate identifiable differences between performance and cognitive assessment scores in a 3-D modeling unit of an engineering drafting course curriculum. The study aimed to provide further investigation of the need of skill-based assessments in engineering/technical graphics courses to potentially increase…

  17. Reliability and Validity of 3 Methods of Assessing Orthopedic Resident Skill in Shoulder Surgery.

    Science.gov (United States)

    Bernard, Johnathan A; Dattilo, Jonathan R; Srikumaran, Uma; Zikria, Bashir A; Jain, Amit; LaPorte, Dawn M

    Traditional measures for evaluating resident surgical technical skills (e.g., case logs) assess operative volume but not level of surgical proficiency. Our goal was to compare the reliability and validity of 3 tools for measuring surgical skill among orthopedic residents when performing 3 open surgical approaches to the shoulder. A total of 23 residents at different stages of their surgical training were tested for technical skill pertaining to 3 shoulder surgical approaches using the following measures: Objective Structured Assessment of Technical Skills (OSATS) checklists, the Global Rating Scale (GRS), and a final pass/fail assessment determined by 3 upper extremity surgeons. Adverse events were recorded. The Cronbach α coefficient was used to assess reliability of the OSATS checklists and GRS scores. Interrater reliability was calculated with intraclass correlation coefficients. Correlations among OSATS checklist scores, GRS scores, and pass/fail assessment were calculated with Spearman ρ. Validity of OSATS checklists was determined using analysis of variance with postgraduate year (PGY) as a between-subjects factor. Significance was set at p shoulder approaches. Checklist scores showed superior interrater reliability compared with GRS and subjective pass/fail measurements. GRS scores were positively correlated across training years. The incidence of adverse events was significantly higher among PGY-1 and PGY-2 residents compared with more experienced residents. OSATS checklists are a valid and reliable assessment of technical skills across 3 surgical shoulder approaches. However, checklist scores do not measure quality of technique. Documenting adverse events is necessary to assess quality of technique and ultimate pass/fail status. Multiple methods of assessing surgical skill should be considered when evaluating orthopedic resident surgical performance. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights

  18. Moving towards the Assessment of Collaborative Problem Solving Skills with a Tangible User Interface

    Science.gov (United States)

    Ras, Eric; Krkovic, Katarina; Greiff, Samuel; Tobias, Eric; Maquil, Valérie

    2014-01-01

    The research on the assessment of collaborative problem solving (ColPS), as one crucial 21st Century Skill, is still in its beginnings. Using Tangible User Interfaces (TUI) for this purpose has only been marginally investigated in technology-based assessment. Our first empirical studies focused on light-weight performance measurements, usability,…

  19. Instructor and Dental Student Perceptions of Clinical Communication Skills via Structured Assessments.

    Science.gov (United States)

    McKenzie, Carly T

    2016-05-01

    The aim of this study was to use structured assessments to assess dental students' clinical communication skills exhibited during patient appointments. Fourth-year dental students (n=55) at the University of Alabama at Birmingham evaluated their own interpersonal skills in a clinical setting utilizing the Four Habits Coding Scheme. An instructor also assessed student-patient clinical communication. These assessments were used to identify perceived strengths and weaknesses in students' clinical communication. Both instructor assessments and student self-assessments pinpointed the following clinical communication skills as effective the most often: patient greeting, avoidance of jargon, and non-verbal behavior. There was also relative agreement between instructor assessments and student self-assessments regarding clinical communication skills that were rated as not effective most frequently: ensuring patient comprehension, identification of patient feelings, and exploration of barriers to treatment. These resulted pointed to strengths and weaknesses in the portion of the curriculum designed to prepare students for effective provider-patient communication. These results may suggest a need for the school's current behavioral science curriculum to better address discussion of potential treatment barriers and patient feelings as well as techniques to ensure patient comprehension.

  20. "It Is Complicated!": Practices and Challenges of Generic Skills Assessment in Vietnamese Universities

    Science.gov (United States)

    Nghia, Tran Le Huu

    2018-01-01

    Contributing to a lack of studies related to generic skills (GS) assessment, especially in non-Western university contexts, this article reports a study that explored practices and challenges of assessing students' GS in the Business Administration programmes in six Vietnamese universities. Content analysis of interviews with 41 teachers of skills…

  1. Guidelines for Assessing Job-Related Social Skills of Mildly Handicapped Students.

    Science.gov (United States)

    Bullis, Michael; Foss, Gilbert

    1986-01-01

    Effective assessment of job-related social skills of mildly handicapped workers should consider three components of social competence: context, cognition, and performance. A comprehensive profile of social competence is best obtained through use of several assessment tools, such as: rating scales; role play; problem-solving tests; applied…

  2. A Classroom-Based Assessment Method to Test Speaking Skills in English for Specific Purposes

    Science.gov (United States)

    Alberola Colomar, María Pilar

    2014-01-01

    This article presents and analyses a classroom-based assessment method to test students' speaking skills in a variety of professional settings in tourism. The assessment system has been implemented in the Communication in English for Tourism course, as part of the Tourism Management degree programme, at Florida Universitaria (affiliated to the…

  3. Promoting Learning Skills through Teamwork Assessment and Self/Peer Evaluation in Higher Education

    Science.gov (United States)

    Issa, Tomayess

    2012-01-01

    In the education sector, teamwork assessment and self/peer evaluation are widely applied in higher education nationally and internationally. This assessment is designed to encourage students to promote and improve their skills in teamwork, communication (writing, interpersonal interaction and cultural awareness, and presenting), critical and…

  4. Multimodal emotion recognition as assessment for learning in a game-based communication skills training

    NARCIS (Netherlands)

    Nadolski, Rob; Bahreini, Kiavash; Westera, Wim

    2014-01-01

    This paper presentation describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for

  5. Multimodal Emotion Recognition for Assessment of Learning in a Game-Based Communication Skills Training

    NARCIS (Netherlands)

    Bahreini, Kiavash; Nadolski, Rob; Westera, Wim

    2015-01-01

    This paper describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for mainly formative

  6. Development of a tool to support holistic generic assessment of clinical procedure skills.

    Science.gov (United States)

    McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

    2008-06-01

    The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

  7. Got Game? A Choice-Based Learning Assessment of Data Literacy and Visualization Skills

    Science.gov (United States)

    Chin, Doris B.; Blair, Kristen P.; Schwartz, Daniel L.

    2016-01-01

    In partnership with both formal and informal learning institutions, researchers have been building a suite of online games, called choicelets, to serve as interactive assessments of learning skills, e.g. critical thinking or seeking feedback. Unlike more traditional assessments, which take a retrospective, knowledge-based view of learning,…

  8. Reliability and validity of a tool to assess airway management skills in anesthesia trainees

    Directory of Open Access Journals (Sweden)

    Aliya Ahmed

    2016-01-01

    Conclusion: The tool designed to assess bag-mask ventilation and tracheal intubation skills in anesthesia trainees demonstrated excellent inter-rater reliability, fair test-retest reliability, and good construct validity. The authors recommend its use for formative and summative assessment of junior anesthesia trainees.

  9. Attention to gender in communication skills assessment instruments in medical education: a review.

    NARCIS (Netherlands)

    Dielissen, P.W.; Bottema, B.J.A.M.; Verdonk, P.; Lagro-Janssen, T.

    2011-01-01

    CONTEXT: Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. METHODS: In 2009 at Radboud University Nijmegen

  10. Standardized Patients Provide a Reliable Assessment of Athletic Training Students' Clinical Skills

    Science.gov (United States)

    Armstrong, Kirk J.; Jarriel, Amanda J.

    2016-01-01

    Context: Providing students reliable objective feedback regarding their clinical performance is of great value for ongoing clinical skill assessment. Since a standardized patient (SP) is trained to consistently portray the case, students can be assessed and receive immediate feedback within the same clinical encounter; however, no research, to our…

  11. A Field-Based Testing Protocol for Assessing Gross Motor Skills in Preschool Children: The Children's Activity and Movement in Preschool Study Motor Skills Protocol

    Science.gov (United States)

    Williams, Harriet G.; Pfeiffer, Karin A.; Dowda, Marsha; Jeter, Chevy; Jones, Shaverra; Pate, Russell R.

    2009-01-01

    The purpose of this study was to develop a valid and reliable tool for use in assessing motor skills in preschool children in field-based settings. The development of the Children's Activity and Movement in Preschool Study Motor Skills Protocol included evidence of its reliability and validity for use in field-based environments as part of large…

  12. Extending the Will, Skill, Tool Model of Technology Integration: Adding Pedagogy as a New Model Construct

    Science.gov (United States)

    Knezek, Gerald; Christensen, Rhonda

    2016-01-01

    An expansion of the Will, Skill, Tool Model of Technology Integration to include teacher's pedagogical style is proposed by the authors as a means of advancing the predictive power of the model for level of classroom technology integration to beyond 90%. Suggested advantages to this expansion include more precise identification of areas to be…

  13. Assessment of structured physical examination skills training using a retro-pre-questionnaire.

    Science.gov (United States)

    Piryani, Rano Mal; Shankar, P Ravi; Piryani, Suneel; Thapa, Trilok Pati; Karki, Balmansingh; Khakurel, Mahesh Prasad; Bhandary, Shital

    2013-01-01

    The effectiveness of physical examination skills (PES) training is very rarely assessed using the "post-then-pre" approach. In this study, a retro-pre-questionnaire was used to study the effect of structured physical examination skills training (SPEST) imparted to second-year undergraduate medical students. KIST Medical College (KISTMC) affiliated to Tribhuvan University Nepal admitted its first batch of MBBS students in November 2008. The university curriculum recommends the involvement of Medicine and Surgery Departments in PES training, but the methods for teaching and assessment are not well defined. KISTMC has made training more structured and involved the Medicine, Surgery, Gynaecology and Obstetrics, Orthopaedics, ENT, Ophthalmology, Paediatrics, and Family Medicine Departments. SPEST includes the teaching/learning of basic PES for 210 minutes once a week for 28 weeks. Self-assessment is done by using a retro-pre-questionnaire at the end of the last session of training, and these data are analysed using SPSS. Out of 100 students, 98 participated in the objective structured clinical examination (OSCE); 82 completed the retro-pre-questionnaire. Forty-six skills representing various systems were selected for inclusion in the retro-pre-questionnaire from among the many skills taught in different departments. The average perceived skills score (maximum score, 46×4=184) before training was 15.9 and increased to 116.5 after training. The increase was statistically significant upon the application of a paired t-test. The students perceived that their level of skills improved after the training. The retro-pre- instrument seems to be useful for assessing the learners' self-reported changes in PES after training if a large number of skills need to be assessed. However, it should be noted that although a retro-pre-questionnaire may reveal valuable information, it is not a substitute for an objective measure or gold standard.

  14. Using Performance in Multiple Simulated Scenarios to Assess Bronchoscopy Skills

    DEFF Research Database (Denmark)

    Konge, Lars; Arendrup, Henrik; Buchwald, Christian von

    2011-01-01

    using a standardized scoring form. Methods: The test was administered on a virtual reality bronchoscopy simulator to a total of 42 test subjects (14 senior consultants, 14 trainees and 14 medical students). The inter-rater reliability of the test procedure was explored according to examination of test......Background: International guidelines suggest that trainees should perform at least 100 flexible bronchoscopies in a supervised setting, but this number is not evidence based. An objective assessment method could provide educational feedback to trainees and help supervisors decide when basic...... competency is established. No former assessment instrument has been able to distinguish between trainees and experts. Objectives: The aim of this study was to explore the validity and reliability of a new assessment procedure relating to testing operators across multiple tasks with increasing difficulty...

  15. Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

    Science.gov (United States)

    Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

    2016-12-11

    The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

  16. Assessing Reflection: Understanding Skill Development through Reflective Learning Journals

    Science.gov (United States)

    Cathro, Virginia; O'Kane, Paula; Gilbertson, Deb

    2017-01-01

    Purpose: The purpose of this paper is to suggest ways in which business educators can interact successfully with reflective learning journals (RLJs). Specifically, the research was interested in how students used RLJs and how educators assessed these RLJs. Design/methodology/approach: In total, 31 RLJs, submitted as part of an international…

  17. Assessment of the Implementation of the Secondary School Skill ...

    African Journals Online (AJOL)

    This study was conducted to assess how the Nigerian secondary school vocational and technical education curriculum was implemented with a view to ascertain the extent to which it has empowered students for self-employment. The descriptive survey research design was adopted for the study. The sample comprised 380 ...

  18. Formative Assessment, Communication Skills and ICT in Initial Teacher Training

    Science.gov (United States)

    Romero-Martín, M. Rosario; Castejón-Oliva, Francisco-Javier; López-Pastor, Víctor-Manuel; Fraile-Aranda, Antonio

    2017-01-01

    The purpose of this study is to analyze the perception of students, graduates, and lecturers in relation to systems of formative and shared assessment and to the acquisition of teaching competences regarding communication and the use of Information and Communications Technology (ICT) in initial teacher education (ITE) on degrees in Primary…

  19. Clinical assessment of transthoracic echocardiography skills: a generalizability study

    DEFF Research Database (Denmark)

    Nielsen, Dorte Guldbrand; O'Neill, Lotte; Jensen, Signe

    2015-01-01

    Context: Transthoracic echocardiography (TTE) is a widely used cardiac imaging technique that all cardiologists should be able to perform competently. Traditionally, TTE competence has been assessed by unstructured observation or in test situations separated from daily clinical practice. An objec......Context: Transthoracic echocardiography (TTE) is a widely used cardiac imaging technique that all cardiologists should be able to perform competently. Traditionally, TTE competence has been assessed by unstructured observation or in test situations separated from daily clinical practice....... An objective assessment instrument for TTE technical proficiency including a global rating score and a checklist score has previously been shown reliability and validity in a standardised setting. Objectives: As clinical test situations typically have several sources of error giving rise to variance in scores......, a more thorough examination of the generalizability of the test scores is needed. Methods Nine physicians performed a TTE scan on the same three patients. Then, two raters rated all 27 TTE scans using the TTE technical assessment in a fully crossed generalizability study. Estimated variance components...

  20. Design and Assessment of a Skills-Based Geoscience Curriculum

    Science.gov (United States)

    Renshaw, Carl E.

    2014-01-01

    There is increasing interest in science curricula that engage students in scientific practices to deepen their understanding of the core ideas of the field. There are, however, few examples of their designs or assessments available for use as guides for understanding the strengths and weaknesses of particular designs. We offer a summary of our…

  1. Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures.

    Science.gov (United States)

    Gallagher, Anthony G; Smith, C Daniel; Bowers, Steven P; Seymour, Neal E; Pearson, Adam; McNatt, Steven; Hananel, David; Satava, Richard M

    2003-09-01

    Minimally invasive surgery (MIS) has introduced a new and unique set of psychomotor skills for a surgeon to acquire and master. Although assessment technologies have been proposed, precise and objective psychomotor skills assessment of surgeons performing laparoscopic procedures has not been detailed. Two hundred ten surgeons attending the 2001 annual meeting of the American College of Surgeons in New Orleans who reported having completed more than 50 laparoscopic procedures participated. Subjects were required to complete one box-trainer laparoscopic cutting task and a similar virtual reality task. These tasks were specifically designed to test only psychomotor and not cognitive skills. Both tasks were completed twice. Performance of tasks was assessed and analyzed. Demographic and laparoscopic experience data were also collected. Complete data were available on 195 surgeons. In this group, surgeons performed the box-trainer task better with their dominant hand (p psychomotor skills is now possible. Surgeons who had performed more than 50 laparoscopic procedures showed considerable variability in their performance on a simple laparoscopic and virtual reality task. Approximately 10% of surgeons tested performed the task significantly worse than the group's average performance. Studies such as this may form the methodology for establishing criteria levels and performance objectives in objective assessment of the technical skills component of determining surgical competence.

  2. Simulation-based rhomboid flap skills training during medical education: comparing low- and high-fidelity bench models.

    Science.gov (United States)

    Denadai, Rafael; Saad-Hossne, Rogerio; Raposo-Amaral, Cassio Eduardo

    2014-11-01

    To assess if the bench model fidelity interferes in the acquisition of rhomboid flap skills by medical students. Sixty novice medical students were randomly assigned to 5 practice conditions with instructor-directed Limberg rhomboid flap skills training: didactic materials (control group 1), low-fidelity rubberized line (group 2) or ethylene-vinyl acetate (group 3) bench models; high-fidelity chicken leg skin (group 4) or pig foot skin (group 5) bench models. Pretests and posttests were applied, and Global Rating Scale, effect size, and self-perceived confidence were used to evaluate all flap performances. Medical students from groups 2 to 5 showed better flap performances based on the Global Rating Scale (all P 0.05). The magnitude of the effect was considered large (>0.80) in all measurements. There was acquisition of rhomboid flap skills regardless of bench model fidelity.

  3. Assessment of Preschool Early Literacy Skills: Linking Children's Educational Needs with Empirically Supported Instructional Activities.

    Science.gov (United States)

    Lonigan, Christopher J; Allan, Nicholas P; Lerner, Matthew D

    2011-05-01

    The importance of the preschool period for becoming a skilled reader is highlighted by a significant body of evidence that preschool children's development in the areas of oral language, phonological awareness, and print knowledge is predictive of how well they will learn to read once they are exposed to formal reading instruction in elementary school. Although there are now a number of empirically supported instructional activities for helping children who are at -risk of later reading difficulties acquire these early literacy skills, limitations in instructional time and opportunities in most preschool settings requires the use of valid assessment procedures to ensure that instructional resources are utilized efficiently. In this paper, we discuss the degree to which informal, diagnostic, screening, and progress-monitoring assessments of preschool early literacy skills can inform instructional decisions by considering the strengths and weaknesses of each approach to assessment.

  4. Assessment of time management skills: psychometric properties of the Swedish version.

    Science.gov (United States)

    Janeslätt, Gunnel Kristina; Holmqvist, Kajsa Lidström; White, Suzanne; Holmefur, Marie

    2018-05-01

    Persons with impaired time management skills are often in need of occupational therapy. Valid and reliable instruments to assess time management and organizational skills are needed for the evaluation of intervention. The purpose of this study was to evaluate the psychometric properties of a Swedish version of the Assessment of Time Management Skills (ATMS-S) for persons with and without impaired time management skills. A total of 238 persons participated in the study, of whom 94 had self-reported impaired time management skills due to mental disorders such as schizophrenic spectrum or neurodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and mild intellectual disabilities, and 144 persons had no reported impaired time management skills. Rasch analysis was used to analyze data. Three subscales were detected: the time management subscale with 11 items, the organization & planning subscale with 11 items, and the subscale of regulation of emotions with 5 items, with excellent to acceptable psychometric properties. The conclusions were that: ATMS-S is a valid instrument for self-rating of time management, organization & planning and for the regulation of emotions. ATMS-S can be useful for persons with mental disorders including mild neurodevelopmental disorders.

  5. Description of the Assessment of Basic Language and Learning Skills Revisited (ABLLS-R

    Directory of Open Access Journals (Sweden)

    Semenovich M.L.

    2015-12-01

    Full Text Available Diagnostics and assessment of the functional skills of children with disabilities and autism spectrum disorders are to be conducted to develop comprehensive remedial educational programmes. The described Methodology of the Assessment of Basic Language and Learning Skills — Revisited (ABLLS-R allows to simplify and make the diagnostics more efficient, to conduct a comprehensive examination of the child in different areas of development, detect the formed and deficit skills. The second and final part of the description of the methodology offers recommendations on the filling of the Table of the Results of Initial and Repeated Testing and on the choice of goals of correctional work with a child on the basis of performance of individual test scales. The pattern of the table filled after the initial and repeated testing is given. In drawing up of the programme of individual development the willingness of the child to the development of that skill should be considered. Regular practice of selected skills in various situations and the preventive measures against the regression of skills are also important. Conclusive part. Beginning in № 3 (48, 2015

  6. Assessing the Nontechnical Skills of Surgical Trainees: Views of the Theater Team.

    Science.gov (United States)

    Al-Jundi, Wissam; Wild, Jonathan; Ritchie, Judith; Daniels, Sarah; Robertson, Eleanor; Beard, Jonathan

    2016-01-01

    This study aims to explore the views of members of theater teams regarding the proposed introduction of a workplace-based assessment of nontechnical skills of surgeons (NOTSS) into the Intercollegiate Surgical Curriculum Programme in the United Kingdom. In addition, the previous training and familiarity of the members of the surgical theater team with the concept and assessment of NOTSS would be evaluated. A regional survey of members of theater teams (consultant surgeons, anesthetists, scrub nurses, and trainees) was performed at 1 teaching and 2 district general hospitals in South Yorkshire. There were 160 respondents corresponding to a response rate of 81%. The majority (77%) were not aware of the NOTSS assessment tool with only 9% of respondents reporting to have previously used the NOTSS tool and just 3% having received training in NOTSS assessment. Overall, 81% stated that assessing NOTSS was as important as assessing technical skills. Trainees attributed less importance to nontechnical skills than the other groups (p ≤ 0.016). Although opinion appears divided as to whether the presence of a consultant surgeon in theater could potentially make it difficult to assess a trainee's leadership skills and decision-making capabilities, overall 60% agree that the routine use of NOTSS assessment would enhance safety in the operating theater and 80% agree that the NOTSS tool should be introduced to assess the nontechnical skills of trainees in theater. However, a significantly lower proportion of trainees (45%) agreed on the latter compared with the other groups (p = 0.001). Our survey demonstrates acceptability among the theater team for the introduction of the NOTSS tool into the surgical curriculum. However, lack of familiarity highlights the importance of faculty training for assessors before such an introduction. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  7. Effectiveness of the Multidimensional Curriculum Model in Developing Higher-Order Thinking Skills in Elementary and Secondary Students

    Science.gov (United States)

    Vidergor, Hava E.

    2018-01-01

    The study aimed to assess the effectiveness of the multidimensional curriculum model (MdCM) in the development of higher-order thinking skills in a sample of 394 elementary and secondary school students in Israel. The study employed a quantitative quasi-experimental pre-post design, using a study module based on MdCM, comparing intervention group…

  8. The 21st century skills with model eliciting activities on linear program

    Science.gov (United States)

    Handajani, Septriana; Pratiwi, Hasih; Mardiyana

    2018-04-01

    Human resources in the 21st century are required to master various forms of skills, including critical thinking skills and problem solving. The teaching of the 21st century is a teaching that integrates literacy skills, knowledge, skills, attitudes, and mastery of ICT. This study aims to determine whether there are differences in the effect of applying Model Elliciting Activities (MEAs) that integrates 21st century skills, namely 4C and conventional learning to learning outcomes. This research was conducted at Vocational High School in the odd semester of 2017 and uses the experimental method. The experimental class is treated MEAs that integrates 4C skills and the control class is given conventional learning. Methods of data collection in this study using the method of documentation and test methods. The data analysis uses Z-test. Data obtained from experiment class and control class. The result of this study showed there are differences in the effect of applying MEAs that integrates 4C skills and conventional learning to learning outcomes. Classes with MEAs that integrates 4C skills give better learning outcomes than the ones in conventional learning classes. This happens because MEAs that integrates 4C skills can improved creativity skills, communication skills, collaboration skills, and problem-solving skills.

  9. Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

    Science.gov (United States)

    Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

    2015-01-01

    Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief

  10. Influence choreographic readiness to gymnasts final assessment of performance skills

    Directory of Open Access Journals (Sweden)

    O.A. Omelichyk-Ziurkalova

    2014-10-01

    Full Text Available Purpose : to provide a quantitative assessment and expert choreographic preparedness gymnasts. Material : the study involved eight gymnasts competition finalists in the floor exercise - female members of the Ukrainian national team in gymnastics. Results : the quantitative indicators of acrobatic and dance elements to determine the baseline assessment. Defined methods complications composition on the floor exercise by reducing the number of acrobatic lines and diagonals and increase the number of gymnastic elements. The theoretical performance of the composite sequence is improved structure and increases the difficulty of the exercise. Conclusions : in the process of composition complications need to pay more attention to the technique of performing gymnastic elements. In improving exercise choreography element replace (in some cases acrobatic element. Based on the results is planned future direction of research in order to improve the training process in gymnastics.

  11. Introducing the Skills of Self-assessment and Peer Feedback

    Directory of Open Access Journals (Sweden)

    Rania K. Jabr

    2011-03-01

    Full Text Available The object of our teaching should not simply be to introduce our students to a foreign language, but it should be to enable them to perform well when we teachers are no longer there to support them. This means we need to teach them to be autonomous, and one way to succeed in this challenging task is to train them in the “skill” of self-assessment (Harris, 1997 and how to benefit from peer interaction.

  12. Improving Junior High Schools' Critical Thinking Skills Based on Test Three Different Models of Learning

    Science.gov (United States)

    Fuad, Nur Miftahul; Zubaidah, Siti; Mahanal, Susriyati; Suarsini, Endang

    2017-01-01

    The aims of this study were (1) to find out the differences in critical thinking skills among students who were given three different learning models: differentiated science inquiry combined with mind map, differentiated science inquiry model, and conventional model, (2) to find out the differences of critical thinking skills among male and female…

  13. Comparison of Parent Report and Direct Assessment of Child Skills in Toddlers.

    Science.gov (United States)

    Miller, Lauren E; Perkins, Kayla A; Dai, Yael G; Fein, Deborah A

    2017-09-01

    There are unique challenges associated with measuring development in early childhood. Two primary sources of information are used: parent report and direct assessment. Each approach has strengths and weaknesses, particularly when used to identify and diagnose developmental delays. The present study aimed to evaluate consistency between parent report and direct assessment of child skills in toddlers with and without Autism Spectrum Disorder (ASD) across receptive language, expressive language, and fine motor domains. 109 children were evaluated at an average age of two years; data on child skills were collected via parent report and direct assessment. Children were classified into three groups (i.e., ASD, Other Developmental Disorder, or Typical Development) based on DSM-IV-TR diagnosis. Mixed design ANOVAs, with data source as a within subjects factor and diagnostic group as a between subjects factor, were used to assess agreement. Chi square tests of agreement were then used to examine correspondence at the item level. Results suggested that parent report of language and fine motor skills did not significantly differ from direct assessment, and this finding held across diagnostic groups. Item level analyses revealed that, in most cases of significant disagreement, parents reported a skill as present, but it was not seen on direct testing. Results indicate that parents are generally reliable reporters of child language and fine motor abilities in toddlerhood, even when their children have developmental disorders such as ASD. However, the fullest picture may be obtained by using both parent report and direct assessment.

  14. Development of Foundational Movement Skills: A Conceptual Model for Physical Activity Across the Lifespan.

    Science.gov (United States)

    Hulteen, Ryan M; Morgan, Philip J; Barnett, Lisa M; Stodden, David F; Lubans, David R

    2018-03-09

    Evidence supports a positive association between competence in fundamental movement skills (e.g., kicking, jumping) and physical activity in young people. Whilst important, fundamental movement skills do not reflect the broad diversity of skills utilized in physical activity pursuits across the lifespan. Debate surrounds the question of what are the most salient skills to be learned which facilitate physical activity participation across the lifespan. In this paper, it is proposed that the term 'fundamental movement skills' be replaced with 'foundational movement skills'. The term 'foundational movement skills' better reflects the broad range of movement forms that increase in complexity and specificity and can be applied in a variety of settings. Thus, 'foundational movement skills' includes both traditionally conceptualized 'fundamental' movement skills and other skills (e.g., bodyweight squat, cycling, swimming strokes) that support physical activity engagement across the lifespan. A proposed conceptual model outlines how foundational movement skill competency can provide a direct or indirect pathway, via specialized movement skills, to a lifetime of physical activity. Foundational movement skill development is hypothesized to vary according to culture and/or geographical location. Further, skill development may be hindered or enhanced by physical (i.e., fitness, weight status) and psychological (i.e., perceived competence, self-efficacy) attributes. This conceptual model may advance the application of motor development principles within the public health domain. Additionally, it promotes the continued development of human movement in the context of how it leads to skillful performance and how movement skill development supports and maintains a lifetime of physical activity engagement.

  15. Skill assessment of the coupled physical-biogeochemical operational Mediterranean Forecasting System

    Science.gov (United States)

    Cossarini, Gianpiero; Clementi, Emanuela; Salon, Stefano; Grandi, Alessandro; Bolzon, Giorgio; Solidoro, Cosimo

    2016-04-01

    The Mediterranean Monitoring and Forecasting Centre (Med-MFC) is one of the regional production centres of the European Marine Environment Monitoring Service (CMEMS-Copernicus). Med-MFC operatively manages a suite of numerical model systems (3DVAR-NEMO-WW3 and 3DVAR-OGSTM-BFM) that provides gridded datasets of physical and biogeochemical variables for the Mediterranean marine environment with a horizontal resolution of about 6.5 km. At the present stage, the operational Med-MFC produces ten-day forecast: daily for physical parameters and bi-weekly for biogeochemical variables. The validation of the coupled model system and the estimate of the accuracy of model products are key issues to ensure reliable information to the users and the downstream services. Product quality activities at Med-MFC consist of two levels of validation and skill analysis procedures. Pre-operational qualification activities focus on testing the improvement of the quality of a new release of the model system and relays on past simulation and historical data. Then, near real time (NRT) validation activities aim at the routinely and on-line skill assessment of the model forecast and relays on the NRT available observations. Med-MFC validation framework uses both independent (i.e. Bio-Argo float data, in-situ mooring and vessel data of oxygen, nutrients and chlorophyll, moored buoys, tide-gauges and ADCP of temperature, salinity, sea level and velocity) and semi-independent data (i.e. data already used for assimilation, such as satellite chlorophyll, Satellite SLA and SST and in situ vertical profiles of temperature and salinity from XBT, Argo and Gliders) We give evidence that different variables (e.g. CMEMS-products) can be validated at different levels (i.e. at the forecast level or at the level of model consistency) and at different spatial and temporal scales. The fundamental physical parameters temperature, salinity and sea level are routinely validated on daily, weekly and quarterly base

  16. Cultural consultation as a model for training multidisciplinary mental healthcare professionals in cultural competence skills: preliminary results.

    Science.gov (United States)

    Owiti, J A; Ajaz, A; Ascoli, M; de Jongh, B; Palinski, A; Bhui, K S

    2014-01-01

    Lack of cultural competence in care contributes to poor experiences and outcomes from care for migrants and racial and ethnic minorities. As a result, health and social care organizations currently promote cultural competence of their workforce as a means of addressing persistent poor experiences and outcomes. At present, there are unsystematic and diverse ways of promoting cultural competence, and their impact on clinician skills and patient outcomes is unknown. We developed and implemented an innovative model, cultural consultation service (CCS), to promote cultural competence of clinicians and directly improve on patient experiences and outcomes from care. CCS model is an adaptation of the McGill model, which uses ethnographic methodology and medical anthropological knowledge. The method and approach not only contributes both to a broader conceptual and dynamic understanding of culture, but also to learning of cultural competence skills by healthcare professionals. The CCS model demonstrates that multidisciplinary workforce can acquire cultural competence skills better through the clinical encounter, as this promotes integration of learning into day-to-day practice. Results indicate that clinicians developed a broader and patient-centred understanding of culture, and gained skills in narrative-based assessment method, management of complexity of care, competing assumptions and expectations, and clinical cultural formulation. Cultural competence is defined as a set of skills, attitudes and practices that enable the healthcare professionals to deliver high-quality interventions to patients from diverse cultural backgrounds. Improving on the cultural competence skills of the workforce has been promoted as a way of reducing ethnic and racial inequalities in service outcomes. Currently, diverse models for training in cultural competence exist, mostly with no evidence of effect. We established an innovative narrative-based cultural consultation service in an inner

  17. What matters? Assessing and developing inquiry and multivariable reasoning skills in high school chemistry

    Science.gov (United States)

    Daftedar Abdelhadi, Raghda Mohamed

    Although the Next Generation Science Standards (NGSS) present a detailed set of Science and Engineering Practices, a finer grained representation of the underlying skills is lacking in the standards document. Therefore, it has been reported that teachers are facing challenges deciphering and effectively implementing the standards, especially with regards to the Practices. This analytical study assessed the development of high school chemistry students' (N = 41) inquiry, multivariable causal reasoning skills, and metacognition as a mediator for their development. Inquiry tasks based on concepts of element properties of the periodic table as well as reaction kinetics required students to conduct controlled thought experiments, make inferences, and declare predictions of the level of the outcome variable by coordinating the effects of multiple variables. An embedded mixed methods design was utilized for depth and breadth of understanding. Various sources of data were collected including students' written artifacts, audio recordings of in-depth observational groups and interviews. Data analysis was informed by a conceptual framework formulated around the concepts of coordinating theory and evidence, metacognition, and mental models of multivariable causal reasoning. Results of the study indicated positive change towards conducting controlled experimentation, making valid inferences and justifications. Additionally, significant positive correlation between metastrategic and metacognitive competencies, and sophistication of experimental strategies, signified the central role metacognition played. Finally, lack of consistency in indicating effective variables during the multivariable prediction task pointed towards the fragile mental models of multivariable causal reasoning the students had. Implications for teacher education, science education policy as well as classroom research methods are discussed. Finally, recommendations for developing reform-based chemistry

  18. The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training.

    Science.gov (United States)

    Lladó Grove, Gabriela; Langager Høgh, Annette; Nielsen, Judith; Sandermann, Jes

    2015-01-01

    The concept of the Objective Structured Assessment of Technical Skills (OSATS) is to quantify surgical skills in an objective way and, thereby, produce an additional procedure-specific assessment tool. Since 2005, a 2-day practical course for upcoming specialist registrars in vascular surgery has been obligatory. The aim of this study is to describe the results from a tailored OSATS test as a tool for the evaluation of practical skills during an intensive training session in a simple simulator box for vascular anastomoses. Between 2005 and 2013, we registered the OSATS scores of all course participants. The following data were collected from the questionnaires: years as a candidate, months in vascular surgery or in another type of surgery, and the number of vascular anastomoses performed before the course. The assessment of surgical skills was conducted with an OSATS score template specifically made for this purpose. It consists of a 12-item table with a 5-point grading scale. OSATS score (points) and time for the procedure (OSATS time in min) were registered at baseline (OSATS I) and at the end of the course (OSATS II). OSATS scores were given in both OSATS I and OSATS II for the 83 trainees, and the mean difference was 8.1 points (95% CI: 6.7; 9.5, p technical skills during an intensive practical course in performing vascular anastomoses. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  19. Vocational education teachers’ attitude towards development of assessment skills

    OpenAIRE

    Miliušienė, Monika; Teresevičienė, Margarita

    2009-01-01

    Šiame straipsnyje aptariamas mokymosi pasiekimų vertinimo procesas, daugiausia dėmesio skiriama profesijos mokytojų gebėjimų vertinti nustatymui. Keičiantis vertinimo koncepcijai, t. y. pereinant nuo vien tik žiniomis paremto vertinimo prie mokymosi pasiekimų vertinimo, keičiasi vertinimo eigai keliami reikalavimai ir ypač aktualus tampa profesijos mokytojų gebėjimų vertinti tobulinimas. This article discusses learning achievement assessment process, focusing on identification of VET teach...

  20. Models for Pesticide Risk Assessment

    Science.gov (United States)

    EPA considers the toxicity of the pesticide as well as the amount of pesticide to which a person or the environments may be exposed in risk assessment. Scientists use mathematical models to predict pesticide concentrations in exposure assessment.

  1. Customization of a tool to assess Danish surgeons´ non-technical skills in the operating room

    DEFF Research Database (Denmark)

    Spanager, Lene; Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter

    2012-01-01

    Errors in surgery often stem from failure related to non-technical skills such as communication and teamwork. Tools for training and assessment of non-technical skills are needed to ensure safe surgery. The aim of this study was to customize the Non-Technical Skills for Surgeons (NOTSS) rating...

  2. Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

    Science.gov (United States)

    Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

    2012-04-01

    The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P assessments of daily living and fine motor skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

  3. Does a perceptuomotor skills assessment have added value to detect talent for table tennis in primary school children?

    Science.gov (United States)

    Faber, Irene R; Pion, Johan; Munivrana, Goran; Faber, Niels R; Nijhuis-Van der Sanden, Maria W G

    2017-04-18

    Talent detection intends to support lifelong sports participation, reduce dropouts and stimulate sports at the elite level. For this purpose it is important to reveal the specific profile which directs children to the sports that connect to their strengths and preferences. This study evaluated a perceptuomotor skills assessment as part of talent detection for table tennis, a sport in which perceptuomotor skills are considered essential to cope with the difficult technical aspects. Primary school children (n = 121) and gifted young table tennis players (n = 146) were assessed using the Dutch perceptuomotor skills assessment measuring "ball control" and "gross motor function". A discriminant function analysis confirmed the added value by identifying primary school children fitting the table tennis perceptuomotor profile of the young gifted table tennis players (28%). General linear model analyses for the assessment's individual test items showed that the table tennis players outperformed their primary school peers on all "ball control" items (P talent detection in table tennis at this young age. Longitudinal studies need to reveal the predictive value for sports participation and elite sports.

  4. Students' performance in the different clinical skills assessed in OSCE: what does it reveal?

    Science.gov (United States)

    Sim, Joong Hiong; Abdul Aziz, Yang Faridah; Mansor, Azura; Vijayananthan, Anushya; Foong, Chan Choong; Vadivelu, Jamuna

    2015-01-01

    The purpose of this study was to compare students' performance in the different clinical skills (CSs) assessed in the objective structured clinical examination. Data for this study were obtained from final year medical students' exit examination (n=185). Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs), procedural skills (PSs), and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332)=20.253, pskill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students' clinical reasoning development.

  5. The feasibility of a multi-format Web-based assessment of physicians' communication skills.

    Science.gov (United States)

    Kim, Sara; Brock, Douglas M; Hess, Brian J; Holmboe, Eric S; Gallagher, Thomas H; Lipner, Rebecca S; Mazor, Kathleen M

    2011-09-01

    Little is known about the best approaches and format for measuring physicians' communication skills in an online environment. This study examines the reliability and validity of scores from two Web-based communication skill assessment formats. We created two online communication skill assessment formats: (a) MCQ (multiple-choice questions) consisting of video-based multiple-choice questions; (b) multi-format including video-based multiple-choice questions with rationales, Likert-type scales, and free text responses of what physicians would say to a patient. We randomized 100 general internists to each test format. Peer and patient ratings collected via the American Board of Internal Medicine (ABIM) served as validity sources. Seventy-seven internists completed the tests (MCQ: 38; multi-format: 39). The adjusted reliability was 0.74 for both formats. Excellent communicators, as based on their peer and patient ratings, performed slightly better on both tests than adequate communicators, though this difference was not statistically significant. Physicians in both groups rated test format innovative (4.2 out of 5.0). The acceptable reliability and participants' overall positive experiences point to the value of ongoing research into rigorous Web-based communication skills assessment. With efficient and reliable scoring, the Web offers an important way to measure and potentially enhance physicians' communication skills. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  6. The Assessment of 21st Century Skills in Industrial and Organizational Psychology: Complex and Collaborative Problem Solving

    OpenAIRE

    Neubert, Jonas; Mainert, Jakob; Kretzschmar, André; Greiff, Samuel

    2015-01-01

    In the current paper, we highlight why and how industrial and organizational psychology can take advantage of research on 21st century skills and their assessment. We present vital theoretical perspectives, a suitable framework for assessment, and exemplary instruments with a focus on advances in the assessment of Human Capital. Specifically, Complex Problem Solving (CPS) and Collaborative Problem Solving (ColPS) are two transversal skills (i.e., skills that span multiple domains) that are...

  7. ASSESSMENT OF ARTICLES ON LISTENING SKILL-DİNLEME BECERİSİ ÜZERİNE YAZILAN MAKALELERİN DEĞERLENDİRİLMESİ

    Directory of Open Access Journals (Sweden)

    Ömer KEMİKSİZ

    2017-04-01

    Full Text Available One of the basic language skills, listening is the most commonly used skill in daily life as well. Therefore, studies to be conducted for improving this skill are very important. This study aims to assess academic studies on listening skill from various aspects. This study is based on descriptive survey model and analyzes 150 articles published in 67 different journals between 2007-2016 through content analysis method. These articles are analyzed under seven titles being publication year, number of authors, article type (original, thesis or publication-based, distribution by basic language skills, sampling/research group, research type and research subject. The obtained findings are presented in charts and tables and related frequency and percentage values are presented as well. According to this study, the number of articles written on listening skill has significantly increased in recent years and these articles are mostly original papers with single author or two authors. It is also found that articles written solely on listening skill are in majority and research group is mostly students in these studies. It is detected that these students are mostly on secondary school and undergraduate education level. It is detected that the analyzed research mostly focus on survey and document analysis studies; the most commonly examined subjects are found as follows, listening strategies, methods and techniques, listening activities and listening texts. The obtained results are compared with other studies conducted on basic language skills and recommendations are made for further research to be conducted on listening skill.

  8. Diagnostic Assessment of Troubleshooting Skill in an Intelligent Tutoring System

    Science.gov (United States)

    1994-03-01

    Teachers of Mathematics (1989). Curriculum and evaluation standards for school mathematics . Reston, VA: NCTM . Noetic Systems (1993). ERGO v. 1.2 (software...e,g, Rutherford & Ahlgren, 1990; National Council of Teachers of Mathematics , 1989). The second feature is a cognitive model of performance that...made, for example, that an individual has high ability in mathematics , yet the epistemic conditions that characterize high ability are never explicitly

  9. E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

    Science.gov (United States)

    Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

    2018-04-01

    Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure

  10. Large-scale Assessment Yields Evidence of Minimal Use of Reasoning Skills in Traditionally Taught Classes

    Science.gov (United States)

    Thacker, Beth

    2017-01-01

    Large-scale assessment data from Texas Tech University yielded evidence that most students taught traditionally in large lecture classes with online homework and predominantly multiple choice question exams, when asked to answer free-response (FR) questions, did not support their answers with logical arguments grounded in physics concepts. In addition to a lack of conceptual understanding, incorrect and partially correct answers lacked evidence of the ability to apply even lower level reasoning skills in order to solve a problem. Correct answers, however, did show evidence of at least lower level thinking skills as coded using a rubric based on Bloom's taxonomy. With the introduction of evidence-based instruction into the labs and recitations of the large courses and in a small, completely laboratory-based, hands-on course, the percentage of correct answers with correct explanations increased. The FR format, unlike other assessment formats, allowed assessment of both conceptual understanding and the application of thinking skills, clearly pointing out weaknesses not revealed by other assessment instruments, and providing data on skills beyond conceptual understanding for course and program assessment. Supported by National Institutes of Health (NIH) Challenge grant #1RC1GM090897-01.

  11. Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery.

    Science.gov (United States)

    Oropesa, Ignacio; Sánchez-González, Patricia; Lamata, Pablo; Chmarra, Magdalena K; Pagador, José B; Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Gómez, Enrique J

    2011-11-01

    Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor-trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons' psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules. Copyright © 2011 Elsevier Inc. All rights reserved.

  12. Network Analysis of Conversation Data for Engineering Professional Skills Assessment. Research Report. ETS RR-17-59

    Science.gov (United States)

    Zhu, Mengxiao; Zhang, Mo

    2017-01-01

    In this paper, we examine the student group discussion processes in a scenario-based assessment of engineering professional skills called Engineering Professional Skills Assessment (EPSA). In the assessment, the students were evaluated through a discussion on a scenario related to an engineering problem with no clear-cut solution. We applied…

  13. Objective structured assessment of technical skills evaluation of theoretical compared with hands-on training of shoulder dystocia management: a randomized controlled trial.

    Science.gov (United States)

    Buerkle, Bernd; Pueth, Julia; Hefler, Lukas A; Tempfer-Bentz, Eva-Katrin; Tempfer, Clemens B

    2012-10-01

    To compare the skills of performing a shoulder dystocia management algorithm after hands-on training compared with demonstration. We randomized medical students to a 30-minute hands-on (group 1) and a 30-minute demonstration (group 2) training session teaching a standardized shoulder dystocia management scheme on a pelvic training model. Participants were tested with a 22-item Objective Structured Assessment of Technical Skills scoring system after training and 72 hours thereafter. Objective Structured Assessment of Technical Skills scores were the primary outcome. Performance time, self-assessment, confidence, and global rating scale were the secondary outcomes. Statistics were performed using Mann-Whitney U test, χ test, and multiple linear regression analysis. Two hundred three participants were randomized. Objective Structured Assessment of Technical Skills scores were significantly higher in group 1 (n=103) compared with group 2 (n=100) (17.95±3.14 compared with 15.67±3.18, respectively; PTechnical Skills scores were still significantly higher in group 1 (n=67) compared with group 2 (n=60) (18.17±2.76 compared with 14.98±3.03, respectively; PTechnical Skills scores. Hands-on training helps to achieve a significant improvement of shoulder dystocia management on a pelvic training model. www.ClinicalTrials.gov, NCT01618565. I.

  14. Skills in clinical communication: Are we correctly assessing them at undergraduate level?

    Directory of Open Access Journals (Sweden)

    Alberto Zamora Cervantes

    2014-07-01

    Full Text Available Communicating with the patient in clinical practice refers to the way in which the doctor and the patient interact both verbally and nonverbally, in order to achieve a shared understanding of problems and solutions. Traditional learning and assessment systems are overwhelmed when it comes to addressing the complex and multi-dimensional problems of professional practice. Problem Based Learning (PBL has been put forward as an alternative to the mere reproduction of knowledge and pre-established patterns, enabling students to develop their own learning strategies to overcome problems in their future professional practice. The challenge is to determine how to assess the acquisition of clinical communication skills. The authors have recommended a summative assessment of clinical communication skills based on the combination of different methods. It highlights the importance of feedback-based formative assessment. This raises the need to develop and validate assessment scales in clinical communication at an undergraduate level. Based on this work, the authors put forward a "fanned out" assessment in terms of clinical communication skills in Medicine degrees, with the use of different instruments in a "spiraled" manner, where the greater the contact with clinical practice in the various degree and integral courses, the greater difficulty experienced, with the participation of all the stakeholders involved (self, hetero and peer assessment without precluding the involvement of patients (real or simulated in the design of assessment instruments.

  15. The Will, Skill, Tool Model of Technology Integration: Adding Pedagogy as a New Model Construct

    Science.gov (United States)

    Knezek, Gerald; Christensen, Rhonda

    2015-01-01

    An expansion of the Will, Skill, Tool Model of Technology Integration to include teacher's pedagogical style is proposed by the authors as a means of advancing the predictive power for level of classroom technology integration to beyond 90%. Suggested advantages to this expansion include more precise identification of areas to be targeted for…

  16. Assessing Nurse Anaesthetists' Non-Technical Skills in the operating room.

    Science.gov (United States)

    Lyk-Jensen, H T; Jepsen, R M H G; Spanager, L; Dieckmann, P; Østergaard, D

    2014-08-01

    Incident reporting and fieldwork in operating rooms have shown that some of the errors that arise in anaesthesia relate to inadequate use of non-technical skills. To provide a tool for training and feedback on nurse anaesthetists' non-technical skills, this study aimed to adapt the Anaesthetists' Non-Technical Skills (ANTS) as a behavioural marker system for the formative assessment of nurse anaesthetists' non-technical skills in the operating room. A qualitative approach with focus group interviews was used to identify the non-technical skills of nurse anaesthetists in the operating room. The interview data were transcribed verbatim. Directed content analysis was used to code and sort data deductively into the ANTS categories: task management, team working, situation awareness and decision making. The prototype named Nurse Anaesthetists' Non-Technical Skills (N-ANTS) was presented and discussed in a group of subject matter experts to ensure face validity. The N-ANTS system consists of the same four categories as ANTS and 15 underlying elements. Three to five good and poor behavioural markers for each element were identified. The headings and definitions of the categories and elements were adjusted to encompass the behavioural markers in N-ANTS. The differences that emerged mainly reflected statements regarding the establishment of role, competence, and task delegation. A behavioural marker system, N-ANTS, for nurse anaesthetists was adapted from a behavioural marker system, ANTS, for anaesthesiologists. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

  17. Assessing competence in communication and interpersonal skills: the Kalamazoo II report.

    Science.gov (United States)

    Duffy, F Daniel; Gordon, Geoffrey H; Whelan, Gerald; Cole-Kelly, Kathy; Frankel, Richard; Buffone, Natalie; Lofton, Stephanie; Wallace, MaryAnne; Goode, Leslie; Langdon, Lynn

    2004-06-01

    Accreditation of residency programs and certification of physicians requires assessment of competence in communication and interpersonal skills. Residency and continuing medical education program directors seek ways to teach and evaluate these competencies. This report summarizes the methods and tools used by educators, evaluators, and researchers in the field of physician-patient communication as determined by the participants in the "Kalamazoo II" conference held in April 2002. Communication and interpersonal skills form an integrated competence with two distinct parts. Communication skills are the performance of specific tasks and behaviors such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills are inherently relational and process oriented; they are the effect communication has on another person such as relieving anxiety or establishing a trusting relationship. This report reviews three methods for assessment of communication and interpersonal skills: (1) checklists of observed behaviors during interactions with real or simulated patients; (2) surveys of patients' experience in clinical interactions; and (3) examinations using oral, essay, or multiple-choice response questions. These methods are incorporated into educational programs to assess learning needs, create learning opportunities, or guide feedback for learning. The same assessment tools, when administered in a standardized way, rated by an evaluator other than the teacher, and using a predetermined passing score, become a summative evaluation. The report summarizes the experience of using these methods in a variety of educational and evaluation programs and presents an extensive bibliography of literature on the topic. Professional conversation between patients and doctors shapes diagnosis, initiates therapy, and establishes a caring relationship. The degree to which these activities are successful depends, in

  18. Subjective and objective assessment of patients' compression therapy skills as a predicator of ulcer recurrence.

    Science.gov (United States)

    Mościcka, Paulina; Szewczyk, Maria T; Jawień, Arkadiusz; Cierzniakowska, Katarzyna; Cwajda-Białasik, Justyna

    2016-07-01

    To verify whether the subjectively and objectively assessed patient's skills in applying compression therapy constitute a predicting factor of venous ulcer recurrence. Systematic implementation of compression therapy by the patient is a core of prophylaxis for recurrent ulcers. Therefore, patient education constitutes a significant element of care. However, controversies remain if all individuals benefit equally from education. A retrospective analysis. The study included medical records of patients with venous ulcers (n = 351) treated between 2001 and 2011 at the Clinic for Chronic Wounds at Bydgoszcz Clinical Hospital. We compared two groups of patients, (1) with at least one episode of recurrent ulcer during the five-year observation period, and (2) without recurrences throughout the analysed period in terms of their theoretical skills and knowledge on compression therapy recorded at baseline and after one month. Very good self-assessment of a patient's compression therapy skills and weak assessment of these skills by a nurse proved significant risk factors for recurrence of the ulcers on univariate analysis. The significance of these variables as independent risk factors for recurrent ulcers has been also confirmed on multivariate analysis, which also took into account other clinical parameters. Building up proper compression therapy skills among the patients should be the key element of a properly construed nurse-based prophylactic program, as it is the most significant modifiable risk factor for recurrent ulcers. Although the development of compression skills is undeniably important, also other factors should be considered, e.g. surgical correction of superficial reflux. Instruction on compression therapy should be conducted by properly trained nursing personnel - the nurses should have received both content and psychological training. The compression therapy training should contain practical instruction with guided exercises and in-depth objective

  19. PENGEMBANGAN MODEL PENDIDIKAN SOFT SKILL MELALUI PEMBELAJARAN PADA PROGRAM STUDI PENDIDIKAN TEKNIK MESIN FT UM

    Directory of Open Access Journals (Sweden)

    Dwi Agus Sudjimat

    2012-08-01

    Full Text Available The purpose of this research was to develop the soft skill education model at the Mechanical Engineering Education Study Program, State University of Malang included the curriculum and its implementation on the instructional activities. The research found that: (1 the soft skill curriculum needed by the Mechanical Engi­neering Education Study Program consists of fundamental skill, personal skill, and social skill; and (2 for implementing the soft skill curriculum entire the instructional activities strive for each lecture to take one or more soft skills statement for development, using the various strategies/methods of teaching refer to student-centered, giving tasks, and introducing the HES (Health and Environment Safety particularly in the practicum activities. Tujuan penelitian ini adalah untuk mengembangkan model pendidikan soft skill pada Program Studi Teknik Mesin Universitas Negeri Malang termasuk kuriku­lum dan implementasinya dalam kegiatan pembelajaran. Temuan penelitian ini adalah: (1 kurikulum soft skill yang diperlukan oleh Program Studi Teknik Mesin terdiri dari keterampilan dasar, keterampilan pribadi, dan keterampilan sosial, dan (2 menerap­kan kurikulum soft skill dalam pembelajaran pada masing-masing dasar, mengambil satu atau lebih soft skill untuk dikembangkan, menggunakan berbagai strategi/metode pengajaran berpusat pada mahasiswa, memberikan tugas, dan memperkenalkan K3 (Kesehatan dan Keselamatan Kerja, terutama dalam kegiatan praktikum.

  20. Conceptual Models and Guidelines for Clinical Assessment of Financial Capacity.

    Science.gov (United States)

    Marson, Daniel

    2016-09-01

    The ability to manage financial affairs is a life skill of critical importance, and neuropsychologists are increasingly asked to assess financial capacity across a variety of settings. Sound clinical assessment of financial capacity requires knowledge and appreciation of applicable clinical conceptual models and principles. However, the literature has presented relatively little conceptual guidance for clinicians concerning financial capacity and its assessment. This article seeks to address this gap. The article presents six clinical models of financial capacity : (1) the early gerontological IADL model of Lawton, (2) the clinical skills model and (3) related cognitive psychological model developed by Marson and colleagues, (4) a financial decision-making model adapting earlier decisional capacity work of Appelbaum and Grisso, (5) a person-centered model of financial decision-making developed by Lichtenberg and colleagues, and (6) a recent model of financial capacity in the real world developed through the Institute of Medicine. Accompanying presentation of the models is discussion of conceptual and practical perspectives they represent for clinician assessment. Based on the models, the article concludes by presenting a series of conceptually oriented guidelines for clinical assessment of financial capacity. In summary, sound assessment of financial capacity requires knowledge and appreciation of clinical conceptual models and principles. Awareness of such models, principles and guidelines will strengthen and advance clinical assessment of financial capacity. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  1. Customisation of an instrument to assess anaesthesiologists' non-technical skills.

    Science.gov (United States)

    Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

    2015-02-22

    The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

  2. Pilot Evaluation of a Communication Skills Training Program for Psychiatry Residents Using Standardized Patient Assessment.

    Science.gov (United States)

    Ditton-Phare, Philippa; Sandhu, Harsimrat; Kelly, Brian; Kissane, David; Loughland, Carmel

    2016-10-01

    Mental health clinicians can experience difficulties communicating diagnostic information to patients and their families/carers, especially about distressing psychiatric disorders such as schizophrenia. There is evidence for the effectiveness of communication skills training (CST) for improving diagnostic discussions, particularly in specialties such as oncology, but only limited evidence exists about CST for psychiatry. This study evaluated a CST program specifically developed for psychiatry residents called ComPsych that focuses on conveying diagnostic and prognostic information about schizophrenia. The ComPsych program consists of an introductory lecture, module booklets for trainees, and exemplary skills videos, followed by small group role-plays with simulated patients (SPs) led by a trained facilitator. A standardized patient assessment (SPA) was digitally recorded pre- and post-training with a SP using a standardized scenario in a time-limited (15 min) period. Recorded SPAs were independently rated using a validated coding system (ComSkil) to identify frequency of skills used in five skills categories (agenda setting, checking, questioning, information organization, and empathic communication). Thirty trainees (15 males and 15 females; median age = 32) undertaking their vocational specialty training in psychiatry participated in ComPsych training and pre- and post-ComPsych SPAs. Skills increased post-training for agenda setting (d = -0.82), while questioning skills (d = 0.56) decreased. There were no significant differences in any other skills grouping, although checking, information organization, and empathic communication skills tended to increase post-training. A dose effect was observed for agenda setting, with trainees who attended more CST sessions outperforming those attending fewer. Findings support the generalization and translation of ComPsych CST to psychiatry.

  3. Assessment of knowledge and skills in information literacy instruction for rehabilitation sciences students: a scoping review.

    Science.gov (United States)

    Boruff, Jill T; Harrison, Pamela

    2018-01-01

    This scoping review investigates how knowledge and skills are assessed in the information literacy (IL) instruction for students in physical therapy, occupational therapy, or speech-language pathology, regardless of whether the instruction was given by a librarian. The objectives were to discover what assessment measures were used, determine whether these assessment methods were tested for reliability and validity, and provide librarians with guidance on assessment methods to use in their instruction in evidence-based practice contexts. A scoping review methodology was used. A systematic search strategy was run in Ovid MEDLINE and adapted for CINAHL; EMBASE; Education Resources Information Center (ERIC) (EBSCO); Library and Information Science Abstracts (LISA); Library, Information Science & Technology Abstracts (LISTA); and Proquest Theses and Dissertations from 1990 to January 16, 2017. Forty articles were included for data extraction. Three major themes emerged: types of measures used, type and context of librarian involvement, and skills and outcomes described. Thirty-four measures of attitude and thirty-seven measures of performance were identified. Course products were the most commonly used type of performance measure. Librarians were involved in almost half the studies, most frequently as instructor, but also as author or assessor. Information literacy skills such as question formulation and database searching were described in studies that did not involve a librarian. Librarians involved in instructional assessment can use rubrics such as the Valid Assessment of Learning in Undergraduate Education (VALUE) when grading assignments to improve the measurement of knowledge and skills in course-integrated IL instruction. The Adapted Fresno Test could be modified to better suit the real-life application of IL knowledge and skills.

  4. MEMFASILITASI HIGHER ORDER THINKING SKILLS DALAM PERKULIAHAN BIOLOGI SEL MELALUI MODEL INTEGRASI ATRIBUT ASESMEN FORMATIF

    Directory of Open Access Journals (Sweden)

    Sigit Saptono

    2017-02-01

    Full Text Available Abstrak ___________________________________________________________________ Higher order thinking skills sangat dibutuhkan untuk memahami permasalahan dan esensi materi perkuliahan Biologi Sel. Studi dengan desain Research and Development ini bertujuan untuk mengembangkan kemampuan penalaran dan berpikir analitik mahasiswa calon guru biologi melalui penerapan model pembelajaran Integrasi Atribut Asesmen Formatif (IAAF. Sejumlah 61 mahasiswa program studi Pendidikan Biologi Universitas Negeri Semarang semester tiga yang sedang menempuh mata kuliah Biologi Sel menjadi subjek penelitian. Kemampuan penalaran dan berpikir analitik mahasiswa diukur melalui tugas individu, tugas kelompok pembuatan peta konsep dan penyusunan laporan reviu artikel, dan 30 item soal berbentuk selected response questions dan constructed response questions tervalidasi. Hasil analisis data menunjukkan bahwa kemampuan penalaran dan berpikir analitik mahasiswa dapat berkembang secara signifikan, meskipun perkembangan kemampuan argumentasi, salah satu kategori kemampuan berpikir analitik, masih perlu perhatian yang cukup serius.   Abstract ___________________________________________________________________ Higher order thinking skills are needed to understand the problem and the essence of the lecture material Biology Sel. Study design Research and Development aims to develop reasoning skills and analytic thinking biology student teachers through the application of learning models Integration Attributes Formative Assessment (IAAF. Some 61 students of Biology Education Semarang State University who is doing his third semester courses Cell Biology is the subject of research. Analytical reasoning and thinking ability of students is measured through individual assignments, group assignments concept map creation and preparation of the Review articles, and 30 items about the shape of the selected response and constructed response questions, validated questions. The result showed

  5. Assessment of sensorimotor cortical representation asymmetries and motor skills in violin players.

    Science.gov (United States)

    Schwenkreis, Peter; El Tom, Susan; Ragert, Patrick; Pleger, Burkhard; Tegenthoff, Martin; Dinse, Hubert R

    2007-12-01

    As a model for use-dependent plasticity, the brains of professional musicians have been extensively studied to examine structural and functional adaptation to unique requirements of skilled performance. Here we provide a combination of data on motor performance and hand representation in the primary motor and somatosensory cortex of professional violin players, with the aim of assessing possible behavioural consequences of sensorimotor cortical asymmetries. We studied 15 healthy right-handed professional violin players and 35 healthy nonmusician controls. Motor and somatosensory cortex asymmetry was assessed by recording the motor output map after transcranial magnetic stimulation from a small hand muscle, and by dipole source localization of somatosensory evoked potentials after electrical stimulation of the median and ulnar nerves. Motor performance was examined using a series of standardized motor tasks covering different aspects of hand function. Violin players showed a significant right-larger-than-left asymmetry of the motor and somatosensory cortex, whereas nonmusician controls showed no significant interhemispheric difference. The amount of asymmetry in the motor and somatosensory cortices of musicians was significantly correlated. At the behavioural level, motor performance did not significantly differ between musicians and nonmusicians. The results support a use-dependent enlargement of the left hand representation in the sensorimotor cortex of violin players. However, these cortical asymmetries were not paralleled by accompanying altered asymmetries at a behavioural level, suggesting that the reorganisation might be task-specific and does not lead to improved motor abilities in general.

  6. Validation of a novel venous duplex ultrasound objective structured assessment of technical skills for the assessment of venous reflux.

    Science.gov (United States)

    Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J

    2015-01-01

    Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  7. Development and validation of a new assessment tool for suturing skills in medical students.

    Science.gov (United States)

    Sundhagen, Henriette Pisani; Almeland, Stian Kreken; Hansson, Emma

    2018-01-01

    In recent years, emphasis has been put on that medical student should demonstrate pre-practice/pre-registration core procedural skills to ensure patient safety. Nonetheless, the formal teaching and training of basic suturing skills to medical students have received relatively little attention and there is no standard for what should be tested and how. The aim of this study was to develop and validate, using scientific methods, a tool for assessment of medical students' suturing skills, measuring both micro- and macrosurgical qualities. A tool was constructed and content, construct, concurrent validity, and inter-rater, inter-item, inter-test reliability were tested. Three groups were included: students with no training in suturing skills, students who have had training, plastic surgery. The results show promising reliability and validity when assessing novice medical students' suturing skills. Further studies are needed on implementation of the instrument. Moreover, how the instrument can be used to give formative feedback, evaluate if a required standard is met and for curriculum development needs further investigation.Level of Evidence: Not ratable.

  8. Use of simulated patients to assess the clinical and communication skills of community pharmacists.

    Science.gov (United States)

    Weiss, Marjorie C; Booth, Anneka; Jones, Bethan; Ramjeet, Sarah; Wong, Eva

    2010-06-01

    To investigate the quality and appropriateness of Emergency Hormonal Contraception (EHC) supply from community pharmacies. Community pharmacies in the southwest of England during 2007. Two simulated patient ('mystery shopper') scenarios to each participating pharmacy, one where the supply of EHC would be appropriate (scenario 1) and one where there was a drug interaction between EHC and St John's Wort, and the supply inappropriate (scenario 2). Pharmacy consultations were rated using criteria developed from two focus groups: one with pharmacist academics and one with female university students. Feedback to pharmacists to inform their continuing professional development was provided. Scores on rating scales encompassing the clinical and communication skills of the participating community pharmacists completed immediately after each mystery shopper visit. 40 pharmacist visits were completed: 21 for scenario 1 and 19 for scenario 2. Eighteen pharmacists were visited twice. Five pharmacists visited for scenario 2 supplied EHC against professional guidance, although other reference sources conflicted with this advice. Pharmacies which were part of the local PGD scheme scored higher overall in scenario 1 (P = 0.005) than those not part of the scheme. Overall the communication skills of pharmacists were rated highly although some pharmacists used jargon when explaining the interaction for scenario 2. Formatively assessing communication skills in an integrative manner alongside clinical skills has been identified as an important part of the medical consultation skills training and can be incorporated into the routine assessment and feedback of pharmacy over-the-counter medicines advice.

  9. From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining

    Science.gov (United States)

    Gobert, Janice D.; Sao Pedro, Michael; Raziuddin, Juelaila; Baker, Ryan S.

    2013-01-01

    We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

  10. Assessing Early Communication Skills at 12 Months: A Retrospective Study of Autism Spectrum Disorder

    Science.gov (United States)

    Swain, Nathaniel Robert; Eadie, Patricia Ann; Prior, Margot Ruth; Reilly, Sheena

    2015-01-01

    Background: Early identification of Autism Spectrum Disorder (ASD) is currently limited by the absence of reliable biological markers for the disorder, as well as the reliability of screening and assessment tools for children aged between 6 and 18 months. Ongoing research has demonstrated the importance of early social communication skills in…

  11. Assessment of Communication Skills of Physical Education and Sport Students in Turkish Universities

    Science.gov (United States)

    Aydin, Ali Dursun

    2015-01-01

    This study assessed the communication skills of the students studying in physical education and sports schools in various universities in Turkey. A total of 1,854 Physical Education and Sports students in five Turkish universities participated in the study. The instrument used to gather information for this study comprised the demographic…

  12. Video Review in Self-Assessment of Pharmacy Students' Communication Skills

    Science.gov (United States)

    Volino, Lucio R.; Das, Rolee Pathak

    2014-01-01

    The objectives of this study were to develop a student self-assessment activity of a video-recorded counseling session and evaluate its impact on student self-perceptions of specific communication skills. This activity was incorporated into a core-communications course within the third professional year of a Doctor of Pharmacy curriculum. Student…

  13. In-game assessment and training of nonverbal cognitive skills using TagTiles

    NARCIS (Netherlands)

    Verhaegh, J.; Fontijn, W.F.J.; Aarts, E.H.L.; Resing, W.C.M.

    2013-01-01

    We present a field study with a game for children called 'Tap the little hedgehog', which is played on the TagTiles console, a tangible electronic interface. The game was developed to train and assess cognitive skills and includes tasks which, in isolation, exhibit a high correlation with a number

  14. Assessment of knowledge and skills about growth monitoring amongst multipurpose workers in an ICDS project.

    Science.gov (United States)

    Kapil, U; Sood, A K; Gaur, D R; Bhasin, S

    1991-08-01

    Knowledge and skills amongst 34 multipurpose workers working in an ICDS project about growth monitoring was assessed using interview technique. All workers had correct knowledge about rationale of growth monitoring. A total of 73.5% and 94.1% had knowledge that flattened growth curve indicates no weight gain and descending growth indicates decrease in weight, respectively.

  15. Alternative Assessment--Can Real-World Skills Be Tested? Policy Briefs.

    Science.gov (United States)

    Simon, Karen; Gregg, Soleil

    Many educators are shifting their teaching strategies and approaches to include more emphasis on critical thinking skills, the communication of ideas, a variety of approaches to content emphasizing varied student learning styles, and the need to draw explicit connections among topics for retention of learning. Real-world assessment measures, then,…

  16. Generic Skill Development and Learning/Assessment Process: Use of Rubrics and Student Validation

    Science.gov (United States)

    Iborra Urios, Montserrat; Ramirez Rangel, Eliana; Bringué Tomàs, Roger; Tejero Salvador, Javier; Cunill García, Fidel; Fité Piquer, Carles

    2015-01-01

    To fulfill the European Higher Education context in the subject of the Chemical Engineering Undergraduate Degree of University of Barcelona named "Chemical Engineering Experimentation II" team work, written and oral communication generic skills were developed and assessed by means of rubrics. In order to appraise the methodological…

  17. Laparoscopic skills assessment: an additional modality for pediatric surgery fellowship selection.

    Science.gov (United States)

    Hazboun, Rajaie; Rodriguez, Samuel; Thirumoorthi, Arul; Baerg, Joanne; Moores, Donald; Tagge, Edward P

    2017-12-01

    The Pediatric Surgery fellow selection is a multi-layered process which has not included assessment of surgical dexterity. Data was collected prospectively as part of the 2016 Pediatric Surgery Match interview process. Applicants completed a questionnaire to document laparoscopic experience and fine motor skills activities. Actual laparoscopic skills were assessed using a simulator. Time to complete an intracorporeal knot was tabulated. An initial rank list was formulated based only on the ERAS application and interview scores. The rank list was re-formulated following the laparoscopic assessment. Un-paired T-test and regression were utilized to analyze the data. Forty applicants were interviewed with 18 matched (45%). The mean knot tying time was 201.31s for matched and 202.35s for unmatched applicants. Playing a musical instrument correlated with faster knot tying (p=0.03). No correlation was identified between knot tying time and either video game experience (p=0.4) or passing the FLS exam (p=0.78). Laparoscopic skills assessment lead to significant reordering of rank list (p=0.01). Laparoscopic skills performance significantly impacted ranking. Playing a musical instrument correlated with faster knot tying. No correlation was identified between laparoscopic performance and passing the FLS exam or other activities traditionally believed to improve technical ability. Prospective study. Level II. Copyright © 2017 Elsevier Inc. All rights reserved.

  18. A software-based tool for video motion tracking in the surgical skills assessment landscape

    NARCIS (Netherlands)

    Ganni, S.; Botden, Sanne M.B.I.; Chmarra, M.K.; Goossens, R.H.M.; Jakimowicz, J.J.

    2018-01-01

    Background: The use of motion tracking has been proved to provide an objective assessment in surgical skills training. Current systems, however, require the use of additional equipment or specialised laparoscopic instruments and cameras to extract the data. The aim of this study was to determine

  19. Using Reflection to Assess Students Ability to Learn and Develop Leadership Skills

    Science.gov (United States)

    Olsen, Heather M.; Burk, Brooke

    2014-01-01

    Leadership skill development has been identified as an important element of future leisure service professionals academic preparation. Thus, the purpose of this paper was to utilize in-depth course reflection and service-learning to assess whether undergraduate students enrolled in a leadership course were meeting the leadership objectives set…

  20. Developing Teachers' Knowledge and Skills at the Intersection of English Language Learners and Language Assessment

    Science.gov (United States)

    Téllez, Kip; Mosqueda, Eduardo

    2015-01-01

    The growth of teachers' professional knowledge and skills has been the topic of policy, research, and even philosophy for many decades. The assessment of English Learners (ELs), a more specific concern, has become an interest of the educational community in just the past 40 years (e.g., Harris, 1969). The authors' task in this chapter is to…