WorldWideScience

Sample records for model skill assessment

  1. Ecosystem Model Skill Assessment. Yes We Can!

    Science.gov (United States)

    Olsen, Erik; Fay, Gavin; Gaichas, Sarah; Gamble, Robert; Lucey, Sean; Link, Jason S.

    2016-01-01

    Need to Assess the Skill of Ecosystem Models Accelerated changes to global ecosystems call for holistic and integrated analyses of past, present and future states under various pressures to adequately understand current and projected future system states. Ecosystem models can inform management of human activities in a complex and changing environment, but are these models reliable? Ensuring that models are reliable for addressing management questions requires evaluating their skill in representing real-world processes and dynamics. Skill has been evaluated for just a limited set of some biophysical models. A range of skill assessment methods have been reviewed but skill assessment of full marine ecosystem models has not yet been attempted. Northeast US Atlantis Marine Ecosystem Model We assessed the skill of the Northeast U.S. (NEUS) Atlantis marine ecosystem model by comparing 10-year model forecasts with observed data. Model forecast performance was compared to that obtained from a 40-year hindcast. Multiple metrics (average absolute error, root mean squared error, modeling efficiency, and Spearman rank correlation), and a suite of time-series (species biomass, fisheries landings, and ecosystem indicators) were used to adequately measure model skill. Overall, the NEUS model performed above average and thus better than expected for the key species that had been the focus of the model tuning. Model forecast skill was comparable to the hindcast skill, showing that model performance does not degenerate in a 10-year forecast mode, an important characteristic for an end-to-end ecosystem model to be useful for strategic management purposes. Skill Assessment Is Both Possible and Advisable We identify best-practice approaches for end-to-end ecosystem model skill assessment that would improve both operational use of other ecosystem models and future model development. We show that it is possible to not only assess the skill of a complicated marine ecosystem model, but that

  2. Ecosystem Model Skill Assessment. Yes We Can!

    Science.gov (United States)

    Olsen, Erik; Fay, Gavin; Gaichas, Sarah; Gamble, Robert; Lucey, Sean; Link, Jason S

    2016-01-01

    Accelerated changes to global ecosystems call for holistic and integrated analyses of past, present and future states under various pressures to adequately understand current and projected future system states. Ecosystem models can inform management of human activities in a complex and changing environment, but are these models reliable? Ensuring that models are reliable for addressing management questions requires evaluating their skill in representing real-world processes and dynamics. Skill has been evaluated for just a limited set of some biophysical models. A range of skill assessment methods have been reviewed but skill assessment of full marine ecosystem models has not yet been attempted. We assessed the skill of the Northeast U.S. (NEUS) Atlantis marine ecosystem model by comparing 10-year model forecasts with observed data. Model forecast performance was compared to that obtained from a 40-year hindcast. Multiple metrics (average absolute error, root mean squared error, modeling efficiency, and Spearman rank correlation), and a suite of time-series (species biomass, fisheries landings, and ecosystem indicators) were used to adequately measure model skill. Overall, the NEUS model performed above average and thus better than expected for the key species that had been the focus of the model tuning. Model forecast skill was comparable to the hindcast skill, showing that model performance does not degenerate in a 10-year forecast mode, an important characteristic for an end-to-end ecosystem model to be useful for strategic management purposes. We identify best-practice approaches for end-to-end ecosystem model skill assessment that would improve both operational use of other ecosystem models and future model development. We show that it is possible to not only assess the skill of a complicated marine ecosystem model, but that it is necessary do so to instill confidence in model results and encourage their use for strategic management. Our methods are applicable

  3. Skill and independence weighting for multi-model assessments

    International Nuclear Information System (INIS)

    Sanderson, Benjamin M.; Wehner, Michael; Knutti, Reto

    2017-01-01

    We present a weighting strategy for use with the CMIP5 multi-model archive in the fourth National Climate Assessment, which considers both skill in the climatological performance of models over North America as well as the inter-dependency of models arising from common parameterizations or tuning practices. The method exploits information relating to the climatological mean state of a number of projection-relevant variables as well as metrics representing long-term statistics of weather extremes. The weights, once computed can be used to simply compute weighted means and significance information from an ensemble containing multiple initial condition members from potentially co-dependent models of varying skill. Two parameters in the algorithm determine the degree to which model climatological skill and model uniqueness are rewarded; these parameters are explored and final values are defended for the assessment. The influence of model weighting on projected temperature and precipitation changes is found to be moderate, partly due to a compensating effect between model skill and uniqueness. However, more aggressive skill weighting and weighting by targeted metrics is found to have a more significant effect on inferred ensemble confidence in future patterns of change for a given projection.

  4. Summary Diagrams for Coupled Hydrodynamic-Ecosystem Model Skill Assessment

    Science.gov (United States)

    2009-01-01

    numerical model study of the Georges bank ecosystems. Part II: biological-physical model. Deep-Sea Research II 48, 457-482. Friedrichs. M.A.M., Dusenberry...upper ocean ecology, photochemistry, and optics. NRL Technical Memorandum. NRI ./MR/7330-07-9026. Naval Research Laboratory, Stennis Space Center...Wallhead, P.J., Martin. A.P.. Srokosz, M.A.. Franks, P.J.S., in press. Predicting the bulk plankton dynamics of Georges Bank : model skill assessment

  5. Towards an Integrated Model for Developing Sustainable Assessment Skills

    Science.gov (United States)

    Fastre, Greet M. J.; van der Klink, Marcel R.; Sluijsmans, Dominique; van Merrienboer, Jeroen J. G.

    2013-01-01

    One of the goals of current education is to ensure that graduates can act as independent lifelong learners. Graduates need to be able to assess their own learning and interpret assessment results. The central question in this article is how to acquire sustainable assessment skills, enabling students to assess their performance and learning…

  6. Assessment of Teacher Perceived Skill in Classroom Assessment Practices Using IRT Models

    Science.gov (United States)

    Koloi-Keaikitse, Setlhomo

    2017-01-01

    The purpose of this study was to assess teacher perceived skill in classroom assessment practices. Data were collected from a sample of (N = 691) teachers selected from government primary, junior secondary, and senior secondary schools in Botswana. Item response theory models were used to identify teacher response on items that measured their…

  7. Assessing Teacher Technology Skills.

    Science.gov (United States)

    Anderson, Mary Alice

    2000-01-01

    Advocates the assessment of teachers' technology skills by school media and technology specialists who are involved in staff training. Discusses what should be assessed, including level of curricular integration and attitudes; assessment objectives; informal assessments; formal assessments; assessment tools; and administrators as role models for…

  8. Moving beyond Assessment to Improving Students' Critical Thinking Skills: A Model for Implementing Change

    Science.gov (United States)

    Haynes, Ada; Lisic, Elizabeth; Goltz, Michele; Stein, Barry; Harris, Kevin

    2016-01-01

    This research examines how the use of the CAT (Critical thinking Assessment Test) and involvement in CAT-Apps (CAT Applications within the discipline) training can serve as an important part of a faculty development model that assists faculty in the assessment of students' critical thinking skills and in the development of these skills within…

  9. Model of practical skill performance as an instrument for supervision and formative assessment

    DEFF Research Database (Denmark)

    Nielsen, Carsten; Sommer, Irene; Larsen, Karin

    2012-01-01

    learning are sparsely researched in the field of clinical education for nursing students. This paper reports on an action research study that promoted and investigated use of The Model of Practical Skill Performance as a learning tool during nursing students’ clinical placement. Clinical supervisors...... as during practice, performance and formative assessment of practical skills learning. It provided a common language about practical skills and enhanced the participants’ understanding of professionalism in practical nursing skill. In conclusion, the model helped to highlight the complexity in mastering...

  10. Operational ocean models in the Adriatic Sea: a skill assessment

    Directory of Open Access Journals (Sweden)

    J. Chiggiato

    2008-02-01

    Full Text Available In the framework of the Mediterranean Forecasting System (MFS project, the performance of regional numerical ocean forecasting systems is assessed by means of model-model and model-data comparison. Three different operational systems considered in this study are: the Adriatic REGional Model (AREG; the Adriatic Regional Ocean Modelling System (AdriaROMS and the Mediterranean Forecasting System General Circulation Model (MFS-GCM. AREG and AdriaROMS are regional implementations (with some dedicated variations of POM and ROMS, respectively, while MFS-GCM is an OPA based system. The assessment is done through standard scores. In situ and remote sensing data are used to evaluate the system performance. In particular, a set of CTD measurements collected in the whole western Adriatic during January 2006 and one year of satellite derived sea surface temperature measurements (SST allow to asses a full three-dimensional picture of the operational forecasting systems quality during January 2006 and to draw some preliminary considerations on the temporal fluctuation of scores estimated on surface quantities between summer 2005 and summer 2006.

    The regional systems share a negative bias in simulated temperature and salinity. Nonetheless, they outperform the MFS-GCM in the shallowest locations. Results on amplitude and phase errors are improved in areas shallower than 50 m, while degraded in deeper locations, where major models deficiencies are related to vertical mixing overestimation. In a basin-wide overview, the two regional models show differences in the local displacement of errors. In addition, in locations where the regional models are mutually correlated, the aggregated mean squared error was found to be smaller, that is a useful outcome of having several operational systems in the same region.

  11. Multi-model global assessment of subseasonal prediction skill of atmospheric rivers

    Science.gov (United States)

    Deflorio, M. J.

    2017-12-01

    Atmospheric rivers (ARs) are global phenomena that are characterized by long, narrow plumes of water vapor transport. They are most often observed in the midlatitudes near climatologically active storm track regions. Because of their frequent association with floods, landslides, and other hydrological impacts on society, there is significant incentive at the intersection of academic research, water management, and policymaking to understand the skill with which state-of-the-art operational weather models can predict ARs weeks-to-months in advance. We use the newly assembled Subseasonal-to-Seasonal (S2S) database, which includes extensive hindcast records of eleven operational weather models, to assess global prediction skill of atmospheric rivers on S2S timescales. We develop a metric to assess AR skill that is suitable for S2S timescales by counting the total number of AR days which occur over each model and observational grid cell during a 2-week time window. This "2-week AR occurrence" metric is suitable for S2S prediction skill assessment because it does not consider discrete hourly or daily AR objects, but rather a smoothed representation of AR occurrence over a longer period of time. Our results indicate that several of the S2S models, especially the ECMWF model, show useful prediction skill in the 2-week forecast window, with significant interannual variation in some regions. We also present results from an experimental forecast of S2S AR prediction skill using the ECMWF and NCEP models.

  12. Innovative integrative bedside teaching model improves tutors’ self-assessments of teaching skills and attitudes

    Directory of Open Access Journals (Sweden)

    Itai Gat

    2016-02-01

    Full Text Available Introduction: Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST practiced during tutor training workshop and its resulting effect on practitioners’ self assessment of teaching skills and perceptions. Methods: One-day tutor training workshop included theoretical knowledge supplementation regarding tutors’ roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Results: Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5 compared with pre-training (mean 2.6, SD 0.6; p<0.001 with significant increase in most examined parameters. Significantly improved tutor's roles internalization was demonstrated after training completion (mean 3.7, SD 0.3 compared with pre-workshop (mean 3.5 SD 0.5; p=0.002. Discussion: Successful BST involves combination of clinical and communication skills. BST model practiced during the workshop may contribute to improved teaching skills in this challenging environment.

  13. Innovative integrative bedside teaching model improves tutors’ self-assessments of teaching skills and attitudes

    Science.gov (United States)

    Gat, Itai; Pessach-Gelblum, Liat; Givati, Gili; Haim, Nadav; Paluch-Shimon, Shani; Unterman, Avraham; Bar-Shavit, Yochay; Grabler, Galit; Sagi, Doron; Achiron, Anat; Ziv, Amitai

    2016-01-01

    Introduction Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST) practiced during tutor training workshop and its resulting effect on practitioners’ self assessment of teaching skills and perceptions. Methods One-day tutor training workshop included theoretical knowledge supplementation regarding tutors’ roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Results Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5) compared with pre-training (mean 2.6, SD 0.6; pskills. BST model practiced during the workshop may contribute to improved teaching skills in this challenging environment. PMID:26894587

  14. Innovative integrative bedside teaching model improves tutors' self-assessments of teaching skills and attitudes.

    Science.gov (United States)

    Gat, Itai; Pessach-Gelblum, Liat; Givati, Gili; Haim, Nadav; Paluch-Shimon, Shani; Unterman, Avraham; Bar-Shavit, Yochay; Grabler, Galit; Sagi, Doron; Achiron, Anat; Ziv, Amitai

    2016-01-01

    Patient bedside is the ideal setting for teaching physical examination, medical interviewing, and interpersonal skills. Herein we describe a novel model for bedside teaching (BST) practiced during tutor training workshop and its resulting effect on practitioners' self assessment of teaching skills and perceptions. One-day tutor training workshop included theoretical knowledge supplementation regarding tutors' roles as well as implementing practical tools for clinical education, mainly BST model. The model, which emphasizes simultaneous clinical and communication teaching in a stepwise approach, was practiced by consecutive simulations with a gradual escalation of difficulty and adjusted instruction approaches. Pre- and post-workshop-adjusted questionnaires using a Likert scale of 1 to 4 were completed by participants and compared. Analysis was based on 25 out of 48 participants who completed both questionnaires. Significantly improved teaching skills were demonstrated upon workshop completion (mean 3.3, SD 0.5) compared with pre-training (mean 2.6, SD 0.6; pteaching skills in this challenging environment.

  15. An assessment model of historical thinking skills by means of the RASCH model

    Directory of Open Access Journals (Sweden)

    Ofianto Ofianto

    2015-06-01

    Full Text Available This study was conducted to produce a model and instruments of historical thinking skills in the history subject at the senior high school (SHS and to identify SHS students’ historical thinking skills. The study was conducted in two stages, namely model development and instrument development altogether with a small-scale tryout and a large-scale tryout. The test for each tryout consisted of six and five sub-test sets. Each test set contained 20 anchor items. The sample for each tryout comprised 1573 and 2613 testees. The data was analyzed by means of Partial Credit Model (PCM using the QUEST program. The overall tryout results indicate that, based on the criteria for an INFIT MNSQ mean of 0.1 and a standard deviation of 1.0, the tests fit the PCM. The reliability coefficients of the tests for the tryouts are moderately good; the Cronbach’s alpha coefficients are, respectively, 0.65 and 0.54. The lowest score of historical thinking skills is -.352 and the highest is +1.21 in an ideal range of -4.0 to +4.0. In overall, the testees’ scores are not satisfactory. Only 5.89% of the testees are above the expected median.

  16. The Standardized Professional Encounter: A New Model to Assess Professionalism and Communication Skills.

    Science.gov (United States)

    Lifchez, Scott D; Cooney, Carisa M; Redett, Richard J

    2015-06-01

    Physician-patient communication is vital to patient care, and physician-nurse interactions are equally critical. Conflict between nurses and physicians can greatly impair communication, increasing the risk of treatment errors, yet physicians receive little education during training on recognizing and resolving professional conflicts. We created and implemented the Standardized Professional (S-Pro) Encounter to improve training and provide opportunities to evaluate resident professionalism and communication with health care team colleagues. The standardized patient model is well established for teaching and assessing clinical and communication skills. Using the standardized patient concept, we created a nurse-resident encounter with 2 professionally trained medical portrayers (1 "nurse," 1 "patient"), in which the nurse disagrees with the resident's treatment plan. Residents were surveyed for prior experience with nurse-physician conflict management, and we assessed postencounter for collaborative skills and conflict resolution. All residents (n=18) observed at least 1 physician-nurse conflict in front of patients. Eleven (61%) reported being involved in at least 1 conflict. Twelve residents (67%) had 2 or fewer prior education experiences in interprofessional conflict management. Faculty assessment and S-Pro scores demonstrated high agreement, while resident self-assessment scores demonstrated low agreement with faculty and S-Pro scores. Participants and evaluators found the encounter to be reasonably authentic. There was strong agreement between the faculty and S-Pro assessment of resident performance when using the Boggs scale. The S-Pro Encounter is easily adapted for other clinical situations or training programs, and facilitates the assessment of professionalism and communication skills between residents and other health care professionals.

  17. The assessment of knowledge and learning in competence spaces: The gain-loss model for dependent skills.

    Science.gov (United States)

    Anselmi, Pasquale; Stefanutti, Luca; de Chiusole, Debora; Robusto, Egidio

    2017-11-01

    The gain-loss model (GaLoM) is a formal model for assessing knowledge and learning. In its original formulation, the GaLoM assumes independence among the skills. Such an assumption is not reasonable in several domains, in which some preliminary knowledge is the foundation for other knowledge. This paper presents an extension of the GaLoM to the case in which the skills are not independent, and the dependence relation among them is described by a well-graded competence space. The probability of mastering skill s at the pretest is conditional on the presence of all skills on which s depends. The probabilities of gaining or losing skill s when moving from pretest to posttest are conditional on the mastery of s at the pretest, and on the presence at the posttest of all skills on which s depends. Two formulations of the model are presented, in which the learning path is allowed to change from pretest to posttest or not. A simulation study shows that models based on the true competence space obtain a better fit than models based on false competence spaces, and are also characterized by a higher assessment accuracy. An empirical application shows that models based on pedagogically sound assumptions about the dependencies among the skills obtain a better fit than models assuming independence among the skills. © 2017 The British Psychological Society.

  18. Employability Skills Assessment Tool Development

    Science.gov (United States)

    Rasul, Mohamad Sattar; Rauf, Rose Amnah Abd; Mansor, Azlin Norhaini; Puvanasvaran, A. P.

    2012-01-01

    Research nationally and internationally found that technical graduates are lacking in employability skills. As employability skills are crucial in outcome-based education, the main goal of this research is to develop an Employability Skill Assessment Tool to help students and lecturers produce competent graduates in employability skills needed by…

  19. Skill assessment of the PELAGOS global ocean biogeochemistry model over the period 1980–2000

    Directory of Open Access Journals (Sweden)

    M. Vichi

    2009-11-01

    Full Text Available Global Ocean Biogeochemistry General Circulation Models are useful tools to study biogeochemical processes at global and large scales under current climate and future scenario conditions. The credibility of future estimates is however dependent on the model skill in capturing the observed multi-annual variability of firstly the mean bulk biogeochemical properties, and secondly the rates at which organic matter is processed within the food web. For this double purpose, the results of a multi-annual simulation of the global ocean biogeochemical model PELAGOS have been objectively compared with multi-variate observations from the last 20 years of the 20th century, both considering bulk variables and carbon production/consumption rates. Simulated net primary production (NPP is comparable with satellite-derived estimates at the global scale and when compared with an independent data-set of in situ observations in the equatorial Pacific. The usage of objective skill indicators allowed us to demonstrate the importance of comparing like with like when considering carbon transformation processes. NPP scores improve substantially when in situ data are compared with modeled NPP which takes into account the excretion of freshly-produced dissolved organic carbon (DOC. It is thus recommended that DOC measurements be performed during in situ NPP measurements to quantify the actual production of organic carbon in the surface ocean. The chlorophyll bias in the Southern Ocean that affects this model as well as several others is linked to the inadequate representation of the mixed layer seasonal cycle in the region. A sensitivity experiment confirms that the artificial increase of mixed layer depths towards the observed values substantially reduces the bias. Our assessment results qualify the model for studies of carbon transformation in the surface ocean and metabolic balances. Within the limits of the model assumption and known biases, PELAGOS indicates a net

  20. Assessment of prediction skill in equatorial Pacific Ocean in high resolution model of CFS

    Science.gov (United States)

    Arora, Anika; Rao, Suryachandra A.; Pillai, Prasanth; Dhakate, Ashish; Salunke, Kiran; Srivastava, Ankur

    2018-01-01

    The effect of increasing atmospheric resolution on prediction skill of El Niño southern oscillation phenomenon in climate forecast system model is explored in this paper. Improvement in prediction skill for sea surface temperature (SST) and winds at all leads compared to low resolution model in the tropical Indo-Pacific basin is observed. High resolution model is able to capture extreme events reasonably well. As a result, the signal to noise ratio is improved in the high resolution model. However, spring predictability barrier (SPB) for summer months in Nino 3 and Nino 3.4 region is stronger in high resolution model, in spite of improvement in overall prediction skill and dynamics everywhere else. Anomaly correlation coefficient of SST in high resolution model with observations in Nino 3.4 region targeting boreal summer months when predicted at lead times of 3-8 months in advance decreased compared its lower resolution counterpart. It is noted that higher variance of winds predicted in spring season over central equatorial Pacific compared to observed variance of winds results in stronger than normal response on subsurface ocean, hence increases SPB for boreal summer months in high resolution model.

  1. Competencies, skills and assessment

    DEFF Research Database (Denmark)

    Højgaard, Tomas

    2009-01-01

    This paper is an analysis of the challenge of assessing student learning and how that is affected by using descriptions of competencies as a core element when describing the aims of the learning process. Assessment is modelled as a three step process; characterising, identifying and judging, to a...... the characterisation part of an assessment process. From a teaching and teachers' perspective, the latter is far more important than the former.......This paper is an analysis of the challenge of assessing student learning and how that is affected by using descriptions of competencies as a core element when describing the aims of the learning process. Assessment is modelled as a three step process; characterising, identifying and judging......, to allow for the following argument: Working with competency descriptions is rightly said to make judging more difficult. This potentially lowers the reliability of the assessment. But competency descriptions also carry a great potential of raising the validity of the assessment by focusing...

  2. Arthroscopic skills assessment and use of box model for training in arthroscopic surgery using Sawbones – “FAST” workstation

    Directory of Open Access Journals (Sweden)

    Goyal Saumitra

    2016-01-01

    Full Text Available Purpose: Arthroscopic skills training outside the operative room may decrease risks and errors by trainee surgeons. There is a need of simple objective method for evaluating proficiency and skill of arthroscopy trainees using simple bench model of arthroscopic simulator. The aim of this study is to correlate motor task performance to level of prior arthroscopic experience and establish benchmarks for training modules. Methods: Twenty orthopaedic surgeons performed a set of tasks to assess a arthroscopic triangulation, b navigation, c object handling and d meniscus trimming using SAWBONES “FAST” arthroscopy skills workstation. Time to completion and the errors were computed. The subjects were divided into four levels; “Novice”, “Beginner”, “Intermediate” and “Advanced” based on previous arthroscopy experience, for analyses of performance. Results: The task performance under transparent dome was not related to experience of the surgeon unlike opaque dome, highlighting the importance of hand-eye co-ordination required in arthroscopy. Median time to completion for each task improved as the level of experience increased and this was found to be statistically significant (p 85% of subjects across all the levels reported improvement in performance with sequential tasks. Conclusion: Use of the arthroscope requires visuo-spatial coordination which is a skill that develops with practice. This simple box model can reliably differentiate the arthroscopic skills based on experience and can be used to monitor progression of skills of trainees in institutions.

  3. Assessing Writing Skills

    Science.gov (United States)

    Narayanan, M.

    2013-12-01

    This is an encore presentation of what was presented at the 2012 AGU International Conference. It was entitled: 'ASSESSING CORE COMPETENCIES.' The poster presentation, however, has been redesigned and reorganized with new, revised perspectives. The importance of ASSESSMENT principles has been emphasized. Catherine Palomba and Trudy Banta offer the following definition of assessment, adapted from one provided by Marchese in 1987. Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development. (Palomba and Banta 1999). Educational institutions are committing substantial resources to the establishment of dedicated technology-based laboratories, so that they will be able to accommodate and fulfill students' desire to master certain of these specific skills. This type of technology-based instruction may raise some fundamental questions about the core competencies of the student learner. Some of the most important questions are : 1. Is the utilization of these fast high-powered computers and user-friendly software programs creating a totally non-challenging instructional environment for the student learner ? 2. Can technology itself all too easily overshadow the learning outcomes intended ? 3. Are the educational institutions simply training students how to use technology rather than educating them in the appropriate field ? 4. Are we still teaching content-driven courses and analysis oriented subject matter ? 5. Are these sophisticated modern era technologies contributing to a decline in the Critical Thinking Capabilities of the 21st century technology-savvy students ? The author tries to focus on technology as a tool and not on the technology itself. He further argues that students must demonstrate that they have the have the ability to think critically before they make an attempt to use technology in a chosen application-specific environment. The author further

  4. Developing Technical Skill Assessments

    Science.gov (United States)

    Hyslop, Alisha

    2009-01-01

    One of the biggest challenges facing the career and technical education (CTE) community as it works to implement the 2006 Perkins Act is responding to more rigorous requirements for reporting on CTE students' technical skill attainment. The U.S. Department of Education suggested in non-regulatory guidance that states and locals use the number of…

  5. Implementation of “PLST” Assessment Model to Detect Development of Language Skill in Early Childhood (Phase II

    Directory of Open Access Journals (Sweden)

    Nelva Rolina

    2015-05-01

    Full Text Available This research will be done for 3 years (3 phases. The first year had been done on 2013 ago. 2014 is the second year of research (phase II. Research phase of this study (second year, namely development phase: the prototype of model is developed to be a model. The activities carried out in phase II include: expert validation test, readability test, revision, kindergarten teacher training, limited trial, and the trial was extended to find models that fit between the theoretical concepts with empirical data in the field. And finally (second year, from all kindergarten which be the sample study, it was found that all kindergarten were using the general assessment without special assessment for development of children’s language, so it is necessary to create assessment “PLST” to detect the development of language skill for early childhood (kindergarten student. It has to continue in second to third year. The final research, which is at the end of the third year (phase III is expected to match model assessment “PLST” as well as the guidance in learning in kindergarten, which can be used by teachers to detect and monitor the development of language skills, identifying the amount of vocabulary and sentences are mastered children, and the stages of language development next. To achieve these objectives, the researcher adopted a model of research, development, and diffusion by Hopkins & Clark (Havelock, 1976

  6. Modelling Kara Sea phytoplankton primary production: Development and skill assessment of regional algorithms

    Science.gov (United States)

    Demidov, Andrey B.; Kopelevich, Oleg V.; Mosharov, Sergey A.; Sheberstov, Sergey V.; Vazyulya, Svetlana V.

    2017-07-01

    Empirical region-specific (RSM), depth-integrated (DIM) and depth-resolved (DRM) primary production models are developed based on data from the Kara Sea during the autumn (September-October 1993, 2007, 2011). The model is validated by using field and satellite (MODIS-Aqua) observations. Our findings suggest that RSM algorithms perform better than non-region-specific algorithms (NRSM) in terms of regression analysis, root-mean-square difference (RMSD) and model efficiency. In general, the RSM and NRSM underestimate or overestimate the in situ water column integrated primary production (IPP) by a factor of 2 and 2.8, respectively. Additionally, our results suggest that the model skill of the RSM increases when the chlorophyll specific carbon fixation rate, efficiency of photosynthesis and photosynthetically available radiation (PAR) are used as input variables. The parameterization of chlorophyll (chl a) vertical profiles is performed in Kara Sea waters with different trophic statuses. Model validation with field data suggests that the DIM and DRM algorithms perform equally (RMSD of 0.29 and 0.31, respectively). No changes in the performance of the DIM and DRM algorithms are observed (RMSD of 0.30 and 0.31, respectively) when satellite-derived chl a, PAR and the diffuse attenuation coefficient (Kd) are applied as input variables.

  7. Assessing Trainee Surgeons’ Nontechnical Skills

    DEFF Research Database (Denmark)

    Spanager, Lene; Konge, Lars; Dieckmann, Peter

    2015-01-01

    BACKGROUND: Trainee surgeons would benefit from regular, formative assessments to ensure they learn the nontechnical aspects of surgical performance. Non-Technical Skills for Surgeons in Denmark (NOTSSdk) is a tool to assess surgeons' nontechnical skills (NTS) during an operation. The aims......, although 2 elements of leadership ("supporting others" and "coping with pressure") were considered irrelevant in 27% to 31% of the cases. Assessments of 5 procedures were sufficient to gain reliable ratings (Generalizability coefficient > 0.80) of a trainee surgeon's NTS. CONCLUSION: As supervisors used...

  8. Construct Validity of a Simple Laparoscopic Ovarian Cystectomy Model Using a Validated Objective Structured Assessment of Technical Skills.

    Science.gov (United States)

    Chahine, Elizabeth Britton; Han, Chan Hee; Auguste, Tamika

    To determine the construct validity and interrater reliability of a laparoscopic ovarian cystectomy simulator using a global rating scale. Prospective blinded observational study (Canadian Task Force classification II.3). Academic teaching hospital. A total of 26 postgraduate year (PGY) 1 to 4 gynecology and obstetrics residents were recruited (15 junior residents, postgraduate year PGY 1-2 and 11 senior residents, PGY 3-4). We developed a simple, low-cost laparoscopic ovarian cystectomy simulator and incorporated it into our simulation curriculum. The simulation was directed at junior residents with instruction and immediate feedback in a scheduled simulation session once during the academic year. At the end of the year resident skills assessment, all levels were recorded with video using this model to assess the construct validity between junior and senior residents. Resident performance was later evaluated and scored by 2 blinded, experienced laparoscopists using a validated Objective Structured Assessment of Technical Skills (OSATS). Each resident received a unique identification number and the simulated laparoscopic ovarian cystectomy procedure was filmed during the end of the year assessment. Two blinded raters evaluated the video of each resident with the modified Global Rating Scale (OSATS), using 5 of the 7 domains (respect for tissue, time and motion, instrument handling, flow of operation and knowledge of specific procedure). An average of the 2 ratings was computed for each domain, and comparisons were made using the Mann-Whitney U test. Interrater reliability was calculated using the Kendall tau β correlation coefficient. Construct validity was determined by comparing the rank scores of the junior to senior residents in each domain. Construct validity and interrater reliability was demonstrated in all of the measured domains except for respect for tissue. This simple, low-cost model can be used to teach important laparoscopic ovarian cystectomy skills

  9. Modeling the Assessment of the Pre-School Children's Motor and Linguistic Skills

    OpenAIRE

    Shingjergji, Besa; Shingjergji, Ardian

    2014-01-01

    Development is a multi-sided process entailing the changes occurring to the individuals in the course of their lifetime. In children, the development perceptions includes the interaction of such fields as the physical, emotional, cognitive and social domains. In this context, the interest fields of this study are those of the pre-school children’s motor and linguistic skills as well as their games as necessary means effecting the development of these skills. Object of the study is the assessm...

  10. Assessing Students' Technical Skill Attainment

    Science.gov (United States)

    Jorgensen, Haley

    2010-01-01

    The Wisconsin Technical College System (WTCS) is working to comply with the Carl D. Perkins Career and Technical Education Improvement Act of 2006 (Perkins) to ensure that its graduates have mastered the technical skills needed by business and industry. The legislation requires that each state identify and approve program assessment strategies…

  11. Assessing the Effectiveness of Holistic Multidimensional Treatment Model (Hojjati Model on Receptive and Expressive Language Skills in Autistic Children

    Directory of Open Access Journals (Sweden)

    Maryam Hojjati

    2017-05-01

    Full Text Available Background: Autism as part of the category called Autism spectrum disorder (ASD, is caused by disorders in brain and nervous network and characterized by defect in social behavior, language and cognition. This study aimed to investigate receptive and expressive language performance and the severity of the disorder in 30 children with autism aged 2-8 years who speak in Persian language. Materials and Methods In this cross-sectional study 30 children with autism were selected using random sampling method. The study tools included "The Childhood Autism Rating Scale (CARS", and "Newsha Developmental Scale (NDS" for assessing the receptive - expressive language skills. In order to assess the level of language impairment in subjects, the participants were divided into 5 groups with 6 people (considering the speaking ability including sign language and speech, with equal number of boys and girls (3 girls and 3 boys in each group. All of these children were evaluated by pediatric psychiatry, pediatric neurologist and pediatrician and were assessed according to the criteria for autism based on the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-V. Eventually, the data were analyzed using descriptive and inferential statistics in SPSS version 16.0 software. Results The results showed that there was a significant difference between the mean (standard deviation and scores of receptive – expressive language skills in autistic subjects in each of the groups (P

  12. Training and Assessment of Hysteroscopic Skills

    DEFF Research Database (Denmark)

    Savran, Mona Meral; Sørensen, Stine Maya Dreier; Konge, Lars

    2016-01-01

    , of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal......OBJECTIVE: The aim of this systematic review was to identify studies on hysteroscopic training and assessment. DESIGN: PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies...... on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study...

  13. A standardized patient model to teach and assess professionalism and communication skills: the effect of personality type on performance.

    Science.gov (United States)

    Lifchez, Scott D; Redett, Richard J

    2014-01-01

    Teaching and assessing professionalism and interpersonal communication skills can be more difficult for surgical residency programs than teaching medical knowledge or patient care, for which many structured educational curricula and assessment tools exist. Residents often learn these skills indirectly, by observing the behavior of their attendings when communicating with patients and colleagues. The purpose of this study was to assess the results of an educational curriculum we created to teach and assess our residents in professionalism and communication. We assessed resident and faculty prior education in delivering bad news to patients. Residents then participated in a standardized patient (SP) encounter to deliver bad news to a patient's family regarding a severe burn injury. Residents received feedback from the encounter and participated in an education curriculum on communication skills and professionalism. As a part of this curriculum, residents underwent assessment of communication style using the Myers-Briggs type inventory. The residents then participated in a second SP encounter discussing a severe pulmonary embolus with a patient's family. Resident performance on the SP evaluation correlated with an increased comfort in delivering bad news. Comfort in delivering bad news did not correlate with the amount of prior education on the topic for either residents or attendings. Most of our residents demonstrated an intuitive thinking style (NT) on the Myers-Briggs type inventory, very different from population norms. The lack of correlation between comfort in delivering bad news and prior education on the subject may indicate the difficulty in imparting communication and professionalism skills to residents effectively. Understanding communication style differences between our residents and the general population can help us teach professionalism and communication skills more effectively. With the next accreditation system, residency programs would need to

  14. Ocean forecasting in terrain-following coordinates: Formulation and skill assessment of the Regional Ocean Modeling System

    Science.gov (United States)

    Haidvogel, D.B.; Arango, H.; Budgell, W.P.; Cornuelle, B.D.; Curchitser, E.; Di, Lorenzo E.; Fennel, K.; Geyer, W.R.; Hermann, A.J.; Lanerolle, L.; Levin, J.; McWilliams, J.C.; Miller, A.J.; Moore, A.M.; Powell, T.M.; Shchepetkin, A.F.; Sherwood, C.R.; Signell, R.P.; Warner, J.C.; Wilkin, J.

    2008-01-01

    Systematic improvements in algorithmic design of regional ocean circulation models have led to significant enhancement in simulation ability across a wide range of space/time scales and marine system types. As an example, we briefly review the Regional Ocean Modeling System, a member of a general class of three-dimensional, free-surface, terrain-following numerical models. Noteworthy characteristics of the ROMS computational kernel include: consistent temporal averaging of the barotropic mode to guarantee both exact conservation and constancy preservation properties for tracers; redefined barotropic pressure-gradient terms to account for local variations in the density field; vertical interpolation performed using conservative parabolic splines; and higher-order, quasi-monotone advection algorithms. Examples of quantitative skill assessment are shown for a tidally driven estuary, an ice-covered high-latitude sea, a wind- and buoyancy-forced continental shelf, and a mid-latitude ocean basin. The combination of moderate-order spatial approximations, enhanced conservation properties, and quasi-monotone advection produces both more robust and accurate, and less diffusive, solutions than those produced in earlier terrain-following ocean models. Together with advanced methods of data assimilation and novel observing system technologies, these capabilities constitute the necessary ingredients for multi-purpose regional ocean prediction systems. 

  15. Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

    Science.gov (United States)

    Zhao, Bin; Zhang, Bo

    2018-02-01

    Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called "double-penalty" problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.

  16. Advances in Teaching and Assessing Nontechnical Skills.

    Science.gov (United States)

    Hull, Louise; Sevdalis, Nick

    2015-08-01

    The importance of surgeons' nontechnical skills is gaining widespread recognition as a critical element of high-quality and safe surgical care. This article reviews the knowledge base on training and assessing surgeons, and operating room (OR) teams, in nontechnical aspects of their performance. Nontechnical skills are defined in the context of the OR and key assessment instruments that have been developed to capture these skills are reviewed. Key developments that have taken place in the past decade on formal skills training are discussed, and recommendations to further advance nontechnical skills and team-based training and assessment in surgery are presented. Copyright © 2015 Elsevier Inc. All rights reserved.

  17. A Perkins Challenge: Assessing Technical Skills in CTE

    Science.gov (United States)

    Stone, James R., III

    2009-01-01

    Federal law requires state to develop performance measures and data-collection systems for secondary and postsecondary technical-skill attainment. This poses many challenges, such as defining a technical skills, measurement and when to assess students. In this article, the author outlines various assessment models and looks at the challenges…

  18. Employability Skills Assessment: Measuring Work Ethic for Research and Learning

    Science.gov (United States)

    Park, HwaChoon; Hill, Roger B.

    2016-01-01

    The Employability Skills Assessment (ESA) was developed by Hill (1995) to provide an alternative measure of work ethic needed for success in employment. This study tested goodness-of-fit for a model used to interpret ESA results. The model had three factors: interpersonal skills, initiative, and dependability. Confirmatory factor analysis results…

  19. The odontology victim identification skill assessment system.

    Science.gov (United States)

    Zohn, Harry K; Dashkow, Sheila; Aschheim, Kenneth W; Dobrin, Lawrence A; Glazer, Howard S; Kirschbaum, Mitchell; Levitt, Daniel; Feldman, Cecile A

    2010-05-01

    Mass fatality identification efforts involving forensic odontology can involve hundreds of dental volunteers. A literature review was conducted and forensic odontologists and dental educators consulted to identify lessons learned from past mass fatality identification efforts. As a result, the authors propose a skill assessment system, the Odontology Victim Identification Skill Assessment System (OVID-SAS), which details qualifications required to participate on the Antemortem, Postmortem, Ante/Postmortem Comparison, Field, and Shift Leader/Initial Response Teams. For each qualification, specific skills have been identified along with suggested educational pedagogy and skill assessment methods. Courses and assessments can be developed by dental schools, professional associations, or forensic organizations to teach and test for the skills required for dental volunteers to participate on each team. By implementing a system, such as OVID-SAS, forensic odontologists responsible for organizing and managing a forensic odontology mass fatality identification effort will be able to optimally utilize individuals presenting with proven skills.

  20. Teaching and Assessing Engineering Professional Skills

    OpenAIRE

    Ali M. Al-Bahi; Mahmoud A. Taha; Nedim Turkmen

    2013-01-01

    Engineering students are required to have, by the time of graduation, a set of professional skills related to teamwork, oral and written communications, impact of engineering solutions, life-long learning, and knowledge of contemporary issues. Teaching and assessment of these skills, as part of ABET accreditation, remains problematic. A systematic methodology to integrate these skills and their assessment in the curriculum is described. The method was recently applied in several engineering p...

  1. Teachers’ assessment of students’ research skills

    NARCIS (Netherlands)

    Stokking, K.M.; Schaaf, M.F. van der; Jaspers, Jos; Erkens, Gijsbert

    2004-01-01

    Today, teachers are expected to develop complex skills, such as research skills, in their students while implementing new views on learning and teaching and using authentic assessment strategies. About these new assessment strategies there is much debate and teachers are vulnerable in using them.

  2. Objective assessment of technical skills in surgery

    OpenAIRE

    Moorthy, Krishna; Munz, Yaron; Sarker, Sudip K; Darzi, Ara

    2003-01-01

    In the past few years, considerable developments have been made in the objective assessment of technical proficiency of surgeons. Technical skills should be assessed during training, and various methods have been developed for this purpose

  3. The Postoperative Pain Assessment Skills Pilot Trial

    Directory of Open Access Journals (Sweden)

    Michael McGillion

    2011-01-01

    Full Text Available BACKGROUND/OBJECTIVES: Pain-related misbeliefs among health care professionals (HCPs are common and contribute to ineffective postoperative pain assessment. While standardized patients (SPs have been effectively used to improve HCPs’ assessment skills, not all centres have SP programs. The present equivalence randomized controlled pilot trial examined the efficacy of an alternative simulation method – deteriorating patient-based simulation (DPS – versus SPs for improving HCPs’ pain knowledge and assessment skills.

  4. Teamwork Skills Assessment for Cooperative Learning

    Science.gov (United States)

    Strom, Paris S.; Strom, Robert D.

    2011-01-01

    Teamwork skills are required at work, but teacher efforts in many countries to track achievement within this context have been hindered by lack of assessment tools and input from students. The Teamwork Skills Inventory relies on peer and self-evaluation to establish accountability, identify competencies, and detect learning needs. Twenty-five…

  5. Fundamental Skills Needs Assessment Methods

    Science.gov (United States)

    1992-05-01

    anthropologists such as S. Tylor and J. Frazer as well as more recent theorists ( Piaget , 1966; Horton, 1967) argue that the logic and normative standards by...development. Lansing, MI: Employability Skills Task Force - Governor’s Commission on Jobs and Economic Development. Piaget , J. (1966). Need and significance...consisting of 187 worker-oriented job elements about activities and work situation variables (McCormick, Jeanneret, & Mecham, 1972; McCormick & Jean

  6. A teaching skills assessment tool inspired by the Calgary-Cambridge model and the patient-centered approach.

    Science.gov (United States)

    Sommer, Johanna; Lanier, Cédric; Perron, Noelle Junod; Nendaz, Mathieu; Clavet, Diane; Audétat, Marie-Claude

    2016-04-01

    The aim of this study was to develop a descriptive tool for peer review of clinical teaching skills. Two analogies framed our research: (1) between the patient-centered and the learner-centered approach; (2) between the structures of clinical encounters (Calgary-Cambridge communication model) and teaching sessions. During the course of one year, each step of the action research was carried out in collaboration with twelve clinical teachers from an outpatient general internal medicine clinic and with three experts in medical education. The content validation consisted of a literature review, expert opinion and the participatory research process. Interrater reliability was evaluated by three clinical teachers coding thirty audiotaped standardized learner-teacher interactions. This tool contains sixteen items covering the process and content of clinical supervisions. Descriptors define the expected teaching behaviors for three levels of competence. Interrater reliability was significant for eleven items (Kendall's coefficient passessment tool has high reliability and can be used to facilitate the acquisition of teaching skills. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

  7. Teaching and Assessing Engineering Professional Skills

    Directory of Open Access Journals (Sweden)

    Ali M. Al-Bahi

    2013-05-01

    Full Text Available Engineering students are required to have, by the time of graduation, a set of professional skills related to teamwork, oral and written communications, impact of engineering solutions, life-long learning, and knowledge of contemporary issues. Teaching and assessment of these skills, as part of ABET accreditation, remains problematic. A systematic methodology to integrate these skills and their assessment in the curriculum is described. The method was recently applied in several engineering programs and proved to be efficient in generating data and evidences for evaluation and continuous improvement of these outcomes.

  8. Training model for laparoscopic Heller and Dor fundoplication: a tool for laparoscopic skills training and assessment-construct validity using the GOALS score.

    Science.gov (United States)

    Bellorin, Omar; Kundel, Anna; Sharma, Saurabh; Ramirez-Valderrama, Alexander; Lee, Paul

    2016-08-01

    Laparoscopic training demands practice. The transfer of laparoscopic skills from training models to real surgical procedures has been proven. The global operative assessment of laparoscopic skills (GOALS) score is a 5-item global rating scale developed to evaluate laparoscopic skills by direct observation. This scale has been used to demonstrate construct validity of several laparoscopic training models. Here, we present a low-cost model of laparoscopic Heller-Dor for advanced laparoscopic training. The aim of this study was to determine the capability of a training model for laparoscopic Heller-Dor to discriminate between different levels of laparoscopic expertise. The performance of two groups with different levels of expertise, novices (300 laparoscopic procedures PGY4-5) was assessed. All participants were instructed to perform two tasks (esophageal myotomy and fundoplication). All the performances were recorded in a digital format. A laparoscopic expert who was blinded to subject's identity evaluated the recordings using the GOALS score. Autonomy, one of the five items of GOALS, was removed since the evaluator and the trainee did not have interaction. The time required to finish each task was also recorded. Performance was compared using the Mann-Whitney U test (p GOALS score. The mean total GOALS score for novices was 7.5 points (SD: 1.64) and 13.9 points (SD: 1.66) for experts (p GOALS score compared to novices: depth perception (mean: 3.3 vs 2 p model has construct validity. The model may be used as a tool for training of the surgical resident.

  9. Development of an instrument to assess the impact of an enhanced experiential model on pharmacy students' learning opportunities, skills and attitudes: A retrospective comparative-experimentalist study

    Directory of Open Access Journals (Sweden)

    Collins John B

    2008-04-01

    Full Text Available Abstract Background Pharmacy schools across North America have been charged to ensure their students are adequately skilled in the principles and practices of pharmaceutical care. Despite this mandate, a large percentage of students experience insufficient opportunities to practice the activities, tasks and processes essential to pharmaceutical care. The objective of this retrospective study of pharmacy students was to: (1 as "proof of concept", test the overall educational impact of an enhanced advanced pharmacy practice experiential (APPE model on student competencies; (2 develop an instrument to measure students' and preceptors' experiences; and (3 assess the psychometric properties of the instrument. Methods A comparative-experimental design, using student and preceptor surveys, was used to evaluate the impact of the enhanced community-based APPE over the traditional APPE model. The study was grounded in a 5-stage learning model: (1 an enhanced learning climate leads to (2 better utilization of learning opportunities, including (3 more frequent student/patient consultation, then to (4 improved skills acquisition, thence to (5 more favorable attitudes toward pharmaceutical care practice. The intervention included a one-day preceptor workshop, a comprehensive on-site student orientation and extending the experience from two four-week experiences in different pharmacies to one eight-week in one pharmacy. Results The 35 student and 38 preceptor survey results favored the enhanced model; with students conducting many more patient consultations and reporting greater skills improvement. In addition, the student self-assessment suggested changes in attitudes favoring pharmaceutical care principles. Psychometric testing showed the instrument to be sensitive, valid and reliable in ascertaining differences between the enhanced and traditional arms. Conclusion The enhanced experiential model positively affects learning opportunities and competency

  10. An Automated Home-Cage System to Assess Learning and Performance of a Skilled Motor Task in a Mouse Model of Huntington's Disease.

    Science.gov (United States)

    Woodard, Cameron L; Bolaños, Federico; Boyd, James D; Silasi, Gergely; Murphy, Timothy H; Raymond, Lynn A

    2017-01-01

    Behavioral testing is a critical step in assessing the validity of rodent models of neurodegenerative disease, as well as evaluating the efficacy of pharmacological interventions. In models of Huntington's disease (HD), a gradual progression of impairments is observed across ages, increasing the need for sensitive, high-throughput and longitudinal assessments. Recently, a number of automated systems have been developed to perform behavioral profiling of animals within their own home-cage, allowing for 24-h monitoring and minimizing experimenter interaction. However, as of yet, few of these have had functionality for the assessment of skilled motor learning, a relevant behavior for movement disorders such as HD. To address this, we assess a lever positioning task within the mouse home-cage. Animals first acquire a simple operant response, before moving to a second phase where they must learn to hold the lever for progressively longer in a rewarded position range. Testing with this paradigm has revealed the presence of distinct phenotypes in the YAC128 mouse model of HD at three early symptomatic time points. YAC128 mice at two months old, but not older, had a motor learning deficit when required to adapt their response to changes in task requirements. In contrast, six-month-old YAC128 mice had disruptions of normal circadian activity and displayed kinematic abnormalities during performance of the task, suggesting an impairment in motor control. This system holds promise for facilitating high throughput behavioral assessment of HD mouse models for preclinical therapeutic screening.

  11. Setting pass scores for clinical skills assessment.

    Science.gov (United States)

    Liu, Min; Liu, Keh-Min

    2008-12-01

    In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  12. Setting Pass Scores for Clinical Skills Assessment

    Directory of Open Access Journals (Sweden)

    Min Liu

    2008-12-01

    Full Text Available In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

  13. Clinical skills assessment of procedural and advanced communication skills: performance expectations of residency program directors

    Science.gov (United States)

    Langenau, Erik E.; Zhang, Xiuyuan; Roberts, William L.; DeChamplain, Andre F.; Boulet, John R.

    2012-01-01

    Background High stakes medical licensing programs are planning to augment and adapt current examinations to be relevant for a two-decision point model for licensure: entry into supervised practice and entry into unsupervised practice. Therefore, identifying which skills should be assessed at each decision point is critical for informing examination development, and gathering input from residency program directors is important. Methods Using data from previously developed surveys and expert panels, a web-delivered survey was distributed to 3,443 residency program directors. For each of the 28 procedural and 18 advanced communication skills, program directors were asked which clinical skills should be assessed, by whom, when, and how. Descriptive statistics were collected, and Intraclass Correlations (ICC) were conducted to determine consistency across different specialties. Results Among 347 respondents, program directors reported that all advanced communication and some procedural tasks are important to assess. The following procedures were considered ‘important’ or ‘extremely important’ to assess: sterile technique (93.8%), advanced cardiovascular life support (ACLS) (91.1%), basic life support (BLS) (90.0%), interpretation of electrocardiogram (89.4%) and blood gas (88.7%). Program directors reported that most clinical skills should be assessed at the end of the first year of residency (or later) and not before graduation from medical school. A minority were considered important to assess prior to the start of residency training: demonstration of respectfulness (64%), sterile technique (67.2%), BLS (68.9%), ACLS (65.9%) and phlebotomy (63.5%). Discussion Results from this study support that assessing procedural skills such as cardiac resuscitation, sterile technique, and phlebotomy would be amenable to assessment at the end of medical school, but most procedural and advanced communications skills would be amenable to assessment at the end of the first

  14. Objective assessment of technical surgical skills

    NARCIS (Netherlands)

    van Hove, P. D.; Tuijthof, G. J. M.; Verdaasdonk, E. G. G.; Stassen, L. P. S.; Dankelman, J.

    2010-01-01

    Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice. A systematic search was

  15. Inter-rater reliability of healthcare professional skills' portfolio assessments: The Andalusian Agency for Healthcare Quality model

    Directory of Open Access Journals (Sweden)

    Antonio Almuedo-Paz

    2014-07-01

    Full Text Available This study aims to determine the reliability of assessment criteria used for a portfolio at the Andalusian Agency for Healthcare Quality (ACSA. Data: all competences certification processes, regardless of their discipline. Period: 2010-2011. Three types of tests are used: 368 certificates, 17,895 reports and 22,642 clinical practice reports (N = 3,010 candidates. The tests were evaluated in pairs by the ACSA team of raters using two categories: valid and invalid. Results: The percentage agreement in assessments of certificates was 89,9%, while for the reports of clinical practice was 85,1 % and for clinical practice reports was 81,7%. The inter-rater agreement coefficients (kappa ranged from 0,468 to 0,711. Discussion: The results of this study show that the inter-rater reliability of assessments varies from fair to good. Compared with other similar studies, the results put the reliability of the model in a comfortable position. Among the improvements incorporated, progressive automation of evaluations must be highlighted.

  16. Training Self-Regulated Learning Skills with Video Modeling Examples: Do Task-Selection Skills Transfer?

    Science.gov (United States)

    Raaijmakers, Steven F.; Baars, Martine; Schaap, Lydia; Paas, Fred; van Merriënboer, Jeroen; van Gog, Tamara

    2018-01-01

    Self-assessment and task-selection skills are crucial in self-regulated learning situations in which students can choose their own tasks. Prior research suggested that training with video modeling examples, in which another person (the model) demonstrates and explains the cyclical process of problem-solving task performance, self-assessment, and…

  17. Assessing the skill of hydrology models at simulating the water cycle in the HJ Andrews LTER: Assumptions, strengths and weaknesses

    Science.gov (United States)

    Simulated impacts of climate on hydrology can vary greatly as a function of the scale of the input data, model assumptions, and model structure. Four models are commonly used to simulate streamflow in model assumptions, and model structure. Four models are commonly used to simu...

  18. PENGEMBANGAN MODEL PEMBELAJARAN SOFT SKILLS DAN HARD SKILLS UNTUK SISWA SMK

    OpenAIRE

    Widarto Noto Widodo, Pardjono

    2013-01-01

    Abstrak: Pengembangan Model Pembelajaran Soft Skills dan Hard Skills untuk Siswa SMK. Era global menuntut sumber daya manusia yang memiliki daya saing, adaptif dan antisipatif, mampu belajar, terampil, mudah beradaptasi dengan teknologi baru. Profil tenaga kerja yang dibutuhkan pasar adalah yang kuat pada aspek soft skills dan hard skills. Ada tiga alternatif model pendidikan yang memadukan hard skills dan soft skills, yaitu (1) aspek soft skills dan hard skills dilaksanakan di sekolah; (2) a...

  19. Modeling the Distinct Phases of Skill Acquisition

    Science.gov (United States)

    Tenison, Caitlin; Anderson, John R.

    2016-01-01

    A focus of early mathematics education is to build fluency through practice. Several models of skill acquisition have sought to explain the increase in fluency because of practice by modeling both the learning mechanisms driving this speedup and the changes in cognitive processes involved in executing the skill (such as transitioning from…

  20. Peer Assessment of Soft Skills and Hard Skills

    Science.gov (United States)

    Zhang, Aimao

    2012-01-01

    Both the information technology (IT) industry and the Accreditation Board for Engineering and Technology (ABET) demand soft-skill training in higher education and require IT graduates to demonstrate competence in interpersonal communication, teamwork, and conflict management. Group projects provide teamwork environment for soft-skill training, but…

  1. Getting Skills Right: Assessing and Anticipating Changing Skill Needs

    Science.gov (United States)

    OECD Publishing, 2016

    2016-01-01

    Digitalisation, globalisation, demographic shifts and other changes in work organisation are constantly reshaping skill needs. This can lead to persistent skill shortages and mismatch which are costly for individuals, firms and society in terms of lost wages and lower productivity and growth. These costs can be reduced through better assessment…

  2. Self-assessment: an alternative method of assessing speaking skills

    Directory of Open Access Journals (Sweden)

    Ekaterini Chalkia

    2012-02-01

    Full Text Available The present study focuses on self-assessment as an alternative method of assessing the speaking skills of a group of sixth graders of a Greek State Primary School. The paper consists of two parts. In the first part, traditional and alternative assessment approaches are compared and a literature review on self-assessment is presented. In the second part the methodology and the findings of the study are presented. The study was carried out by means of a questionnaire and observation notes. This was done in order to draw conclusions on the benefits of self-assessment, the difficulties students faced while carrying out self-assessment as well as to reveal the extent to which students improved their speaking skills after being involved in self-assessment. The findings revealed that the students were positive towards self-assessment. Although self-assessment was of limited duration, it turned out to be a worthwhile activity as it fostered motivation and sensitized the students to take a more active role in the learning process. It also enabled them to notice their strengths and weaknesses and improve their speaking skills. The study also revealed the practical difficulties the students faced in carrying out their self-assessment. Finally, the study concludes with recommendations for further research into this specific assessment method.

  3. MOVEMENT SKILL ASSESSMENT OF TYPICALLY DEVELOPING PRESCHOOL CHILDREN: A REVIEW OF SEVEN MOVEMENT SKILL ASSESSMENT TOOLS

    Directory of Open Access Journals (Sweden)

    Wouter Cools

    2009-06-01

    Full Text Available The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child's physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools' usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children.

  4. Metrics for Objective Assessment of Surgical Skills Workshop

    National Research Council Canada - National Science Library

    Satava, Richard

    2001-01-01

    On 9-10 July, 2001 the Metrics for Objective Assessment of Surgical Skills Workshop convened an international assemblage of subject matter experts in objective assessment of surgical technical skills...

  5. The Reliability of Parkour Skills Assessment

    Directory of Open Access Journals (Sweden)

    Martin Dvořák

    2018-01-01

    Full Text Available The aim of the study was to determine the reliability of parkour skills assessment in field conditions. Twenty young men completed three trials of a parkour obstacle course on two separate days. The tested group consisted of 10 beginners (age 16 ± 1 years, body mass = 65 ± 12 kg, height = 177 ± 7 cm and 10 advanced traceurs (age 18 ± 2 years, body mass = 68 ± 14 kg, height = 178 ± 6 cm. The performance was video-recorded and subsequently analyzed by three raters (total score 0–45. Median and percentiles were used to characterize results from all sessions by all raters. Inter-rater, intra-session and inter-session reliability were assessed using Krippendorff’s α for ordinal data. The Mann-Whitney test was used to assess the differences between beginners and advanced traceurs. Advanced traceurs obtained a total score from 41 to 44 whilst beginners achieved 27 to 33 points. Krippendorff’s α for total score ranged from 0.910 to 0.916 between raters, 0.828 to 0.874 between trials, and from 0.839 to 0.924 between days. The proposed parkour course differentiated two different ability levels and the skills assessment demonstrated excellent reliability between raters, trials, and days.

  6. Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools

    Science.gov (United States)

    Cools, Wouter; Martelaer, Kristine De; Samaey, Christiane; Andries, Caroline

    2009-01-01

    The importance of movement is often overlooked because it is such a natural part of human life. It is, however, crucial for a child’s physical, cognitive and social development. In addition, experiences support learning and development of fundamental movement skills. The foundations of those skills are laid in early childhood and essential to encourage a physically active lifestyle. Fundamental movement skill performance can be examined with several assessment tools. The choice of a test will depend on the context in which the assessment is planned. This article compares seven assessment tools which are often referred to in European or international context. It discusses the tools’ usefulness for the assessment of movement skill development in general population samples. After a brief description of each assessment tool the article focuses on contents, reliability, validity and normative data. A conclusion outline of strengths and weaknesses of all reviewed assessment tools focusing on their use in educational research settings is provided and stresses the importance of regular data collection of fundamental movement skill development among preschool children. Key pointsThis review discusses seven movement skill assessment tool’s test content, reliability, validity and normative samples.The seven assessment tools all showed to be of great value. Strengths and weaknesses indicate that test choice will depend on specific purpose of test use.Further data collection should also include larger data samples of able bodied preschool children.Admitting PE specialists in assessment of fundamental movement skill performance among preschool children is recommended.The assessment tool’s normative data samples would benefit from frequent movement skill performance follow-up of today’s children. Abbreviations MOT 4-6: Motoriktest fur vier- bis sechsjährige Kinder, M-ABC: Movement Assessment Battery for Children, PDMS: Peabody Development Scales, KTK: K

  7. Lagrangian Predictive Skill Assessment for the Deepwater Horizon Spill

    Science.gov (United States)

    Lipphardt, B. L.; Huntley, H. S.; Sulman, M.; Kirwan, A. D.

    2011-12-01

    The explosion and sinking of the Deepwater Horizon drilling platform produced enormous human, ecological, and economic impacts. At the same time this disaster provided an unprecedented amount of Lagrangian information on ocean processes, including a large number of surface and near-surface drifters deployed in the northeastern Gulf of Mexico as well as remotely sensed images of the surface oil slick. In addition several global and regional ocean model predictions were used to forecast the spill movements. These models generally exhibited large variations in the mesoscale flow near the Deepwater Horizon site, even though they all assimilated similar sets of ocean observations. This provides a unique opportunity to thoroughly assess model Lagrangian predictive skill. Here, the predictive skill of one model, a regional implementation of the Hybrid Coordinate Ocean Model (HYCOM), is evaluated using data from more than 80 drifter trajectories in the northern Gulf of Mexico. These trajectories are compared with maps of Lagrangian coherent structures, computed from near-surface model velocities, to determine whether the observations are consistent with the larger scale transport structure predicted by the model. We also discuss new metrics to assess model Lagrangian predictive skill of the plume movement.

  8. Validation of the Danish version of the McGill Ingestive Skills Assessment using classical test theory and the Rasch model

    DEFF Research Database (Denmark)

    Hansen, Tina; Lambert, Heather C; Faber, Jens

    2012-01-01

    Purpose: The study aimed to validate the Danish version of the Canadian the "McGill Ingestive Skills Assessment" (MISA-DK) for measuring dysphagia in frail elders. Method: One-hundred and ten consecutive older medical patients were recruited to the study. Reliability was assessed by internal...... consistency (Chronbach's alpha). External construct validity (convergent and known-groups validity) was evaluated against theoretical constructs assessing the complex concept of ingestive skills. Internal construct validity was tested using Rasch analysis. Results: High internal consistency reliability......), p¿=¿0.424) and unidimensionality of the MISA-DK was confirmed after resolving disordered thresholds for 11 items and adjustment of local dependency. Conclusion: The psychometric properties of the MISA-DK equal the original Canadian version. Assessment of internal construct validity indicated...

  9. Assessment of technical and nontechnical skills in surgical residents.

    Science.gov (United States)

    Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

    2016-11-01

    Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P technical skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P technical and nontechnical skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

  10. Training and assessment of laparoscopic skills using a haptic simulator.

    Science.gov (United States)

    Rolfsson, Göran; Nordgren, Anna; Bindzau, Stefan; Hagström, J-P; McLaughlin, John; Thurfjell, Lennart

    2002-01-01

    Surgical simulation is a promising technique for training of laparoscopic surgery. Computer based simulation provides not only a cost effective alternative to traditional training but also a way to assess the surgeons performance. In this paper, we present a haptic simulator that allows for training and assessment of basic laparoscopic skills. The skills trained are modeled around a cholecystectomy procedure and include bi-manual dissection, clips setting, catheter insertion and cutting. The system uses accurate anatomic models of the organs involved in the procedure. This combined with effective methods for soft tissue deformation and haptic feedback, giving the surgeon a precise feeling of the interaction between organs and surgical instruments, provides a realistic training environment. The system has been designed with procedural training in mind and by putting together the individual tasks it will be possible to train on performing a complete cholecystectomy procedure.

  11. A Procedural Skills OSCE: Assessing Technical and Non-Technical Skills of Internal Medicine Residents

    Science.gov (United States)

    Pugh, Debra; Hamstra, Stanley J.; Wood, Timothy J.; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

    2015-01-01

    Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

  12. Assessing Topographical Orientation Skills in Cannabis Users

    Directory of Open Access Journals (Sweden)

    Liana Palermo

    2012-01-01

    Full Text Available The long-term effects of cannabis on human cognition are still unclear, but, considering that cannabis is a widely used substance and, overall, its potential use in therapeutic interventions, it is important to evaluate them. We hypothesize that the discrepancies among studies could be attributed to the specific cognitive function investigated and that skills subserved by the hippocampus, such as the spatial orientation abilities and, specifically, the ability to form and use cognitive maps, should be more compromised than others. Indeed it has been showed that cannabis users have a reduced hippocampus and that the hippocampus is the brain region in which cannabis has the greatest effect since it contains the highest concentration of cannabinoid receptors. To test this hypothesis we asked 15 heavy cannabis users and 19 nonusers to perform a virtual navigational test, the CMT, that assesses the ability to form and use cognitive maps. We found that using cannabis has no effect on these hippocampus-dependent orientation skills. We discuss the implications of our findings and how they relate to evidence reported in the literature that the intervention of functional reorganization mechanisms in cannabis user allows them to cope with the cognitive demands of navigational tasks.

  13. Suitability of the Social Skills Performance Assessment (SSPA) for the assessment of social skills in adults with autism spectrum disorders

    NARCIS (Netherlands)

    Verhoeven, E.W.M.; Smeekens, I.; Didden, H.C.M.

    2013-01-01

    The present study aims at examining whether the 'Social Skills Performance Assessment' (SSPA; Patterson et al. in Schizophr Res 48(2-3):351-360, 2001) is a suitable performance-based measure to assess social skills in adults with autism spectrum disorders (ASD). For this purpose, social skills of

  14. Soft Skills Assessment: Theory Development and the Research Agenda

    Science.gov (United States)

    Gibb, Stephen

    2014-01-01

    Soft skills have become a subject of increasing interest in lifelong learning. Soft skills development is intended to enable and enhance personal development, participation in learning and success in employment. The assessment of soft skill is therefore widely practised, but there is little in the way of research or evidence on how well this…

  15. Assessment of professional engineering skills - define, monitor and assess

    DEFF Research Database (Denmark)

    Andersson, Niclas; Andersson, Pernille Hammar

    2012-01-01

    in an engineering teaching context. A suggested approach, based on the three consecutive steps of Define – Monitor – Assess, was applied and tested in an engineering course in which the students and professional engineers from industry interacted in an extensive role play simulation. The students’ were actively...... involved in the three steps of defining the professional skills criteria, monitoring and documenting their professional performance on basis of direct feedback from the professional engineers and finally, assessing their learning process. The study concludes that the suggested approach is applicable...

  16. Critical Emergency Medicine Procedural Skills: A Comparative Study of Methods for Teaching and Assessment.

    Science.gov (United States)

    Chapman, Dane M.; And Others

    Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

  17. Challenge Course Facilitator Technical Skills Assessment Tool Mark

    Science.gov (United States)

    Wagstaff, William Quinn

    2007-01-01

    A study was conducted to develop a technical skills assessment tool for the training and development of challenge course facilitators. Researchers accessed two professional on-line listserves to collect a sample size of twenty-seven currently used technical skills assessment tools. The assessment tools were critically analysed by three independent…

  18. Observational assessment of fundamental movement skill proficiency in preschool children

    OpenAIRE

    佐々木, 玲子; 石沢, 順子

    2014-01-01

    Fundamental movement skill competency in children has been declining in recent years. Early childhood is a sensitive period for the development of fundamental movement skills ; the mastery of certain of these skills is a prerequisite for daily functioning and participation in later physical or sport-specific activities. Although quantitative methods have been developed for assessing movement development in children, it is also important to qualitatively evaluate such skills in developing chil...

  19. Improving visual skills: II-remote assessment via Internet.

    Science.gov (United States)

    Powers, Maureen K; Grisham, J David; Wurm, Janice K; Wurm, William C

    2009-02-01

    Even though poor readers often have poor visual skills, such as binocular coordination and oculomotor control, students' visual skills are rarely assessed. Computer assessments have the potential to assist in identifying students whose visual skills are deficient. This study compared assessments made by an Internet-based computer orthoptics program with those of an on-site vision therapist. Students (N = 41) in grades 1 through 8, reading at least 2 levels below grade, were assessed for visual skill dysfunction (including binocular fusion and tracking ability) by a vision therapist at their school in Wisconsin. The therapist determined whether the student had adequate visual skills based on clinical and behavioral observations. A "remote" investigator located in California determined the adequacy of accommodative facility, tracking, and vergence skills in the same students, based on quantitative progress through the modules of an Internet-based computer orthoptics training program during 3 assessment sessions. The on-site therapist made 33 referrals for possible visual skills training (80%). The remote investigator made 25 referrals (61%), all of which were consistent with referrals made by the on-site therapist; thus, no false-positives occurred when using the remote assessment technique. The 8 additional referrals by the therapist were attributed to the ability to observe student behavior during assessment. Remote assessment of visual skills via an Internet orthoptics program may provide a simple means to detect visual skill problems experienced by poor readers.

  20. Empirically Assessing the Importance of Computer Skills

    Science.gov (United States)

    Baker, William M.

    2013-01-01

    This research determines which computer skills are important for entry-level accountants, and whether some skills are more important than others. Students participated before and after internships in public accounting. Longitudinal analysis is also provided; responses from 2001 are compared to those from 2008-2009. Responses are also compared to…

  1. Assessing Practical Laboratory Skills in Undergraduate Molecular Biology Courses

    Science.gov (United States)

    Hunt, Lynne; Koenders, Annette; Gynnild, Vidar

    2012-01-01

    This study explored a new strategy of assessing laboratory skills in a molecular biology course to improve: student effort in preparation for and participation in laboratory work; valid evaluation of learning outcomes; and students' employment prospects through provision of evidence of their skills. Previously, assessment was based on written…

  2. Ability-versus skill-based assessment of emotional intelligence.

    Science.gov (United States)

    Bradberry, Travis R; Su, Lac D

    2006-01-01

    Emotional intelligence has received an intense amount of attention in leadership circles during the last decade and continuing debate exists concerning the best method for measuring this construct. This study analyzed leader emotional intelligence scores, measured via skill and ability methodologies, against leader job performance. Two hundred twelve employees from three organizations participated in this study. Scores on the Emotional Intelligence Appraisal, a skill-based assessment, were positively, though not significantly, correlated with scores on the MSCEIT, an ability-based assessment of emotional intelligence. Scores on the MSCEIT did not have a significant relationship with job performance in this study, whereas, scores on the Emotional Intelligence Appraisal had a strong link to leader job performance. The four subcomponents of the Emotional Intelligence Appraisal were examined against job performance. Relationship management was a stronger predictor of leader job performance than the other three subcomponents. Social awareness was the single emotional intelligence skill that did not have a significant link to leader job performance. Factor analyses yielded a two-component model of emotional intelligence encompassing personal and social competence, rather than confirmation of a four-part taxonomy.

  3. The use of advanced physical assessment skills by cardiac nurses.

    Science.gov (United States)

    Edmunds, Linda; Ward, Susan; Barnes, Rhian

    To establish what advanced physical assessment skills are being used by cardiac nurses after they undertook a clinical patient assessment module; and to explore the factors that influence their use of these skills. A longitudinal descriptive approach using convenience sampling was employed. Qualitative data was obtained from individual interviews, non-participant observation within the participants' clinical environment and self-reported activity logs. Five key themes emerged: use of advanced physical assessment skills varied; use and development of skills was linked to personal characteristics; use influenced by perceptions of role boundaries, permission and cooperation; use influenced by participants' perception of nursing and the development of their own nursing practice; and use influenced by the physical environment and the human support within it. Cardiac nurses selectively use physical assessment skills, predominately related to the cardiorespiratory systems. Organisational structure, professional relationships and the professionalism of the individual nurse appear to play a significant part in the use of physical assessment skills. Although the findings from this qualitative study cannot be generalized, they concur with findings from recent research into physical assessment skills used by a variety of UK nurses. The implications identified are: first, for those who provide the education, in terms of what should be taught and facilitated; and second, for organizations, in ensuring staff have assessment skills relevant to their role and that systems are in place to enable the development of a supportive and progressive culture that embraces modernization congruent with healthcare policy.

  4. Teaching and assessing procedural skills: a qualitative study.

    Science.gov (United States)

    Touchie, Claire; Humphrey-Murto, Susan; Varpio, Lara

    2013-05-14

    Graduating Internal Medicine residents must possess sufficient skills to perform a variety of medical procedures. Little is known about resident experiences of acquiring procedural skills proficiency, of practicing these techniques, or of being assessed on their proficiency. The purpose of this study was to qualitatively investigate resident 1) experiences of the acquisition of procedural skills and 2) perceptions of procedural skills assessment methods available to them. Focus groups were conducted in the weeks following an assessment of procedural skills incorporated into an objective structured clinical examination (OSCE). Using fundamental qualitative description, emergent themes were identified and analyzed. Residents perceived procedural skills assessment on the OSCE as a useful formative tool for direct observation and immediate feedback. This positive reaction was regularly expressed in conjunction with a frustration with available assessment systems. Participants reported that proficiency was acquired through resident directed learning with no formal mechanism to ensure acquisition or maintenance of skills. The acquisition and assessment of procedural skills in Internal Medicine programs should move toward a more structured system of teaching, deliberate practice and objective assessment. We propose that directed, self-guided learning might meet these needs.

  5. Meningkatkan Hard Skills dan Soft Skills Siswa melalui Model Pembelajaran Koooperatif Tipe Stad

    OpenAIRE

    Alfiansyah, Muhammad; Jamal, M. Arifuddin; An'nur, Syubhan

    2014-01-01

    Penelitian ini secara umum bertujuan untuk mendeskripsikan keefektifan model pembelajaran kooperatif tipe STAD dalam meningkatkan hard skills dan soft skills siswa SMAN 8 Barabai pada pokok bahasan fluida statis. Secara khusus untuk mendeskripsikan keterlaksanaan RPP model kooperatif tipe STAD, hard skills siswa, soft skills siswa dan respon siswa. Metode penelitian yang digunakan merupakan penelitian tindakan kelas model Kemmis dan Mc Taggart. Hasil penelitian menunjukkan bahwa terjadi pen...

  6. Teaching and Assessing Communication Skills in Medical Undergraduate Training.

    Science.gov (United States)

    Modi, Jyoti Nath; Anshu, -; Chhatwal, Jugesh; Gupta, Piyush; Singh, Tejinder

    2016-06-08

    Good communication skills are essential for an optimal doctor-patient relationship, and also contribute to improved health outcomes. Although the need for training in communication skills is stated as a requirement in the 1997 Graduate Medical Education Regulations of the Medical Council of India, formal training in these skills has been fragmentary and non-uniform in most Indian curricula. The Vision 2015 document of the Medical Council of India reaffirms the need to include training in communication skills in the MBBS curriculum. Training in communication skills needs approaches which are different from that of teaching other clinical subjects. It is also a challenge to ensure that students not only imbibe the nuances of communication and interpersonal skills, but adhere to them throughout their careers. This article addresses the possible ways of standardizing teaching and assessment of communication skills and integrating them into the existing curriculum.

  7. Assessment of psychomotor skills acquisition during laparoscopic cholecystectomy courses.

    Science.gov (United States)

    Hance, Julian; Aggarwal, Rajesh; Moorthy, Krishna; Munz, Yaron; Undre, Shabnam; Darzi, Ara

    2005-09-01

    Standardized short courses in laparoscopic cholecystectomy aim to teach laparoscopic skills to surgical trainees, although end-of-course assessments of performance remain subjective. The current study aims to objectively assess psychomotor skills acquisition of trainees attending laparoscopic cholecystectomy courses. Thirty-seven junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate 2-day courses (A, B, and C), all with identical format. Assessments were comprised of a standardized simulated laparoscopic task, with performance measured using a valid electromagnetic hand-motion tracking device. Overall, trainees made significant improvements in path length (P=.006), number of movements (Ppsychomotor skills on courses. In addition to providing participants with an insight into their skills, these data can be used to demonstrate course efficacy.

  8. Comparing new BSN RN self skills assessment to actual skills demonstration.

    Science.gov (United States)

    Adair, Jean; Hughes, Lin; Davis, Sue; Wolcott-Breci, Mary

    2014-01-01

    The purpose of the study was to compare the self-skills assessment with the skill competence during an actual skills demonstration of newly hired bachelor of science in nursing (BSN) registered nurse graduates. This retrospective study included 32 randomly selected BSN registered nurse graduates from January 2010 to December 31, 2010. The participants were already hired into a midwest health system. Because this was a retrospective study, no demographic data were collected, and no consent from participants was needed. This study included a clinical skills check list where the participants rated themselves on specific skills utilizing a Likert scale ranging from 1 (no knowledge) to 4 (able to perform independently). The same clinical check list was utilized by an expert registered nurse when the skill was demonstrated. This study compared the difference between the subject's self-rating of skills and the clinical demonstration of the skills. We used t tests in the analysis to demonstrate the differences between the participant's self-rating of skills and the expert evaluation of the clinical demonstration of the skills. The data were inserted into the Statistical Package for the Social Sciences 19 software program to assist in the analysis process. The study demonstrated 17 significant differences in the skills ratings between the participant and competency demonstration of new BSN graduates. These significant results (2 tailed) ranged from .000 to .048.The 17 out of 46 specific skills where differences were noted included the following: staple removal, nasal pharyngeal suctioning, urinary catheter specimen collection, site care dressing change, urinary catheter irrigation, Juzo application and measurement, 5-lead telemetry, oral airway insertion, hemovac/Jackson Pratt, oral pharyngeal suctioning, urinary catheter insertion, dry suction chest drainage, bed to cart/slider board, urinary catheter removal, antiembolism stockings, measurement and application, removal of

  9. Assessment of the critical thinking skills of student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2006-01-01

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills

  10. Assessment of the critical thinking skills of student radiographers

    Energy Technology Data Exchange (ETDEWEB)

    Castle, Alan [University of Portsmouth, Centre for Radiography Education, St George' s Building, Portsmouth PO1 2HY (United Kingdom)]. E-mail: alan.castle@port.ac.uk

    2006-05-15

    Purpose: Enabling students to develop critical thinking skills is one of the key aims of higher education and in preparing student radiographers for the future, there are increasing demands on educators to teach critical thinking skills to facilitate reflective, evidence-based practice and inter-professional working. The aim of the paper is to attempt to compare students' self-perception of their critical thinking skills to their actual written assessment performance. Methods: Students were asked to self-report how they thought the course had developed their critical thinking skills and the outcomes of this exercise were compared to the scores of previous assessments that required the demonstration of these skills. Results: The results suggest that whilst students report having developed critical thinking skills during the course, the results of their written assessments requiring the demonstration of these skills all had a mean score of less than 60% which indicates (in terms of the university's grade criteria guidelines) 'little attempt to use critical discussion in their work.' Discussion: Thirteen components of critical thinking are proposed, together with ways in which they could be incorporated into a radiographic curriculum. Conclusions: It is suggested that educators may need to review the constructive alignment of their curricula and re-assess their teaching and assessment strategies in order to effectively develop students' critical thinking skills.

  11. The development and validation of measures to assess cooking skills and food skills.

    Science.gov (United States)

    Lavelle, Fiona; McGowan, Laura; Hollywood, Lynsey; Surgenor, Dawn; McCloat, Amanda; Mooney, Elaine; Caraher, Martin; Raats, Monique; Dean, Moira

    2017-09-02

    With the increase use of convenience food and eating outside the home environment being linked to the obesity epidemic, the need to assess and monitor individuals cooking and food skills is key to help intervene where necessary to promote the usage of these skills. Therefore, this research aimed to develop and validate a measure for cooking skills and one for food skills, that are clearly described, relatable, user-friendly, suitable for different types of studies, and applicable across all sociodemographic levels. Two measures were developed in light of the literature and expert opinion and piloted for clarity and ease of use. Following this, four studies were undertaken across different cohorts (including a sample of students, both 'Food preparation novices' and 'Experienced food preparers', and a nationally representative sample) to assess temporal stability, psychometrics, internal consistency reliability and construct validity of both measures. Analysis included T-tests, Pearson's correlations, factor analysis, and Cronbach's alphas, with a significance level of 0.05. Both measures were found to have a significant level of temporal stability (P skills confidence measure ranged from 0.78 to 0.93 across all cohorts. The food skills confidence measure's Cronbach's alpha's ranged from 0.85 to 0.94. The two measures also showed a high discriminate validity as there were significant differences (P skills confidence and P skills confidence) between Food preparation novices' and 'Experienced food preparers.' The cooking skills confidence measure and the food skills confidence measure have been shown to have a very satisfactory reliability, validity and are consistent over time. Their user-friendly applicability make both measures highly suitable for large scale cross-sectional, longitudinal and intervention studies to assess or monitor cooking and food skills levels and confidence.

  12. Teaching and Assessing Teamwork Skills in Engineering and Computer Science

    Directory of Open Access Journals (Sweden)

    Robert W. Lingard

    2010-02-01

    Full Text Available To be successful in today's workplace, engineering and computer science students must possess high levels of teamwork skills. Unfortunately, most engineering programs provide little or no specific instruction in this area. This paper outlines an assessment-driven approach toward teaching teamwork skills. Working with the Industrial Advisory Board for the College, a set of performance criteria for teamwork was developed. This set of criteria was used to build an assessment instrument to measure the extent to which students are able to achieve the necessary skills. This set of criteria provides a clear basis for the development of an approach toward teaching teamwork skills. Furthermore, the results from the assessment can be used to adjust the teaching techniques to address the particular skills where students show some weaknesses. Although this effort is in the early stages, the approach seems promising and will be improved over time.

  13. Sibling Conflict Resolution Skills: Assessment and Training

    Science.gov (United States)

    Thomas, Brett W.; Roberts, Mark W.

    2009-01-01

    Sibling conflict can rise to the level of a clinical problem. In Phase 1 a lengthy behavioral role-play analog sampling child reactions to normal sibling conflicts was successfully shortened. In Phase 2 normal children who lacked sibling conflict resolution skills were randomly assigned to a Training or Measurement Only condition. Training…

  14. Developing and Assessing College Student Teamwork Skills

    Science.gov (United States)

    Hughes, Richard L.; Jones, Steven K.

    2011-01-01

    Some form of team-oriented work is employed in most, if not all, organizations today. It would seem, then, that an important role for higher education should involve developing critical teamwork skills among students so as to prepare them for success in life. This very point was highlighted in a 2009 poll conducted on behalf of the Association of…

  15. Reliability and Validity of the Research Methods Skills Assessment

    Science.gov (United States)

    Smith, Tamarah; Smith, Samantha

    2018-01-01

    The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

  16. Innovative Use of Blackboard[R] to Assess Laboratory Skills

    Science.gov (United States)

    Epping, Ronald J.

    2010-01-01

    A novel application of the popular web instruction architecture Blackboard Academic Suite[R] is described. The method was applied to a large number of students to assess quantitatively the accuracy of each student's laboratory skills. The method provided immediate feedback to students on their personal skill level, replaced labour-intensive…

  17. Ophthalmic Skills Assessment of Primary Health Care Workers at ...

    African Journals Online (AJOL)

    Ophthalmic Skills Assessment of Primary Health Care Workers at Primary Health Care Facilities in Rural Communities in Cross River State, Nigeria. ... The workers attributed the high failure rate/low score to lack of follow-up and inadequate duration of training on eye care, which was just for one day. The ophthalmic skills ...

  18. Evaluating IMU communication skills training programme: assessment tool development.

    Science.gov (United States)

    Yeap, R; Beevi, Z; Lukman, H

    2008-08-01

    This article describes the development of four assessment tools designed to evaluate the communication skills training (CST) programme at the International Medical University (IMU). The tools measure pre-clinical students' 1) perceived competency in basic interpersonal skills, 2) attitude towards patient-centred communication, 3) conceptual knowledge on doctor-patient communication, and 4) acceptance of the CST programme.

  19. Assessing the Impact of Surface and Upper-Air Observations on the Forecast Skill of the ACCESS Numerical Weather Prediction Model over Australia

    Directory of Open Access Journals (Sweden)

    Sergei Soldatenko

    2018-01-01

    Full Text Available The impact of the Australian Bureau of Meteorology’s in situ observations (land and sea surface observations, upper air observations by radiosondes, pilot balloons, wind profilers, and aircraft observations on the short-term forecast skill provided by the ACCESS (Australian Community Climate and Earth-System Simulator global numerical weather prediction (NWP system is evaluated using an adjoint-based method. This technique makes use of the adjoint perturbation forecast model utilized within the 4D-Var assimilation system, and is able to calculate the individual impact of each assimilated observation in a cycling NWP system. The results obtained show that synoptic observations account for about 60% of the 24-h forecast error reduction, with the remainder accounted for by aircraft (12.8%, radiosondes (10.5%, wind profilers (3.9%, pilot balloons (2.8%, buoys (1.7% and ships (1.2%. In contrast, the largest impact per observation is from buoys and aircraft. Overall, all observation types have a positive impact on the 24-h forecast skill. Such results help to support the decision-making process regarding the evolution of the observing network, particularly at the national level. Consequently, this 4D-Var-based approach has great potential as a tool to assist the design and running of an efficient and effective observing network.

  20. Objective assessment of skills acquisition during laparoscopic surgery courses.

    Science.gov (United States)

    Sarker, Shah-Jalal; Telfah, Muwaffaq Mezeil; Onuba, Louisa; Patel, Bijendra P

    2013-10-01

    The aim of this prospective study is to objectively assess the acquisition of skills of trainees attending laparoscopic surgery courses. Thirty-four junior surgical trainees had their laparoscopic skills assessed before and after attending 1 of 3 separate runs of 3-day core skills in laparoscopic surgery course. Nine control trainees were also included who did not attend the course. Three virtual tasks (camera navigation, hand-eye coordination, and 2-handed maneuver) were used from a virtual reality simulator (Simbionix) for assessment. Camera navigation was assessed by completion time and maintenance of horizontal view, whereas the other 2 tasks were assessed by completion time, path length (both hands), and the number of movements (both hands). A composite score of overall performance was calculated by combining all the 12 parameters. The course significantly (P hand. No significant improvement in skills was seen in any 1 of the 12 parameters for the control participants except for a slight reduction in performance matrics. Foundation and core trainees had acquired significantly (P = .02) more skills (23% improvement) than the specialist trainees (8% improvement). Overall acquired skills did not differ significantly in terms of age, sex, or dominant hand of trainees. Objective validated methods can be used to demonstrate course efficacy in addition to providing participants with an insight into their skills. Junior trainees with little or no previous experience benefit the most from such courses irrespective of their age, sex, and dominant hand.

  1. Crowd-sourced assessment of technical skills: an opportunity for improvement in the assessment of laparoscopic surgical skills.

    Science.gov (United States)

    Deal, Shanley B; Lendvay, Thomas S; Haque, Mohamad I; Brand, Timothy; Comstock, Bryan; Warren, Justin; Alseidi, Adnan

    2016-02-01

    Objective, unbiased assessment of surgical skills remains a challenge in surgical education. We sought to evaluate the feasibility and reliability of Crowd-Sourced Assessment of Technical Skills. Seven volunteer general surgery interns were given time for training and then testing, on laparoscopic peg transfer, precision cutting, and intracorporeal knot-tying. Six faculty experts (FEs) and 203 Amazon.com Mechanical Turk crowd workers (CWs) evaluated 21 deidentified video clips using the Global Objective Assessment of Laparoscopic Skills validated rating instrument. Within 19 hours and 15 minutes we received 662 eligible ratings from 203 CWs and 126 ratings from 6 FEs over 10 days. FE video ratings were of borderline internal consistency (Krippendorff's alpha = .55). FE ratings were highly correlated with CW ratings (Pearson's correlation coefficient = .78, P Technical Skills as a reliable, basic tool to standardize the evaluation of technical skills in general surgery. Copyright © 2016 Elsevier Inc. All rights reserved.

  2. Core skills assessment to improve mathematical competency

    Science.gov (United States)

    Carr, Michael; Bowe, Brian; Fhloinn, Eabhnat Ní

    2013-12-01

    Many engineering undergraduates begin third-level education with significant deficiencies in their core mathematical skills. Every year, in the Dublin Institute of Technology, a diagnostic test is given to incoming first-year students, consistently revealing problems in basic mathematics. It is difficult to motivate students to address these problems; instead, they struggle through their degree, carrying a serious handicap of poor core mathematical skills, as confirmed by exploratory testing of final year students. In order to improve these skills, a pilot project was set up in which a 'module' in core mathematics was developed. The course material was basic, but 90% or higher was required to pass. Students were allowed to repeat this module throughout the year by completing an automated examination on WebCT populated by a question bank. Subsequent to the success of this pilot with third-year mechanical engineering students, the project was extended to five different engineering programmes, across three different year-groups. Full results and analysis of this project are presented, including responses to interviews carried out with a selection of the students involved.

  3. A Model for Evaluating Student Clinical Psychomotor Skills.

    Science.gov (United States)

    And Others; Fiel, Nicholas J.

    1979-01-01

    A long-range plan to evaluate medical students' physical examination skills was undertaken at the Ingham Family Medical Clinic at Michigan State University. The development of the psychomotor skills evaluation model to evaluate the skill of blood pressure measurement, tests of the model's reliability, and the use of the model are described. (JMD)

  4. Evaluating structured assessment of anaesthesiologists' non-technical skills

    DEFF Research Database (Denmark)

    Jepsen, R M H G; Dieckmann, Gerhard Peter; Spanager, L

    2016-01-01

    BACKGROUND: Non-technical skills (NTS) are essential for safe and efficient anaesthesia. Assessment instruments with appropriate validity evidence can be used to ensure that anaesthesiologists possess the NTS necessary to deliver high-standard patient care. The aims were to collect validity...... evidence using a contemporary validity framework for the assessment instrument Anaesthesiologists' Non-Technical Skills in Denmark (ANTSdk) regarding response process and internal structure (including reliability), and to investigate the effect of rater training on these properties. METHODS: An explorative...

  5. Technical and Technological Skills Assessment in Laparoscopic Surgery

    OpenAIRE

    Sarker, Sudip K.; Chang, Avril; Vincent, Charles

    2006-01-01

    Objectives: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. Methods: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each op...

  6. Assessing students' communication skills: validation of a global rating.

    Science.gov (United States)

    Scheffer, Simone; Muehlinghaus, Isabel; Froehmel, Annette; Ortwein, Heiderose

    2008-12-01

    Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to validate a global rating scale. A Canadian instrument was translated to German and adapted to assess students' communication skills during an end-of-semester-OSCE. Subjects were second and third year medical students at the reformed track of the Charité-Universitaetsmedizin Berlin. Different groups of raters were trained to assess students' communication skills using the global rating scale. Validity testing included concurrent validity and construct validity: Judgements of different groups of raters were compared to expert ratings as a defined gold standard. Furthermore, the amount of agreement between scores obtained with this global rating scale and a different instrument for assessing communication skills was determined. Results show that communication skills can be validly assessed by trained non-expert raters as well as standardised patients using this instrument.

  7. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria

    Directory of Open Access Journals (Sweden)

    Asieba IO

    2018-03-01

    Full Text Available Background: Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. Objective: This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. Methods: A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974/Herron (1990 Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. Result: The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90% still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03 and stock growth (P=0.04; while stock growth was significantly affected by leadership skills (P=0.002 and entrepreneurial skills (0.02. Net profit was significantly affected by industry skills (P=0.008. Conclusions: Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on

  8. An assessment of the impact of entrepreneurial skills of community pharmacists on pharmaceutical business performance in Jos metropolis, Nigeria.

    Science.gov (United States)

    Asieba, Iyeseun O; Nmadu, Teresa M

    2018-01-01

    Community pharmacy has been a lucrative area of practice for pharmacists in Jos, Nigeria, until about the turn of the millennium where a decline in viability of the business has been observed. This study assessed the entrepreneurial skills of community pharmacists, the business performance of community pharmacies and the impact of their entrepreneurial skills on business performance. A cross sectional survey was conducted by administering a pretested questionnaire to 30 community pharmacists in Jos. An adaptation of the Bernelli model and the expanded Katz (1974)/Herron (1990) Skill Typology Model was used to assess nine entrepreneurial skills - product, organizational, industry, networking, leadership, executive, entrepreneurial, marketing and money skills; while sales growth, net profit and stock growth were used to assess business performance. Frequency distribution of results was presented, with further analysis done with the Epi-Info software using the chi square test of association. The results from this study showed that community pharmacies in Jos do possess requisite entrepreneurial skills, but to varying extents. Product skills ranked highest while money skills and entrepreneurial skills ranked least, portraying a need for skills enhancement in these areas. Business performance was suboptimal, being rated as average or poor by 56.6% of respondents. However, most respondents (90%) still assessed their businesses as profitable. Money skills had a significant impact on business performance (P=0.03) and stock growth (P=0.04); while stock growth was significantly affected by leadership skills (P=0.002) and entrepreneurial skills (0.02). Net profit was significantly affected by industry skills (P=0.008). Community pharmacy business is still a profitable business venture in Jos though business performance is sub optimal. The entrepreneurial skills set of a community pharmacist set has an impact on business performance with money skills, leadership skills and

  9. Defining and assessing critical thinking skills for student radiographers

    International Nuclear Information System (INIS)

    Castle, Alan

    2009-01-01

    Developing critical thinking skills is a key aim of higher education and is important in preparing student radiographers for their future careers in clinical practice. The aim of this paper was to attempt to devise and assess six key components of critical thinking appropriate for radiographic practice. Each of the six components was divided into three dimensions and a Critical Thinking Skills Scoring Chart (CTSSC) devised to assess students' written performance against each dimension. Scores revealed that approximately 30% of students were rated as good and approximately 10% of students were rated as poor in each component, although there was some variability between different dimensions. It is suggested that educators need to encourage and support students to develop their critical thinking skills by reviewing their curriculum to clearly define specific skills and ensure that they are appropriately taught and assessed

  10. Defining and assessing critical thinking skills for student radiographers

    Energy Technology Data Exchange (ETDEWEB)

    Castle, Alan [University of Portsmouth, School of Health Sciences and Social Work, Centre for Radiography Education, James Watson Building, 2 King Richard 1st Road, Portsmouth PO1 2FR (United Kingdom)], E-mail: alan.castle@port.ac.uk

    2009-02-15

    Developing critical thinking skills is a key aim of higher education and is important in preparing student radiographers for their future careers in clinical practice. The aim of this paper was to attempt to devise and assess six key components of critical thinking appropriate for radiographic practice. Each of the six components was divided into three dimensions and a Critical Thinking Skills Scoring Chart (CTSSC) devised to assess students' written performance against each dimension. Scores revealed that approximately 30% of students were rated as good and approximately 10% of students were rated as poor in each component, although there was some variability between different dimensions. It is suggested that educators need to encourage and support students to develop their critical thinking skills by reviewing their curriculum to clearly define specific skills and ensure that they are appropriately taught and assessed.

  11. Technical and Technological Skills Assessment in Laparoscopic Surgery

    Science.gov (United States)

    Chang, Avril; Vincent, Charles

    2006-01-01

    Objectives: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. Methods: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each operation blindly and independently on DVD. The technological skills were assessed in the operating room. Results: One hundred operations were analyzed. Eight trainees and 10 consultant surgeons were recruited. No adverse events occurred due to technical or technological skills. Mean interrater reliability was kappa=0.88, P=technical and technological skills between trainee and consultant surgeons were significant, Mann-Whitney P=technical and technological skills can be measured to assess performance of laparoscopic surgeons. This technical and technological assessment tool for laparoscopic surgery seems to have face, content, concurrent, and construct validities and could be modified and applied to any laparoscopic operation. The tool has the possibility of being used in surgical training and appraisal. We aim to modify and apply this tool to advanced laparoscopic operations. PMID:17212881

  12. Cross-platform digital assessment forms for evaluating surgical skills

    Directory of Open Access Journals (Sweden)

    Steven Arild Wuyts Andersen

    2015-04-01

    Full Text Available A variety of structured assessment tools for use in surgical training have been reported, but extant assessment tools often employ paper-based rating forms. Digital assessment forms for evaluating surgical skills could potentially offer advantages over paper-based forms, especially in complex assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database containing the digital assessment forms, because this software has cross-platform functionality on both desktop computers and handheld devices. The database is hosted online, and the rating forms can therefore also be accessed through most modern web browsers. Cross-platform digital assessment forms were developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion, digital assessment forms can be used for the structured rating of surgical skills and have the potential to be especially useful in complex assessment situations with multiple raters, repeated assessments in various times and locations, and situations requiring substantial subsequent data processing or complex score calculations.

  13. Assessment of Communication Skills Level among Healthcare Practitioners

    Directory of Open Access Journals (Sweden)

    M. Barati

    2012-04-01

    Full Text Available Introduction & Objective: Communication skills are the most important characteristics for healthcare providers. The aim of this study was to assess communication skills level and its related factors among healthcare practitioners in Bahar-Hamadan.Materials & Methods: This descriptive-analytical study was carried out on 309 employees in Bahar health care system. Data-gathering tools consisted of a 3-part questionnaire: communication skills level measuring feedback, listening, and verbal communication. Subjects’ demographic variables such as age, gender, education level and job were also recorded. The obtained data was analyzed by means of the statistical software SPSS-13 using coefficient correlation, liner regression, t-test, and One-way Anova.Results: The subjects reported 62.2, 57.1, and 60.2% of receivable scores of verbal, listening, and feedback communication, respectively. Overall communication skills of 27.8% of the participants were evaluated at the desired level. Significant differences were observed in average score of communication skills related to age, gender, education degree, employment status, workhouse, and experience (P<0.05. In liner regression, factors influencing communication skills were age, gender, and education degree (P< 0.05.Conclusion: The results reveal that the communication skills of more than half of the medical practitioners are weak and moderate. It is recommended to design some program to improve medical practitioners' communication skills. (Sci J Hamadan Univ Med Sci 2012;19(1:62-69

  14. Reliable and valid assessment of Lichtenstein hernia repair skills

    DEFF Research Database (Denmark)

    Carlsen, C G; Lindorff Larsen, Karen; Funch-Jensen, P

    2014-01-01

    of an assessment tool designed to measure surgical skills in Lichtenstein hernia repair. METHODS: Key issues were identified through a focus group interview. On this basis, an assessment tool with eight items was designed. Ten surgeons and surgical trainees were video recorded while performing Lichtenstein hernia...... repair, (four experts, three intermediates, and three novices). The videos were blindly and individually assessed by three raters (surgical consultants) using the assessment tool. Based on these assessments, validity and reliability were explored. RESULTS: The internal consistency of the items was high...... a significant difference between the three groups which indicates construct validity, p skills can be assessed blindly by a single rater in a reliable and valid fashion with the new procedure-specific assessment tool. We recommend this tool for future assessment...

  15. Developing Enterprise Skills through Peer-Assessed Pitch Presentations

    Science.gov (United States)

    Faherty, Anna

    2015-01-01

    Purpose: The purpose of this paper is to investigate the impact of using summative peer assessment to develop enterprise skills within higher education. Design/methodology/approach: An empirical investigation analysing students own perceptions of the peer assessment process to evaluate its impact. Findings: Participating students indicate that…

  16. Assessment of Inquiry Skills in the SAILS Project

    Science.gov (United States)

    Harrison, Chris

    2014-01-01

    Inquiry provides both the impetus and experience that helps students acquire problem solving and lifelong learning skills. Teachers on the Strategies for Assessment of Inquiry Learning in Science Project (SAILS) strengthened their inquiry pedagogy, through focusing on seeking assessment evidence for formative action. This paper reports on both the…

  17. Assessment Strategies, Self-Regulated Learning Skills, and Perceptions of Assessment in Online Learning

    Science.gov (United States)

    Mao, Jin; Peck, Kyle

    2013-01-01

    This study investigated the effects of assessment strategies and self-regulated learning skills on students' learning and perceptions of assessment for learning. The results revealed no statistically significant difference in the immediate skill-based and cognitive learning outcomes, but peer assessment teams scored significantly higher than the…

  18. Assessment of dental students’ communication skills with patients

    Science.gov (United States)

    MEMARPOUR, MAHTAB; BAZRAFKAN, LEILA; ZAREI, ZAHRA

    2016-01-01

    Introduction Establishment of effective communication between the clinician and patient is essential in order to increase the effectiveness of treatment. These skills have been less investigated among dental students. This study aimed to evaluate communication skills of dental students in Shiraz with patients through direct observation, patients' perspectives and students' self-assessments. Methods This cross-sectional study enrolled the fifth and sixth year dental students and one of each student’s patients who was chosen using simple random sampling method. We used a checklist for data collection. Students’ communication skills were assessed at three steps of the student-patient interview – at the beginning of the interview, during the interview, and at the end of the interview. The checklist was completed by three groups: 1) an observer, 2) the patient and 3) the student, as self-assessment. The validity of the checklist was confirmed by clinical professors and the reliability was determined by Cronbach's alpha test. Data were analyzed using descriptive statistics and Student’s t test. A repeated measure MANOVA was used to compare the mean communication skills in the researcher, patients, and students at each step of the patient interviews. Results There were 110 students (mean age: 22.3±8.4 years) and 110 patients (mean age: 32±8.8 years) who completed the checklists. Overall, the communication skills of dental students were rated as good according to the patients. However, the observer and student participants rated the skills at the moderate level. We observed significant differences between communication skills in all three groups and in the three steps of the patient interviews (ppatients' beliefs and students' self assessments, there were no differences between male and female students in communication skills in the three steps of the patient interviews (all p>0.05). However from the observer’s viewpoint, female students showed better

  19. Assessment of dental students' communication skills with patients.

    Science.gov (United States)

    Memarpour, Mahtab; Bazrafkan, Leila; Zarei, Zahra

    2016-01-01

    Establishment of effective communication between the clinician and patient is essential in order to increase the effectiveness of treatment. These skills have been less investigated among dental students. This study aimed to evaluate communication skills of dental students in Shiraz with patients through direct observation, patients' perspectives and students' self-assessments. This cross-sectional study enrolled the fifth and sixth year dental students and one of each student's patients who was chosen using simple random sampling method. We used a checklist for data collection. Students' communication skills were assessed at three steps of the student-patient interview - at the beginning of the interview, during the interview, and at the end of the interview. The checklist was completed by three groups: 1) an observer, 2) the patient and 3) the student, as self-assessment. The validity of the checklist was confirmed by clinical professors and the reliability was determined by Cronbach's alpha test. Data were analyzed using descriptive statistics and Student's t test. A repeated measure MANOVA was used to compare the mean communication skills in the researcher, patients, and students at each step of the patient interviews. There were 110 students (mean age: 22.3±8.4 years) and 110 patients (mean age: 32±8.8 years) who completed the checklists. Overall, the communication skills of dental students were rated as good according to the patients. However, the observer and student participants rated the skills at the moderate level. We observed significant differences between communication skills in all three groups and in the three steps of the patient interviews (ppatients' beliefs and students' self assessments, there were no differences between male and female students in communication skills in the three steps of the patient interviews (all p>0.05). However from the observer's viewpoint, female students showed better communication skills during the interviews (p=0

  20. Assessing computer skills in Tanzanian medical students: an elective experience

    Directory of Open Access Journals (Sweden)

    Melvin Rob

    2004-08-01

    Full Text Available Abstract Background One estimate suggests that by 2010 more than 30% of a physician's time will be spent using information technology tools. The aim of this study is to assess the information and communication technologies (ICT skills of medical students in Tanzania. We also report a pilot intervention of peer mentoring training in ICT by medical students from the UK tutoring students in Tanzania. Methods Design: Cross sectional study and pilot intervention study. Participants: Fourth year medical students (n = 92 attending Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania. Main outcome measures: Self-reported assessment of competence on ICT-related topics and ability to perform specific ICT tasks. Further information related to frequency of computer use (hours per week, years of computer use, reasons for use and access to computers. Skills at specific tasks were reassessed for 12 students following 4 to 6 hours of peer mentoring training. Results The highest levels of competence in generic ICT areas were for email, Internet and file management. For other skills such as word processing most respondents reported low levels of competence. The abilities to perform specific ICT skills were low – less than 60% of the participants were able to perform the core specific skills assessed. A period of approximately 5 hours of peer mentoring training produced an approximate doubling of competence scores for these skills. Conclusion Our study has found a low level of ability to use ICT facilities among medical students in a leading university in sub-Saharan Africa. A pilot scheme utilising UK elective students to tutor basic skills showed potential. Attention is required to develop interventions that can improve ICT skills, as well as computer access, in order to bridge the digital divide.

  1. Assessing computer skills in Tanzanian medical students: an elective experience.

    Science.gov (United States)

    Samuel, Miriam; Coombes, John C; Miranda, J Jaime; Melvin, Rob; Young, Eoin J W; Azarmina, Pejman

    2004-08-12

    One estimate suggests that by 2010 more than 30% of a physician's time will be spent using information technology tools. The aim of this study is to assess the information and communication technologies (ICT) skills of medical students in Tanzania. We also report a pilot intervention of peer mentoring training in ICT by medical students from the UK tutoring students in Tanzania. Cross sectional study and pilot intervention study. Fourth year medical students (n = 92) attending Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania. Self-reported assessment of competence on ICT-related topics and ability to perform specific ICT tasks. Further information related to frequency of computer use (hours per week), years of computer use, reasons for use and access to computers. Skills at specific tasks were reassessed for 12 students following 4 to 6 hours of peer mentoring training. The highest levels of competence in generic ICT areas were for email, Internet and file management. For other skills such as word processing most respondents reported low levels of competence. The abilities to perform specific ICT skills were low - less than 60% of the participants were able to perform the core specific skills assessed. A period of approximately 5 hours of peer mentoring training produced an approximate doubling of competence scores for these skills. Our study has found a low level of ability to use ICT facilities among medical students in a leading university in sub-Saharan Africa. A pilot scheme utilising UK elective students to tutor basic skills showed potential. Attention is required to develop interventions that can improve ICT skills, as well as computer access, in order to bridge the digital divide.

  2. Skill Acquisition in Ski Instruction and the Skill Model's Application to Treating Anorexia Nervosa

    Science.gov (United States)

    Duesund, Liv; Jespersen, Ejgil

    2004-01-01

    The Dreyfus skill model has a wide range of applications to various domains, including sport, nursing, engineering, flying, and so forth. In this article, the authors discuss the skill model in connection with two different research projects concerning ski instruction and treating anorexia nervosa. The latter project has been published but not in…

  3. The Role of Crowdsourcing in Assessing Surgical Skills.

    Science.gov (United States)

    Katz, Andrew J

    2016-08-01

    Assessing surgical skill is critical in improving patient care while reducing medical errors, length of stay, and readmission rates. Crowdsourcing provides 1 potential method for accurately assessing this; only recently has crowdsourcing been studied as a valid way to provide feedback to surgeons. The results of such studies are explored. A systematic literature search was performed on PubMed to identify studies that have attempted to validate crowdsourcing as a method for assessing surgical skill. Through a combination of abstract screening and full-length review, 9 studies that met the inclusion criteria were reviewed. Crowdsourcing has been validated as an important way to provide feedback for surgical skill. It has been demonstrated to be effective in both dry-lab and live surgery, for a variety of tasks and methods. However, more studies must be performed to ensure that crowdsourcing can provide quality feedback in a wider variety of scenarios.

  4. The use of structured imagery and dispositional measurement to assess situational use of mindfulness skills.

    Directory of Open Access Journals (Sweden)

    Jonathan C Mitchell

    Full Text Available The recent proliferation of studies on mindfulness produced varying theoretical models, each based in part on how mindfulness is assessed. These models agree, however, that mindfulness encompasses moment-to-moment or situational experiences. Incongruence between dispositional and situational assessment would be problematic for theory and empirical research. In particular, it remains to be established whether situational measurement is an accurate method for mindfulness assessment and whether dispositional measures are able to accurately detect mindfulness skills in various situations. The association between dispositional and situational mindfulness processes (i.e., situational attention awareness and emotion acceptance was examined in two studies. In Study 1 (N = 148, independent groups who reported high and low levels of dispositional mindfulness skills were compared on a continuous measure of situational mindfulness skills. In Study 2 (N = 317, dispositional mindfulness questionnaires were used to predict situational use of mindfulness skills. Results suggest not only that situational measures accurately detect use of mindfulness skills, but also that dispositional measures can predict one's use of situational mindfulness skills. Findings from both studies were consistent across both positive and negative situations. Moreover, neither neuroticism nor extraversion was shown to have a moderating effect on the relationship between dispositional and situational use of mindfulness skills. The implications of these findings for clinical practice and future investigations pertaining to measurement validity in this area are discussed.

  5. Predictive model for early math skills based on structural equations.

    Science.gov (United States)

    Aragón, Estíbaliz; Navarro, José I; Aguilar, Manuel; Cerda, Gamal; García-Sedeño, Manuel

    2016-12-01

    Early math skills are determined by higher cognitive processes that are particularly important for acquiring and developing skills during a child's early education. Such processes could be a critical target for identifying students at risk for math learning difficulties. Few studies have considered the use of a structural equation method to rationalize these relations. Participating in this study were 207 preschool students ages 59 to 72 months, 108 boys and 99 girls. Performance with respect to early math skills, early literacy, general intelligence, working memory, and short-term memory was assessed. A structural equation model explaining 64.3% of the variance in early math skills was applied. Early literacy exhibited the highest statistical significance (β = 0.443, p < 0.05), followed by intelligence (β = 0.286, p < 0.05), working memory (β = 0.220, p < 0.05), and short-term memory (β = 0.213, p < 0.05). Correlations between the independent variables were also significant (p < 0.05). According to the results, cognitive variables should be included in remedial intervention programs. © 2016 Scandinavian Psychological Associations and John Wiley & Sons Ltd.

  6. Designing an Automated Assessment of Public Speaking Skills Using Multimodal Cues

    Science.gov (United States)

    Chen, Lei; Feng, Gary; Leong, Chee Wee; Joe, Jilliam; Kitchen, Christopher; Lee, Chong Min

    2016-01-01

    Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and human rating were conducted according to standards in educational assessment. An initial corpus of…

  7. Materials for Assessing the Writing Skill

    Directory of Open Access Journals (Sweden)

    Vahid Nimehchisalem

    2010-07-01

    Full Text Available This paper reviews the issues of concern in writing scale development in English as Second Language (ESL settings with an intention to provide a useful guide for researchers or writing teachers who wish to develop or adapt valid, reliable and efficient writing scales considering their present assessment situations. With a brief discussion on the rationale behind writing scales, the author considers the process of scale development by breaking it into three phases of design, operationalization and administration. The issues discussed in the first phase include analyzing the samples, deciding on the type of scale and ensuring the validity of its design. Phase two encompasses setting the scale criteria, operationalization of definitions, setting a numerical value, assigning an appropriate weight for each trait, accounting for validity and reliability. The final phase comprises recommendations on how a writing scale should be used.

  8. Assessment of dental students’ communication skills with patients

    Directory of Open Access Journals (Sweden)

    MAHTAB MEMARPOUR

    2016-01-01

    Full Text Available Introduction: Establishment of effective communication between the clinician and patient is essential in order to increase the effectiveness of treatment. These skills have been less investigated among dental students. This study aimed to evaluate communication skills of dental students in Shiraz with patients through direct observation, patients’ perspectives and students’ self-assessments. Methods: This cross-sectional study enrolled the fifth and sixth year dental students and one of each student’s patients who was chosen using simple random sampling method. We used a checklist for data collection. Students’ communication skills were assessed at three steps of the student-patient interview – at the beginning of the interview, during the interview, and at the end of the interview. The checklist was completed by three groups: 1 an observer, 2 the patient and 3 the student, as self-assessment. The validity of the checklist was confirmed by clinical professors and the reliability was determined by Cronbach’s alpha test. Data were analyzed using descriptive statistics and Student’s t test. A repeated measure MANOVA was used to compare the mean communication skills in the researcher, patients, and students at each step of the patient interviews. Results: There were 110 students (mean age: 22.3±8.4 years and 110 patients (mean age: 32±8.8 years who completed the checklists. Overall, the communication skills of dental students were rated as good according to the patients. However, the observer and student participants rated the skills at the moderate level. We observed significant differences between communication skills in all three groups and in the three steps of the patient interviews (p0.05. However from the observer’s viewpoint, female students showed better communication skills during the interviews (p=0.001. Conclusion: There was a degree of failure in communication skills of dental students with patients in the interview

  9. Cross-platform digital assessment forms for evaluating surgical skills

    DEFF Research Database (Denmark)

    Andersen, Steven Arild Wuyts

    2015-01-01

    assessment situations. In this paper, we report on the development of cross-platform digital assessment forms for use with multiple raters in order to facilitate the automatic processing of surgical skills assessments that include structured ratings. The FileMaker 13 platform was used to create a database...... containing the digital assessment forms, because this software has cross-platform functionality on both desktop computers and handheld devices. The database is hosted online, and the rating forms can therefore also be accessed through most modern web browsers. Cross-platform digital assessment forms were...... developed for the rating of surgical skills. The database platform used in this study was reasonably priced, intuitive for the user, and flexible. The forms have been provided online as free downloads that may serve as the basis for further development or as inspiration for future efforts. In conclusion...

  10. Learning Model and Form of Assesment toward the Inferensial Statistical Achievement by Controlling Numeric Thinking Skills

    Science.gov (United States)

    Widiana, I. Wayan; Jampel, I. Nyoman

    2016-01-01

    This study aimed to find out the effect of learning model and form of assessment toward inferential statistical achievement after controlling numeric thinking skills. This study was quasi experimental study with 130 students as the sample. The data analysis used ANCOVA. After controlling numeric thinking skills, the result of this study show that:…

  11. The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students.

    Science.gov (United States)

    Hastie, Carolyn; Fahy, Kathleen; Parratt, Jenny

    2014-09-01

    Poor teamwork is cited as one of the major root causes of adverse events in healthcare. Bullying, resulting in illness for staff, is an expression of poor teamwork skills. Despite this knowledge, poor teamwork persists in healthcare and teamwork skills are rarely the focus of teaching and assessment in undergraduate health courses. To develop and implement an assessment tool for use in facilitating midwifery students' learning of teamwork skills. This paper describes how the TeamUP rubric tool was developed. A review of the literature found no research reports on how to teach and assess health students' teamwork skills in standing teams. The literature, however, gives guidance about how university educators should evaluate individual students using peer assessment. The developmental processes of the rubric were grounded in the theoretical literature and feminist collaborative conversations. The rubric incorporates five domains of teamwork skills: Fostering a Team Climate; Project Planning; Facilitating Teams; Managing Conflict and Quality Individual Contribution. The process and outcomes of student and academic content validation are described. The TeamUP rubric is useful for articulating, teaching and assessing teamwork skills for health professional students. The TeamUP rubric is a robust, theoretically grounded model that defines and details effective teamwork skills and related behaviours. If these skills are mastered, we predict that graduates will be more effective in teams. Our assumption is that graduates, empowered by having these skills, are more likely to manage conflict effectively and less likely to engage in bullying behaviours. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.

  12. Basic Laparoscopic Skills Assessment Study: Validation and Standard Setting among Canadian Urology Trainees.

    Science.gov (United States)

    Lee, Jason Y; Andonian, Sero; Pace, Kenneth T; Grober, Ethan

    2017-06-01

    As urology training programs move to a competency based medical education model, iterative assessments with objective standards will be required. To develop a valid set of technical skills standards we initiated a national skills assessment study focusing initially on laparoscopic skills. Between February 2014 and March 2016 the basic laparoscopic skill of Canadian urology trainees and attending urologists was assessed using 4 standardized tasks from the AUA (American Urological Association) BLUS (Basic Laparoscopic Urological Surgery) curriculum, including peg transfer, pattern cutting, suturing and knot tying, and vascular clip applying. All performances were video recorded and assessed using 3 methods, including time and error based scoring, expert global rating scores and C-SATS (Crowd-Sourced Assessments of Technical Skill Global Rating Scale), a novel, crowd sourced assessment platform. Different methods of standard setting were used to develop pass-fail cut points. Six attending urologists and 99 trainees completed testing. Reported laparoscopic experience and training level correlated with performance (p standard setting methods to define pass-fail cut points for all 4 AUA BLUS tasks. The 4 AUA BLUS tasks demonstrated good construct validity evidence for use in assessing basic laparoscopic skill. Performance scores using the novel C-SATS platform correlated well with traditional time-consuming methods of assessment. Various standard setting methods were used to develop pass-fail cut points for educators to use when making formative and summative assessments of basic laparoscopic skill. Copyright © 2017 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  13. Technical skills assessment toolbox: a review using the unitary framework of validity.

    Science.gov (United States)

    Ghaderi, Iman; Manji, Farouq; Park, Yoon Soo; Juul, Dorthea; Ott, Michael; Harris, Ilene; Farrell, Timothy M

    2015-02-01

    The purpose of this study was to create a technical skills assessment toolbox for 35 basic and advanced skills/procedures that comprise the American College of Surgeons (ACS)/Association of Program Directors in Surgery (APDS) surgical skills curriculum and to provide a critical appraisal of the included tools, using contemporary framework of validity. Competency-based training has become the predominant model in surgical education and assessment of performance is an essential component. Assessment methods must produce valid results to accurately determine the level of competency. A search was performed, using PubMed and Google Scholar, to identify tools that have been developed for assessment of the targeted technical skills. A total of 23 assessment tools for the 35 ACS/APDS skills modules were identified. Some tools, such as Operative Performance Rating System (OSATS) and Objective Structured Assessment of Technical Skill (OPRS), have been tested for more than 1 procedure. Therefore, 30 modules had at least 1 assessment tool, with some common surgical procedures being addressed by several tools. Five modules had none. Only 3 studies used Messick's framework to design their validity studies. The remaining studies used an outdated framework on the basis of "types of validity." When analyzed using the contemporary framework, few of these studies demonstrated validity for content, internal structure, and relationship to other variables. This study provides an assessment toolbox for common surgical skills/procedures. Our review shows that few authors have used the contemporary unitary concept of validity for development of their assessment tools. As we progress toward competency-based training, future studies should provide evidence for various sources of validity using the contemporary framework.

  14. Assessment and treatment of planning skills in adolescents with ADHD

    NARCIS (Netherlands)

    Boyer, B.E.

    2016-01-01

    Planning problems are described to be prominent in the daily lives of adolescents with ADHD (Barkley, 2004) and may cause comorbid conditions and impairments (Safren, 2006). Therefore the central aim of this thesis was to assess planning skills of adolescents with ADHD and to investigate whether

  15. Trait Based Assessment on Teaching Writing Skill for EFL Learners

    Science.gov (United States)

    Asrobi, Maman; Prasetyaningrum, Ari

    2017-01-01

    This study was conducted in order to investigate the effectiveness of trait based assessment on teaching writing skill for EFL learners. Designed as pre-experimental study with one group pretest and posttest design, it examined 20 students of the second semester of English Department of "Hamzanwadi University" in the academic year…

  16. Fostering and Assessing Critical Listening Skills in the Speech Course

    Science.gov (United States)

    Ferrari-Bridgers, Franca; Vogel, Rosanne; Lynch, Barbara

    2017-01-01

    In this article we present the results of two listening assessments conducted in spring 2013 and fall 2013. Our primary goal is of a pedagogical nature and is concerned with the design and the testing of a tool that could measure students' critical listening skill improvement during the span of a semester. A total of N = 370 students participated…

  17. Approaching time is important for assessment of endoscopic surgical skills.

    Science.gov (United States)

    Tokunaga, Masakazu; Egi, Hiroyuki; Hattori, Minoru; Yoshimitsu, Masanori; Sumitani, Daisuke; Kawahara, Tomohiro; Okajima, Masazumi; Ohdan, Hideki

    2012-05-01

    This study aimed to verify whether the approaching time (the time taken to reach the target point from another point, a short distance apart, during point-to-point movement in endoscopic surgery), assessed using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), could distinguish the skill level of surgeons. Expert surgeons (who had performed more than 50 endoscopic surgeries) and novice surgeons (who had no experience in performing endoscopic surgery) were tested using the HUESAD. The approaching time, total time, and intermediate time (total time--approaching time) were measured and analyzed using the trajectory of the tip of the instrument. The approaching time and total time were significantly shorter in the expert group than in the novice group (p time did not significantly differ between the groups (p > 0.05). The approaching time, which is a component of the total time, is very mportant in the measurement of the total time to assess endoscopic surgical skills. Further, the approaching time was useful for skill assessment by the HUESAD for evaluating the skill of surgeons performing endoscopic surgery.

  18. Assessment of computer literacy skills of university librarians in Nigeria

    African Journals Online (AJOL)

    The study used quantitative research techniques that involved a total coverage o f 32 librarians at FUTO library. The primary instrument for data collection was a self administered open and close -ended questionnaire. An assessment of computer literacy skills questionnaire was designed and administered by the researcher ...

  19. An Assessment of lnformation Literacy Skills of Students in Selected ...

    African Journals Online (AJOL)

    The study assessed the information literacy skills of students in selected secondary schools within Ibadan metropolis; Senior Secondary School II (SS2) students in both public and private secondary schools in Ibadan constituted the sample for the study. Survey research design was adopted; questionnaire was used for data ...

  20. Assessment of medical communication skills by computer: assessment method and student experiences

    NARCIS (Netherlands)

    Hulsman, R. L.; Mollema, E. D.; Hoos, A. M.; de Haes, J. C. J. M.; Donnison-Speijer, J. D.

    2004-01-01

    BACKGROUND A computer-assisted assessment (CAA) program for communication skills designated ACT was developed using the objective structured video examination (OSVE) format. This method features assessment of cognitive scripts underlying communication behaviour, a broad range of communication

  1. Does a Rater's Professional Background Influence Communication Skills Assessment?

    Science.gov (United States)

    Artemiou, Elpida; Hecker, Kent G; Adams, Cindy L; Coe, Jason B

    2015-01-01

    There is increasing pressure in veterinary education to teach and assess communication skills, with the Objective Structured Clinical Examination (OSCE) being the most common assessment method. Previous research reveals that raters are a large source of variance in OSCEs. This study focused on examining the effect of raters' professional background as a source of variance when assessing students' communication skills. Twenty-three raters were categorized according to their professional background: clinical sciences (n=11), basic sciences (n=4), clinical communication (n=5), or hospital administrator/clinical skills technicians (n=3). Raters from each professional background were assigned to the same station and assessed the same students during two four-station OSCEs. Students were in year 2 of their pre-clinical program. Repeated-measures ANOVA results showed that OSCE scores awarded by the rater groups differed significantly: (F(matched_station_1) [2,91]=6.97, p=.002), (F(matched_station_2) [3,90]=13.95, p=.001), (F(matched_station_3) [3,90]=8.76, p=.001), and ((Fmatched_station_4) [2,91]=30.60, p=.001). A significant time effect between the two OSCEs was calculated for matched stations 1, 2, and 4, indicating improved student performances. Raters with a clinical communication skills background assigned scores that were significantly lower compared to the other rater groups. Analysis of written feedback provided by the clinical sciences raters showed that they were influenced by the students' clinical knowledge of the case and that they did not rely solely on the communication checklist items. This study shows that it is important to consider rater background both in recruitment and training programs for communication skills' assessment.

  2. Development and verification of a taxonomy of assessment metrics for surgical technical skills.

    Science.gov (United States)

    Schmitz, Connie C; DaRosa, Debra; Sullivan, Maura E; Meyerson, Shari; Yoshida, Ken; Korndorffer, James R

    2014-01-01

    To create and empirically verify a taxonomy of metrics for assessing surgical technical skills, and to determine which types of metrics, skills, settings, learners, models, and instruments were most commonly reported in the technical skills assessment literature. In 2011-2012, the authors used a rational analysis of existing and emerging metrics to create the taxonomy, and used PubMed to conduct a systematic literature review (2001-2011) to test the taxonomy's comprehensiveness and verifiability. Using 202 articles identified from the review, the authors classified metrics according to the taxonomy and coded data concerning their context and use. Frequencies (counts, percentages) were calculated for all variables. The taxonomy contained 12 objective and 4 subjective categories. Of 567 metrics identified in the literature, 520 (92%) were classified using the new taxonomy. Process metrics outnumbered outcome metrics by 8:1. The most frequent metrics were "time," "manual techniques" (objective and subjective), "errors," and "procedural steps." Only one new metric, "learning curve," emerged. Assessments of basic motor skills and skills germane to laparoscopic surgery dominated the literature. Novices, beginners, and intermediate learners were the most frequent subjects, and box trainers and virtual reality simulators were the most frequent models used for assessing performance. Metrics convey what is valued in human performance. This taxonomy provides a common nomenclature. It may help educators and researchers in procedurally oriented disciplines to use metrics more precisely and consistently. Future assessments should focus more on bedside tasks and open surgical procedures and should include more outcome metrics.

  3. Validity of evaluation instrument on the implementation of performance assessment to measure science process skills

    OpenAIRE

    Marina Ramadani; Supahar Supahar; Dadan Rosana

    2017-01-01

    This study aims to develop an evaluation instrument CIPP (context, input, process, product) model that suitable at implementation of performance assessment instrument to measure students' science process skills of junior high school. Methods in this study are research and development (R & D) which is adopted by model Borg & Gall model. This evaluation instrument used one of evaluation CIPP model with context, input, process, and product components. The evaluation instrument is used to determi...

  4. Is motion analysis a valid tool for assessing laparoscopic skill?

    Science.gov (United States)

    Mason, John D; Ansell, James; Warren, Neil; Torkington, Jared

    2013-05-01

    The use of simulation for laparoscopic training has led to the development of objective tools for skills assessment. Motion analysis represents one area of focus. This study was designed to assess the evidence for the use of motion analysis as a valid tool for laparoscopic skills assessment. Embase, MEDLINE and PubMed were searched using the following domains: (1) motion analysis, (2) validation and (3) laparoscopy. Studies investigating motion analysis as a tool for assessment of laparoscopic skill in general surgery were included. Common endpoints in motion analysis metrics were compared between studies according to a modified form of the Oxford Centre for Evidence-Based Medicine levels of evidence and recommendation. Thirteen studies were included from 2,039 initial papers. Twelve (92.3 %) reported the construct validity of motion analysis across a range of laparoscopic tasks. Of these 12, 5 (41.7 %) evaluated the ProMIS Augmented Reality Simulator, 3 (25 %) the Imperial College Surgical Assessment Device (ICSAD), 2 (16.7 %) the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), 1 (8.33 %) the Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) and 1 (8.33 %) the Robotic and Video Motion Analysis Software (ROVIMAS). Face validity was reported by 1 (7.7 %) study each for ADEPT and ICSAD. Concurrent validity was reported by 1 (7.7 %) study each for ADEPT, ICSAD and ProMIS. There was no evidence for predictive validity. Evidence exists to validate motion analysis for use in laparoscopic skills assessment. Valid parameters are time taken, path length and number of hand movements. Future work should concentrate on the conversion of motion data into competency-based scores for trainee feedback.

  5. Separation index and fit items of creative thinking skills assessment

    Directory of Open Access Journals (Sweden)

    Andi Ulfa Tenri Pada

    2016-06-01

    Full Text Available This article discusses the evaluation results of the separation index and fit item of creative thinking skills assessment that supports the conation aspect of prospective biology teachers in Aceh. This assessment consists of 37 items of divergent tasks, which is the application of human physiology courses that support the conation aspects. The participants were selected from the Biology Education Program, Faculty of Teacher Training and Education, Syiah Kuala University. The data were analyzed using the Quest software including the separation index and fit item. The results indicate that the creative thinking skills assessment instrument that supports the conation aspect of prospective biology teachers has a good separation index and all the items fit PCM-1PL.

  6. Modeling Diagnostic Assessments with Bayesian Networks

    Science.gov (United States)

    Almond, Russell G.; DiBello, Louis V.; Moulder, Brad; Zapata-Rivera, Juan-Diego

    2007-01-01

    This paper defines Bayesian network models and examines their applications to IRT-based cognitive diagnostic modeling. These models are especially suited to building inference engines designed to be synchronous with the finer grained student models that arise in skills diagnostic assessment. Aspects of the theory and use of Bayesian network models…

  7. Implementing and Evaluating a National Certification Technical Skills Examination: The Colorectal Objective Structured Assessment of Technical Skill.

    Science.gov (United States)

    de Montbrun, Sandra; Roberts, Patricia L; Satterthwaite, Lisa; MacRae, Helen

    2016-07-01

    To implement the Colorectal Objective Structured Assessment of Technical skill (COSATS) into American Board of Colon and Rectal Surgery (ABCRS) certification and build evidence of validity for the interpretation of the scores of this high stakes assessment tool. Currently, technical skill assessment is not a formal component of board certification. With the technical demands of surgical specialties, documenting competence in technical skill at the time of certification with a valid tool is ideal. In September 2014, the COSATS was a mandatory component of ABCRS certification. Seventy candidates took the examination, with their performance evaluated by expert colorectal surgeons using a task-specific checklist, global rating scale, and overall performance scale. Passing scores were set and compared using 2 standard setting methodologies, using a compensatory and conjunctive model. Inter-rater reliability and the reliability of the pass/fail decision were calculated using Cronbach alpha and Subkoviak methodology, respectively. Overall COSATS scores and pass/fail status were compared with results on the ABCRS oral examination. The pass rate ranged from 85.7% to 90%. Inter-rater reliability (0.85) and reliability of the pass/fail decision (0.87 and 0.84) were high. A low positive correlation (r= 0.25) was seen between the COSATS and oral examination. All individuals who failed the COSATS passed the ABCRS oral examination. COSATS is the first technical skill examination used in national surgical board certification. This study suggests that the current certification process may be failing to identify individuals who have demonstrated technical deficiencies on this standardized assessment tool.

  8. Nursing physical assessment for patient safety in general wards: reaching consensus on core skills.

    Science.gov (United States)

    Douglas, Clint; Booker, Catriona; Fox, Robyn; Windsor, Carol; Osborne, Sonya; Gardner, Glenn

    2016-07-01

    To determine consensus across acute care specialty areas on core physical assessment skills necessary for early recognition of changes in patient status in general wards. Current approaches to physical assessment are inconsistent and have not evolved to meet increased patient and system demands. New models of nursing assessment are needed in general wards that ensure a proactive and patient safety approach. A modified Delphi study. Focus group interviews with 150 acute care registered nurses at a large tertiary referral hospital generated a framework of core skills that were developed into a web-based survey. We then sought consensus with a panel of 35 senior acute care registered nurses following a classical Delphi approach over three rounds. Consensus was predefined as at least 80% agreement for each skill across specialty areas. Content analysis of focus group transcripts identified 40 discrete core physical assessment skills. In the Delphi rounds, 16 of these were consensus validated as core skills and were conceptually aligned with the primary survey: (Airway) Assess airway patency; (Breathing) Measure respiratory rate, Evaluate work of breathing, Measure oxygen saturation; (Circulation) Palpate pulse rate and rhythm, Measure blood pressure by auscultation, Assess urine output; (Disability) Assess level of consciousness, Evaluate speech, Assess for pain; (Exposure) Measure body temperature, Inspect skin integrity, Inspect and palpate skin for signs of pressure injury, Observe any wounds, dressings, drains and invasive lines, Observe ability to transfer and mobilise, Assess bowel movements. Among a large and diverse group of experienced acute care registered nurses consensus was achieved on a structured core physical assessment to detect early changes in patient status. Although further research is needed to refine the model, clinical application should promote systematic assessment and clinical reasoning at the bedside. © 2016 John Wiley & Sons Ltd.

  9. Instructional Model and Thinking Skill in Chemistry Class

    Science.gov (United States)

    Langkudi, H. H.

    2018-02-01

    Chemistry course are considered a difficult lesson for students as evidenced by low learning outcomes on daily tests, mid-semester tests as well as final semester tests. This research intended to investigate the effect of instructional model, thinking skill and the interaction of these variables on students’ achievement in chemistry. Experimental method was applying used 2 x 2 factorial design. The results showed that the use of instructional model with thinking skill influences student’s learning outcomes, so that the chemistry teacher is recommended to pay attention to the learning model, and adjusted to the student’s skill thinking on the chemistry material being taught. The conclusion of this research is that discovery model is suitable for students who have formal thinking skill and conventional model is fit for the students that have concrete thinking skill.

  10. Impact of teaching and assessment format on electrocardiogram interpretation skills.

    Science.gov (United States)

    Raupach, Tobias; Hanneforth, Nathalie; Anders, Sven; Pukrop, Tobias; Th J ten Cate, Olle; Harendza, Sigrid

    2010-07-01

    Interpretation of the electrocardiogram (ECG) is a core clinical skill that should be developed in undergraduate medical education. This study assessed whether small-group peer teaching is more effective than lectures in enhancing medical students' ECG interpretation skills. In addition, the impact of assessment format on study outcome was analysed. Two consecutive cohorts of Year 4 medical students (n=335) were randomised to receive either traditional ECG lectures or the same amount of small-group, near-peer teaching during a 6-week cardiorespiratory course. Before and after the course, written assessments of ECG interpretation skills were undertaken. Whereas this final assessment yielded a considerable amount of credit points for students in the first cohort, it was merely formative in nature for the second cohort. An unannounced retention test was applied 8 weeks after the end of the cardiovascular course. A significant advantage of near-peer teaching over lectures (effect size 0.33) was noted only in the second cohort, whereas, in the setting of a summative assessment, both teaching formats appeared to be equally effective. A summative instead of a formative assessment doubled the performance increase (Cohen's d 4.9 versus 2.4), mitigating any difference between teaching formats. Within the second cohort, the significant difference between the two teaching formats was maintained in the retention test (p=0.017). However, in both cohorts, a significant decrease in student performance was detected during the 8 weeks following the cardiovascular course. Assessment format appeared to be more powerful than choice of instructional method in enhancing student learning. The effect observed in the second cohort was masked by an overriding incentive generated by the summative assessment in the first cohort. This masking effect should be considered in studies assessing the effectiveness of different teaching methods.

  11. Early Grade Writing Assessment: An Instrument Model

    Science.gov (United States)

    Jiménez, Juan E.

    2017-01-01

    The United Nations Educational, Scientific, and Cultural Organization promoted the creation of a model instrument for individual assessment of students' foundational writing skills in the Spanish language that was based on a literature review and existing writing tools and assessments. The purpose of the "Early Grade Writing Assessment"…

  12. Models for Delivering Written Business Communication Skills: Improving the Process

    Science.gov (United States)

    Penrod, Catherine B.; Tucker, Mary; Hartman, Katherine B.

    2017-01-01

    Employers, higher education faculty, and accrediting bodies value communication as an important entry-level job skill. Unfortunately, research indicates that college graduates have inadequate communication skills and, in particular, lack strong business writing acumen. The ways business communication is taught, integrated, and assessed varies by…

  13. Rubric Assessment on Science and Creative Thinking Skills of Students

    Science.gov (United States)

    Ratnasusanti, H.; Ana, A.; Nurafiati, P.; Umusyaadah, L.

    2018-02-01

    The result of the monitoring and evaluation of the latest Indonesian curriculum (the 2013 curriculum) implementation at junior high school level year of 2014 showed that one of the difficult things that learners had in implementation 2013 curriculum is doing the result. The characteristic of applying the 2013 curriculum is to emphasize the modern pedagogic dimension of learning, which is using scientific approach, which requires learners to have highlevel thinking skills, one of which is creative thinking skills. The aims of this research is to implement performance assessment in measuring the creative thinking of junior high school students on subject Prakarya. The form of the main performance assessment is the task and assessment criteria. The experimental method that been used is the Quasi Experiment with Non-Equivalent Design Group Research. Population in this study is the students of VIII class of junior high school in Bandung, Indonesia which consists of six classes. And two classes are selected for the sample from that six classes and VIII A class were chosen, while VIII F class has been chosen as control class. The result of this research showed that the rubics of performance assessment can be measure or identify the creative thinking skill, its prove by the result of pre-test dan post-test are more dominant. In material of identification student’s creative thinking skills are reached an average 85 compare 79 with the control class. while in the presentation the experimental class got an average of 85 bigger than the control class which only reached 79.

  14. Patients' assessment of professionalism and communication skills of medical graduates.

    Science.gov (United States)

    Abadel, Fatima T; Hattab, Abdulla S

    2014-02-11

    Professionalism and communication skills constitute important components of the integral formation of physicians which has repercussion on the quality of health care and medical education. The objective of this study was to assess medical graduates' professionalism and communication skills from the patients' perspective and to examine its association with patients' socio-demographic variables. This is a hospital based cross-sectional study. It involved 315 patients and 105 medical graduates selected by convenient sampling method. A modified and validated version of the American Board of Internal Medicine's (ABIM) Patient Assessment survey questionnaire was used for data collection through a face to face interview. Data processing and analysis were performed using the Statistical Package for Social Science (SPSS) 16.0. Mean, frequency distribution, and percentage of the variables were calculated. A non-parametric Kruskal Wallis test was applied to verify whether the patients' assessment was influenced by variables such as age, gender, education, at a level of significance, p ≤ 0.05. Female patients constituted 46% of the sample, whereas males constituted 54%. The mean age was 36 ± 16. Patients' scoring of the graduate's skills ranged from 3.29 to 3.83 with a mean of 3.64 on a five-point Likert scale. Items assessing the "patient involvement in decision-making" were assigned the minimum mean values, while items dealing with "establishing adequate communication with patient" assigned the maximum mean values. Patients, who were older than 45 years, gave higher scores than younger ones (p communication skills at a good level. Patients' age and educational level were significantly associated with the rating level.

  15. Modeling Parallelization and Flexibility Improvements in Skill Acquisition: From Dual Tasks to Complex Dynamic Skills

    Science.gov (United States)

    Taatgen, Niels

    2005-01-01

    Emerging parallel processing and increased flexibility during the acquisition of cognitive skills form a combination that is hard to reconcile with rule-based models that often produce brittle behavior. Rule-based models can exhibit these properties by adhering to 2 principles: that the model gradually learns task-specific rules from instructions…

  16. Retrospectively Assessed Early Motor and Current Pragmatic Language Skills in Autistic and Neurotypical Children.

    Science.gov (United States)

    Stevenson, Jennifer L; Lindley, Caitlin E; Murlo, Nicole

    2017-08-01

    Autistic individuals often struggle developmentally, even in areas that are not explicit diagnostic criteria, such as motor skills. This study explored the relation between early motor skills, assessed retrospectively, and current pragmatic language skills. Caregivers of neurotypical and autistic children, matched on gender and age, completed assessments of their child's early motor development and current language abilities. Early motor skills were correlated with later pragmatic language skills, and autistic children exhibited fewer motor skills than neurotypical children. In fact, motor skills were a better predictor of an autism spectrum diagnosis than were scores on a measure of current pragmatic language. These results highlight the important role of motor skills in autism spectrum disorders.

  17. Comparison between young male drivers' self-assessed and objectively measured driving skills

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Self-assessment of skills is a self-generated feedback process that contributes to confidence in one's skills. The higher one's self-assessed skills, the more likely one is to feel competent a particular domain thereby influencing the related behaviors. Drivers' self-assessed driving skills...... are not always accurate, which may cause serious problems such as underestimation of risk, reckless driving and accidents. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aim of this study was to test the accuracy...... of young male drivers' self-assessments of driving skills using a driving simulator, and to examine whether self-assessment accuracy varied with driving skill, experience or sensation-seeking propensity. Results showed that the drivers' self-assessments were inconsistent with their driving performance...

  18. Generic skills requirements (KSA model) towards future mechanical ...

    African Journals Online (AJOL)

    Generic Skills is a basic requirement that engineers need to master in all areas of Engineering. This study was conducted throughout the peninsular Malaysia involving small, medium and heavy industries using the KSA Model. The objectives of this study are studying the level of requirement of Generic Skills that need to be ...

  19. Certified Basic Life Support Instructors Assess Cardiopulmonary Resuscitation Skills Poorly

    DEFF Research Database (Denmark)

    Hansen, Camilla; Rasmussen, Stinne E; Kristensen, Mette Amalie

    2016-01-01

    quality poorly. Currently no studies have evaluated CPR assessment among certified BLS instructors. The aim of this study was to investigate certified BLS instructors’ assessment of chest compressions and rescue breathing.Methods: Data were collected at BLS courses for medical students at Aarhus...... University, Denmark. In pairs, BLS instructors, certified by the European Resuscitation Council, evaluated each learner in an end-of-course cardiac arrest test. Instructors’ assessments were compared with CPR quality data collected from the resuscitation manikin. Correct chest compressions were defined as ≥2......Introduction: High-quality cardiopulmonary resuscitation (CPR) improves survival from cardiac arrest. During basic life support (BLS) training, instructors assess CPR skills to enhance learning outcome. Emergency department staff and senior residents have been shown to assess chest compression...

  20. Energy-Based Metrics for Arthroscopic Skills Assessment

    Directory of Open Access Journals (Sweden)

    Behnaz Poursartip

    2017-08-01

    Full Text Available Minimally invasive skills assessment methods are essential in developing efficient surgical simulators and implementing consistent skills evaluation. Although numerous methods have been investigated in the literature, there is still a need to further improve the accuracy of surgical skills assessment. Energy expenditure can be an indication of motor skills proficiency. The goals of this study are to develop objective metrics based on energy expenditure, normalize these metrics, and investigate classifying trainees using these metrics. To this end, different forms of energy consisting of mechanical energy and work were considered and their values were divided by the related value of an ideal performance to develop normalized metrics. These metrics were used as inputs for various machine learning algorithms including support vector machines (SVM and neural networks (NNs for classification. The accuracy of the combination of the normalized energy-based metrics with these classifiers was evaluated through a leave-one-subject-out cross-validation. The proposed method was validated using 26 subjects at two experience levels (novices and experts in three arthroscopic tasks. The results showed that there are statistically significant differences between novices and experts for almost all of the normalized energy-based metrics. The accuracy of classification using SVM and NN methods was between 70% and 95% for the various tasks. The results show that the normalized energy-based metrics and their combination with SVM and NN classifiers are capable of providing accurate classification of trainees. The assessment method proposed in this study can enhance surgical training by providing appropriate feedback to trainees about their level of expertise and can be used in the evaluation of proficiency.

  1. The Assessment of Comunication and Interaction Skills in Psychotic Patiens

    Directory of Open Access Journals (Sweden)

    Katayoun Khoushabi

    2002-10-01

    Full Text Available Objective: The main objective at study was to assess the communication and interaction of psychotic patient above age of 18 in 2000. Materials & Methods: The study sample consist of 80 psychotic patients (38 female and 42 male from Razi and Imam Hossein Hospital and Raad and Sina outpatient clinic, selected based on occupational therapist using the Assessment of Communication and Interaction Skills Questionnaire (ACIS. Statistical analyses of information have done by spearman coefficient correlation, Mann Whitney and Wilcoxon tests. Results: Spearman of correlation, mann-and wilcoxon Findings indicate: 1-The average grade of ACIS test in the group of schizophrenic patients were significantly lower than the group schizoaffective patients (P<0.00l. 2-The average of ACIS test in the group of inpatient was lower than the group of outpatient (p<0.00l. 3-No significant difference was found for the average grade of ACIS test in the group of male & female. Conclusion: The obtained results show the weakness of communication and interaction skills in schizophrenic patient and also inpatients. The obtained results of this investigation give useful information about the communication and interaction skill of patient to the occupational therapists but application of this instrument needs more studies.

  2. Decadal prediction skill in a multi-model ensemble

    Energy Technology Data Exchange (ETDEWEB)

    Oldenborgh, Geert Jan van; Wouters, Bert; Hazeleger, Wilco [Royal Netherlands Meteorological Institute (KNMI), P.O. Box 201, De Bilt (Netherlands); Doblas-Reyes, Francisco J. [Institucio Catalana de Recerca i Estudis Avancats (ICREA) and Institut Catala de Ciencies del Clima (IC3), Barcelona (Spain)

    2012-04-15

    Decadal climate predictions may have skill due to predictable components in boundary conditions (mainly greenhouse gas concentrations but also tropospheric and stratospheric aerosol distributions) and initial conditions (mainly the ocean state). We investigate the skill of temperature and precipitation hindcasts from a multi-model ensemble of four climate forecast systems based on coupled ocean-atmosphere models. Regional variations in skill with and without trend are compared with similarly analysed uninitialised experiments to separate the trend due to monotonically increasing forcings from fluctuations around the trend due to the ocean initial state and aerosol forcings. In temperature most of the skill in both multi-model ensembles comes from the externally forced trends. The rise of the global mean temperature is represented well in the initialised hindcasts, but variations around the trend show little skill beyond the first year due to the absence of volcanic aerosols in the hindcasts and the unpredictability of ENSO. The models have non-trivial skill in hindcasts of North Atlantic sea surface temperature beyond the trend. This skill is highest in the northern North Atlantic in initialised experiments and in the subtropical North Atlantic in uninitialised simulations. A similar result is found in the Pacific Ocean, although the signal is less clear. The uninitialised simulations have good skill beyond the trend in the western North Pacific. The initialised experiments show some skill in the decadal ENSO region in the eastern Pacific, in agreement with previous studies. However, the results in this study are not statistically significant (p {approx} 0.1) by themselves. The initialised models also show some skill in forecasting 4-year mean Sahel rainfall at lead times of 1 and 5 years, in agreement with the observed teleconnection from the Atlantic Ocean. Again, the skill is not statistically significant (p {approx} 0.2). Furthermore, uninitialised simulations

  3. The effectiveness of the Geritalk communication skills course: a real-time assessment of skill acquisition and deliberate practice.

    Science.gov (United States)

    Gelfman, Laura P; Lindenberger, Elizabeth; Fernandez, Helen; Goldberg, Gabrielle R; Lim, Betty B; Litrivis, Evgenia; O'Neill, Lynn; Smith, Cardinale B; Kelley, Amy S

    2014-10-01

    Communication skills are critical in Geriatrics and Palliative Medicine because these patients confront complex clinical scenarios. We evaluated the effectiveness of the Geritalk communication skills course by comparing pre- and post-course real-time assessment of the participants leading family meetings. We also evaluated the participants' sustained skills practice. We compare the participants' skill acquisition before and after Geritalk using a direct observation Family Meeting Communication Assessment Tool and assess their deliberate practice at follow-up. First-year Geriatrics or Palliative Medicine fellows at Mount Sinai Medical Center and the James J. Peters Bronx VA Medical Center participated in Geritalk. Pre- and post-course family meeting assessments were compared. An average net gain of 6.8 skills represented a greater than 20% improvement in use of applicable skills. At two month follow-up, most participants reported deliberate practice of fundamental and advanced skills. This intensive training and family meeting assessment offers evidence-based communication skills training. Published by Elsevier Inc.

  4. Decadal prediction skill using a high-resolution climate model

    Science.gov (United States)

    Monerie, Paul-Arthur; Coquart, Laure; Maisonnave, Éric; Moine, Marie-Pierre; Terray, Laurent; Valcke, Sophie

    2017-11-01

    The ability of a high-resolution coupled atmosphere-ocean general circulation model (with a horizontal resolution of a quarter of a degree in the ocean and of about 0.5° in the atmosphere) to predict the annual means of temperature, precipitation, sea-ice volume and extent is assessed based on initialized hindcasts over the 1993-2009 period. Significant skill in predicting sea surface temperatures is obtained, especially over the North Atlantic, the tropical Atlantic and the Indian Ocean. The Sea Ice Extent and volume are also reasonably predicted in winter (March) and summer (September). The model skill is mainly due to the external forcing associated with well-mixed greenhouse gases. A decrease in the global warming rate associated with a negative phase of the Pacific Decadal Oscillation is simulated by the model over a suite of 10-year periods when initialized from starting dates between 1999 and 2003. The model ability to predict regional change is investigated by focusing on the mid-90's Atlantic Ocean subpolar gyre warming. The model simulates the North Atlantic warming associated with a meridional heat transport increase, a strengthening of the North Atlantic current and a deepening of the mixed layer over the Labrador Sea. The atmosphere plays a role in the warming through a modulation of the North Atlantic Oscillation: a negative sea level pressure anomaly, located south of the subpolar gyre is associated with a wind speed decrease over the subpolar gyre. This leads to a reduced oceanic heat-loss and favors a northward displacement of anomalously warm and salty subtropical water that both concur to the subpolar gyre warming. We finally conclude that the subpolar gyre warming is mainly triggered by ocean dynamics with a possible contribution of atmospheric circulation favoring its persistence.

  5. Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

    Science.gov (United States)

    Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

    2016-11-01

    To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

  6. Feedback Simulation for Acupressure Training and Skill Assessment.

    Science.gov (United States)

    Noll, Eric; Romeiser, Jamie; Shodhan, Shivam; Madariaga, Maria Cecilia; Guo, Xiaojun; Rizwan, Sabeen; Al-Bizri, Ehab; Bennett-Guerrero, Elliott

    2017-08-01

    Previous acupressure studies have yielded varying results. This could be due to differences in the amount of pressure applied to the acupressure point (acupoint) by study personnel within a study as well as between studies. Standardizing the level of pressure applied at an acupoint could improve clinical care and future research. As part of an ongoing randomized clinical trial of postoperative acupressure, five trainees were asked to perform 2 minutes of acupressure and light touch sessions on a simulator. The applied weight was recorded every minute. Individual skill assessment was performed using cumulative sum analysis. Six pretraining and 20 posttraining measurements in each acupressure and light touch group were compared with an expert's simulation values. Before training (baseline), there was significant difference in applied weight (grams) between the expert [5705 (636)] and five trainees [2998 (798), P = 0.004]. Four of the five trainees crossed the lower decision limit assessing proficiency in the acupressure group, and all five trainees were successful in the light touch group. The trainees' average number of measurements needed to cross the lower decision limit (H0), that is, defining that an individual failure rate does not statistically differ from the acceptable failure rate, was 21.3 measurements for acupressure. After this feedback simulation, trainees' scores showed no significant difference (P > 0.05) when assessed against the expert. Feedback simulation for acupressure training and skill assessment, evaluated by cumulative sum analysis, may help in improving the standardization of acupressure therapy performed during clinical practice or research.

  7. Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills.

    Science.gov (United States)

    Gustin, Jillian L; Way, David P; Wells-Di Gregorio, Sharla; McCallister, Jennifer W

    2016-08-01

    Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings. We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC. We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity. Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC

  8. Interpersonal Skills in MBA Admissions: How Are They Conceptualized and Assessed?

    Science.gov (United States)

    Beenen, Gerard; Pichler, Shaun; Davoudpour, Shahin

    2018-01-01

    Employers and students concur that soft skills or interpersonal skills are critical to managerial success, yet we know little about how MBA program admissions professionals conceptualize and assess these skills in the context of global management education. Such practices have key implications for interpersonal skills curriculum and training in…

  9. Multi-Institutional Validation of an OSATS for the Assessment of Cystoscopic and Ureteroscopic Skills.

    Science.gov (United States)

    Argun, Omer Burak; Chrouser, Kristin; Chauhan, Sanket; Monga, Manoj; Knudsen, Bodo; Box, Geoffrey N; Lee, David I; Gettman, Matthew T; Poniatowski, Lauren H; Wang, Qi; Reihsen, Troy E; Sweet, Robert M

    2015-10-01

    We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

  10. Are We Teaching Them Anything?: A Model for Measuring Methodology Skills in the Political Science Major

    Science.gov (United States)

    Siver, Christi; Greenfest, Seth W.; Haeg, G. Claire

    2016-01-01

    While the literature emphasizes the importance of teaching political science students methods skills, there currently exists little guidance for how to assess student learning over the course of their time in the major. To address this gap, we develop a model set of assessment tools that may be adopted and adapted by political science departments…

  11. Development and Assessment of Modules to Integrate Quantitative Skills in Introductory Biology Courses

    Science.gov (United States)

    Hoffman, Kathleen; Leupen, Sarah; Dowell, Kathy; Kephart, Kerrie; Leips, Jeff

    2016-01-01

    Redesigning undergraduate biology courses to integrate quantitative reasoning and skill development is critical to prepare students for careers in modern medicine and scientific research. In this paper, we report on the development, implementation, and assessment of stand-alone modules that integrate quantitative reasoning into introductory biology courses. Modules are designed to improve skills in quantitative numeracy, interpreting data sets using visual tools, and making inferences about biological phenomena using mathematical/statistical models. We also examine demographic/background data that predict student improvement in these skills through exposure to these modules. We carried out pre/postassessment tests across four semesters and used student interviews in one semester to examine how students at different levels approached quantitative problems. We found that students improved in all skills in most semesters, although there was variation in the degree of improvement among skills from semester to semester. One demographic variable, transfer status, stood out as a major predictor of the degree to which students improved (transfer students achieved much lower gains every semester, despite the fact that pretest scores in each focus area were similar between transfer and nontransfer students). We propose that increased exposure to quantitative skill development in biology courses is effective at building competency in quantitative reasoning. PMID:27146161

  12. Opportunity integrated assessment facilitating critical thinking and science process skills measurement on acid base matter

    Science.gov (United States)

    Sari, Anggi Ristiyana Puspita; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

    2017-05-01

    Recognizing the importance of the development of critical thinking and science process skills, the instrument should give attention to the characteristics of chemistry. Therefore, constructing an accurate instrument for measuring those skills is important. However, the integrated instrument assessment is limited in number. The purpose of this study is to validate an integrated assessment instrument for measuring students' critical thinking and science process skills on acid base matter. The development model of the test instrument adapted McIntire model. The sample consisted of 392 second grade high school students in the academic year of 2015/2016 in Yogyakarta. Exploratory Factor Analysis (EFA) was conducted to explore construct validity, whereas content validity was substantiated by Aiken's formula. The result shows that the KMO test is 0.714 which indicates sufficient items for each factor and the Bartlett test is significant (a significance value of less than 0.05). Furthermore, content validity coefficient which is based on 8 experts is obtained at 0.85. The findings support the integrated assessment instrument to measure critical thinking and science process skills on acid base matter.

  13. Assessing the skill of seasonal rainfall outlooks for the Caribbean

    Science.gov (United States)

    Bedward, Shanice; Van Meerbeeck, Cedric

    2013-04-01

    The Caribbean's island and low lying coastal nations make the region highly vulnerable to water-related natural hazards, many originating from seasonal rainfall variability. To help mitigate this risk, Global Producing Centres (GPCs) such as the International Research Institute for Climate and Society (IRI) publish global seasonal rainfall probability forecasts each month. However, the Caribbean's geography warrants the production of downscaled forecasts, such as done by the Caribbean Institute for Meteorology and Hydrology (CIMH). Yet, even CIMH's prediction system, which balances GPC forecasts with regional climatological expertise, is perceived to show limited reliability. To find out to what extent this results from inherently low predictability and what model improvements should be made, we compared the forecasting skills of the IRI and CIMH prediction systems from 2000 to 2012. Specifically, we calculated the commonly used Ranked Probability Skill Score (RPSS) and Heidke Skill Score (HSS) to distinguish which system, season and sub-region are more accurately forecasted. If scores above 0.2 and 0.5 represent good and very good forecasts, respectively, the CIMH prediction system produced ~1/3 good and ~1/10 very good forecasts or ~1.5 times as many as IRI's. The most accurately forecasted season was Jan-Feb-Mar by IRI (~1/3% good or very good forecasts), compared to Sep-Oct-Nov by CIMH (~2/3 good or very good forecasts). By contrast, Apr-May-Jun was less well predicted by both systems. Broken down by sub-region, the Lesser Antilles were best predicted with an average RPSS score of nearly 0.1 by CIMH and 0.05 by IRI whereas less skill was found for the Greater Antilles and Guianas and virtually no skill for Belize in either system. Though consistent with a greater predictability of seasonal rainfall in the Lesser Antilles, such scores point to forecasting accuracy well below a previously estimated 30% inherent predictability. Thus, there is much space for system

  14. Validity of evaluation instrument on the implementation of performance assessment to measure science process skills

    Directory of Open Access Journals (Sweden)

    Marina Ramadani

    2017-10-01

    Full Text Available This study aims to develop an evaluation instrument CIPP (context, input, process, product model that suitable at implementation of performance assessment instrument to measure students' science process skills of junior high school. Methods in this study are research and development (R & D which is adopted by model Borg & Gall model. This evaluation instrument used one of evaluation CIPP model with context, input, process, and product components. The evaluation instrument is used to determine the implementation of performance assessment instrument to measure junior high school students' science process skills in excretion system topic. This development study involves some experts to give validation of the development of feasibility products. Experts involved, they are two lecturers of evaluation expert, two junior high school science teachers, and four peers. The validity of evaluation instruments was analyzed using V'aiken formula. The results of this study are evaluation instrument of CIPP model of the implementation of performance assessment to measure junior high school students' science process skills of grade VIII in excretion system topic. The results of the validity of this product indicates that this evaluation instruments are eligible in using with V'eiken coefficient of 0.86. It indicates that the evaluation instruments are valid in substance, construction, and language aspects.

  15. The predictive skill of species distribution models for plankton in a changing climate

    DEFF Research Database (Denmark)

    Brun, Philipp Georg; Kiørboe, Thomas; Licandro, Priscilla

    2016-01-01

    Statistical species distribution models (SDMs) are increasingly used to project spatial relocations of marine taxa under future climate change scenarios. However, tests of their predictive skill in the real-world are rare. Here, we use data from the Continuous Plankton Recorder program, one...... null models, is essential to assess the robustness of projections of marine planktonic species under climate change...

  16. Comparing the self-assessed and examiner-assessed driving skills of Japanese driving school students

    Directory of Open Access Journals (Sweden)

    Hiroshi Nakai

    2012-03-01

    A sample of Japanese driving test candidates (n=2021 completed a self-assessment using a 5-point scale applied to 19 items. The candidates completed the assessment shortly after passing their practical driving test conducted at a driving school. Their performance was also assessed by an examiner who used the same scale. The comparison between self-assessment and examiner-assessment revealed that around 40% of Japanese driving school students made a realistic assessment of their skills. With regard to the gender differences, although males displayed higher levels of overconfidence than females did, the differences were not as large as earlier studies with questionnaires had suggested. Furthermore, the effect of age on the accuracy of novice drivers' skill assessment was found to be relatively small. Our findings, which are based on a comparison of subjective assessments of driving skills between examiners and novices, instead of a questionable method which relies on a comparison with a hypothetical average driver, suggest that the majority of candidates in fact do not overrate their own skills. These results were discussed from the viewpoint of the driver education system and compared to other European research using the same framework.

  17. Drawing students' attention to relevant assessment criteria: effects on self-assessment skills and performance

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Sluijsmans, Dominique; Van Merriënboer, Jeroen

    2012-01-01

    Fastré, G. M. J., Van der Klink, M. R., Sluijsmans, D., & Van Merriënboer, J. J. G. (2012). Drawing students’ attention to relevant assessment criteria: effects on self-assessment skills and performance. Journal of Vocational Education & Training, 64(2), 185-198. doi:10.1080/13636820.2011.630537

  18. The effects of performance-based assessment criteria on student performance and self-assessment skills

    NARCIS (Netherlands)

    Fastré, Greet; Van der Klink, Marcel; Van Merriënboer, Jeroen

    2010-01-01

    Fastré, G. M. J., Van der Klink, M. R., & Van Merriënboer, J. J. G. (2010). The effects of performance-based assessment criteria on student performance and self-assessment skills. Advances in Health Science Education, 15(4), 517-532.

  19. Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

    Science.gov (United States)

    Muller, Christoph; Elliott, Joshua; Chryssanthacopoulos, James; Arneth, Almut; Balkovic, Juraj; Ciais, Philippe; Deryng, Delphine; Folberth, Christian; Glotter, Michael; Hoek, Steven; hide

    2017-01-01

    Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all

  20. Communication Skills Training in Pediatric Oncology: Moving Beyond Role Modeling

    Science.gov (United States)

    Feraco, Angela M.; Brand, Sarah R.; Mack, Jennifer W.; Kesselheim, Jennifer C.; Block, Susan D.; Wolfe, Joanne

    2018-01-01

    Communication is central to pediatric oncology care. Pediatric oncologists disclose life-threatening diagnoses, explain complicated treatment options, and endeavor to give honest prognoses, to maintain hope, to describe treatment complications, and to support families in difficult circumstances ranging from loss of function and fertility to treatment-related or disease-related death. However, parents, patients, and providers report substantial communication deficits. Poor communication outcomes may stem, in part, from insufficient communication skills training, overreliance on role modeling, and failure to utilize best practices. This review summarizes evidence for existing methods to enhance communication skills and calls for revitalizing communication skills training within pediatric oncology. PMID:26822066

  1. Communication Skills Training in Pediatric Oncology: Moving Beyond Role Modeling.

    Science.gov (United States)

    Feraco, Angela M; Brand, Sarah R; Mack, Jennifer W; Kesselheim, Jennifer C; Block, Susan D; Wolfe, Joanne

    2016-06-01

    Communication is central to pediatric oncology care. Pediatric oncologists disclose life-threatening diagnoses, explain complicated treatment options, and endeavor to give honest prognoses, to maintain hope, to describe treatment complications, and to support families in difficult circumstances ranging from loss of function and fertility to treatment-related or disease-related death. However, parents, patients, and providers report substantial communication deficits. Poor communication outcomes may stem, in part, from insufficient communication skills training, overreliance on role modeling, and failure to utilize best practices. This review summarizes evidence for existing methods to enhance communication skills and calls for revitalizing communication skills training within pediatric oncology. © 2016 Wiley Periodicals, Inc.

  2. Procedural Skills Education – Colonoscopy as a Model

    Directory of Open Access Journals (Sweden)

    Maitreyi Raman

    2008-01-01

    Full Text Available Traditionally, surgical and procedural apprenticeship has been an assumed activity of students, without a formal educational context. With increasing barriers to patient and operating room access such as shorter work week hours for residents, and operating room and endoscopy time at a premium, alternate strategies to maximizing procedural skill development are being considered. Recently, the traditional surgical apprenticeship model has been challenged, with greater emphasis on the need for surgical and procedural skills training to be more transparent and for alternatives to patient-based training to be considered. Colonoscopy performance is a complex psychomotor skill requiring practioners to integrate multiple sensory inputs, and involves higher cortical centres for optimal performance. Colonoscopy skills involve mastery in the cognitive, technical and process domains. In the present review, we propose a model for teaching colonoscopy to the novice trainee based on educational theory.

  3. Objective assessment of laparoscopic skills: dual-task approach.

    Science.gov (United States)

    Meneghetti, Adam T; Pachev, George; Zheng, Bin; Panton, Ormond Neely; Qayumi, Karim

    2012-12-01

    Assessment of surgical performance is often accomplished with traditional methods that often provide only subjective data. Trainees who perform well on a simulator in a controlled environment may not perform well in a real operating room environment with distractions. This project uses the ideas of dual-task methodology and applies them to the assessment of performance of laparoscopic surgical skills. The level of performance on distracting secondary tasks while trying to perform a primary task becomes an indirect but objective measure of the surgical skill of the trainee. Nine surgery residents and 6 experienced laparoscopic surgeons performed 3 primary tasks on a laparoscopic virtual reality simulator (camera position, grasping, and cholecystectomy) while being distracted by 3 secondary tasks (counting beeps, selective responses, and mental arithmetic). Completion time and error rates were recorded for each combination of tasks. When performed separately, time to completion and error rates for primary and secondary tasks were similar for learners and experts. When performing the tasks simultaneously, learners had more errors than experts. Error rates increased for learners when distracting tasks became more difficult or required more attention. Expert surgeons maintained consistent error rates despite the increasing difficulty of task combinations. The use of dual-task methodology may help trainers to identify which surgical trainees require more preparation before entering the real operating room environment. Expert surgeons are capable of maintaining performance levels on a primary task in the face of distractions that may occur in the operating room.

  4. Accuracy of young male drivers’ self-assessments of driving skill

    DEFF Research Database (Denmark)

    Martinussen, Laila Marianne; Møller, Mette; Prato, Carlo Giacomo

    2017-01-01

    Accurate self-assessment of skill is important because it creates an appropriate level of confidence and hence behaviour. Inaccurate self-assessment of driving ability has been linked to reckless driving and accidents. Inaccurate self-assessment of driving skills may be a contributing factor...... to the over-representation of young male drivers in accident statistics. Most previous research on self-assessment of driving skills did not compare self-reported skills to objectively measured driving skills, so the aims of this study were: (1) to test the accuracy of young male drivers’ self-assessments...... of specific driving skills by comparing them with performance in a driving simulator; (2) to test whether self-assessment accuracy varied with driving skill, driving experience and sensation-seeking propensity. We found that young male drivers’ self-assessments were inconsistent with their driving performance...

  5. The Measurement Properties of the Assessing Math Concepts' Assessments of Primary Students' Number Sense Skills.

    Science.gov (United States)

    Martin, Christie; Lambert, Richard; Polly, Drew; Wang, Chuang; Pugalee, David

    The purpose of this study was to examine the measurement properties of the Assessing Math Concepts AMC Anywhere Hiding and Ten Frame Assessments, formative assessments of primary students' number sense skills. Each assessment has two parts, where Part 1 is intended to be foundational skills for part two. Part 1 includes manipulatives whereas Part 2 does not. Student data from 228 kindergarten through second grade teachers with a total of 3,666 students was analyzed using Rasch scaling. Data analyses indicated that when the two assessments were examined separately the intended order of item difficulty was clear. When the parts of both assessments were analyzed together, the items in Part 2 were not consistently more difficult that the items in Part 1. This suggests an alternative sequence of tasks in that students may progress from working with a specific number with manipulatives then without manipulatives rather than working with a variety of numbers with manipulatives before moving onto assessments without manipulatives.

  6. Assessing Change in High School Student Information Literacy Using the Tool for Real-Time Assessment of Information Literacy Skills

    Science.gov (United States)

    Kovalik, Cindy L.; Yutzey, Susan D.; Piazza, Laura M.

    2012-01-01

    Change in high school student information literacy (IL) knowledge and skills, from freshman year to senior year in high school was the focus of this quasi-experimental research project. Researchers used a free information literacy skills assessment tool entitled TRAILS (Tool for Real-time Assessment of Information Literacy Skills) to measure…

  7. Assessment of HIV/AIDS and Life Skills Delivery in Primary Schools in Tanzania

    Science.gov (United States)

    Rushahu, Bernadetha Gabriel

    2015-01-01

    This study was conducted to assess the effectiveness of HIV/AIDS and the Life Skills Education delivery in primary schools in Tanzania. Specifically the study investigated pupils' views about the effect of HIV/AIDS and Life Skills teaching in primary schools in Tanzania; assessed pupils' knowledge related to HIV/AIDS and Life Skills education, and…

  8. Feedforward self-modeling enhances skill acquisition in children learning trampoline skills

    Directory of Open Access Journals (Sweden)

    Diane M. Ste-Marie

    2011-07-01

    Full Text Available The purpose of this research was to examine whether children would benefit from a feedforward self-modeling (FSM video and to explore possible explanatory mechanisms for the potential benefits, using a self-regulation framework. To this end, children were involved in learning two five-skill trampoline routines. For one of the routines, a FSM video was provided during acquisition, whereas only verbal instructions were provided for the alternate routine. The FSM involved editing video footage such that it showed the learner performing the trampoline routine at a higher skill level than their current capability. Analyses of the data showed that while physical performance benefits were observed for the routine that was learned with the FSM video, no differences were obtained in relation to the self-regulatory measures. Thus, the FSM video enhanced motor skill acquisition, but this could not be explained by changes to the varied self-regulatory processes examined.

  9. Assessment of achievement in problem-solving skills in a General Chemistry course

    Directory of Open Access Journals (Sweden)

    Patricia Morales Bueno

    2014-12-01

    Full Text Available This article reports the development and validation study of tests to assess achievements at three levels of knowledge structure, following the model proposed by Sugrue to measure problem-solving skills. This model is particularly consistent with the theoretical constructs underlying problem-based learning (PBL methodology. The tests were constructed for a General Chemistry course in a curriculum of engineering, which implements PBL methodology at a Peruvian university. The content validation of the tests was performed, as well as a pilot implementation with Peruvian students of first year enginnering. The results obtained in omissions percentage, difficulty degree, items response pattern and the point biserial coefficient (rpb, let us to conclude that these are appropiate tools for assessing these skills, so constitute a significant contribution to future research in this line.

  10. Assessing the skills of home care workers in helping older people take their prescribed medications.

    Science.gov (United States)

    Smyth, Elizabeth E J

    2015-08-01

    The Southern Health and Social Care Trust in Northern Ireland applied a modified version of the Objective Structured Clinical Examination (OSCE) to assess the skills of home care workers in assisting older people taking prescribed medications. In Northern Ireland, home care workers are care workers employed by health and social care trusts or private agencies. The application of the model has developed the skills of this staff group, improved the relationship between the commissioner and provider, significantly reduced the time spent by community nurses in individual training and assessment, and enhanced the patient experience for those taking medication. Overall, the application of this model has provided assurances to the Trust board, the executive director of nursing, and operational directors that home care workers are competent in assisting older people in this high-risk activity.

  11. Assessing procedural skills in context: Exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI).

    Science.gov (United States)

    Kneebone, R; Nestel, D; Yadollahi, F; Brown, R; Nolan, C; Durack, J; Brenton, H; Moulton, C; Archer, J; Darzi, A

    2006-11-01

    The assessment of clinical procedural skills has traditionally focused on technical elements alone. However, in real practice, clinicians are expected to be able to integrate technical with communication and other professional skills. We describe an integrated procedural performance instrument (IPPI), where clinicians are assessed on 12 clinical procedures in a simulated clinical setting which combines simulated patients (SPs) with inanimate models or items of medical equipment. Candidates are observed remotely by assessors whose data are fed back to the clinician within 24 hours of the assessment. This paper describes the feasibility of IPPI. A full-scale IPPI and 2 pilot studies with trainee and qualified health care professionals has yielded an extensive data set including 585 scenario evaluations from candidates, 60 from clinical assessors and 31 from simulated patients (SPs). Interview and questionnaire data showed that for the majority of candidates IPPI provided a powerful and valuable learning experience. Realism was rated highly. Remote and real-time assessment worked effectively, although for some procedures limited camera resolution affected observation of fine details. IPPI offers an innovative approach to assessing clinical procedural skills. Although resource-intensive, it has the potential to provide insight into individual's performance over a spectrum of clinical scenarios and at no risk to the safety of patients. Additional benefits of IPPI include assessment in real time from experts (allowing remote rating by external examiners) as well as provision of feedback from simulated patients.

  12. Development of a patient-doctor communication skills model for medical students.

    Science.gov (United States)

    Lee, Young Hee; Lee, Young-Mee

    2010-09-01

    Communication is a core clinical skill that can be taught and learned. The authors intended to develop a patient-doctor communication model for teaching and assessing undergraduate medical students in Korea. To develop a model, literature reviews and an iterative process of discussion between faculty members of a communication skills course for second year medical students were conducted. The authors extracted common communication skill competencies by comparing the Kalamazoo Consensus Statement, SEGUE framework communication skills, the Calgary Cambridge Observation Guides, and previous communication skills lists that have been used by the authors. The content validity, with regard to clinical importance and feasibility, was surveyed by both faculty physicians and students. The first version of the model consisted of 36 items under 7 categories: initiating the session (8 items), building a relationship (6), gathering information (8), understanding a patient's perspectives (4), sharing information (4), reaching an agreement (3), and closing the session (3). It was used as a guide for both students and teachers in an actual communication skills course. At the end of the course, student performance was assessed using two 7-minute standardized patient interviews with a 34-item checklist. This assessment tool was modified from the first version of the model to reflect the case specificity of the scenarios. A patient-doctor communication model, which can be taught to those with limited patient care experience, was finally developed. We recommended a patient-doctor communication skills model that can be used for teaching and evaluating preclinical and clinical students. Further studies are needed to verify its validity and reliability.

  13. Assessment of the forecast skill of spring onset in the NMME experiment

    Science.gov (United States)

    Carrillo, C. M.; Ault, T.

    2017-12-01

    This study assesses the predictability of spring onset using an index of its interannual variability. We use the North American Multi-Model Ensemble (NMME) experiment to assess this predictability. The input dataset to compute spring onset index, SI-x, were treated with a daily joint bias correction (JBC) approach, and the SI-x outputs were post-processed using three ensemble model output statistic (EMOS) approaches—logistic regression, Gaussian Ensemble Dressing, and non-homogeneous Gaussian regression. These EMOS approaches quantify the effect of training period length and ensemble size on forecast skill. The highest range of predictability for the timing spring onset is from 10 to 60 days, and it is located along a narrow band between 35° to 45°N in the US. Using rank probability scores based on quantiles (q), a forecast threshold (q) of 0.5 provides a range of predictability that falls into two categories 10-40 and 40-60 days, which seems to represent the effect of the intra-seasonal scale. Using higher thresholds (q=0.6 and 0.7) predictability shows lower range with values around 10-30 days. The post-processing work using JBC improves the predictability skill by 13% from uncorrected results. Using EMOS, a significant positive change in the skill score is noted in regions where the skill with JBC shows evidence of improvement. The consensus of these techniques shows that regions of better predictability can be expanded.

  14. Norming a VALUE rubric to assess graduate information literacy skills.

    Science.gov (United States)

    Turbow, David J; Evener, Julie

    2016-07-01

    The study evaluated whether a modified version of the information literacy Valid Assessment of Learning in Undergraduate Education (VALUE) rubric would be useful for assessing the information literacy skills of graduate health sciences students. Through facilitated calibration workshops, an interdepartmental six-person team of librarians and faculty engaged in guided discussion about the meaning of the rubric criteria. They applied the rubric to score student work for a peer-review essay assignment in the "Information Literacy for Evidence-Based Practice" course. To determine inter-rater reliability, the raters participated in a follow-up exercise in which they independently applied the rubric to ten samples of work from a research project in the doctor of physical therapy program: the patient case report assignment. For the peer-review essay, a high level of consistency in scoring was achieved for the second workshop, with statistically significant intra-class correlation coefficients above 0.8 for 3 criteria: "Determine the extent of evidence needed," "Use evidence effectively to accomplish a specific purpose," and "Access the needed evidence." Participants concurred that the essay prompt and rubric criteria adequately discriminated the quality of student work for the peer-review essay assignment. When raters independently scored the patient case report assignment, inter-rater agreement was low and statistically insignificant for all rubric criteria (kappa=-0.16, p>0.05-kappa=0.12, p>0.05). While the peer-review essay assignment lent itself well to rubric calibration, scorers had a difficult time with the patient case report. Lack of familiarity among some raters with the specifics of the patient case report assignment and subject matter might have accounted for low inter-rater reliability. When norming, it is important to hold conversations about search strategies and expectations of performance. Overall, the authors found the rubric to be appropriate for

  15. ASSESSMENT OF ARTICLES ON LISTENING SKILL-DİNLEME BECERİSİ ÜZERİNE YAZILAN MAKALELERİN DEĞERLENDİRİLMESİ

    OpenAIRE

    Ömer KEMİKSİZ

    2017-01-01

    One of the basic language skills, listening is the most commonly used skill in daily life as well. Therefore, studies to be conducted for improving this skill are very important. This study aims to assess academic studies on listening skill from various aspects. This study is based on descriptive survey model and analyzes 150 articles published in 67 different journals between 2007-2016 through content analysis method. These articles are analyzed under seven titles being publication year, num...

  16. Role modelling in medical education: the importance of teaching skills.

    Science.gov (United States)

    Burgess, Annette; Oates, Kim; Goulston, Kerry

    2016-04-01

    By observation of role models, and participation in activities, students develop their attitudes, values and professional competencies. Literature suggests that clinical skills and knowledge, personality, and teaching skills are three main areas that students consider central to the identification of positive role models. The aim of this study was to explore junior medical students' opinions of the ideal attributes of a good role model in clinical tutors. The study was conducted with one cohort (n = 301) of students who had completed year 1 of the medical programme in 2013. All students were asked to complete a questionnaire regarding the ideal attributes of a good role model in a clinical tutor. The questionnaire consisted of seven closed items and one open-ended question. The response rate to the questionnaire was 265/301 (88%). Although students found all three key areas important in a good role model, students emphasised the importance of excellence in teaching skills. Specifically, students see good role models as being able to provide a constructive learning environment, a good understanding of the curriculum and an ability to cater to the learning needs of all students. Students see good role models as being able to provide a constructive learning environment While acknowledging the importance of a patient-centred approach, as well as clinical knowledge and skills, our findings reinforce the importance of the actual teaching abilities of role models within medical education. © 2015 John Wiley & Sons Ltd.

  17. Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

    Science.gov (United States)

    Granite, Guinevere; Pugh, Kristy; Chen, Hegang; Longinaker, Nyaradzo; Garofalo, Evan; Shackelford, Stacy; Shalin, Valerie; Puche, Adam; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin

    2018-03-01

    Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

  18. Efficiency of Motivation Development Models for Hygienic Skills

    Directory of Open Access Journals (Sweden)

    Alexander V. Tscymbalystov

    2017-09-01

    Full Text Available The combined influence of a family and a state plays an important role in the development of an individual. This study is aimed at the model effectiveness evaluation concerning the development of oral hygiene skills among children living in families (n = 218 and being under the care of a state (n = 229. The groups were created among the children who took part in the study: the preschoolers of 5-7 years, schoolchildren of 8-11 years and adolescents of 12-15 years. During the initial examination, the hygienic status of the oral cavity before and after tooth brushing was evaluated. After that, subgroups were formed in each age group according to three models of hygienic skills training: 1 computer presentation lesson; 2 one of the students acted as a demonstrator of the skill; 3 an individual training by a hygienist. During the next 48 hours children did not take hygienic measures. Then the children were invited for a control session to demonstrate the acquired skills of oral care and evaluate the effectiveness of a model developing the skills of individual oral hygiene. During the control examination, the hygienic status was determined before and after the tooth cleaning, which allowed to determine the regimes of hygienic measure performance for children with different social status and the effectiveness of hygiene training models.

  19. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality.

    Science.gov (United States)

    Gallagher, A G; Richie, K; McClure, N; McGuigan, J

    2001-11-01

    Objective assessment of psychomotor skills in surgery is now a priority; however, this assessment is difficult to achieve because of measurement difficulties associated with the reliability and validity of assessing surgical skills in vivo and in the laboratory. In this study virtual reality (VR) was used to overcome these problems in the objective psychomotor assessment of senior, junior, and novice laparoscopists. Twelve experienced laparoscopic surgeons (performed >50 Minimal Access Surgery (MAS) procedures), 12 inexperienced laparoscopic surgeons (psychomotor skills for laparoscopic surgery.

  20. MODERN METHODOLOGICAL TOOLS FOR STUDENTS’ LANGUAGE SKILLS SELF-ASSESSMENT

    Directory of Open Access Journals (Sweden)

    A. N. Astanina

    2017-01-01

    Full Text Available Introduction. Nowadays, the problem of standardization of foreign language training at the higher school is becoming currently topical. With regard to the processes of globalization, the international educational projects and students exchange programs gain greater international recognition. Such international programmes involve foreign language knowledge graded as not only high certified academic levels but also as basic language skills. The lack of foreign language competence becomes the obstacle for successful training, depriving a future graduate of a part of chances to become the competitive and popular expert in the chosen profession. The success of a foreign language course completion among students depends on many factors; the most important factor is motivation which can affect self-assessment of training results. The aim of the study is to describe possibilities of the CanDos tools implementation for the organization of students self-consciousness and self-assessment of own achievements in order to influence the motivation for mastering a foreign language.Methodology and research methods. The research is based on competencybased approach. The methods involve comparative analysis, synthesis, and generalization.Results and scientific novelty. The questionnaire developed for the experiment helped to collect the data concerning the effectiveness of the CanDos software implementation for self-assessment of students’ foreign language skills. The corresponding self-assessment helps students to carry out a self-reflection of own knowledge and abilities, and to find “weak points” in language proficiency which need additional practice and improvement. By regularly using CanDos software as self-assessment tools, students learn to identify the correspondence of their language competence to the external requirements and standards of education. Orientation to training results will help future experts to create self-motivation that positively

  1. Osteopathic Manipulative Treatment Technique Scores on the COMLEX-USA Level 2-PE: An Analysis of the Skills Assessed.

    Science.gov (United States)

    Smith, Larissa L; Xu, Wei; Sandella, Jeanne M; Dowling, Dennis J

    2016-06-01

    The National Board of Osteopathic Medical Examiners uses the Osteopathic Manipulative Treatment (OMT) Global Rating Tool to score candidate performance in OMT during standardized patient encounters. To the authors' knowledge, no validity research has been published on the underlying constructs measured by this instrument to date. To evaluate whether the OMT Global Rating Tool measures 1 holistic skill or multiple skill sets. Structural equation models were fit to data from first-time test-takers who took the Comprehensive Osteopathic Medical Licensing Examination-USA Level 2-Performance Evaluation (COMLEX-USA Level 2-PE) between July 7, 2014, and April 30, 2015. Two theoretical models were evaluated: a model that posited a single underlying skill set, and a model that posited 2 related but distinct skill sets. The 1-factor and 2-factor models were fit to data from 4673 third- and fourth-year osteopathic medical students. Fit statistics indicated that the data were best fit by a model representing 2 factors: pre- and post-OMT technique assessment and OMT technique (r=0.47). The OMT Global Rating Tool seems to measure 2 distinct but related skills. Although the results of this study are applicable to broad populations and cannot be used to provide skill-specific subscores, it might be helpful to remediation efforts to target pre- and post-OMT technique assessments and OMT techniques as distinct areas for intervention.

  2. Teacher-made models: the answer for medical skills training in developing countries?

    Science.gov (United States)

    Tran, Trung Q; Scherpbier, Albert; Van Dalen, Jan; Wright, Pamela E

    2012-10-19

    The advantages of using simulators in skills training are generally recognized, but simulators are often too expensive for medical schools in developing countries. Cheaper locally-made models (or part-task trainers) could be the answer, especially when teachers are involved in design and production (teacher-made models, TM). We evaluated the effectiveness of a TM in training and assessing intravenous injection skills in comparison to an available commercial model (CM) in a randomized, blind, pretest-posttest study with 144 undergraduate nursing students. All students were assessed on both the TM and the CM in the pre-test and post-test. After the post-test the students were also assessed while performing the skill on real patients. Differences in the mean scores pre- and post-test were marked in all groups. Training with TM or CM improved student scores substantially but there was no significant difference in mean scores whether students had practiced on TM or CM. Students who practiced on TM performed better on communication with the patient than did students who practiced on CM. Decreasing the ratio of students per TM model helped to increase practice opportunities but did not improve student's mean scores. The result of the assessment on both the TM and the CM had a low correlation with the results of the assessment on real persons. The TM appears to be an effective alternative to CM for training students on basic IV skills, as students showed similar increases in performance scores after training on models that cost considerably less than commercially available models. These models could be produced using locally available materials in most countries, including those with limited resources to invest in medical education and skills laboratories.

  3. Fostering the development of effective person-centered healthcare communication skills: an interprofessional shared learning model.

    Science.gov (United States)

    Cavanaugh, James T; Konrad, Shelley Cohen

    2012-01-01

    To describe the implementation of an interprofessional shared learning model designed to promote the development of person-centered healthcare communication skills. Master of social work (MSW) and doctor of physical therapy (DPT) degree students. The model used evidence-based principles of effective healthcare communication and shared learning methods; it was aligned with student learning outcomes contained in MSW and DPT curricula. Students engaged in 3 learning sessions over 2 days. Sessions involved interactive reflective learning, simulated role-modelpan>ing with peer assessment, and context-specific practice of communication skills. The perspective of patients/clients was included in each learning activity. Activities were evaluated through narrative feedback. Students valued opportunities to learn directly from each other and from healthcare consumers. Important insights and directions for future interprofessional learning experiences were gleaned from model implementation. The interprofessional shared learning model shows promise as an effective method for developing person-centered communication skills.

  4. The Impact of Statistical Adjustment on Conditional Standard Errors of Measurement in the Assessment of Physician Communication Skills

    Science.gov (United States)

    Raymond, Mark R.; Clauser, Brian E.; Furman, Gail E.

    2010-01-01

    The use of standardized patients to assess communication skills is now an essential part of assessing a physician's readiness for practice. To improve the reliability of communication scores, it has become increasingly common in recent years to use statistical models to adjust ratings provided by standardized patients. This study employed ordinary…

  5. Management of Radioactive Spills in Nuclear Medicine; Teaching and Assessing with Objectively Structured Assessment of Technical Skills

    International Nuclear Information System (INIS)

    Hussain, Riffat Parveen

    2015-01-01

    Routine work in nuclear medicine requires the careful elution of radioactivity and its subsequent, storage and handling. Though all effort is maintained to prevent any “spill” of this radioactivity, accidents are bound to happen. The response to this spill is a methodically worked out a plan that is written and adopted as a “standard operating procedure.” This protocol is taught to all involved in the area of working as a mock drill/apprenticeship model. No formal evaluation of learning is in place except for the mock drills. The objectively structured assessment of technical skills (OSATS) is a variation on the Objective Structured Clinical Examination, which is a form of workplace based assessment. The OSATS is cited in the Accreditation Council of Graduate Medical Education evaluation toolbox on the website as the most desirable evaluation tool for the patient care topics. It is the objective of this paper is to introduce the “OSATS” for teaching, and assessment of the learning, of the protocol for the management of radioactive spill. As a review of the literature on the subject failed to reveal any such teaching protocol/material/document for this important technical skill, we hope that it may act as a landmark for the development of teaching and assessment of other technical skills also

  6. A Guttman scale for assessing condom use skills among college students.

    Science.gov (United States)

    Lindemann, Dana F; Brigham, Thomas A

    2003-03-01

    HIV risk-reduction interventions frequently teach correct condom use skills, yet few researchers actually measure those skills. Without measuring condom use skills, it is not possible to evaluate the effectiveness of condom use interventions, or determine what variables may be related to those skills. The Measure of Observed Condom Use Skills (MOCUS) was developed using standard Guttman scaling procedures, and administered to 106 female and 71 male undergraduates. The MOCUS was administered by the primary investigator to each participant individually. Guttman scale analyses demonstrated the MOCUS has acceptable reproducibility. These findings support future use of the MOCUS to assess condom use skills.

  7. Concrete Steps for Assessing the "Soft Skills" in an MBA Program

    Science.gov (United States)

    Ingols, Cynthia; Shapiro, Mary

    2014-01-01

    In 2006, our School of Management began the serious path of assessing both the "hard skills" (such as accounting, finance, and strategy) and the "soft skills" (such as leadership, team work, and ethics) of our MBA Program. The data generated from examining the "soft skills" that we want students to learn within our…

  8. Assessing maths literacy skills in type 1 diabetic children and their ...

    African Journals Online (AJOL)

    Background: It is essential that children have adequate numeracy and literacy skills in order to manage their diabetes effectively. The objective was to undertake a pilot study to assess the level of numeracy skills in type 1 diabetic children and their caregivers, and to ascertain if there was a deficit in these skills.

  9. Analysis of Student Service-Learning Reflections for the Assessment of Transferable-Skills Development

    Science.gov (United States)

    Rizzo, D. M.; Dewoolkar, M.; Hayden, N.; Oka, L.; Pearce, A. R.

    2010-12-01

    The civil and environmental engineering (CEE) programs at the University of Vermont (UVM) incorporate systems thinking and a systems approach to sustainable engineering problem solving. A systems approach considers long-term social, environmental and economic factors within the context of the engineering problem solution and encompasses sustainable engineering solutions. Our goal is to prepare students to become leaders in their chosen field who can anticipate co-products associated with forecasted solutions. As a way of practicing the systems approach, we include service-learning projects in many of our undergraduate engineering courses, culminating with the senior capstone design course. We use a variety of formative and summative assessment methods to gage student understanding and attitudes including student surveys, focus groups, assessment of student projects, and student reflections. Student reflections from two courses -Modeling Environmental and Transportation Systems (31 juniors) and Senior Design Project (30 seniors) are compared. Of these, 25 students were common to both courses. The focus of the systems modeling service-learning project involved mentoring home-schooled children (11-14 yrs old) to solve problems of mobility, using the fun and inspiration of biomimicry. Students were required to invent innovative methods to move people or goods that improve associated constraints (i.e., minimize congestion, reduce pollution, increase safety), or reduce the need for transportation altogether. The capstone design project required a comprehensive engineering design involving two or more CEE sub-disciplines. Both service-learning projects were intended to enhance students’ academic learning experience, attain civic engagement and reinforce transferable skills (written and oral communication, teamwork, leadership and mentoring skills). The student course reflections were not guided; yet they provided valuable data to assess commonalities and differences in

  10. A model for training and evaluation of myringotomy and tube placement skills.

    Science.gov (United States)

    Malekzadeh, Sonya; Hanna, Glenn; Wilson, Brette; Pehlivanova, Marieta; Milmoe, Gregory

    2011-07-01

    Simulation is emerging as a mandatory component of surgical training and a means of demonstrating surgical competency. We designed a cost-effective, low-fidelity model to further acquisition of technical skills related to myringotomy and ventilation tube insertion (M&T). The purpose of the study was to examine the skills trainer as a method of assessment to evaluate competency, timeliness, and procedure confidence in junior residents. Prospective, randomized. A simplistic M&T skills box was developed. General surgery interns (n = 20) with no prior procedure training were randomized to receive either didactic instruction or skills training using the model. One hour of lecture or technical skills training was provided to each group. A blinded examiner evaluated the subjects in both groups before and after training. Performance was measured using a global rating scale, task-specific checklist, and time-to-completion. Pre- and postsession questionnaires assessed procedure confidence. Analysis revealed a trend toward improvement in global rating scores between groups. There was a statistically significant difference in time improvement between groups (P = .0211). The skills lab group felt they could perform the procedure faster and with improved abilities, as compared to the didactic group (P = .0069 and 0.0007, respectively). Junior surgical residents performed an M&T procedure using a novel, low-cost model. This study demonstrated the skills lab's positive effect on training as measured by global rating scale, time-to-completion, and overall resident confidence. We anticipate its application to be valuable not only in training residents but also in assessing competency. Copyright © 2011 The American Laryngological, Rhinological, and Otological Society, Inc.

  11. A comparison of students' self-assessments with faculty evaluations of their communication skills.

    Science.gov (United States)

    Lundquist, Lisa M; Shogbon, Angela O; Momary, Kathryn M; Rogers, Hannah K

    2013-05-13

    To compare students' self-assessment of their communication skills with faculty members' formal evaluation of their skills in a therapeutics course. Over a 3-year period, faculty members evaluated second-year pharmacy students' communication skills as part of a requirement in a therapeutics course. Immediately following an individual oral assessment and again following a group oral assessment, students self-assessed their communication skills using the same rubric the faculty members had used. Students' self-assessments were then compared with faculty members' evaluation of students' communication skills. Four hundred one (97.3%) students consented to participate in this study. Faculty evaluation scores of students for both the individual and group oral assessments were significantly higher than students' self-assessment scores. Students' self-assessment scores of their communication skills increased from the individual to the group oral assessment. Students' self-assessments of communication skills were consistently lower than faculty members' evaluations. Greater use of oral assessments throughout the pharmacy curriculum may help to improve students' confidence in and self-assessment of their communication skills.

  12. Social Skills Assessment and Intervention Review and Recommendations for School Practitioners

    Science.gov (United States)

    Luiselli, James K.; McCarty, Joseph; Coniglio, Jennifer; Zorilla-Ramirez, Claudia; Putnam, Robert F.

    2005-01-01

    We present a "practitioner's guide" to social skills assessment and intervention with students attending public schools. Important characteristics of assessment instruments are discussed, including psychometric properties and strategies applicable to school settings. We then review several social skills assessment protocols and rating scales that…

  13. Enhancing Students' Communication Skills through Treffinger Teaching Model

    Science.gov (United States)

    Alhaddad, Idrus; Kusumah, Yaya S.; Sabandar, Jozua; Dahlan, Jarnawi A.

    2015-01-01

    This research aims to investigate, compare, and describe the achievement and enhancement of students' mathematical communication skills (MCS). It based on the prior mathematical knowledge (PMK) category (high, medium and low) by using Treffinger models (TM) and conventional learning (CL). This research is an experimental study with the population…

  14. The Flipped Classroom Model: When Technology Enhances Professional Skills

    Science.gov (United States)

    Baytiyeh, Hoda

    2017-01-01

    Purpose: The purpose of this paper is to investigate the effectiveness of the flipped classroom model in teaching and learning as well as the skills that can be acquired by students after being exposed to this learning style. Design/methodology/approach: This paper uses a qualitative case study design. In total, 20 students, from various majors,…

  15. Mentoring Model for Lecturers' Research Skills Development: Case ...

    African Journals Online (AJOL)

    The informal group mentoring model for research skills development begins with desk research for qualities of a publishable paper. Five dummy papers were reviewed by participants for quality. Participants conducted new studies and wrote research articles. These articles were peer reviewed by participants and submitted ...

  16. Skills of different mesoscale models over Indian region during ...

    Indian Academy of Sciences (India)

    Home; Journals; Journal of Earth System Science; Volume 117; Issue 5. Skills of different mesoscale models over Indian region during monsoon season: Forecast errors. Someshwar Das Raghavendra Ashrit Gopal Raman Iyengar Saji Mohandas M Das Gupta John P George E N Rajagopal Surya Kanti Dutta. Volume 117 ...

  17. Production compilation : A simple mechanism to model complex skill acquisition

    NARCIS (Netherlands)

    Taatgen, N.A.; Lee, F.J.

    2003-01-01

    In this article we describe production compilation, a mechanism for modeling skill acquisition. Production compilation has been developed within the ACT-Rational (ACT-R; J. R. Anderson, D. Bothell, M. D. Byrne, & C. Lebiere, 2002) cognitive architecture and consists of combining and specializing

  18. An Econometric Model of the Low-Skill Labor Market

    Science.gov (United States)

    Crandall, Robert W.; And Others

    1975-01-01

    The model describes the demand and supply of low-skill labor (private household workers, other service workers, and nonfarm laborers) by State, based on the March 1970 Current Population Survey for 43 States and groups of States by a simultaneous-equations method. (Author/EA)

  19. Video Modeling and Prompting in Practice: Teaching Cooking Skills

    Science.gov (United States)

    Kellems, Ryan O.; Mourra, Kjerstin; Morgan, Robert L.; Riesen, Tim; Glasgow, Malinda; Huddleston, Robin

    2016-01-01

    This article discusses the creation of video modeling (VM) and video prompting (VP) interventions for teaching novel multi-step tasks to individuals with disabilities. This article reviews factors to consider when selecting skills to teach, and students for whom VM/VP may be successful, as well as the difference between VM and VP and circumstances…

  20. Assessing problem-solving skills in construction education with the virtual construction simulator

    Science.gov (United States)

    Castronovo, Fadi

    problem-solving skills, a new version of the VCS(4) was developed, with new building modules and assessment framework. The design and development of the VCS4 leveraged research in educational psychology, multimedia learning, human-computer interaction, and Building Information Modeling. In this dissertation the researcher aimed to evaluate the pedagogical value of the VCS4 in fostering problem-solving skills. To answer the research questions, a crossover repeated measures quasi-experiment was designed to assess the educational gains that the VCS can provide to construction education. A group of 34 students, attending a fourth-year construction course at a university in the United States was chosen to participate in the experiment. The three learning modules of the VCS were used, which challenged the students to plan and manage the construction process of a wooden pavilion, the steel erection of a dormitory, and the concrete placement of the same dormitory. Based on the results the researcher was able to provide evidence supporting the hypothesis that the chosen sample of construction students were able to gain and retain problem-solving skills necessary to solve complex construction simulation problems, no matter what the sequence with which these modules were played. In conclusion, the presented results provide evidence supporting the theory that educational simulation games can help the learning and retention of transferable problem-solving skills, which are necessary to solve complex construction problems.

  1. Development and Assessment of Modules to Integrate Quantitative Skills in Introductory Biology Courses.

    Science.gov (United States)

    Hoffman, Kathleen; Leupen, Sarah; Dowell, Kathy; Kephart, Kerrie; Leips, Jeff

    2016-01-01

    Redesigning undergraduate biology courses to integrate quantitative reasoning and skill development is critical to prepare students for careers in modern medicine and scientific research. In this paper, we report on the development, implementation, and assessment of stand-alone modules that integrate quantitative reasoning into introductory biology courses. Modules are designed to improve skills in quantitative numeracy, interpreting data sets using visual tools, and making inferences about biological phenomena using mathematical/statistical models. We also examine demographic/background data that predict student improvement in these skills through exposure to these modules. We carried out pre/postassessment tests across four semesters and used student interviews in one semester to examine how students at different levels approached quantitative problems. We found that students improved in all skills in most semesters, although there was variation in the degree of improvement among skills from semester to semester. One demographic variable, transfer status, stood out as a major predictor of the degree to which students improved (transfer students achieved much lower gains every semester, despite the fact that pretest scores in each focus area were similar between transfer and nontransfer students). We propose that increased exposure to quantitative skill development in biology courses is effective at building competency in quantitative reasoning. © 2016 K. Hoffman, S. Leupen, et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

  2. Examining the Relationship between Middle School Students' Critical Reading Skills, Science Literacy Skills and Attitudes: A Structural Equation Modeling

    Science.gov (United States)

    Karademir, Ersin; Ulucinar, Ufuk

    2017-01-01

    The purpose of this study is to verify the causal relationship between middle school students' critical reading skills, science literacy skills and attitudes towards science literacy with research data according to the default model. Through the structural equation modeling, path analysis has been applied in the study which was designed in…

  3. The development of an integrated assessment instrument for measuring analytical thinking and science process skills

    Science.gov (United States)

    Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

    2017-05-01

    This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

  4. THE EFFECT OF INQUIRY TRAINING MODEL USE THE MEDIA PHET AGAINST SCIENCE PROCESS SKILLS AND LOGICAL THINKING SKILLS STUDENTS

    Directory of Open Access Journals (Sweden)

    Fajrul Wahdi Ginting

    2015-12-01

    Full Text Available The Purpose of The study: science process skills and logical thinking ability of students who use inquiry learning model training using PhET media; science process skills and logical thinking ability of students who use conventional learning model; and the difference science process skills and logical thinking ability of students to use learning model Inquiry Training using PhET media and conventional learning models. This research is a quasi experimental. Sample selection is done by cluster random sampling are two classes of classes VIII-E and class VIII-B, where the class VIII-E is taught by inquiry training model using media PhET and VIII-B with conventional learning model. The instrument used consisted of tests science process skills such as essay tests and tests of the ability to think logically in the form of multiple-choice tests. The data were analyzed using t test. The results showed that physics science process skills use Inquiry Training models using PhET media is different and showed better results compared with conventional learning model, and logical thinking skills students use Inquiry Training model using PhET media is different and show better results compared with conventional learning, and there is a difference between the ability to think logically and science process skills of students who use Inquiry Training model using PhET media and conventional learning models.

  5. Enhancing Student Communication Skills Through Arabic Language Competency and Simulated Patient Assessments.

    Science.gov (United States)

    Hasan, Sanah; Tarazi, Hamadeh M Khier; Halim Hilal, Dana Abdel

    2017-05-01

    Objective. To assess student communication and patient management skill with introduction of Arabic and use of simulated patient assessments to a communication and counseling course. Design. Five, 3-hour tutorials (clinical skill laboratory) were added to the course covering: listening and empathic responding, non-verbal communications, interviewing skills, assertiveness, counseling in special situations: conflict, anger, worry or rushed situations, and professional decision making. Arabic content was introduced to the course to enhance Arabic communications and competence among students. Simulated patient assessment was used to evaluate student skills. Students' feedback about course changes was evaluated. Assessment. The course now covers a wider content and Arabic language. Students' scores were similar in the assessment and other assessments within the course and between Arabic and English groups. Students favorably rated the changes in the course and provided constructive feedback on content usefulness and adequacy. Conclusion. Expanding the course to include Arabic language and content and simulated patient assessments enhanced student communication skills.

  6. An Assessment of Motor Music Skill Development in Young Children.

    Science.gov (United States)

    Gilbert, Janet

    1980-01-01

    The Motoric Music Skills Test was administered to 808 children, ages three to six, from seven Kansas communities. Analysis of descriptive and inferential data indicate that the measured skills increase with age and differ by sex. Race, community size, and previous musical instrument experience were not significantly related to test performance.…

  7. Developing Critical Thinking Skills: Assessing the Effectiveness of Workbook Exercises

    Science.gov (United States)

    Wallace, Elise D.; Jefferson, Renee N.

    2015-01-01

    To address the challenge of developing critical thinking skills in college students, this empirical study examines the effectiveness of cognitive exercises in developing those skills. The study uses Critical Thinking: Building the Basics by Walter, Knudsvig, and Smith (2003). This workbook is specifically designed to exercise and develop critical…

  8. Teaching and Assessing Study Skills: A Classroom Study.

    Science.gov (United States)

    Oakerson, Peggy Fast

    A study skills course was evaluated for effects on results from the Learning and Study Strategies Inventory (LASSI) (D. Mealy, 1988). Subjects were students in a freshman level college study skills course. At pretest, there were 29 students in the treatment condition, and by the post-test 25 students remained. In a followup telephone survey, 21…

  9. Assessment Of Information Literacy Skills Among Librarians In Delta ...

    African Journals Online (AJOL)

    The paper surveys the information literacy skills among librarians in Delta State University, Abraka. The study is intended to explore the information literacy skills of the librarians in this era of electronic librarianship. Questionnaire and observation techniques were used to gather data. A total of 30 librarians made up of ...

  10. Development of a virtual reality assessment of everyday living skills.

    Science.gov (United States)

    Ruse, Stacy A; Davis, Vicki G; Atkins, Alexandra S; Krishnan, K Ranga R; Fox, Kolleen H; Harvey, Philip D; Keefe, Richard S E

    2014-04-23

    Cognitive impairments affect the majority of patients with schizophrenia and these impairments predict poor long term psychosocial outcomes.  Treatment studies aimed at cognitive impairment in patients with schizophrenia not only require demonstration of improvements on cognitive tests, but also evidence that any cognitive changes lead to clinically meaningful improvements.  Measures of "functional capacity" index the extent to which individuals have the potential to perform skills required for real world functioning.  Current data do not support the recommendation of any single instrument for measurement of functional capacity.  The Virtual Reality Functional Capacity Assessment Tool (VRFCAT) is a novel, interactive gaming based measure of functional capacity that uses a realistic simulated environment to recreate routine activities of daily living. Studies are currently underway to evaluate and establish the VRFCAT's sensitivity, reliability, validity, and practicality. This new measure of functional capacity is practical, relevant, easy to use, and has several features that improve validity and sensitivity of measurement of function in clinical trials of patients with CNS disorders.

  11. ASSESSMENT OF PHYSICAL SKILLS TO THE STUDENT FITNESS INDEX

    Directory of Open Access Journals (Sweden)

    Ratko Pavlović

    2011-09-01

    Full Text Available A very common way of assessing the state of physical abilities is to determine on the basis of diagnostic tests, and they give us the necessary information when it comes to general skills defined population. This evaluation is usually performed diagnostic tests in the laboratory. However, reliable data are available on the performance of some field tests. Depending on field conditions, very often is done using estimates of general ability test, 2km walking UKK. To perform this test shall include data on body height, weight, BMI-in, values, heart rate, time walking. Based on the formula and application of these data are obtained fitness value of the index by which to define the overall physical condition of patients. Also based on the formula to obtain indicators on maximum oxygen consumption. The study comprised third-year students East Sarajevo, who held classes in subjects walking sports athletics, in order to determine their state of physical fitness index based on fitness.

  12. Assessment and Comparison of Tourism Vocabulary Skills in ESL Learners

    Directory of Open Access Journals (Sweden)

    Pokupec Martina

    2017-06-01

    Full Text Available Teaching and learning English for professional purposes largely involves the acquisition of specialised vocabulary, with teaching methodology focusing on the development of understanding and usage of specific vocabulary items. Within the wide variety of professional purposes the language is acquired for, teaching learners of tourism and hospitality also requires a focus on a range of specific language skills, mostly based on understanding of diverse types of discourse and strong communication skills in varied language situations and contexts. English for professional purposes thus becomes more specific - English for Tourism and Hospitality - signalling a slightly different approach to teaching and learning, i.e. not heavily based on acquiring vocabulary skills, but shifting focus on strong communication skills and enhancement of the four elementary language skills: reading, writing, listening and speaking.

  13. Effectiveness of Video Modeling Provided by Mothers in Teaching Play Skills to Children with Autism

    Science.gov (United States)

    Besler, Fatma; Kurt, Onur

    2016-01-01

    Video modeling is an evidence-based practice that can be used to provide instruction to individuals with autism. Studies show that this instructional practice is effective in teaching many types of skills such as self-help skills, social skills, and academic skills. However, in previous studies, videos used in the video modeling process were…

  14. Medical and psychology students' self-assessed communication skills: A pilot study.

    Science.gov (United States)

    Tiuraniemi, Juhani; Läärä, Riitta; Kyrö, Tuuli; Lindeman, Sari

    2011-05-01

    The purpose of this study was to describe how psychology and medical students assess their own competency and skills before and after training, in which role-play was used to teach interpersonal and communication skills. Interpersonal and communication skills were assessed with a semi-structured questionnaire before and after the training. The students of both medicine and psychology estimated their skill levels to be higher after the course. The psychology students estimated their skills for communication, motivating interviewing, empathy and reflection, and change orientation to be better at the end of the course. Medical students estimated their communication skills, motivating interviewing skills, and change orientation skills to be better at the end of the course. Even a short period of training in interpersonal and communication skills can positively affect the self-assessed skills of the medical students. In the future, it would be worthwhile to pay attention to reflective teaching practices in the training of both medical and psychology students. The cognitive and emotional components of these practices help students to develop their own communication skills. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

  15. Fuzzy Logic as a Tool for Assessing Students’ Knowledge and Skills

    Directory of Open Access Journals (Sweden)

    Michael Gr. Voskoglou

    2013-05-01

    Full Text Available Fuzzy logic, which is based on fuzzy sets theory introduced by Zadeh in 1965, provides a rich and meaningful addition to standard logic. The applications which may be generated from or adapted to fuzzy logic are wide-ranging and provide the opportunity for modeling under conditions which are imprecisely defined. In this article we develop a fuzzy model for assessing student groups’ knowledge and skills. In this model the students’ characteristics under assessment (knowledge of the subject matter, problem solving skills and analogical reasoning abilities are represented as fuzzy subsets of a set of linguistic labels characterizing their performance, and the possibilities of all student profiles are calculated. In this way, a detailed quantitative/qualitative study of the students’ group performance is obtained. The centroid method and the group’s total possibilistic uncertainty are used as defuzzification methods in converting our fuzzy outputs to a crisp number. According to the centroid method, the coordinates of the center of gravity of the graph of the membership function involved provide a measure of the students’ performance. Techniques of assessing the individual students’ abilities are also studied and examples are presented to illustrate the use of our results in practice.

  16. The development and validation of a golf swing and putt skill assessment for children.

    Science.gov (United States)

    Barnett, Lisa M; Hardy, Louise L; Brian, Ali S; Robertson, Sam

    2015-03-01

    The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument's discriminative validity in terms of age and reliability (intra-rater and re-test). A Delphi consultation (with golf industry professionals and researchers in movement skill assessment) was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24). Children (n = 43) aged 6-10 years (M = 7.8 years, SD = 1.3) were assessed in both skills live in the field by one rater at Time 1(T1). A subset of children (n = 28) had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3). An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years). Intraclass correlations (ICC) assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3). Paired t-tests assessed any systematic differences between live and video assessments (T1) and between T2 and T3. Older children were more skilled (F (2, 40) = 11.18, p mastery level, and talent identification in beginner young golf players.Process rather than product oriented outcomes better identify areas of skill deficit in young children.The proposed swing and putt instrument can reliably identify skill deficits in children of elementary school age who are new to golf and can be used by a range of stakeholders including golf coaches, generalist sport coaches and physical education teachers.

  17. Construct validation of teacher portfolio assessment : Procedures for improving teacher competence assessment illustrated by teaching students research skills

    NARCIS (Netherlands)

    Schaaf, M.F. van der

    2005-01-01

    The study aims to design and test procedures for teacher portfolio assessments. What are suitable procedures to assess teachers' competencies in developing students' research skills? We first searched into the tasks teachers have in teaching students research skills and the competencies needed to

  18. Establishing the concurrent validity of general and technique-specific skills assessments in surgical education.

    Science.gov (United States)

    Steigerwald, Sarah N; Park, Jason; Hardy, Krista M; Gillman, Lawrence; Vergis, Ashley S

    2016-01-01

    Laparoscopic surgery entails a unique skill set, but it is unclear whether it requires a specific assessment form or whether more general assessment tools can be applied. The purpose of this study was to assess the concurrent validity of 2 previously validated assessment scales. One scale designed specifically to assess laparoscopic skills and the other to assess more general surgical skills. Postgraduate year 1-6 general surgery and urology residents (n = 33) performed a live laparoscopic cholecystectomy. Three surgeon raters scored their performance using previously validated objective structured assessment of technical skills (OSATS) and global operative assessment of laparoscopic skills rating scales. Pearson's correlation coefficient between global operative assessment of laparoscopic skills and OSATS rating scales was .975 (P = .01). The near total correlation between the 2 scales questions the need for separate laparoscopic assessment tools, highlighting the real strengths of OSATS, the use of which allows for more consistent nomenclature and standardized skills assessment across surgical platforms. Copyright © 2016 Elsevier Inc. All rights reserved.

  19. Clinical skills temporal degradation assessment in undergraduate medical education.

    Science.gov (United States)

    Fisher, Joseph; Viscusi, Rebecca; Ratesic, Adam; Johnstone, Cameron; Kelley, Ross; Tegethoff, Angela M; Bates, Jessica; Situ-Lacasse, Elaine H; Adamas-Rappaport, William J; Amini, Richard

    2018-01-01

    Medical students' ability to learn clinical procedures and competently apply these skills is an essential component of medical education. Complex skills with limited opportunity for practice have been shown to degrade without continued refresher training. To our knowledge there is no evidence that objectively evaluates temporal degradation of clinical skills in undergraduate medical education. The purpose of this study was to evaluate temporal retention of clinical skills among third year medical students. This was a cross-sectional study conducted at four separate time intervals in the cadaver laboratory at a public medical school. Forty-five novice third year medical students were evaluated for retention of skills in the following three procedures: pigtail thoracostomy, femoral line placement, and endotracheal intubation. Prior to the start of third-year medical clerkships, medical students participated in a two-hour didactic session designed to teach clinically relevant materials including the procedures. Prior to the start of their respective surgery clerkships, students were asked to perform the same three procedures and were evaluated by trained emergency medicine and surgery faculty for retention rates, using three validated checklists. Students were then reassessed at six week intervals in four separate groups based on the start date of their respective surgical clerkships. We compared the evaluation results between students tested one week after training and those tested at three later dates for statistically significant differences in score distribution using a one-tailed Wilcoxon Mann-Whitney U-test for non-parametric rank-sum analysis. Retention rates were shown to have a statistically significant decline between six and 12 weeks for all three procedural skills. In the instruction of medical students, skill degradation should be considered when teaching complex technical skills. Based on the statistically significant decline in procedural skills noted

  20. Clinical skills temporal degradation assessment in undergraduate medical education

    Directory of Open Access Journals (Sweden)

    JOSEPH FISHER

    2018-01-01

    Full Text Available Introduction: Medical students’ ability to learn clinical procedures and competently apply these skills is an essential component of medical education. Complex skills with limited opportunity for practice have been shown to degrade without continued refresher training. To our knowledge there is no evidence that objectively evaluates temporal degradation of clinical skills in undergraduate medical education. The purpose of this study was to evaluate temporal retention of clinical skills among third year medical students. Methods: This was a cross-sectional study conducted at four separate time intervals in the cadaver laboratory at a public medical school. Forty-five novice third year medical students were evaluated for retention of skills in the following three procedures: pigtail thoracostomy, femoral line placement, and endotracheal intubation. Prior to the start of third-year medical clerkships, medical students participated in a two-hour didactic session designed to teach clinically relevant materials including the procedures. Prior to the start of their respective surgery clerkships, students were asked to perform the same three procedures and were evaluated by trained emergency medicine and surgery faculty for retention rates, using three validated checklists. Students were then reassessed at six week intervals in four separate groups based on the start date of their respective surgical clerkships. We compared the evaluation results between students tested one week after training and those tested at three later dates for statistically significant differences in score distribution using a one-tailed Wilcoxon Mann-Whitney U-test for non-parametric rank-sum analysis. Results: Retention rates were shown to have a statistically significant decline between six and 12 weeks for all three procedural skills. Conclusion: In the instruction of medical students, skill degradation should be considered when teaching complex technical skills. Based on

  1. A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

    Science.gov (United States)

    Winkel, Abigail Ford; Lerner, Veronica; Zabar, Sondra R; Szyld, Demian

    2013-01-01

    Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  2. Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator

    DEFF Research Database (Denmark)

    Larsen, C R; Grantcharov, Teodor; Aggarwal, R

    2006-01-01

    Safe realistic training and unbiased quantitative assessment of technical skills are required for laparoscopy. Virtual reality (VR) simulators may be useful tools for training and assessing basic and advanced surgical skills and procedures. This study aimed to investigate the construct validity o...

  3. The Impact of Adaptive Complex Assessment on the HOT Skill Development of Students

    Science.gov (United States)

    Raiyn, Jamal; Tilchin, Oleg

    2016-01-01

    In this paper we propose a method for the adaptive complex assessment (ACA) of the higher-order thinking (HOT) skills needed by students for problem solving, and we examine the impact of the method on the development of HOT skills in a problem-based learning (PBL) environment. Complexity in the assessment is provided by initial, formative, and…

  4. Social Skills Differences among Attention-Deficit/Hyperactivity Disorder Types in a Chat Room Assessment Task

    Science.gov (United States)

    Mikami, Amori Yee; Huang-Pollock, Cynthia L.; Pfiffner, Linda J.; McBurnett, Keith; Hangai, Dana

    2007-01-01

    This study assessed social skills in 116 children aged 7-12 with ADHD-Combined Type (ADHD-C; n=33), ADHD-Inattentive Type (ADHD-I; n=45), and comparison children (n=38), with consideration of the role sluggish cognitive tempo (SCT) symptoms play in distinguishing profiles. Social skills were assessed using a novel computerized chat room task, in…

  5. Reliable assessment of general surgeons' non-technical skills based on video-recordings of patient simulated scenarios

    DEFF Research Database (Denmark)

    Spanager, Lene; Beier-Holgersen, Randi; Dieckmann, Peter

    2013-01-01

    Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training.......Nontechnical skills are essential for safe and efficient surgery. The aim of this study was to evaluate the reliability of an assessment tool for surgeons' nontechnical skills, Non-Technical Skills for Surgeons dk (NOTSSdk), and the effect of rater training....

  6. Developing thinking skill system for modelling creative thinking and critical thinking of vocational high school student

    Science.gov (United States)

    Dewanto, W. K.; Agustianto, K.; Sari, B. E.

    2018-01-01

    Vocational students must have practical skills in accordance with the purpose of vocational school that creating the skilled graduates according to their field. Graduates of vocational education are required not just as users, but be able to create. Thus requiring critical and creative thinking skills to assist students in generating ideas, analyzing and creating a product of value. Based on this, then this research aims to develop a system to know the level of ability to think critically and creative students, that resulted students can do self-reflection in improving the ability to think critically and creatively as a supporter of practical ability. The system testing using Naïve Bayes Correlation shown an average accuracy of 93.617% in assessing the students’ critical and creative thinking ability. By using modeling with this system will be known level of students’ critical and creative thinking ability, then the output of the system is used to determine the type of innovation in the learning process to improve the critical and creative thinking skills to support the practical skills of students as skilled vocational students.

  7. Self-assessment and goal-setting is associated with an improvement in interviewing skills.

    Science.gov (United States)

    Hanley, Kathleen; Zabar, Sondra; Charap, Joseph; Nicholson, Joseph; Disney, Lindsey; Kalet, Adina; Gillespie, Colleen

    2014-01-01

    Describe the relationship between medical students' self-assessment and goal-setting (SAGS) skills and development of interviewing skills during the first-year doctoring course. 157 first-year medical students completed three two-case standardized patient (SP) interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. SAGS improved over time (37% good week 1 vs. 61% good week 10). Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills - those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024). For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1-10 and then increased significantly at week 17. For those whose SAGS remained 'poor' in weeks 1-10, interviewing skills declined in weeks 10-17. In general, the quality of students' SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  8. Self-assessment and goal-setting is associated with an improvement in interviewing skills

    Directory of Open Access Journals (Sweden)

    Kathleen Hanley

    2014-07-01

    Full Text Available Purpose: Describe the relationship between medical students’ self-assessment and goal-setting (SAGS skills and development of interviewing skills during the first-year doctoring course. Method: 157 first-year medical students completed three two-case standardized patient (SP interviews. After each of the first two, students viewed videotapes of their interview, completed a SAGS worksheet, and reviewed a selected tape segment in a seminar. SAGS was categorized into good and poor quality and interviewing skills were rated by trained raters. Results: SAGS improved over time (37% good week 1 vs. 61% good week 10. Baseline SAGS and interviewing skills were not associated. Initial SAGS quality was associated with change in interviewing skills – those with poor-quality SAGS demonstrated a decrease and those with good-quality SAGS demonstrated an increase in scores by 17 weeks (ANOVA F=4.16, p=0.024. For students whose SAGS skills were good at both week 1 and 10, interviewing skills declined in weeks 1–10 and then increased significantly at week 17. For those whose SAGS remained ‘poor’ in weeks 1–10, interviewing skills declined in weeks 10–17. Conclusions: In general, the quality of students’ SAGS improved over time. Poor baseline SAGS skills and failure to improve were associated with a decrease in interviewing skills at 17 weeks. For students with better SAGS, interviewing skills increased at week 17. Improvement in SAGS skills was not associated with improved interviewing skills. Understanding structured self-assessment skills helps identify student characteristics that influence progressive mastery of communication skills and therefore may inform curriculum and remediation tailoring.

  9. How Is Building Lego Models Related to Math Skills?

    OpenAIRE

    Murti, Swiya; Szucs, Denes

    2017-01-01

    Math is usually taught using a lot of words. But, is this the way the human brain learns math? We studied how math is related to memory, intelligence, and reading in 7-year-old children. We found that memory for visual information (things you can see) and spatial information (where things are located in relationship to each other) is related to math skills more than memory for words and verbal information. Interestingly, previous studies have found that building Lego models (construction play...

  10. Trade and Technical. Volume II. Access Skills. Vocational Readiness Skills. Missouri LINC. Assessing Vocational Education.

    Science.gov (United States)

    Missouri Univ., Columbia. Dept. of Practical Arts and Vocational-Technical Education.

    This document contains trade and industrial occupations-related materials to help teachers and parents teach access skills to Missouri junior high and high school special needs students who want to pursue a vocational program in auto body repair, auto mechanics, building maintenance and custodial work, diesel mechanics, machinist, small engine…

  11. Trade and Technical Volumes I: Access Skills. Vocational Readiness Skills. Missouri LINC. Assessing Vocational Education.

    Science.gov (United States)

    Missouri Univ., Columbia. Dept. of Practical Arts and Vocational-Technical Education.

    This document contains trade and industrial occupations-related materials to help teachers and parents teach access skills to Missouri junior high and high school special needs students who want to pursue a vocational program in carpentry; commercial art; drafting; electronics; heating, air conditioning, and refrigeration; or offset lithography…

  12. Assessing the Development of Medical Students' Personal and Professional Skills by Portfolio.

    Science.gov (United States)

    Yielder, Jill; Moir, Fiona

    2016-01-01

    The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program.

  13. Assessing the Development of Medical Students’ Personal and Professional Skills by Portfolio

    Directory of Open Access Journals (Sweden)

    Jill Yielder

    2016-01-01

    Full Text Available The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program.

  14. Assessing the Development of Medical Students’ Personal and Professional Skills by Portfolio

    Science.gov (United States)

    Yielder, Jill; Moir, Fiona

    2016-01-01

    The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the challenges, strengths, and limitations of the approach within the context of the current literature. We then outline a cyclical model of evaluation used to monitor and fine-tune the portfolio tasks and implementation process, in response to student and assessor feedback. The portfolios have illustrated the level of insight, maturity, and synthesis of personal and professional qualities that students are capable of achieving. The Auckland medical program strives to foster these qualities in its students, and the portfolio provides an opportunity for students to demonstrate their reflective abilities. Moreover, the creation of a Personal and Professional Skills domain with the portfolio as its key assessment emphasizes the importance of reflective practice and personal and professional development and gives a clear message that these are fundamental longitudinal elements of the program. PMID:29349315

  15. Are general surgeons able to accurately self-assess their level of technical skills?

    Science.gov (United States)

    Rizan, C; Ansell, J; Tilston, T W; Warren, N; Torkington, J

    2015-11-01

    Self-assessment is a way of improving technical capabilities without the need for trainer feedback. It can identify areas for improvement and promote professional medical development. The aim of this review was to identify whether self-assessment is an accurate form of technical skills appraisal in general surgery. The PubMed, MEDLINE(®), Embase(™) and Cochrane databases were searched for studies assessing the reliability of self-assessment of technical skills in general surgery. For each study, we recorded the skills assessed and the evaluation methods used. Common endpoints between studies were compared to provide recommendations based on the levels of evidence. Twelve studies met the inclusion criteria from 22,292 initial papers. There was no level 1 evidence published. All papers compared the correlation between self-appraisal versus an expert score but differed in the technical skills assessment and the evaluation tools used. The accuracy of self-assessment improved with increasing experience (level 2 recommendation), age (level 3 recommendation) and the use of video playback (level 3 recommendation). Accuracy was reduced by stressful learning environments (level 2 recommendation), lack of familiarity with assessment tools (level 3 recommendation) and in advanced surgical procedures (level 3 recommendation). Evidence exists to support the reliability of self-assessment of technical skills in general surgery. Several variables have been shown to affect the accuracy of self-assessment of technical skills. Future work should focus on evaluating the reliability of self-assessment during live operating procedures.

  16. Framework of Assessment for the Evaluation of Thinking Skills of Tertiary Level Students

    Directory of Open Access Journals (Sweden)

    Chan Swee Heng

    2015-10-01

    Full Text Available In the 21st century, students are required to master thinking skills in order to deal with many situations that arise in the tertiary environment which later would translate into the workplace. Nowadays, thinking skills play a vital role in tertiary education. To provide an approach for teachers, this paper identifies a 4-step model that can be implemented in test design with reference to Bloom’s Taxonomy for thinking skills. This model illustrates a feasible procedure of test construction built upon existing resource. The procedures can easily be applied to different fields of study. It provides an appropriate way for teachers who may want to add more ideas to their repertoire skills in addressing the learning of HOT (higher-order thinking skills. Keywords: thinking skills, Bloom’s Taxonomy, 4-step model

  17. Which Global Rating Scale? A Comparison of the ASSET, BAKSSS, and IGARS for the Assessment of Simulated Arthroscopic Skills.

    Science.gov (United States)

    Middleton, Robert M; Baldwin, Mathew J; Akhtar, Kash; Alvand, Abtin; Rees, Jonathan L

    2016-01-06

    With the move to competency-based models of surgical training, a number of assessment methods have been developed. Of these, global rating scales have emerged as popular tools, and several are specific to the assessment of arthroscopic skills. Our aim was to determine which one of a group of commonly used global rating scales demonstrated superiority in the assessment of simulated arthroscopic skills. Sixty-three individuals of varying surgical experience performed a number of arthroscopic tasks on a virtual reality simulator (VirtaMed ArthroS). Performance was blindly assessed by two observers using three commonly used global rating scales used to assess simulated skills. Performance was also assessed by validated objective motion analysis. All of the global rating scales demonstrated construct validity, with significant differences between each skill level and each arthroscopic task (p rating scale. Correlations of global rating scale ratings with motion analysis were high and strong for each global rating scale when correlated with time taken (Spearman rho, -0.95 to -0.76; p rating scale demonstrated superiority as an assessment tool. For these commonly used arthroscopic global rating scales, none was particularly superior and any one score could therefore be used. Agreement on using a single score seems sensible, and it would seem unnecessary to develop further scales with the same domains for these purposes. Copyright © 2016 by The Journal of Bone and Joint Surgery, Incorporated.

  18. A Preliminary Investigation of General and Technique-specific Assessments for the Evaluation of Laparoscopic Technical Skills.

    Science.gov (United States)

    Vergis, Ashley; Steigerwald, Sarah

    2017-10-07

    Background  Both general and technique-specific assessments of technical skill have been validated in surgical education. The purpose of this study was to assess the correlation between the objective structured assessment of technical skills (OSATS) and the global operative assessment of laparoscopic skills (GOALS) rating scales using a high-fidelity porcine laparoscopic cholecystectomy model. Methods Post-graduate year-one general surgery and urology residents (n=14) performed a live laparoscopic porcine cholecystectomy. Trained surgeons rated their performance using OSATS and GOALS assessment scales. Results Pearson's correlation coefficient between OSATS and GOALS was 0.96 for overall scores. It ranged from 0.78 - 0.89 for domains that overlapped between the two scales. Conclusion There is a very high correlation between OSATS and GOALS. This implies that they likely measure similar constructs and that either may be used for summative-type assessments of trainee skill. However, further investigation is needed to determine if technique-specific assessments may provide more useful feedback in formative evaluation.

  19. MEMFASILITASI HIGHER ORDER TIHINKING SKILLS DALAM PERKULIAHAN BIOLOGI SEL MELALUI MODEL INTEGRASI ATRIBUT ASESMEN FORMATIF

    Directory of Open Access Journals (Sweden)

    Sigit Saptono

    2017-10-01

    Full Text Available ABSTRACTHigher order thinking skills are needed to understand the problem and the essence of the lecture material Biology Sel. Study design Research and Development aims to develop reasoning skills and analytic thinking biology student teachers through the application of learning models Integration Attributes Formative Assessment (IAAF. Some 61 students of Biology Education Semarang State University who is doing his third semester courses Cell Biology is the subject of research. Analytical reasoning and  thinking ability of students is measured through individual assignments, group assignments concept map creation and preparation of the Review articles, and 30 items about the shape of the selected response and constructed response questions, validated questions. The result showed that the ability of reasoning and analytical thinking of students can be expanded significantly, although the development of the ability of argumentation, one category of analytic thinking skills, they need serious attention.

  20. Taxonomy of Trauma Leadership Skills: A Framework for Leadership Training and Assessment.

    Science.gov (United States)

    Leenstra, Nico F; Jung, Oliver C; Johnson, Addie; Wendt, Klaus W; Tulleken, Jaap E

    2016-02-01

    Good leadership is essential for optimal trauma team performance, and targeted training of leadership skills is necessary to achieve such leadership proficiency. To address the need for a taxonomy of leadership skills that specifies the skill components to be learned and the behaviors by which they can be assessed across the five phases of trauma care, the authors developed the Taxonomy of Trauma Leadership Skills (TTLS). Critical incident interviews were conducted with trauma team leaders and members from different specialties-emergency physicians, trauma surgeons, anesthesiologists, and emergency ward nurses-at three teaching hospitals in the Netherlands during January-June 2013. Data were iteratively analyzed for examples of excellent leadership skills at each phase of trauma care. Using the grounded theory approach, elements of excellent leadership skills were identified and classified. Elements and behavioral markers were sorted and categorized using multiple raters. In a two-round verification process in late 2013, the taxonomy was reviewed and rated by trauma team leaders and members from the multiple specialties for its coverage of essential items. Data were gathered from 28 interviews and 14 raters. The TTLS details 5 skill categories (information coordination, decision making, action coordination, communication management, and coaching and team development) and 37 skill elements. The skill elements are captured by 67 behavioral markers. The three-level taxonomy is presented according to five phases of trauma care. The TTLS provides a framework for teaching, learning, and assessing team leadership skills in trauma care and other complex, acute care situations.

  1. Tracking Skill Acquisition with Cognitive Diagnosis Models: A Higher-Order, Hidden Markov Model with Covariates

    Science.gov (United States)

    Wang, Shiyu; Yang, Yan; Culpepper, Steven Andrew; Douglas, Jeffrey A.

    2018-01-01

    A family of learning models that integrates a cognitive diagnostic model and a higher-order, hidden Markov model in one framework is proposed. This new framework includes covariates to model skill transition in the learning environment. A Bayesian formulation is adopted to estimate parameters from a learning model. The developed methods are…

  2. Model characteristics of competitive activity of different skilled female volleyball players

    Directory of Open Access Journals (Sweden)

    N.Y. Shchepotina

    2015-02-01

    Full Text Available Purpose: to determine and compare the model characteristics of competitive activity and an integrated assessment of highly qualified and skilled volleyball players. Material : the study involved 49 highly qualified and 53 qualified volleyball players. Results : identified indicators of competitive activity (intensity factors, mobility, aggressiveness, efficiency and effectiveness ratio of attack-block and the integral evaluation of volleyball players of various skill levels. Developed a scale evaluation. Built model. Also, a comparison of model characteristics of competitive activity volleyball. Conclusions : the significant differences are fixed model characteristics of competitive activity in athletes of high qualification of different roles. Qualified volleyball, these differences are not so pronounced. This demonstrates the universality of minor league players.

  3. Attention to gender in communication skills assessment instruments in medical education: a review.

    Science.gov (United States)

    Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

    2011-03-01

    Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

  4. Non-technical skills assessment for prelicensure nursing students: An integrative review.

    Science.gov (United States)

    Pires, Sara; Monteiro, Sara; Pereira, Anabela; Chaló, Daniela; Melo, Elsa; Rodrigues, Alexandre

    2017-11-01

    In nursing, non-technical skills are recognized as playing an important role to increase patient safety and successful clinical outcomes (Pearson and McLafferty, 2011). Non-technical skills are cognitive and social resource skills that complement technical skills and contribute to safe and efficient task performance (Flin et al., 2008). In order to effectively provide non-technical skills training, it is essential to have an instrument to measure these skills. An online search was conducted. Articles were selected if they referred to and/or described instruments assessing non-technical skills for nurses and/or prelicensure nursing students in educational, clinical and/or simulated settings with validation evidence (inclusion criteria). Of the 53 articles located, 26 met the inclusion criteria. Those referred to and/or described 16 instruments with validation evidence developed to assess non-technical skills in multidisciplinary teams including nurses. Although articles have shown 16 valid and reliable instruments, to our knowledge, no instrument has been published or developed and validated for the assessment of non-technical skills of only nurses in general, relevant for use in high-fidelity simulation-based training for prelicensure nursing students. Therefore, there is a need for the development of such an instrument. Copyright © 2017 Elsevier Ltd. All rights reserved.

  5. Examining Variability in Model Skill During the 7 January 2013 Sudden Stratospheric Warming Event

    Science.gov (United States)

    Blufer, Jonathan L.

    Recent analyses of numerical weather prediction models have shown that stratospheric regime changes (e.g. strong and weak vortex events) are not skillfully predicted at medium-range lead times. Motivated by these recent analyses, this thesis investigates the sources of variability in stratospheric forecast skill amongst several operational models initiated at different lead times prior to the 7 January 2013 sudden stratospheric warming (SSW). This study extends upon a previous analysis by the Stratospheric Network for the Assessment of Predictability (SNAP), which concluded that a change in forecast lead-time from 15 to 10 days increased model skill in predicting the 2013 SSW by roughly 50 percent. The sources of such variability in predictive skill are investigated further in this thesis. Coordinated reforecasts from the SNAP dataset are used to examine model variability and forecast skill in six medium-range operational ensemble forecast models. Both elliptical diagnostics of the polar vortex that quantify the vortex eccentricity, center longitude and latitude, and area, as well as zonal mean metrics are used to assess model errors and biases in the stratosphere. Ensemble skill is categorized into low and high error composite groups according to two separate metrics: the strength of the 10-hPa zonal mean zonal wind at 60?N and the center latitude of the 10-hPa vortex ellipse. Analysis reveals that ensemble members forecasting an ellipse center located equatorward of 70°N prior to 7 January 2013 had greater skill in predicting an easterly 10-hPa zonal mean zonal wind regime at the time of verified SSW onset. It is hypothesized that model error in forecasting thermodynamic processes linked to the SSW precursor tropospheric blocking in the N. Atlantic resulted in systematic biases and variability in dynamical forcing (e.g. upward wave activity flux) into the polar stratosphere in forecasts of the 7 January 2013 SSW event. Results indicate that errors in maintaining

  6. Comparison of the Effectiveness of a Virtual Simulator With a Plastic Arm Model in Teaching Intravenous Catheter Insertion Skills.

    Science.gov (United States)

    Günay İsmailoğlu, Elif; Zaybak, Ayten

    2018-02-01

    The objective of this study was to compare the effectiveness of a virtual intravenous simulator with a plastic arm model in teaching intravenous catheter insertion skills to nursing students. We used a randomized controlled quasi-experimental trial design and recruited 65 students who were assigned to the experimental (n = 33) and control (n = 32) groups using the simple random sampling method. The experimental group received intravenous catheterization skills training on the virtual intravenous simulator, and the control group received the same training on a plastic model of a human arm. Data were collected using the personal information form, intravenous catheterization knowledge assessment form, Intravenous Catheterization Skill Test, Self-Confidence and Satisfaction Scale, and Fear Symptoms Scale. In the study, the mean scores in the control group were 20.44 for psychomotor skills, 15.62 for clinical psychomotor skills, 31.78 for self-confidence, and 21.77 for satisfaction. The mean scores in the experimental group were 45.18 for psychomotor skills, 16.28 for clinical psychomotor skills, 34.18 for self-confidence, and 43.89 for satisfaction. The results indicated that psychomotor skills and satisfaction scores were higher in the experimental group, while the clinical psychomotor skills and self-confidence scores were similar in both groups. More students in the control group reported experiencing symptoms such as cold and sweaty hands, significant restlessness, and tense muscles than those in the experimental group.

  7. Developing model-making and model-breaking skills using direct measurement video-based activities

    Science.gov (United States)

    Vonk, Matthew; Bohacek, Peter; Militello, Cheryl; Iverson, Ellen

    2017-12-01

    This study focuses on student development of two important laboratory skills in the context of introductory college-level physics. The first skill, which we call model making, is the ability to analyze a phenomenon in a way that produces a quantitative multimodal model. The second skill, which we call model breaking, is the ability to critically evaluate if the behavior of a system is consistent with a given model. This study involved 116 introductory physics students in four different sections, each taught by a different instructor. All of the students within a given class section participated in the same instruction (including labs) with the exception of five activities performed throughout the semester. For those five activities, each class section was split into two groups; one group was scaffolded to focus on model-making skills and the other was scaffolded to focus on model-breaking skills. Both conditions involved direct measurement videos. In some cases, students could vary important experimental parameters within the video like mass, frequency, and tension. Data collected at the end of the semester indicate that students in the model-making treatment group significantly outperformed the other group on the model-making skill despite the fact that both groups shared a common physical lab experience. Likewise, the model-breaking treatment group significantly outperformed the other group on the model-breaking skill. This is important because it shows that direct measurement video-based instruction can help students acquire science-process skills, which are critical for scientists, and which are a key part of current science education approaches such as the Next Generation Science Standards and the Advanced Placement Physics 1 course.

  8. Developing model-making and model-breaking skills using direct measurement video-based activities

    Directory of Open Access Journals (Sweden)

    Matthew Vonk

    2017-08-01

    Full Text Available This study focuses on student development of two important laboratory skills in the context of introductory college-level physics. The first skill, which we call model making, is the ability to analyze a phenomenon in a way that produces a quantitative multimodal model. The second skill, which we call model breaking, is the ability to critically evaluate if the behavior of a system is consistent with a given model. This study involved 116 introductory physics students in four different sections, each taught by a different instructor. All of the students within a given class section participated in the same instruction (including labs with the exception of five activities performed throughout the semester. For those five activities, each class section was split into two groups; one group was scaffolded to focus on model-making skills and the other was scaffolded to focus on model-breaking skills. Both conditions involved direct measurement videos. In some cases, students could vary important experimental parameters within the video like mass, frequency, and tension. Data collected at the end of the semester indicate that students in the model-making treatment group significantly outperformed the other group on the model-making skill despite the fact that both groups shared a common physical lab experience. Likewise, the model-breaking treatment group significantly outperformed the other group on the model-breaking skill. This is important because it shows that direct measurement video-based instruction can help students acquire science-process skills, which are critical for scientists, and which are a key part of current science education approaches such as the Next Generation Science Standards and the Advanced Placement Physics 1 course.

  9. What should be included in the assessment of laypersons' paediatric basic life support skills?

    DEFF Research Database (Denmark)

    Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim

    2018-01-01

    body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. METHODS: A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts...... resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify......' paediatric basic life support and foreign body airway obstruction management skills was established. The assessment of these skills may help to determine when laypersons have acquired competencies. TRIAL REGISTRATION: Not relevant....

  10. Assessment of Critical Thinking Skills in Associate Degree Nursing Students.

    Science.gov (United States)

    Soukup, Frances

    A study examined the change in the critical thinking skills of associate degree nursing students as they progressed through their educational process at the Reedsburg campus of Madison Area Technical College (MATC) in Wisconsin. The study sample consisted of two cohorts of 24 students each (students entering MATC's associate degree nursing program…

  11. Assessing Aptitude and Attitude Development in a Translation Skills Course

    Science.gov (United States)

    Mekheimer, Mohamed Amin A.

    2012-01-01

    This study investigates the effects on EFL students of using Blackboard technology and online dictionaries in developing translating skills and building positive attitudes towards translation in male Saudi college students. The study compares two groups of students in a translation course; one in a traditional, face-to-face setting (control) and…

  12. Assessment of Library Instruction and Library Literacy Skills of First ...

    African Journals Online (AJOL)

    This study investigated the effectiveness and impact of library instruction (GST 111 – the use of library) course on library literacy skills of first year undergraduate students. The study adopted the descriptive survey research method and questionnaire was used as the research instrument. First year undergraduate students of ...

  13. Assessing Practical Skills in Physics Using Computer Simulations

    Science.gov (United States)

    Walsh, Kevin

    2018-01-01

    Computer simulations have been used very effectively for many years in the teaching of science but the focus has been on cognitive development. This study, however, is an investigation into the possibility that a student's experimental skills in the real-world environment can be judged via the undertaking of a suitably chosen computer simulation…

  14. The Use of Rubrics in Benchmarking and Assessing Employability Skills

    Science.gov (United States)

    Riebe, Linda; Jackson, Denise

    2014-01-01

    Calls for employability skill development in undergraduates now extend across many culturally similar developed economies. Government initiatives, industry professional accreditation criteria, and the development of academic teaching and learning standards increasingly drive the employability agenda, further cementing the need for skill…

  15. Assessing Progress in Mastery of Counseling Communication Skills

    NARCIS (Netherlands)

    A.J. Kuntze (Jeroen)

    2009-01-01

    textabstractDuring the last century the attention paid in higher education to the development of professional skills has progressively increased. In the first half of the last century the term ‘skill’ mainly referred to motor or technical actions, for instance driving a car or operating a machine

  16. Assessment of library user skills possessed by unity school students ...

    African Journals Online (AJOL)

    The findings have a number of implications for education. It was strongly recommended that because of the immense benefits of Library User Skills acquisition, Government should give urgent attention to the provision of Library Resources to Unity schools. Secondary school curriculum should be revisited for inclusion of ...

  17. Effect of simulated emergency skills training and assessments on ...

    African Journals Online (AJOL)

    ... of emergency skills in simulation was highly effective in enhancing the competence and confidence of medical students when managing a clinical emergency. However, students appeared to be overconfident, which could be ascribed to ignorance, and possibly indicates that feedback during training should be improved.

  18. Pain assessment and medications use among daily paid skilled ...

    African Journals Online (AJOL)

    Paracetamol 186(46.5%) was the most commonly used analgesic followed by Ibuprofen 100(25%). The pain experienced by daily paid skilled workers was found to be work- related musculoskeletal disorder. There is a need for establishment of intervention programs to reduce the risk of work - related musculoskeletal ...

  19. Self vs expert assessment of technical and non-technical skills in high fidelity simulation.

    Science.gov (United States)

    Arora, Sonal; Miskovic, Danilo; Hull, Louise; Moorthy, Krishna; Aggarwal, Rajesh; Johannsson, Helgi; Gautama, Sanjay; Kneebone, Roger; Sevdalis, Nick

    2011-10-01

    Accurate assessment is imperative for learning, feedback and progression. The aim of this study was to examine whether surgeons can accurately self-assess their technical and nontechnical skills compared with expert faculty members' assessments. Twenty-five surgeons performed a laparoscopic cholecystectomy (LC) in a simulated operating room. Technical and nontechnical performance was assessed by participants and faculty members using the validated Objective Structured Assessment of Technical Skills (OSATS) and the Non-Technical Skills for Surgeons scale (NOTSS). Assessment of technical performance correlated between self and faculty members' ratings for experienced (median score, 30.0 vs 31.0; ρ = .831; P = .001) and inexperienced (median score, 22.0 vs 28.0; ρ = .761; P = .003) surgeons. Assessment of nontechnical skills between self and faculty members did not correlate for experienced surgeons (median score, 8.0 vs 10.5; ρ = -.375; P = .229) or their more inexperienced counterparts (median score, 9.0 vs 7.0; ρ = -.018; P = .953). Surgeons can accurately self-assess their technical skills in virtual reality LC. Conversely, formal assessment with faculty members' input is required for nontechnical skills, for which surgeons lack insight into their behaviours. Copyright © 2011 Elsevier Inc. All rights reserved.

  20. Self- and rater-assessed effectiveness of "thinking-aloud" and "regular" morning report to intensify young physicians' clinical skills.

    Science.gov (United States)

    Hsu, Hui-Chi; Lee, Fa-Yauh; Yang, Ying-Ying; Tsao, Yen-Po; Lee, Wen-Shin; Chuang, Chiao-Lin; Chang, Ching-Chih; Huang, Chia-Chang; Huang, Chin-Chou; Ho, Shung-Tai

    2015-09-01

    This study compared the effects of the "thinking aloud" (TA) morning report (MR), which is characterized by sequential and interactive case discussion by all participants, with "regular" MR for clinical skill training of young physicians. Between February 2011 and February 2014, young physicians [including postgraduate year-1 (PGY1) residents, interns, and clerks) from our hospital were sequentially enrolled and followed for 3 months. The self- and rater-assessed educational values of two MR models for building up clinical skills of young physicians were compared. The junior (intern and clerk) attendees had higher self-assessed educational values scores and reported post-training application frequency of skills trained by TA MR compared with the senior (PGY1 resident) attendees. Higher average and percentage of increased overall rater-assessed OSCE scores were noted among the regular MR senior attendees and TA MR junior attendees than in their corresponding control groups (regular MR junior attendees and TA MR senior attendees). Interestingly, regular MRs provided additional beneficial effects for establishing the "professionalism, consulting skills and organization efficiency" aspects of clinical skills of senior/junior attendees. Moreover, senior and junior attendees benefited the most by participating in seven sessions of regular MR and TA MR each month, respectively. TA MR effectively trains junior attendees in basic clinical skills, whereas regular MR enhances senior attendees' "work reports, professionalism, organizational efficiency, skills in dealing with controversial and professional issues." Undoubtedly, all elements of the two MR models should be integrated together to ensure patient safety and good discipline among young physicians. Copyright © 2015. Published by Elsevier Taiwan.

  1. How can teachers assess reading skills of generation z learners in German language class?

    Science.gov (United States)

    Dirga, R. N.; Wijayati, P. H.

    2018-01-01

    Generation Z is a digital native generation who has unique characteristics on the daily basis includes reading. In order to assess their reading skills correctly, teachers need to take these characteristics into consideration. This paper aims to describe the process in developing an instrument to assess reading skills of Generation Z learners in German language class. This study used developmental method. The developed instrument has not only good quality but also consists of texts that are suitable for German learners of Generation Z. This instrument can be used as an example in assessing German learners’ reading skills in the 21st century.

  2. Teachers' Perceptions of Their RTI Skills as They Relate to Assessment, Instruction, and Intervention

    Science.gov (United States)

    Christian, Karyn Spann

    2013-01-01

    The purpose of this study was to examine teachers' perceptions of their Response to Intervention (RTI) skills as they relate to assessment, instruction, and intervention. "The Perceptions of RTI Skills Survey" was distributed to 138 elementary general education teachers in ten elementary schools in six rural school districts, and ninety…

  3. Assessment and Teaching of Science Skills: Whole of Programme Perceptions of Graduating Students

    Science.gov (United States)

    Hodgson, Yvonne; Varsavsky, Cristina; Matthews, Kelly E.

    2014-01-01

    This study reports on science student perceptions of their skills (scientific knowledge, oral communication, scientific writing, quantitative skills, teamwork and ethical thinking) as they approach graduation. The focus is on which teaching activities and assessment tasks over the whole programme of study students thought utilised each of the six…

  4. Creating Trails: Tool for Real-Time Assessment of Information Literacy Skills

    Science.gov (United States)

    Schloman, Barbara F.; Gedeon, Julie A.

    2007-01-01

    This article describes Tool for Real-time Assessment of Information Literacy Skills (TRAILS), a freely available, online tool designed to measure the information literacy skills of high school students. It is based on information literacy competencies for ninth-graders found in the "Ohio Academic Content Standards" (Ohio Department of Education…

  5. Self-Assessment of Video-Recorded Presentations: Does It Improve Skills?

    Science.gov (United States)

    Ritchie, Sian M.

    2016-01-01

    The opportunity to give oral presentations is important because it helps develop skills that are necessary for many aspects of professional careers. Competencies for oral presentations include appropriate content, design and organization of the presentation, and delivery skills. Self-assessment has been shown to help students develop…

  6. Measuring beyond Content: A Rubric Bank for Assessing Skills in Authentic Research Assignments in the Sciences

    Science.gov (United States)

    Kishbaugh, Tara L. S.; Cessna, Stephen; Horst, S. Jeanne; Leaman, Lori; Flanagan, Toni; Neufeld, Doug Graber; Siderhurst, Matthew

    2012-01-01

    Herein we report the development of an analytic rubric bank to assess non-content learning, namely higher order cognitive skills, the understanding of the nature of science, and effective scientific communication skills in student research projects. Preliminary findings indicate that use of this tool enhances our students' learning in these areas,…

  7. Assessing the impact of a study skills workshop on the academic ...

    African Journals Online (AJOL)

    This article presents a study which was conducted to assess the impact of a study skills workshop on learning strategies and academic achievement of first- year nursing students in the School of Health Sciences at the University of Venda, South Africa. The results indicated that the study skills workshop had a positive effect ...

  8. Assessing Teamwork in Undergraduate Education: A Measurement Tool to Evaluate Individual Teamwork Skills

    Science.gov (United States)

    Britton, Emily; Simper, Natalie; Leger, Andrew; Stephenson, Jenn

    2017-01-01

    Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…

  9. The Promotion of Critical Thinking Skills in School-Based Assessment (SBA)

    Science.gov (United States)

    Kamarulzaman, Wirawani; Kamarulzaman, Wirawahida

    2016-01-01

    The new curriculum introduced in the Malaysian primary students; the Primary School Standard Curriculum (Kurikulum Standard Sekolah Rendah-KSSR) together with the school-based assessment (SBA) is a step taken by the Malaysian government to encourage thinking skills to students, specifically critical thinking skills. The study explores teachers'…

  10. Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

    Science.gov (United States)

    Shackelford, Stacy; Garofalo, Evan; Shalin, Valerie; Pugh, Kristy; Chen, Hegang; Pasley, Jason; Sarani, Babak; Henry, Sharon; Bowyer, Mark; Mackenzie, Colin F

    2015-07-01

    Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular

  11. Self-Assessment of Employability Skill Outcomes among Undergraduates and Alignment with Academic Ratings

    Science.gov (United States)

    Jackson, Denise

    2014-01-01

    Despite acknowledgement of the benefits of self-assessment in higher education, disparity between student and academic assessments, with associated trends in overrating and underrating, plagues its meaningful use, particularly as a tool for formal assessment. This study examines self-assessment of capabilities in certain employability skills in…

  12. Climate predictability and prediction skill on seasonal time scales over South America from CHFP models

    Science.gov (United States)

    Osman, Marisol; Vera, C. S.

    2017-10-01

    This work presents an assessment of the predictability and skill of climate anomalies over South America. The study was made considering a multi-model ensemble of seasonal forecasts for surface air temperature, precipitation and regional circulation, from coupled global circulation models included in the Climate Historical Forecast Project. Predictability was evaluated through the estimation of the signal-to-total variance ratio while prediction skill was assessed computing anomaly correlation coefficients. Both indicators present over the continent higher values at the tropics than at the extratropics for both, surface air temperature and precipitation. Moreover, predictability and prediction skill for temperature are slightly higher in DJF than in JJA while for precipitation they exhibit similar levels in both seasons. The largest values of predictability and skill for both variables and seasons are found over northwestern South America while modest but still significant values for extratropical precipitation at southeastern South America and the extratropical Andes. The predictability levels in ENSO years of both variables are slightly higher, although with the same spatial distribution, than that obtained considering all years. Nevertheless, predictability at the tropics for both variables and seasons diminishes in both warm and cold ENSO years respect to that in all years. The latter can be attributed to changes in signal rather than in the noise. Predictability and prediction skill for low-level winds and upper-level zonal winds over South America was also assessed. Maximum levels of predictability for low-level winds were found were maximum mean values are observed, i.e. the regions associated with the equatorial trade winds, the midlatitudes westerlies and the South American Low-Level Jet. Predictability maxima for upper-level zonal winds locate where the subtropical jet peaks. Seasonal changes in wind predictability are observed that seem to be related to

  13. Nanotechnologies: Risk assessment model

    Science.gov (United States)

    Giacobbe, F.; Monica, L.; Geraci, D.

    2009-05-01

    The development and use of nanomaterials has grown widely in the last years. Hence, it is necessary to carry out a careful and aimed risk assessment for the safety of the workers. The objective of this research is a specific assessment model finalized to the workplaces where the personnel work manipulating nanoparticles. This model mainly takes into account the number of exposed workers, the dimensions of particles, the information found in the safety data sheets and the uncertainties about the danger level coming from the exposition to nanomaterials. The evaluation algorithm considers the normal work conditions, the abnormal (e.g. breakdown air filter) and emergency situations (e.g. package cracking). It has been necessary to define several risk conditions in order to quantify the risk by increasing levels ("low", "middle" and "high" level). Each level includes appropriate behavioural procedures. In particular for the high level, it is advisable that the user carries out urgent interventions finalized to reduce the risk level (e.g. the utilization of vacuum box for the manipulation, high efficiency protection PPE, etc). The model has been implemented in a research laboratory where titanium dioxide and carbon nanotubes are used. The outcomes taken out from such specific evaluation gave a risk level equal to middle.

  14. Nanotechnologies: Risk assessment model

    International Nuclear Information System (INIS)

    Giacobbe, F; Monica, L; Geraci, D

    2009-01-01

    The development and use of nanomaterials has grown widely in the last years. Hence, it is necessary to carry out a careful and aimed risk assessment for the safety of the workers. The objective of this research is a specific assessment model finalized to the workplaces where the personnel work manipulating nanoparticles. This model mainly takes into account the number of exposed workers, the dimensions of particles, the information found in the safety data sheets and the uncertainties about the danger level coming from the exposition to nanomaterials. The evaluation algorithm considers the normal work conditions, the abnormal (e.g. breakdown air filter) and emergency situations (e.g. package cracking). It has been necessary to define several risk conditions in order to quantify the risk by increasing levels ('low', 'middle' and 'high' level). Each level includes appropriate behavioural procedures. In particular for the high level, it is advisable that the user carries out urgent interventions finalized to reduce the risk level (e.g. the utilization of vacuum box for the manipulation, high efficiency protection PPE, etc). The model has been implemented in a research laboratory where titanium dioxide and carbon nanotubes are used. The outcomes taken out from such specific evaluation gave a risk level equal to middle.

  15. Employability Skills among Students and Employers’ Perceptions: An Assessment of Levels of Employability Skills Acquired by Business Students at Ishik University

    Directory of Open Access Journals (Sweden)

    Fayeq Ali Ali

    2017-01-01

    Full Text Available Skills are prerequisite for managers and employees success, especially for newly graduate students. This study is to evaluate the employability skills of business students at Ishik University and to assess how employability skills are perceived by potential employers. Three sets of employability skills have been used in this study such as basic academic skills, high-order thinking, and personal qualities. A questionnaire has been developed which included above dimensions and was distributed among students in the faculty of administrative sciences and economics at Ishik University, Kurdistan Region. Respondents’ opinions were assessed using a Likert scale analysis that shows divergent opinions between two extremes of levels of agreement and disagreement. Another technique of an open-ended questionnaire was used when conducting interviews with a few of the potential employers in some private sector companies. Study focuses on the common employability skills of business graduates by evaluating the faculty of administrative sciences and economics courses. Study find out that communication skills, team working skills, computer skills, and critical thinking were among the employability skills which are expected by potential employers. The paper concludes that business graduates have developed an adequate level of employability skill through their years of academic training at business department in Ishik University. Thus, the curriculum of business department at Ishik University is adequately developed to prompt the employability skills that are sought by potential employers that every business student should acquire to stand out in the aggressively competitive job market.

  16. Integrated Assessment Modeling

    Energy Technology Data Exchange (ETDEWEB)

    Edmonds, James A.; Calvin, Katherine V.; Clarke, Leon E.; Janetos, Anthony C.; Kim, Son H.; Wise, Marshall A.; McJeon, Haewon C.

    2012-10-31

    This paper discusses the role of Integrated Assessment models (IAMs) in climate change research. IAMs are an interdisciplinary research platform, which constitutes a consistent scientific framework in which the large-scale interactions between human and natural Earth systems can be examined. In so doing, IAMs provide insights that would otherwise be unavailable from traditional single-discipline research. By providing a broader view of the issue, IAMs constitute an important tool for decision support. IAMs are also a home of human Earth system research and provide natural Earth system scientists information about the nature of human intervention in global biogeophysical and geochemical processes.

  17. Hand-assisted laparoscopic sigmoid colectomy skills acquisition: augmented reality simulator versus human cadaver training models.

    Science.gov (United States)

    Leblanc, Fabien; Senagore, Anthony J; Ellis, Clyde N; Champagne, Bradley J; Augestad, Knut M; Neary, Paul C; Delaney, Conor P

    2010-01-01

    The aim of this study was to compare a simulator with the human cadaver model for hand-assisted laparoscopic colorectal skills acquisition training. An observational prospective comparative study was conducted to compare the laparoscopic surgery training models. The study took place during the laparoscopic colectomy training course performed at the annual scientific meeting of the American Society of Colon and Rectal Surgeons. Thirty four practicing surgeons performed hand-assisted laparoscopic sigmoid colectomy on human cadavers (n = 7) and on an augmented reality simulator (n = 27). Prior laparoscopic colorectal experience was assessed. Trainers and trainees completed independently objective structured assessment forms. Training models were compared by trainees' technical skills scores, events scores, and satisfaction. Prior laparoscopic experience was similar in both surgeon groups. Generic and specific skills scores were similar on both training models. Generic events scores were significantly better on the cadaver model. The 2 most frequent generic events occurring on the simulator were poor hand-eye coordination and inefficient use of retraction. Specific events were scored better on the simulator and reached the significance limit (p = 0.051) for trainers. The specific events occurring on the cadaver were intestinal perforation and left ureter identification difficulties. Overall satisfaction was better for the cadaver than for the simulator model (p = 0.009). With regard to skills scores, the augmented reality simulator had adequate qualities for the hand-assisted laparoscopic colectomy training. Nevertheless, events scores highlighted weaknesses of the anatomical replication on the simulator. Although improvements likely will be required to incorporate the simulator more routinely into the colorectal training, it may be useful in its current form for more junior trainees or those early on their learning curve. Copyright 2010 Association of Program

  18. Improving Critical Thinking Skills of College Students through RMS Model for Learning Basic Concepts in Science

    Science.gov (United States)

    Muhlisin, Ahmad; Susilo, Herawati; Amin, Mohamad; Rohman, Fatchur

    2016-01-01

    The purposes of this study were to: 1) Examine the effect of RMS learning model towards critical thinking skills. 2) Examine the effect of different academic abilities against critical thinking skills. 3) Examine the effect of the interaction between RMS learning model and different academic abilities against critical thinking skills. The research…

  19. Teaching and Assessing Manipulative Motor Skills in High School Physical Education

    Science.gov (United States)

    Bert, Greg

    2015-01-01

    This article provides new ways to teach and assess motor skills in various lifetime sports such as tennis, golf, badminton, and other sports that students are likely to play as adults by focusing on five basic biomechanical principles.

  20. THE EFFECT OF MODEL SCIENTIFIC INQUIRY USING MEDIA PhET TOWARD SKILLS PROCESS OF SCIENCE VIEWED FROM CRITICAL THINKING SKILLS

    Directory of Open Access Journals (Sweden)

    Nanda Safarati

    2017-06-01

    Full Text Available The purpose of research to analyse: the science process skills that are taught in a model of scientific inquiry using the media PhET better than students taught by learning direct instruction, science process skills of physics students who has the critical thinking skills using a model of scientific inquiry than average -rata better than students who have critical thinking skills using a direct model of instruction above average, the interaction of scientific inquiry learning model using PhET media with critical thinking skills of students in improving students' science process skills. This research is quasi experimental. Technique that used to gain a sample is random cluster sampling. The instrument used is the science process skills test and test critical thinking skills. The results of this study concluded that: the science process skills of students who are taught by the model of scientific inquiry using the media PhET better than students taught by learning direct instruction, science process skills of physics students who have the critical thinking skills using a model of scientific inquiry over average better than students who have critical thinking skills using a direct model of instruction above average, there is interaction scientific inquiry model using the media PhET with critical thinking skills of students in improving students' science process skills.

  1. Curriculum learning designs: teaching health assessment skills for advanced nursing practitioners through sustainable flexible learning.

    Science.gov (United States)

    Fitzgerald, Les; Wong, Pauline; Hannon, John; Solberg Tokerud, Marte; Lyons, Judith

    2013-10-01

    Innovative curriculum designs are vital for effective learning in contemporary nursing education where traditional modes of delivery are not adequate to meet the learning needs of postgraduate students. This instance of postgraduate teaching in a distributed learning environment offered the opportunity to design a flexible learning model for teaching advanced clinical skills. To present a sustainable model for flexible learning that enables specialist nurses to gain postgraduate qualifications without on-campus class attendance by teaching and assessing clinical health care skills in an authentic workplace setting. An action research methodology was used to gather evidence and report on the process of curriculum development of a core unit, Comprehensive Health Assessment (CHA), within 13 different postgraduate speciality courses. Qualitative data was collected from 27 teaching academics, 21 clinical specialist staff, and 7 hospital managers via interviews, focus groups and journal reflections. Evaluations from the initial iteration of CHA from 36 students were obtained. Data was analyzed to develop and evaluate the curriculum design of CHA. The key factors indicated by participants in the curriculum design process were coordination and structuring of teaching and assessment; integration of content development; working with technologies, balancing specialities and core knowledge; and managing induction and expectations. A set of recommendations emerged as a result of the action research process. These included: a constructive alignment approach to curriculum design; the production of a facilitator's guide that specifies expectations and unit information for academic and clinical education staff; an agreed template for content authors; and the inclusion of synchronous communication for real-time online tutoring. The highlight of the project was that it built curriculum design capabilities of clinicians and students which can sustain this alternative model of online

  2. Framework of Assessment for the Evaluation of Thinking Skills of Tertiary Level Students

    Science.gov (United States)

    Heng, Chan Swee; Ziguang, Yan

    2015-01-01

    In the 21st century, students are required to master thinking skills in order to deal with many situations that arise in the tertiary environment which later would translate into the workplace. Nowadays, thinking skills play a vital role in tertiary education. To provide an approach for teachers, this paper identifies a 4-step model that can be…

  3. OSCE vs. TEM: Different Approaches to Assess Clinical Skills of Nursing Students.

    Science.gov (United States)

    Jelly, Prasuna; Sharma, Rakesh

    2017-01-01

    Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE) could be a better approach to assess clinical skills of nursing students. A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM) was used to assess the clinical skills and to get opinion. The mean score of OSCE was more than TEM and the difference was statistically significant ( P OSCE was higher than TEM. The study concluded that implementing OSCE will overweigh the advantages of the TEM.

  4. OSCE vs. TEM: Different approaches to assess clinical skills of nursing students

    Directory of Open Access Journals (Sweden)

    Prasuna Jelly

    2017-01-01

    Full Text Available Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001. The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM.

  5. OSCE vs. TEM: Different Approaches to Assess Clinical Skills of Nursing Students

    Science.gov (United States)

    Jelly, Prasuna; Sharma, Rakesh

    2017-01-01

    Introduction: Nurses are trained with specific clinical skills, and objective structured clinical examination (OSCE) could be a better approach to assess clinical skills of nursing students. Materials and Methods: A comparative study was conducted by observational checklist regarding antenatal care and opinionnaire on the usefulness of OSCE and tradition evaluation method (TEM) was used to assess the clinical skills and to get opinion. Results: The mean score of OSCE was more than TEM and the difference was statistically significant (P < 0.001). The opinion of students regarding the usefulness of OSCE was higher than TEM. Conclusions: The study concluded that implementing OSCE will overweigh the advantages of the TEM. PMID:28382064

  6. Assessment of validity of an OSATS for cystoscopic and ureteroscopic cognitive and psychomotor skills.

    Science.gov (United States)

    Kishore, Thekke Adiyat; Pedro, Renato N; Monga, Manoj; Sweet, Robert M

    2008-12-01

    The purpose of the study was to assess the construct validity of an Objective Structured Assessment of Technical Skills (OSATS) developed for cystoscopic and ureteroscopic cognitive and psychomotor skills. An OSATS was designed based on a 14-point comprehensive curriculum prepared by two experts that targeted both cognitive and psychomotor cystoscopic and ureteroscopic skills. Ten urology residents from a single institution with different levels of training were assessed on a series of stations that targeted these skills. Evaluation of cognitive skills was done via a written examination, and psychomotor skills assessment was done by experts using both subjective and objective metrics. Twelve of 15 cognitive tasks and 5 of 5 psychomotor tasks demonstrated construct validity with correlation coefficient (r) more than .75. All three of the cognitive tasks that failed to initially demonstrate validity did so on editorial revision and restructuring of the questions. Our cystoscopic and ureteroscopic OSATS showed excellent construct validity for our population of residents, and we have incorporated it into our urologic skills curriculum.

  7. Impact of tailored feedback in assessment of communication skills for medical students.

    Science.gov (United States)

    Uhm, Seilin; Lee, Gui H; Jin, Jeong K; Bak, Yong I; Jeoung, Yeon O; Kim, Chan W

    2015-01-01

    Finding out the effective ways of teaching and assessing communication skills remain a challenging part of medication education. This study aims at exploring the usefulness and effectiveness of having additional feedback using qualitative analysis in assessment of communication skills in undergraduate medical training. We also determined the possibilities of using qualitative analysis in developing tailored strategies for improvement in communication skills training. This study was carried out on medical students (n=87) undergoing their final year clinical performance examination on communication skills using standardized patient by video-recording and transcribing their performances. Video-recordings of 26 students were randomly selected for qualitative analysis, and additional feedback was provided. We assessed the level of acceptance of communication skills scores between the study and nonstudy group and within the study group, before and after receiving feedback based on qualitative analysis. There was a statistically significant increase in the level of acceptance of feedback after delivering additional feedback using qualitative analysis, where the percentage of agreement with feedback increased from 15.4 to 80.8% (pcommunication skills assessment gives essential information for medical students to learn and self-reflect, which could potentially lead to improved communication skills. As evident from our study, feedback becomes more meaningful and effective with additional feedback using qualitative analysis.

  8. Psychomotor skills assessment by motion analysis in minimally invasive surgery on an animal organ.

    Science.gov (United States)

    Hofstad, Erlend Fagertun; Våpenstad, Cecilie; Bø, Lars Eirik; Langø, Thomas; Kuhry, Esther; Mårvik, Ronald

    2017-08-01

    A high level of psychomotor skills is required to perform minimally invasive surgery (MIS) safely. To be able to measure these skills is important in the assessment of surgeons, as it enables constructive feedback during training. The aim of this study was to test the validity of an objective and automatic assessment method using motion analysis during a laparoscopic procedure on an animal organ. Experienced surgeons in laparoscopy (experts) and medical students (novices) performed a cholecystectomy on a porcine liver box model. The motions of the surgical tools were acquired and analyzed by 11 different motion-related metrics, i.e., a total of 19 metrics as eight of them were measured separately for each hand. We identified for which of the metrics the experts outperformed the novices. In total, two experts and 28 novices were included. The experts achieved significantly better results for 13 of the 19 instrument motion metrics. Expert performance is characterized by a low time to complete the cholecystectomy, high bimanual dexterity (instrument coordination), a limited amount of movement and low measurement of motion smoothness of the dissection instrument, and relatively high usage of the grasper to optimize tissue positioning for dissection.

  9. ENHANCING STUDENTS’ COMMUNICATION SKILLS THROUGH TREFFINGER TEACHING MODEL

    Directory of Open Access Journals (Sweden)

    Idrus Alhaddad

    2015-01-01

    Full Text Available This research aims to  investigate, compare, and describe the achievement and enhancement of students’ mathematical communication skills (MCS.  It based on the prior mathematical knowledge (PMK category (high, medium and low by using Treffinger models (TM and conventional learning (CL. This research is an experimental study with the population of all students of Mathematics Education Department who took Discrete Mathematics subject matter of one university in the city of Ternate. The results show that (1 the achievement and enhancement of MCS  students that used  TM are higher than the students learning using CL; (2 Based on the categories of PMK, the achievement and enhancement of MCS of students using TM are also higher than those learning with CL; and  (3 There was no interaction effect between learning (TM and CL and PMK to the achievement and enhancement of MCS of the students.Keyword: Communication Skills, Prior Mathematical Knowledge, Treffinger Model DOI: dx.doi.org/10.22342/jme.61.31

  10. MJO simulation in CMIP5 climate models: MJO skill metrics and process-oriented diagnosis

    Science.gov (United States)

    Ahn, Min-Seop; Kim, Daehyun; Sperber, Kenneth R.; Kang, In-Sik; Maloney, Eric; Waliser, Duane; Hendon, Harry

    2017-12-01

    The Madden-Julian Oscillation (MJO) simulation diagnostics developed by MJO Working Group and the process-oriented MJO simulation diagnostics developed by MJO Task Force are applied to 37 Coupled Model Intercomparison Project phase 5 (CMIP5) models in order to assess model skill in representing amplitude, period, and coherent eastward propagation of the MJO, and to establish a link between MJO simulation skill and parameterized physical processes. Process-oriented diagnostics include the Relative Humidity Composite based on Precipitation (RHCP), Normalized Gross Moist Stability (NGMS), and the Greenhouse Enhancement Factor (GEF). Numerous scalar metrics are developed to quantify the results. Most CMIP5 models underestimate MJO amplitude, especially when outgoing longwave radiation (OLR) is used in the evaluation, and exhibit too fast phase speed while lacking coherence between eastward propagation of precipitation/convection and the wind field. The RHCP-metric, indicative of the sensitivity of simulated convection to low-level environmental moisture, and the NGMS-metric, indicative of the efficiency of a convective atmosphere for exporting moist static energy out of the column, show robust correlations with a large number of MJO skill metrics. The GEF-metric, indicative of the strength of the column-integrated longwave radiative heating due to cloud-radiation interaction, is also correlated with the MJO skill metrics, but shows relatively lower correlations compared to the RHCP- and NGMS-metrics. Our results suggest that modifications to processes associated with moisture-convection coupling and the gross moist stability might be the most fruitful for improving simulations of the MJO. Though the GEF-metric exhibits lower correlations with the MJO skill metrics, the longwave radiation feedback is highly relevant for simulating the weak precipitation anomaly regime that may be important for the establishment of shallow convection and the transition to deep convection.

  11. Development of a Social Skills Assessment Screening Scale for Psychiatric Rehabilitation Settings: A Pilot Study.

    Science.gov (United States)

    Bhola, Poornima; Basavarajappa, Chethan; Guruprasad, Deepti; Hegde, Gayatri; Khanam, Fatema; Thirthalli, Jagadisha; Chaturvedi, Santosh K

    2016-01-01

    Deficits in social skills may present in a range of psychiatric disorders, particularly in the more serious and persistent conditions, and have an influence on functioning across various domains. This pilot study aimed at developing a brief measure, for structured evaluation and screening for social skills deficits, which can be easily integrated into routine clinical practice. The sample consisted of 380 inpatients and their accompanying caregivers, referred to Psychiatric Rehabilitation Services at a tertiary care government psychiatric hospital. The evaluation included an Inpatient intake Proforma and the 20-item Social Skills Assessment Screening Scale (SSASS). Disability was assessed using the Indian Disability Evaluation and Assessment Scale (IDEAS) for a subset of 94 inpatients. The analysis included means and standard deviations, frequency and percentages, Cronbach's alpha to assess internal consistency, t -tests to assess differences in social skills deficits between select subgroups, and correlation between SSASS and IDEAS scores. The results indicated the profile of social skills deficits assessed among the inpatients with varied psychiatric diagnoses. The "psychosis" group exhibited significantly higher deficits than the "mood disorder" group. Results indicated high internal consistency of the SSASS and adequate criterion validity demonstrated by correlations with select IDEAS domains. Modifications were made to the SSASS following the pilot study. The SSASS has potential value as a measure for screening and individualised intervention plans for social skills training in mental health and rehabilitation settings. The implications for future work on the psychometric properties and clinical applications are discussed.

  12. [Assessment of clinical observation skills of last year medical students].

    Science.gov (United States)

    Steichen, O; Georgin-Lavialle, S; Grateau, G; Ranque, B

    2015-05-01

    Clinical examination skills are poorly evaluated by theoretical tests. We observed the clinical examination of real patients by 6th year medical students. Four internists involved in teaching activities defined 11 clinical examination items, with two objective performance criteria each. The students were evaluated in two internal medicine departments during the rotation preceding or following their national graduation test. Scores by item and by criterion and an overall score were calculated and correlated with their rank at the national graduation test. Thirty-two students were evaluated in one department and 18 in the other; each evaluation lasted approximately 30 minutes. The results were similar in both departments. Only 2 items got a score over 75% in this students' sample (acute respiratory failure, peripheral pulses); 4 items were satisfied at less than 50% (lymph nodes, right heart failure, liver failure, and attention). The mean overall score was 6.5/11 (standard deviation 1.5). National rankings were good (median 1605/8001, interquartile 453-3036) but uncorrelated with the global score (Spearman coefficient -0.13; P=0.39). Bedside evaluation of the students reveals substantial deficiencies, a few months or weeks before taking their position as residents. Several elementary skills are mastered by a minority of them (search for an asterixis, distended jugular veins, deep tendon reflexes), even among those successful at the national graduation test. Bedside evaluation of clinical examination skills should be more systematically performed. Copyright © 2014 Société nationale française de médecine interne (SNFMI). Published by Elsevier SAS. All rights reserved.

  13. Identifying and assessing the factors affecting skill gap in digital marketing in communication industry companies

    Directory of Open Access Journals (Sweden)

    Fereshteh Ghotbifar

    2017-03-01

    Full Text Available As far as new communication channels are concerned, there have been extensive developments in communications and marketing in digital era. Today, therefore, companies try to take advantage of digital marketing channels to provide suitable services to customers to improve their satisfaction level. However, this study aimed to identify and assess factors affecting skill gap in digital marketing. This was descriptive correlation study. The population consisted of experts in communications industry to identify most important skill gaps in digital marketing and factors affecting them; also, managers and specialists of these companies were investigated to determine the role of identified factors in reducing skills gaps. Using localized questionnaire and interviewing with ten experts who were selected by Delphi snowball method, the skill gaps in marketing and factors affecting them were identified. Also, a researcher made questionnaire with 32 questions was distributed among 226 employees to investigate the identified factors role in reducing skills gap in digital marketing. The results showed that from four identified factors, the components including operational strategic factors and environmental factors had direct and positive impact on creating skill gap in digital marketing of studied companies. The environmental factors such as social and cultural conditions, religion, technology, and economy had more proactive impact on skills gap in digital marketing. Also, the results showed that among skills gaps in digital marketing of studied companies, the skills (Principles of Communication and (Predicting Future had the highest and lowest gaps, respectively.

  14. Video and accelerometer-based motion analysis for automated surgical skills assessment.

    Science.gov (United States)

    Zia, Aneeq; Sharma, Yachna; Bettadapura, Vinay; Sarin, Eric L; Essa, Irfan

    2018-03-01

    Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

  15. Peer-assessment of medical communication skills: the impact of students' personality, academic and social reputation on behavioural assessment

    NARCIS (Netherlands)

    Hulsman, Robert L.; Peters, Joline F.; Fabriek, Marcel

    2013-01-01

    Peer-assessment of communication skills may contribute to mastery of assessment criteria. When students develop the capacity to judge their peers' performance, they might improve their capacity to examine their own clinical performance. In this study peer-assessment ratings are compared to

  16. Using Portfolio to Assess Rural Young Learners' Writing Skills in English Language Classroom

    Science.gov (United States)

    Aziz, Muhammad Noor Abdul; Yusoff, Nurahimah Mohd.

    2015-01-01

    This study aimed at discussing the benefits of portfolio assessment in assessing students' writing skills. The study explores the use of authentic assessment in the classroom. Eleven primary school children from Year 4 in a rural school in Sabah participated in this study. Data were collected by observing them during the English Language lessons…

  17. Assessing the Clinical Skills of Dental Students: A Review of the Literature

    Science.gov (United States)

    Taylor, Carly L.; Grey, Nick; Satterthwaite, Julian D.

    2013-01-01

    Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

  18. Assessing soft skills of undergraduate students: framework for improving competitiveness, innovation and competence of higher education graduates

    Directory of Open Access Journals (Sweden)

    Ansar

    2018-04-01

    Full Text Available Research shows that soft skills, such as teamwork capability, creativity, time management, problem solving skills, communication skills, conflict management, leadership skills, cultural awareness, information management skills and work ethic, are the affective skills most demanded by industries/companies of today's entry-level employees. However, it is this same set of skills that industries claim are still not adequately teaching to the students in the higher education. The research was aimed at identifying life skill formation based teaching and learning model and concept by integrating and synergizing hard skills and soft skills. The research results in the mapped soft skill mastery profile of the students that was at the high category of 72,24%. The mapping will be used as the basic reference for the teaching and learning model developed in this research.

  19. Influence Learning Model ARIAS and ARIAS Combined Concept maps to Critical Thinking Skills, Cognitive, and Affective

    Directory of Open Access Journals (Sweden)

    Ismail Ismail

    2014-06-01

    Full Text Available Pengaruh Model Pembelajaran ARIAS dan ARIAS Dipadu Peta Konsep terhadap Kemampuan Berpikir Kritis, Kognitif, dan Afektif Abstract: The learning model Assurance, Relevance, Interest, Assessment, and Satisfaction (ARIAS combined concept maps can enhance critical thinking skills, cognitive, and affective. The study aims to examine the effect of learning model ARIAS, combined ARIAS concept maps and concept maps on the ability of critical thinking, cognitive, and affective. The research data were collected through the test description and observation sheet. The result showed that the average value of critical thinking skills, cognitive and affective for group learning model combined ARIAS Concept maps very well classified category, class learning ARIAS treatment, and treatment classes Concept maps including both categories. Key Words: influence, ARIAS, concept maps, critical thinking, cognitive, and affective Abstrak: Model pembelajaran Assurance, Relevance, Interest, Assessment, dan Satisfaction (ARIAS  dipadu peta konsep dapat meningkatkan kemampuan berpikir kritis, kognitif, dan afektif. Penelitian bertujuan untuk menguji pengaruh model pembelajaran ARIAS, ARIAS dipadu peta konsep, dan peta konsep terhadap kemampuan berpikir kritis, kognitif, dan afektif. Data penelitian dikumpulkan melalui tes uraian dan lembar observasi. Hasil analisis data menunjukkan bahwa nilai rata-rata kemampuan berpikir kritis, kognitif dan afektif untuk kelompok model pembelajaran ARIAS dipadu Peta Konsep tergolong kategori sangat baik, kelas perlakuan pembelajaran ARIAS, dan kelas perlakuan Peta Konsep termasuk kategori baik. Kata kunci: pengaruh, ARIAS, peta konsep, berpikir kritis, kognitif, afektif

  20. Students’ performance in the different clinical skills assessed in OSCE: what does it reveal?

    Directory of Open Access Journals (Sweden)

    Joong Hiong Sim

    2015-02-01

    Full Text Available Introduction: The purpose of this study was to compare students’ performance in the different clinical skills (CSs assessed in the objective structured clinical examination. Methods: Data for this study were obtained from final year medical students’ exit examination (n=185. Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Results: Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs, procedural skills (PSs, and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332=20.253, p<0.001]. Pairwise multiple comparisons revealed significant differences between the means of the eight pairs of CSs assessed, at p<0.05. Conclusions: CRSs appeared to be the weakest while PSs were the strongest, among the six CSs assessed. Students’ unsatisfactory performance in CRS needs to be addressed as CRS is one of the core competencies in medical education and a critical skill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students’ clinical reasoning development.

  1. Students’ performance in the different clinical skills assessed in OSCE: what does it reveal?

    Science.gov (United States)

    Sim, Joong Hiong; Abdul Aziz, Yang Faridah; Mansor, Azura; Vijayananthan, Anushya; Foong, Chan Choong; Vadivelu, Jamuna

    2015-01-01

    Introduction The purpose of this study was to compare students’ performance in the different clinical skills (CSs) assessed in the objective structured clinical examination. Methods Data for this study were obtained from final year medical students’ exit examination (n=185). Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Results Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs), procedural skills (PSs), and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332)=20.253, p<0.001]. Pairwise multiple comparisons revealed significant differences between the means of the eight pairs of CSs assessed, at p<0.05. Conclusions CRSs appeared to be the weakest while PSs were the strongest, among the six CSs assessed. Students’ unsatisfactory performance in CRS needs to be addressed as CRS is one of the core competencies in medical education and a critical skill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students’ clinical reasoning development. PMID:25697602

  2. How to Assess Creative Thinking Skill in Making Products of Liquid Pressure?

    Science.gov (United States)

    Chasanah, L.; Kaniawati, I.; Hernani, H.

    2017-09-01

    The primary skills that must be possessed in the 21st century curriculum are learning and innovation skills. One of the learning strategies that can train students to innovate and improve creative thinking skills is by applying Science, Technology, Engineering and Mathematics (STEM) in learning. Based on an interview to one of the science teachers that learning that aims to train learning and innovation skills has not been applied to learning in the classroom because there is not enough time, learning materials and assessment instruments used. This study aims to determine the results of the implementation of performance assessment of creative thinking skills on STEM-based learning in junior high school for the material of liquid pressure. This research uses descriptive method. Participants in this study were junior high school students 8th in Kudus area. The research instrument consists of observation sheet, performance assessment and documentation. The result showed that creative thinking skills performance assessment can assess student’s creativity in making products of STEM-based learning for junior high school.

  3. The Development and Validation of a Golf Swing and Putt Skill Assessment for Children

    Directory of Open Access Journals (Sweden)

    Lisa M. Barnett, Louise L. Hardy, Ali S. Brian

    2015-03-01

    Full Text Available The aim was to describe development of a process-oriented instrument designed to assess the golf swing and putt stroke, and to assess the instrument’s discriminative validity in terms of age and reliability (intra-rater and re-test. A Delphi consultation (with golf industry professionals and researchers in movement skill assessment was used to develop an assessment for each skill based on existing skill assessment protocols. Each skill had six components to be marked as present/absent. Individual scores were based on the number of performance components successfully demonstrated over two trials for each skill (potential score range 0 to 24. Children (n = 43 aged 6-10 years (M = 7.8 years, SD = 1.3 were assessed in both skills live in the field by one rater at Time 1(T1. A subset of children (n = 28 had consent for assessments to be videoed. Six weeks later 19 children were reassessed, five days apart (T2, T3. An ANOVA assessed discriminative validity i.e. whether skill competence at T1 differed by age (6 years, 7/8 years and 9/10 years. Intraclass correlations (ICC assessed intra-rater reliability between the live and video assessment at T1 and test-retest reliability (between T2 and T3. Paired t-tests assessed any systematic differences between live and video assessments (T1 and between T2 and T3. Older children were more skilled (F (2, 40 = 11.18, p < 0.001. The live assessment reflected the video assessment (ICC = 0.79, 95% CI 0.59, 0.90 and scores did not differ between live and video assessments. Test retest reliability was acceptable (ICC = 0.60, 95% CI 0.23, 0.82, although the mean score was slightly higher at retest. This instrument could be used reliably by golf coaches and physical education teachers as part of systematic early player assessment and feedback.

  4. Enhancing paramedics procedural skills using a cadaveric model.

    Science.gov (United States)

    Lim, David; Bartlett, Stephen; Horrocks, Peter; Grant-Wakefield, Courtenay; Kelly, Jodie; Tippett, Vivienne

    2014-07-08

    Paramedic education has evolved in recent times from vocational post-employment to tertiary pre-employment supplemented by clinical placement. Simulation is advocated as a means of transferring learned skills to clinical practice. Sole reliance of simulation learning using mannequin-based models may not be sufficient to prepare students for variance in human anatomy. In 2012, we trialled the use of fresh frozen human cadavers to supplement undergraduate paramedic procedural skill training. The purpose of this study is to evaluate whether cadaveric training is an effective adjunct to mannequin simulation and clinical placement. A multi-method approach was adopted. The first step involved a Delphi methodology to formulate and validate the evaluation instrument. The instrument comprised of knowledge-based MCQs, Likert for self-evaluation of procedural skills and behaviours, and open answer. The second step involved a pre-post evaluation of the 2013 cadaveric training. One hundred and fourteen students attended the workshop and 96 evaluations were included in the analysis, representing a return rate of 84%. There was statistically significant improved anatomical knowledge after the workshop. Students' self-rated confidence in performing procedural skills on real patients improved significantly after the workshop: inserting laryngeal mask (MD 0.667), oropharyngeal (MD 0.198) and nasopharyngeal (MD 0.600) airways, performing Bag-Valve-Mask (MD 0.379), double (MD 0.344) and triple (MD 0.326,) airway manoeuvre, doing 12-lead electrocardiography (MD 0.729), using laryngoscope (MD 0.726), using Magill® forceps to remove foreign body (MD 0.632), attempting thoracocentesis (MD 1.240), and putting on a traction splint (MD 0.865). The students commented that the workshop provided context to their theoretical knowledge and that they gained an appreciation of the differences in normal tissue variation. Following engagement in/ completion of the workshop, students were more aware

  5. Modelling Graduate Skill Transfer from University to the Workplace

    Science.gov (United States)

    Jackson, Denise

    2016-01-01

    This study explores skill transfer in graduates as they transition from university to the workplace. Graduate employability continues to dominate higher education agendas yet the transfer of acquired skills is often assumed. The study is prompted by documented concern with graduate performance in certain employability skills, and prevalent skill…

  6. Zoo U: A Stealth Approach to Social Skills Assessment in Schools

    Directory of Open Access Journals (Sweden)

    Melissa E. DeRosier

    2012-01-01

    Full Text Available This paper describes the design and evaluation of Zoo U, a novel computer game to assess children’s social skills development. Zoo U is an innovative product that combines theory-driven content and customized game mechanics. The game-like play creates the opportunity for stealth assessment, in which dynamic evidence of social skills is collected in real time and players’ choices during gameplay provide the needed data. To ensure the development of an engaging and valid game, we utilized an iterative data-driven validation process in which the game was created, tested, revised based on student performance and feedback, and retested until game play was statistically matched to independent ratings of social skills. We first investigated whether the data collected through extensive logging of student actions provided information that could be used to improve the assessment. We found that detailed game logs of socially relevant player behavior combined with external measures of player social skills provided an efficient vector to incrementally improve the accuracy of the embedded assessments. Next, we investigated whether the game performance correlated with teachers’ assessments of students’ social skills competencies. An evaluation of the final game showed (a significant correlations between in-game social skills assessments and independently obtained standard psychological assessments of the same students and (b high levels of engagement and likeability for students. These findings support the use of the interactive and engaging computer game format for the stealth assessment of children’s social skills. The created innovative design methodologies should prove useful in the design and improvement of computer games in education.

  7. Digital Games as Tools for Stimulating and Assessing Reasoning Skills

    Directory of Open Access Journals (Sweden)

    Rosa Maria Bottino

    2016-04-01

    Full Text Available This paper offers some thoughts on the use of educational digital logic games. Specifically refers to a number of research experiments conducted by ITD-CNR, which have highlighted the significant potential of digital games to help develop and/or consolidation of logical thinking and reasoning skills in students of primary and secondary school level. It offers a brief overview of four research experiences carried out by multidisciplinary teams coordinated by ITD-CNR since the early 2000s These experiences have highlighted the high potential of digital games to develop and strengthen logical thinking skills and have shown the positive impact of their use even on school performance. Verificare e stimolare le abilità di ragionamento con i giochi digitaliQuesto contributo propone alcune riflessioni sull’uso educativo dei giochi logici digitali. In particolare fa riferimento ad alcune esperienze di ricerca condotte dall’Istituto di Tecnologie Didattiche - Consiglio Nazionale delle Ricerche (ITD-CNR che hanno evidenziato le interessanti potenzialità dei giochi digitali per contribuire allo sviluppo e/o al consolidamento del pensiero logico e delle abilità di ragionamento in studenti di scuola primaria e secondaria di primo grado. Si propone un breve excursus su quattro esperienze di ricerca svolte da equipe multidisciplinari coordinate da ITD-CNR a partire dai primi anni Duemila. Tali esperienze hanno messo in luce l’alto potenziale dei giochi digitali per sviluppare e potenziare abilità di pensiero logico ed hanno evidenziato il positivo impatto del loro uso anche sul rendimento scolastico.

  8. The Dutch motor skills assessment as tool for talent development in table tennis : a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, Irene R.; Nijhuis-Van der Sanden, Maria W. G.; Elferink-Gemser, Marije T.; Oosterveld, Frits G. J.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  9. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.G.; Elferink-Gemser, M.T.; Oosterveld, F.G.

    2015-01-01

    A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in their

  10. The Dutch motor skills assessment as tool for talent development in table tennis: a reproducibility and validity study

    NARCIS (Netherlands)

    Faber, I.R.; Nijhuis-Van der Sanden, M.W.; Elferink-Gemser, M.T.; Oosterveld, F.G.J.

    2014-01-01

    Abstract A motor skills assessment could be helpful in talent development by estimating essential perceptuo-motor skills of young players, which are considered requisite to develop excellent technical and tactical qualities. The Netherlands Table Tennis Association uses a motor skills assessment in

  11. Teaching domain-specific skills before peer assessment skills is superior to teaching them simultaneously

    NARCIS (Netherlands)

    J.J.G. van Merriënboer; Marjo van Zundert; Dominique Sluijsmans; K. Könings

    2012-01-01

    Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students

  12. Can Perceptuo-Motor Skills Assessment Outcomes in Young Table Tennis Players (7-11 years) Predict Future Competition Participation and Performance? An Observational Prospective Study.

    Science.gov (United States)

    Faber, Irene R; Elferink-Gemser, Marije T; Faber, Niels R; Oosterveld, Frits G J; Nijhuis-Van der Sanden, Maria W G

    2016-01-01

    Forecasting future performance in youth table tennis players based on current performance is complex due to, among other things, differences between youth players in growth, development, maturity, context and table tennis experience. Talent development programmes might benefit from an assessment of underlying perceptuo-motor skills for table tennis, which is hypothesized to determine the players' potential concerning the perceptuo-motor domain. The Dutch perceptuo-motor skills assessment intends to measure the perceptuo-motor potential for table tennis in youth players by assessing the underlying skills crucial for developing technical and tactical qualities. Untrained perceptuo-motor tasks are used as these are suggested to represent a player's future potential better than specific sport skills themselves as the latter depend on exposure to the sport itself. This study evaluated the value of the perceptuo-motor skills assessment for a talent developmental programme by evaluating its predictive validity for competition participation and performance in 48 young table tennis players (7-11 years). Players were tested on their perceptuo-motor skills once during a regional talent day, and the subsequent competition results were recorded half-yearly over a period of 2.5 years. Logistic regression analysis showed that test scores did not predict future competition participation (p >0.05). Yet, the Generalized Estimating Equations analysis, including the test items 'aiming at target', 'throwing a ball', and 'eye-hand coordination' in the best fitting model, revealed that the outcomes of the perceptuo-motor skills assessment were significant predictors for future competition results (R2 = 51%). Since the test age influences the perceptuo-motor skills assessment's outcome, another multivariable model was proposed including test age as a covariate (R2 = 53%). This evaluation demonstrates promising prospects for the perceptuo-motor skills assessment to be included in a talent

  13. Developing learning community model with soft skill integration for the building engineering apprenticeship programme in vocational high school

    Science.gov (United States)

    Sutrisno, Dardiri, Ahmad; Sugandi, R. Machmud

    2017-09-01

    This study aimed to address the procedure, effectiveness, and problems in the implementation of learning model for Building Engineering Apprenticeship Training Programme. This study was carried out through survey method and experiment. The data were collected using questionnaire, test, and assessment sheet. The collected data were examined through description, t-test, and covariance analysis. The results of the study showed that (1) the model's procedure covered preparation course, readiness assessment, assignment distribution, handing over students to apprenticeship instructors, task completion, assisting, field assessment, report writing, and follow-up examination, (2) the Learning Community model could significantly improve students' active learning, but not improve students' hard skills and soft skills, and (3) the problems emerging in the implementation of the model were (1) students' difficulties in finding apprenticeship places and qualified instructors, and asking for relevant tasks, (2) teachers' difficulties in determining relevant tasks and monitoring students, and (3) apprenticeship instructors' difficulties in assigning, monitoring, and assessing students.

  14. Assessing Thinking Skills in Astro 101: Do We Make an Impact?

    Science.gov (United States)

    Bruning, D.

    2005-12-01

    Most instructors agree that a major goal of "Astronomy 101" is to develop thinking skills in our students (Partridge and Greenstein, AER 2, 46, 2003). Much educational research in astronomy has initially concentrated on "best practices" for improving student learning (development of "think-pair-share", lecture tutorials, peer tutoring, etc.). Little has been done to date to assess our efforts to improve student thinking skills and students' desire to think more deeply about the cognitively rich ideas offered in the typical astronomy class. This study surveys several astronomy and physics courses to determine whether general analytical thinking skills increase because of the science course and whether students' attitudes toward cognition improve. Cacioppo, Petty and Kao's "Need for Cognition" scale is used for the latter assessment (J. Personality Assessment 48, 306, 1984). A shortened version of Whimbey and Lochhead's ASI skills instrument is used to assess analytical skills ("Problem Solving and Comprehension," 1986). Preliminary results suggest that students need for cognition does not change in general, although there may be a correlation between increasing need for cognition and improvement in grades through the semester. There is a suggestion that need for cognition is slightly predictive of course performance, but a greater correlation exists between the post-course survey and grades. Gains in general analytical skills have been seen in initial surveys, but correlations with course performance appear elusive.

  15. Accuracy and Reliability of Peer Assessment of Athletic Training Psychomotor Laboratory Skills

    Science.gov (United States)

    Marty, Melissa C.; Henning, Jolene M.; Willse, John T.

    2010-01-01

    Abstract Context: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. Objective: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. Design: Cross-sectional study. Setting: Entry-level master's athletic training education program. Patients or Other Participants: First-year (n  =  5) and second-year (n  =  8) students. Main Outcome Measure(s): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. Results: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the ϕ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (ϕ  =  0.79) for the Faber test, with 1 participant on 2 occasions (ϕ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (ϕ  =  0.72). Conclusions: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was

  16. Ready for OR or not? Human reader supplements Eyesi scoring in cataract surgical skills assessment

    Directory of Open Access Journals (Sweden)

    Selvander M

    2013-10-01

    Full Text Available Madeleine Selvander,1,2 Peter Åsman11Department of Clinical Sciences, Malmö: Ophthalmology, Lund University, Malmö, Sweden; 2Practicum Clinical Skills Centre, Skåne University Hospital, Malmö, SwedenPurpose: To compare the internal computer-based scoring with human-based video scoring of cataract modules in the Eyesi virtual reality intraocular surgical simulator, a comparative case series was conducted at the Department of Clinical Sciences – Ophthalmology, Lund University, Skåne University Hospital, Malmö, Sweden.Methods: Seven cataract surgeons and 17 medical students performed one video-recorded trial with each of the capsulorhexis, hydromaneuvers, and phacoemulsification divide-and-conquer modules. For each module, the simulator calculated an overall score for the performance ranging from 0 to 100. Two experienced masked cataract surgeons analyzed each video using the Objective Structured Assessment of Cataract Surgical Skill (OSACSS for individual models and modified Objective Structured Assessment of Surgical Skills (OSATS for all three modules together. The average of the two assessors' scores for each tool was used as the video-based performance score. The ability to discriminate surgeons from naive individuals using the simulator score and the video score, respectively, was compared using receiver operating characteristic (ROC curves.Results: The ROC areas for simulator score did not differ from 0.5 (random for hydromaneuvers and phacoemulsification modules, yielding unacceptably poor discrimination. OSACSS video scores all showed good ROC areas significantly different from 0.5. The OSACSS video score was also superior compared to the simulator score for the phacoemulsification procedure: ROC area 0.945 vs 0.664 for simulator score (P = 0.010. Corresponding values for capsulorhexis were 0.887 vs 0.761 (P = 0.056 and for hydromaneuvers 0.817 vs 0.571 (P = 0.052 for the video scores and simulator scores, respectively.The ROC

  17. Medical students on the value of role models for developing 'soft skills'

    African Journals Online (AJOL)

    Adele

    later career choices.4,5,8 Students evaluate their clinical teachers not only on their practical clinical skills, but also on their soft skills. The aim of this paper is to present medical students' views of role models and their effect on students' personal and professional development, reporting on one of the findings of the Soft Skills ...

  18. Testing a Model of Undergraduate Competence in Employability Skills and Its Implications for Stakeholders

    Science.gov (United States)

    Jackson, Denise

    2014-01-01

    Despite the development of employability skills being firmly entrenched in higher education's strategic agenda worldwide; recent graduates' standards in certain skills are not meeting industry expectations. This paper presents and tests a model of undergraduate competence in employability skills. It highlights those factors which impact on…

  19. The development and implementation of an instrument to assess students' data analysis skills in molecular biology.

    Science.gov (United States)

    Rybarczyk, Brian J; Walton, Kristen L W; Grillo, Wendy Heck

    2014-12-01

    Developing visual literacy skills is an important component of scientific literacy in undergraduate science education. Comprehension, analysis, and interpretation are parts of visual literacy that describe related data analysis skills important for learning in the biological sciences. The Molecular Biology Data Analysis Test (MBDAT) was developed to measure students' data analysis skills connected with scientific reasoning when analyzing and interpreting scientific data generated from experimental research. The skills analyzed included basic skills, such as identification of patterns and trends in data and connecting a method that generated the data, and advanced skills, such as distinguishing positive and negative controls, synthesizing conclusions, determining if data supports a hypothesis, and predicting alternative or next-step experiments. Construct and content validity were established and calculated statistical parameters demonstrate that the MBDAT is valid and reliable for measuring students' data analysis skills in molecular and cell biology contexts. The instrument also measures students' perceived confidence in their data interpretation abilities. As scientific research continues to evolve in complexity, interpretation of scientific information in visual formats will continue to be an important component of scientific literacy. Thus science education will need to support and assess students' development of these skills as part of students' scientific training.

  20. Neurosurgical Skills Assessment: Measuring Technical Proficiency in Neurosurgery Residents Through Intraoperative Video Evaluations.

    Science.gov (United States)

    Sarkiss, Christopher A; Philemond, Steven; Lee, James; Sobotka, Stanislaw; Holloway, Terrell D; Moore, Maximillian M; Costa, Anthony B; Gordon, Errol L; Bederson, Joshua B

    2016-05-01

    Although technical skills are fundamental in neurosurgery, there is little agreement on how to describe, measure, or compare skills among surgeons. The primary goal of this study was to develop a quantitative grading scale for technical surgical performance that distinguishes operator skill when graded by domain experts (residents, attendings, and nonsurgeons). Scores provided by raters should be highly reliable with respect to scores from other observers. Neurosurgery residents were fitted with a head-mounted video camera while performing craniotomies under attending supervision. Seven videos, 1 from each postgraduate year (PGY) level (1-7), were anonymized and scored by 16 attendings, 8 residents, and 7 nonsurgeons using a grading scale. Seven skills were graded: incision, efficiency of instrument use, cauterization, tissue handling, drilling/craniotomy, confidence, and training level. A strong correlation was found between skills score and PGY year (P Technical skills of neurosurgery residents recorded during craniotomy can be measured with high interrater reliability. Surgeons and nonsurgeons alike readily distinguish different skill levels. This type of assessment could be used to coach residents, to track performance over time, and potentially to compare skill levels. Developing an objective tool to evaluate surgical performance would be useful in several areas of neurosurgery education. Copyright © 2016 Elsevier Inc. All rights reserved.

  1. The Development and Implementation of an Instrument to Assess Students’ Data Analysis Skills in Molecular Biology

    Directory of Open Access Journals (Sweden)

    Brian J. Rybarczyk

    2014-03-01

    Full Text Available Developing visual literacy skills is an important component of scientific literacy in undergraduate science education.  Comprehension, analysis, and interpretation are parts of visual literacy that describe related data analysis skills important for learning in the biological sciences. The Molecular Biology Data Analysis Test (MBDAT was developed to measure students’ data analysis skills connected with scientific reasoning when analyzing and interpreting scientific data generated from experimental research.  The skills analyzed included basic skills such as identification of patterns and trends in data and connecting a method that generated the data and advanced skills such as distinguishing positive and negative controls, synthesizing conclusions, determining if data supports a hypothesis, and predicting alternative or next-step experiments.  Construct and content validity were established and calculated statistical parameters demonstrate that the MBDAT is valid and reliable for measuring students’ data analysis skills in molecular and cell biology contexts.  The instrument also measures students’ perceived confidence in their data interpretation abilities.  As scientific research continues to evolve in complexity, interpretation of scientific information in visual formats will continue to be an important component of scientific literacy.  Thus science education will need to support and assess students’ development of these skills as part of students’ scientific training.

  2. Enhancing Students’ Communication Skills Through Treffinger Teaching Model

    Directory of Open Access Journals (Sweden)

    Idrus Alhaddad

    2015-10-01

    Full Text Available This research aims to investigate, compare, and describe the achievement and enhancement of students’ mathematical communication skills (MCS. It based on the prior mathematical knowledge (PMK category (high, medium and low by using Treffinger models (TM and conventional learning (CL. This research is an experimental study with the population of all students of Mathematics Education Department who took Discrete Mathematics subject matter of one university in the city of Ternate. The results show that (1 the achievement and enhancement of MCS students that used TM are higher than the students learning using CL; (2 Based on the categories of PMK, the achievement and enhancement of MCS of students using TM are also higher than those learning with CL; and (3 There was no interaction effect between learning (TM and CL and PMK to the achievement and enhancement of MCS of the students

  3. Can both residents and chief physicians assess surgical skills?

    DEFF Research Database (Denmark)

    Oestergaard, Jeanett; Larsen, Christian Rifbjerg; Maagaard, Mathilde

    2012-01-01

    It is known that structured assessment of an operation can provide trainees with useful knowledge and potentially shorten their learning curve. However, methods for objective assessment have not been widely adopted into the clinical setting. This might be because of a lack of expertise using an a...

  4. Extending the Will, Skill, Tool Model of Technology Integration: Adding Pedagogy as a New Model Construct

    Science.gov (United States)

    Knezek, Gerald; Christensen, Rhonda

    2016-01-01

    An expansion of the Will, Skill, Tool Model of Technology Integration to include teacher's pedagogical style is proposed by the authors as a means of advancing the predictive power of the model for level of classroom technology integration to beyond 90%. Suggested advantages to this expansion include more precise identification of areas to be…

  5. Development and assessment of key skills in undergraduate students: An action-research experience

    Directory of Open Access Journals (Sweden)

    Ana Fernández-Santander

    2012-03-01

    Full Text Available Employers look for professionals able to work in a team, able to approach problems, with the capacity to analyze and resolve problems, under the constant renewal of knowledge and competencies. In this paper, a group of University teachers from different areas of knowledge presents an experience to introduce key employability skills in the higher education students’ curricula. This work has been developed under the action research scope. The first goal was to make an analysis of terms referred to key skills, generating an integrated denomination for each competency. The elaboration of general templates for key skills is proposed here as a useful tool that provides information about development, assessment and marking of each skill. Different types of rubrics and assessment templates, used during this experience, are presented. DOI: 10.18870/hlrc.v2i1.37

  6. Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists

    DEFF Research Database (Denmark)

    Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter; Konge, Lars

    2016-01-01

    Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N......-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse...

  7. Manual Skill Acquisition During Transesophageal Echocardiography Simulator Training of Cardiology Fellows: A Kinematic Assessment.

    Science.gov (United States)

    Matyal, Robina; Montealegre-Gallegos, Mario; Mitchell, John D; Kim, Han; Bergman, Remco; Hawthorne, Katie M; O'Halloran, David; Wong, Vanessa; Hess, Phillip E; Mahmood, Feroze

    2015-12-01

    To investigate whether a transesophageal echocardiography (TEE) simulator with motion analysis can be used to impart proficiency in TEE in an integrated curriculum-based model. A prospective cohort study. A tertiary-care university hospital. TEE-naïve cardiology fellows. Participants underwent an 8-session multimodal TEE training program. Manual skills were assessed at the end of sessions 2 and 8 using motion analysis of the TEE simulator's probe. At the end of the course, participants performed an intraoperative TEE; their examinations were video captured, and a blinded investigator evaluated the total time and image transitions needed for each view. Results are reported as mean±standard deviation, or median (interquartile range) where appropriate. Eleven fellows completed the knowledge and kinematic portions of the study. Five participants were excluded from the evaluation in the clinical setting because of interim exposure to TEE or having participated in a TEE rotation after the training course. An increase of 12.95% in post-test knowledge scores was observed. From the start to the end of the course, there was a significant reduction (pcardiology fellows can be complemented with kinematic analyses to objectify acquisition of manual skills during simulator-based training. Copyright © 2015 Elsevier Inc. All rights reserved.

  8. Assessment of Future Skills Requirements in the Hospitality Sector in Ireland, 2015-2020

    OpenAIRE

    2015-01-01

    The hospitality sector is one of the most important employment services sectors in the Irish economy, and there is significant potential for future expansion. The objective of this study is to assess the skills demand needs arising within the Hospitality sector in Ireland – hotels, restaurants, bars, canteens and catering – over the period to 2020. The aim is to ensure that there will be the right supply of skills to help drive domestic hospitality sector business and employment growth.

  9. Soft Skills assessment through virtual environments in the university sector : A narrative review

    OpenAIRE

    Ruiz Morales, Yovanni; Biencinto López, Chantal; García García, Mercedes; Carpintero Molina, Elvira

    2017-01-01

    The paper presents a narrative on the state of the question about the teaching and assessment of generic soft skills through Virtual Environments (VEs) in universities, based on consultation of scientific journals in electronic and printed format published between 2000 and 2014, as well as research projects focused on the development of generic skills through VEs. The paper summarises the theoretical and empirical contributions as a way of providing a greater insight into a line of research t...

  10. THE METHODOLOGY OF ASSESSING CALL IN IMPROVING LISTENING SKILLS AMONG ENGINEERING COLLEGE STUDENTS

    OpenAIRE

    M.Anand

    2017-01-01

    In the recent trend and development, the scope for the study in improving language skills through CALL plays an important role in building a bridge between language and technology, the conceptual details of how computers could be used to learn language can be something inimitable and different. In this study, the researcher tries to find out The Methodology of Assessing CALL in Improving Listening Skills among Engineering College Students, Virudhunagar.

  11. Improving skills development in residency using a deliberate-practice and learner-centered model.

    Science.gov (United States)

    Bhatti, Nasir I; Ahmed, Aadil

    2015-10-01

    Work-hour restrictions, increased workload, and subjective assessment of competency are major threats to the efficacy of the traditional apprenticeship model of surgical training in modern surgical practice. In response, medical educators are developing time- and resource-efficient competency-based models of surgical training. The purpose of our project was to develop, implement, and measure the outcomes of such objective and structured programs in otolaryngology. We also investigated factors affecting the learning curve, especially deliberate practice, formative feedback, and learners' autonomy. Prospective, longitudinal study. To measure the surgical skills of residents, we first developed and tested objective tools for otolaryngology procedures. Based on these instruments, we identified milestones of the procedures. Training on a virtual-reality simulator was validated to shorten the learning curve. We also studied a learner-centered approach of training, factors affecting the learning curve, and barriers to a competency-based model. The objective tools were found to be a feasible, reliable, and valid opportunity for measuring competency in both the laboratory and operating room. With the formative assessment from these tools, residents had a remediation target to be achieved by deliberate practice. The milestones helped identify the threshold of competency, and deliberate practice on the simulator gave an opportunity for improving skills. The learner-centered approach allowed flexibility and personalized learning by shifting the responsibility of the learning process to the learners. The competency-based model of residency, based on the principles of deliberate practice and a learner-centered approach, is a feasible model of residency training that allows development of competent surgeons and hence improves patient outcomes. Despite these advantages, challenges to this model require a concerted effort to overcome and fully implement these principles of training

  12. The assessment of surgical skills as a complement to the training method. Revision.

    Science.gov (United States)

    Sánchez-Fernández, J; Bachiller-Burgos, J; Serrano-Pascual, Á; Cózar-Olmo, J M; Díaz-Güemes Martín-Portugués, I; Pérez-Duarte, F J; Hernández-Hurtado, L; Álvarez-Ossorio, J L; Sánchez-Margallo, F M

    2016-01-01

    The acquisition and improvement of surgical skills constitute a fundamental element in the training of any practitioner. At present, however, the assessment of these skills is a scarcely developed area of research. The aim of this study was to analyse the peculiarities of the various assessment systems and establish the minimum criteria that a skills and knowledge assessment system should meet as a method for assessing surgical skills in urological surgery. Scientific literature review aimed at the various currently available assessment systems for skills and competencies (technical and nontechnical), with a special focus on the systematic reviews and prospective studies. After conducting the review, we found that the various assessment systems for surgical competence have, in our opinion, a number of shortcomings. There is a certain degree of subjectivity in the assessment of surgeons by the evaluators. The assessment of nontechnical competencies is not formally recorded. There is no description of a follow-up assessment or any basic parameters associated with healthcare quality. There is no registration of associated competencies associated with the various surgical techniques. There is also no ranking of these competencies and the specific peculiarities for their application. We believe that the development of a new assessment system for surgical competencies (technical and nontechnical) aimed at assessing urologists in the various surgical techniques is necessary. To this end, our team has worked on developing the Evaluation System for Surgical Competencies on Laparoscopy, which is based on the definition, ranking and assessment of competencies demonstrated by surgeons. Copyright © 2015 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

  13. Evaluating first-year nursing students' ability to self-assess psychomotor skills using videotape.

    Science.gov (United States)

    Watts, Wilda Ellen; Rush, Kathy; Wright, Marjorie

    2009-01-01

    Developing confidence in self-assessment is an important skill in becoming a self-regulated learner. This article describes the process undertaken by a group of educators of incorporating self-assessment in combination with psychomotor skill development with freshman students. Students were videotaped performing a wound-dressing change; the videotaping was immediately followed by a self-assessment of their performance using a faculty-generated checklist. Comparison of faculty and student ratings revealed the tendency for students to overrate their performance and identified discordance between students and faculty on several steps of the procedure. These evaluation findings are discussed and future directions explored.

  14. Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills

    DEFF Research Database (Denmark)

    Jensen, Jesper Kørup; Dyre, Liv; Jørgensen, Mattis Enggaard

    2017-01-01

    skills assessed using a virtual reality ultrasound simulator. Procedural performance on the 4 FAST windows was assessed by automated simulator metrics, which received a passing or failing score. The validity evidence for these simulator metrics was examined by a stepwise approach according......OBJECTIVES: The aim of this study was to examine the validity of a simulator test designed to evaluate focused assessment with sonography for trauma (FAST) skills. METHODS: Participants included a group of ultrasound novices (n = 25) and ultrasound experts (n = 10). All participants had their FAST...

  15. Nonspecialist Raters Can Provide Reliable Assessments of Procedural Skills

    DEFF Research Database (Denmark)

    Mahmood, Oria; Dagnæs, Julia; Bube, Sarah

    2018-01-01

    BACKGROUND: Competency-based learning has become a crucial component in medical education. Despite the advantages of competency-based learning, there are still challenges that need to be addressed. Currently, the common perception is that specialist assessment is needed for evaluating procedural ...... study suggests that nonspecialist raters can provide reliable and valid assessments of video recorded cystoscopies. This could make mastery learning and competency-based education more feasible....

  16. Assessing neurosurgical non-technical skills: an exploratory study of a new behavioural marker system.

    Science.gov (United States)

    Michinov, Estelle; Jamet, Eric; Dodeler, Virginie; Haegelen, Claire; Jannin, Pierre

    2014-10-01

    The management of non-technical skills is a major factor affecting teamwork quality and patient safety. This article presents a behavioural marker system for assessing neurosurgical non-technical skills (BMS-NNTS). We tested the BMS during deep brain stimulation surgery. We developed the BMS in three stages. First, we drew up a provisional assessment tool based on the literature and observation tools developed for other surgical specialties. We then analysed videos made in an operating room (OR) during deep brain stimulation operations in order to ensure there were no significant omissions from the skills list. Finally, we used five videos of operations to identify the behavioural markers of non-technical skills in verbal communications. Analyses of more than six hours of observations revealed 3515 behaviours from which we determined the neurosurgeon's non-technical skills behaviour pattern. The neurosurgeon frequently engaged in explicit coordination, situation awareness and leadership behaviours. In addition, the neurosurgeon's behaviours differed according to the stage of the operation and the OR staff members with whom she was communicating. Our behavioural marker system provides a structured approach to assessing non-technical skills in the field of neurosurgery. It can also be transferred to other surgical specialties and used in surgeon training curricula. © 2014 John Wiley & Sons, Ltd.

  17. Profile of Students Communication Skills on Global Warming and Pollution Subject Using Conference Assessment

    Directory of Open Access Journals (Sweden)

    T. Gustiani

    2017-12-01

    Full Text Available This research purpose is to analyze the student’s communication skills using the conference assessment and student response of conference assessment implementation on global warming and pollution subject. The method used is descriptive. Participants included 34 students 11th grade in senior high school. Conference assessment applied through project based learning on global warming and pollution subject. Conference assessment consists of written conference using online access and oral conference in face-to-face classrooms. The conference was held in three sessions (project planning, project work, and project reflection. Students communication skills consist of five indicators based on 21st skills. The indicator was 1 articulate thoughts and ideas effectively; 2 listen effectively; 3 use communication for a range of purposes; 4 utilize multiple media and technologies; and 5 communicate effectively in diverse environments. The average score of communication skill skills categorized into three groups: high, medium and low. The data showed that three indicators in high categorized (83.09% in the second indicator during oral conference,  77.94% in the fourth indicator and 88.97% in the fifth indicator. And three indicators in medium categorized (64,71% in the first indicator, 56.62% in second indicator during written conference and 69.85% in the third indicator. Students showed a positive response to the implementation and results of conference assessment.

  18. A Classroom-Based Assessment Method to Test Speaking Skills in English for Specific Purposes

    Science.gov (United States)

    Alberola Colomar, María Pilar

    2014-01-01

    This article presents and analyses a classroom-based assessment method to test students' speaking skills in a variety of professional settings in tourism. The assessment system has been implemented in the Communication in English for Tourism course, as part of the Tourism Management degree programme, at Florida Universitaria (affiliated to the…

  19. Use of Digital Video to Assess Orientation and Mobility Observational Skills

    Science.gov (United States)

    Zebehazy, Kim T.; Zimmerman, George J.; Fox, Lynn A.

    2005-01-01

    This study compared the observational skills in orientation and mobility (O&M) of nine university students and nine certified O&M specialists using a digital video assessment. The students differed from the O&M specialists in their stylistic observations and the details of their responses. Implications for the improvement of video assessments are…

  20. Guidelines for Assessing Job-Related Social Skills of Mildly Handicapped Students.

    Science.gov (United States)

    Bullis, Michael; Foss, Gilbert

    1986-01-01

    Effective assessment of job-related social skills of mildly handicapped workers should consider three components of social competence: context, cognition, and performance. A comprehensive profile of social competence is best obtained through use of several assessment tools, such as: rating scales; role play; problem-solving tests; applied…

  1. Multimodal Emotion Recognition for Assessment of Learning in a Game-Based Communication Skills Training

    NARCIS (Netherlands)

    Bahreini, Kiavash; Nadolski, Rob; Westera, Wim

    2015-01-01

    This paper describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for mainly formative

  2. Multimodal emotion recognition as assessment for learning in a game-based communication skills training

    NARCIS (Netherlands)

    Nadolski, Rob; Bahreini, Kiavash; Westera, Wim

    2014-01-01

    This paper presentation describes how our FILTWAM software artifacts for face and voice emotion recognition will be used for assessing learners' progress and providing adequate feedback in an online game-based communication skills training. This constitutes an example of in-game assessment for

  3. Standardized Patients Provide a Reliable Assessment of Athletic Training Students' Clinical Skills

    Science.gov (United States)

    Armstrong, Kirk J.; Jarriel, Amanda J.

    2016-01-01

    Context: Providing students reliable objective feedback regarding their clinical performance is of great value for ongoing clinical skill assessment. Since a standardized patient (SP) is trained to consistently portray the case, students can be assessed and receive immediate feedback within the same clinical encounter; however, no research, to our…

  4. Peer Assessment of Clinical Skills and Professional Behaviors among Undergraduate Athletic Training Students

    Science.gov (United States)

    Engelmann, Jeanine E.

    2016-01-01

    Context: Peer assessment is widely used in medical education as a formative evaluation and preparatory tool for students. Athletic training students learn similar knowledge, skills, and affective traits as medical students. Peer assessment has been widely studied with beneficial results in medical education, yet athletic training education has…

  5. Teenage Consumers: A Profile. Results of the 1978 National Assessment of Consumer Skills and Attitudes.

    Science.gov (United States)

    Education Commission of the States, Denver, CO.

    This document reports some of the findings of a national assessment of seventeen-year-olds on consumer knowledge, skills, and attitudes. An introduction describes the development of the survey, the probability sample, the administration of the assessment, and the format for reporting the results. Chapter 1 of five chapters summarizes the responses…

  6. "It Is Complicated!": Practices and Challenges of Generic Skills Assessment in Vietnamese Universities

    Science.gov (United States)

    Nghia, Tran Le Huu

    2018-01-01

    Contributing to a lack of studies related to generic skills (GS) assessment, especially in non-Western university contexts, this article reports a study that explored practices and challenges of assessing students' GS in the Business Administration programmes in six Vietnamese universities. Content analysis of interviews with 41 teachers of skills…

  7. Got Game? A Choice-Based Learning Assessment of Data Literacy and Visualization Skills

    Science.gov (United States)

    Chin, Doris B.; Blair, Kristen P.; Schwartz, Daniel L.

    2016-01-01

    In partnership with both formal and informal learning institutions, researchers have been building a suite of online games, called choicelets, to serve as interactive assessments of learning skills, e.g. critical thinking or seeking feedback. Unlike more traditional assessments, which take a retrospective, knowledge-based view of learning,…

  8. Instructor and Dental Student Perceptions of Clinical Communication Skills via Structured Assessments.

    Science.gov (United States)

    McKenzie, Carly T

    2016-05-01

    The aim of this study was to use structured assessments to assess dental students' clinical communication skills exhibited during patient appointments. Fourth-year dental students (n=55) at the University of Alabama at Birmingham evaluated their own interpersonal skills in a clinical setting utilizing the Four Habits Coding Scheme. An instructor also assessed student-patient clinical communication. These assessments were used to identify perceived strengths and weaknesses in students' clinical communication. Both instructor assessments and student self-assessments pinpointed the following clinical communication skills as effective the most often: patient greeting, avoidance of jargon, and non-verbal behavior. There was also relative agreement between instructor assessments and student self-assessments regarding clinical communication skills that were rated as not effective most frequently: ensuring patient comprehension, identification of patient feelings, and exploration of barriers to treatment. These resulted pointed to strengths and weaknesses in the portion of the curriculum designed to prepare students for effective provider-patient communication. These results may suggest a need for the school's current behavioral science curriculum to better address discussion of potential treatment barriers and patient feelings as well as techniques to ensure patient comprehension.

  9. Reliability and validity of a tool to assess airway management skills in anesthesia trainees

    Directory of Open Access Journals (Sweden)

    Aliya Ahmed

    2016-01-01

    Conclusion: The tool designed to assess bag-mask ventilation and tracheal intubation skills in anesthesia trainees demonstrated excellent inter-rater reliability, fair test-retest reliability, and good construct validity. The authors recommend its use for formative and summative assessment of junior anesthesia trainees.

  10. Attention to gender in communication skills assessment instruments in medical education: a review.

    NARCIS (Netherlands)

    Dielissen, P.W.; Bottema, B.J.A.M.; Verdonk, P.; Lagro-Janssen, T.

    2011-01-01

    CONTEXT: Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. METHODS: In 2009 at Radboud University Nijmegen

  11. Overuse Injury Assessment Model

    National Research Council Canada - National Science Library

    Stuhmiller, James H; Shen, Weixin; Sih, Bryant

    2005-01-01

    .... Previously, we developed a preliminary model that predicted the stress fracture rate and used biomechanical modeling, nonlinear optimization for muscle force, and bone structural analysis to estimate...

  12. Development and validation of an instrument to assess knowledge and skills of evidence-based nursing.

    Science.gov (United States)

    Gu, Mee Ock; Ha, Yeongmi; Kim, Jeongsook

    2015-05-01

    To develop an objective instrument to measure nurses' entry-level knowledge of and skills in evidence-based practice, and to evaluate the validity and reliability of the instrument. To promote evidence-based practice in nursing, nurses should initially receive education about evidence-based practice knowledge and learn the skills, and this should be followed by measurement with an instrument that was developed to evaluate the extent to which they are prepared to use evidence-based practice knowledge and skills. Although some self-report instruments have been developed to measure evidence-based practice in nursing, an objective instrument to evaluate nurses' evidence-based practice knowledge and skills is not available at present. A methodological study. This study was conducted in two stages: the instrument development and its psychometric evaluation, including its validity and reliability. An instrument, 'Knowledge and Skills of Evidence-based Nursing,' was developed. Content validity was assessed by five experts in evidence-based nursing, and the construct validity was evaluated by the known-groups method. Reliability was examined with internal consistency reliability and inter-rater reliability. A content validity index >0·80 was achieved. For construct validity, there were statistically significant differences between the evidence-based practice and nonevidence-based practice groups in total scores and in the scores on each subscale of the Knowledge and Skills of Evidence-based Nursing. Cronbach's alpha was 0·96, and the inter-rater reliability was excellent. The Knowledge and Skills of Evidence-based Nursing is a valid and reliable instrument for objectively assessing nurses' evidence-based practice knowledge and skills; it is quick to complete and to score the answers. Because the Knowledge and Skills of Evidence-based Nursing objectively assesses nurses' evidence-based practice knowledge and skills, it can be used to examine the effects of evidence

  13. Clinical assessment of transthoracic echocardiography skills: a generalizability study.

    Science.gov (United States)

    Guldbrand Nielsen, Dorte; Jensen, Signe Lichtenstein; O'Neill, Lotte

    2015-02-01

    Transthoracic echocardiography (TTE) is a widely used cardiac imaging technique that all cardiologists should be able to perform competently. Traditionally, TTE competence has been assessed by unstructured observation or in test situations separated from daily clinical practice. An instrument for assessment of clinical TTE technical proficiency including a global rating score and a checklist score has previously shown reliability and validity in a standardised setting. As clinical test situations typically have several sources of error giving rise to variance in scores, a more thorough examination of the generalizability of the assessment instrument is needed. Nine physicians performed a TTE scan on the same three patients. Then, two raters rated all 27 TTE scans using the TTE technical assessment instrument in a fully crossed, all random generalizability study. Estimated variance components were calculated for both the global rating and checklist scores. Finally, dependability (phi) coefficients were also calculated for both outcomes in a decision study. For global rating scores, 66.6% of score variance can be ascribed to true differences in performance. For checklist scores this was 88.8%. The difference was primarily due to physician-rater interaction. Four random cases rated by one random rater resulted in a phi value of 0.81 for global ratings and two random cases rated by one random rater showed a phi value of 0.92 for checklist scores. Using the TTE checklist as opposed to the TTE global rating score had the effect of minimising the largest source of error variance in test scores. Two cases rated by one rater using the TTE checklist are sufficiently reliable for high stakes examinations. As global rating is less time consuming it could be considered performing four global rating assessments in addition to the checklist assessments to account for both reliability and content validity of the assessment.

  14. Simulation-based rhomboid flap skills training during medical education: comparing low- and high-fidelity bench models.

    Science.gov (United States)

    Denadai, Rafael; Saad-Hossne, Rogerio; Raposo-Amaral, Cassio Eduardo

    2014-11-01

    To assess if the bench model fidelity interferes in the acquisition of rhomboid flap skills by medical students. Sixty novice medical students were randomly assigned to 5 practice conditions with instructor-directed Limberg rhomboid flap skills training: didactic materials (control group 1), low-fidelity rubberized line (group 2) or ethylene-vinyl acetate (group 3) bench models; high-fidelity chicken leg skin (group 4) or pig foot skin (group 5) bench models. Pretests and posttests were applied, and Global Rating Scale, effect size, and self-perceived confidence were used to evaluate all flap performances. Medical students from groups 2 to 5 showed better flap performances based on the Global Rating Scale (all P 0.05). The magnitude of the effect was considered large (>0.80) in all measurements. There was acquisition of rhomboid flap skills regardless of bench model fidelity.

  15. Reported cystoscopic experience correlates poorly with objective assessment of cystoscopic skills.

    Science.gov (United States)

    Nihira, Mikio A; Drake, Natalie L; Corton, Marlene M; Wai, Clifford Y; Coleman, Robert L; Quiroz, Lieschen H

    2012-01-01

    Although gynecologists perform a large number of surgeries in close proximity to the ureters and the urinary bladder, traditionally, Obstetrics and Gynecology resident physicians are not formally taught to perform cystoscopy. The primary objective was to document resident physicians' performance in diagnostic cystoscopic instrumentation and technique. The secondary objective was to examine if reported prior cystoscopic experience was associated with superior performance. Fifty-one postgraduate year 4 residents with reported experience with cystoscopy were evaluated using an operation-specific checklist and a global ratings scale based on the Objective Structured Assessment of Technical Skill model. Before evaluation, they attended a formal training session in cystoscopy, which included practice on a bench model of a simulated bladder. Forty-three of the 51 residents were able to successfully perform a thorough diagnostic examination immediately after the course. Six of the 8 failures were re-evaluated 2 weeks later and successfully performed a complete examination at that time. Before the course, the residents had performed a mean of 12.2 cystoscopic examinations as the primary surgeon (median, 12; range, 2-33). The number of reported cystoscopic examinations performed before the course did not correlate with the ability to perform a thorough cystoscopic examination (r = -0.109; P = 0.496). For this group of residents, there was poor correlation between the number of reported cystoscopic examinations and the ability to perform diagnostic cystoscopy. Trainees may not be able to determine when they have received enough instruction in hands-on training with models before acquisition of technical skills.

  16. Assessing Children's Mathematical Thinking in Practical Modelling Situations.

    Science.gov (United States)

    Tanner, Howard; Jones, Sonia

    2002-01-01

    Investigates the use of mathematical modeling tasks in 11- and 12-year-old students and the development of mathematical thinking skills using practical modeling activities. Analyzes the development of students' mathematical thinking with interviews of a form of dynamic assessment. Reports that some students proved to be naturally mindful and…

  17. Identifying error types in visual diagnostic skill assessment.

    Science.gov (United States)

    Ravesloot, Cécile J; van der Gijp, Anouk; van der Schaaf, Marieke F; Huige, Josephine C B M; Ten Cate, Olle; Vincken, Koen L; Mol, Christian P; van Schaik, Jan P J

    2017-06-27

    Misinterpretation of medical images is an important source of diagnostic error. Errors can occur in different phases of the diagnostic process. Insight in the error types made by learners is crucial for training and giving effective feedback. Most diagnostic skill tests however penalize diagnostic mistakes without an eye for the diagnostic process and the type of error. A radiology test with stepwise reasoning questions was used to distinguish error types in the visual diagnostic process. We evaluated the additional value of a stepwise question-format, in comparison with only diagnostic questions in radiology tests. Medical students in a radiology elective (n=109) took a radiology test including 11-13 cases in stepwise question-format: marking an abnormality, describing the abnormality and giving a diagnosis. Errors were coded by two independent researchers as perception, analysis, diagnosis, or undefined. Erroneous cases were further evaluated for the presence of latent errors or partial knowledge. Inter-rater reliabilities and percentages of cases with latent errors and partial knowledge were calculated. The stepwise question-format procedure applied to 1351 cases completed by 109 medical students revealed 828 errors. Mean inter-rater reliability of error type coding was Cohen's κ=0.79. Six hundred and fifty errors (79%) could be coded as perception, analysis or diagnosis errors. The stepwise question-format revealed latent errors in 9% and partial knowledge in 18% of cases. A stepwise question-format can reliably distinguish error types in the visual diagnostic process, and reveals latent errors and partial knowledge.

  18. Assessment of resident physicians in professionalism, interpersonal and communication skills: a multisource feedback.

    Science.gov (United States)

    Qu, Bo; Zhao, Yu-hong; Sun, Bao-zhi

    2012-01-01

    To assess the internal validity and reliability of a multisource feedback (MSF) program by China Medical Board for resident physicians in China. Multisource feedback was used to assess professionalism, interpersonal and communication skills. 258 resident physicians were assessed by attending doctors, self-evaluation, resident peers, nurses, office staffs, and patients who completed a sealed questionnaire at 19 hospitals in China. Cronbach's alpha coefficient was used to assess reliability. Validity was assessed by exploratory factor analyses and by profile ratings. 4128 questionnaires were collected from this study. All responses had high internal consistency and reliability (Cronbach's α > 0.90), which suggests that both questions and form data were internally consistent. The exploratory factor analysis with varimax rotation for the evaluators' questionnaires was able to account for 70 to 74% of the total variance. The current MSF assessment tools are internally valid and reliable for assessing resident physician professionalism and interpersonal and communication skills in China.

  19. Using Performance in Multiple Simulated Scenarios to Assess Bronchoscopy Skills

    DEFF Research Database (Denmark)

    Konge, Lars; Arendrup, Henrik; Buchwald, Christian von

    2011-01-01

    competency is established. No former assessment instrument has been able to distinguish between trainees and experts. Objectives: The aim of this study was to explore the validity and reliability of a new assessment procedure relating to testing operators across multiple tasks with increasing difficulty...... using a standardized scoring form. Methods: The test was administered on a virtual reality bronchoscopy simulator to a total of 42 test subjects (14 senior consultants, 14 trainees and 14 medical students). The inter-rater reliability of the test procedure was explored according to examination of test...

  20. Improving Junior High Schools' Critical Thinking Skills Based on Test Three Different Models of Learning

    Science.gov (United States)

    Fuad, Nur Miftahul; Zubaidah, Siti; Mahanal, Susriyati; Suarsini, Endang

    2017-01-01

    The aims of this study were (1) to find out the differences in critical thinking skills among students who were given three different learning models: differentiated science inquiry combined with mind map, differentiated science inquiry model, and conventional model, (2) to find out the differences of critical thinking skills among male and female…

  1. Development of a Brazilian Portuguese adapted version of the Gap-Kalamazoo communication skills assessment form.

    Science.gov (United States)

    Amaral, Anna Beatriz C N; Rider, Elizabeth A; Lajolo, Paula P; Tone, Luiz G; Pinto, Rogerio M C; Lajolo, Marisa P; Calhoun, Aaron W

    2016-12-11

    The goal of this study was to translate, adapt and validate the items of the Gap-Kalamazoo Communication Skills Assessment Form for use in the Brazilian cultural setting. The Gap-Kalamazoo Communication Skills Assessment Form was translated into Portuguese by two independent bilingual Brazilian translators and was reconciled by a third bilingual healthcare professional. The translated text was then assessed for content using a modified Delphi technique and adjusted as needed to assure content validity. A total of nine phrases in the completed tool were adjusted. The final tool was then used to assess videotaped simulations as a means of validation.  Response process was assessed using exploratory factor analysis and internal structure was assessed via Cronbach's Alpha (internal consistency) and Intraclass Correlation (test-retest reliability and inter-rater reliability). One hundred and four (104) videotaped communication skills simulations were assessed by 38 subjects (6 staff physicians, 4 faculty physicians, 8 resident physicians, 4 professional actors with experience in simulation, and 16 other allied healthcare professionals). Measures of Internal consistency (Cronbach's alpha = 0.818) and test-retest reliability (intra-class correlation coefficient = 0.942) were high.  Exploratory factor analysis confirmed the uni-dimensionality of the instrument. Our results support the validity and reliability of the Brazilian Gap-Kalamazoo Communication Skills Assessment Form when used among Brazilian medical residents.  The Brazilian version of Gap-Kalamazoo Communication Skills Assessment Form was found to be adequate both in the linguistic and technical aspects.  The use of this instrument in Brazilian medical education can enhance the assessment of physician-patient-team relationships on an ongoing basis.

  2. Assessing Reflection: Understanding Skill Development through Reflective Learning Journals

    Science.gov (United States)

    Cathro, Virginia; O'Kane, Paula; Gilbertson, Deb

    2017-01-01

    Purpose: The purpose of this paper is to suggest ways in which business educators can interact successfully with reflective learning journals (RLJs). Specifically, the research was interested in how students used RLJs and how educators assessed these RLJs. Design/methodology/approach: In total, 31 RLJs, submitted as part of an international…

  3. Assessment of the Implementation of the Secondary School Skill ...

    African Journals Online (AJOL)

    This study was conducted to assess how the Nigerian secondary school vocational and technical education curriculum was implemented with a view to ascertain the extent to which it has empowered students for self-employment. The descriptive survey research design was adopted for the study. The sample comprised 380 ...

  4. Ophthalmic Skills Assessment of Primary Health Care Workers at ...

    African Journals Online (AJOL)

    The aim of the study was to assess the ability of the primary health care workers to provide basic ophthalmic .... Material resources for eye-care delivery in urban South eastern Nigeria. OJM. 2004; 16: .... However, in a country that is not technologically advanced, coupled with the challenges of scarce resources, it may be ...

  5. Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures.

    Science.gov (United States)

    Gallagher, Anthony G; Smith, C Daniel; Bowers, Steven P; Seymour, Neal E; Pearson, Adam; McNatt, Steven; Hananel, David; Satava, Richard M

    2003-09-01

    Minimally invasive surgery (MIS) has introduced a new and unique set of psychomotor skills for a surgeon to acquire and master. Although assessment technologies have been proposed, precise and objective psychomotor skills assessment of surgeons performing laparoscopic procedures has not been detailed. Two hundred ten surgeons attending the 2001 annual meeting of the American College of Surgeons in New Orleans who reported having completed more than 50 laparoscopic procedures participated. Subjects were required to complete one box-trainer laparoscopic cutting task and a similar virtual reality task. These tasks were specifically designed to test only psychomotor and not cognitive skills. Both tasks were completed twice. Performance of tasks was assessed and analyzed. Demographic and laparoscopic experience data were also collected. Complete data were available on 195 surgeons. In this group, surgeons performed the box-trainer task better with their dominant hand (p psychomotor skills is now possible. Surgeons who had performed more than 50 laparoscopic procedures showed considerable variability in their performance on a simple laparoscopic and virtual reality task. Approximately 10% of surgeons tested performed the task significantly worse than the group's average performance. Studies such as this may form the methodology for establishing criteria levels and performance objectives in objective assessment of the technical skills component of determining surgical competence.

  6. Assessing family caregiver skill in managing behavioral symptoms of Alzheimer’s disease

    Science.gov (United States)

    Farran, Carol J.; Fogg, Louis G.; McCann, Judith J.; Etkin, Caryn; Dong, Xinqi; Barnes, Lisa L.

    2011-01-01

    Objectives This measurement study operationalized family caregiver skill in managing behavioral symptoms associated with Alzheimer’s disease (AD) by testing a Caregiver Assessment of Behavioral Skill-Self Report measure (CAB-SR). Method A cross-sectional design was used. Caregivers had a family member with possible/probable AD, resided at home with the care recipient and provided the majority of care (N=82). The mail-administered assessment included the CAB-SR and other care recipient and caregiver measures. Results Preliminary CAB-SR reliability and validity were determined, using reliability, factor analytic and correlational procedures. Conclusion This measure provides a preliminary assessment of caregiver skill in managing behavioral symptoms of AD and shows promise for use in research and clinical intervention settings. PMID:21500018

  7. Development of an assessment instrument to evaluate performance of the skill of decontamination.

    Science.gov (United States)

    Farra, Sharon; Smith, Sherrill; French, DeAnne; Gillespie, Gordon

    2015-10-01

    Nurses must competently demonstrate psychomotor skills. Few reliable and valid instruments are available for psychomotor evaluation for disaster skills, including the skill of decontamination. The purpose of this study was to develop and refine an instrument to measure the skill of decontamination. A seven step instrument development design was implemented that included content validity and reliability as well as inter-rater reliability analysis. A convenience sample of approximately 140 participants was drawn from two colleges of nursing at two large academic universities. The sample included senior nursing students in either their community or final practicum nursing course. Based on a sample of 140 students who participated in a decontamination training experience using virtual reality simulation, a seven step established process for assessment of reliability and validity was implemented to develop a checklist for the skill of decontamination. The final instrument statistics: Content Validity Index for the overall instrument score was 0.94, Internal consistency coefficient=0.607(KR-20) and Inter-rater reliability=0.9114. This instrument provides a reliable and valid assessment of nurses' competency in performing the skill of decontamination offering a template for educators to develop similar tools. Copyright © 2015 Elsevier Ltd. All rights reserved.

  8. Description of the Assessment of Basic Language and Learning Skills Revisited (ABLLS-R

    Directory of Open Access Journals (Sweden)

    Semenovich M.L.

    2015-12-01

    Full Text Available Diagnostics and assessment of the functional skills of children with disabilities and autism spectrum disorders are to be conducted to develop comprehensive remedial educational programmes. The described Methodology of the Assessment of Basic Language and Learning Skills — Revisited (ABLLS-R allows to simplify and make the diagnostics more efficient, to conduct a comprehensive examination of the child in different areas of development, detect the formed and deficit skills. The second and final part of the description of the methodology offers recommendations on the filling of the Table of the Results of Initial and Repeated Testing and on the choice of goals of correctional work with a child on the basis of performance of individual test scales. The pattern of the table filled after the initial and repeated testing is given. In drawing up of the programme of individual development the willingness of the child to the development of that skill should be considered. Regular practice of selected skills in various situations and the preventive measures against the regression of skills are also important. Conclusive part. Beginning in № 3 (48, 2015

  9. Assessment of time management skills: psychometric properties of the Swedish version.

    Science.gov (United States)

    Janeslätt, Gunnel Kristina; Holmqvist, Kajsa Lidström; White, Suzanne; Holmefur, Marie

    2018-05-01

    Persons with impaired time management skills are often in need of occupational therapy. Valid and reliable instruments to assess time management and organizational skills are needed for the evaluation of intervention. The purpose of this study was to evaluate the psychometric properties of a Swedish version of the Assessment of Time Management Skills (ATMS-S) for persons with and without impaired time management skills. A total of 238 persons participated in the study, of whom 94 had self-reported impaired time management skills due to mental disorders such as schizophrenic spectrum or neurodevelopmental disorders such as attention deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and mild intellectual disabilities, and 144 persons had no reported impaired time management skills. Rasch analysis was used to analyze data. Three subscales were detected: the time management subscale with 11 items, the organization & planning subscale with 11 items, and the subscale of regulation of emotions with 5 items, with excellent to acceptable psychometric properties. The conclusions were that: ATMS-S is a valid instrument for self-rating of time management, organization & planning and for the regulation of emotions. ATMS-S can be useful for persons with mental disorders including mild neurodevelopmental disorders.

  10. Cultural consultation as a model for training multidisciplinary mental healthcare professionals in cultural competence skills: preliminary results.

    Science.gov (United States)

    Owiti, J A; Ajaz, A; Ascoli, M; de Jongh, B; Palinski, A; Bhui, K S

    2014-01-01

    Lack of cultural competence in care contributes to poor experiences and outcomes from care for migrants and racial and ethnic minorities. As a result, health and social care organizations currently promote cultural competence of their workforce as a means of addressing persistent poor experiences and outcomes. At present, there are unsystematic and diverse ways of promoting cultural competence, and their impact on clinician skills and patient outcomes is unknown. We developed and implemented an innovative model, cultural consultation service (CCS), to promote cultural competence of clinicians and directly improve on patient experiences and outcomes from care. CCS model is an adaptation of the McGill model, which uses ethnographic methodology and medical anthropological knowledge. The method and approach not only contributes both to a broader conceptual and dynamic understanding of culture, but also to learning of cultural competence skills by healthcare professionals. The CCS model demonstrates that multidisciplinary workforce can acquire cultural competence skills better through the clinical encounter, as this promotes integration of learning into day-to-day practice. Results indicate that clinicians developed a broader and patient-centred understanding of culture, and gained skills in narrative-based assessment method, management of complexity of care, competing assumptions and expectations, and clinical cultural formulation. Cultural competence is defined as a set of skills, attitudes and practices that enable the healthcare professionals to deliver high-quality interventions to patients from diverse cultural backgrounds. Improving on the cultural competence skills of the workforce has been promoted as a way of reducing ethnic and racial inequalities in service outcomes. Currently, diverse models for training in cultural competence exist, mostly with no evidence of effect. We established an innovative narrative-based cultural consultation service in an inner

  11. Influence choreographic readiness to gymnasts final assessment of performance skills

    Directory of Open Access Journals (Sweden)

    O.A. Omelichyk-Ziurkalova

    2014-10-01

    Full Text Available Purpose : to provide a quantitative assessment and expert choreographic preparedness gymnasts. Material : the study involved eight gymnasts competition finalists in the floor exercise - female members of the Ukrainian national team in gymnastics. Results : the quantitative indicators of acrobatic and dance elements to determine the baseline assessment. Defined methods complications composition on the floor exercise by reducing the number of acrobatic lines and diagonals and increase the number of gymnastic elements. The theoretical performance of the composite sequence is improved structure and increases the difficulty of the exercise. Conclusions : in the process of composition complications need to pay more attention to the technique of performing gymnastic elements. In improving exercise choreography element replace (in some cases acrobatic element. Based on the results is planned future direction of research in order to improve the training process in gymnastics.

  12. Assessing the Nontechnical Skills of Surgical Trainees: Views of the Theater Team.

    Science.gov (United States)

    Al-Jundi, Wissam; Wild, Jonathan; Ritchie, Judith; Daniels, Sarah; Robertson, Eleanor; Beard, Jonathan

    2016-01-01

    This study aims to explore the views of members of theater teams regarding the proposed introduction of a workplace-based assessment of nontechnical skills of surgeons (NOTSS) into the Intercollegiate Surgical Curriculum Programme in the United Kingdom. In addition, the previous training and familiarity of the members of the surgical theater team with the concept and assessment of NOTSS would be evaluated. A regional survey of members of theater teams (consultant surgeons, anesthetists, scrub nurses, and trainees) was performed at 1 teaching and 2 district general hospitals in South Yorkshire. There were 160 respondents corresponding to a response rate of 81%. The majority (77%) were not aware of the NOTSS assessment tool with only 9% of respondents reporting to have previously used the NOTSS tool and just 3% having received training in NOTSS assessment. Overall, 81% stated that assessing NOTSS was as important as assessing technical skills. Trainees attributed less importance to nontechnical skills than the other groups (p ≤ 0.016). Although opinion appears divided as to whether the presence of a consultant surgeon in theater could potentially make it difficult to assess a trainee's leadership skills and decision-making capabilities, overall 60% agree that the routine use of NOTSS assessment would enhance safety in the operating theater and 80% agree that the NOTSS tool should be introduced to assess the nontechnical skills of trainees in theater. However, a significantly lower proportion of trainees (45%) agreed on the latter compared with the other groups (p = 0.001). Our survey demonstrates acceptability among the theater team for the introduction of the NOTSS tool into the surgical curriculum. However, lack of familiarity highlights the importance of faculty training for assessors before such an introduction. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  13. Introducing the Skills of Self-assessment and Peer Feedback

    Directory of Open Access Journals (Sweden)

    Rania K. Jabr

    2011-03-01

    Full Text Available The object of our teaching should not simply be to introduce our students to a foreign language, but it should be to enable them to perform well when we teachers are no longer there to support them. This means we need to teach them to be autonomous, and one way to succeed in this challenging task is to train them in the “skill” of self-assessment (Harris, 1997 and how to benefit from peer interaction.

  14. Motivational Interviewing Skills in Health Care Encounters (MISHCE): Development and psychometric testing of an assessment tool.

    Science.gov (United States)

    Petrova, Tatjana; Kavookjian, Jan; Madson, Michael B; Dagley, John; Shannon, David; McDonough, Sharon K

    2015-01-01

    Motivational interviewing (MI) has demonstrated a significant impact as an intervention strategy for addiction management, change in lifestyle behaviors, and adherence to prescribed medication and other treatments. Key elements to studying MI include training in MI of professionals who will use it, assessment of skills acquisition in trainees, and the use of a validated skills assessment tool. The purpose of this research project was to develop a psychometrically valid and reliable tool that has been designed to assess MI skills competence in health care provider trainees. The goal was to develop an assessment tool that would evaluate the acquisition and use of specific MI skills and principles, as well as the quality of the patient-provider therapeutic alliance in brief health care encounters. To address this purpose, specific steps were followed, beginning with a literature review. This review contributed to the development of relevant conceptual and operational definitions, selecting a scaling technique and response format, and methods for analyzing validity and reliability. Internal consistency reliability was established on 88 video recorded interactions. The inter-rater and test-retest reliability were established using randomly selected 18 from the 88 interactions. The assessment tool Motivational Interviewing Skills for Health Care Encounters (MISHCE) and a manual for use of the tool were developed. Validity and reliability of MISHCE were examined. Face and content validity were supported with well-defined conceptual and operational definitions and feedback from an expert panel. Reliability was established through internal consistency, inter-rater reliability, and test-retest reliability. The overall internal consistency reliability (Cronbach's alpha) for all fifteen items was 0.75. MISHCE demonstrated good inter-rater reliability and good to excellent test-retest reliability. MISHCE assesses the health provider's level of knowledge and skills in brief

  15. Skill assessment of the coupled physical-biogeochemical operational Mediterranean Forecasting System

    Science.gov (United States)

    Cossarini, Gianpiero; Clementi, Emanuela; Salon, Stefano; Grandi, Alessandro; Bolzon, Giorgio; Solidoro, Cosimo

    2016-04-01

    The Mediterranean Monitoring and Forecasting Centre (Med-MFC) is one of the regional production centres of the European Marine Environment Monitoring Service (CMEMS-Copernicus). Med-MFC operatively manages a suite of numerical model systems (3DVAR-NEMO-WW3 and 3DVAR-OGSTM-BFM) that provides gridded datasets of physical and biogeochemical variables for the Mediterranean marine environment with a horizontal resolution of about 6.5 km. At the present stage, the operational Med-MFC produces ten-day forecast: daily for physical parameters and bi-weekly for biogeochemical variables. The validation of the coupled model system and the estimate of the accuracy of model products are key issues to ensure reliable information to the users and the downstream services. Product quality activities at Med-MFC consist of two levels of validation and skill analysis procedures. Pre-operational qualification activities focus on testing the improvement of the quality of a new release of the model system and relays on past simulation and historical data. Then, near real time (NRT) validation activities aim at the routinely and on-line skill assessment of the model forecast and relays on the NRT available observations. Med-MFC validation framework uses both independent (i.e. Bio-Argo float data, in-situ mooring and vessel data of oxygen, nutrients and chlorophyll, moored buoys, tide-gauges and ADCP of temperature, salinity, sea level and velocity) and semi-independent data (i.e. data already used for assimilation, such as satellite chlorophyll, Satellite SLA and SST and in situ vertical profiles of temperature and salinity from XBT, Argo and Gliders) We give evidence that different variables (e.g. CMEMS-products) can be validated at different levels (i.e. at the forecast level or at the level of model consistency) and at different spatial and temporal scales. The fundamental physical parameters temperature, salinity and sea level are routinely validated on daily, weekly and quarterly base

  16. Competency-based achievement system: using formative feedback to teach and assess family medicine residents' skills.

    Science.gov (United States)

    Ross, Shelley; Poth, Cheryl N; Donoff, Michel; Humphries, Paul; Steiner, Ivan; Schipper, Shirley; Janke, Fred; Nichols, Darren

    2011-09-01

    Family medicine residency programs require innovative means to assess residents' competence in "soft" skills (eg, patient-centred care, communication, and professionalism) and to identify residents who are having difficulty early enough in their residency to provide remedial training. To develop a method to assess residents' competence in various skills and to identify residents who are having difficulty. The Competency-Based Achievement System (CBAS) was designed to measure competence using 3 main principles: formative feedback, guided self-assessment, and regular face-to-face meetings. The CBAS is resident driven and provides a framework for meaningful interactions between residents and advisors. Residents use the CBAS to organize and review their feedback, to guide their own assessment of their progress, and to discern their future learning needs. Advisors use the CBAS to monitor, guide, and verify residents' knowledge of and competence in important skills. By focusing on specific skills and behaviour, the CBAS enables residents and advisors to make formative assessments and to communicate their findings. Feedback indicates that the CBAS is a user-friendly and helpful system to assess competence.

  17. What matters? Assessing and developing inquiry and multivariable reasoning skills in high school chemistry

    Science.gov (United States)

    Daftedar Abdelhadi, Raghda Mohamed

    Although the Next Generation Science Standards (NGSS) present a detailed set of Science and Engineering Practices, a finer grained representation of the underlying skills is lacking in the standards document. Therefore, it has been reported that teachers are facing challenges deciphering and effectively implementing the standards, especially with regards to the Practices. This analytical study assessed the development of high school chemistry students' (N = 41) inquiry, multivariable causal reasoning skills, and metacognition as a mediator for their development. Inquiry tasks based on concepts of element properties of the periodic table as well as reaction kinetics required students to conduct controlled thought experiments, make inferences, and declare predictions of the level of the outcome variable by coordinating the effects of multiple variables. An embedded mixed methods design was utilized for depth and breadth of understanding. Various sources of data were collected including students' written artifacts, audio recordings of in-depth observational groups and interviews. Data analysis was informed by a conceptual framework formulated around the concepts of coordinating theory and evidence, metacognition, and mental models of multivariable causal reasoning. Results of the study indicated positive change towards conducting controlled experimentation, making valid inferences and justifications. Additionally, significant positive correlation between metastrategic and metacognitive competencies, and sophistication of experimental strategies, signified the central role metacognition played. Finally, lack of consistency in indicating effective variables during the multivariable prediction task pointed towards the fragile mental models of multivariable causal reasoning the students had. Implications for teacher education, science education policy as well as classroom research methods are discussed. Finally, recommendations for developing reform-based chemistry

  18. Assessing the Development of Medical Students’ Personal and Professional Skills by Portfolio

    OpenAIRE

    Jill Yielder; Fiona Moir

    2016-01-01

    The introduction of a new domain of learning for Personal and Professional Skills in the medical program at the University of Auckland in New Zealand has involved the compilation of a portfolio for assessment. This departure from the traditional assessment methods predominantly used in the past has been challenging to design, introduce, and maintain as a relevant and authentic assessment method. We present the portfolio format along with the process for its introduction and appraise the chall...

  19. Quantitative skills as a graduate learning outcome of university science degree programmes: student performance explored through theplanned-enacted-experiencedcurriculum model

    Science.gov (United States)

    Matthews, Kelly E.; Adams, Peter; Goos, Merrilyn

    2016-07-01

    Application of mathematical and statistical thinking and reasoning, typically referred to as quantitative skills, is essential for university bioscience students. First, this study developed an assessment task intended to gauge graduating students' quantitative skills. The Quantitative Skills Assessment of Science Students (QSASS) was the result, which examined 10 mathematical and statistical sub-topics. Second, the study established an evidential baseline of students' quantitative skills performance and confidence levels by piloting the QSASS with 187 final-year biosciences students at a research-intensive university. The study is framed within the planned-enacted-experienced curriculum model and contributes to science reform efforts focused on enhancing the quantitative skills of university graduates, particularly in the biosciences. The results found, on average, weak performance and low confidence on the QSASS, suggesting divergence between academics' intentions and students' experiences of learning quantitative skills. Implications for curriculum design and future studies are discussed.

  20. The Will, Skill, Tool Model of Technology Integration: Adding Pedagogy as a New Model Construct

    Science.gov (United States)

    Knezek, Gerald; Christensen, Rhonda

    2015-01-01

    An expansion of the Will, Skill, Tool Model of Technology Integration to include teacher's pedagogical style is proposed by the authors as a means of advancing the predictive power for level of classroom technology integration to beyond 90%. Suggested advantages to this expansion include more precise identification of areas to be targeted for…

  1. Interpretive Structural Modeling of MLearning Curriculum Implementation Model of English Language Communication Skills for Undergraduates

    Science.gov (United States)

    Abdullah, Muhammad Ridhuan Tony Lim; Siraj, Saedah; Asra; Hussin, Zaharah

    2014-01-01

    In the field of distance education, learning mediated through mobile technology or mobile learning (mLearning) has rapidly building a repertoire of influence in distance education research. This paper aims to propose an mLearning curriculum implementation model for English Language and Communication skills course among undergraduates using…

  2. Does a perceptuomotor skills assessment have added value to detect talent for table tennis in primary school children?

    Science.gov (United States)

    Faber, Irene R; Pion, Johan; Munivrana, Goran; Faber, Niels R; Nijhuis-Van der Sanden, Maria W G

    2017-04-18

    Talent detection intends to support lifelong sports participation, reduce dropouts and stimulate sports at the elite level. For this purpose it is important to reveal the specific profile which directs children to the sports that connect to their strengths and preferences. This study evaluated a perceptuomotor skills assessment as part of talent detection for table tennis, a sport in which perceptuomotor skills are considered essential to cope with the difficult technical aspects. Primary school children (n = 121) and gifted young table tennis players (n = 146) were assessed using the Dutch perceptuomotor skills assessment measuring "ball control" and "gross motor function". A discriminant function analysis confirmed the added value by identifying primary school children fitting the table tennis perceptuomotor profile of the young gifted table tennis players (28%). General linear model analyses for the assessment's individual test items showed that the table tennis players outperformed their primary school peers on all "ball control" items (P talent detection in table tennis at this young age. Longitudinal studies need to reveal the predictive value for sports participation and elite sports.

  3. Validation of a Visual-Spatial Secondary Task to Assess Automaticity in Laparoscopic Skills.

    Science.gov (United States)

    Castillo, Richard; Alvarado, Juan; Moreno, Pablo; Billeke, Pablo; Martínez, Carlos; Varas, Julián; Jarufe, Nicolás

    2017-12-26

    Our objective was to assess reliability and validity of a visual-spatial secondary task (VSST) as a method to measure automaticity on a basic simulated laparoscopic skill model. In motor skill acquisition, expertise is defined by automaticity. The highest level of performance with less cognitive and attentional resources characterizes this stage, allowing experts to perform multiple tasks. Conventional validated parameters as operative time, objective assessment skills scales (OSATS), and movement economy, are insufficient to distinguish if an individual has reached the more advanced learning phases, such as automaticity. There is literature about using a VSST as an attention indicator that correlates with the automaticity level. Novices with completed and approved Fundamentals of Laparoscopic Surgery course, and laparoscopy experts were enrolled for an experimental study and measured under dual tasks conditions. Each participant performed the test giving priority to the primary task while at the same time they responded to a VSST. The primary task consisted of 4 interrupted laparoscopic stitches (ILS) on a bench-model. The VSST was a screen that showed different patterns that the surgeon had to recognize and press a pedal while doing the stitches (PsychoPsy software, Python, MacOS). Novices were overtrained on ILS until they reach at least 100 repetitions and then were retested. Participants were video recorded and then assessed by 2 blinded evaluators who measured operative time and OSATS. These scores were considered indicators of quality for the primary task. The VSST performance was measured by the detectability index (DI), which is a ratio between correct and wrong detections. A reliable evaluation was defined as two measures of DI with less than 10% of difference, maintaining the cutoff scores for performance on the primary task (operative time 17 points). Novices (n = 11) achieved reliable measure of the test after 2 (2-5) repetitions on the preassessment

  4. An Exploratory Study of the Determinants and Outcomes of Shared Mental Models of Skill Use in Autonomous Work Teams

    OpenAIRE

    Tarnoff, Karen Ann

    1999-01-01

    This research investigated the determinants and outcomes of shared mental models of skill use in autonomous work teams. A model of the determinants and outcomes (team task behaviors) of shared mental models of skill use was tested. Three components of shared mental models of skill use were investigated: shared knowledge pertaining to skill use in task performance (i.e., knowledge about the task, equipment, team, and team interaction), shared expectations for skill use in task p...

  5. The use of the "Objective Structured Assessment of Technical Skills" as an Assessment Tool Among Danish Vascular Surgeons in Training.

    Science.gov (United States)

    Lladó Grove, Gabriela; Langager Høgh, Annette; Nielsen, Judith; Sandermann, Jes

    2015-01-01

    The concept of the Objective Structured Assessment of Technical Skills (OSATS) is to quantify surgical skills in an objective way and, thereby, produce an additional procedure-specific assessment tool. Since 2005, a 2-day practical course for upcoming specialist registrars in vascular surgery has been obligatory. The aim of this study is to describe the results from a tailored OSATS test as a tool for the evaluation of practical skills during an intensive training session in a simple simulator box for vascular anastomoses. Between 2005 and 2013, we registered the OSATS scores of all course participants. The following data were collected from the questionnaires: years as a candidate, months in vascular surgery or in another type of surgery, and the number of vascular anastomoses performed before the course. The assessment of surgical skills was conducted with an OSATS score template specifically made for this purpose. It consists of a 12-item table with a 5-point grading scale. OSATS score (points) and time for the procedure (OSATS time in min) were registered at baseline (OSATS I) and at the end of the course (OSATS II). OSATS scores were given in both OSATS I and OSATS II for the 83 trainees, and the mean difference was 8.1 points (95% CI: 6.7; 9.5, p technical skills during an intensive practical course in performing vascular anastomoses. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  6. Customization of a tool to assess Danish surgeons´ non-technical skills in the operating room

    DEFF Research Database (Denmark)

    Spanager, Lene; Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter

    2012-01-01

    Errors in surgery often stem from failure related to non-technical skills such as communication and teamwork. Tools for training and assessment of non-technical skills are needed to ensure safe surgery. The aim of this study was to customize the Non-Technical Skills for Surgeons (NOTSS) rating...

  7. Students' performance in the different clinical skills assessed in OSCE: what does it reveal?

    Science.gov (United States)

    Sim, Joong Hiong; Abdul Aziz, Yang Faridah; Mansor, Azura; Vijayananthan, Anushya; Foong, Chan Choong; Vadivelu, Jamuna

    2015-01-01

    The purpose of this study was to compare students' performance in the different clinical skills (CSs) assessed in the objective structured clinical examination. Data for this study were obtained from final year medical students' exit examination (n=185). Retrospective analysis of data was conducted using SPSS. Means for the six CSs assessed across the 16 stations were computed and compared. Means for history taking, physical examination, communication skills, clinical reasoning skills (CRSs), procedural skills (PSs), and professionalism were 6.25±1.29, 6.39±1.36, 6.34±0.98, 5.86±0.99, 6.59±1.08, and 6.28±1.02, respectively. Repeated measures ANOVA showed there was a significant difference in the means of the six CSs assessed [F(2.980, 548.332)=20.253, pskill to be acquired by medical students before entering the workplace. Despite its challenges, students must learn the skills of clinical reasoning, while clinical teachers should facilitate the clinical reasoning process and guide students' clinical reasoning development.

  8. The feasibility of a multi-format Web-based assessment of physicians' communication skills.

    Science.gov (United States)

    Kim, Sara; Brock, Douglas M; Hess, Brian J; Holmboe, Eric S; Gallagher, Thomas H; Lipner, Rebecca S; Mazor, Kathleen M

    2011-09-01

    Little is known about the best approaches and format for measuring physicians' communication skills in an online environment. This study examines the reliability and validity of scores from two Web-based communication skill assessment formats. We created two online communication skill assessment formats: (a) MCQ (multiple-choice questions) consisting of video-based multiple-choice questions; (b) multi-format including video-based multiple-choice questions with rationales, Likert-type scales, and free text responses of what physicians would say to a patient. We randomized 100 general internists to each test format. Peer and patient ratings collected via the American Board of Internal Medicine (ABIM) served as validity sources. Seventy-seven internists completed the tests (MCQ: 38; multi-format: 39). The adjusted reliability was 0.74 for both formats. Excellent communicators, as based on their peer and patient ratings, performed slightly better on both tests than adequate communicators, though this difference was not statistically significant. Physicians in both groups rated test format innovative (4.2 out of 5.0). The acceptable reliability and participants' overall positive experiences point to the value of ongoing research into rigorous Web-based communication skills assessment. With efficient and reliable scoring, the Web offers an important way to measure and potentially enhance physicians' communication skills. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  9. ASSESSMENT OF ARTICLES ON LISTENING SKILL-DİNLEME BECERİSİ ÜZERİNE YAZILAN MAKALELERİN DEĞERLENDİRİLMESİ

    Directory of Open Access Journals (Sweden)

    Ömer KEMİKSİZ

    2017-04-01

    Full Text Available One of the basic language skills, listening is the most commonly used skill in daily life as well. Therefore, studies to be conducted for improving this skill are very important. This study aims to assess academic studies on listening skill from various aspects. This study is based on descriptive survey model and analyzes 150 articles published in 67 different journals between 2007-2016 through content analysis method. These articles are analyzed under seven titles being publication year, number of authors, article type (original, thesis or publication-based, distribution by basic language skills, sampling/research group, research type and research subject. The obtained findings are presented in charts and tables and related frequency and percentage values are presented as well. According to this study, the number of articles written on listening skill has significantly increased in recent years and these articles are mostly original papers with single author or two authors. It is also found that articles written solely on listening skill are in majority and research group is mostly students in these studies. It is detected that these students are mostly on secondary school and undergraduate education level. It is detected that the analyzed research mostly focus on survey and document analysis studies; the most commonly examined subjects are found as follows, listening strategies, methods and techniques, listening activities and listening texts. The obtained results are compared with other studies conducted on basic language skills and recommendations are made for further research to be conducted on listening skill.

  10. Measuring non-technical skills in medical emergency care: a review of assessment measures

    Directory of Open Access Journals (Sweden)

    Simon Cooper

    2010-01-01

    Full Text Available Simon Cooper1, Ruth Endacott2, Robyn Cant11School of Nursing and Midwifery, Monash University, Gippsland Campus, Churchill, Victoria, Australia; 2School of Nursing and Midwifery, University of Plymouth, Drake Circus, Plymouth UKAim: To review the literature on non-technical skills and assessment methods relevant to emergency care.Background: Non-technical skills (NTS include leadership, teamwork, decision making and situation awareness, all of which have an impact on healthcare outcomes. Significant concerns have been raised about the rates of adverse medical events, many of which are attributed to NTS failures.Methods: Ovid, Medline, ProQUEST, PsycINFO and specialty websites were searched for NTS measures using applicable access strategies, inclusion and exclusion criteria. Publications identified were assessed for relevance.Results: A range of non-technical skill measures relevant to emergency care was identified: leadership (n = 5, teamwork (n = 7, personality/behavior (n = 3 and situation awareness tools (n = 1. Of these, 9 have been used with emergency care populations/clinicians. All had varying degrees of reliability and validity. In the last decade there has been some development of teamwork measures specific to emergency care with a predominantly global and collective rating of broad skills.Conclusion: A variety of non-technical skill measures are available; only a few have been used in the emergency care arena. There is a need for an increase in the focused assessment of teamwork skills for a greater understanding of team performance to enhance patient safety in medical emergency care.Keywords: non-technical skills, teamwork, medical emergency, standards

  11. Audiological Assessment of Word Recognition Skills in Persons With Aphasia.

    Science.gov (United States)

    Zhang, Min; Pratt, Sheila R; Doyle, Patrick J; McNeil, Malcolm R; Durrant, John D; Roxberg, Jillyn; Ortmann, Amanda

    2018-03-08

    The purpose of this study was to evaluate the ability of persons with aphasia, with and without hearing loss, to complete a commonly used open-set word recognition test that requires a verbal response. Furthermore, phonotactic probabilities and neighborhood densities of word recognition errors were assessed to explore potential underlying linguistic complexities that might differentially influence performance among groups. Four groups of adult participants were tested: participants with no brain injury with normal hearing, participants with no brain injury with hearing loss, participants with brain injury with aphasia and normal hearing, and participants with brain injury with aphasia and hearing loss. The Northwestern University Auditory Test No. 6 (NU-6; Tillman & Carhart, 1966) was administered. Those participants who were unable to respond orally (repeating words as heard) were assessed with the Picture Identification Task (Wilson & Antablin, 1980), permitting a picture-pointing response instead. Error patterns from the NU-6 were assessed to determine whether phonotactic probability influenced performance. All participants with no brain injury and 72.7% of the participants with aphasia (24 out of 33) completed the NU-6. Furthermore, all participants who were unable to complete the NU-6 were able to complete the Picture Identification Task. There were significant group differences on NU-6 performance. The 2 groups with normal hearing had significantly higher scores than the 2 groups with hearing loss, but the 2 groups with normal hearing and the 2 groups with hearing loss did not differ from one another, implying that their performance was largely determined by hearing loss rather than by brain injury or aphasia. The neighborhood density, but not phonotactic probabilities, of the participants' errors differed across groups with and without aphasia. Because the vast majority of the participants with aphasia examined could be tested readily using an instrument

  12. E-learning teaches attendings "how to" objectively assess pediatric urology trainees' surgery skills for orchiopexy.

    Science.gov (United States)

    Fernandez, Nicolas; Maizels, Max; Farhat, Walid; Smith, Edwin; Liu, Dennis; Chua, Michael; Bhanji, Yasin

    2017-11-09

    Established methods to train pediatric urology surgery by residency training programs require updating in response to administrative changes such as new, reduced trainee duty hours. Therefore, new objective methods must be developed to teach trainees. We approached this need by creating e-learning to teach attendings objective assessment of trainee skills using the Zwisch scale, an established assessment tool. The aim of this study was to identify whether or not e-learning is an appropriate platform for effective teaching of this assessment tool, by assessing inter-rater correlation of assessments made by the attendings after participation in the e-learning. Pediatric orchiopexy was used as the index case. An e-learning tool was created to teach attending surgeons objective assessment of trainees' surgical skills. First, e-learning content was created which showed the assessment method videotape of resident surgery done in the operating room. Next, attendings were enrolled to e-learn this method. Finally, the ability of enrollees to assess resident surgery skill performance was tested. Namely, test video was made showing a trainee performing inguinal orchiopexy. All enrollees viewed the same online videos. Assessments of surgical skills (Zwisch scale) were entered into an online survey. Data were analyzed by intercorrelation coefficient kappa analysis (strong correlation was ICC ≥ 0.7). A total of 11 attendings were enrolled. All accessed the online learning and then made assessments of surgical skills trainees showed on videotapes. The e-learning comprised three modules: 1. "Core concepts," in which users learned the assessment tool methods; 2. "Learn to assess," in which users learned how to assess by watching video clips, explaining the assessment method; and 3. "Test," in which users tested their skill at making assessments by watching video clips and then actively inputting their ratings of surgical and global skills as viewed in the video clips (Figure

  13. Delinquency, Social Skills and the Structure of Peer Relations: Assessing Criminological Theories by Social Network Theory

    Science.gov (United States)

    Smangs, Mattias

    2010-01-01

    This article explores the plausibility of the conflicting theoretical assumptions underlying the main criminological perspectives on juvenile delinquents, their peer relations and social skills: the social ability model, represented by Sutherland's theory of differential associations, and the social disability model, represented by Hirschi's…

  14. Large-scale Assessment Yields Evidence of Minimal Use of Reasoning Skills in Traditionally Taught Classes

    Science.gov (United States)

    Thacker, Beth

    2017-01-01

    Large-scale assessment data from Texas Tech University yielded evidence that most students taught traditionally in large lecture classes with online homework and predominantly multiple choice question exams, when asked to answer free-response (FR) questions, did not support their answers with logical arguments grounded in physics concepts. In addition to a lack of conceptual understanding, incorrect and partially correct answers lacked evidence of the ability to apply even lower level reasoning skills in order to solve a problem. Correct answers, however, did show evidence of at least lower level thinking skills as coded using a rubric based on Bloom's taxonomy. With the introduction of evidence-based instruction into the labs and recitations of the large courses and in a small, completely laboratory-based, hands-on course, the percentage of correct answers with correct explanations increased. The FR format, unlike other assessment formats, allowed assessment of both conceptual understanding and the application of thinking skills, clearly pointing out weaknesses not revealed by other assessment instruments, and providing data on skills beyond conceptual understanding for course and program assessment. Supported by National Institutes of Health (NIH) Challenge grant #1RC1GM090897-01.

  15. Assessing nursing students' knowledge and skills in performing venepuncture and inserting peripheral venous catheters.

    Science.gov (United States)

    Ahlin, C; Klang-Söderkvist, B; Johansson, E; Björkholm, M; Löfmark, A

    2017-03-01

    Venepuncture and the insertion of peripheral venous catheters are common tasks in health care, and training in these procedures is included in nursing programmes. Evidence of nursing students' knowledge and skills in these procedures is limited. The main aim of this study was to assess nursing students' knowledge and skills when performing venepuncture and inserting peripheral venous catheters. Potential associations between level of knowledge and skills, self-training, self-efficacy, and demographic characteristics were also investigated. The assessment was performed by lecturers at a university college in Sweden using the two previously tested instruments "Assess Venepuncture" and "Assess Peripheral Venous Catheter Insertion". Between 81% and 100% of steps were carried out correctly by the students. The step with the highest rating was "Uses gloves", and lowest rating was 'Informs the patients about the possibility of obtaining local anaesthesia'. Significant correlations between degree of self-training and correct performance were found in the group of students who registered their self-training. No associations between demographic characteristics and correct performances were found. Assessing that students have achieved adequate levels of knowledge and skills in these procedures at different levels of the nursing education is of importance to prevent complications and support patient safety. Copyright © 2017 Elsevier Ltd. All rights reserved.

  16. Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery.

    Science.gov (United States)

    Oropesa, Ignacio; Sánchez-González, Patricia; Lamata, Pablo; Chmarra, Magdalena K; Pagador, José B; Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Gómez, Enrique J

    2011-11-01

    Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor-trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons' psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules. Copyright © 2011 Elsevier Inc. All rights reserved.

  17. Implementation of Performance Assessment in STEM (Science, Technology, Engineering, Mathematics) Education to Detect Science Process Skill

    Science.gov (United States)

    Septiani, A.; Rustaman, N. Y.

    2017-02-01

    A descriptive study about the implementation of performance assessment in STEM based instruction was carried out to investigate the tenth grade of Vocational school students’ science process skills during the teaching learning processes. A number of tenth grade agriculture students was involved as research subjects selected through cluster random sampling technique (n=35). Performance assessment was planned on skills during the teaching learning process through observation and on product resulted from their engineering practice design. The procedure conducted in this study included thinking phase (identifying problem and sharing idea), designing phase, construction phase, and evaluation phase. Data was collected through the use of science process skills (SPS) test, observation sheet on student activity, as well as tasks and rubrics for performance assessment during the instruction. Research findings show that the implementation of performance assessment in STEM education in planting media could detect students science process skills better from the observation individually compared through SPS test. It was also found that the result of performance assessment was diverse when it was correlated to each indicator of SPS (strong and positive; weak and positive).

  18. Examining construct validity of a new naturalistic observational assessment of hand skills for preschool- and school-age children.

    Science.gov (United States)

    Chien, Chi-Wen; Brown, Ted; McDonald, Rachael

    2012-04-01

    The Assessment of Children's Hand Skills is a new assessment that utilises a naturalistic observational method to capture children's real-life hand skill performance when engaged at various types of daily activities in everyday living contexts. The Assessment of Children's Hand Skills is designed for use with 2- to 12-year-old children with a range of disabilities or health conditions. The study aimed to investigate construct validity of the Assessment of Children's Hand Skills in Australian children. Rasch analysis was used to examine internal construct validity of the Assessment of Children's Hand Skills in a mixed sample of 53 children with disabilities (including autism spectrum disorder, developmental/genetic disorders and physical disabilities) and 85 typically developing children. External construct validity was examined by correlating with three questionnaires evaluating daily living skills and hand skills. Rasch goodness-of-fit analysis suggested that all 22 activity items and 19 of 20 hand skill items in the Assessment of Children's Hand Skills measured a single construct. The Assessment of Children's Hand Skills items were placed in a clinically meaningful hierarchy from easy to hard, and the difficulty range of the items also matched the majority of children with disabilities and typically developing preschool-aged children. Moderate to high correlations (0.59 ≤ Spearman's ρ coefficients ≤ 0.89, P skills. This study provided preliminary evidence supporting the construct validity of the Assessment of Children's Hand Skills for its clinical application in assessing children's real-life hand skill performance in Australian contexts. © 2012 The Authors Australian Occupational Therapy Journal © 2012 Occupational Therapy Australia.

  19. MEMFASILITASI HIGHER ORDER THINKING SKILLS DALAM PERKULIAHAN BIOLOGI SEL MELALUI MODEL INTEGRASI ATRIBUT ASESMEN FORMATIF

    Directory of Open Access Journals (Sweden)

    Sigit Saptono

    2017-02-01

    Full Text Available Abstrak ___________________________________________________________________ Higher order thinking skills sangat dibutuhkan untuk memahami permasalahan dan esensi materi perkuliahan Biologi Sel. Studi dengan desain Research and Development ini bertujuan untuk mengembangkan kemampuan penalaran dan berpikir analitik mahasiswa calon guru biologi melalui penerapan model pembelajaran Integrasi Atribut Asesmen Formatif (IAAF. Sejumlah 61 mahasiswa program studi Pendidikan Biologi Universitas Negeri Semarang semester tiga yang sedang menempuh mata kuliah Biologi Sel menjadi subjek penelitian. Kemampuan penalaran dan berpikir analitik mahasiswa diukur melalui tugas individu, tugas kelompok pembuatan peta konsep dan penyusunan laporan reviu artikel, dan 30 item soal berbentuk selected response questions dan constructed response questions tervalidasi. Hasil analisis data menunjukkan bahwa kemampuan penalaran dan berpikir analitik mahasiswa dapat berkembang secara signifikan, meskipun perkembangan kemampuan argumentasi, salah satu kategori kemampuan berpikir analitik, masih perlu perhatian yang cukup serius.   Abstract ___________________________________________________________________ Higher order thinking skills are needed to understand the problem and the essence of the lecture material Biology Sel. Study design Research and Development aims to develop reasoning skills and analytic thinking biology student teachers through the application of learning models Integration Attributes Formative Assessment (IAAF. Some 61 students of Biology Education Semarang State University who is doing his third semester courses Cell Biology is the subject of research. Analytical reasoning and thinking ability of students is measured through individual assignments, group assignments concept map creation and preparation of the Review articles, and 30 items about the shape of the selected response and constructed response questions, validated questions. The result showed

  20. Video self-assessment of basic suturing and knot tying skills by novice trainees.

    Science.gov (United States)

    Hu, Yinin; Tiemann, Debbie; Michael Brunt, L

    2013-01-01

    Self-assessment is important to learning but few studies have utilized video self-assessment of basic surgical skills. We compared a video self-assessment of suturing and knot tying skills by novice trainees to the assessment by a senior attending surgeon. Sixteen senior medical students and 7 beginner surgical interns were video-recorded while performing five suturing and knot tying tasks. All videos were analyzed using an objective structured assessment of technical skills (OSATS) metrics (1-5 scale; 1 = novice, 5 = expert). Video self-assessment was carried out within 4 weeks of an instructional session and subsequently by one senior surgery instructor (blinded to the individual). Both a Global score and total combined OSATS scores were analyzed. Total possible OSATS scores were: interrupted suture-30, subcuticular closure-30, one and two-handed knot tying-25 each, tying in a restricted space 20; maximum combined score-130 points). Confidence levels in performing the tasks pre-test and the value of video self-assessment were rated on a 1-5 Likert scale (1 = low and 5 = high). Data are mean±SD and statistical significance was evaluated using Friedman's test. Self-assessment scoring was significantly higher than the assessment by a senior instructor for three tasks by global score and all five tasks by combined OSATS score (self-assessment 71.8±16.7 vs attending assessment 56.7±11.0, p = 0.007). Mean self-assessment Global scores ranged from 2.5 to 2.8 for all tasks performed compared to 1.8-2.3 for attending surgeon assessment (pvideo self-assessment was rated as a highly valuable (mean 4.3±0.8) component to skills training. Novice trainees over-estimate their basic technical skills performance compared to the assessment by a senior surgeon. Video self-assessment may be a valuable addition to a pre-residency and surgical internship preparatory curriculum in basic suturing and knot tying. Copyright © 2013 Association of Program Directors in Surgery. Published

  1. Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists

    DEFF Research Database (Denmark)

    Lyk-Jensen, Helle Teglgaard; Dieckmann, Peter; Konge, Lars

    2016-01-01

    Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N......-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse...... at the elements level. When the raters' ratings were compared with ratings by an expert reference group, there was no statistically significant effect on training. We conclude that Danish nurse anesthetist supervisors without further rater training besides their work experience can use N-ANTS to assess...

  2. The Role of Work-Related Skills and Career Role Models in Adolescent Career Maturity.

    Science.gov (United States)

    Flouri, Eirini; Buchanan, Ann

    2002-01-01

    Using data for 2,722 British adolescents explores whether work-related skills and career role models are associated with career maturity when sociodemographic characteristics, family support, and personal characteristics are controlled. Having work-related skills and having a career role model were positively associated with career maturity.…

  3. Developing Learning Model P3E to Improve Students’ Critical Thinking Skills of Islamic Senior High School

    Science.gov (United States)

    Bahtiar; Rahayu, Y. S.; Wasis

    2018-01-01

    This research aims to produce P3E learning model to improve students’ critical thinking skills. The developed model is named P3E, consisting of 4 (four) stages namely; organization, inquiry, presentation, and evaluation. This development research refers to the development stage by Kemp. The design of the wide scale try-out used pretest-posttest group design. The wide scale try-out was conducted in grade X of 2016/2017 academic year. The analysis of the results of this development research inludes three aspects, namely: validity, practicality, and effectiveness of the model developed. The research results showed; (1) the P3E learning model was valid, according to experts with an average value of 3.7; (2) The completion of the syntax of the learning model developed obtained 98.09% and 94.39% for two schools based on the assessment of the observers. This shows that the developed model is practical to be implemented; (3) the developed model is effective for improving students’ critical thinking skills, although the n-gain of the students’ critical thinking skills was 0.54 with moderate category. Based on the results of the research above, it can be concluded that the developed P3E learning model is suitable to be used to improve students’ critical thinking skills.

  4. Reliability and Validity of a Spanish Language Assessment of Children's Social-Emotional Learning Skills.

    Science.gov (United States)

    Russo, Jaclyn M; McKown, Clark; Russo-Ponsaran, Nicole M; Allen, Adelaide

    2017-06-19

    Few Spanish language tools are available for assessing important social-emotional learning (SEL) skills. The present study presents evidence of the psychometric properties of a Spanish-language version of SELweb (SELweb-S), a web-based system for assessing children's ability to recognize others' emotions and perspectives, solve social problems, and engage in self-control. With a sample of 524 students in Grades K to 3, we examined the reliability and validity of SELweb-S. This study provided evidence that (a) individual assessment modules exhibited moderate to high internal consistency and moderate 6-month temporal stability, (b) composite assessment scores exhibited high reliability, (c) assessment module scores fit a theoretically coherent factor structure, and (d) performance on SELweb-S assessment modules was positively related to teacher-reported SEL skills. Findings are discussed in terms of the importance of direct assessments of SEL skills in languages other than English. In addition, we highlight the importance of abiding by rigorous recommendations in the literature for the translation and cultural adaptation of assessments. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  5. Skills in clinical communication: Are we correctly assessing them at undergraduate level?

    Directory of Open Access Journals (Sweden)

    Alberto Zamora Cervantes

    2014-07-01

    Full Text Available Communicating with the patient in clinical practice refers to the way in which the doctor and the patient interact both verbally and nonverbally, in order to achieve a shared understanding of problems and solutions. Traditional learning and assessment systems are overwhelmed when it comes to addressing the complex and multi-dimensional problems of professional practice. Problem Based Learning (PBL has been put forward as an alternative to the mere reproduction of knowledge and pre-established patterns, enabling students to develop their own learning strategies to overcome problems in their future professional practice. The challenge is to determine how to assess the acquisition of clinical communication skills. The authors have recommended a summative assessment of clinical communication skills based on the combination of different methods. It highlights the importance of feedback-based formative assessment. This raises the need to develop and validate assessment scales in clinical communication at an undergraduate level. Based on this work, the authors put forward a "fanned out" assessment in terms of clinical communication skills in Medicine degrees, with the use of different instruments in a "spiraled" manner, where the greater the contact with clinical practice in the various degree and integral courses, the greater difficulty experienced, with the participation of all the stakeholders involved (self, hetero and peer assessment without precluding the involvement of patients (real or simulated in the design of assessment instruments.

  6. Assessment of advocacy skills of students in the faculty of law

    Directory of Open Access Journals (Sweden)

    Arifi Besa

    2015-12-01

    Full Text Available This article aims to present the main findings of a small scale project developed with third year students of the Faculty of Law at South East European University regarding assessment of advocacy skills. The author who works as an assistant professor in the Faculty of Law has developed a pilot project aiming to create a new methodology on assessment. Advocacy skills represent the main learning outcome for law students in different universities. Oral assessment in faculties of law has evolved in interesting ways thoroughly described in this article. The aim of this pilot project was to establish an objective and comprehensive methodology of assessment that includes oral presentations of case studies as well as oral assessment in the final exam. The author explains the challenges faced during the development of this pilot project and the creation of assessment rubrics. The author discusses the results of the project and gives an explanation of the way the project was developed and conducted. The conclusions and the recommendations given at the end discuss the importance of development of oral assessment techniques and provide certain insight information regarding the experience of teaching in the Faculty of Law. The author argues that oral assessment should be regarded as a very important asset which needs to be developed further with the aim of providing students the possibility to gain effective advocacy skills during their education.

  7. Assessing Nurse Anaesthetists' Non-Technical Skills in the operating room.

    Science.gov (United States)

    Lyk-Jensen, H T; Jepsen, R M H G; Spanager, L; Dieckmann, P; Østergaard, D

    2014-08-01

    Incident reporting and fieldwork in operating rooms have shown that some of the errors that arise in anaesthesia relate to inadequate use of non-technical skills. To provide a tool for training and feedback on nurse anaesthetists' non-technical skills, this study aimed to adapt the Anaesthetists' Non-Technical Skills (ANTS) as a behavioural marker system for the formative assessment of nurse anaesthetists' non-technical skills in the operating room. A qualitative approach with focus group interviews was used to identify the non-technical skills of nurse anaesthetists in the operating room. The interview data were transcribed verbatim. Directed content analysis was used to code and sort data deductively into the ANTS categories: task management, team working, situation awareness and decision making. The prototype named Nurse Anaesthetists' Non-Technical Skills (N-ANTS) was presented and discussed in a group of subject matter experts to ensure face validity. The N-ANTS system consists of the same four categories as ANTS and 15 underlying elements. Three to five good and poor behavioural markers for each element were identified. The headings and definitions of the categories and elements were adjusted to encompass the behavioural markers in N-ANTS. The differences that emerged mainly reflected statements regarding the establishment of role, competence, and task delegation. A behavioural marker system, N-ANTS, for nurse anaesthetists was adapted from a behavioural marker system, ANTS, for anaesthesiologists. © 2014 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

  8. Customisation of an instrument to assess anaesthesiologists' non-technical skills.

    Science.gov (United States)

    Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

    2015-02-22

    The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

  9. Pilot Evaluation of a Communication Skills Training Program for Psychiatry Residents Using Standardized Patient Assessment.

    Science.gov (United States)

    Ditton-Phare, Philippa; Sandhu, Harsimrat; Kelly, Brian; Kissane, David; Loughland, Carmel

    2016-10-01

    Mental health clinicians can experience difficulties communicating diagnostic information to patients and their families/carers, especially about distressing psychiatric disorders such as schizophrenia. There is evidence for the effectiveness of communication skills training (CST) for improving diagnostic discussions, particularly in specialties such as oncology, but only limited evidence exists about CST for psychiatry. This study evaluated a CST program specifically developed for psychiatry residents called ComPsych that focuses on conveying diagnostic and prognostic information about schizophrenia. The ComPsych program consists of an introductory lecture, module booklets for trainees, and exemplary skills videos, followed by small group role-plays with simulated patients (SPs) led by a trained facilitator. A standardized patient assessment (SPA) was digitally recorded pre- and post-training with a SP using a standardized scenario in a time-limited (15 min) period. Recorded SPAs were independently rated using a validated coding system (ComSkil) to identify frequency of skills used in five skills categories (agenda setting, checking, questioning, information organization, and empathic communication). Thirty trainees (15 males and 15 females; median age = 32) undertaking their vocational specialty training in psychiatry participated in ComPsych training and pre- and post-ComPsych SPAs. Skills increased post-training for agenda setting (d = -0.82), while questioning skills (d = 0.56) decreased. There were no significant differences in any other skills grouping, although checking, information organization, and empathic communication skills tended to increase post-training. A dose effect was observed for agenda setting, with trainees who attended more CST sessions outperforming those attending fewer. Findings support the generalization and translation of ComPsych CST to psychiatry.

  10. PENGEMBANGAN MODEL PELATIHAN SOFT-SKILLS PADA SISWA SEKOLAH MENENGAH PERTAMA NEGERI (SMPN DI KOTA MATARAM

    Directory of Open Access Journals (Sweden)

    Anik Darmiany

    2016-06-01

    Full Text Available Abstrak : Penelitian dan pengembangan ini bertujuan menghasilkan model pelatihan soft-skill khususnya keterampilan komunikasi dan kendali emosi siswa sekolah menengah pertama negeri (SMPN di kota Mataram. Metode penelitian dan pengembangan dilakukan melalui tiga tahap dari sepuluh langkah Borg & Gall yaitu, (1 penelitian awal (analisis kebutuhan, (2 pengembangan model pelatihan, (3 uji coba dan evaluasi model. Hasil penelitian menunjukkan bahwa pengembangan model pelatihan soft-skill menghasilkan pedoman pelatihan untuk konselor dan siswa, serta materi pelatihan soft-skill yang memenuhi kriteria akseptabel dari kegunaan, kemanfaatan, dan kelayakan. Disamping itu hasil penelitian menunjukkan pula bahwa terdapat perbedaan skor antara pre-test dan post-test keterampilan mengelola emosi dari tidak terampil menjadi sangat trampil, dan keterampilan komunikasi dari tidak terampil menjadi cukup terampil.   Abstract: Research and development is aimed to produce soft-skills training models especially in communication skills and emotional control student junior high school (SMP in Mataram city. Research and development method is carried out through three stages from the ten steps of Borg & Gall, they are; (1 the preliminary research (needs analysis, (2 the development of training model, (3 Model evaluation and try out. The results show that the development of soft-skills training model develop training manual for counselors and students, as well as soft-skills training materials that meet acceptable criteria of usability, usefulness and feasibility. Besides, the results showed also that there is a difference in scores between pre-test and post-test in skills at managing emotions from unskilled to be very skilled, and communication skills from unskilled become quite skilled.

  11. Assessment of sensorimotor cortical representation asymmetries and motor skills in violin players.

    Science.gov (United States)

    Schwenkreis, Peter; El Tom, Susan; Ragert, Patrick; Pleger, Burkhard; Tegenthoff, Martin; Dinse, Hubert R

    2007-12-01

    As a model for use-dependent plasticity, the brains of professional musicians have been extensively studied to examine structural and functional adaptation to unique requirements of skilled performance. Here we provide a combination of data on motor performance and hand representation in the primary motor and somatosensory cortex of professional violin players, with the aim of assessing possible behavioural consequences of sensorimotor cortical asymmetries. We studied 15 healthy right-handed professional violin players and 35 healthy nonmusician controls. Motor and somatosensory cortex asymmetry was assessed by recording the motor output map after transcranial magnetic stimulation from a small hand muscle, and by dipole source localization of somatosensory evoked potentials after electrical stimulation of the median and ulnar nerves. Motor performance was examined using a series of standardized motor tasks covering different aspects of hand function. Violin players showed a significant right-larger-than-left asymmetry of the motor and somatosensory cortex, whereas nonmusician controls showed no significant interhemispheric difference. The amount of asymmetry in the motor and somatosensory cortices of musicians was significantly correlated. At the behavioural level, motor performance did not significantly differ between musicians and nonmusicians. The results support a use-dependent enlargement of the left hand representation in the sensorimotor cortex of violin players. However, these cortical asymmetries were not paralleled by accompanying altered asymmetries at a behavioural level, suggesting that the reorganisation might be task-specific and does not lead to improved motor abilities in general.

  12. Assessment of knowledge and skills in information literacy instruction for rehabilitation sciences students: a scoping review.

    Science.gov (United States)

    Boruff, Jill T; Harrison, Pamela

    2018-01-01

    This scoping review investigates how knowledge and skills are assessed in the information literacy (IL) instruction for students in physical therapy, occupational therapy, or speech-language pathology, regardless of whether the instruction was given by a librarian. The objectives were to discover what assessment measures were used, determine whether these assessment methods were tested for reliability and validity, and provide librarians with guidance on assessment methods to use in their instruction in evidence-based practice contexts. A scoping review methodology was used. A systematic search strategy was run in Ovid MEDLINE and adapted for CINAHL; EMBASE; Education Resources Information Center (ERIC) (EBSCO); Library and Information Science Abstracts (LISA); Library, Information Science & Technology Abstracts (LISTA); and Proquest Theses and Dissertations from 1990 to January 16, 2017. Forty articles were included for data extraction. Three major themes emerged: types of measures used, type and context of librarian involvement, and skills and outcomes described. Thirty-four measures of attitude and thirty-seven measures of performance were identified. Course products were the most commonly used type of performance measure. Librarians were involved in almost half the studies, most frequently as instructor, but also as author or assessor. Information literacy skills such as question formulation and database searching were described in studies that did not involve a librarian. Librarians involved in instructional assessment can use rubrics such as the Valid Assessment of Learning in Undergraduate Education (VALUE) when grading assignments to improve the measurement of knowledge and skills in course-integrated IL instruction. The Adapted Fresno Test could be modified to better suit the real-life application of IL knowledge and skills.

  13. Station-based deconstructed training model for teaching procedural skills to medical students: a quasi-experimental study

    Directory of Open Access Journals (Sweden)

    Mahdi Panah Khahi

    2010-09-01

    Full Text Available Seyyed M Razavi1, Mojgan Karbakhsh1, Mahdi Panah Khahi2, Soheila Dabiran1, Sara Asefi3, GhamarH Zaker Shahrak4, Ali R Bad Afrooz41Department of Community Medicine, 2Department of Anesthesiology, 3Department of General Practice, 4Clinical Skills Center, Tehran University of Medical Sciences, IranBackground: Every procedural skill consists of some microskills. One of the effective techniques for teaching a main procedural skill is to deconstruct the skill into a series of microskills and train students on each microskill separately. When we learn microskills, we will learn the main skill also. This model can be beneficial for tuition on procedural skills.Objective: In this study, we propose a stationed-based deconstructed training model for tuition of each microskill, and then we assessed the medical students’ self-perceived abilities.Methods: This quasi-experimental study was conducted in 268 medical students (536 matched pre- and post-questionnaires at the surgical clerkship stage during five consecutive years in three teaching and learning groups. In this study, we taught each skill in 10 steps (proposed model to the students. We then evaluated the students’ self-perceived abilities using a pre- and post-self-assessment technique. SPSS v13 software with one-way analysis of variance and paired t-tests were used for data collection and analysis.Results: Assessment of medical students’ perceived abilities before and after training showed a significant improvement (P < 0.001 in both cognitive and practical domains. There were also significant differences between the three teaching and learning groups (P < 0.001. There were no significant differences for the different years of training regarding the observed improvement.Conclusion: This study suggests that deconstructing the practical skills into microskills and tuition of those microskills via the separated structured educational stations is effective according to the students’ self

  14. The Role of Infographics for the Development of Skills for Cognitive Modeling in Education

    Directory of Open Access Journals (Sweden)

    Ivo Damyanov

    2018-01-01

    Full Text Available Contemporary culture is a visual culture. Visual images become the predominant form of communication. Students should be visually literate and be able to read and use visual language, to decode, interpret and evaluate visual messages successfully, and, last but not least, to encode and compose meaningful visual communication. The combination of modeling with other methods in scientific knowledge increases its potential as a cognitive method. Infographics can play a significant role in the process as tool or target according to the age and cognitive abilities of the students. Information images (infographics are visual representations of information, data or knowledge. The use of infographics as a modeling method can develop different cognitive skills such as interpretation, analysis, assessment, conclusion, explanation, which are all part of the modeling process. In fact, they can be a tool for achieving the next stage of literacy - visual literacy. All this necessitates the exploration of infographics as an instrument in the development of a comprehensive system of cognitive tasks in education related to the formation of skills for modeling. In the paper, six types of cognitive tasks in education are analyzed as well as their relation to the visual literacy competence standards approved by the Association of College & Research Libraries. A comparison of freely available infographics tools is provided and the suitability of different infographics templates is discussed.

  15. Use of simulated patients to assess the clinical and communication skills of community pharmacists.

    Science.gov (United States)

    Weiss, Marjorie C; Booth, Anneka; Jones, Bethan; Ramjeet, Sarah; Wong, Eva

    2010-06-01

    To investigate the quality and appropriateness of Emergency Hormonal Contraception (EHC) supply from community pharmacies. Community pharmacies in the southwest of England during 2007. Two simulated patient ('mystery shopper') scenarios to each participating pharmacy, one where the supply of EHC would be appropriate (scenario 1) and one where there was a drug interaction between EHC and St John's Wort, and the supply inappropriate (scenario 2). Pharmacy consultations were rated using criteria developed from two focus groups: one with pharmacist academics and one with female university students. Feedback to pharmacists to inform their continuing professional development was provided. Scores on rating scales encompassing the clinical and communication skills of the participating community pharmacists completed immediately after each mystery shopper visit. 40 pharmacist visits were completed: 21 for scenario 1 and 19 for scenario 2. Eighteen pharmacists were visited twice. Five pharmacists visited for scenario 2 supplied EHC against professional guidance, although other reference sources conflicted with this advice. Pharmacies which were part of the local PGD scheme scored higher overall in scenario 1 (P = 0.005) than those not part of the scheme. Overall the communication skills of pharmacists were rated highly although some pharmacists used jargon when explaining the interaction for scenario 2. Formatively assessing communication skills in an integrative manner alongside clinical skills has been identified as an important part of the medical consultation skills training and can be incorporated into the routine assessment and feedback of pharmacy over-the-counter medicines advice.

  16. Overuse Injury Assessment Model

    Science.gov (United States)

    2006-03-01

    bones in celiac disease patients." Am J Gastroenterol 98(2): 382-390. Ferretti, J. L. 1997. "Noninvasive Assessment of Bone Architecture and...altered gait pretest anthropometry diet and nutrition genetics endocrine status and hormones bone disease (pathology) age initial bone health state...and between subjects can be expected. Consequently large numbers of subject are required to obtain statistically significant results. Even with

  17. Using Reflection to Assess Students Ability to Learn and Develop Leadership Skills

    Science.gov (United States)

    Olsen, Heather M.; Burk, Brooke

    2014-01-01

    Leadership skill development has been identified as an important element of future leisure service professionals academic preparation. Thus, the purpose of this paper was to utilize in-depth course reflection and service-learning to assess whether undergraduate students enrolled in a leadership course were meeting the leadership objectives set…

  18. Assessment of knowledge and skills about growth monitoring amongst multipurpose workers in an ICDS project.

    Science.gov (United States)

    Kapil, U; Sood, A K; Gaur, D R; Bhasin, S

    1991-08-01

    Knowledge and skills amongst 34 multipurpose workers working in an ICDS project about growth monitoring was assessed using interview technique. All workers had correct knowledge about rationale of growth monitoring. A total of 73.5% and 94.1% had knowledge that flattened growth curve indicates no weight gain and descending growth indicates decrease in weight, respectively.

  19. From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining

    Science.gov (United States)

    Gobert, Janice D.; Sao Pedro, Michael; Raziuddin, Juelaila; Baker, Ryan S.

    2013-01-01

    We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

  20. Assessing nursing students' basic communication and interviewing skills: the development and testing of a rating scale.

    Science.gov (United States)

    Arthur, D

    1999-03-01

    This study explores the communication skills of a group of nursing students who were required to interview a simulated client as part of their studies. In order to assess the students and to improve the process of learning discrete skills, an instrument was developed and tested as part of this process. The subjects were 212 nurses enrolled in a bachelor of nursing programme, in New South Wales, Australia, who were studying a problem-based learning package the focus of which was 'alcohol early intervention'. The sub-groups within the sample included registered nurses, a significant percentage of whom had completed their basic nursing education in overseas countries. The Simulated Client Interview Rating Scale (SCIRS) was developed to assess basic humanistic communication skills as well as beginning motivational interviewing skills. The students were required to interview a simulated client and demonstrate competence in interviewing. This was assessed by the SCIRS which was completed by the students and the simulated clients. The instrument proved to be a reliable and valid means of assessing student interview technique as well as a flexible educational tool, while valuable insights into students' interviewing techniques were gained.

  1. Assessment of Communication Skills of Physical Education and Sport Students in Turkish Universities

    Science.gov (United States)

    Aydin, Ali Dursun

    2015-01-01

    This study assessed the communication skills of the students studying in physical education and sports schools in various universities in Turkey. A total of 1,854 Physical Education and Sports students in five Turkish universities participated in the study. The instrument used to gather information for this study comprised the demographic…

  2. Video Review in Self-Assessment of Pharmacy Students' Communication Skills

    Science.gov (United States)

    Volino, Lucio R.; Das, Rolee Pathak

    2014-01-01

    The objectives of this study were to develop a student self-assessment activity of a video-recorded counseling session and evaluate its impact on student self-perceptions of specific communication skills. This activity was incorporated into a core-communications course within the third professional year of a Doctor of Pharmacy curriculum. Student…

  3. Assessing Early Communication Skills at 12 Months: A Retrospective Study of Autism Spectrum Disorder

    Science.gov (United States)

    Swain, Nathaniel Robert; Eadie, Patricia Ann; Prior, Margot Ruth; Reilly, Sheena

    2015-01-01

    Background: Early identification of Autism Spectrum Disorder (ASD) is currently limited by the absence of reliable biological markers for the disorder, as well as the reliability of screening and assessment tools for children aged between 6 and 18 months. Ongoing research has demonstrated the importance of early social communication skills in…

  4. Developing Teachers' Knowledge and Skills at the Intersection of English Language Learners and Language Assessment

    Science.gov (United States)

    Téllez, Kip; Mosqueda, Eduardo

    2015-01-01

    The growth of teachers' professional knowledge and skills has been the topic of policy, research, and even philosophy for many decades. The assessment of English Learners (ELs), a more specific concern, has become an interest of the educational community in just the past 40 years (e.g., Harris, 1969). The authors' task in this chapter is to…

  5. Assessing students' ability in performing scientific inquiry: instruments for measuring science skills in primary education

    NARCIS (Netherlands)

    Kruit, Patricia; Oostdam, R.J.; van den Berg, E.; Schuitema, J.

    2018-01-01

    ABSTRACT Background: With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to

  6. Assessing the Communication Skills of Carers Working with Multiple Learning Disabilities: A Case Study

    Science.gov (United States)

    Koski, Katja; Launonen, Kaisa

    2012-01-01

    Background: Speech and language therapists (SLTs) working with adults who have multiple learning disabilities and complex communication needs often deliver their care via indirect therapy where SLTs train carers to communicate with their clients. Yet, very little is known about how SLTs assess the carers' communication skills prior to the training…

  7. Assessing the impact of a study skills workshop on the academic ...

    African Journals Online (AJOL)

    Assessing the impact of a study skills workshop on the academic achievement of first-year nursing students at the University of Venda, South Africa. ... The training is offered in the form of workshops and covers various topics such as motivation, time management, learning strategies, concentration and examination ...

  8. Critical thinking skills in midwifery practice: Development of a self-assessment tool for students.

    Science.gov (United States)

    Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

    2017-07-01

    Develop and test a tool designed for use by pre-registration midwifery students to self-appraise their critical thinking in practice. A descriptive cohort design was used. All students (n=164) enrolled in a three-year Bachelor of Midwifery program in Queensland, Australia. The staged model for tool development involved item generation, mapping draft items to critical thinking concepts and expert review to test content validity, pilot testing of the tool to a convenience sample of students, and psychometric testing. Students (n=126, 76.8% response rate) provided demographic details, completed the new tool, and five questions from the Motivated Strategies for Learning Questionnaire (MSLQ) via an online platform or paper version. A high content validity index score of 0.97 was achieved through expert review. Construct validity via factor analysis revealed four factors: seeks information, reflects on practice, facilitates shared decision making, and evaluates practice. The mean total score for the tool was 124.98 (SD=12.58). Total and subscale scores correlated significantly. The scale achieved good internal reliability with a Cronbach's alpha coefficient of 0.92. Concurrent validity with the MSLQ subscale was 0.35 (pthinking in practice. Critical thinking skills are vital for safe and effective midwifery practice. Students' assessment of their critical thinking development throughout their pre-registration programme makes these skills explicit, and could guide teaching innovation to address identified deficits. The availability of a reliable and valid tool assists research into the development of critical thinking in education and practice. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

  9. Preliminary study of virtual reality and model simulation for learning laparoscopic suturing skills.

    Science.gov (United States)

    McDougall, Elspeth M; Kolla, Surendra B; Santos, Rosanne T; Gan, Jennifer M; Box, Geoffrey N; Louie, Michael K; Gamboa, Aldrin J R; Kaplan, Adam G; Moskowitz, Ross M; Andrade, Lorena A; Skarecky, Douglas W; Osann, Kathryn E; Clayman, Ralph V

    2009-09-01

    Repetitive practice of laparoscopic suturing and knot tying can facilitate surgeon proficiency in performing this reconstructive technique. We compared a silicone model and pelvic trainer to a virtual reality simulator in the learning of laparoscopic suturing and knot tying by laparoscopically naïve medical students, and evaluated the subsequent performance of porcine laparoscopic cystorrhaphy. A total of 20 medical students underwent a 1-hour didactic session with video demonstration of laparoscopic suturing and knot tying by an expert laparoscopic surgeon. The students were randomized to a pelvic trainer (10) or virtual reality simulator (10) for a minimum of 2 hours of laparoscopic suturing and knot tying training. Within 1 week of the training session the medical students performed laparoscopic closure of a 2 cm cystotomy in a porcine model. Objective structured assessment of technical skills for laparoscopic cystorrhaphy was performed at the procedure by laparoscopic surgeons blinded to the medical student training format. A video of the procedure was evaluated with an objective structured assessment of technical skills by an expert laparoscopic surgeon blinded to medical student identity and training format. The medical students completed an evaluation questionnaire regarding the training format after the laparoscopic cystorrhaphy. All students were able to complete the laparoscopic cystorrhaphy. There was no difference between the pelvic trainer and virtual reality groups in mean +/- SD time to perform the porcine cystorrhaphy at 40 +/- 15 vs 41 +/- 10 minutes (p = 0.87) or the objective structured assessment of technical skills score of 8.8 +/- 2.3 vs 8.2 +/- 2.2 (p = 0.24), respectively. Bladder leak occurred in 3 (30%) of the pelvic trainer trained and 6 (60%) of the virtual reality trained medical student laparoscopic cystorrhaphy procedures (Fisher exact test p = 0.37). The only significant difference between the 2 groups was that 4 virtual reality

  10. Skill assessment of precipitation nowcasting in Mediterranean Heavy Precipitation Events

    Science.gov (United States)

    Bech, Joan; Berenguer, Marc

    2013-04-01

    Gayà, J Arús, J Montanyà, O van der Velde, 2011: A Mediterranean nocturnal heavy rainfall and tornadic event. Part I: Overview, damage survey and radar analysis. Atmospheric Research 100:621-637 http://dx.doi.org/10.1016/j.atmosres.2010.12.024 Bech J, R Pascual, T Rigo, N Pineda, JM López, J Arús, and M Gayà, 2007: An observational study of the 7 September 2005 Barcelona tornado outbreak. Natural Hazards and Earth System Science 7:129-139 http://dx.doi.org/10.5194/nhess-7-129-2007 Berenguer M, C Corral, R Sánchez-Diezma, D Sempere-Torres, 2005: Hydrological validation of a radar-based nowcasting technique. Journal of Hydrometeorology 6: 532-549 http://dx.doi.org/10.1175/JHM433.1 Berenguer M, D Sempere, G Pegram, 2011: SBMcast - An ensemble nowcasting technique to assess the uncertainty in rainfall forecasts by Lagrangian extrapolation. Journal of Hydrology 404: 226-240 http://dx.doi.org/10.1016/j.jhydrol.2011.04.033 Pierce C, A Seed, S Ballard, D Simonin, Z Li, 2012: Nowcasting. In Doppler Radar Observations (J Bech, JL Chau, ed.) Ch. 13, 98-142. InTech, Rijeka, Croatia http://dx.doi.org/10.5772/39054

  11. Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review.

    Science.gov (United States)

    Jelovsek, J Eric; Kow, Nathan; Diwadkar, Gouri B

    2013-07-01

    The Accreditation Council for Graduate Medical Education (ACGME) Milestone Project mandates programmes to assess the attainment of training outcomes, including the psychomotor (surgical or procedural) skills of medical trainees. The objectives of this study were to determine which tools exist to directly assess psychomotor skills in medical trainees on live patients and to identify the data indicating their psychometric and edumetric properties. An electronic search was conducted for papers published from January 1948 to May 2011 using the PubMed, Education Resource Information Center (ERIC), Cumulative Index to Nursing and Allied Health Literature (CINAHL) and Web of Science electronic databases and the review of references in article bibliographies. A study was included if it described a tool or instrument designed for the direct observation of psychomotor skills in patient care settings by supervisors. Studies were excluded if they referred to tools that assessed only clinical or non-technical skills, involved non-medical health professionals, or assessed skills performed on a simulator. Overall, 4114 citations were screened, 168 (4.1%) articles were reviewed for eligibility and 51 (1.2%) manuscripts were identified as meeting the study inclusion criteria. Three authors abstracted and reviewed studies using a standardised form for the presence of key psychometric and edumetric elements as per ACGME and American Psychological Association (APA) recommendations, and also assigned an overall grade based on the ACGME Committee on Educational Outcome Assessment grading system. A total of 30 tools were identified. Construct validity based on associations between scores and training level was identified in 24 tools, internal consistency in 14, test-retest reliability in five and inter-rater reliability in 20. The modification of attitudes, knowledge or skills was reported using five tools. The seven-item Global Rating Scale and the Procedure-Based Assessment received an

  12. Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

    Science.gov (United States)

    Azizah, K. N.; Ibrahim, M.; Widodo, W.

    2018-01-01

    Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

  13. Effects of Cooperative Integrated Reading and Composition Learning Model on the English Learning Skills

    Directory of Open Access Journals (Sweden)

    Hadiwinarto Hadiwinarto

    2015-05-01

    Full Text Available This research was aimed at describing the effects of Cooperative Integrated Reading and Composition (CIRC learning model on the reading and writing skills of junior high school students in learning English. This research applied one group pretest-posttest design. Data were collected by using tests and analized by using descriptive analysis and t-test. The result showed that: the average score for reading skill before the experiment was 50.00 and the average score for reading skill after the experiment was 65.58. On the other hand, the average score for writing skill before the experiment was 38.21 and the average score for writing skill after experiment was 58.05. The implementation of CIRC learning model had very significant effects on the English reading and writing skills of the junior high school students.

  14. Novel real-time feedback and integrated simulation model for teaching and evaluating ultrasound-guided regional anesthesia skills in pediatric anesthesia trainees.

    Science.gov (United States)

    Moore, David L; Ding, Lili; Sadhasivam, Senthilkumar

    2012-09-01

    To assess, teach, and improve core competencies and skills sets associated with ultrasound-guided regional anesthesia (UGRA) of pediatric anesthesia trainees. To effectively assess and improve UGRA-associated cognitive and technical skills and proficiency of pediatric anesthesia trainees using simulators and real-time feedback. Ultrasound usage has been increasingly adopted by anesthesiologists to perform regional anesthesia. Pediatric UGRA performance significantly lags behind adult UGRA practice. Lack of effective UGRA training is the major reason for this unfortunate lag. Integration of ultrasound imaging, target location, and needling skills are crucial in safely performing UGRA. However, there are no standards to ensure proficiency in practice, nor in training. We implemented an UGRA instructional program for all trainees, in two parts. First, we used a unique training model for initial assessment and training of technical skills. Second, we used an instructional program that encompasses UGRA and equipment-associated cognitive skills. After baseline assessment at 0 months, we retested these trainees at 6 and 12 months to identify progression of proficiency over time. Cognitive and technical UGRA skills of trainees improved significantly over the course of time. UGRA performance average accuracy improved to 79% at 12 months from the baseline accuracy of 57%. Cognitive UGRA-related skills of trainees improved from baseline results of 52.5-79.2% at 12 months. Implementing a multifaceted assessment and real-time feedback-based training has significantly improved UGRA-related cognitive and technical skills and proficiency of pediatric anesthesia trainees. © 2012 Blackwell Publishing Ltd.

  15. Adapting the Assessing British Sign Language Development: Receptive Skills Test into American sign language

    OpenAIRE

    Enns, C. J.; Herman, R.

    2011-01-01

    Signed languages continue to be a key element of deaf education programs that incorporate a bilingual approach to teaching and learning. In order to monitor the success of bilingual deaf education programs, and in particular to monitor the progress of children acquiring signed language, it is essential to develop an assessment tool of signed language skills. Although researchers have developed some checklists and experimental tests related to American Sign Language (ASL) assessment, at this t...

  16. Using systematically observed clinical encounters (SOCEs to assess medical students’ skills in clinical settings

    Directory of Open Access Journals (Sweden)

    George R Bergus

    2010-11-01

    Full Text Available George R Bergus1–3, Jerold C Woodhead4, Clarence D Kreiter2,51Performance Based Assessment Program, Office of Student Affairs and Curriculum, 2Department of Family Medicine, 3Department of Psychiatry, 4Department of Pediatrics, 5Office of Consultation and Research in Medical Education, Roy J and Lucille A Carver College of Medicine, The University of Iowa, Iowa City, IA, USAIntroduction: The Objective Structured Clinical Examination (OSCE is widely used to assess the clinical performance of medical students. However, concerns related to cost, availability, and validity, have led educators to investigate alternatives to the OSCE. Some alternatives involve assessing students while they provide care to patients – the mini-CEX (mini-Clinical Evaluation Exercise and the Long Case are examples. We investigated the psychometrics of systematically observed clinical encounters (SOCEs, in which physicians are supplemented by lay trained observers, as a means of assessing the clinical performances of medical students.Methods: During the pediatrics clerkship at the University of Iowa, trained lay observers assessed the communication skills of third-year medical students using a communication checklist while the students interviewed and examined pediatric patients. Students then verbally presented their findings to faculty, who assessed students’ clinical skills using a standardized form. The reliability of the combined communication and clinical skills scores was calculated using generalizability theory.Results: Fifty-one medical students completed 199 observed patient encounters. The mean combined clinical and communication skills score (out of a maximum 45 points was 40.8 (standard deviation 3.3. The calculated reliability of the SOCE scores, using generalizability theory, from 10 observed patient encounters was 0.81. Students reported receiving helpful feedback from faculty after 97% of their observed clinical encounters.Conclusion: The SOCE can

  17. The development of the PARENTS: a tool for parents to assess residents' non-technical skills in pediatric emergency departments.

    Science.gov (United States)

    Moreau, Katherine A; Eady, Kaylee; Tang, Kenneth; Jabbour, Mona; Frank, Jason R; Campbell, Meaghan; Hamstra, Stanley J

    2017-11-14

    Parents can assess residents' non-technical skills (NTS) in pediatric emergency departments (EDs). There are no assessment tools, with validity evidence, for parental use in pediatric EDs. The purpose of this study was to develop the Parents' Assessment of Residents Enacting Non-Technical Skills (PARENTS) educational assessment tool and collect three sources of validity evidence (i.e., content, response process, internal structure) for it. We established content evidence for the PARENTS through interviews with physician-educators and residents, focus groups with parents, a literature review, and a modified nominal group technique with experts. We collected response process evidence through cognitive interviews with parents. To examine the internal structure evidence, we administered the PARENTS and performed exploratory factor analysis. Initially, a 20-item PARENTS was developed. Cognitive interviews led to the removal of one closed-ended item, the addition of resident photographs, and wording/formatting changes. Thirty-seven residents and 434 parents participated in the administration of the resulting 19-item PARENTS. Following factor analysis, a one-factor model prevailed. The study presents initial validity evidence for the PARENTS. It also highlights strategies for potentially: (a) involving parents in the assessment of residents, (b) improving the assessment of NTS in pediatric EDs, and (c) capturing parents' perspectives to improve the preparation of future physicians.

  18. Integrated Environmental Assessment Modelling

    Energy Technology Data Exchange (ETDEWEB)

    Guardanz, R.; Gimeno, B. S.; Bermejo, V.; Elvira, S.; Martin, F.; Palacios, M.; Rodriguez, E.; Donaire, I. [Ciemat, Madrid (Spain)

    2000-07-01

    This report describes the results of the Spanish participation in the project Coupling CORINAIR data to cost-effect emission reduction strategies based on critical threshold. (EU/LIFE97/ENV/FIN/336). The subproject has focused on three tasks. Develop tools to improve knowledge on the spatial and temporal details of emissions of air pollutants in Spain. Exploit existing experimental information on plant response to air pollutants in temperate ecosystem and Integrate these findings in a modelling framework that can asses with more accuracy the impact of air pollutants to temperate ecosystems. The results obtained during the execution of this project have significantly improved the models of the impact of alternative emission control strategies on ecosystems and crops in the Iberian Peninsula. (Author) 375 refs.

  19. Encouraging IS developers to learn business skills: an examination of the MARS model

    OpenAIRE

    Tsay, Han-Huei (Crystal)

    2016-01-01

    Though prior research has recognized business skills as one of the keys to successful information system development, few studies have investigated the determinants of an IS developer’s behavioral intention to learn such skills. Based on the Motivation–Ability–Role Perception–Situational factors (i.e., the MARS model), this study argues that the intention of IS developers to acquire business skills is influenced by learning motivation (M), learning self-efficacy (A), change agent role percept...

  20. Effects of Cooperative Integrated Reading and Composition Learning Model on the English Learning Skills

    OpenAIRE

    Hadiwinarto, Hadiwinarto; Novianti, Novianti

    2015-01-01

    This research was aimed at describing the effects of Cooperative Integrated Reading and Composition (CIRC) learning model on the reading and writing skills of junior high school students in learning English. This research applied one group pretest-posttest design. Data were collected by using tests and analized by using descriptive analysis and t-test. The result showed that: the average score for reading skill before the experiment was 50.00 and the average score for reading skill after the ...

  1. PENGEMBANGAN MODEL PELATIHAN SOFT-SKILLS PADA SISWA SEKOLAH MENENGAH PERTAMA NEGERI (SMPN) DI KOTA MATARAM

    OpenAIRE

    Anik Darmiany

    2016-01-01

    Abstrak : Penelitian dan pengembangan ini bertujuan menghasilkan model pelatihan soft-skill khususnya keterampilan komunikasi dan kendali emosi siswa sekolah menengah pertama negeri (SMPN) di kota Mataram. Metode penelitian dan pengembangan dilakukan melalui tiga tahap dari sepuluh langkah Borg & Gall yaitu, (1) penelitian awal (analisis kebutuhan), (2) pengembangan model pelatihan, (3) uji coba dan evaluasi model. Hasil penelitian menunjukkan bahwa pengembangan model pelatihan soft-skill men...

  2. Evidence Regarding Teaching and Assessment of Record-Keeping Skills in Training of Dental Students.

    Science.gov (United States)

    Amos, Kate J; Bearman, Margaret; Palermo, Claire

    2015-10-01

    The aim of this study was to assess the literature on teaching and assessing dental students' record-keeping skills prior to qualification to practice independently as a dentist. A systematic literature review was performed using Ovid MEDLINE and SCOPUS. Keywords used in the search included dental, record, audit, education, and assessment. Electronic search results were screened for publications that targeted undergraduate dental training, related to a record-keeping education intervention, and were published in English and available in full text. Six studies met the inclusion and exclusion criteria. Data extraction and quality assessment were performed, and research findings were compared across the included studies. These six articles addressed the techniques used to teach and assess record-keeping skills in a pre-qualification context. The techniques included supervisor audits, peer audits, lectures, tutorials, research assignments, case reports, record-keeping templates, and checklists of required record components. The use of record audit as part of teaching and evaluation dominated these articles; it was used as the assessment method in five of the six studies. All methods of record-keeping training in studies published to date were found effective in improving student record-keeping skills. However, there was insufficient evidence to determine whether certain methods were more effective than others.

  3. Communication Skills assessed at OSCE are not affected by Participation in the Adolescent Healthy Sexuality Program

    Directory of Open Access Journals (Sweden)

    Deborah Penava

    2002-12-01

    Full Text Available We proposed that first year medical students who voluntarily participated in the Healthy Sexuality adolescent program would perform better than their peers on an adolescent counseling station at the year-end OSCE (Objective Structured Clinical Examination. In addition we compared medical students’ communication skills at the time of the program as assessed by self, peers and participating adolescents. Methods: Nineteen first year medical students voluntarily participated in the ongoing Healthy Sexuality program. Adolescent participants, medical student peer participants and medical students assessed communication components on a 7-point Likert scale at the end of the program. At the year-end OSCE, all first year medical students at the University of Western Ontario were assessed at an adolescent counseling station by a standardized patient (SP and a physician examiner. Statistical analysis examined differences between the two groups. Results: Students who participated in the Healthy Sexuality program did not perform better than their colleagues on the year-end OSCE. A statistically significant correlation between physician examiner and SP evaluations was found (r = 0.62. Adolescent participants communication skills assessments in the Healthy Sexuality Program demonstrated no significant correlation with medical student assessments (self or peer. Conclusions:Voluntary intervention with adolescents did not result in improved communication skills at the structured year-end examination. Further investigation will be directed towards delineating differences between SP and physician examiner assessments.

  4. The consequences of using advanced physical assessment skills in medical and surgical nursing: A hermeneutic pragmatic study.

    Science.gov (United States)

    Zambas, Shelaine I; Smythe, Elizabeth A; Koziol-Mclain, Jane

    2016-01-01

    The aim of this study was to explore the consequences of the nurse's use of advanced assessment skills on medical and surgical wards. Appropriate, accurate, and timely assessment by nurses is the cornerstone of maintaining patient safety in hospitals. The inclusion of "advanced" physical assessment skills such as auscultation, palpation, and percussion is thought to better prepare nurses for complex patient presentations within a wide range of clinical situations. This qualitative study used a hermeneutic pragmatic approach. Unstructured interviews were conducted with five experienced medical and surgical nurses to obtain 13 detailed narratives of assessment practice. Narratives were analyzed using Van Manen's six-step approach to identify the consequences of the nurse's use of advanced assessment skills. The consequences of using advanced assessment skills include looking for more, challenging interpretations, and perseverance. The use of advanced assessment skills directs what the nurse looks for, what she sees, interpretation of the findings, and her response. It is the interpretation of what is seen, heard, or felt within the full context of the patient situation, which is the advanced skill. Advanced assessment skill is the means to an accurate interpretation of the clinical situation and contributes to appropriate diagnosis and medical management in complex patient situations. The nurse's use of advanced assessment skills enables her to contribute to diagnostic reasoning within the acute medical and surgical setting.

  5. Prediction skill of rainstorm events over India in the TIGGE weather prediction models

    Science.gov (United States)

    Karuna Sagar, S.; Rajeevan, M.; Vijaya Bhaskara Rao, S.; Mitra, A. K.

    2017-12-01

    Extreme rainfall events pose a serious threat of leading to severe floods in many countries worldwide. Therefore, advance prediction of its occurrence and spatial distribution is very essential. In this paper, an analysis has been made to assess the skill of numerical weather prediction models in predicting rainstorms over India. Using gridded daily rainfall data set and objective criteria, 15 rainstorms were identified during the monsoon season (June to September). The analysis was made using three TIGGE (THe Observing System Research and Predictability Experiment (THORPEX) Interactive Grand Global Ensemble) models. The models considered are the European Centre for Medium-Range Weather Forecasts (ECMWF), National Centre for Environmental Prediction (NCEP) and the UK Met Office (UKMO). Verification of the TIGGE models for 43 observed rainstorm days from 15 rainstorm events has been made for the period 2007-2015. The comparison reveals that rainstorm events are predictable up to 5 days in advance, however with a bias in spatial distribution and intensity. The statistical parameters like mean error (ME) or Bias, root mean square error (RMSE) and correlation coefficient (CC) have been computed over the rainstorm region using the multi-model ensemble (MME) mean. The study reveals that the spread is large in ECMWF and UKMO followed by the NCEP model. Though the ensemble spread is quite small in NCEP, the ensemble member averages are not well predicted. The rank histograms suggest that the forecasts are under prediction. The modified Contiguous Rain Area (CRA) technique was used to verify the spatial as well as the quantitative skill of the TIGGE models. Overall, the contribution from the displacement and pattern errors to the total RMSE is found to be more in magnitude. The volume error increases from 24 hr forecast to 48 hr forecast in all the three models.

  6. Assessing spelling in kindergarten: further comparison of scoring metrics and their relation to reading skills.

    Science.gov (United States)

    Clemens, Nathan H; Oslund, Eric L; Simmons, Leslie E; Simmons, Deborah

    2014-02-01

    Early reading and spelling development share foundational skills, yet spelling assessment is underutilized in evaluating early reading. This study extended research comparing the degree to which methods for scoring spelling skills at the end of kindergarten were associated with reading skills measured at the same time as well as at the end of first grade. Five strategies for scoring spelling responses were compared: totaling the number of words spelled correctly, totaling the number of correct letter sounds, totaling the number of correct letter sequences, using a rubric for scoring invented spellings, and calculating the Spelling Sensitivity Score (Masterson & Apel, 2010b). Students (N=287) who were identified at kindergarten entry as at risk for reading difficulty and who had received supplemental reading intervention were administered a standardized spelling assessment in the spring of kindergarten, and measures of phonological awareness, decoding, word recognition, and reading fluency were administered concurrently and at the end of first grade. The five spelling scoring metrics were similar in their strong relations with factors summarizing reading subskills (phonological awareness, decoding, and word reading) on a concurrent basis. Furthermore, when predicting first-grade reading skills based on spring-of-kindergarten performance, spelling scores from all five metrics explained unique variance over the autoregressive effects of kindergarten word identification. The practical advantages of using a brief spelling assessment for early reading evaluation and the relative tradeoffs of each scoring metric are discussed. Copyright © 2013 Society for the Study of School Psychology. Published by Elsevier Ltd. All rights reserved.

  7. Pedagogical characteristics of the systems for assessing the technical and tactical skills of qualified volleyball players

    Directory of Open Access Journals (Sweden)

    Мykhailo Oliinyk

    2017-12-01

    Full Text Available Purpose: on the basis of the analysis of the special literature and their own experimental studies, to determine the characteristics of the systems for assessing the technical and tactical skills of qualified volleyball players. Material & Methods: study was conducted on the basis of the material of the national team of Zaporozhye State Medical University on volleyball. Analysis and generalization of the data of scientific and methodical literature are used; registration, analysis and interpretation of indicators of technical and tactical actions of qualified volleyball players in training and competitive processes; pedagogical observations; algorithms for calculating the quantitative and qualitative indicators of technical and tactical skill in volleyball; methods of mathematical statistics. Results: data on the existence of a strong statistical relationship between the systems of assessment of technical and tactical skills of qualified volleyball players, taking into account the specificity of the game role. Conclusion: shows the specifics of the application of various systems for assessing the technical and tactical skills of qualified volleyball players, taking into account the factors of the game role, noted the methodological features of special analysis and interpretation of indicators of technical and tactical actions in the adversarial process.

  8. Microsurgical skills training with a new tympanoplasty model: learning curve and motivational impact.

    Science.gov (United States)

    Neudert, Marcus; Kluge, Anne; Beleites, Thomas; Kemper, Max; Zahnert, Thomas

    2012-04-01

    To evaluate the microsurgical skills training on a tympanoplasty model with regard to the learning curve and the participants' motivation for a surgical specialty. Randomized controlled prospective study. Department of Otolaryngology, Head and Neck Surgery, Medical Campus Carl Gustav Carus at the Technische Universität Dresden, Germany. Thirty randomly chosen fifth-year medical students divided into 2 groups. Group 2 (n = 16) had to perform an ossicular and tympanic membrane reconstruction on a tympanoplasty model on Days 1, 7, 14, and 21 and Group 1 (n = 14) on Days 1 and 21, while observing the procedure at Days 7 and 14. Six otosurgeons served as gold standard. Attempts and time of prosthesis placement and time for tympanic membrane reconstruction were recorded. Tremor frequency and amplitude were obtained at the same time points. An adjusted study interest questionnaire was used to assess students' motivation. Students in Group 2 showed a significant improvement in all reconstruction parameters over the study period compared with both, baseline measurement on first day and Group 1. However, the obtained learning curve did not reach the experts level. Tremor indices and students' motivation showed no correlation with the reconstruction parameters, whereas the training itself had a positive impact on students' interest in the surgical specialty. Training with the tympanoplasty model is suitable to acquire first microsurgical motor skills in otolaryngology and to arouse students' interest in the surgical field and otorhinolaryngology.

  9. A Skill Score of Trajectory Model Evaluation Using Reinitialized Series of Normalized Cumulative Lagrangian Separation

    Science.gov (United States)

    Liu, Y.; Weisberg, R. H.

    2017-12-01

    The Lagrangian separation distance between the endpoints of simulated and observed drifter trajectories is often used to assess the performance of numerical particle trajectory models. However, the separation distance fails to indicate relative model performance in weak and strong current regions, such as a continental shelf and its adjacent deep ocean. A skill score is proposed based on the cumulative Lagrangian separation distances normalized by the associated cumulative trajectory lengths. The new metrics correctly indicates the relative performance of the Global HYCOM in simulating the strong currents of the Gulf of Mexico Loop Current and the weaker currents of the West Florida Shelf in the eastern Gulf of Mexico. In contrast, the Lagrangian separation distance alone gives a misleading result. Also, the observed drifter position series can be used to reinitialize the trajectory model and evaluate its performance along the observed trajectory, not just at the drifter end position. The proposed dimensionless skill score is particularly useful when the number of drifter trajectories is limited and neither a conventional Eulerian-based velocity nor a Lagrangian-based probability density function may be estimated.

  10. Assessment of Written Expression Skills of University Students in Terms of Text Completion Technique

    Directory of Open Access Journals (Sweden)

    Abdulkadir KIRBAŞ

    2017-12-01

    Full Text Available Writing is to transfer the visualised ideas on the paper. Writing, one of the language skills, is a significant tool of communication which provides the permanency of information conveying emotions and thoughts. Since writing has both cognitive and physical aspects, it makes writing the hardest and the latest language skill to improve. The studies show that writing activity is the most difficult skill students have difficulty. In higher education, in order to improve writing skills of students and give basic information and skills about writing skills written expression, composition and writing education lessons are taught both in the department of Turkish Language and Literature and in the departments of Turkish Language in the Faculties of Education. One of the aims of these lessons is to teach students written expression techniques together with the purposes and practices. One of the written expression techniques is text completion skill that improves student’s creativity and enhances her/his imaginary world. The purpose of this study is to assess students’ skills of using text completion technique with reference to the writing studies of students in higher education. the sample of the study consists of 85 college students studying in the department of Turkish Language and Literature in Gümüşhane University in 2016-2017 academic year. The data of the study were obtained from the written expression studies of the students. The introduction part of the article ‘On Reading’ by F. Bacon was given to the students and they were required to complete the text. ‘Text Completion Rating Scale in Writing Expression’ was developed to assess the data of the study by taking opinions of lecturers and Turkish education experts. The data of the study were presented with percentage and frequency rates. At the end of the study, it was concluded that students had weakness in some skills such as writing an effective body part about the topic given

  11. Comparing Video Modeling and Graduated Guidance Together and Video Modeling Alone for Teaching Role Playing Skills to Children with Autism

    Science.gov (United States)

    Akmanoglu, Nurgul; Yanardag, Mehmet; Batu, E. Sema

    2014-01-01

    Teaching play skills is important for children with autism. The purpose of the present study was to compare effectiveness and efficiency of providing video modeling and graduated guidance together and video modeling alone for teaching role playing skills to children with autism. The study was conducted with four students. The study was conducted…

  12. [Psychomotor skills assessment in basic procedures of laparoscopic surgery in undergraduate medical students at the School of Medicine of the University of Colima].

    Science.gov (United States)

    Prieto-Díaz-Chávez, Emilio; Medina-Chávez, José Luís; Martínez-Lira, Rafael; Millán-Guerrero, Rebeca; Vázquez-Jiménez, Clemente; Trujillo-Hernández, Benjamín

    2014-01-01

    The changes in recent decades in the training of medical student seem to agree that the educational model for professional skills is most appropriate. The virtual simulator translates skills acquired the operating room, in the Faculty of Medicine of the University of Colima noticed the need to prepare the students of pregrade transferring surgical trainees' skills in basic laparoscopic activities that require a simple cognitive effort. The hypothesis in this study was to evaluate the acquisition of skills in laparoscopic simulator in students of pregrade. Educational research, analytical comparison, which was conducted within the activities of the program of Problem Based Learning in the program of Education and Surgical Technique, Faculty of Medicine of the University of Colima. All participants in the simulator achieved a significantly better during the task one after three repetitions (p= 0.001). The evaluation of final students calcification, we observed significant differences in means being lower during the initial assessment (8.60 ± 0.76) compared to the end (8.96 ± 0.58) p= 0.001. The acquisition of skills in the simulator is longer but at the end is better than the acquisition of skills from the traditional method, showing that leads to the acquisition of skills that promote the transfer of skills to the surgical environment.

  13. An evaluation of the HM prison service "thinking skills programme" using psychometric assessments.

    Science.gov (United States)

    Gobbett, Matthew J; Sellen, Joselyn L

    2014-04-01

    The most widely implemented offending behaviour programme in the United Kingdom was Enhanced Thinking Skills (ETS), a cognitive-behavioural group intervention that aimed to develop participant's general cognitive skills. A new offending behaviour programme has been developed to replace ETS: the Thinking Skills Programme (TSP). This study reports an evaluation of the effectiveness of TSP using psychometric assessments. Phasing of the two programmes created an opportunity to compare the two programmes consecutively. Forty participants, 20 from each programme, completed a range of psychometric measures to examine cognition, attitudes, and thinking styles. Analysis of pre- and post-programme psychometric results indicated that participants of TSP demonstrated improvements on 14 of the 15 scales, 9 of which were statistically significant. Effect sizes between pre-post results were generally greater for TSP than ETS, demonstrating that TSP had a more positive impact on the thinking styles and attitudes of participants than the ETS programme.

  14. TEACHING AND ASSESSING SKILLS IN ENVIRONMENTAL GEOGRAPHY IN A BILINGUAL CLASS

    Directory of Open Access Journals (Sweden)

    FLORINA PĂUNESCU

    2016-01-01

    Full Text Available This paper presents my experience in bilingual teaching, an integrated programme for geography and English language learning for upper secondary students. General geographical aspects are connected to the geography of Great Britain and that of the USA, with an attitude of raising students’ awareness on environmental issues. The topics are a framework for the development of (environmental geography-related knowledge and skills, cognitive skills and language aspects. Therefore, the paper presents various methods of teaching and assessing environmental issues in four distinct structured texts, which combine typical geographical skills (like completing a sketch or a mind map with methods used in English classes (like true/false questions. A special accent is on both the use of specific environmental vocabulary – synonyms, false friends, also anticipated grammar mistakes – as well as on discussions in class, based on cause-effect relationships between processes and phenomena.

  15. Communication skills assessment in the final postgraduate years to established practice: a systematic review.

    Science.gov (United States)

    Gillis, Amy E; Morris, Marie C; Ridgway, Paul F

    2015-01-01

    Communication breakdown is a factor in the majority of all instances of medical error. Despite the importance, a relative paucity of time is invested in communication skills in postgraduate curricula. Our objective is to systematically review the literature to identify the current tools used to assess communication skills in postgraduate trainees in the latter 2 years of training and in established practice. Two reviewers independently reviewed the literature identifying communication skill assessment tools, for postgraduate trainees in the latter 2 years of training and in established practice following Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, and inclusion/exclusion criteria from January 1990 to 15 August 2014. PubMed/CINAHL/ERIC/EMBASE/PsycInfo/Psyc Articles/Cochrane. 222 articles were identified; after review, 34 articles fulfilled criteria for complete evaluation; the majority (26) had a high level of evidence scoring 3 or greater on the Best Evidence Medical Education guide. 22 articles used objective structured clinical examination/standardised patient (SP)-based formats in an assessment or training capacity. Evaluation tools included author-developed questionnaires and validated tools. Nineteen articles demonstrated an educational initiative. The reviewed literature is heterogeneous for objectives and measurement techniques for communication. Observed interactions, with patients or SPs, is the current favoured method of evaluation using author-developed questionnaires. The role of self-evaluation of skill level is questioned. The need for a validated assessment tool for communication skills is highlighted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  16. The teaching of physical assessment skills in pre-registration nursing programmes in Australia: issues for nursing education.

    Science.gov (United States)

    Birks, Melanie; James, Ainsley; Chung, Catherine; Cant, Robyn; Davis, Jenny

    2014-01-01

    Health assessment is a fundamental aspect of the professional nursing role. The teaching of skills in physical assessment is therefore a large component of pre-registration nursing programmes. As the nursing curriculum becomes more crowded with what is deemed to be essential content, there is a need to rationalise what is taught in preparatory nursing programmes to ensure readiness for practice. The study outlined in this paper, as part of a larger project, explored the teaching of physical assessment skills in pre-registration nursing programmes across Australia. Fifty-three academics completed the 121 item online survey, indicating whether each skill was taught with practice, taught with no practice or not taught at all. The results suggest that only half the skills were being taught by more than 80% of the academics and 23 skills (19%) were taught by more than 90%. Of the 121 skills commonly taught--69 skills (57%) were taught with student practice and 29 (24%) were taught with no student practice. The results of this study raise questions about the teaching of physical assessment in pre-registration nursing programmes. The suggestion is not that skills that are used regularly or infrequently should be removed from the curriculum, rather, the authors propose that consideration be given to whether the teaching of skills that are never likely to be used is occurring at the expense of comprehensive mastery of core skills.

  17. A content validity approach to creating an end-user computer skill assessment tool

    Directory of Open Access Journals (Sweden)

    Shirley Gibbs

    Full Text Available Practical assessment instruments are commonly used in the workplace and educational environments to assess a person\\'s level of digital literacy and end-user computer skill. However, it is often difficult to find statistical evidence of the actual validity of instruments being used. To ensure that the correct factors are being assessed for a particular purpose it is necessary to undertake some type of psychometric testing, and the first step is to study the content relevance of the measure. The purpose of this paper is to report on the rigorous judgment-quantification process using panels of experts in order to establish inter-rater reliability and agreement in the development of end-user instruments developed to measure workplace skills using spreadsheet and word-processing applications.

  18. Formative Assessment of Procedural Skills: Students' Responses to the Objective Structured Clinical Examination and the Integrated Performance Procedural Instrument

    Science.gov (United States)

    Nestel, Debra; Kneebone, Roger; Nolan, Carmel; Akhtar, Kash; Darzi, Ara

    2011-01-01

    Assessment of clinical skills is a critical element of undergraduate medical education. We compare a traditional approach to procedural skills assessment--the Objective Structured Clinical Examination (OSCE) with the Integrated Performance Procedural Instrument (IPPI). In both approaches, students work through "stations" or…

  19. Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. Learning curves and reliability measures.

    Science.gov (United States)

    Gallagher, A G; Satava, R M

    2002-12-01

    The objective assessment of the psychomotor skills of surgeons is now a priority; however, this is a difficult task because of measurement difficulties associated with the assessment of surgery in vivo. In this study, virtual reality (VR) was used to overcome these problems. Twelve experienced (>50 minimal-access procedures), 12 inexperienced laparoscopic surgeons (psychomotor skills needed to perform laparoscopic surgery.

  20. Creating Curriculum-Embedded, Performance-Based Assessments for Measuring 21st Century Skills in K-5 Students

    Science.gov (United States)

    Lai, Emily R.

    2012-01-01

    This paper will share the author's experiences working with a large and diverse school district to design curriculum-embedded, performance-based assessments (PBAs) that measure 21st century skills in K-5 students. These assessments are designed to integrate seamlessly with classroom instruction; measure skills such as critical thinking,…

  1. Validity and Reliability of Global Operative Assessment of Laparoscopic Skills (GOALS) in Novice Trainees Performing a Laparoscopic Cholecystectomy

    NARCIS (Netherlands)

    Kramp, Kelvin H.; van Det, Marc J.; Hoff, Christiaan; Lamme, Bas; Veeger, Nic J. G. M.; Pierie, Jean-Pierre E. N.

    2015-01-01

    PURPOSE: Global Operative Assessment of Laparoscopic Skills (GOALS) assessment has been designed to evaluate skills in laparoscopic surgery. A longitudinal blinded study of randomized video fragments was conducted to estimate the validity and reliability of GOALS in novice trainees. METHODS: In

  2. Investigating the Practices of Assessment Methods in Amharic Language Writing Skill Context: The Case of Selected Higher Education in Ethiopia

    Science.gov (United States)

    Tesfay, Hailay

    2017-01-01

    This study aims to investigate Ethiopian higher education Amharic language writing skills instructors' practices of Assessment Methods in writing skill context. It was also intended to look for their viewpoints about the practicality of implementing Assessment Methods in Amharic writing courses. In order to achieve the goals of this study,…

  3. Peer-Assisted History-Taking Groups: A Subjective Assessment of their Impact Upon Medical Students' Interview Skills.

    Science.gov (United States)

    Keifenheim, Katharina Eva; Petzold, Ernst Richard; Junne, Florian; Erschens, Rebecca Sarah; Speiser, Natalie; Herrmann-Werner, Anne; Zipfel, Stephan; Teufel, Martin

    2017-01-01

    Background and Objectives: Among the clinical skills needed by all physicians, history taking is one of the most important. The teaching model for peer-assisted history-taking groups investigated in the present study consists of small-group courses in which students practice conducting medical interviews with real patients. The purpose of this pilot study was to investigate the expectations, experiences, and subjective learning progress of participants in peer-assisted history-taking groups. Methods: The 42 medical student participants completed a 4-month, peer-assisted, elective history-taking course, which both began and ended with a subjective assessment of their interview skills by way of a pseudonymized questionnaire. Measures comprised the students' self-assessment of their interview skills, their expectations of, and their experiences with the course and especially with the peer tutors. Results: Medical students' most important motivations in attending peer-assisted history-taking groups were becoming able to complete a structured medical interview, to mitigate difficult interviewing situations, and to address patients' emotional demands appropriately. By the end of the course, students' self-assessment of both their interview skills and management of emotional issues improved significantly. Students especially benefitted from individual feedback regarding interview style and relationship formation, as well as generally accepted and had their expectations met by peer tutors. Conclusions: To meet the important learning objectives of history-taking and management of emotional issues, as well as self-reflection and reflection of student-patient interactions, students in the field greatly appreciate practicing medical interviewing in small, peer-assisted groups with real patients. At the same time, peer tutors are experienced to be helpful and supportive and can help students to overcome inhibitions in making contact with patients.

  4. THE DEVELOPMENT OF RESEARCH-BASED PHYSICS LEARNING MODEL WITH SCIENTIFIC APPROACH TO DEVELOP STUDENTS’ SCIENTIFIC PROCESSING SKILL

    Directory of Open Access Journals (Sweden)

    Usmeldi Usmeldi

    2016-04-01

    Full Text Available Physics learning in SMA N 2 Padang was implemented through theory and practicum for verifying the theories. The results of the initial survey showed that the physics teachers had not yet applied the research-based learning. Supporting facilities such as physics lab and its equipment has been already available, but it has not been utilized optimally. Research-based learning is a model that can improve scientific processing skills and learning outcomes of students. The research aimed to produce a valid, practical, and effective research-based physics learning model and devices. This research was a research and development using the 4D model of Thiagarajan. The instrument of this research are interview guides, observation sheets, sheet of validation of model and learning tools, questionnaire for both teachers’ and learners’ responses, assessment sheets for scientific processing skills, and achievement test. The results showed that the developed model and the learning devices according to the assessment of experts were declared valid. Model and learning devices were practical based on the observation and the questionnaires. The application of research-based physics learning could effectively improve scientific skills and learning outcomes of students. This model is suggested to physics teachers in high school in regard with implementing research-based learning.

  5. Determinants of consistent condom use among college students in China: application of the information-motivation-behavior skills (IMB) model.

    Science.gov (United States)

    Liu, Zhihao; Wei, Pingmin; Huang, Minghao; Liu, Yuan bao; Li, Lucy; Gong, Xiao; Chen, Juan; Li, Xiaoning

    2014-01-01

    Due to the increase incidents of premarital sex and the lack of reproductive health services, college students are at high risk of HIV/AIDS infections in China. This study was designed to examine the predictors of consistency of condom use among college students based on the Information-Motivation-Behavioral Skills (IMB) model and to describe the relationships between the model constructs. A cross-sectional study was conducted to assess HIV/AIDS related information, motivation, behavioral skills and preventive behavior among college students in five colleges and universities in Nanjing, China. An anonymous questionnaire survey was conducted for data collection, and the structural equation model (SEM) was used to assess the IMB model. A total of 3183 participants completed this study. The average age was 19.90 years (SD = 1.43, range 16 to 25). 342 (10.7%) participants of them reported having had premarital sex, among whom 30.7% reported having had a consistent condom use, 13.7% with the experience of abortion (including the participants whose sex partner has the same experience), 32.7% of participants had experience of multiple sex partners. The final IMB model provided acceptable fit to the data (CFI = 0.992, RMSEA = 0.028). Preventive behavior was significantly predicted by behavioral skills (β = 0.754, Pmotivation (β = 0.363, Pstudents in China. The main influencing factor of preventive behavior among college students is behavioral skills. Both information and motivation could affect preventive behavior through behavioral skills. Further research could develop preventive interventions based on the IMB model to promote consistent condom use among college students in China.

  6. Applying the Digital Doorway design research model in facilitating skills transfer in rural communities

    CSIR Research Space (South Africa)

    Herselman, ME

    2010-11-01

    Full Text Available The purpose of this article is to indicate how skills can be transferred through the application of the Digital Doorway (DD) design research model. Skills transfer takes place between the initiators of Digital Doorway (CSIR Meraka Institute) project...

  7. Teaching Recreational Skills to Handicapped Youths with Video Modeling and Peer Tutoring.

    Science.gov (United States)

    Durham, Robert L.; And Others

    1981-01-01

    A videotape modeling and peer counseling program was utilized to teach recreational skills to 89 handicapped children (3 to 15 years old) and employment skills to 18 adolescent handicapped youths (15 to 19 years old) who served as trainers. (Author/SW)

  8. Self-assessment in laparoscopic surgical skills training: Is it reliable?

    Science.gov (United States)

    Ganni, Sandeep; Chmarra, Magdalena K; Goossens, Richard H M; Jakimowicz, Jack J

    2017-06-01

    The concept of self-assessment has been widely acclaimed for its role in the professional development cycle and self-regulation. In the field of medical education, self-assessment has been most used to evaluate the cognitive knowledge of students. The complexity of training and evaluation in laparoscopic surgery has previously acted as a barrier in determining the benefits self-assessment has to offer in comparison with other fields of medical education. Thirty-five surgical residents who attended the 2-day Laparoscopic Surgical Skills Grade 1 Level 1 curriculum were invited to participate from The Netherlands, India and Romania. The competency assessment tool (CAT) for laparoscopic cholecystectomy was used for self- and expert-assessment and the resulting distributions assessed. A comparison between the expert- and self-assessed aggregates of scores from the CAT agreed with previous studies. Uniquely to this study, the aggregates of individual sub-categories-'use of instruments'; 'tissue handling'; and errors 'within the component tasks' and the 'end product' from both self- and expert-assessments-were investigated. There was strong positive correlation (r s  > 0.5; p self-assessment in all categories with only the 'tissue handling' having a weaker correlation (r s  = 0.3; p = 0.04). The distribution of the mean of the differences between self-assessment and expert-assessment suggested no significant difference between the scores of experts and the residents in all categories except the 'end product' evaluation where the difference was significant (W = 119, p = 0.03). Self-assessment using the CAT form gives results that are consistently not different from expert-assessment when assessing one's proficiency in surgical skills. Areas where there was less agreement could be explained by variations in the level of training and understanding of the assessment criteria.

  9. A model to teach concomitant patient communication during psychomotor skill development.

    Science.gov (United States)

    Nicholls, Delwyn; Sweet, Linda; Muller, Amanda; Hyett, Jon

    2018-01-01

    Many health professionals use psychomotor or task-based skills in clinical practice that require concomitant communication with a conscious patient. Verbally engaging with the patient requires highly developed verbal communication skills, enabling the delivery of patient-centred care. Historically, priority has been given to learning the psychomotor skills essential to clinical practice. However, there has been a shift towards also ensuring competent communication with the patient during skill performance. While there is literature outlining the steps to teach and learn verbal communication skills, little is known about the most appropriate instructional approach to teach how to verbally engage with the patient when also learning to perform a task. A literature review was performed and it identified that there was no model or proven approach which could be used to integrate the learning of both psychomotor and communication skills. This paper reviews the steps to teach a communication skill and provides a suggested model to guide the acquisition and development of the concomitant -communication skills required with a patient at the time a psychomotor skill is performed. Copyright © 2017 Elsevier Ltd. All rights reserved.

  10. A Clinic-Based Assessment for Evaluating Job-Related Social Skills in Adolescents and Adults with Autism.

    Science.gov (United States)

    Lerman, Dorothea C; White, Bridgette; Grob, Carolyn; Laudont, Courtney

    2017-12-01

    Many individuals with autism spectrum disorder (ASD) have difficulties obtaining and maintaining employment, yet little research has evaluated methods for assessing and improving critical vocational skills. In this study, we evaluated an assessment of job-related social skills for individuals with ASD by arranging conditions that simulated on-the-job experiences in a clinic setting. The experimenter contrived situations to assess a variety of social skills, including asking for help, asking for more materials, and responding to corrective feedback. A total of eight individuals, aged 16 to 32 years, participated. Results suggested that the assessment was useful for identifying specific social skills that could be targeted for intervention to increase success in the work environment. These findings add to the current literature by demonstrating an objective method for assessing a variety of job-related social skills under controlled, naturalistic conditions.

  11. Skills development programme: The UNISA/CSIR model

    CSIR Research Space (South Africa)

    Sparrow, RW

    2010-09-01

    Full Text Available materials at the molecular and atomic level. The barriers between disciplines such as Biology, Physics and Engineering are, for all intense and purposes, non-existent. Whole new industries are being created based on these developments. Thus new skills...

  12. Improving Junior High Schools’ Critical Thinking Skills Based on Test Three Different Models of Learning

    OpenAIRE

    Nur Miftahul Fuad; Siti Zubaidah; Susriyati Mahanal; Endang Suarsini

    2017-01-01

    The aims of this study were (1) to find out the differences in critical thinking skills among students who were given three different learning models: differentiated science inquiry combined with mind map, differentiated science inquiry model, and conventional model, (2) to find out the differences of critical thinking skills among male and female students. This study is a quasi-experimental research with pretest-posttest nonequivalent control group design. The population in...

  13. Self-Assessment of Vocabulary and Relevant Language Skills for Evaluation Purposes

    Directory of Open Access Journals (Sweden)

    Violeta Janulevičienė

    2011-04-01

    Full Text Available Learner self-assessment of linguistic performance has been lately used due to its potential to activate the process of learning. Self-assessment raises learner awareness of language use and leads to developing learner responsibility and autonomy. However, usefulness of self-assessment for evaluation purposes has been scarcely researched. This paper examines some aspects of learners’ self-assessment for evaluation purposes at tertiary level. Research focuses on self-assessment of English for Specific Purposes (ESP vocabulary and some language skills relevant for vocabulary retention. Data on learner self-assessment are compared to actual results in tests. The analysis provided points to importance of self-evaluation in language acquisition and suggests practical implications of self-assessment for evaluation.

  14. A Study of Students’ Assessment in Writing Skills of the English Language

    Directory of Open Access Journals (Sweden)

    Muhammad Javed

    2013-07-01

    Full Text Available This paper addresses to evaluate and assess the students’ competency in writing skills at Secondary school level in the English Language focusing five major content areas: word completion, sentence making/syntax, comprehension, tenses/ grammar and handwriting. The target population was the male and female students of grade 10 of urban and rural Secondary schools from public and private sector. Forty (40 Secondary schools of District Bahawalnagar, Pakistan were taken using stratified sampling. A sample consisting of 440 students (11students from each school was randomly selected using a table of random numbers. An achievement test consisting of different items was developed to assess the students’ competency and capability in sub-skills of writing such as word completion, sentence making/syntax, comprehension, tenses/grammar and handwriting. Mean score and standard deviation were used to analyze the students’ proficiency in each sub-skill. The t-test was applied to make the comparison on the bases of gender, density and public and private sector. The overall performance of all the students was better in comprehension as compared to other sub-skills namely word completion, sentence making/syntax, tenses/grammar and handwriting. The analysis, based on t-value, revealed no significant difference between the performance of male and female students and the students of public and private schools, whereas there was a significant difference between the performance of urban and rural students.

  15. A Mentor-Based Portfolio Program to Evaluate Pharmacy Students’ Self-Assessment Skills

    Science.gov (United States)

    Kalata, Lindsay R.

    2013-01-01

    Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students. PMID:23716749

  16. Dynamic assessment of word learning skills of pre-school children with primary language impairment.

    Science.gov (United States)

    Camilleri, Bernard; Law, James

    2014-10-01

    Dynamic assessment has been shown to have considerable theoretical and clinical significance in the assessment of socially disadvantaged and culturally and linguistically diverse children. In this study it is used to enhance assessment of pre-school children with primary language impairment. The purpose of the study was to determine whether a dynamic assessment (DA) has the potential to enhance the predictive capacity of a static measure of receptive vocabulary in pre-school children. Forty pre-school children were assessed using the static British Picture Vocabulary Scale (BPVS), a DA of word learning potential and an assessment of non-verbal cognitive ability. Thirty-seven children were followed up 6 months later and re-assessed using the BPVS. Although the predictive capacity of the static measure was found to be substantial, the DA increased this significantly especially for children with static scores below the 25th centile. The DA of children's word learning has the potential to add value to the static assessment of the child with low language skills, to predict subsequent receptive vocabulary skills and to increase the chance of correctly identifying children in need of ongoing support.

  17. A Qualitative Analysis of Narrative Preclerkship Assessment Data to Evaluate Teamwork Skills.

    Science.gov (United States)

    Dolan, Brigid M; O'Brien, Celia Laird; Cameron, Kenzie A; Green, Marianne M

    2018-04-16

    Construct: Students entering the health professions require competency in teamwork. Although many teamwork curricula and assessments exist, studies have not demonstrated robust longitudinal assessment of preclerkship students' teamwork skills and attitudes. Assessment portfolios may serve to fill this gap, but it is unknown how narrative comments within portfolios describe student teamwork behaviors. We performed a qualitative analysis of narrative data in 15 assessment portfolios. Student portfolios were randomly selected from 3 groups stratified by quantitative ratings of teamwork performance gathered from small-group and clinical preceptor assessment forms. Narrative data included peer and faculty feedback from these same forms. Data were coded for teamwork-related behaviors using a constant comparative approach combined with an identification of the valence of the coded statements as either "positive observation" or "suggestion for improvement." Eight codes related to teamwork emerged: attitude and demeanor, information facilitation, leadership, preparation and dependability, professionalism, team orientation, values team member contributions, and nonspecific teamwork comments. The frequency of codes and valence varied across the 3 performance groups, with students in the low-performing group receiving more suggestions for improvement across all teamwork codes. Narrative data from assessment portfolios included specific descriptions of teamwork behavior, with important contributions provided by both faculty and peers. A variety of teamwork domains were represented. Such feedback as collected in an assessment portfolio can be used for longitudinal assessment of preclerkship student teamwork skills and attitudes.

  18. A mentor-based portfolio program to evaluate pharmacy students' self-assessment skills.

    Science.gov (United States)

    Kalata, Lindsay R; Abate, Marie A

    2013-05-13

    Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students.

  19. Adapting the helpful responses questionnaire to assess communication skills involved in delivering contingency management: preliminary psychometrics.

    Science.gov (United States)

    Hartzler, Bryan

    2015-08-01

    A paper/pencil instrument, adapted from Miller and colleagues' (1991) Helpful Responses Questionnaire (HRQ), was developed to assess clinician skill with core communicative aspects involved in delivering contingency management (CM). The instrument presents a single vignette consisting of six points of client dialogue to which respondents write 'what they would say next.' In the context of an implementation/effectiveness hybrid trial, 19 staff clinicians at an opiate treatment program completed serial training outcome assessments before, following, and three months after CM training. Assessments included this adaptation of the HRQ, a multiple-choice CM knowledge test, and a recorded standardized patient encounter scored for CM skillfulness. Study results reveal promising psychometric properties for the instrument, including strong scoring reliability, internal consistency, concurrent and predictive validity, test-retest reliability and sensitivity to training effects. These preliminary findings suggest the instrument is a viable, practical method to assess clinician skill in communicative aspects of CM delivery. Copyright © 2015 Elsevier Inc. All rights reserved.

  20. Virtual reality-based assessment of basic laparoscopic skills using the Leap Motion controller.

    Science.gov (United States)

    Lahanas, Vasileios; Loukas, Constantinos; Georgiou, Konstantinos; Lababidi, Hani; Al-Jaroudi, Dania

    2017-12-01

    The majority of the current surgical simulators employ specialized sensory equipment for instrument tracking. The Leap Motion controller is a new device able to track linear objects with sub-millimeter accuracy. The aim of this study was to investigate the potential of a virtual reality (VR) simulator for assessment of basic laparoscopic skills, based on the low-cost Leap Motion controller. A simple interface was constructed to simulate the insertion point of the instruments into the abdominal cavity. The controller provided information about the position and orientation of the instruments. Custom tools were constructed to simulate the laparoscopic setup. Three basic VR tasks were developed: camera navigation (CN), instrument navigation (IN), and bimanual operation (BO). The experiments were carried out in two simulation centers: MPLSC (Athens, Greece) and CRESENT (Riyadh, Kingdom of Saudi Arabia). Two groups of surgeons (28 experts and 21 novices) participated in the study by performing the VR tasks. Skills assessment metrics included time, pathlength, and two task-specific errors. The face validity of the training scenarios was also investigated via a questionnaire completed by the participants. Expert surgeons significantly outperformed novices in all assessment metrics for IN and BO (p controller for assessment of basic laparoscopic skills. The proposed system allowed the evaluation of dexterity of the hand movements. Future work will involve comparison studies with validated simulators and development of advanced training scenarios on current Leap Motion controller.