Learning Physics Teaching through Collaborative Design of Conceptual Multiple-Choice Questions

Science.gov (United States)

Milner-Bolotin, Marina

2015-01-01

Increasing student engagement through Electronic Response Systems (clickers) has been widely researched. Its success largely depends on the quality of multiple-choice questions used by instructors. This paper describes a pilot project that focused on the implementation of online collaborative multiple-choice question repository, PeerWise, in a…

Multiple choice questions in electronics and electrical engineering

CERN Document Server

DAVIES, T J

2013-01-01

A unique compendium of over 2000 multiple choice questions for students of electronics and electrical engineering. This book is designed for the following City and Guilds courses: 2010, 2240, 2320, 2360. It can also be used as a resource for practice questions for any vocational course.

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

Science.gov (United States)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

Does Correct Answer Distribution Influence Student Choices When Writing Multiple Choice Examinations?

Directory of Open Access Journals (Sweden)

Jacqueline A. Carnegie

2017-03-01

Full Text Available Summative evaluation for large classes of first- and second-year undergraduate courses often involves the use of multiple choice question (MCQ exams in order to provide timely feedback. Several versions of those exams are often prepared via computer-based question scrambling in an effort to deter cheating. An important parameter to consider when preparing multiple exam versions is that they must be equivalent in their assessment of student knowledge. This project investigated a possible influence of correct answer organization on student answer selection when writing multiple versions of MCQ exams. The specific question asked was whether the existence of a series of four to five consecutive MCQs in which the same letter represented the correct answer had a detrimental influence on a student’s ability to continue to select the correct answer as he/she moved through that series. Student outcomes from such exams were compared with results from exams with identical questions but which did not contain such series. These findings were supplemented by student survey data in which students self-assessed the extent to which they paid attention to the distribution of correct answer choices when writing summative exams, both during their initial answer selection and when transferring their answer letters to the Scantron sheet for correction. Despite the fact that more than half of survey respondents indicated that they do make note of answer patterning during exams and that a series of four to five questions with the same letter for the correct answer would encourage many of them to take a second look at their answer choice, the results pertaining to student outcomes suggest that MCQ randomization, even when it does result in short serial arrays of letter-specific correct answers, does not constitute a distraction capable of adversely influencing student performance. Dans les très grandes classes de cours de première et deuxième années, l�

Negatively-marked MCQ assessments that reward partial knowledge do not introduce gender bias yet increase student performance and satisfaction and reduce anxiety.

Directory of Open Access Journals (Sweden)

A Elizabeth Bond

Full Text Available Multiple-choice question (MCQ examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The 'Single Answer' (SA test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the

Negatively-marked MCQ assessments that reward partial knowledge do not introduce gender bias yet increase student performance and satisfaction and reduce anxiety.

Science.gov (United States)

Bond, A Elizabeth; Bodger, Owen; Skibinski, David O F; Jones, D Hugh; Restall, Colin J; Dudley, Edward; van Keulen, Geertje

2013-01-01

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The 'Single Answer' (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the

Distance teaching using self-marking multiple choice questions.

Science.gov (United States)

Poore, P

1987-01-01

In Papua New Guinea health extension officers receive a 3-year course of training in college, followed by a period of in-service training in hospital. They are then posted to a health center, where they are in charge of all health services within their district. While the health extension officers received an excellent basic training, and were provided with books and appropriate, locally produced texts, they often spent months or even years after graduation in remote rural health centers with little communication from colleagues. This paper describes an attempt to improve communication, and to provide support inexpensively by post. Multiple choice questions, with a system for self-marking, were sent by post to rural health workers. Multiple choice questions are used in the education system in Papua New Guinea, and all health extension officers are familiar with the technique. The most obvious and immediate result was the great enthusiasm shown by the majority of health staff involved. In this way a useful exchange of correspondence was established. With this exchange of information and recognition of each other's problems, the quality of patient care must improve.

A Two-Tier Multiple Choice Questions to Diagnose Thermodynamic Misconception of Thai and Laos Students

Science.gov (United States)

Kamcharean, Chanwit; Wattanakasiwich, Pornrat

The objective of this study was to diagnose misconceptions of Thai and Lao students in thermodynamics by using a two-tier multiple-choice test. Two-tier multiple choice questions consist of the first tier, a content-based question and the second tier, a reasoning-based question. Data of student understanding was collected by using 10 two-tier multiple-choice questions. Thai participants were the first-year students (N = 57) taking a fundamental physics course at Chiang Mai University in 2012. Lao participants were high school students in Grade 11 (N = 57) and Grade 12 (N = 83) at Muengnern high school in Xayaboury province, Lao PDR. As results, most students answered content-tier questions correctly but chose incorrect answers for reason-tier questions. When further investigating their incorrect reasons, we found similar misconceptions as reported in previous studies such as incorrectly relating pressure with temperature when presenting with multiple variables.

The Answering Process for Multiple-Choice Questions in Collaborative Learning: A Mathematical Learning Model Analysis

Science.gov (United States)

Nakamura, Yasuyuki; Nishi, Shinnosuke; Muramatsu, Yuta; Yasutake, Koichi; Yamakawa, Osamu; Tagawa, Takahiro

2014-01-01

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…

Practical Usage of Multiple-Choice Questions as Part of Learning and Self-Evaluation

Directory of Open Access Journals (Sweden)

Paula Kangasniemi

2016-12-01

Full Text Available The poster describes how the multiple-choice questions could be a part of learning, not only assessing. We often think of the role of questions only in order to test the student's skills. We have tested how questions could be a part of learning in our web-based course of information retrieval in Lapland University. In web-based learning there is a need for high-quality mediators. Mediators are learning promoters which trigger, support, and amplify learning. Mediators can be human mediators or tool mediators. The tool mediators are for example; tests, tutorials, guides and diaries. The multiple-choice questions can also be learning promoters which select, interpret and amplify objects for learning. What do you have to take into account when you are preparing multiple-choice questions as mediators? First you have to prioritize teaching objectives: what must be known and what should be known. According to our experience with contact learning, you can assess what the things are that students have problems with and need more guidance on. The most important addition to the questions is feedback during practice. The questions’ answers (wrong or right are not important. The feedback on the answers are important to guide students on how to search. The questions promote students’ self-regulation and self-evaluation. Feedback can be verbal, a screenshot or a video. We have added a verbal feedback for every question and also some screenshots and eight videos in our web-based course.

INQUIRE: a case study in evaluating the potential of online MCQ tests in a discursive subject

Directory of Open Access Journals (Sweden)

Sophie Clarke

2004-12-01

Full Text Available There has been a wealth of investigation into the use of online multiple-choice questions as a means of summative assessment, however the research into the use of formative MCQs by the same mode of delivery still remains patchy. Similarly, research and implementation has been largely concentrated within the Sciences and Medicine rather than the more discursive subjects within the Humanities and Social Sciences. The INQUIRE (Interactive Questions Reinforcing Education Evaluation Project was jointly conducted by two groups at the University of Oxford–the Saïd Business School and the Academic Computing Development Team to evaluate the use of online MCQs as a mechanism to reinforce and extend student learning. This initial study used a small set of highly focused MCQ tests that were designed to complement an introductory series of first-year undergraduate management lectures. MCQ is a simple and well-established technology, and hence the emphasis was very much on situating the tests within the student experience. The paper will cover how the online MCQs are intended to fit into the Oxford Undergraduate study agenda, and how a simple evaluation was executed and planned to investigate their usage and impact. The chosen method of evaluation was to combine focus groups with automated online methods of tracking, and the paper discusses the findings of both of these.

Multiple choice questiones as a tool for assessment in medical ...

African Journals Online (AJOL)

Methods For this review, a PuBMed online search was carried out for English language ... Advantages and disadvantages of MCQs in medical education are ... multiple-choice question meets many of the educational requirements for an assessment method. The use of automation for grading and low costs makes it a viable ...

Automatic Generation of Analogy Questions for Student Assessment: An Ontology-Based Approach

Science.gov (United States)

Alsubait, Tahani; Parsia, Bijan; Sattler, Uli

2012-01-01

Different computational models for generating analogies of the form "A is to B as C is to D" have been proposed over the past 35 years. However, analogy generation is a challenging problem that requires further research. In this article, we present a new approach for generating analogies in Multiple Choice Question (MCQ) format that can be used…

Student-Generated Content: Enhancing Learning through Sharing Multiple-Choice Questions

Science.gov (United States)

Hardy, Judy; Bates, Simon P.; Casey, Morag M.; Galloway, Kyle W.; Galloway, Ross K.; Kay, Alison E.; Kirsop, Peter; McQueen, Heather A.

2014-01-01

The relationship between students' use of PeerWise, an online tool that facilitates peer learning through student-generated content in the form of multiple-choice questions (MCQs), and achievement, as measured by their performance in the end-of-module examinations, was investigated in 5 large early-years science modules (in physics, chemistry and…

Multiple choice questions are superior to extended matching questions to identify medicine and biomedical sciences students who perform poorly.

Science.gov (United States)

Eijsvogels, Thijs M H; van den Brand, Tessa L; Hopman, Maria T E

2013-11-01

In recent years, medical faculties at Dutch universities have implemented a legally binding study advice to students of medicine and biomedical sciences during their propaedeutic phase. Appropriate examination is essential to discriminate between poor (grade age and examination preference on this score. Data were collected for 452 first-year medical and biomedical science students during three distinct course examinations: one examination with EMQ only, one with MCQ only and one mixed examination (including EMQ and MCQ). Logistic regression analysis revealed that MCQ examination was 3 times better in identifying poor students compared with EMQ (RR 3.0, CI 2.0-4.5), whereas EMQ better detected excellent students (average grade ≥8) (RR 1.93, CI 1.47-2.53). Mixed examination had comparable characteristics to MCQ. Sex and examination preference did not impact the score of the student. Students ≥20 years had a 4-fold higher risk ratio of obtaining a poor grade (<6) compared with students ≤18 years old (RR 4.1, CI 2.1-8.0). Given the strong discriminative capacity of MCQ examinations to identify poor students, we recommend the use of this type of examination during the propaedeutic phase of medicine and biomedical science study programmes, in the light of the binding study advice.

The Use of Management and Marketing Textbook Multiple-Choice Questions: A Case Study.

Science.gov (United States)

Hampton, David R.; And Others

1993-01-01

Four management and four marketing professors classified multiple-choice questions in four widely adopted introductory textbooks according to the two levels of Bloom's taxonomy of educational objectives: knowledge and intellectual ability and skill. Inaccuracies may cause instructors to select questions that require less thinking than they intend.…

Augmenting Fellow Education Through Spaced Multiple-Choice Questions.

Science.gov (United States)

Barsoumian, Alice E; Yun, Heather C

2018-01-01

The San Antonio Uniformed Services Health Education Consortium Infectious Disease Fellowship program historically included a monthly short-answer and multiple-choice quiz. The intent was to ensure medical knowledge in relevant content areas that may not be addressed through clinical rotations, such as operationally relevant infectious disease. After completion, it was discussed in a small group with faculty. Over time, faculty noted increasing dissatisfaction with the activity. Spaced interval education is useful in retention of medical knowledge and skills by medical students and residents. Its use in infectious disease fellow education has not been described. To improve the quiz experience, we assessed the introduction of spaced education curriculum in our program. A pre-intervention survey was distributed to assess the monthly quiz with Likert scale and open-ended questions. A multiple-choice question spaced education curriculum was created using the Qstream(R) platform in 2011. Faculty development on question writing was conducted. Two questions were delivered every 2 d. Incorrectly and correctly answered questions were repeated after 7 and 13 d, respectively. Questions needed to be answered correctly twice to be retired. Fellow satisfaction was assessed at semi-annual fellowship reviews over 5 yr and by a one-time repeat survey. Pre-intervention survey of six fellows indicated dissatisfaction with the time commitment of the monthly quiz (median Likert score of 2, mean 6.5 h to complete), neutral in perceived utility, but satisfaction with knowledge retention (Likert score 4). Eighteen fellows over 5 yr participated in the spaced education curriculum. Three quizzes with 20, 39, and 48 questions were designed. Seventeen percentage of questions addressed operationally relevant topics. Fifty-nine percentage of questions were answered correctly on first attempt, improving to 93% correct answer rate at the end of the analysis. Questions were attempted 2,999 times

Will a Short Training Session Improve Multiple-Choice Item-Writing Quality by Dental School Faculty? A Pilot Study.

Science.gov (United States)

Dellinges, Mark A; Curtis, Donald A

2017-08-01

Faculty members are expected to write high-quality multiple-choice questions (MCQs) in order to accurately assess dental students' achievement. However, most dental school faculty members are not trained to write MCQs. Extensive faculty development programs have been used to help educators write better test items. The aim of this pilot study was to determine if a short workshop would result in improved MCQ item-writing by dental school faculty at one U.S. dental school. A total of 24 dental school faculty members who had previously written MCQs were randomized into a no-intervention group and an intervention group in 2015. Six previously written MCQs were randomly selected from each of the faculty members and given an item quality score. The intervention group participated in a training session of one-hour duration that focused on reviewing standard item-writing guidelines to improve in-house MCQs. The no-intervention group did not receive any training but did receive encouragement and an explanation of why good MCQ writing was important. The faculty members were then asked to revise their previously written questions, and these were given an item quality score. The item quality scores for each faculty member were averaged, and the difference from pre-training to post-training scores was evaluated. The results showed a significant difference between pre-training and post-training MCQ difference scores for the intervention group (p=0.04). This pilot study provides evidence that the training session of short duration was effective in improving the quality of in-house MCQs.

A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions.

Science.gov (United States)

Oyebola, D D; Adewoye, O E; Iyaniwura, J O; Alada, A R; Fasanmade, A A; Raji, Y

2000-01-01

This study was designed to compare the performance of medical students in physiology when assessed by multiple choice questions (MCQs) and short essay questions (SEQs). The study also examined the influence of factors such as age, sex, O/level grades and JAMB scores on performance in the MCQs and SEQs. A structured questionnaire was administered to 264 medical students' four months before the Part I MBBS examination. Apart from personal data of each student, the questionnaire sought information on the JAMB scores and GCE O' Level grades of each student in English Language, Biology, Chemistry, Physics and Mathematics. The physiology syllabus was divided into five parts and the students were administered separate examinations (tests) on each part. Each test consisted of MCQs and SEQs. The performance in MCQs and SEQs were compared. Also, the effects of JAMB scores and GCE O/level grades on the performance in both the MCQs and SEQs were assessed. The results showed that the students performed better in all MCQ tests than in the SEQs. JAMB scores and O' level English Language grade had no significant effect on students' performance in MCQs and SEQs. However O' level grades in Biology, Chemistry, Physics and Mathematics had significant effects on performance in MCQs and SEQs. Inadequate knowledge of physiology and inability to present information in a logical sequence are believed to be major factors contributing to the poorer performance in the SEQs compared with MCQs. In view of the finding of significant association between performance in MCQs and SEQs and GCE O/level grades in science subjects and mathematics, it was recommended that both JAMB results and the GCE results in the four O/level subjects above may be considered when selecting candidates for admission into the medical schools.

[A factor analysis method for contingency table data with unlimited multiple choice questions].

Science.gov (United States)

Toyoda, Hideki; Haiden, Reina; Kubo, Saori; Ikehara, Kazuya; Isobe, Yurie

2016-02-01

The purpose of this study is to propose a method of factor analysis for analyzing contingency tables developed from the data of unlimited multiple-choice questions. This method assumes that the element of each cell of the contingency table has a binominal distribution and a factor analysis model is applied to the logit of the selection probability. Scree plot and WAIC are used to decide the number of factors, and the standardized residual, the standardized difference between the sample, and the proportion ratio, is used to select items. The proposed method was applied to real product impression research data on advertised chips and energy drinks. Since the results of the analysis showed that this method could be used in conjunction with conventional factor analysis model, and extracted factors were fully interpretable, and suggests the usefulness of the proposed method in the study of psychology using unlimited multiple-choice questions.

The Prevalence of Multiple-Choice Testing in Registered Nurse Licensure-Qualifying Nursing Education Programs in New York State.

Science.gov (United States)

Birkhead, Susan; Kelman, Glenda; Zittel, Barbara; Jatulis, Linnea

The aim of this study was to describe nurse educators' use of multiple-choice questions (MCQs) in testing in registered nurse licensure-qualifying nursing education programs in New York State. This study was a descriptive correlational analysis of data obtained from surveying 1,559 nurse educators; 297 educators from 61 institutions responded (response rate [RR] = 19 percent), yielding a final cohort of 200. MCQs were reported to comprise a mean of 81 percent of questions on a typical test. Baccalaureate program respondents were equally likely to use MCQs as associate degree program respondents (p > .05) but were more likely to report using other methods of assessing student achievement to construct course grades (p < .01). Both groups reported little use of alternate format-type questions. Respondent educators reported substantial reliance upon the use of MCQs, corroborating the limited data quantifying the prevalence of use of MCQ tests in licensure-qualifying nursing education programs.

Automatic Generation System of Multiple-Choice Cloze Questions and its Evaluation

Directory of Open Access Journals (Sweden)

Takuya Goto

2010-09-01

Full Text Available Since English expressions vary according to the genres, it is important for students to study questions that are generated from sentences of the target genre. Although various questions are prepared, it is still not enough to satisfy various genres which students want to learn. On the other hand, when producing English questions, sufficient grammatical knowledge and vocabulary are needed, so it is difficult for non-expert to prepare English questions by themselves. In this paper, we propose an automatic generation system of multiple-choice cloze questions from English texts. Empirical knowledge is necessary to produce appropriate questions, so machine learning is introduced to acquire knowledge from existing questions. To generate the questions from texts automatically, the system (1 extracts appropriate sentences for questions from texts based on Preference Learning, (2 estimates a blank part based on Conditional Random Field, and (3 generates distracters based on statistical patterns of existing questions. Experimental results show our method is workable for selecting appropriate sentences and blank part. Moreover, our method is appropriate to generate the available distracters, especially for the sentence that does not contain the proper noun.

An Australian Study Comparing the Use of Multiple-Choice Questionnaires with Assignments as Interim, Summative Law School Assessment

Science.gov (United States)

Huang, Vicki

2017-01-01

To the author's knowledge, this is the first Australian study to empirically compare the use of a multiple-choice questionnaire (MCQ) with the use of a written assignment for interim, summative law school assessment. This study also surveyed the same student sample as to what types of assessments are preferred and why. In total, 182 undergraduate…

An Online National Archive of Multiple-Choice Questions for Astro 101 and the Development of the Question Complexity Rubric

Science.gov (United States)

Cormier, S.; Prather, E.; Brissenden, G.

2011-09-01

We are developing a national archive of multiple-choice questions for use in the Astronomy 101 classroom. These questions are intended to supplement an instructor's implementation of Think-Pair-Share or for their assessment purposes (i.e., exams and homework). We are also developing the Question Complexity Rubric (QCR) to guide members of the Astro 101 teaching and learning community in assisting us with hierarchically ranking questions in this archive based on their conceptual complexity. Using the QCR, a score is assigned to differentiate each question based on the cognitive steps necessary to comprehensively explain the reasoning pathway to the correct answer. The lowest QCR score is given to questions with a reasoning pathway requiring only declarative knowledge. The highest QCR score is given to questions with a reasoning pathway that requires multiple connected cognitive steps. When completed, the online question archive will provide users with the utility to 1) use the QCR to score questions 2) search for and download questions based on topic and/or QCR score, and 3) add their own questions to the archive. Stop by our poster to test your skills at determining question complexity by trying out the QCR with our sample questions.

Making the Most of Multiple Choice

Science.gov (United States)

Brookhart, Susan M.

2015-01-01

Multiple-choice questions draw criticism because many people perceive they test only recall or atomistic, surface-level objectives and do not require students to think. Although this can be the case, it does not have to be that way. Susan M. Brookhart suggests that multiple-choice questions are a useful part of any teacher's questioning repertoire…

The Question Complexity Rubric: Development and Application for a National Archive of Astro 101 Multiple-Choice Questions

Science.gov (United States)

Cormier, Sebastien; Prather, E. E.; Brissenden, G.; Collaboration of Astronomy Teaching Scholars CATS

2011-01-01

For the last two years we have been developing an online national archive of multiple-choice questions for use in the Astro 101 classroom. These questions are intended to either supplement an instructor's implementation of Think-Pair-Share or be used for assessment purposes (i.e. exams and homework). In this talk we will describe the development, testing and implementation of the Question Complexity Rubric (QCR), which is designed to guide the ranking of questions in this archive based on their conceptual complexity. Using the QCR, a score is assigned to differentiate each question based on the cognitive steps necessary to comprehensively explain the reasoning pathway to the correct answer. The lowest QCR score is given to questions with a reasoning pathway requiring only declarative knowledge whereas the highest QCR score is given to questions that require multiple pathways of multi-step reasoning. When completed, the online question archive will provide users with the utility to 1) search for and download questions based on subject and average QCR score, 2) use the QCR to score questions, and 3) add their own questions to the archive. We will also discuss other potential applications of the QCR, such as how it informs our work in developing and testing of survey instruments by allowing us to calibrate the range of question complexity. This material is based upon work supported by the National Science Foundation under Grant No. 0715517, a CCLI Phase III Grant for the Collaboration of Astronomy Teaching Scholars (CATS). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

The impact of two multiple-choice question formats on the problem-solving strategies used by novices and experts.

Science.gov (United States)

Coderre, Sylvain P; Harasym, Peter; Mandin, Henry; Fick, Gordon

2004-11-05

Pencil-and-paper examination formats, and specifically the standard, five-option multiple-choice question, have often been questioned as a means for assessing higher-order clinical reasoning or problem solving. This study firstly investigated whether two paper formats with differing number of alternatives (standard five-option and extended-matching questions) can test problem-solving abilities. Secondly, the impact of the alternatives number on psychometrics and problem-solving strategies was examined. Think-aloud protocols were collected to determine the problem-solving strategy used by experts and non-experts in answering Gastroenterology questions, across the two pencil-and-paper formats. The two formats demonstrated equal ability in testing problem-solving abilities, while the number of alternatives did not significantly impact psychometrics or problem-solving strategies utilized. These results support the notion that well-constructed multiple-choice questions can in fact test higher order clinical reasoning. Furthermore, it can be concluded that in testing clinical reasoning, the question stem, or content, remains more important than the number of alternatives.

Digital assessments – challenges, choices and pitfalls

DEFF Research Database (Denmark)

Simonsen, Eivind Ortind

assessments at the faculty of Health, Aarhus University. Today (2015) we have digitalized approximately 70 % of our assessments, including MCQ (multiple choice) and OSCE (objective structured clinical examination), with 7-800 students assessed each semester. We have developed our own systems...

Optimizing multiple-choice tests as tools for learning.

Science.gov (United States)

Little, Jeri L; Bjork, Elizabeth Ligon

2015-01-01

Answering multiple-choice questions with competitive alternatives can enhance performance on a later test, not only on questions about the information previously tested, but also on questions about related information not previously tested-in particular, on questions about information pertaining to the previously incorrect alternatives. In the present research, we assessed a possible explanation for this pattern: When multiple-choice questions contain competitive incorrect alternatives, test-takers are led to retrieve previously studied information pertaining to all of the alternatives in order to discriminate among them and select an answer, with such processing strengthening later access to information associated with both the correct and incorrect alternatives. Supporting this hypothesis, we found enhanced performance on a later cued-recall test for previously nontested questions when their answers had previously appeared as competitive incorrect alternatives in the initial multiple-choice test, but not when they had previously appeared as noncompetitive alternatives. Importantly, however, competitive alternatives were not more likely than noncompetitive alternatives to be intruded as incorrect responses, indicating that a general increased accessibility for previously presented incorrect alternatives could not be the explanation for these results. The present findings, replicated across two experiments (one in which corrective feedback was provided during the initial multiple-choice testing, and one in which it was not), thus strongly suggest that competitive multiple-choice questions can trigger beneficial retrieval processes for both tested and related information, and the results have implications for the effective use of multiple-choice tests as tools for learning.

The Incidence of Clueing in Multiple Choice Testbank Questions in Accounting: Some Evidence from Australia

Science.gov (United States)

Ibbett, Nicole L.; Wheldon, Brett J.

2016-01-01

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

The MCQ in the primary FRCS(Eng).

OpenAIRE

Lumley, J. S.; Browne, P. D.; Elcock, N. J.

1984-01-01

Analysis of the primary fellowship results showed that on average candidates were scoring a significantly higher mark in the MCQ than in the essay or viva. The level of MCQ marking has therefore been reset to the standards of the other parts of the examination. The need for continually monitoring the results of all examinations is emphasised.

The MCQ in the primary FRCS(Eng).

Science.gov (United States)

Lumley, J S; Browne, P D; Elcock, N J

1984-11-01

Analysis of the primary fellowship results showed that on average candidates were scoring a significantly higher mark in the MCQ than in the essay or viva. The level of MCQ marking has therefore been reset to the standards of the other parts of the examination. The need for continually monitoring the results of all examinations is emphasised.

Pushing Critical Thinking Skills With Multiple-Choice Questions: Does Bloom's Taxonomy Work?

Science.gov (United States)

Zaidi, Nikki L Bibler; Grob, Karri L; Monrad, Seetha M; Kurtz, Joshua B; Tai, Andrew; Ahmed, Asra Z; Gruppen, Larry D; Santen, Sally A

2018-06-01

Medical school assessments should foster the development of higher-order thinking skills to support clinical reasoning and a solid foundation of knowledge. Multiple-choice questions (MCQs) are commonly used to assess student learning, and well-written MCQs can support learner engagement in higher levels of cognitive reasoning such as application or synthesis of knowledge. Bloom's taxonomy has been used to identify MCQs that assess students' critical thinking skills, with evidence suggesting that higher-order MCQs support a deeper conceptual understanding of scientific process skills. Similarly, clinical practice also requires learners to develop higher-order thinking skills that include all of Bloom's levels. Faculty question writers and examinees may approach the same material differently based on varying levels of knowledge and expertise, and these differences can influence the cognitive levels being measured by MCQs. Consequently, faculty question writers may perceive that certain MCQs require higher-order thinking skills to process the question, whereas examinees may only need to employ lower-order thinking skills to render a correct response. Likewise, seemingly lower-order questions may actually require higher-order thinking skills to respond correctly. In this Perspective, the authors describe some of the cognitive processes examinees use to respond to MCQs. The authors propose that various factors affect both the question writer and examinee's interaction with test material and subsequent cognitive processes necessary to answer a question.

Approaches to Data Analysis of Multiple-Choice Questions

Science.gov (United States)

Ding, Lin; Beichner, Robert

2009-01-01

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

A Novel Multiple Choice Question Generation Strategy: Alternative Uses for Controlled Vocabulary Thesauri in Biomedical-Sciences Education.

Science.gov (United States)

Lopetegui, Marcelo A; Lara, Barbara A; Yen, Po-Yin; Çatalyürek, Ümit V; Payne, Philip R O

2015-01-01

Multiple choice questions play an important role in training and evaluating biomedical science students. However, the resource intensive nature of question generation limits their open availability, reducing their contribution to evaluation purposes mainly. Although applied-knowledge questions require a complex formulation process, the creation of concrete-knowledge questions (i.e., definitions, associations) could be assisted by the use of informatics methods. We envisioned a novel and simple algorithm that exploits validated knowledge repositories and generates concrete-knowledge questions by leveraging concepts' relationships. In this manuscript we present the development and validation of a prototype which successfully produced meaningful concrete-knowledge questions, opening new applications for existing knowledge repositories, potentially benefiting students of all biomedical sciences disciplines.

Approaches to data analysis of multiple-choice questions

OpenAIRE

Lin Ding; Robert Beichner

2009-01-01

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics education research. We minimize mathematics, instead placing emphasis on data interpretation using these approaches.

Approaches to data analysis of multiple-choice questions

Directory of Open Access Journals (Sweden)

Lin Ding

2009-09-01

Full Text Available This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics education research. We minimize mathematics, instead placing emphasis on data interpretation using these approaches.

Retrieval practice with short-answer, multiple-choice, and hybrid tests.

Science.gov (United States)

Smith, Megan A; Karpicke, Jeffrey D

2014-01-01

Retrieval practice improves meaningful learning, and the most frequent way of implementing retrieval practice in classrooms is to have students answer questions. In four experiments (N=372) we investigated the effects of different question formats on learning. Students read educational texts and practised retrieval by answering short-answer, multiple-choice, or hybrid questions. In hybrid conditions students first attempted to recall answers in short-answer format, then identified answers in multiple-choice format. We measured learning 1 week later using a final assessment with two types of questions: those that could be answered by recalling information verbatim from the texts and those that required inferences. Practising retrieval in all format conditions enhanced retention, relative to a study-only control condition, on both verbatim and inference questions. However, there were little or no advantages of answering short-answer or hybrid format questions over multiple-choice questions in three experiments. In Experiment 4, when retrieval success was improved under initial short-answer conditions, there was an advantage of answering short-answer or hybrid questions over multiple-choice questions. The results challenge the simple conclusion that short-answer questions always produce the best learning, due to increased retrieval effort or difficulty, and demonstrate the importance of retrieval success for retrieval-based learning activities.

Learning from peer feedback on student-generated multiple choice questions: Views of introductory physics students

Science.gov (United States)

Kay, Alison E.; Hardy, Judy; Galloway, Ross K.

2018-06-01

PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.

Effectiveness of Guided Multiple Choice Objective Questions Test on Students' Academic Achievement in Senior School Mathematics by School Location

Science.gov (United States)

Igbojinwaekwu, Patrick Chukwuemeka

2015-01-01

This study investigated, using pretest-posttest quasi-experimental research design, the effectiveness of guided multiple choice objective questions test on students' academic achievement in Senior School Mathematics, by school location, in Delta State Capital Territory, Nigeria. The sample comprised 640 Students from four coeducation secondary…

Marijuana Craving Questionnaire (MCQ-SF/Versão Brasil: validação semântica Marijuana Craving Questionnaire (MCQ-SF/Brazil Version: semantic validation

Directory of Open Access Journals (Sweden)

Rosemeri Siqueira Pedroso

2009-01-01

Full Text Available OBJETIVO: O objetivo deste estudo foi realizar tradução e adaptação transcultural do Marijuana Craving Questionnaire (MCQ-SF10, que avalia o craving por maconha em uma amostra brasileira. MÉTODO: O MCQ-SF foi traduzido do inglês para o português, aplicado em 10 sujeitos, submetido ao brainstorming num grupo de três indivíduos para reprodução individual e verbal, item a item. Realizou-se o back-translation, uma versão para o idioma de origem, a partir da primeira tradução e do brainstorming. Logo após, traduziu-se novamente para o português. Um comitê de juízes especialistas analisou todas as traduções. RESULTADOS: Após as considerações do comitê e um estudo-piloto com 30 sujeitos, a versão final do MCQ-SF/Versão Brasil foi construída. CONCLUSÃO: Os resultados demonstraram uma equivalência semântica satisfatória entre as versões. O MCQ-SF/Versão Brasil pode ser útil para avaliar o craving pela maconha nos dependentes dessa substância.OBJECTIVE: The aim of this study was to translate and adapt culturally the Marijuana Craving Questionnaire (MCQ-SF10 which evaluates the craving for marijuana in a Brazilian sample. METHOD: The Marijuana Craving Questionnaire (MCQ-SF was translated from English to Portuguese, administered to 10 subjects, submitted to a brainstorming in a group of three people for individual and verbal reproduction, item by item. Back-translation was executed, a translation for the original language, based on first translation and from brainstorming. Soon after, it was translated again into Portuguese. A committee of specialists analyzed all translations. RESULTS: After the committee considerations and a pilot study with 30 subjects, the final version of MCQ-SF/Versão Brasil was built. CONCLUSION: The results showed a satisfactory semantic equivalence between versions. The MCQ/Versão Brasil can be useful to evaluate the craving for marijuana on the dependents of this substance.

Formulation of multiple choice questions as a revision exercise at the end of a teaching module in biochemistry.

Science.gov (United States)

Bobby, Zachariah; Radhika, M R; Nandeesha, H; Balasubramanian, A; Prerna, Singh; Archana, Nimesh; Thippeswamy, D N

2012-01-01

The graduate medical students often get less opportunity for clarifying their doubts and to reinforce their concepts after lecture classes. Assessment of the effect of MCQ preparation by graduate medical students as a revision exercise on the topic "Mineral metabolism." At the end of regular teaching module on the topic "Mineral metabolism," graduate medical students were asked to prepare the stems of 15 MCQs based on the four discriminators given for each. They were told that one of the discriminators could be the answer for the MCQ and the remaining three could be the distracters. They were further guided in their task by providing few key word(s) in the stem of the expected MCQ. In the first phase of the exercise, the students attempted the MCQ preparation individually without peer consultation. In the second phase, the students participated in small group discussion to formulate the best MCQs of the group. The effects on low, medium, and high achievers were evaluated by pre and post-tests with the same set of MCQs. Both the individual endeavor in Phase 1 and small group discussion in Phase 2 for the formulation of MCQs significantly contributed to the gain from the exercise. The gains from the individual task and from small group discussion were equal among the different categories of students. Both phases of the exercise were equally beneficial for the low, medium, and high achievers. The high and medium achievers retained the gain from the exercise even after 1 week of the exercise whereas the low achievers could not retain the gain completely. Formulation of MCQs is an effective and useful unconventional revision exercise in Biochemistry for graduate medical students. Copyright © 2012 Wiley Periodicals, Inc.

Does the think-aloud protocol reflect thinking? Exploring functional neuroimaging differences with thinking (answering multiple choice questions) versus thinking aloud

NARCIS (Netherlands)

Durning, S.J.; Artino, A.R.; Beckman, T.J.; Graner, J.; Vleuten, C.P.M. van der; Holmboe, E.; Schuwirth, L.

2013-01-01

Background: Whether the think-aloud protocol is a valid measure of thinking remains uncertain. Therefore, we used functional magnetic resonance imaging (fMRI) to investigate potential functional neuroanatomic differences between thinking (answering multiple-choice questions in real time) versus

Teaching Critical Thinking without (Much) Writing: Multiple-Choice and Metacognition

Science.gov (United States)

Bassett, Molly H.

2016-01-01

In this essay, I explore an exam format that pairs multiple-choice questions with required rationales. In a space adjacent to each multiple-choice question, students explain why or how they arrived at the answer they selected. This exercise builds the critical thinking skill known as metacognition, thinking about thinking, into an exam that also…

Semantic Similarity Measures for the Generation of Science Tests in Basque

Science.gov (United States)

Aldabe, Itziar; Maritxalar, Montse

2014-01-01

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language…

Development of knowledge tests for multi-disciplinary emergency training

DEFF Research Database (Denmark)

Sorensen, J. L.; Thellesen, L.; Strandbygaard, J.

2015-01-01

and evaluating a multiple-choice question(MCQ) test for use in a multi-disciplinary training program inobstetric-anesthesia emergencies. Methods: A multi-disciplinary working committee with 12members representing six professional healthcare groups andanother 28 participants were involved. Recurrent revisions......, 40 out of originally50 items were included in the final MCQ test. The MCQ test wasable to distinguish between levels of competence, and good con-struct validity was indicated by a significant difference in the meanscore between consultants and first-year trainees, as well as betweenfirst...

Evaluating multiple-choice exams in large introductory physics courses

OpenAIRE

Gary Gladding; Tim Stelzer; Michael Scott

2006-01-01

The reliability and validity of professionally written multiple-choice exams have been extensively studied for exams such as the SAT, graduate record examination, and the force concept inventory. Much of the success of these multiple-choice exams is attributed to the careful construction of each question, as well as each response. In this study, the reliability and validity of scores from multiple-choice exams written for and administered in the large introductory physics courses at the Unive...

Evaluating Multiple-Choice Exams in Large Introductory Physics Courses

Science.gov (United States)

Scott, Michael; Stelzer, Tim; Gladding, Gary

2006-01-01

The reliability and validity of professionally written multiple-choice exams have been extensively studied for exams such as the SAT, graduate record examination, and the force concept inventory. Much of the success of these multiple-choice exams is attributed to the careful construction of each question, as well as each response. In this study,…

Incorporating Multiple-Choice Questions into an AACSB Assurance of Learning Process: A Course-Embedded Assessment Application to an Introductory Finance Course

Science.gov (United States)

Santos, Michael R.; Hu, Aidong; Jordan, Douglas

2014-01-01

The authors offer a classification technique to make a quantitative skills rubric more operational, with the groupings of multiple-choice questions to match the student learning levels in knowledge, calculation, quantitative reasoning, and analysis. The authors applied this classification technique to the mid-term exams of an introductory finance…

Formulation of Multiple Choice Questions as a Revision Exercise at the End of a Teaching Module in Biochemistry

Science.gov (United States)

Bobby, Zachariah; Radhika, M. R.; Nandeesha, H.; Balasubramanian, A.; Prerna, Singh; Archana, Nimesh; Thippeswamy, D. N.

2012-01-01

The graduate medical students often get less opportunity for clarifying their doubts and to reinforce their concepts after lecture classes. Assessment of the effect of MCQ preparation by graduate medical students as a revision exercise on the topic "Mineral metabolism." At the end of regular teaching module on the topic "Mineral metabolism,"…

A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development

Science.gov (United States)

Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.

2013-01-01

Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…

Student certainty answering misconception question: study of Three-Tier Multiple-Choice Diagnostic Test in Acid-Base and Solubility Equilibrium

Science.gov (United States)

Ardiansah; Masykuri, M.; Rahardjo, S. B.

2018-04-01

Students’ concept comprehension in three-tier multiple-choice diagnostic test related to student confidence level. The confidence level related to certainty and student’s self-efficacy. The purpose of this research was to find out students’ certainty in misconception test. This research was quantitative-qualitative research method counting students’ confidence level. The research participants were 484 students that were studying acid-base and equilibrium solubility subject. Data was collected using three-tier multiple-choice (3TMC) with thirty questions and students’ questionnaire. The findings showed that #6 item gives the highest misconception percentage and high student confidence about the counting of ultra-dilute solution’s pH. Other findings were that 1) the student tendency chosen the misconception answer is to increase over item number, 2) student certainty decreased in terms of answering the 3TMC, and 3) student self-efficacy and achievement were related each other in the research. The findings suggest some implications and limitations for further research.

Assessment of the Greek worry-related metacognitions: the Greek version of the Metacognitions Questionnaire (MCQ-30).

Science.gov (United States)

Typaldou, G M; Konstantakopoulos, G; Roxanis, I; Nidos, A; Vaidakis, N; Papadimitriou, G N; Wells, A

2014-01-01

The Metacognitions Questionnaire-30 (MCQ-30), developed by Wells and Cartwright-Hatton (2004), represents a multidimensional measure of metacognitive factors considered to be important in the metacognitive model of psychological disorders. The primary aim of the present study was to examine internal consistency, test-retest reliability, convergent validity and the factor structure of the Greek version of the MCQ-30. Moreover, we investigated the associations of the extracted factors with trait anxiety in a Greek sample. The study sample consisted of 547 non-clinical participants (213 males and 334 females). All participants completed the Greek version of the MCQ-30. A subsample of 157 participants also completed the Trait Anxiety subscale of the State -Trait Anxiety Inventory and the Meta-worry subscale of the Anxious Thought Inventory. Thirty participants were retested with the MCQ-30 over a retest interval ranging from three to five weeks. The results confirmed the dimensionality of the MCQ-30 and five factors were extracted consistent with the original English version: (1) positive beliefs about worry, (2) negative beliefs about worry concerning uncontrollability and danger, (3) cognitive confidence, (4) beliefs about the need to control thoughts and the negative consequences of not controlling them, and (5) cognitive selfconsciousness. The MCQ-30 showed high levels of internal consistency and test-retest reliability. The correlation between MCQ-30 total score and AnTI-MW was strong, indicating high level of convergent validity. Moreover, all correlations between MCQ-30 total and subscale scores and STAI-T were significant apart from the correlation between 'cognitive confidence' and trait anxiety. The Greek sample scored higher in the MCQ-30 and its subscales than the English sample in the original study. Women scored significantly higher than men in the overall MCQ-30 and the "uncontrollability and danger" and "need to control thoughts" subscales, whereas no

Evaluating multiple-choice exams in large introductory physics courses

Directory of Open Access Journals (Sweden)

Gary Gladding

2006-07-01

Full Text Available The reliability and validity of professionally written multiple-choice exams have been extensively studied for exams such as the SAT, graduate record examination, and the force concept inventory. Much of the success of these multiple-choice exams is attributed to the careful construction of each question, as well as each response. In this study, the reliability and validity of scores from multiple-choice exams written for and administered in the large introductory physics courses at the University of Illinois, Urbana-Champaign were investigated. The reliability of exam scores over the course of a semester results in approximately a 3% uncertainty in students’ total semester exam score. This semester test score uncertainty yields an uncertainty in the students’ assigned letter grade that is less than 1 / 3 of a letter grade. To study the validity of exam scores, a subset of students were ranked independently based on their multiple-choice score, graded explanations, and student interviews. The ranking of these students based on their multiple-choice score was found to be consistent with the ranking assigned by physics instructors based on the students’ written explanations ( r>0.94 at the 95% confidence level and oral interviews (r=0.94−0.09+0.06 .

Qualitätsverbesserung von MC Fragen [Quality assurance of Multiple Choice Questions

Directory of Open Access Journals (Sweden)

Rotthoff, Thomas

2006-08-01

Full Text Available [english] Because of the missing relevance of graded examinations at the German medical faculties, there was no need to reflect the question quality in written examinations consistently. Through the new national legislation for medical education certification-relevant, faculty-internal examinations are prescribed. Until now, there is a lack of structures and processes which could lead to an improvement of the question quality. To reflect the different performance of the students, a different severity and a good selectivity of the test questions are necessary. For a interdisciplinary examination for fourth year undergraduate students at the University Hospital Duesseldorf, new Multiple choice (MC- questions which are application-orientated, clearly formulated and to a large extent free from formal errors should be developed. The implementation took place in the conception and performance of Workshops for the construction of MC-questions and the appointment of an interdisciplinary review-committee. It could be shown that an author training facilitates and accelerates the review-process for the committee and that a review process reflects itself in a high practise-orientation of the items. Prospectively, high-quality questions which are created in a review-process and metrological analysed could be read into inter-university databases. Therewith the initial expenditure of time could be reduced. The interdisciplinary constitution of the review-committee offers the possibility of an intensified discussion over content and relevance of the questions. [german] Wegen fehlender notenrelevanter Prüfungen an den Medizinischen Fakultäten in Deutschland bestand bisher keine Notwendigkeit, die Fragenqualität in schriftlichen Prüfungen konsequent zu reflektieren. Erst durch die neue Approbationsordnung sind zeugnisrelevante, fakultätsinterne Prüfungen vorgeschrieben. Es fehlen somit oftmals Strukturen und Prozesse, die zu einer Verbesserung der

Correcting Grade Deflation Caused by Multiple-Choice Scoring.

Science.gov (United States)

Baranchik, Alvin; Cherkas, Barry

2000-01-01

Presents a study involving three sections of pre-calculus (n=181) at four-year college where partial credit scoring on multiple-choice questions was examined over an entire semester. Indicates that grades determined by partial credit scoring seemed more reflective of both the quantity and quality of student knowledge than grades determined by…

The feasibility of a multi-format Web-based assessment of physicians' communication skills.

Science.gov (United States)

Kim, Sara; Brock, Douglas M; Hess, Brian J; Holmboe, Eric S; Gallagher, Thomas H; Lipner, Rebecca S; Mazor, Kathleen M

2011-09-01

Little is known about the best approaches and format for measuring physicians' communication skills in an online environment. This study examines the reliability and validity of scores from two Web-based communication skill assessment formats. We created two online communication skill assessment formats: (a) MCQ (multiple-choice questions) consisting of video-based multiple-choice questions; (b) multi-format including video-based multiple-choice questions with rationales, Likert-type scales, and free text responses of what physicians would say to a patient. We randomized 100 general internists to each test format. Peer and patient ratings collected via the American Board of Internal Medicine (ABIM) served as validity sources. Seventy-seven internists completed the tests (MCQ: 38; multi-format: 39). The adjusted reliability was 0.74 for both formats. Excellent communicators, as based on their peer and patient ratings, performed slightly better on both tests than adequate communicators, though this difference was not statistically significant. Physicians in both groups rated test format innovative (4.2 out of 5.0). The acceptable reliability and participants' overall positive experiences point to the value of ongoing research into rigorous Web-based communication skills assessment. With efficient and reliable scoring, the Web offers an important way to measure and potentially enhance physicians' communication skills. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Using a Classroom Response System to Improve Multiple-Choice Performance in AP[R] Physics

Science.gov (United States)

Bertrand, Peggy

2009-01-01

Participation in rigorous high school courses such as Advanced Placement (AP[R]) Physics increases the likelihood of college success, especially for students who are traditionally underserved. Tackling difficult multiple-choice exams should be part of any AP program because well-constructed multiple-choice questions, such as those on AP exams and…

Understanding Test-Takers' Perceptions of Difficulty in EAP Vocabulary Tests: The Role of Experiential Factors

Science.gov (United States)

Oruç Ertürk, Nesrin; Mumford, Simon E.

2017-01-01

This study, conducted by two researchers who were also multiple-choice question (MCQ) test item writers at a private English-medium university in an English as a foreign language (EFL) context, was designed to shed light on the factors that influence test-takers' perceptions of difficulty in English for academic purposes (EAP) vocabulary, with the…

Impact of Answer-Switching Behavior on Multiple-Choice Test Scores in Higher Education

Directory of Open Access Journals (Sweden)

Ramazan BAŞTÜRK

2011-06-01

Full Text Available The multiple- choice format is one of the most popular selected-response item formats used in educational testing. Researchers have shown that Multiple-choice type test is a useful vehicle for student assessment in core university subjects that usually have large student numbers. Even though the educators, test experts and different test recourses maintain the idea that the first answer should be retained, many researchers argued that this argument is not dependent with empirical findings. The main question of this study is to examine how the answer switching behavior affects the multiple-choice test score. Additionally, gender differences and relationship between number of answer switching behavior and item parameters (item difficulty and item discrimination were investigated. The participants in this study consisted of 207 upper-level College of Education students from mid-sized universities. A Midterm exam consisted of 20 multiple-choice questions was used. According to the result of this study, answer switching behavior statistically increase test scores. On the other hand, there is no significant gender difference in answer-switching behavior. Additionally, there is a significant negative relationship between answer switching behavior and item difficulties.

Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: evidence for the dual-process theory of memory.

Science.gov (United States)

Sinha, Neha; Glass, Arnold Lewis

2015-01-01

Three experiments, two performed in the laboratory and one embedded in a college psychology lecture course, investigated the effects of immediate versus delayed feedback following a multiple-choice exam on subsequent short answer and multiple-choice exams. Performance on the subsequent multiple-choice exam was not affected by the timing of the feedback on the prior exam; however, performance on the subsequent short answer exam was better following delayed than following immediate feedback. This was true regardless of the order in which immediate versus delayed feedback was given. Furthermore, delayed feedback only had a greater effect than immediate feedback on subsequent short answer performance following correct, confident responses on the prior exam. These results indicate that delayed feedback cues a student's prior response and increases subsequent recollection of that response. The practical implication is that delayed feedback is better than immediate feedback during academic testing.

Comparing Item Performance on Three- Versus Four-Option Multiple Choice Questions in a Veterinary Toxicology Course.

Science.gov (United States)

Royal, Kenneth; Dorman, David

2018-06-09

The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpose of this study was to evaluate item performance on 3-option versus 4-option MCQs used in a core curriculum course in veterinary toxicology at a large veterinary medical school in the United States. A quasi-experimental, crossover design was used in which students in each class were randomly assigned to take one of two versions (A or B) of two major exams. Both the 3-option and 4-option MCQs resulted in similar psychometric properties. The findings of our study support earlier research in other medical disciplines and settings that likewise concluded there was no significant change in the psychometric properties of three option MCQs when compared to the traditional MCQs with four or more options.

Analyzing Multiple-Choice Questions by Model Analysis and Item Response Curves

Science.gov (United States)

Wattanakasiwich, P.; Ananta, S.

2010-07-01

In physics education research, the main goal is to improve physics teaching so that most students understand physics conceptually and be able to apply concepts in solving problems. Therefore many multiple-choice instruments were developed to probe students' conceptual understanding in various topics. Two techniques including model analysis and item response curves were used to analyze students' responses from Force and Motion Conceptual Evaluation (FMCE). For this study FMCE data from more than 1000 students at Chiang Mai University were collected over the past three years. With model analysis, we can obtain students' alternative knowledge and the probabilities for students to use such knowledge in a range of equivalent contexts. The model analysis consists of two algorithms—concentration factor and model estimation. This paper only presents results from using the model estimation algorithm to obtain a model plot. The plot helps to identify a class model state whether it is in the misconception region or not. Item response curve (IRC) derived from item response theory is a plot between percentages of students selecting a particular choice versus their total score. Pros and cons of both techniques are compared and discussed.

Consequences the extensive use of multiple-choice questions might have on student's reasoning structure

OpenAIRE

Raduta, C. M.

2013-01-01

Learning physics is a context dependent process. I consider a broader interdisciplinary problem of where differences in understanding and reasoning arise. I suggest the long run effects a multiple choice based learning system as well as society cultural habits and rules might have on student reasoning structure.

An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis.

Science.gov (United States)

Tarrant, Marie; Ware, James; Mohammed, Ahmed M

2009-07-07

Four- or five-option multiple choice questions (MCQs) are the standard in health-science disciplines, both on certification-level examinations and on in-house developed tests. Previous research has shown, however, that few MCQs have three or four functioning distractors. The purpose of this study was to investigate non-functioning distractors in teacher-developed tests in one nursing program in an English-language university in Hong Kong. Using item-analysis data, we assessed the proportion of non-functioning distractors on a sample of seven test papers administered to undergraduate nursing students. A total of 514 items were reviewed, including 2056 options (1542 distractors and 514 correct responses). Non-functioning options were defined as ones that were chosen by fewer than 5% of examinees and those with a positive option discrimination statistic. The proportion of items containing 0, 1, 2, and 3 functioning distractors was 12.3%, 34.8%, 39.1%, and 13.8% respectively. Overall, items contained an average of 1.54 (SD = 0.88) functioning distractors. Only 52.2% (n = 805) of all distractors were functioning effectively and 10.2% (n = 158) had a choice frequency of 0. Items with more functioning distractors were more difficult and more discriminating. The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs. Test items should consist of as many options as is feasible given the item content and the number of plausible distractors; in most cases this would be three. Item analysis results can be used to identify and remove non-functioning distractors from MCQs that have been used in previous tests.

Dual processing theory and experts' reasoning: exploring thinking on national multiple-choice questions.

Science.gov (United States)

Durning, Steven J; Dong, Ting; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Schuwirth, Lambert

2015-08-01

An ongoing debate exists in the medical education literature regarding the potential benefits of pattern recognition (non-analytic reasoning), actively comparing and contrasting diagnostic options (analytic reasoning) or using a combination approach. Studies have not, however, explicitly explored faculty's thought processes while tackling clinical problems through the lens of dual process theory to inform this debate. Further, these thought processes have not been studied in relation to the difficulty of the task or other potential mediating influences such as personal factors and fatigue, which could also be influenced by personal factors such as sleep deprivation. We therefore sought to determine which reasoning process(es) were used with answering clinically oriented multiple-choice questions (MCQs) and if these processes differed based on the dual process theory characteristics: accuracy, reading time and answering time as well as psychometrically determined item difficulty and sleep deprivation. We performed a think-aloud procedure to explore faculty's thought processes while taking these MCQs, coding think-aloud data based on reasoning process (analytic, nonanalytic, guessing or combination of processes) as well as word count, number of stated concepts, reading time, answering time, and accuracy. We also included questions regarding amount of work in the recent past. We then conducted statistical analyses to examine the associations between these measures such as correlations between frequencies of reasoning processes and item accuracy and difficulty. We also observed the total frequencies of different reasoning processes in the situations of getting answers correctly and incorrectly. Regardless of whether the questions were classified as 'hard' or 'easy', non-analytical reasoning led to the correct answer more often than to an incorrect answer. Significant correlations were found between self-reported recent number of hours worked with think-aloud word count

An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis

Directory of Open Access Journals (Sweden)

Mohammed Ahmed M

2009-07-01

Full Text Available Abstract Background Four- or five-option multiple choice questions (MCQs are the standard in health-science disciplines, both on certification-level examinations and on in-house developed tests. Previous research has shown, however, that few MCQs have three or four functioning distractors. The purpose of this study was to investigate non-functioning distractors in teacher-developed tests in one nursing program in an English-language university in Hong Kong. Methods Using item-analysis data, we assessed the proportion of non-functioning distractors on a sample of seven test papers administered to undergraduate nursing students. A total of 514 items were reviewed, including 2056 options (1542 distractors and 514 correct responses. Non-functioning options were defined as ones that were chosen by fewer than 5% of examinees and those with a positive option discrimination statistic. Results The proportion of items containing 0, 1, 2, and 3 functioning distractors was 12.3%, 34.8%, 39.1%, and 13.8% respectively. Overall, items contained an average of 1.54 (SD = 0.88 functioning distractors. Only 52.2% (n = 805 of all distractors were functioning effectively and 10.2% (n = 158 had a choice frequency of 0. Items with more functioning distractors were more difficult and more discriminating. Conclusion The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs. Test items should consist of as many options as is feasible given the item content and the number of plausible distractors; in most cases this would be three. Item analysis results can be used to identify and remove non-functioning distractors from MCQs that have been used in previous tests.

Formative assessment: a student perspective.

Science.gov (United States)

Hill, D A; Guinea, A I; McCarthy, W H

1994-09-01

An educator's view would be that formative assessment has an important role in the learning process. This study was carried out to obtain a student perspective of the place of formative assessment in the curriculum. Final-year medical students at Royal Prince Alfred Hospital took part in four teaching sessions, each structured to integrate teaching with assessment. Three assessment methods were used; the group objective structured clinical examination (G-OSCE), structured short answer (SSA) questions and a pre/post-test multiple choice questionnaire (MCQ). Teaching sessions were conducted on the subject areas of traumatology, the 'acute abdomen', arterial disorders and cancer. Fifty-five students, representing 83% of those who took part in the programme, responded to a questionnaire where they were asked to rate (on a 5-point Likert scale) their response to general questions about formative assessment and 13 specific questions concerning the comparative value of the three assessment modalities. Eighty-nine per cent of respondents felt that formative assessment should be incorporated into the teaching process. The SSA assessment was regarded as the preferred modality to reinforce previous teaching and test problem-solving skills. The MCQ was the least favoured assessment method. The effect size variable between the total scores for the SSA and MCQ was 0.64. The variable between G-OSCE and SSA/MCQ was 0.26 and 0.33 respectively. Formative assessment is a potentially powerful method to direct learning behaviour. Students should have input into the methods used.

A singular choice for multiple choice

DEFF Research Database (Denmark)

Frandsen, Gudmund Skovbjerg; Schwartzbach, Michael Ignatieff

2006-01-01

How should multiple choice tests be scored and graded, in particular when students are allowed to check several boxes to convey partial knowledge? Many strategies may seem reasonable, but we demonstrate that five self-evident axioms are sufficient to determine completely the correct strategy. We ...

Single best answer MCQs: a new format for the FRCR part 2a exam

International Nuclear Information System (INIS)

McCoubrie, P.; McKnight, L.

2008-01-01

The single best answer multiple-choice question (MCQ) format has many advantages over traditional true/false format MCQs. From 2009, the Royal College of Radiologists will be adopting this format for written examinations. This article describes the background of this decision and the evidence behind it. There are numerous benefits to examiners and candidates alike from adopting this format. Using examples, the usual structure of the format of this type of questions is explained, how they are written, and tips provided on how to prepare for and answer them

[To what extent do reviewers of multiple-choice questions need to be trained? A comparison between handing out information sheets and brief workshop sessions].

Science.gov (United States)

Öchsner, Wolfgang; Böckers, Anja

2016-01-01

A competent review process is crucial to ensure the quality of multiple-choice (MC) questions. However, the acquisition of reviewing skills should not cause any unnecessary additional burden for a medical staff that is already facing heavy workloads. 100 MC questions, for which an expert review existed, were presented to 12 novices. In advance, six participants received a specific information sheet covering critical information for high-calibre review; the other six participants attended a 2.5-hour workshop covering the same information. The review results of both groups were analysed with a licensed version of the IBM software SPSS 19.0 (SPSS Inc., Chicago, IL). The results of the workshop group were distinctly closer to the experts' results (gold standard) than those of the information sheet group. For the quantitatively important category of medium quality MC questions, the results of the workshop group did not significantly differ from the experts' results. In the information sheet group the results were significantly poorer than the experts', regardless of the quality of the questions. Distributing specific information sheets to MC question reviewers is not sufficient for ensuring the quality of the review so that - regardless of the increased effort involved - a recommendation to conduct specific workshops must be made. Copyright © 2014. Published by Elsevier GmbH.

The positive and negative consequences of multiple-choice testing.

Science.gov (United States)

Roediger, Henry L; Marsh, Elizabeth J

2005-09-01

Multiple-choice tests are commonly used in educational settings but with unknown effects on students' knowledge. The authors examined the consequences of taking a multiple-choice test on a later general knowledge test in which students were warned not to guess. A large positive testing effect was obtained: Prior testing of facts aided final cued-recall performance. However, prior testing also had negative consequences. Prior reading of a greater number of multiple-choice lures decreased the positive testing effect and increased production of multiple-choice lures as incorrect answers on the final test. Multiple-choice testing may inadvertently lead to the creation of false knowledge.

Mindful eating reduces impulsive food choice in adolescents and adults.

Science.gov (United States)

Hendrickson, Kelsie L; Rasmussen, Erin B

2017-03-01

The present study tested the extent to which age and obesity predicted impulsive choices for food and monetary outcomes and tested how a brief mindful-eating training would alter delay discounting for food and money choices compared with control groups. First, 172 adolescents (M age = 13.13 years) and 176 (M age = 23.33 years) adults completed the Food Choice Questionnaire (FCQ) and Monetary Choice Questionnaire (MCQ) as measures of food and money delay discounting, respectively. Then, participants returned to the lab and were randomly assigned to complete a brief mindful-eating training, watch a DVD on nutrition, or serve as a control. Participants completed the FCQ and MCQ again as a postmanipulation measure. Participants with high percent body fat (PBF) were more impulsive for food than those with low PBF. Adults with high PBF were also more impulsive for money compared with adults with low PBF; no PBF-related differences were found for adolescents. Participants in the mindful-eating group exhibited more self-controlled choices for food, but not for money. The control conditions did not exhibit changes. The study suggests that individuals with high PBF make more impulsive food choices relative to those with low PBF, which could increase the risk of obesity over time. It also is the first to demonstrate shifts in choice patterns for food and money using a brief mindful-eating training with adolescents. Mindful eating is a beneficial strategy to reduce impulsive food choice, at least temporarily, that may impede weight gain. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study

Science.gov (United States)

DiBattista, David; Sinnige-Egger, Jo-Anne; Fortuna, Glenda

2014-01-01

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

THE EXPLICIT COMPREHENSION-STRATEGY INSTRUCTION: QUESTION-ANSWER RELATIONSHIP VS SELF-QUESTIONING

Directory of Open Access Journals (Sweden)

Lalu Thohir

2017-12-01

Full Text Available This study was aimed at examining and comparing the effectiveness of the Question-Answer Relationship (QAR and Self-Questioning (SQ strategies in improving the reading ability of the undergraduate students. This study was a quasi-experimental study in which two out of three classes of the third semester students at English department of Mataram University were selected randomly to receive either QAR strategy or SQ strategy instructions for ten weekly meetings. The findings of pre- and posttest with multiple-choice questions revealed that both comprehension strategies were effective in improving the undergraduate students‘ reading ability. The findings from the posttest with multiple-choice questions indicated the students who received SQ strategy instruction scored significantly higher than those students who received QAR strategy instruction. On the other hand, the students who received QAR strategy instruction scored slightly higher than those students who received SQ strategy instruction in the posttest with open-ended questions.

Measuring University students' understanding of the greenhouse effect - a comparison of multiple-choice, short answer and concept sketch assessment tools with respect to students' mental models

Science.gov (United States)

Gold, A. U.; Harris, S. E.

2013-12-01

The greenhouse effect comes up in most discussions about climate and is a key concept related to climate change. Existing studies have shown that students and adults alike lack a detailed understanding of this important concept or might hold misconceptions. We studied the effectiveness of different interventions on University-level students' understanding of the greenhouse effect. Introductory level science students were tested for their pre-knowledge of the greenhouse effect using validated multiple-choice questions, short answers and concept sketches. All students participated in a common lesson about the greenhouse effect and were then randomly assigned to one of two lab groups. One group explored an existing simulation about the greenhouse effect (PhET-lesson) and the other group worked with absorption spectra of different greenhouse gases (Data-lesson) to deepen the understanding of the greenhouse effect. All students completed the same assessment including multiple choice, short answers and concept sketches after participation in their lab lesson. 164 students completed all the assessments, 76 completed the PhET lesson and 77 completed the data lesson. 11 students missed the contrasting lesson. In this presentation we show the comparison between the multiple-choice questions, short answer questions and the concept sketches of students. We explore how well each of these assessment types represents student's knowledge. We also identify items that are indicators of the level of understanding of the greenhouse effect as measured in correspondence of student answers to an expert mental model and expert responses. Preliminary data analysis shows that student who produce concept sketch drawings that come close to expert drawings also choose correct multiple-choice answers. However, correct multiple-choice answers are not necessarily an indicator that a student produces an expert-like correlating concept sketch items. Multiple-choice questions that require detailed

Multiple-choice pretesting potentiates learning of related information.

Science.gov (United States)

Little, Jeri L; Bjork, Elizabeth Ligon

2016-10-01

Although the testing effect has received a substantial amount of empirical attention, such research has largely focused on the effects of tests given after study. The present research examines the effect of using tests prior to study (i.e., as pretests), focusing particularly on how pretesting influences the subsequent learning of information that is not itself pretested but that is related to the pretested information. In Experiment 1, we found that multiple-choice pretesting was better for the learning of such related information than was cued-recall pretesting or a pre-fact-study control condition. In Experiment 2, we found that the increased learning of non-pretested related information following multiple-choice testing could not be attributed to increased time allocated to that information during subsequent study. Last, in Experiment 3, we showed that the benefits of multiple-choice pretesting over cued-recall pretesting for the learning of related information persist over 48 hours, thus demonstrating the promise of multiple-choice pretesting to potentiate learning in educational contexts. A possible explanation for the observed benefits of multiple-choice pretesting for enhancing the effectiveness with which related nontested information is learned during subsequent study is discussed.

Aufwandsanalyse für computerunterstützte Multiple-Choice Papierklausuren [Cost analysis for computer supported multiple-choice paper examinations

Directory of Open Access Journals (Sweden)

Mandel, Alexander

2011-11-01

Full Text Available [english] Introduction: Multiple-choice-examinations are still fundamental for assessment in medical degree programs. In addition to content related research, the optimization of the technical procedure is an important question. Medical examiners face three options: paper-based examinations with or without computer support or completely electronic examinations. Critical aspects are the effort for formatting, the logistic effort during the actual examination, quality, promptness and effort of the correction, the time for making the documents available for inspection by the students, and the statistical analysis of the examination results.Methods: Since three semesters a computer program for input and formatting of MC-questions in medical and other paper-based examinations is used and continuously improved at Wuerzburg University. In the winter semester (WS 2009/10 eleven, in the summer semester (SS 2010 twelve and in WS 2010/11 thirteen medical examinations were accomplished with the program and automatically evaluated. For the last two semesters the remaining manual workload was recorded. Results: The cost of the formatting and the subsequent analysis including adjustments of the analysis of an average examination with about 140 participants and about 35 questions was 5-7 hours for exams without complications in the winter semester 2009/2010, about 2 hours in SS 2010 and about 1.5 hours in the winter semester 2010/11. Including exams with complications, the average time was about 3 hours per exam in SS 2010 and 2.67 hours for the WS 10/11. Discussion: For conventional multiple-choice exams the computer-based formatting and evaluation of paper-based exams offers a significant time reduction for lecturers in comparison with the manual correction of paper-based exams and compared to purely electronically conducted exams it needs a much simpler technological infrastructure and fewer staff during the exam.[german] Einleitung: Multiple-Choice

Assessing choice making among children with multiple disabilities.

OpenAIRE

Sigafoos, J; Dempsey, R

1992-01-01

Some learners with multiple disabilities display idiosyncratic gestures that are interpreted as a means of making choices. In the present study, we assessed the validity of idiosyncratic choice-making behaviors of 3 children with multiple disabilities. Opportunities for each child to choose between food and drink were provided under two conditions. In one condition, the children were given the food or drink item corresponding to their prior choice. In the other condition, the teacher delivere...

"None of the above" as a correct and incorrect alternative on a multiple-choice test: implications for the testing effect.

Science.gov (United States)

Odegard, Timothy N; Koen, Joshua D

2007-11-01

Both positive and negative testing effects have been demonstrated with a variety of materials and paradigms (Roediger & Karpicke, 2006b). The present series of experiments replicate and extend the research of Roediger and Marsh (2005) with the addition of a "none-of-the-above" response option. Participants (n=32 in both experiments) read a set of passages, took an initial multiple-choice test, completed a filler task, and then completed a final cued-recall test (Experiment 1) or multiple-choice test (Experiment 2). Questions were manipulated on the initial multiple-choice test by adding a "none-of-the-above" response alternative (choice "E") that was incorrect ("E" Incorrect) or correct ("E" Correct). The results from both experiments demonstrated that the positive testing effect was negated when the "none-of-the-above" alternative was the correct response on the initial multiple-choice test, but was still present when the "none-of-the-above" alternative was an incorrect response.

Are Faculty Predictions or Item Taxonomies Useful for Estimating the Outcome of Multiple-Choice Examinations?

Science.gov (United States)

Kibble, Jonathan D.; Johnson, Teresa

2011-01-01

The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

Using automatic item generation to create multiple-choice test items.

Science.gov (United States)

Gierl, Mark J; Lai, Hollis; Turner, Simon R

2012-08-01

Many tests of medical knowledge, from the undergraduate level to the level of certification and licensure, contain multiple-choice items. Although these are efficient in measuring examinees' knowledge and skills across diverse content areas, multiple-choice items are time-consuming and expensive to create. Changes in student assessment brought about by new forms of computer-based testing have created the demand for large numbers of multiple-choice items. Our current approaches to item development cannot meet this demand. We present a methodology for developing multiple-choice items based on automatic item generation (AIG) concepts and procedures. We describe a three-stage approach to AIG and we illustrate this approach by generating multiple-choice items for a medical licensure test in the content area of surgery. To generate multiple-choice items, our method requires a three-stage process. Firstly, a cognitive model is created by content specialists. Secondly, item models are developed using the content from the cognitive model. Thirdly, items are generated from the item models using computer software. Using this methodology, we generated 1248 multiple-choice items from one item model. Automatic item generation is a process that involves using models to generate items using computer technology. With our method, content specialists identify and structure the content for the test items, and computer technology systematically combines the content to generate new test items. By combining these outcomes, items can be generated automatically. © Blackwell Publishing Ltd 2012.

THE MULTIPLE CHOICE PROBLEM WITH INTERACTIONS BETWEEN CRITERIA

Directory of Open Access Journals (Sweden)

Luiz Flavio Autran Monteiro Gomes

2015-12-01

Full Text Available ABSTRACT An important problem in Multi-Criteria Decision Analysis arises when one must select at least two alternatives at the same time. This can be denoted as a multiple choice problem. In other words, instead of evaluating each of the alternatives separately, they must be combined into groups of n alternatives, where n = 2. When the multiple choice problem must be solved under multiple criteria, the result is a multi-criteria, multiple choice problem. In this paper, it is shown through examples how this problemcan be tackled on a bipolar scale. The Choquet integral is used in this paper to take care of interactions between criteria. A numerical application example is conducted using data from SEBRAE-RJ, a non-profit private organization that has the mission of promoting competitiveness, sustainable developmentand entrepreneurship in the state of Rio de Janeiro, Brazil. The paper closes with suggestions for future research.

Climbing Bloom's taxonomy pyramid: Lessons from a graduate histology course.

Science.gov (United States)

Zaidi, Nikki B; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-09-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were generally assigned a higher BTHT level than simple text questions. The type of microscopy technique (light or electron microscopy) used for these image-based questions did not result in any significant differences in their Bloom's taxonomy scores. The BTHT levels for teacher-generated MCQs correlated positively with higher discrimination indices and inversely with the percent of students answering these questions correctly (difficulty index), suggesting that higher-level Bloom's taxonomy questions differentiate well between higher- and lower-performing students. When examining BTHT scores for MCQs that were written by students in a Multiple-Choice Item Development Assignment (MCIDA) there was no significant correlation between these scores and the students' ability to answer teacher-generated MCQs. This suggests that the ability to answer histology MCQs relies on a different skill set than the aptitude to construct higher-level Bloom's taxonomy questions. However, students significantly improved their average BTHT scores from the midterm to the final MCIDA task, which indicates that practice, experience and feedback increased their MCQ writing proficiency. Anat Sci Educ 10: 456-464. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

An Empirical Study on the Effect of Different Technology Environments on Students’ Assessment

DEFF Research Database (Denmark)

Khalid, Md. Saifuddin; Sujan, Khaled Mahmud; Haque, Indrani

2011-01-01

Multiple choice question (MCQ)-based assessment for higher education students can be a solution to reduce workload where teacher-student ratio is significantly high and also in distance learning approaches. Originating from the users problem claiming that “web-based and mobile-based tests...... experienced in implementing such web-based and SMS based system in Bangladesh are discussed. In Bangladesh, some telecentres has been established by government and NGOs which are engaged in educating people in the rural and remote areas of the country. This low-cost SMS-based testing can be used for testing...

Predictive value of the korean academy of family medicine in-training examination for certifying examination.

Science.gov (United States)

Cho, Jung-Jin; Kim, Ji-Yong

2011-09-01

In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certification Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. 275 out of 372 residents completed ITE. Those who completed ITE had significantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field.

Use of Multi-Response Format Test in the Assessment of Medical Students’ Critical Thinking Ability

Science.gov (United States)

Mafinejad, Mahboobeh Khabaz; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-01-01

Introduction To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student’s ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. Aim To assess critical thinking ability of medical students by using multi-response format of assessment. Materials and Methods A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson’s coefficient to explore the association between the total scores of tests and subtests. Results One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST’s subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). Conclusion This study highlights the importance of considering multi-response format test in

Use of Multi-Response Format Test in the Assessment of Medical Students' Critical Thinking Ability.

Science.gov (United States)

Mafinejad, Mahboobeh Khabaz; Arabshahi, Seyyed Kamran Soltani; Monajemi, Alireza; Jalili, Mohammad; Soltani, Akbar; Rasouli, Javad

2017-09-01

To evaluate students critical thinking skills effectively, change in assessment practices is must. The assessment of a student's ability to think critically is a constant challenge, and yet there is considerable debate on the best assessment method. There is evidence that the intrinsic nature of open and closed-ended response questions is to measure separate cognitive abilities. To assess critical thinking ability of medical students by using multi-response format of assessment. A cross-sectional study was conducted on a group of 159 undergraduate third-year medical students. All the participants completed the California Critical Thinking Skills Test (CCTST) consisting of 34 multiple-choice questions to measure general critical thinking skills and a researcher-developed test that combines open and closed-ended questions. A researcher-developed 48-question exam, consisting of 8 short-answers and 5 essay questions, 19 Multiple-Choice Questions (MCQ), and 16 True-False (TF) questions, was used to measure critical thinking skills. Correlation analyses were performed using Pearson's coefficient to explore the association between the total scores of tests and subtests. One hundred and fifty-nine students participated in this study. The sample comprised 81 females (51%) and 78 males (49%) with an age range of 20±2.8 years (mean 21.2 years). The response rate was 64.1%. A significant positive correlation was found between types of questions and critical thinking scores, of which the correlations of MCQ (r=0.82) and essay questions (r=0.77) were strongest. The significant positive correlations between multi-response format test and CCTST's subscales were seen in analysis, evaluation, inference and inductive reasoning. Unlike CCTST subscales, multi-response format test have weak correlation with CCTST total score (r=0.45, p=0.06). This study highlights the importance of considering multi-response format test in the assessment of critical thinking abilities of medical

Reducing the number of options on multiple-choice questions: response time, psychometrics and standard setting.

Science.gov (United States)

Schneid, Stephen D; Armour, Chris; Park, Yoon Soo; Yudkowsky, Rachel; Bordage, Georges

2014-10-01

Despite significant evidence supporting the use of three-option multiple-choice questions (MCQs), these are rarely used in written examinations for health professions students. The purpose of this study was to examine the effects of reducing four- and five-option MCQs to three-option MCQs on response times, psychometric characteristics, and absolute standard setting judgements in a pharmacology examination administered to health professions students. We administered two versions of a computerised examination containing 98 MCQs to 38 Year 2 medical students and 39 Year 3 pharmacy students. Four- and five-option MCQs were converted into three-option MCQs to create two versions of the examination. Differences in response time, item difficulty and discrimination, and reliability were evaluated. Medical and pharmacy faculty judges provided three-level Angoff (TLA) ratings for all MCQs for both versions of the examination to allow the assessment of differences in cut scores. Students answered three-option MCQs an average of 5 seconds faster than they answered four- and five-option MCQs (36 seconds versus 41 seconds; p = 0.008). There were no significant differences in item difficulty and discrimination, or test reliability. Overall, the cut scores generated for three-option MCQs using the TLA ratings were 8 percentage points higher (p = 0.04). The use of three-option MCQs in a health professions examination resulted in a time saving equivalent to the completion of 16% more MCQs per 1-hour testing period, which may increase content validity and test score reliability, and minimise construct under-representation. The higher cut scores may result in higher failure rates if an absolute standard setting method, such as the TLA method, is used. The results from this study provide a cautious indication to health professions educators that using three-option MCQs does not threaten validity and may strengthen it by allowing additional MCQs to be tested in a fixed amount

Biology Question Generation from a Semantic Network

Science.gov (United States)

Zhang, Lishan

Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students' learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student's current competence so that a suitable question could be selected based on the student's previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from

Dual process theory and intermediate effect: are faculty and residents' performance on multiple-choice, licensing exam questions different?

Science.gov (United States)

Dong, Ting; Durning, Steven J; Artino, Anthony R; van der Vleuten, Cees; Holmboe, Eric; Lipner, Rebecca; Schuwirth, Lambert

2015-04-01

Clinical reasoning is essential for the practice of medicine. Dual process theory conceptualizes reasoning as falling into two general categories: nonanalytic reasoning (pattern recognition) and analytic reasoning (active comparing and contrasting of alternatives). The debate continues regarding how expert performance develops and how individuals make the best use of analytic and nonanalytic processes. Several investigators have identified the unexpected finding that intermediates tend to perform better on licensing examination items than experts, which has been termed the "intermediate effect." We explored differences between faculty and residents on multiple-choice questions (MCQs) using dual process measures (both reading and answering times) to inform this ongoing debate. Faculty (board-certified internists; experts) and residents (internal medicine interns; intermediates) answered live licensing examination MCQs (U.S. Medical Licensing Examination Step 2 Clinical Knowledge and American Board of Internal Medicine Certifying Examination) while being timed. We conducted repeated analysis of variance to compare the 2 groups on average reading time, answering time, and accuracy on various types of items. Faculty and residents did not differ significantly in reading time [F (1,35) = 0.01, p = 0.93], answering time [F (1,35) = 0.60, p = 0.44], or accuracy [F (1,35) = 0.24, p = 0.63] regardless of easy or hard items. Dual process theory was not evidenced in this study. However, this lack of difference between faculty and residents may have been affected by the small sample size of participants and MCQs may not reflect how physicians made decisions in actual practice setting. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

The process of developing a rubric to assess the cognitive complexity of student-generated multiple choice questions in medical education

Directory of Open Access Journals (Sweden)

Rebecca Grainger

2018-05-01

Full Text Available Cognitively complex assessments encourage students to prepare using deep learning strategies rather than surface learning, recall-based ones. In order to prepare such assessment tasks, it is necessary to have some way of measuring cognitive complexity. In the context of a student-generated MCQ writing task, we developed a rubric for assessing the cognitive complexity of MCQs based on Bloom’s taxonomy. We simplified the six-level taxonomy into a three-level rubric. Three rounds of moderation and rubric development were conducted, in which 10, 15 and 100 randomly selected student-generated MCQs were independently rated by three academic staff. After each round of marking, inter-rater reliability was calculated, qualitative analysis of areas of agreement and disagreement was conducted, and the markers discussed the cognitive processes required to answer the MCQs. Inter-rater reliability, defined by the intra-class correlation coefficient, increased from 0.63 to 0.94, indicating the markers rated the MCQs consistently. The three-level rubric was found to be effective for evaluating the cognitive complexity of MCQs generated by medical students.

To Show or Not to Show: The Effects of Item Stems and Answer Options on Performance on a Multiple-Choice Listening Comprehension Test

Science.gov (United States)

Yanagawa, Kozo; Green, Anthony

2008-01-01

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

Wh-Questions, Universal Statements and Free Choice Inferences in Child Mandarin.

Science.gov (United States)

Huang, Haiquan; Zhou, Peng; Crain, Stephen

2017-11-16

This study investigated 5-year-old Mandarin-speaking children's comprehension of wh-questions, universal statements and free choice inferences. Previous research has found that Mandarin-speaking children assign a universal interpretation to sentences with a wh-word (e.g., shei 'who') followed by the adverbial quantifier dou 'all' (Zhou in Appl Psycholinguist 36:411-435, 2013). Children also compute free choice inferences in sentences that contain a modal verb in addition to a wh-word and dou (Zhou, in: Nakayama, Su, Huang (eds.) Studies in Chinese and Japanese language acquisition: in honour of Stephen Crain. John Benjamins Publishing Company, Amsterdam, pp 223-235, 2017). The present study used a Question-Statement Task to assess children's interpretation of sentences containing shei + dou, both with and without the modal verb beiyunxu 'was allowed to', as well as the contrast between sentences with shei + dou, which are statements for adults, versus ones with dou + shei, which are wh-questions for adults. The 5-year-old Mandarin-speaking child participants exhibited adult-like linguistic knowledge of the semantics and pragmatics of wh-words, the adverbial quantifier dou, and the deontic modal verb beiyunxu.

Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters.

Science.gov (United States)

Parker, Joyce M; Anderson, Charles W; Heidemann, Merle; Merrill, John; Merritt, Brett; Richmond, Gail; Urban-Lurain, Mark

2012-01-01

We present a diagnostic question cluster (DQC) that assesses undergraduates' thinking about photosynthesis. This assessment tool is not designed to identify individual misconceptions. Rather, it is focused on students' abilities to apply basic concepts about photosynthesis by reasoning with a coordinated set of practices based on a few scientific principles: conservation of matter, conservation of energy, and the hierarchical nature of biological systems. Data on students' responses to the cluster items and uses of some of the questions in multiple-choice, multiple-true/false, and essay formats are compared. A cross-over study indicates that the multiple-true/false format shows promise as a machine-gradable format that identifies students who have a mixture of accurate and inaccurate ideas. In addition, interviews with students about their choices on three multiple-choice questions reveal the fragility of students' understanding. Collectively, the data show that many undergraduates lack both a basic understanding of the role of photosynthesis in plant metabolism and the ability to reason with scientific principles when learning new content. Implications for instruction are discussed.

The Use of Case Based Multiple Choice Questions for Assessing Large Group Teaching: Implications on Student's Learning

Directory of Open Access Journals (Sweden)

Christina Donnelly

2014-06-01

Full Text Available The practice of assessments in third level education is extremely important and a rarely disputed part of the university curriculum as a method to demonstrate a student’s learning. However, assessments to test a student’s knowledge and level of understanding are challenging to apply given recent trends which are showing that student numbers are increasing, student demographics are wide ranging and resources are being stretched. As a result of these emerging challenges, lecturers are required to develop a comprehensive assessment to effectively demonstrate student learning, whilst efficiently managing large class sizes. One form of assessment which has been used for efficient assessment is multiple choice questions (MCQs; however this method has been criticised for encouraging surface learning, in comparison to other methods such as essays or case studies. This research explores the impact of blended assessment methods on student learning. This study adopts a rigorous three-staged qualitative methodology to capture third level lecturers’ and students’ perception to (1 the level of learning when using MCQs; (2 the level of learning when blended assessment in the form of case based MCQs are used. The findings illuminate the positive impact of cased based MCQs as students and lecturers suggest that it leads to a higher level of learning and deeper information processing over that of MCQs without case studies. 2 The implications of this research is that this type of assessment contributes to the current thinking within literature on the use of assessments methods, as well as the blending of assessment methods to reach a higher level of learning. It further serves to reinforce the belief that assessments are the greatest influence on students’ learning, and the requirement for both universities and lecturers to reflect on the best form of assessment to test students’ level of understanding, whilst also balancing the real challenges of

Should essays and other "open-ended"-type questions retain a place in written summative assessment in clinical medicine?

Science.gov (United States)

Hift, Richard J

2014-11-28

Written assessments fall into two classes: constructed-response or open-ended questions, such as the essay and a number of variants of the short-answer question, and selected-response or closed-ended questions; typically in the form of multiple-choice. It is widely believed that constructed response written questions test higher order cognitive processes in a manner that multiple-choice questions cannot, and consequently have higher validity. An extensive review of the literature suggests that in summative assessment neither premise is evidence-based. Well-structured open-ended and multiple-choice questions appear equivalent in their ability to assess higher cognitive functions, and performance in multiple-choice assessments may correlate more highly than the open-ended format with competence demonstrated in clinical practice following graduation. Studies of construct validity suggest that both formats measure essentially the same dimension, at least in mathematics, the physical sciences, biology and medicine. The persistence of the open-ended format in summative assessment may be due to the intuitive appeal of the belief that synthesising an answer to an open-ended question must be both more cognitively taxing and similar to actual experience than is selecting a correct response. I suggest that cognitive-constructivist learning theory would predict that a well-constructed context-rich multiple-choice item represents a complex problem-solving exercise which activates a sequence of cognitive processes which closely parallel those required in clinical practice, hence explaining the high validity of the multiple-choice format. The evidence does not support the proposition that the open-ended assessment format is superior to the multiple-choice format, at least in exit-level summative assessment, in terms of either its ability to test higher-order cognitive functioning or its validity. This is explicable using a theory of mental models, which might predict that the

On the Equivalence of Constructed-Response and Multiple-Choice Tests.

Science.gov (United States)

Traub, Ross E.; Fisher, Charles W.

Two sets of mathematical reasoning and two sets of verbal comprehension items were cast into each of three formats--constructed response, standard multiple-choice, and Coombs multiple-choice--in order to assess whether tests with indentical content but different formats measure the same attribute, except for possible differences in error variance…

Analysis of Multiple Choice Tests Designed by Faculty Members of Kermanshah University of Medical Sciences

Directory of Open Access Journals (Sweden)

Reza Pourmirza Kalhori

2013-12-01

Full Text Available Dear Editor Multiple choice tests are the most common objective tests in medical education which are used to assess the ind-ividual knowledge, recall, recognition and problem solving abilities. One of the testing components is the post-test analysis. This component includes; first, qualitative analysis of the taxonomy of questions based on the Bloom’s educational objectives and percentage of the questions with no structural problems; and second, the quantitative analysis of the reliability (KR-20 and indices of difficulty and differentiation (1. This descriptive-analytical study was aimed to qualitatively and quan-titatively investigate the multiple-choice tests of the faculty members at Kermanshah University of Medical Sciences in 2009-2010. The sample size comprised of 156 tests. Data were analyzed by SPSS-16 software using t-test, chi-squared test, ANOVA and Tukey multiple comparison tests. The mean of reliability (KR-20, difficulty index, and discrimination index were 0.68 (± 0.31, 0.56 (± 0.15 and 0.21 (± 0.15, respectively, which were acceptable. The analysis of the tests at Mashad University of Medical Sciences indicated that the mean for the reliability of the tests was 0.72, and 52.2% of the tests had inappropriate difficulty index and 49.2% of the tests did not have acceptable differentiation index (2. Comparison of the tests at Kermanshah University of Medical Sciences for the fields of anatomy, physiology, biochemistry, genetics, statistics and behavioral sciences courses at Malaysia Faculty of Medicine (3 and tests at Argentina Faculty of Medicine (4 showed that while difficulty index was acceptable in all three universities, but differentiation indices in Malaysia and Argentina Medical Faculties were higher than that in Kermanshah University of Medical Sciences. The mean for the questions with no structural flaws in all tests, taxonomy I, taxonomy II, and taxonomy III were 73.88% (± 14.88, 34.65% (± 15.78, 41.34% (± 13

Peer Review Improves the Quality of MCQ Examinations

Science.gov (United States)

Malau-Aduli, Bunmi S.; Zimitat, Craig

2012-01-01

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

CT colonography training for radiographers - a formal evaluation

International Nuclear Information System (INIS)

Haycock, A.; Burling, D.; Wylie, P.; Muckian, J.; Ilangovan, R.; Thomas-Gibson, S.

2010-01-01

Aims: To evaluate the efficacy of a new intensive 'hands-on' course designed to train small teams of radiographers in computed tomography colonography (CTC) technique and initial interpretation for patient triage. Materials and methods: The course comprised small-group lectures, active participation in the daily CTC service with practical technique and image interpretation training by experienced radiologists and radiographers. Evaluation was by assessment of knowledge using randomized sets of multiple choice questions (MCQ; pre/post-course), practical technique using checklists and expert global scores, and interpretation performance outcomes using randomized pre/post-course test datasets (five validated CTC examinations each). Paired t-tests were used to investigate change in performance for MCQ score and interpretation accuracy. Results: Thirteen courses with 49 participants were evaluated over 2 years. Practical skills were high, with mean (SD) checklist scores of 14/15 (0.85) and global scores of 26/30 (2.3). MCQ scores increased significantly from a mean of 59% pre-course to 69% post-course, p 10 mm) detection rates also improved significantly from 49% to 60%, p = 0.002. Conclusion: Structured training in CTC can significantly improve knowledge and interpretation skills of radiographers, while assessing safe procedural performance. Implementation of similar programmes nationally may help reduce performance gaps between centres.

An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender

Science.gov (United States)

Bowhay, Andrew R; Watmough, Simon D

2009-01-01

Background There has been comparatively little consideration of the impact that the changes to undergraduate curricula might have on postgraduate academic performance. This study compares the performance of graduates by UK medical school and gender in the Multiple Choice Question (MCQ) section of the first part of the Fellowship of the Royal College of Anaesthetists (FRCA) examination. Methods Data from each sitting of the MCQ section of the primary FRCA examination from June 1999 to May 2008 were analysed for performance by medical school and gender. Results There were 4983 attempts at the MCQ part of the examination by 3303 graduates from the 19 United Kingdom medical schools. Using the standardised overall mark minus the pass mark graduates from five medical schools performed significantly better than the mean for the group and five schools performed significantly worse than the mean for the group. Males performed significantly better than females in all aspects of the MCQ – physiology, mean difference = 3.0% (95% CI 2.3, 3.7), p < 0.001; pharmacology, mean difference = 1.7% (95% CI 1.0, 2.3), p < 0.001; physics with clinical measurement, mean difference = 3.5% (95% CI 2.8, 4.1), p < 0.001; overall mark, mean difference = 2.7% (95% CI 2.1, 3.3), p < 0.001; and standardised overall mark minus the pass mark, mean difference = 2.5% (95% CI 1.9, 3.1), p < 0.001. Graduates from three medical schools that have undergone the change from Traditional to Problem Based Learning curricula did not show any change in performance in any aspects of the MCQ pre and post curriculum change. Conclusion Graduates from each of the medical schools in the UK do show differences in performance in the MCQ section of the primary FRCA, but significant curriculum change does not lead to deterioration in post graduate examination performance. Whilst females now outnumber males taking the MCQ, they are not performing as well as the males. PMID:19563655

Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing.

Science.gov (United States)

Butler, Andrew C; Roediger, Henry L

2008-04-01

Multiple-choice tests are used frequently in higher education without much consideration of the impact this form of assessment has on learning. Multiple-choice testing enhances retention of the material tested (the testing effect); however, unlike other tests, multiple-choice can also be detrimental because it exposes students to misinformation in the form of lures. The selection of lures can lead students to acquire false knowledge (Roediger & Marsh, 2005). The present research investigated whether feedback could be used to boost the positive effects and reduce the negative effects of multiple-choice testing. Subjects studied passages and then received a multiple-choice test with immediate feedback, delayed feedback, or no feedback. In comparison with the no-feedback condition, both immediate and delayed feedback increased the proportion of correct responses and reduced the proportion of intrusions (i.e., lure responses from the initial multiple-choice test) on a delayed cued recall test. Educators should provide feedback when using multiple-choice tests.

Two layers LSTM with attention for multi-choice question answering in exams

Science.gov (United States)

Li, Yongbin

2018-03-01

Question Answering in Exams is typical question answering task that aims to test how accurately the model could answer the questions in exams. In this paper, we use general deep learning model to solve the multi-choice question answering task. Our approach is to build distributed word embedding of question and answers instead of manually extracting features or linguistic tools, meanwhile, for improving the accuracy, the external corpus is introduced. The framework uses a two layers LSTM with attention which get a significant result. By contrast, we introduce the simple long short-term memory (QA-LSTM) model and QA-LSTM-CNN model and QA-LSTM with attention model as the reference. Experiment demonstrate superior performance of two layers LSTM with attention compared to other models in question answering task.

Question presentation methods for paired-associate learning

NARCIS (Netherlands)

Engel, F.L.; Geerings, M.P.W.

1988-01-01

Four different methods of question presentation, in interactive computeraided learning of Dutch-English word pairs are evaluated experimentally. These methods are: 1) the 'open-question method', 2) the 'multiple-choice method', 3) the 'sequential method' and 4) the 'true/ false method'. When

Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test.

Science.gov (United States)

Sirota, Miroslav; Juanchich, Marie

2018-03-27

The Cognitive Reflection Test, measuring intuition inhibition and cognitive reflection, has become extremely popular because it reliably predicts reasoning performance, decision-making, and beliefs. Across studies, the response format of CRT items sometimes differs, based on the assumed construct equivalence of tests with open-ended versus multiple-choice items (the equivalence hypothesis). Evidence and theoretical reasons, however, suggest that the cognitive processes measured by these response formats and their associated performances might differ (the nonequivalence hypothesis). We tested the two hypotheses experimentally by assessing the performance in tests with different response formats and by comparing their predictive and construct validity. In a between-subjects experiment (n = 452), participants answered stem-equivalent CRT items in an open-ended, a two-option, or a four-option response format and then completed tasks on belief bias, denominator neglect, and paranormal beliefs (benchmark indicators of predictive validity), as well as on actively open-minded thinking and numeracy (benchmark indicators of construct validity). We found no significant differences between the three response formats in the numbers of correct responses, the numbers of intuitive responses (with the exception of the two-option version, which had a higher number than the other tests), and the correlational patterns of the indicators of predictive and construct validity. All three test versions were similarly reliable, but the multiple-choice formats were completed more quickly. We speculate that the specific nature of the CRT items helps build construct equivalence among the different response formats. We recommend using the validated multiple-choice version of the CRT presented here, particularly the four-option CRT, for practical and methodological reasons. Supplementary materials and data are available at https://osf.io/mzhyc/ .

Gruppenleistungen beim Review von Multiple-Choice-Fragen - Ein Vergleich von face-to-face und virtuellen Gruppen mit und ohne Moderation [Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation

Directory of Open Access Journals (Sweden)

Schüttpelz-Brauns, Katrin

2010-11-01

Full Text Available [english] Background: Multiple choice questions (MCQs are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects.Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality.Results: There was no significant influence of the variables “form of review committee” and “facilitation”. However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition “face to face without facilitation” was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task.Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.[german] Einleitung: Multiple-Choice-Fragen (MCF werden in vielen Prüfungen der medizinischen Ausbildung verwendet und bedürfen aus diesem Grund einer sorgfältigen Qualitätssicherung, beispielsweise durch den Einsatz von Review-Komitees. Anhand der vorliegenden empirischen Studie soll erforscht werden, ob virtuell per E-Mail kommunizierende Review-Komitees vergleichbar sind mit face-to-face Review-Komitees hinsichtlich ihrer Leistung beim Review-Prozess und ob sich Moderation positiv auswirkt.Methodik: 16 Kleingruppen von Psychologie-Studenten hatten die Aufgabe unter vier verschiedenen Versuchsbedingungen MCF zu bewerten und zu

Multiple-Choice and Short-Answer Exam Performance in a College Classroom

Science.gov (United States)

Funk, Steven C.; Dickson, K. Laurie

2011-01-01

The authors experimentally investigated the effects of multiple-choice and short-answer format exam items on exam performance in a college classroom. They randomly assigned 50 students to take a 10-item short-answer pretest or posttest on two 50-item multiple-choice exams in an introduction to personality course. Students performed significantly…

Multiple Choice Testing and the Retrieval Hypothesis of the Testing Effect

Science.gov (United States)

Sensenig, Amanda E.

2010-01-01

Taking a test often leads to enhanced later memory for the tested information, a phenomenon known as the "testing effect". This memory advantage has been reliably demonstrated with recall tests but not multiple choice tests. One potential explanation for this finding is that multiple choice tests do not rely on retrieval processes to the same…

Comparison of Integrated Testlet and Constructed-Response Question Formats

Science.gov (United States)

Slepkov, Aaron D.; Shiell, Ralph C.

2014-01-01

Constructed-response (CR) questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC) questions in formal exams. The integrated testlet (IT) is a recently developed…

Integrating personalized medical test contents with XML and XSL-FO.

Science.gov (United States)

Toddenroth, Dennis; Dugas, Martin; Frankewitsch, Thomas

2011-03-01

In 2004 the adoption of a modular curriculum at the medical faculty in Muenster led to the introduction of centralized examinations based on multiple-choice questions (MCQs). We report on how organizational challenges of realizing faculty-wide personalized tests were addressed by implementation of a specialized software module to automatically generate test sheets from individual test registrations and MCQ contents. Key steps of the presented method for preparing personalized test sheets are (1) the compilation of relevant item contents and graphical media from a relational database with database queries, (2) the creation of Extensible Markup Language (XML) intermediates, and (3) the transformation into paginated documents. The software module by use of an open source print formatter consistently produced high-quality test sheets, while the blending of vectorized textual contents and pixel graphics resulted in efficient output file sizes. Concomitantly the module permitted an individual randomization of item sequences to prevent illicit collusion. The automatic generation of personalized MCQ test sheets is feasible using freely available open source software libraries, and can be efficiently deployed on a faculty-wide scale.

Enhancement of medical student performance through narrative reflective practice: a pilot project

Directory of Open Access Journals (Sweden)

Alan Thomson

2013-03-01

Full Text Available Background: Narrative Reflective Practice (NRP is a process that helps medical students become better listeners and physicians. We hypothesized that NRP would enhance students’ performance on multiple choice question exams (MCQs, on objective structured clinical examinations (OSCEs, and on subjective clinical evaluations (SCEs. Methods: The MCQs, OSCEs and SCEs test scores from 139 third year University of Alberta medical students from the same class doing their Internal Medicine rotation were collected over a 12 month period. All preceptors followed the same one-hour clinical teaching format, except for the single preceptor who incorporated 2 weeks of NRP in the usual clinical teaching of 16 students. The testing was done at the end of each 8-week rotation, and all students within each cohort received the same MCQs, OSCE and SCEs Results: Independent t-tests were used to assess group differences in the mean MCQ, OSCE and SCE scores. The group receiving NRP training scored 4.7 % higher on the MCQ component than those who did not. The mean differences for OSCE and SCE scores were non-significant. Conclusions: Two weeks NRP exposure produced an absolute increase in students’ MCQ score. Longer periods of NRP exposure may also increase the OSCE and SCE scores. This promising pilot project needs to be confirmed using several trained preceptors and trainees at different levels of their clinical experience.

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions

DEFF Research Database (Denmark)

McEvoy, Fintan; Shen, Nicholas W; Nielsen, Dorte Hald

2017-01-01

for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p ... scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree...... review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p correlation was found between peer review...

Genetic Algorithms for Multiple-Choice Problems

Science.gov (United States)

Aickelin, Uwe

2010-04-01

This thesis investigates the use of problem-specific knowledge to enhance a genetic algorithm approach to multiple-choice optimisation problems.It shows that such information can significantly enhance performance, but that the choice of information and the way it is included are important factors for success.Two multiple-choice problems are considered.The first is constructing a feasible nurse roster that considers as many requests as possible.In the second problem, shops are allocated to locations in a mall subject to constraints and maximising the overall income.Genetic algorithms are chosen for their well-known robustness and ability to solve large and complex discrete optimisation problems.However, a survey of the literature reveals room for further research into generic ways to include constraints into a genetic algorithm framework.Hence, the main theme of this work is to balance feasibility and cost of solutions.In particular, co-operative co-evolution with hierarchical sub-populations, problem structure exploiting repair schemes and indirect genetic algorithms with self-adjusting decoder functions are identified as promising approaches.The research starts by applying standard genetic algorithms to the problems and explaining the failure of such approaches due to epistasis.To overcome this, problem-specific information is added in a variety of ways, some of which are designed to increase the number of feasible solutions found whilst others are intended to improve the quality of such solutions.As well as a theoretical discussion as to the underlying reasons for using each operator,extensive computational experiments are carried out on a variety of data.These show that the indirect approach relies less on problem structure and hence is easier to implement and superior in solution quality.

Optimizing Multiple-Choice Tests as Learning Events

Science.gov (United States)

Little, Jeri Lynn

2011-01-01

Although generally used for assessment, tests can also serve as tools for learning--but different test formats may not be equally beneficial. Specifically, research has shown multiple-choice tests to be less effective than cued-recall tests in improving the later retention of the tested information (e.g., see meta-analysis by Hamaker, 1986),…

Item and test analysis to identify quality multiple choice questions (MCQS from an assessment of medical students of Ahmedabad, Gujarat

Directory of Open Access Journals (Sweden)

Sanju Gajjar

2014-01-01

Full Text Available Background: Multiple choice questions (MCQs are frequently used to assess students in different educational streams for their objectivity and wide reach of coverage in less time. However, the MCQs to be used must be of quality which depends upon its difficulty index (DIF I, discrimination index (DI and distracter efficiency (DE. Objective: To evaluate MCQs or items and develop a pool of valid items by assessing with DIF I, DI and DE and also to revise/ store or discard items based on obtained results. Settings: Study was conducted in a medical school of Ahmedabad. Materials and Methods: An internal examination in Community Medicine was conducted after 40 hours teaching during 1 st MBBS which was attended by 148 out of 150 students. Total 50 MCQs or items and 150 distractors were analyzed. Statistical Analysis: Data was entered and analyzed in MS Excel 2007 and simple proportions, mean, standard deviations, coefficient of variation were calculated and unpaired t test was applied. Results: Out of 50 items, 24 had "good to excellent" DIF I (31 - 60% and 15 had "good to excellent" DI (> 0.25. Mean DE was 88.6% considered as ideal/ acceptable and non functional distractors (NFD were only 11.4%. Mean DI was 0.14. Poor DI (< 0.15 with negative DI in 10 items indicates poor preparedness of students and some issues with framing of at least some of the MCQs. Increased proportion of NFDs (incorrect alternatives selected by < 5% students in an item decrease DE and makes it easier. There were 15 items with 17 NFDs, while rest items did not have any NFD with mean DE of 100%. Conclusion: Study emphasizes the selection of quality MCQs which truly assess the knowledge and are able to differentiate the students of different abilities in correct manner.

Validity of the ISUOG basic training test

DEFF Research Database (Denmark)

Hillerup, Niels Emil; Tabor, Ann; Konge, Lars

2018-01-01

A certain level of theoretical knowledge is required when performing basic obstetrical and gynecological ultrasound. To assess the adequacy of trainees' basic theoretical knowledge, the International Society of Ultrasound in Obstetrics and Gynecology (ISUOG) has developed a theoretical test of 49...... Multiple Choice Questionnaire (MCQ) items for their basic training courses....

Calibrating the Medical Council of Canada's Qualifying Examination Part I using an integrated item response theory framework: a comparison of models and designs.

Science.gov (United States)

De Champlain, Andre F; Boulais, Andre-Philippe; Dallas, Andrew

2016-01-01

The aim of this research was to compare different methods of calibrating multiple choice question (MCQ) and clinical decision making (CDM) components for the Medical Council of Canada's Qualifying Examination Part I (MCCQEI) based on item response theory. Our data consisted of test results from 8,213 first time applicants to MCCQEI in spring and fall 2010 and 2011 test administrations. The data set contained several thousand multiple choice items and several hundred CDM cases. Four dichotomous calibrations were run using BILOG-MG 3.0. All 3 mixed item format (dichotomous MCQ responses and polytomous CDM case scores) calibrations were conducted using PARSCALE 4. The 2-PL model had identical numbers of items with chi-square values at or below a Type I error rate of 0.01 (83/3,499 or 0.02). In all 3 polytomous models, whether the MCQs were either anchored or concurrently run with the CDM cases, results suggest very poor fit. All IRT abilities estimated from dichotomous calibration designs correlated very highly with each other. IRT-based pass-fail rates were extremely similar, not only across calibration designs and methods, but also with regard to the actual reported decision to candidates. The largest difference noted in pass rates was 4.78%, which occurred between the mixed format concurrent 2-PL graded response model (pass rate= 80.43%) and the dichotomous anchored 1-PL calibrations (pass rate= 85.21%). Simpler calibration designs with dichotomized items should be implemented. The dichotomous calibrations provided better fit of the item response matrix than more complex, polytomous calibrations.

The Effect of Accounting Question Response Formats on Student Performance

Science.gov (United States)

Jonick, Christine; Schneider, Jennifer; Boylan, Daniel

2017-01-01

The purpose of the research is to examine the effect of different response formats on student performance on introductory accounting exam questions. The study analyzes 1104 accounting students' responses to quantitative questions presented in two formats: multiple-choice and fill-in. Findings indicate that response format impacts student…

CT colonography training for radiographers - a formal evaluation

Energy Technology Data Exchange (ETDEWEB)

Haycock, A. [Intestinal Imaging Centre and Wolfson Unit for Endoscopy, St Mark' s Hospital, Imperial College London, London (United Kingdom); Burling, D., E-mail: burlingdavid@yahoo.co.u [Intestinal Imaging Centre and Wolfson Unit for Endoscopy, St Mark' s Hospital, Imperial College London, London (United Kingdom); Wylie, P.; Muckian, J.; Ilangovan, R.; Thomas-Gibson, S. [Intestinal Imaging Centre and Wolfson Unit for Endoscopy, St Mark' s Hospital, Imperial College London, London (United Kingdom)

2010-12-15

Aims: To evaluate the efficacy of a new intensive 'hands-on' course designed to train small teams of radiographers in computed tomography colonography (CTC) technique and initial interpretation for patient triage. Materials and methods: The course comprised small-group lectures, active participation in the daily CTC service with practical technique and image interpretation training by experienced radiologists and radiographers. Evaluation was by assessment of knowledge using randomized sets of multiple choice questions (MCQ; pre/post-course), practical technique using checklists and expert global scores, and interpretation performance outcomes using randomized pre/post-course test datasets (five validated CTC examinations each). Paired t-tests were used to investigate change in performance for MCQ score and interpretation accuracy. Results: Thirteen courses with 49 participants were evaluated over 2 years. Practical skills were high, with mean (SD) checklist scores of 14/15 (0.85) and global scores of 26/30 (2.3). MCQ scores increased significantly from a mean of 59% pre-course to 69% post-course, p < 0.001. Correct classification of CTC examination improved significantly from a mean of 55% pre-course to 71% post-course, p < 0.001. Cancer and large polyp (>10 mm) detection rates also improved significantly from 49% to 60%, p = 0.002. Conclusion: Structured training in CTC can significantly improve knowledge and interpretation skills of radiographers, while assessing safe procedural performance. Implementation of similar programmes nationally may help reduce performance gaps between centres.

Multiple-Choice Exams: An Obstacle for Higher-Level Thinking in Introductory Science Classes

Science.gov (United States)

Stanger-Hall, Kathrin F.

2012-01-01

Learning science requires higher-level (critical) thinking skills that need to be practiced in science classes. This study tested the effect of exam format on critical-thinking skills. Multiple-choice (MC) testing is common in introductory science courses, and students in these classes tend to associate memorization with MC questions and may not see the need to modify their study strategies for critical thinking, because the MC exam format has not changed. To test the effect of exam format, I used two sections of an introductory biology class. One section was assessed with exams in the traditional MC format, the other section was assessed with both MC and constructed-response (CR) questions. The mixed exam format was correlated with significantly more cognitively active study behaviors and a significantly better performance on the cumulative final exam (after accounting for grade point average and gender). There was also less gender-bias in the CR answers. This suggests that the MC-only exam format indeed hinders critical thinking in introductory science classes. Introducing CR questions encouraged students to learn more and to be better critical thinkers and reduced gender bias. However, student resistance increased as students adjusted their perceptions of their own critical-thinking abilities. PMID:22949426

Multiple-choice test of energy and momentum concepts

OpenAIRE

Singh, Chandralekha; Rosengrant, David

2016-01-01

We investigate student understanding of energy and momentum concepts at the level of introductory physics by designing and administering a 25-item multiple choice test and conducting individual interviews. We find that most students have difficulty in qualitatively interpreting basic principles related to energy and momentum and in applying them in physical situations.

Feasibility of a multiple-choice mini mental state examination for chronically critically ill patients.

Science.gov (United States)

Miguélez, Marta; Merlani, Paolo; Gigon, Fabienne; Verdon, Mélanie; Annoni, Jean-Marie; Ricou, Bara

2014-08-01

Following treatment in an ICU, up to 70% of chronically critically ill patients present neurocognitive impairment that can have negative effects on their quality of life, daily activities, and return to work. The Mini Mental State Examination is a simple, widely used tool for neurocognitive assessment. Although of interest when evaluating ICU patients, the current version is restricted to patients who are able to speak. This study aimed to evaluate the feasibility of a visual, multiple-choice Mini Mental State Examination for ICU patients who are unable to speak. The multiple-choice Mini Mental State Examination and the standard Mini Mental State Examination were compared across three different speaking populations. The interrater and intrarater reliabilities of the multiple-choice Mini Mental State Examination were tested on both intubated and tracheostomized ICU patients. Mixed 36-bed ICU and neuropsychology department in a university hospital. Twenty-six healthy volunteers, 20 neurological patients, 46 ICU patients able to speak, and 30 intubated or tracheostomized ICU patients. None. Multiple-choice Mini Mental State Examination results correlated satisfactorily with standard Mini Mental State Examination results in all three speaking groups: healthy volunteers: intraclass correlation coefficient = 0.43 (95% CI, -0.18 to 0.62); neurology patients: 0.90 (95% CI, 0.82-0.95); and ICU patients able to speak: 0.86 (95% CI, 0.70-0.92). The interrater and intrarater reliabilities were good (0.95 [0.87-0.98] and 0.94 [0.31-0.99], respectively). In all populations, a Bland-Altman analysis showed systematically higher scores using the multiple-choice Mini Mental State Examination. Administration of the multiple-choice Mini Mental State Examination to ICU patients was straightforward and produced exploitable results comparable to those of the standard Mini Mental State Examination. It should be of interest for the assessment and monitoring of the neurocognitive

Evaluating the impact of a Canadian national anatomy and radiology contouring boot camp for radiation oncology residents.

Science.gov (United States)

Jaswal, Jasbir; D'Souza, Leah; Johnson, Marjorie; Tay, KengYeow; Fung, Kevin; Nichols, Anthony; Landis, Mark; Leung, Eric; Kassam, Zahra; Willmore, Katherine; D'Souza, David; Sexton, Tracy; Palma, David A

2015-03-15

Radiation therapy treatment planning has advanced over the past 2 decades, with increased emphasis on 3-dimensional imaging for target and organ-at-risk (OAR) delineation. Recent studies suggest a need for improved resident instruction in this area. We developed and evaluated an intensive national educational course ("boot camp") designed to provide dedicated instruction in site-specific anatomy, radiology, and contouring using a multidisciplinary (MDT) approach. The anatomy and radiology contouring (ARC) boot camp was modeled after prior single-institution pilot studies and a needs-assessment survey. The boot camp incorporated joint lectures from radiation oncologists, anatomists, radiologists, and surgeons, with hands-on contouring instruction and small group interactive seminars using cadaveric prosections and correlative axial radiographs. Outcomes were evaluated using pretesting and posttesting, including anatomy/radiology multiple-choice questions (MCQ), timed contouring sessions (evaluated relative to a gold standard using Dice similarity metrics), and qualitative questions on satisfaction and perceived effectiveness. Analyses of pretest versus posttest scores were performed using nonparametric paired testing. Twenty-nine radiation oncology residents from 10 Canadian universities participated. As part of their current training, 29%, 75%, and 21% receive anatomy, radiology, and contouring instruction, respectively. On posttest scores, the MCQ knowledge scores improved significantly (pretest mean 60% vs posttest mean 80%, Pradiology in addition to enhancing their confidence and accuracy in contouring. Copyright © 2015 Elsevier Inc. All rights reserved.

Differences in gender performance on competitive physics selection tests

Science.gov (United States)

Wilson, Kate; Low, David; Verdon, Matthew; Verdon, Alix

2016-12-01

[This paper is part of the Focused Collection on Gender in Physics.] We have investigated gender differences in performance over the past eight years on the Australian Science Olympiad Exam (ASOE) for physics, which is taken by nearly 1000 high school students each year. The ASOE, run by Australian Science Innovations (ASI), is the initial stage of the process of selection of teams to represent Australia at the Asian and International Physics Olympiads. Students taking the exam are generally in their penultimate year of school and selected by teachers as being high performing in physics. Together with the overall differences in facility, we have investigated how the content and presentation of multiple-choice questions (MCQs) affects the particular answers selected by male and female students. Differences in the patterns of responses by male and female students indicate that males and females might be modeling situations in different ways. Some strong patterns were found in the gender gaps when the questions were categorized in five broad dimensions: content, process required, difficulty, presentation, and context. Almost all questions saw male students performing better, although gender differences were relatively small for questions with a more abstract context. Male students performed significantly better on most questions with a concrete context, although notable exceptions were found, including two such questions where female students performed better. Other categories that showed consistently large gaps favoring male students include questions with projectile motion and other two-dimensional motion or forces content, and processes involving interpreting diagrams. Our results have important implications, suggesting that we should be able to reduce the gender gaps in performance on MCQ tests by changing the way information is presented and setting questions in contexts that are less likely to favor males over females. This is important as MCQ tests are

Question Generation and Adaptation Using a Bayesian Network of the Learner’s Achievements

NARCIS (Netherlands)

Wißner, M.; Linnebank, F.; Liem, J.; Bredeweg, B.; André, E.; Lane, H.C.; Yacef, K.; Mostow, J.; Pavlik, P.

2013-01-01

This paper presents a domain independent question generation and interaction procedure that automatically generates multiple-choice questions for conceptual models created with Qualitative Reasoning vocabulary. A Bayesian Network is deployed that captures the learning progress based on the answers

Questioning Chemistry: The Role of Level, Familiarity, Language and Taxonomy

Science.gov (United States)

Rodrigues, Susan; Taylor, Neil; Cameron, Margaret; Syme-Smith, Lorraine; Fortuna, Colette

2010-01-01

This paper reports on data collected via an audience response system, where a convenience sample of 300 adults aged 17-50 pressed a button to register their answers for twenty multiple choice questions. The responses were then discussed with the respondents at the time. The original dataset includes physics, biology and chemistry questions. The…

Measurement and validation of measures for impulsive food choice across obese and healthy-weight individuals.

Science.gov (United States)

Hendrickson, Kelsie L; Rasmussen, Erin B; Lawyer, Steven R

2015-07-01

The present study established a brief measure of delay discounting for food, the Food Choice Questionnaire (FCQ), and compared it to another more established measure of food discounting that uses the adjusting amount (AA) procedure. One hundred forty-four undergraduate participants completed either two measures of hypothetical food discounting (a computerized food AA procedure or the FCQ) or two measures of hypothetical money discounting [a computerized monetary AA procedure or the Monetary Choice questionnaire (MCQ)]. The money condition was used as a replication of previous work. Results indicated that the FCQ yielded consistent data that strongly correlated with the AA food discounting task. Moreover, a magnitude effect was found with the FCQ, such that smaller amounts of food were discounted more steeply than larger amounts. In addition, individuals with higher percent body fat (PBF) discounted food more steeply than individuals with lower PBF. The MCQ, which also produced a magnitude effect, and the monetary adjusting amount procedure yielded data that were orderly, consistent, and correlated strongly with one another, replicating previous literature. This study is the first to show that a novel measure of food discounting (the FCQ) yields consistent data strongly correlated with an established measure of food discounting and is sensitive to PBF. Moreover, the FCQ is easier and quicker to administer than the AA procedure, which may interest researchers who use discounting tasks in food-related research. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Instrument Implementation of Two-tier Multiple Choice to Analyze Students’ Science Process Skill Profile

Directory of Open Access Journals (Sweden)

Sukarmin Sukarmin

2018-01-01

Full Text Available This research is aimed to analyze the profile of students’ science process skill (SPS by using instrument two-tier multiple choice. This is a descriptive research that describes the profile of students’ SPS. Subjects of the research were 10th-grade students from high, medium and low categorized school. Instrument two-tier multiple choice consists of 30 question that contains an indicator of SPS. The indicator of SPS namely formulating a hypothesis, designing experiment, analyzing data, applying the concept, communicating, making a conclusion. Based on the result of the research and analysis, it shows that: 1 the average of indicator achievement of science process skill at high categorized school on formulating hypothesis is 74,55%, designing experiment is 74,89%, analyzing data is 67,89%, applying concept is 52,89%, communicating is 80,22%, making conclusion is 76%, 2. the average of indicator achievement of science process skill at medium categorized school on formulating hypothesis is 53,47%, designing experiment is 59,86%, analyzing data is 42,22%, applying concept is 33,19%, communicating is 76,25%, making conclusion is 61,53%, 3 the average of indicator achievement of science process skill at low categorized school on formulating hypothesis is 51%, designing experiment is 55,17%, analyzing data is 39,17%, applying concept is 35,83%, communicating is 58,83%, making conclusion is 58%.

Audiovisual preconditioning enhances the efficacy of an anatomical dissection course: A randomised study.

Science.gov (United States)

Collins, Anne M; Quinlan, Christine S; Dolan, Roisin T; O'Neill, Shane P; Tierney, Paul; Cronin, Kevin J; Ridgway, Paul F

2015-07-01

The benefits of incorporating audiovisual materials into learning are well recognised. The outcome of integrating such a modality in to anatomical education has not been reported previously. The aim of this randomised study was to determine whether audiovisual preconditioning is a useful adjunct to learning at an upper limb dissection course. Prior to instruction participants completed a standardised pre course multiple-choice questionnaire (MCQ). The intervention group was subsequently shown a video with a pre-recorded commentary. Following initial dissection, both groups completed a second MCQ. The final MCQ was completed at the conclusion of the course. Statistical analysis confirmed a significant improvement in the performance in both groups over the duration of the three MCQs. The intervention group significantly outperformed their control group counterparts immediately following audiovisual preconditioning and in the post course MCQ. Audiovisual preconditioning is a practical and effective tool that should be incorporated in to future course curricula to optimise learning. Level of evidence This study appraises an intervention in medical education. Kirkpatrick Level 2b (modification of knowledge). Copyright © 2015 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.

Calibrating the Medical Council of Canada’s Qualifying Examination Part I using an integrated item response theory framework: a comparison of models and designs

Directory of Open Access Journals (Sweden)

Andre F. De Champlain

2016-01-01

Full Text Available Purpose: The aim of this research was to compare different methods of calibrating multiple choice question (MCQ and clinical decision making (CDM components for the Medical Council of Canada’s Qualifying Examination Part I (MCCQEI based on item response theory. Methods: Our data consisted of test results from 8,213 first time applicants to MCCQEI in spring and fall 2010 and 2011 test administrations. The data set contained several thousand multiple choice items and several hundred CDM cases. Four dichotomous calibrations were run using BILOG-MG 3.0. All 3 mixed item format (dichotomous MCQ responses and polytomous CDM case scores calibrations were conducted using PARSCALE 4. Results: The 2-PL model had identical numbers of items with chi-square values at or below a Type I error rate of 0.01 (83/3,499 or 0.02. In all 3 polytomous models, whether the MCQs were either anchored or concurrently run with the CDM cases, results suggest very poor fit. All IRT abilities estimated from dichotomous calibration designs correlated very highly with each other. IRT-based pass-fail rates were extremely similar, not only across calibration designs and methods, but also with regard to the actual reported decision to candidates. The largest difference noted in pass rates was 4.78%, which occurred between the mixed format concurrent 2-PL graded response model (pass rate= 80.43% and the dichotomous anchored 1-PL calibrations (pass rate= 85.21%. Conclusion: Simpler calibration designs with dichotomized items should be implemented. The dichotomous calibrations provided better fit of the item response matrix than more complex, polytomous calibrations.

Chemistry and biology by new multiple choice

International Nuclear Information System (INIS)

Seo, Hyeong Seok; Kim, Seong Hwan

2003-02-01

This book is divided into two parts, the first part is about chemistry, which deals with science of material, atom structure and periodic law, chemical combination and power between molecule, state of material and solution, chemical reaction and an organic compound. The second part give description of biology with molecule and cell, energy in cells and chemical synthesis, molecular biology and heredity, function on animal, function on plant and evolution and ecology. This book has explanation of chemistry and biology with new multiple choice.

The detection of cheating in multiple choice examinations

Science.gov (United States)

Richmond, Peter; Roehner, Bertrand M.

2015-10-01

Cheating in examinations is acknowledged by an increasing number of organizations to be widespread. We examine two different approaches to assess their effectiveness at detecting anomalous results, suggestive of collusion, using data taken from a number of multiple-choice examinations organized by the UK Radio Communication Foundation. Analysis of student pair overlaps of correct answers is shown to give results consistent with more orthodox statistical correlations for which confidence limits as opposed to the less familiar "Bonferroni method" can be used. A simulation approach is also developed which confirms the interpretation of the empirical approach. Then the variables Xi =(1 -Ui) Yi +Ui Z are a system of symmetric dependent binary variables (0 , 1 ; p) whose correlation matrix is ρij = r. The proof is easy and given in the paper. Let us add two remarks. • We used the expression "symmetric variables" to reflect the fact that all Xi play the same role. The expression "exchangeable variables" is often used with the same meaning. • The correlation matrix has only positive elements. This is of course imposed by the symmetry condition. ρ12 0, thus violating the symmetry requirement. In the following subsections we will be concerned with the question of uniqueness of the set of Xi generated above. Needless to say, it is useful to know whether the proposition gives the answer or only one among many. More precisely, the problem can be stated as follows.

Semi-automated categorization of open-ended questions

Directory of Open Access Journals (Sweden)

Matthias Schonlau

2016-08-01

Full Text Available Text data from open-ended questions in surveys are difficult to analyze and are frequently ignored. Yet open-ended questions are important because they do not constrain respondents’ answer choices. Where open-ended questions are necessary, sometimes multiple human coders hand-code answers into one of several categories. At the same time, computer scientists have made impressive advances in text mining that may allow automation of such coding. Automated algorithms do not achieve an overall accuracy high enough to entirely replace humans. We categorize open-ended questions soliciting narrative responses using text mining for easy-to-categorize answers and humans for the remainder using expected accuracies to guide the choice of the threshold delineating between “easy” and “hard”. Employing multinomial boosting avoids the common practice of converting machine learning “confidence scores” into pseudo-probabilities. This approach is illustrated with examples from open-ended questions related to respondents’ advice to a patient in a hypothetical dilemma, a follow-up probe related to respondents’ perception of disclosure/privacy risk, and from a question on reasons for quitting smoking from a follow-up survey from the Ontario Smoker’s Helpline. Targeting 80% combined accuracy, we found that 54%-80% of the data could be categorized automatically in research surveys.

Use of Constructed-Response Questions to Support Learning of Cell Biology during Lectures

Directory of Open Access Journals (Sweden)

Foong May Yeong

2015-02-01

Full Text Available The use of class-response systems such as the Clickers to promote active-learning during lectures has been wide-spread. However, the often-used MCQ format in class activities as well as in assessments for large classes might lower students’ expectations and attitudes towards learning. Here, I describe my experience converting MCQs to constructed-response questions for in-class learning activities by removing cues from the MCQs. From the responses submitted, students seemed capable of providing answers without the need for cues. Using class-response systems such as Socrative for such constructed-response questions could be useful to challenge students to express their ideas in their own words. Moreover, by constructing their own answers, mis-conceptions could be revealed and corrected in a timely manner.

The development and validation of a two-tiered multiple-choice instrument to identify alternative conceptions in earth science

Science.gov (United States)

Mangione, Katherine Anna

This study was to determine reliability and validity for a two-tiered, multiple- choice instrument designed to identify alternative conceptions in earth science. Additionally, this study sought to identify alternative conceptions in earth science held by preservice teachers, to investigate relationships between self-reported confidence scores and understanding of earth science concepts, and to describe relationships between content knowledge and alternative conceptions and planning instruction in the science classroom. Eighty-seven preservice teachers enrolled in the MAT program participated in this study. Sixty-eight participants were female, twelve were male, and seven chose not to answer. Forty-seven participants were in the elementary certification program, five were in the middle school certification program, and twenty-nine were pursuing secondary certification. Results indicate that the two-tiered, multiple-choice format can be a reliable and valid method for identifying alternative conceptions. Preservice teachers in all certification areas who participated in this study may possess common alternative conceptions previously identified in the literature. Alternative conceptions included: all rivers flow north to south, the shadow of the Earth covers the Moon causing lunar phases, the Sun is always directly overhead at noon, weather can be predicted by animal coverings, and seasons are caused by the Earth's proximity to the Sun. Statistical analyses indicated differences, however not all of them significant, among all subgroups according to gender and certification area. Generally males outperformed females and preservice teachers pursuing middle school certification had higher scores on the questionnaire followed by those obtaining secondary certification. Elementary preservice teachers scored the lowest. Additionally, self-reported scores of confidence in one's answers and understanding of the earth science concept in question were analyzed. There was a

Effects of basic clinical skills training on objective structured clinical examination performance.

Science.gov (United States)

Jünger, Jana; Schäfer, Sybille; Roth, Christiane; Schellberg, Dieter; Friedman Ben-David, Miriam; Nikendei, Christoph

2005-10-01

The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.

Comparison of Two Different Curricula in Psychiatry Clerkship at Tehran University of Medical Sciences

Directory of Open Access Journals (Sweden)

S. Ali Ahmadi-Abhari

2013-09-01

Full Text Available Objectives: The aim of this study was to evaluate the efficacy of a new psychiatry clerkship curriculum which was designed to improve the knowledge and skills of medical students of Tehran University of Medical Sciences (TUMS, Iran.Methods:This quasi-experimental study was conducted in two consecutive semesters from February 2009 to January 2010. In total, 167 medical students participated in the study. In the first semester, as the control group, the clerks’ training was based on the traditional curriculum. In the next semester, we constructed and applied a new curriculum based on the SPICES model (student-centered, problem-based, integrated, community-based, elective and systematic.At the end of the clerkship, the students were given two exams: Multiple Choice Questions (MCQ to assess their knowledge, and Objective Structured Clinical Examination (OSCE to assess their skills. Baseline data and test performance for each student were analyzed. Results:Compared to the control group, students in the intervention group showed significantly higher OSCE scores (P= 0.01. With respect to MCQ score, no significant difference was found between the two groups.Conclusions:The results suggest that the revised curriculum is more effective than the traditional one in improving the required clinical skills in medical students during their psychiatry clerkship.

Mobile telecommunication networks choice among Ghanaians

Directory of Open Access Journals (Sweden)

Boateng Henry

2013-07-01

Full Text Available The paper investigates the factors influencing customers choice of telecommunication network in Ghana. The survey design was employed to enable the researchers perform statistical analysis. Questionnaire consisting of Likert scale question was used to collect the primary data. Multiple regression analysis was performed to ascertain the factors influencing customers’ choice of telecommunication networks. The study found six factors that influence customers to choose a particular network. These factors include; brand awareness, brand image, perceived quality, price, convenience and brand loyalty. The study concludes that all the six factors contribute to the factors that drive consumer choice of telecommunications service in Ghana.

Classroom Voting Questions to Stimulate Discussions in Precalculus

Science.gov (United States)

Cline, Kelly; Zullo, Holly; Huckaby, David A.; Storm, Christopher; Stewart, Ann

2018-01-01

Classroom voting can be an effective way to stimulate student discussions. In this pedagogy, the instructor poses a multiple-choice question to the class, and then allows a few minutes for consideration and small-group discussion before students vote, either with clickers, cell phones, or a non-electronic method. After the vote the instructor…

Using Module Analysis for Multiple Choice Responses: A New Method Applied to Force Concept Inventory Data

Science.gov (United States)

Brewe, Eric; Bruun, Jesper; Bearden, Ian G.

2016-01-01

We describe "Module Analysis for Multiple Choice Responses" (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual…

Development and validation of a theoretical test in non-anaesthesiologist-administered propofol sedation for gastrointestinal endoscopy

DEFF Research Database (Denmark)

Jensen, Jeppe Thue; Savran, Mona Meral; Møller, Ann Merete

2016-01-01

OBJECTIVE: Safety with non-anaesthesiologist-administered propofol sedation (NAAP) during gastrointestinal (GI) endoscopy is related to theoretical knowledge. A summative testing of knowledge before attempting supervised nurse-administered propofol sedation (NAPS) in the clinic is advised. The aims...... of this study were to develop a theoretical test about propofol sedation, to gather validity evidence for the test and to measure the effect of a NAPS-specific training course. MATERIAL AND METHODS: A three-phased psychometric study on multiple choice questionnaire (MCQ) test development, gathering of validity......% increase; p = 0.001 and 0.001, respectively). CONCLUSIONS: Data supported the validity of the developed MCQ test. The NAPS-specific course with pre-course testing adds theoretical knowledge to already well-prepared participants....

Using the Multiple Choice Procedure to Measure College Student Gambling

Science.gov (United States)

Butler, Leon Harvey

2010-01-01

Research suggests that gambling is similar to addictive behaviors such as substance use. In the current study, gambling was investigated from a behavioral economics perspective. The Multiple Choice Procedure (MCP) with gambling as the target behavior was used to assess for relative reinforcing value, the effect of alternative reinforcers, and…

A One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation

NARCIS (Netherlands)

AlFaris, E.; Naeem, N; Irfan, F.; Qureshi, R.; Saad, H.; Sadhan, R. Al; Abdulghani, H.M.; Vleuten, C. van der

2015-01-01

Long training workshops on the writing of exam questions have been shown to be effective; however, the effectiveness of short workshops needs to be demonstrated. The aim of this study was to evaluate the impact of a one-day, seven-hour faculty development workshop at the College of Dentistry, King

FormScanner: Open-Source Solution for Grading Multiple-Choice Exams

Science.gov (United States)

Young, Chadwick; Lo, Glenn; Young, Kaisa; Borsetta, Alberto

2016-01-01

The multiple-choice exam remains a staple for many introductory physics courses. In the past, people have graded these by hand or even flaming needles. Today, one usually grades the exams with a form scanner that utilizes optical mark recognition (OMR). Several companies provide these scanners and particular forms, such as the eponymous…

Multiple relationships: does the new ethics code answer the right questions?

Science.gov (United States)

Sonne, J L

1994-11-01

The new "Ethical Principles of Psychologists and Code of Conduct" (American Psychological Association, 1992) presented expanded attempts to clarify the ethical issues regarding multiple relationships and to provide useful guidance for psychologists. This article proposes that the new code fails to address adequately two basic questions necessary to provide psychologists with clear guidance: (a) What are multiple relationships? and (b) When do multiple relationships constitute unethical conduct? The article offers a definition of multiple relationships and identifies several dynamics operating within a professional relationship that are likely to be adversely affected by the imposition of a secondary relationship. Unethical multiple relationships are defined. Finally, the article suggests additions to the new code that would enhance its utility for psychologists.

Fostering dental student self-assessment of knowledge by confidence scoring of multiple-choice examinations.

Science.gov (United States)

McMahan, C Alex; Pinckard, R Neal; Jones, Anne Cale; Hendricson, William D

2014-12-01

Creating a learning environment that fosters student acquisition of self-assessment behaviors and skills is critically important in the education and training of health professionals. Self-assessment is a vital component of competent practice and lifelong learning. This article proposes applying a version of confidence scoring of multiple-choice questions as one avenue to address this crucial educational objective for students to be able to recognize and admit what they do not know. The confidence scoring algorithm assigns one point for a correct answer, deducts fractional points for an incorrect answer, but rewards students fractional points for leaving the question unanswered in admission that they are unsure of the correct answer. The magnitude of the reward relative to the deduction is selected such that the expected gain due to random guessing, even after elimination of all but one distractor, is never greater than the reward. Curricular implementation of this confidence scoring algorithm should motivate health professions students to develop self-assessment behaviors and enable them to acquire the skills necessary to critically evaluate the extent of their current knowledge throughout their professional careers. This is a professional development competency that is emphasized in the educational standards of the Commission on Dental Accreditation (CODA).

Effectiveness of an audience response system on orthodontic knowledge retention of undergraduate dental students--a randomised control trial.

Science.gov (United States)

Robson, Nicholas; Popat, Hashmat; Richmond, Stephen; Farnell, Damian J J

2015-01-01

To determine the effect of an audience response system (ARS) on knowledge retention of dental students and to gauge student perceptions of using the ARS. Randomised control study. School of Dentistry, Cardiff University. Seventy four second-year dental students were stratified by gender and randomised anonymously to one of two groups. One group received a lecture on orthodontic terminology and diagnosis in a traditional didactic format and the other received the same lecture integrated with ARS slides. Students completed an assessment of multiple-choice questions (MCQs) scored out of 20, before and immediately after the lecture. Students were also asked to complete a self-reported questionnaire on their perceptions of ARS. Both groups had statistically significant increases in MCQ scores post-lecture (ARS mean increase 3.6 SD2.0, 95% CI 2.2-3.5 and Didactic mean increase 2.9 SD2.3, 95% CI 2.8-4.3). A mixed-design analysis of variance showed that ARS led to an improved MCQ score (by 0.8 or 25%) compared to the didactic group, although this effect was not significant (P = 0.15). The effect of gender at baseline (P = 0.49), post-lecture (P = 0.73) and increase in MCQ score split by group (P = 0.46) was also not significant. Students reported that the ARS was easy to use, helped them engage with the lecture and encouraged them to work harder. The ARS did not lead to a significant increase in short-term orthodontic knowledge recall of students compared with didactic teaching. However, the use of ARS within orthodontic teaching could make lectures more interactive and engaging.

Differences in gender performance on competitive physics selection tests

Directory of Open Access Journals (Sweden)

Kate Wilson

2016-08-01

Full Text Available [This paper is part of the Focused Collection on Gender in Physics.] We have investigated gender differences in performance over the past eight years on the Australian Science Olympiad Exam (ASOE for physics, which is taken by nearly 1000 high school students each year. The ASOE, run by Australian Science Innovations (ASI, is the initial stage of the process of selection of teams to represent Australia at the Asian and International Physics Olympiads. Students taking the exam are generally in their penultimate year of school and selected by teachers as being high performing in physics. Together with the overall differences in facility, we have investigated how the content and presentation of multiple-choice questions (MCQs affects the particular answers selected by male and female students. Differences in the patterns of responses by male and female students indicate that males and females might be modeling situations in different ways. Some strong patterns were found in the gender gaps when the questions were categorized in five broad dimensions: content, process required, difficulty, presentation, and context. Almost all questions saw male students performing better, although gender differences were relatively small for questions with a more abstract context. Male students performed significantly better on most questions with a concrete context, although notable exceptions were found, including two such questions where female students performed better. Other categories that showed consistently large gaps favoring male students include questions with projectile motion and other two-dimensional motion or forces content, and processes involving interpreting diagrams. Our results have important implications, suggesting that we should be able to reduce the gender gaps in performance on MCQ tests by changing the way information is presented and setting questions in contexts that are less likely to favor males over females. This is important as MCQ

Item difficulty of multiple choice tests dependant on different item response formats – An experiment in fundamental research on psychological assessment

Directory of Open Access Journals (Sweden)

KLAUS D. KUBINGER

2007-12-01

Full Text Available Multiple choice response formats are problematical as an item is often scored as solved simply because the test-taker is a lucky guesser. Instead of applying pertinent IRT models which take guessing effects into account, a pragmatic approach of re-conceptualizing multiple choice response formats to reduce the chance of lucky guessing is considered. This paper compares the free response format with two different multiple choice formats. A common multiple choice format with a single correct response option and five distractors (“1 of 6” is used, as well as a multiple choice format with five response options, of which any number of the five is correct and the item is only scored as mastered if all the correct response options and none of the wrong ones are marked (“x of 5”. An experiment was designed, using pairs of items with exactly the same content but different response formats. 173 test-takers were randomly assigned to two test booklets of 150 items altogether. Rasch model analyses adduced a fitting item pool, after the deletion of 39 items. The resulting item difficulty parameters were used for the comparison of the different formats. The multiple choice format “1 of 6” differs significantly from “x of 5”, with a relative effect of 1.63, while the multiple choice format “x of 5” does not significantly differ from the free response format. Therefore, the lower degree of difficulty of items with the “1 of 6” multiple choice format is an indicator of relevant guessing effects. In contrast the “x of 5” multiple choice format can be seen as an appropriate substitute for free response format.

Formative student-authored question bank: perceptions, question quality and association with summative performance.

Science.gov (United States)

Walsh, Jason L; Harris, Benjamin H L; Denny, Paul; Smith, Phil

2018-02-01

There are few studies on the value of authoring questions as a study method, the quality of the questions produced by students and student perceptions of student-authored question banks. Here we evaluate PeerWise, a widely used and free online resource that allows students to author, answer and discuss multiple-choice questions. We introduced two undergraduate medical student cohorts to PeerWise (n=603). We looked at their patterns of PeerWise usage; identified associations between student engagement and summative exam performance; and used focus groups to assess student perceptions of the value of PeerWise for learning. We undertook item analysis to assess question difficulty and quality. Over two academic years, the two cohorts wrote 4671 questions, answered questions 606 658 times and posted 7735 comments. Question writing frequency correlated most strongly with summative performance (Spearman's rank: 0.24, p=<0.001). Student focus groups found that: (1) students valued curriculum specificity; and (2) students were concerned about student-authored question quality. Only two questions of the 300 'most-answered' questions analysed had an unacceptable discriminatory value (point-biserial correlation <0.2). Item analysis suggested acceptable question quality despite student concerns. Quantitative and qualitative methods indicated that PeerWise is a valuable study tool. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Standard setting: comparison of two methods.

Science.gov (United States)

George, Sanju; Haque, M Sayeed; Oyebode, Femi

2006-09-14

The outcome of assessments is determined by the standard-setting method used. There is a wide range of standard-setting methods and the two used most extensively in undergraduate medical education in the UK are the norm-reference and the criterion-reference methods. The aims of the study were to compare these two standard-setting methods for a multiple-choice question examination and to estimate the test-retest and inter-rater reliability of the modified Angoff method. The norm-reference method of standard-setting (mean minus 1 SD) was applied to the 'raw' scores of 78 4th-year medical students on a multiple-choice examination (MCQ). Two panels of raters also set the standard using the modified Angoff method for the same multiple-choice question paper on two occasions (6 months apart). We compared the pass/fail rates derived from the norm reference and the Angoff methods and also assessed the test-retest and inter-rater reliability of the modified Angoff method. The pass rate with the norm-reference method was 85% (66/78) and that by the Angoff method was 100% (78 out of 78). The percentage agreement between Angoff method and norm-reference was 78% (95% CI 69% - 87%). The modified Angoff method had an inter-rater reliability of 0.81-0.82 and a test-retest reliability of 0.59-0.74. There were significant differences in the outcomes of these two standard-setting methods, as shown by the difference in the proportion of candidates that passed and failed the assessment. The modified Angoff method was found to have good inter-rater reliability and moderate test-retest reliability.

Impression formation of tests: retrospective judgments of performance are higher when easier questions come first.

Science.gov (United States)

Jackson, Abigail; Greene, Robert L

2014-11-01

Four experiments are reported on the importance of retrospective judgments of performance (postdictions) on tests. Participants answered general knowledge questions and estimated how many questions they answered correctly. They gave higher postdictions when easy questions preceded difficult questions. This was true when time to answer each question was equalized and constrained, when participants were instructed not to write answers, and when questions were presented in a multiple-choice format. Results are consistent with the notion that first impressions predominate in overall perception of test difficulty.

Examining the Prediction of Reading Comprehension on Different Multiple-Choice Tests

Science.gov (United States)

Andreassen, Rune; Braten, Ivar

2010-01-01

In this study, 180 Norwegian fifth-grade students with a mean age of 10.5 years were administered measures of word recognition skills, strategic text processing, reading motivation and working memory. Six months later, the same students were given three different multiple-choice reading comprehension measures. Based on three forced-order…

Part I. Analyzing the distribution of gas law questions in chemistry textbooks. Part II. Chlorine-35 NQR spectra of group 1 and silver dichloromethanesulfonates

Science.gov (United States)

Gillette, Gabriel

Part I. Two studies involving the gas law questions in eight high school and Advanced Placement/college chemistry textbooks were performed using loglinear analysis to look for associations among six variables. These variables included Bloom's Taxonomy (higher-order, lower-order), Book Type (high school, college), Question Format (multiple-choice, problem, short answer), Question Placement (in-chapter, end-of-chapter, test bank), Representation (macroscopic, microscopic, symbolic), and Arkansas Science Standard (conceptual, mathematical; gas laws, pressure conversion, stoichiometry). The first study, involving the conceptual gas law questions, found the Book Type and Question Placement variables had the biggest impact, each appearing in 5 of the 11 significant associations. The second study, involving the mathematical gas law questions, found the Question Placement had the biggest impact, appearing in 7 of the 11 significant associations, followed by Book Type and the Arkansas Science Standard variables, which appeared in 5 of the 11 significant associations. These studies showed that compared to the high school books, college books have fewer multiple-choice questions (compared to short-answer and problem questions), fewer in-chapter questions (compared to end-of-chapter and test bank questions), fewer questions in the chapters and more questions at the end of the chapters and fewer multiple-choice questions in and at the end of the books and more multiple-choice questions in the test banks. Part II. The dichloromethanesulfonate salts of several +1 charged cations, M+Cl2CHSO3 - (M = Li, Na, K, Rb Ag, Cs Tl) were synthesized and studied by 35Cl nuclear quadrupole resonance (NQR). Dichloromethanesulfonic acid was prepared by the methanolysis of dichloromethanesulfonyl chloride, which was neutralized with the metal carbonates to produce the corresponding metal dichloromethanesulfonate salts. This study completed the NQR investigation of the family of chloroacetates

How do STEM-interested students pursue multiple interests in their higher educational choice?

Science.gov (United States)

Vulperhorst, Jonne Pieter; Wessels, Koen Rens; Bakker, Arthur; Akkerman, Sanne Floor

2018-05-01

Interest in science, technology, engineering and mathematics (STEM) has lately received attention in research due to a gap between the number of STEM students and the needs of the labour market. As interest seems to be one of the most important factors in deciding what to study, we focus in the present study on how STEM-interested students weigh multiple interests in making educational choices. A questionnaire with both open-ended and closed-ended items was administered to 91 STEM-interested students enrolled in a STEM programme of a Dutch University for secondary school students. Results indicate that students find it important that a study programme allows them to pursue multiple interests. Some students pursued multiple interests by choosing to enrol in two programmes at the same time. Most students chose one programme that enabled them to combine multiple interests. Combinations of pursued interests were dependent on the disciplinary range of interests of students. Students who were interested in diverse domains combined interests in an educational programme across academic and non-academic domains, whilst students who were mainly interested in STEM combined only STEM-focused interests. Together these findings stress the importance of taking a multiple interest perspective on interest development and educational choice.

The effectiveness of ERC advanced life support (ALS) provider courses for the retention of ALS knowledge.

Science.gov (United States)

Fischer, Henrik; Strunk, Guido; Neuhold, Stephanie; Kiblböck, Daniel; Trimmel, Helmut; Baubin, Michael; Domanovits, Hans; Maurer, Claudia; Greif, Robert

2012-02-01

Out-of-hospital emergency physicians in Austria need mandatory emergency physician training, followed by biennial refresher courses. Currently, both standardized ERC advanced life support (ALS) provider courses and conventional refresher courses are offered. This study aimed to compare the retention of ALS-knowledge of out-of-hospital emergency physicians depending on whether they had or had not participated in an ERC-ALS provider course since 2005. Participants (n=807) from 19 refresher courses for out-of-hospital emergency physicians answered eight multiple-choice questions (MCQ) about ALS based on the 2005 ERC guidelines. The pass score was 75% correct answers. A multivariate logistic regression analyzed differences in passing scores between those who had previously participated in an ERC-ALS provider course and those who had not. Age, gender, regularity of working as an out-of-hospital emergency physician and the self-reported number of real resuscitation efforts within the last 6months were entered as control variables. Out-of-hospital emergency physicians who had previously attended an ERC-ALS provider course had a significantly higher chance of passing the MCQ test (OR=1.60, p=0.015). Younger age (OR=0.95, pERC-ALS provider course since 2005 had a higher retention of ALS knowledge compared to non-ERC-ALS course participants. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Multiple Choice Knapsack Problem: example of planning choice in transportation.

Science.gov (United States)

Zhong, Tao; Young, Rhonda

2010-05-01

Transportation programming, a process of selecting projects for funding given budget and other constraints, is becoming more complex as a result of new federal laws, local planning regulations, and increased public involvement. This article describes the use of an integer programming tool, Multiple Choice Knapsack Problem (MCKP), to provide optimal solutions to transportation programming problems in cases where alternative versions of projects are under consideration. In this paper, optimization methods for use in the transportation programming process are compared and then the process of building and solving the optimization problems is discussed. The concepts about the use of MCKP are presented and a real-world transportation programming example at various budget levels is provided. This article illustrates how the use of MCKP addresses the modern complexities and provides timely solutions in transportation programming practice. While the article uses transportation programming as a case study, MCKP can be useful in other fields where a similar decision among a subset of the alternatives is required. Copyright 2009 Elsevier Ltd. All rights reserved.

The Inclusion of Science Process Skills in Multiple Choice Questions: Are We Getting Any Better?

Science.gov (United States)

Elmas, Ridvan; Bodner, George M.; Aydogdu, Bulent; Saban, Yakup

2018-01-01

The goal of this study was to analyze the science and technology questions with respect to science process skills (SPS) included in the "Transition from Primary to Secondary Education" (TEOG) examination developed for use with 8th-grade students in Turkey. The 12 TEOG exams administered in the course of three academic years from 2014…

An intuitive graphical webserver for multiple-choice protein sequence search.

Science.gov (United States)

Banky, Daniel; Szalkai, Balazs; Grolmusz, Vince

2014-04-10

Every day tens of thousands of sequence searches and sequence alignment queries are submitted to webservers. The capitalized word "BLAST" becomes a verb, describing the act of performing sequence search and alignment. However, if one needs to search for sequences that contain, for example, two hydrophobic and three polar residues at five given positions, the query formation on the most frequently used webservers will be difficult. Some servers support the formation of queries with regular expressions, but most of the users are unfamiliar with their syntax. Here we present an intuitive, easily applicable webserver, the Protein Sequence Analysis server, that allows the formation of multiple choice queries by simply drawing the residues to their positions; if more than one residue are drawn to the same position, then they will be nicely stacked on the user interface, indicating the multiple choice at the given position. This computer-game-like interface is natural and intuitive, and the coloring of the residues makes possible to form queries requiring not just certain amino acids in the given positions, but also small nonpolar, negatively charged, hydrophobic, positively charged, or polar ones. The webserver is available at http://psa.pitgroup.org. Copyright © 2014 Elsevier B.V. All rights reserved.

Feedback-related brain activity predicts learning from feedback in multiple-choice testing.

Science.gov (United States)

Ernst, Benjamin; Steinhauser, Marco

2012-06-01

Different event-related potentials (ERPs) have been shown to correlate with learning from feedback in decision-making tasks and with learning in explicit memory tasks. In the present study, we investigated which ERPs predict learning from corrective feedback in a multiple-choice test, which combines elements from both paradigms. Participants worked through sets of multiple-choice items of a Swahili-German vocabulary task. Whereas the initial presentation of an item required the participants to guess the answer, corrective feedback could be used to learn the correct response. Initial analyses revealed that corrective feedback elicited components related to reinforcement learning (FRN), as well as to explicit memory processing (P300) and attention (early frontal positivity). However, only the P300 and early frontal positivity were positively correlated with successful learning from corrective feedback, whereas the FRN was even larger when learning failed. These results suggest that learning from corrective feedback crucially relies on explicit memory processing and attentional orienting to corrective feedback, rather than on reinforcement learning.

Providing Transthoracic Echocardiography Training for Intensive Care Unit Trainees: An Educational Improvement Initiative.

Science.gov (United States)

Kuza, Catherine M; Hanifi, M Tariq; Koç, Melissa; Stopfkuchen-Evans, Matthias

2018-04-09

Transthoracic echocardiography (TTE) is important in the management of critically ill patients, yet it has not been incorporated into many residency programs' curricula. Our objective is to determine if trainees undergoing a 60-minute training session on TTE have improved knowledge, ultrasound skills, and increases the utilization of TTE during their rotation in the intensive care unit (ICU). We will also compare the results of participants with prior TTE exposure to TTE-naïve trainees. Our hypothesis is that after the training, participants' will have improved knowledge and ultrasound skills compared to before training. Our secondary hypotheses are that TTE-naïve trainees will have greater improvements in knowledge scores compared to those who have had prior TTE experience and trainees will increase their use of TTE in the ICU. Single-center, prospective trial. Brigham and Women's Hospital (academic hospital). Residents and fellows rotating through the ICU, at any level of postgraduate training. Forty-two trainees participated in the study. Statistically significant improvement after training was observed for all multiple choice questions (MCQ) and practical assessments (p < 0.001). When assessing the differences in score improvement between TTE-experienced versus TTE-naïve users, mean score improvements were notably higher for TTE-naïve participants (MCQ: 28.2 ± 11.6; echo clinical: 48.6 ± 23.4) compared to TTE-experienced users (MCQ: 18.6 ± 13.5, p = 0.01; echo clinical: 38.3 ± 30.2, p = 0.04). A short didactic presentation on TTE use may be useful in teaching ICU trainees basic TTE skills and encouraging the use of bedside TTE in the ICU. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Multidisciplinary Difficult Airway Course: An Essential Educational Component of a Hospital-Wide Difficult Airway Response Program.

Science.gov (United States)

Leeper, W Robert; Haut, Elliott R; Pandian, Vinciya; Nakka, Sajan; Dodd-O, Jeffrey; Bhatti, Nasir; Hunt, Elizabeth A; Saheed, Mustapha; Dalesio, Nicholas; Schiavi, Adam; Miller, Christina; Kirsch, Thomas D; Berkow, Lauren

2018-04-05

A hospital-wide difficult airway response team was developed in 2008 at The Johns Hopkins Hospital with three central pillars: operations, safety monitoring, and education. The objective of this study was to assess the outcomes of the educational pillar of the difficult airway response team program, known as the multidisciplinary difficult airway course (MDAC). The comprehensive, full-day MDAC involves trainees and staff from all provider groups who participate in airway management. The MDAC occurs within the Johns Hopkins Medicine Simulation Center approximately four times per year and uses a combination of didactic lectures, hands-on sessions, and high-fidelity simulation training. Participation in MDAC is the main intervention being investigated in this study. Data were collected prospectively using course evaluation survey with quantitative and qualitative components, and prepost course knowledge assessment multiple choice questions (MCQ). Outcomes include course evaluation scores and themes derived from qualitative assessments, and prepost course knowledge assessment MCQ scores. Tertiary care academic hospital center PARTICIPANTS: Students, residents, fellows, and practicing physicians from the departments of Surgery, Otolaryngology Head and Neck Surgery, Anesthesiology/Critical Care Medicine, and Emergency Medicine; advanced practice providers (nurse practitioners and physician assistants), nurse anesthetists, nurses, and respiratory therapists. Totally, 23 MDACs have been conducted, including 499 participants. Course evaluations were uniformly positive with mean score of 86.9 of 95 points. Qualitative responses suggest major value from high-fidelity simulation, the hands-on skill stations, and teamwork practice. MCQ scores demonstrated significant improvement: median (interquartile range) pre: 69% (60%-81%) vs post: 81% (72%-89%), p < 0.001. Implementation of a MDAC successfully disseminated principles and protocols to all airway providers. Demonstrable

Visual Attention for Solving Multiple-Choice Science Problem: An Eye-Tracking Analysis

Science.gov (United States)

Tsai, Meng-Jung; Hou, Huei-Tse; Lai, Meng-Lung; Liu, Wan-Yi; Yang, Fang-Ying

2012-01-01

This study employed an eye-tracking technique to examine students' visual attention when solving a multiple-choice science problem. Six university students participated in a problem-solving task to predict occurrences of landslide hazards from four images representing four combinations of four factors. Participants' responses and visual attention…

Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed to Discourage Guessing

Science.gov (United States)

Campbell, Mark L.

2015-01-01

Multiple-choice exams, while widely used, are necessarily imprecise due to the contribution of the final student score due to guessing. This past year at the United States Naval Academy the construction and grading scheme for the department-wide general chemistry multiple-choice exams were revised with the goal of decreasing the contribution of…

Standard setting: Comparison of two methods

Directory of Open Access Journals (Sweden)

Oyebode Femi

2006-09-01

Full Text Available Abstract Background The outcome of assessments is determined by the standard-setting method used. There is a wide range of standard – setting methods and the two used most extensively in undergraduate medical education in the UK are the norm-reference and the criterion-reference methods. The aims of the study were to compare these two standard-setting methods for a multiple-choice question examination and to estimate the test-retest and inter-rater reliability of the modified Angoff method. Methods The norm – reference method of standard -setting (mean minus 1 SD was applied to the 'raw' scores of 78 4th-year medical students on a multiple-choice examination (MCQ. Two panels of raters also set the standard using the modified Angoff method for the same multiple-choice question paper on two occasions (6 months apart. We compared the pass/fail rates derived from the norm reference and the Angoff methods and also assessed the test-retest and inter-rater reliability of the modified Angoff method. Results The pass rate with the norm-reference method was 85% (66/78 and that by the Angoff method was 100% (78 out of 78. The percentage agreement between Angoff method and norm-reference was 78% (95% CI 69% – 87%. The modified Angoff method had an inter-rater reliability of 0.81 – 0.82 and a test-retest reliability of 0.59–0.74. Conclusion There were significant differences in the outcomes of these two standard-setting methods, as shown by the difference in the proportion of candidates that passed and failed the assessment. The modified Angoff method was found to have good inter-rater reliability and moderate test-retest reliability.

Social attribution test--multiple choice (SAT-MC) in schizophrenia: comparison with community sample and relationship to neurocognitive, social cognitive and symptom measures.

Science.gov (United States)

Bell, Morris D; Fiszdon, Joanna M; Greig, Tamasine C; Wexler, Bruce E

2010-09-01

This is the first report on the use of the Social Attribution Task - Multiple Choice (SAT-MC) to assess social cognitive impairments in schizophrenia. The SAT-MC was originally developed for autism research, and consists of a 64-second animation showing geometric figures enacting a social drama, with 19 multiple choice questions about the interactions. Responses from 85 community-dwelling participants and 66 participants with SCID confirmed schizophrenia or schizoaffective disorders (Scz) revealed highly significant group differences. When the two samples were combined, SAT-MC scores were significantly correlated with other social cognitive measures, including measures of affect recognition, theory of mind, self-report of egocentricity and the Social Cognition Index from the MATRICS battery. Using a cut-off score, 53% of Scz were significantly impaired on SAT-MC compared with 9% of the community sample. Most Scz participants with impairment on SAT-MC also had impairment on affect recognition. Significant correlations were also found with neurocognitive measures but with less dependence on verbal processes than other social cognitive measures. Logistic regression using SAT-MC scores correctly classified 75% of both samples. Results suggest that this measure may have promise, but alternative versions will be needed before it can be used in pre-post or longitudinal designs. (c) 2009 Elsevier B.V. All rights reserved.

USE OF MULTIPLE RESPONSE QUESTIONS (MRQS DURING LECTURE SESSIONS AS A TOOL TO ENHANCE LEARNING

Directory of Open Access Journals (Sweden)

Rosh

2015-12-01

Full Text Available INTRODUCTION Lecture classes are time tested solid method of teaching and have lot of advantages and few disadvantages. The main drawback is its unidirectional monotonous nature and many a time students fail to concentrate and understand especially when the sessions are long, and from the students’ point of view, many are boring too. Lecture sessions are still continued because of its various advantages. There are many methods tried to improve efficacy and effectiveness of lecture sessions including reinforcement, questions and discussions. There are many studies incorporating multiple choice questions (MCQs in lecture sessions for this purpose, with positive results. These sessions evoke creative thinking and enhance learning. For this purpose MCQs are to be prepared with care considering the areas to be covered. In order to make lecture classes more impressive, interesting and effective, we tried introducing a short multiple response session in between, along with some rewards for correct responses in terms of study materials. AIMS AND OBJECTIVES To study the impact of incorporation of MRQs during theory sessions to enhance the efficacy of teaching- learning process MATERIAL AND METHODS Study was conducted in a private medical college in Calicut. We surveyed 169 MBBS students initially with questionnaire covering various aspects of a lecture classes in general. For the next 6 months we incorporated MRQs in routine theory classes. Survey was then conducted again on the same group using same questionnaire and the results were compared. Scores were given according to performance, a maximum of 5 per question. RESULTS After 6 months the data showed substantial improvement in the understanding pattern of students. The average score regarding the usefulness increased from 3.57 to 3.91. After the intervention a substantial number agreed that the sessions have become more interesting, the score changed from 2.99 to 3.87. This also increased the

Cytogenetic Alterations in Multiple Myeloma: Prognostic Significance and the Choice of Frontline Therapy.

Science.gov (United States)

Stella, Flavia; Pedrazzini, Estela; Agazzoni, Mara; Ballester, Oscar; Slavutsky, Irma

2015-01-01

Multiple myeloma tumor cells demonstrate multiple and often complex genetic lesions as evaluated by standard cytogenetic/FISH studies. Over the past decade, specific abnormalities have been associated with standard or high-risk clinical behavior and they have become strong prognostic indicators. Further, as evidenced by recent randomized clinical trials, the choice of front-line therapy (transplant vs. no transplant, inclusion of novel drugs such as bortezomib, thalidomide, and lenalidomide) may be able to overcome the adverse effect of high-risk genetic lesions.

Medical Students' vs. Family Physicians' Assessment of Practical and Logical Values of Pathophysiology Multiple-Choice Questions

Science.gov (United States)

Secic, Damir; Husremovic, Dzenana; Kapur, Eldan; Jatic, Zaim; Hadziahmetovic, Nina; Vojnikovic, Benjamin; Fajkic, Almir; Meholjic, Amir; Bradic, Lejla; Hadzic, Amila

2017-01-01

Testing strategies can either have a very positive or negative effect on the learning process. The aim of this study was to examine the degree of consistency in evaluating the practicality and logic of questions from a medical school pathophysiology test, between students and family medicine doctors. The study engaged 77 family medicine doctors…

Is Video Podcast Supplementation as a Learning Aid Beneficial to Dental Students?

Science.gov (United States)

Kalludi, Shivananda; Punja, Dhiren; Rao, Raghavendra; Dhar, Murali

2015-12-01

Podcasting has recently emerged as an important information technology tool for health professionals. Podcasts can be viewed online or downloaded to a user computer or a handheld multimedia device like a portable MP3 player, smart phone and tablet device. The principal advantage of the podcast is that the presentation of information need not be linked with any particular time or location. Since students are familiar with newer technology tools and may be using it on a regular basis, video podcast could serve as a convenient tool for students to help remember both conceptual and factual information. The purpose of this study was to assess the attitude of first year dental students towards video podcast supplementation and to assess the efficacy of video podcast as a teaching aid in comparison to text book reading. First year dental students were recruited for this study. A didactic lecture class was conducted for the students (n=100). The students were then randomly divided into two groups. Students present in group A (n=46) underwent a video podcast session followed by a multiple choice question test. This was followed by student feedback to assess the usefulness of video podcast. Students belonging to group B (n=54) had a study session for 20 minutes followed by the MCQ test. Students then underwent the video podcast session followed by feedback to assess the utility of video podcast. Mann-Whitney U test was applied to compare the difference in the median MCQ score between the two groups. The findings revealed a significant gain in the median MCQ score in the intervention group (group A) when compared to control group (Group B). In the feedback form, 89% of students agreed that the video podcast might be useful as it would enable them to view slides and hear the lectures repeatedly. Students who underwent the video podcast session performed significantly better in the MCQ test compared to students who underwent text book reading alone. This demonstrates an

Assessment of current undergraduate anesthesia course in a Saudi University.

Science.gov (United States)

Shams, Tarek; El-Masry, Ragaa; Al Wadani, Hamed; Amr, Mostafa

2013-04-01

The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5(th) year medical students in our university, as well as study the influence of gender on student performance in anesthesia. We examined the performance of 154, 5(th) year medical students through OSCE, portfolios, and MCQ. The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel.

Multiple-Choice versus Constructed-Response Tests in the Assessment of Mathematics Computation Skills.

Science.gov (United States)

Gadalla, Tahany M.

The equivalence of multiple-choice (MC) and constructed response (discrete) (CR-D) response formats as applied to mathematics computation at grade levels two to six was tested. The difference between total scores from the two response formats was tested for statistical significance, and the factor structure of items in both response formats was…

Clinical teachers' tacit knowledge of basic pedagogic principles.

Science.gov (United States)

McLeod, P J; Meagher, T; Steinert, Y; Schuwirth, L; McLeod, A H

2004-02-01

Academic faculty members in medical schools rarely receive formal instruction in basic pedagogic principles; nevertheless many develop into competent teachers. Perhaps they acquire tacit knowledge of these principles with teaching experience. This study was designed to assess clinical teachers' tacit knowledge of basic pedagogic principles and concepts. The authors developed a multiple-choice question (MCQ) exam based on 20 pedagogic principles judged by a panel of education experts to be important for clinical teaching. Three groups of clinician-educators sat the test: (1) clinicians with advanced education training and experience; (2) internal medicine specialists; (3) surgical specialists. All four groups of clinicians-educators passed the test, indicating that they possess a reasonable tacit knowledge of basic pedagogic principles. Those with advanced education training performed much better than members of the other two groups while specialists and residents working in teaching hospitals outperformed specialists from non-teaching hospitals. It is possible that converting this tacit knowledge to explicit knowledge may improve individual teaching effectiveness.

Efficient question answering with question decomposition and multiple answer streams

OpenAIRE

Hartrumpf, Sven; Glöckner, Ingo; Leveling, Johannes

2009-01-01

The German question answering (QA) system IRSAW (formerly: InSicht) participated in QA@CLEF for the fth time. IRSAW was introduced in 2007 by integrating the deep answer producer InSicht, several shallow answer producers, and a logical validator. InSicht builds on a deep QA approach: it transforms documents to semantic representations using a parser, draws inferences on semantic representations with rules, and matches semantic representations derived from questions and documents. InS...

Multiattribute Risky Choice Behavior: The Editing of Complex Prospects

OpenAIRE

John W. Payne; Dan J. Laughhunn; Roy Crum

1984-01-01

This investigation draws upon concepts from prospect theory (Kahneman and Tversky [Kahneman, D., A. Tversky. 1979. Prospect theory: an analysis of decisions under risk. Econometrica 47 263--291.]) and multiattribute utility theory (Keeney and Raiffa [Keeney, R. L., H. Raiffa. 1976. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. Wiley, New York.]) in an examination of the multiattribute risky choice behavior of 128 managers. The questions of how managers edit multiattribu...

Step by Step: Biology Undergraduates’ Problem-Solving Procedures during Multiple-Choice Assessment

Science.gov (United States)

Prevost, Luanna B.; Lemons, Paula P.

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. PMID:27909021

Benford's Law: textbook exercises and multiple-choice testbanks.

Science.gov (United States)

Slepkov, Aaron D; Ironside, Kevin B; DiBattista, David

2015-01-01

Benford's Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.

Benford's Law: textbook exercises and multiple-choice testbanks.

Directory of Open Access Journals (Sweden)

Aaron D Slepkov

Full Text Available Benford's Law describes the finding that the distribution of leading (or leftmost digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.

All of the above: When multiple correct response options enhance the testing effect.

Science.gov (United States)

Bishara, Anthony J; Lanzo, Lauren A

2015-01-01

Previous research has shown that multiple choice tests often improve memory retention. However, the presence of incorrect lures often attenuates this memory benefit. The current research examined the effects of "all of the above" (AOTA) options. When such options are correct, no incorrect lures are present. In the first three experiments, a correct AOTA option on an initial test led to a larger memory benefit than no test and standard multiple choice test conditions. The benefits of a correct AOTA option occurred even without feedback on the initial test; for both 5-minute and 48-hour retention delays; and for both cued recall and multiple choice final test formats. In the final experiment, an AOTA question led to better memory retention than did a control condition that had identical timing and exposure to response options. However, the benefits relative to this control condition were similar regardless of the type of multiple choice test (AOTA or not). Results suggest that retrieval contributes to multiple choice testing effects. However, the extra testing effect from a correct AOTA option, rather than being due to more retrieval, might be due simply to more exposure to correct information.

Multiple choice exams of medical knowledge with open books and web access? A validity study

DEFF Research Database (Denmark)

O'Neill, Lotte; Simonsen, Eivind Ortind; Knudsen, Ulla Breth

2015-01-01

Background: Open book tests have been suggested to lower test anxiety and promote deeper learning strategies. In the Aarhus University medical program, ¼ of the curriculum assess students’ medical knowledge with ‘open book, open web’ (OBOW) multiple choice examinations. We found little existing...

Questioning English Standards: Learner Attitudes and L2 Choices in Norway

Science.gov (United States)

Rindal, Ulrikke

2014-01-01

This study investigates attitudes towards varieties of English among Norwegian adolescent learners and assesses the role of social evaluation for second language (L2) pronunciation choices by combining a verbal guise test with speaker commentary and reports of language choices. The results suggest that while American English is the most accessible…

The Monte Carlo Quiz: Encouraging Punctual Completion and Deep Processing of Assigned Readings

Science.gov (United States)

Fernald, Peter S.

2004-01-01

The Monte Carlo Quiz (MCQ), a single-item quiz, is so named because chance, with the roll of a die, determines (a) whether the quiz is administered; (b) the specific article, chapter, or section of the assigned reading that the quiz covers; and (c) the particular question that makes up the quiz. The MCQ encourages both punctual completion and deep…

MCQ testing in higher education: Yes, there are bad items and invalid scores—A case study identifying solutions

OpenAIRE

Brown, Gavin

2017-01-01

This is a lecture given at Umea University, Sweden in September 2017. It is based on the published study: Brown, G. T. L., & Abdulnabi, H. (2017). Evaluating the quality of higher education instructor-constructed multiple-choice tests: Impact on student grades. Frontiers in Education: Assessment, Testing, & Applied Measurement, 2(24).. doi:10.3389/feduc.2017.00024

Constructing a multiple choice test to measure elementary school teachers' Pedagogical Content Knowledge of technology education.

NARCIS (Netherlands)

Rohaan, E.J.; Taconis, R.; Jochems, W.M.G.

2009-01-01

This paper describes the construction and validation of a multiple choice test to measure elementary school teachers' Pedagogical Content Knowledge of technology education. Pedagogical Content Knowledge is generally accepted to be a crucial domain of teacher knowledge and is, therefore, an important

Do Students Behave Rationally in Multiple Choice Tests? Evidence from a Field Experiment

OpenAIRE

María Paz Espinosa; Javier Gardeazabal

2013-01-01

A disadvantage of multiple choice tests is that students have incentives to guess. To discourage guessing, it is common to use scoring rules that either penalize wrong answers or reward omissions. In psychometrics, penalty and reward scoring rules are considered equivalent. However, experimental evidence indicates that students behave differently under penalty or reward scoring rules. These differences have been attributed to the different framing (penalty versus reward). In this paper, we mo...

Exploring Multiple Motivations on Urban Residents’ Travel Mode Choices: An Empirical Study from Jiangsu Province in China

Directory of Open Access Journals (Sweden)

Jichao Geng

2017-01-01

Full Text Available People’s actions are always accompanied with multiple motives. How to estimate the role of the pro-environment motivation under the interference of other motivations will help us to better interpret human environmental behaviors. On the basis of classical motivation theories and travel mode choice research backgrounds, the concepts of pro-environmental and self-interested motivation were defined. Then based on survey data on 1244 urban residents in the Jiangsu Province in China, the multinomial logistic regression model was constructed to examine the effects of multiple motivations, government measures, and demographic characteristics on residents’ travel mode choice behaviors. The result indicates that compared to car use, pro-environmental motivation certainly has a significant and positive role in promoting green travel mode choices (walking, bicycling, and using public transport, but this unstable green behavior is always dominated by self-interested motivations rather than the pro-environmental motivation. In addition, the effects of gender, age, income, vehicle ownership, travel distance, and government instruments show significant differences among travel mode choices. The findings suggest that pro-environmental motivation needs to be stressed and highlighted to ensure sustainable urban transportation. However, policies aimed to only increase the public awareness of environment protection are not enough; tailored policy interventions should be targeted to specific groups having different main motivations.

Using a Fine-Grained Multiple-Choice Response Format in Educational Drill-and-Practice Video Games

Science.gov (United States)

Beserra, Vagner; Nussbaum, Miguel; Grass, Antonio

2017-01-01

When using educational video games, particularly drill-and-practice video games, there are several ways of providing an answer to a quiz. The majority of paper-based options can be classified as being either multiple-choice or constructed-response. Therefore, in the process of creating an educational drill-and-practice video game, one fundamental…

New Methods of Evaluation for Postgraduate Training in Kermanshah University of Medical Sciences (2014

Directory of Open Access Journals (Sweden)

Nasrin Jalilian

2015-09-01

Full Text Available Revered editor evaluation of medical students in specialized medical fields has great importance in determining the necessary competence to learning clinical environments and necessary ability for functioning in the real environment (1. New specialized medical evaluation focuses on ways that confirm the clinical competence assistant that can point to the students’ experience booklet (log book; assay exams; Multiple Choice Question (MCQ; Objective Structural Clinical Examination (OSCE; observation with check list or rating scale; self-assessment and assessment by peers rating scale general; Portfolio; Direct Observation of Procedure Skill (DOPS; Mini Clinical Evaluation Exercise (Mini-CEX; 360-degree comprehensive assessment of Clinical Skills based on Records assistants (CSR; Objective Structural Practical Examination (OSPE (2. This descriptive-analytical study was performed to evaluate the use of modern methods of evaluation among eleven postgraduate departments in Kermanshah University of Medical Sciences in 2015. Data collection tool was a checklist that was prepared by researchers and was completed by clinical group managers. Data were analyzed with SPSS-16 software, Chi-square test and analysis of variance. In total of 11 studied groups, 106 full-time board faculty members, 14 co-education, 221 residents were working. The most modern methods to evaluate in %100 of groups were OSCE and MCQ, DOPS in %80 of groups, and Mini-CEX and CSR in% 27 of groups. Assay exams were used in infectious and pathology groups as the use of other modern methods of evaluation was not observed in all groups. Statistically, the most important reasons for the lack of significant new methods of evaluation were: internal decision of the department (P=0.002, unfamiliarity of team members with modern methods of evaluation (P=0.06, and the adequacy of other methods of evaluation according to the decision of the department (P<0.001. Other cited reasons such as lack of

The Different Paths in the Franchising Entrepreneurship Choice

Science.gov (United States)

Tomaras, Petros; Konstantopoulos, Nikolaos; Zondiros, Dimitris

2007-12-01

This study aims to testify the scientific veracity of the question: is the franchisees' choice on entrepreneurial start-up univocal or many-valued? Two variables are examined by registering daily activities of the entrepreneurial franchisees, as they appear by the answers given to a closed-ended questionnaire. We proceeded with a multiple variable statistical analysis (principal component analysis) of survey data collected from franchisees of a Greece-based franchise system. The results of the research indicate that among different value standards, the entrepreneurs conclude in choosing the franchising.

Multiple choices of time in quantum cosmology

International Nuclear Information System (INIS)

Małkiewicz, Przemysław

2015-01-01

It is often conjectured that a choice of time function merely sets up a frame for the quantum evolution of the gravitational field, meaning that all choices should be in some sense compatible. In order to explore this conjecture (and the meaning of compatibility), we develop suitable tools for determining the relation between quantum theories based on different time functions. First, we discuss how a time function fixes a canonical structure on the constraint surface. The presentation includes both the kinematical and the reduced perspective, and the relation between them. Second, we formulate twin theorems about the existence of two inequivalent maps between any two deparameterizations, a formal canonical and a coordinate one. They are used to separate the effects induced by choice of clock and other factors. We show, in an example, how the spectra of quantum observables are transformed under the change of clock and prove, via a general argument, the existence of choice-of-time-induced semiclassical effects. Finally, we study an example, in which we find that the semiclassical discrepancies can in fact be arbitrarily large for dynamical observables. We conclude that the values of critical energy density or critical volume in the bouncing scenarios of quantum cosmology cannot in general be at the Planck scale, and always need to be given with reference to a specific time function. (paper)

Questionable Word Choice in Scientific Writing in Orthopedic Surgery

Directory of Open Access Journals (Sweden)

Casey M. O`Connor

2017-07-01

Full Text Available Background: Given the strong influence of thoughts, emotions, and behaviors on musculoskeletal symptoms andlimitations it’s important that both scientific and lay writing use the most positive, hopeful, and adaptive words andconcepts consistent with medical evidence. The use of words that might reinforce misconceptions about preferencesensitiveconditions (particularly those associated with age could increase symptoms and limitations and might alsodistract patients from the treatment preferences they would select when informed and at ease.Methods: We reviewed 100 consecutive papers published in 2014 and 2015 in 6 orthopedic surgery scientific journals.We counted the number and proportion of journal articles with questionable use of one or more of the following words:tear, aggressive, required, and fail. For each word, we counted the rate of misuse per journal and the number of specificterms misused per article per journalResults: Eighty percent of all orthopedic scientific articles reviewed had questionable use of at least one term. Tearwas most questionably used with respect to rotator cuff pathology. The words fail and require were the most commonquestionably used terms overall.Conclusion: The use of questionable words and concepts is common in scientific writing in orthopedic surgery. It’sworth considering whether traditional ways or referring to musculoskeletal illness merit rephrasing.

The Multiple-Choice Model: Some Solutions for Estimation of Parameters in the Presence of Omitted Responses

Science.gov (United States)

Abad, Francisco J.; Olea, Julio; Ponsoda, Vicente

2009-01-01

This article deals with some of the problems that have hindered the application of Samejima's and Thissen and Steinberg's multiple-choice models: (a) parameter estimation difficulties owing to the large number of parameters involved, (b) parameter identifiability problems in the Thissen and Steinberg model, and (c) their treatment of omitted…

Benford’s Law: Textbook Exercises and Multiple-Choice Testbanks

Science.gov (United States)

Slepkov, Aaron D.; Ironside, Kevin B.; DiBattista, David

2015-01-01

Benford’s Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. Currently, the most common application of Benford’s Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford’s Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford’s Law, the testbank is nonetheless secure against such a Benford’s attack for banal reasons. PMID:25689468

e-Learning in Advanced Life Support-What factors influence assessment outcome?

Science.gov (United States)

Thorne, C J; Lockey, A S; Kimani, P K; Bullock, I; Hampshire, S; Begum-Ali, S; Perkins, G D

2017-05-01

To establish variables which are associated with favourable Advanced Life Support (ALS) course assessment outcomes, maximising learning effect. Between 1 January 2013 and 30 June 2014, 8218 individuals participated in a Resuscitation Council (UK) e-learning Advanced Life Support (e-ALS) course. Participants completed 5-8h of online e-learning prior to attending a one day face-to-face course. e-Learning access data were collected through the Learning Management System (LMS). All participants were assessed by a multiple choice questionnaire (MCQ) before and after the face-to-face aspect alongside a practical cardiac arrest simulation (CAS-Test). Participant demographics and assessment outcomes were analysed. The mean post e-learning MCQ score was 83.7 (SD 7.3) and the mean post-course MCQ score was 87.7 (SD 7.9). The first attempt CAS-Test pass rate was 84.6% and overall pass rate 96.6%. Participants with previous ALS experience, ILS experience, or who were a core member of the resuscitation team performed better in the post-course MCQ, CAS-Test and overall assessment. Median time spent on the e-learning was 5.2h (IQR 3.7-7.1). There was a large range in the degree of access to e-learning content. Increased time spent accessing e-learning had no effect on the overall result (OR 0.98, P=0.367) on simulated learning outcome. Clinical experience through membership of cardiac arrest teams and previous ILS or ALS training were independent predictors of performance on the ALS course whilst time spent accessing e-learning materials did not affect course outcomes. This supports the blended approach to e-ALS which allows participants to tailor their e-learning experience to their specific needs. Copyright © 2017 Elsevier B.V. All rights reserved.

THE OCCUPATIONAL CHOICE AS A SOCIOLOGICAL PHENOMENON: QUESTIONS OF THE THEORY

Directory of Open Access Journals (Sweden)

A. I. Kravchenko

2017-01-01

Full Text Available At different stages of the history of various types of labor assigned to the members of the society forced or involuntary manner. Only in a market society, i.e., under capitalism, the process of securing the labor of employees assumes the character almost free occupational choice. On the professional preferences of the applicant affect not only his needs, desires, motivation and personal qualities, but also the situation on the labour market and economic situation of the family.In the Russian sociology there are two phenomena – the occupational choice and occupational selection. The occupational choice – a spontaneous process of finding an individual workplace, the characteristics of which would correspond to the characteristics of the person (inclinations, temperament, social status, place of residence, etc.. Occupational selection – purposeful selection of a single candidate among several applicants for vacancies, which is carried out expert – an employee of the organization, on the basis of the list of requirements that characterize a given workplace. Sociologists often use the definition that is offered by psychologists. According to the latest point of view, the occupational selection – a purposeful process of selecting a single candidate from the group of applicants for the position of those persons who meet the requirements of the workplace in their personal qualities.Occupational selection – the process by which a company or an organization chooses from among the candidates of one or more that best fit under the criteria of selection for the vacant position, taking into account the current environment conditions. The occupational choice, as opposed to professional self-determination (for E.I. Golovakha – a decision that affects only the near-term student life. American sociologist and psychologist D. Super believes that during the life (career, a person is forced to make a lot of choices (he considered a career as an �

Electronic voting to encourage interactive lectures: a randomised trial

Directory of Open Access Journals (Sweden)

Palmer Edward

2007-07-01

Full Text Available Abstract Background Electronic Voting Systems have been used for education in a variety of disciplines. Outcomes from these studies have been mixed. Because results from these studies have been mixed, we examined whether an EVS system could enhance a lecture's effect on educational outcomes. Methods A cohort of 127 Year 5 medical students at the University of Adelaide was stratified by gender, residency status and academic record then randomised into 2 groups of 64 and 63 students. Each group received consecutive 40-minute lectures on two clinical topics. One group received the EVS for both topics. The other group received traditional teaching only. Evaluation was undertaken with two, 15-question multiple-choice questionnaires (MCQ assessing knowledge and problem solving and undertaken as a written paper immediately before and after the lectures and repeated online 8–12 weeks later. Standardised institutional student questionnaires were completed for each lecture and independent observers assessed student behaviour during the lectures. Lecturer's opinions were assessed by a questionnaire developed for this study. Results Two-thirds of students randomised to EVS and 59% of students randomised to traditional lectures attended. One-half of the students in the EVS group and 41% in the traditional group completed all questionnaires. There was no difference in MCQ scores between EVS and traditional lectures (p = 0.785. The cervical cancer lectures showed higher student ranking in favour of EVS in all parameters. The breast cancer lectures showed higher ranking in favour of traditional lectures in 5 of 7 parameters (p Conclusion In this setting, EVS technology used in large group lectures did not offer significant advantages over the more traditional lecture format.

Pre-travel consultation: evaluation of primary care physician practice in the Franche-Comté region.

Science.gov (United States)

Piotte, Emeline; Bellanger, Anne-Pauline; Piton, Gaël; Millon, Laurence; Marguet, Philippe

2013-01-01

Primary care physicians (PCP) are first in line to provide adequate pre-travel medical advice. Little data are available on the content of pre-travel PCP consultations in France. We undertook an observational survey to assess the level of specific knowledge among PCPs on health advice, vaccinations, and malaria prophylaxis. Standardized questionnaires were sent to a random sample of 400 PCPs practicing in the Franche-Comté regions (eastern France) who were asked to complete and return it on a voluntary and anonymous basis. The questionnaire requested sociodemographic details, practice-related characteristics, and proposed three clinical situations with multiple choice questions (MCQ). To identify factors associated with a higher level of specific knowledge in travel medicine, results were studied by uni- and multivariate analyses. An overall score was calculated based on the MCQ answers and a motivation score was calculated based on parameters such as frequency and developments in pre-travel consulting at the practice, PCPs' personal experience as travelers, and the formal agreement of PCPs to administer yellow fever vaccination. The response rate was 37.5%, with 150 questionnaires returned completed and suitable for analysis. After multivariate logistic regression, the three variables associated with a higher score were: proximity of a vaccination center (p = 0.001), motivation score (p = 0.004), and absence of request for expert advice on malaria prophylaxis (p = 0.007). PCPs play an important role in travel medicine. This study showed that their high level of knowledge in travel medicine was mostly linked to their motivation to practice in this specialized discipline. © 2013 International Society of Travel Medicine.

North Korean refugee doctors' preliminary examination scores

Directory of Open Access Journals (Sweden)

Sung Uk Chae

2016-12-01

Full Text Available Purpose Although there have been studies emphasizing the re-education of North Korean (NK doctors for post-unification of the Korean Peninsula, study on the content and scope of such re-education has yet to be conducted. Researchers intended to set the content and scope of re-education by a comparative analysis for the scores of the preliminary examination, which is comparable to the Korean Medical Licensing Examination (KMLE. Methods The scores of the first and second preliminary exams were analyzed by subject using the Wilcoxon signed rank test. The passing status of the group of NK doctors for KMLE in recent 3 years were investigated. The multiple-choice-question (MCQ items of which difficulty indexes of NK doctors were lower than those of South Korean (SK medical students by two times of the standard deviation of the scores of SK medical students were selected to investigate the relevant reasons. Results The average scores of nearly all subjects were improved in the second exam compared with the first exam. The passing rate of the group of NK doctors was 75%. The number of MCQ items of which difficulty indexes of NK doctors were lower than those of SK medical students was 51 (6.38%. NK doctors’ lack of understandings for Diagnostic Techniques and Procedures, Therapeutics, Prenatal Care, and Managed Care Programs was suggested as the possible reason. Conclusion The education of integrated courses focusing on Diagnostic Techniques and Procedures and Therapeutics, and apprenticeship-style training for clinical practice of core subjects are needed. Special lectures on the Preventive Medicine are likely to be required also.

Step by Step: Biology Undergraduates' Problem-Solving Procedures during Multiple-Choice Assessment.

Science.gov (United States)

Prevost, Luanna B; Lemons, Paula P

2016-01-01

This study uses the theoretical framework of domain-specific problem solving to explore the procedures students use to solve multiple-choice problems about biology concepts. We designed several multiple-choice problems and administered them on four exams. We trained students to produce written descriptions of how they solved the problem, and this allowed us to systematically investigate their problem-solving procedures. We identified a range of procedures and organized them as domain general, domain specific, or hybrid. We also identified domain-general and domain-specific errors made by students during problem solving. We found that students use domain-general and hybrid procedures more frequently when solving lower-order problems than higher-order problems, while they use domain-specific procedures more frequently when solving higher-order problems. Additionally, the more domain-specific procedures students used, the higher the likelihood that they would answer the problem correctly, up to five procedures. However, if students used just one domain-general procedure, they were as likely to answer the problem correctly as if they had used two to five domain-general procedures. Our findings provide a categorization scheme and framework for additional research on biology problem solving and suggest several important implications for researchers and instructors. © 2016 L. B. Prevost and P. P. Lemons. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Multiple Hub Network Choice in the Liberalized European Market

Science.gov (United States)

Berechman, Joseph; deWit, Jaap

1997-01-01

. In the meantime, open skies agreements have been concluded between the USA and most of the EU member states to facilitate strategic alliances between airlines of the states involved. As a result of this on-going liberalization the model of the single 'national' carrier using the national home base as its single hub for the designated third, fourth and sixth freedom operations will stepwise disappear. Within the EU the concept of the national carrier has already been replaced by that of the community carrier. State ownership in more and more European carriers is reduced. On the longer run mergers or even bankruptcy will further undermine the "single national carrier - single national hub" model in Europe. In the meantime, strategic alliances between national carriers in Europe will already reduce the airlines' loyalty to a single airport. Profit maximization and accountability to share holders will supersede the loyalty of these newly emerging alliances, probably looking for the opportunities of a multiple hub network to adequately cover the whole European market. As a consequence, some European airports might see a substantial decline in arriving, departing and transfer traffic, thus in revenues and financial solvency, as well as in their connection to other inter-continental and intra-European destinations. At the same time, other airports might realize a significant increase in traffic as they will be sought after by the profit maximizing airlines as their major gateway hubs. Which will be the losing airports and which will be the winning ones? Can airports anticipate the actions of airlines in deregulated markets and utilize policies which will improve their relative position? If so, what should be these anticipatory policies? These questions become the more urgent, since an increasing number of major European airports will be privatized in the near future. Although increasing airport congestion in Europe will also be reflected in a growing demand pressure for

Consumers' store choice behavior for fresh food

NARCIS (Netherlands)

Meulenberg, M.T.G.; Trijp, van J.C.M.

1991-01-01

Consumers' preference for fresh food stores is analyzed. In particular the choice between supermarkets and specialized shops for purchasing fresh food is analyzed. Attention is given to the factors influencing this choice. For this purpose a number of research questions with respect to store choice

Electricity contract choices of Finnish residential customers. A choice based conjoint analysis

Energy Technology Data Exchange (ETDEWEB)

Rouvinen, S.; Matero, J. (Univ. of Eastern Finland, Joensuu (Finland), School of Forest Sciences), e-mail: seppo.rouvinen@uef.fi, e-mail: jukka.matero@uef.fi

2010-07-01

Our aim is to examine how different environmental attributes of electricity contracts affect the residential customer choices when heterogeneity in customer preferences and motivations is taken into account. The data was acquired by a mail questionnaire to random sample of Finnish people in October-November 2009 with a response rate of 38 %. In addition to conventional questions, like questions on socio-demographic and agreements of energy related statements, the discrete choice experiment (DCE) of electricity contracts was included. The choice sets in the DCE had three electricity contract alternatives with varying levels of predetermined attributes (including unit price, supplier type, frequency of power outages, energy source and CO{sub 2} emissions). In this paper, we present the findings of our DCE design. Modeling respondent choices resulted in implicit prices for various electricity contract attributes that provide guidance for green marketing strategies of electricity suppliers and energy related informational activities of public institutions. We conclude that currently the potential for increasing demand-based environmental competitiveness from the wood electricity differentiation remains limited as we did not find any significant market segment of residential customers with strong preferences for wood over other sources of electricity (including 'mixture'). (orig.)

Airport choice model in multiple airport regions

Directory of Open Access Journals (Sweden)

Claudia Muñoz

2017-02-01

Full Text Available Purpose: This study aims to analyze travel choices made by air transportation users in multi airport regions because it is a crucial component when planning passenger redistribution policies. The purpose of this study is to find a utility function which makes it possible to know the variables that influence users’ choice of the airports on routes to the main cities in the Colombian territory. Design/methodology/approach: This research generates a Multinomial Logit Model (MNL, which is based on the theory of maximizing utility, and it is based on the data obtained on revealed and stated preference surveys applied to users who reside in the metropolitan area of Aburrá Valley (Colombia. This zone is the only one in the Colombian territory which has two neighboring airports for domestic flights. The airports included in the modeling process were Enrique Olaya Herrera (EOH Airport and José María Córdova (JMC Airport. Several structure models were tested, and the MNL proved to be the most significant revealing the common variables that affect passenger airport choice include the airfare, the price to travel the airport, and the time to get to the airport. Findings and Originality/value: The airport choice model which was calibrated corresponds to a valid powerful tool used to calculate the probability of each analyzed airport of being chosen for domestic flights in the Colombian territory. This is done bearing in mind specific characteristic of each of the attributes contained in the utility function. In addition, these probabilities will be used to calculate future market shares of the two airports considered in this study, and this will be done generating a support tool for airport and airline marketing policies.

Comparison of integrated testlet and constructed-response question formats

Directory of Open Access Journals (Sweden)

Aaron D. Slepkov

2014-09-01

Full Text Available Constructed-response (CR questions are a mainstay of introductory physics textbooks and exams. However, because of the time, cost, and scoring reliability constraints associated with this format, CR questions are being increasingly replaced by multiple-choice (MC questions in formal exams. The integrated testlet (IT is a recently developed question structure designed to provide a proxy of the pedagogical advantages of CR questions while procedurally functioning as set of MC questions. ITs utilize an answer-until-correct response format that provides immediate confirmatory or corrective feedback, and they thus allow not only for the granting of partial credit in cases of initially incorrect reasoning, but, furthermore, the ability to build cumulative question structures. Here, we report on a study that directly compares the functionality of ITs and CR questions in introductory physics exams. To do this, CR questions were converted to concept-equivalent ITs, and both sets of questions were deployed in midterm and final exams. We find that both question types provide adequate discrimination between stronger and weaker students, with CR questions discriminating slightly better than the ITs. There is some indication that any difference in discriminatory power may result from the baseline score for guessing that is inherent in MC testing. Meanwhile, an analysis of interrater scoring of the CR questions raises serious concerns about the reliability of the granting of partial credit when this traditional assessment technique is used in a realistic (but nonoptimized setting. Furthermore, we show evidence that partial credit is granted in a valid manner in the ITs. Thus, together with consideration of the vastly reduced costs of administering IT-based examinations compared to CR-based examinations, our findings indicate that ITs are viable replacements for CR questions in formal examinations where it is desirable both to assess concept integration and to

Effects of phentermine and pentobarbital on choice processes during multiple probability learning (MPL) and decision processes manipulated by pay-off conditions

NARCIS (Netherlands)

Volkerts, ER; VanLaar, MW; Verbaten, MN; Mulder, G; Maes, RAA

1997-01-01

The primary research question in this investigation concerned whether arousal manipulation by a stimulant (phentermine 20 mg) and a depressant (pentobarbital 100 mg) will oppositely affect choice behaviour in a probability learning task and decision processes manipulated by pay-off. A 3-source

Evaluating the Impact of a Canadian National Anatomy and Radiology Contouring Boot Camp for Radiation Oncology Residents

Energy Technology Data Exchange (ETDEWEB)

Jaswal, Jasbir [Department of Radiation Oncology, London Health Sciences Centre, London, Ontario (Canada); D' Souza, Leah; Johnson, Marjorie [Department of Anatomy and Cell Biology, Schulich School of Medicine and Dentistry, Western University, London, Ontario (Canada); Tay, KengYeow [Department of Diagnostic Radiology, London Health Sciences, London, Ontario (Canada); Fung, Kevin; Nichols, Anthony [Department of Otolaryngology, Head & Neck Surgery, Victoria Hospital, London, Ontario (Canada); Landis, Mark [Department of Diagnostic Radiology, London Health Sciences, London, Ontario (Canada); Leung, Eric [Department of Radiation Oncology, London Health Sciences Centre, London, Ontario (Canada); Kassam, Zahra [Department of Diagnostic Radiology, St. Joseph' s Health Care London, London, Ontario (Canada); Willmore, Katherine [Department of Anatomy and Cell Biology, Schulich School of Medicine and Dentistry, Western University, London, Ontario (Canada); D' Souza, David; Sexton, Tracy [Department of Radiation Oncology, London Health Sciences Centre, London, Ontario (Canada); Palma, David A., E-mail: david.palma@lhsc.on.ca [Department of Radiation Oncology, London Health Sciences Centre, London, Ontario (Canada)

2015-03-15

Background: Radiation therapy treatment planning has advanced over the past 2 decades, with increased emphasis on 3-dimensional imaging for target and organ-at-risk (OAR) delineation. Recent studies suggest a need for improved resident instruction in this area. We developed and evaluated an intensive national educational course (“boot camp”) designed to provide dedicated instruction in site-specific anatomy, radiology, and contouring using a multidisciplinary (MDT) approach. Methods: The anatomy and radiology contouring (ARC) boot camp was modeled after prior single-institution pilot studies and a needs-assessment survey. The boot camp incorporated joint lectures from radiation oncologists, anatomists, radiologists, and surgeons, with hands-on contouring instruction and small group interactive seminars using cadaveric prosections and correlative axial radiographs. Outcomes were evaluated using pretesting and posttesting, including anatomy/radiology multiple-choice questions (MCQ), timed contouring sessions (evaluated relative to a gold standard using Dice similarity metrics), and qualitative questions on satisfaction and perceived effectiveness. Analyses of pretest versus posttest scores were performed using nonparametric paired testing. Results: Twenty-nine radiation oncology residents from 10 Canadian universities participated. As part of their current training, 29%, 75%, and 21% receive anatomy, radiology, and contouring instruction, respectively. On posttest scores, the MCQ knowledge scores improved significantly (pretest mean 60% vs posttest mean 80%, P<.001). Across all contoured structures, there was a 0.20 median improvement in students' average Dice score (P<.001). For individual structures, significant Dice improvements occurred in 10 structures. Residents self-reported an improved ability to contour OARs and interpret radiographs in all anatomic sites, 92% of students found the MDT format effective for their learning, and 93% found the boot camp

Evaluating the Impact of a Canadian National Anatomy and Radiology Contouring Boot Camp for Radiation Oncology Residents

International Nuclear Information System (INIS)

Jaswal, Jasbir; D'Souza, Leah; Johnson, Marjorie; Tay, KengYeow; Fung, Kevin; Nichols, Anthony; Landis, Mark; Leung, Eric; Kassam, Zahra; Willmore, Katherine; D'Souza, David; Sexton, Tracy; Palma, David A.

2015-01-01

Background: Radiation therapy treatment planning has advanced over the past 2 decades, with increased emphasis on 3-dimensional imaging for target and organ-at-risk (OAR) delineation. Recent studies suggest a need for improved resident instruction in this area. We developed and evaluated an intensive national educational course (“boot camp”) designed to provide dedicated instruction in site-specific anatomy, radiology, and contouring using a multidisciplinary (MDT) approach. Methods: The anatomy and radiology contouring (ARC) boot camp was modeled after prior single-institution pilot studies and a needs-assessment survey. The boot camp incorporated joint lectures from radiation oncologists, anatomists, radiologists, and surgeons, with hands-on contouring instruction and small group interactive seminars using cadaveric prosections and correlative axial radiographs. Outcomes were evaluated using pretesting and posttesting, including anatomy/radiology multiple-choice questions (MCQ), timed contouring sessions (evaluated relative to a gold standard using Dice similarity metrics), and qualitative questions on satisfaction and perceived effectiveness. Analyses of pretest versus posttest scores were performed using nonparametric paired testing. Results: Twenty-nine radiation oncology residents from 10 Canadian universities participated. As part of their current training, 29%, 75%, and 21% receive anatomy, radiology, and contouring instruction, respectively. On posttest scores, the MCQ knowledge scores improved significantly (pretest mean 60% vs posttest mean 80%, P<.001). Across all contoured structures, there was a 0.20 median improvement in students' average Dice score (P<.001). For individual structures, significant Dice improvements occurred in 10 structures. Residents self-reported an improved ability to contour OARs and interpret radiographs in all anatomic sites, 92% of students found the MDT format effective for their learning, and 93% found the boot camp

Evaluation of five guidelines for option development in multiple-choice item-writing.

Science.gov (United States)

Martínez, Rafael J; Moreno, Rafael; Martín, Irene; Trigo, M Eva

2009-05-01

This paper evaluates certain guidelines for writing multiple-choice test items. The analysis of the responses of 5013 subjects to 630 items from 21 university classroom achievement tests suggests that an option should not differ in terms of heterogeneous content because such error has a slight but harmful effect on item discrimination. This also occurs with the "None of the above" option when it is the correct one. In contrast, results do not show the supposedly negative effects of a different-length option, the use of specific determiners, or the use of the "All of the above" option, which not only decreases difficulty but also improves discrimination when it is the correct option.

Analysis of the residential location choice and household energy consumption behavior by incorporating multiple self-selection effects

International Nuclear Information System (INIS)

Yu Biying; Junyi Zhang; Fujiwara, Akimasa

2012-01-01

It is expected that the residential location choice and household energy consumption behavior might correlate with each other. Besides, due to the existence of self-selection effects, the observed inter-relationship between them might be the spurious result of the fact that some unobserved variables are causing both. These concerns motivate us to (1) consider residential location choice and household energy consumption behavior (for both in-home appliances and out-of-home cars) simultaneously and, (2) explicitly control self-selection effects so as to capture a relatively true effect of land-use policy on household energy consumption behavior. An integrated model termed as joint mixed Multinomial Logit-Multiple Discrete-Continuous Extreme Value model is presented here to identify the sensitivity of household energy consumption to land use policy by considering multiple self-selection effects. The model results indicate that land-use policy do play a great role in changing Beijing residents’ energy consumption pattern, while the self-selection effects cannot be ignored when evaluating the effect of land-use policy. Based on the policy scenario design, it is found that increasing recreational facilities and bus lines in the neighborhood can greatly promote household's energy-saving behavior. Additionally, the importance of “soft policy” and package policy is also emphasized in the context of Beijing. - Highlights: ► Representing residential choice and household energy consumption behavior jointly. ► Land use policy is found effective to control the household energy use in Beijing. ► Multiple self-selection effects are posed to get the true effect of land use policy. ► Significant self-selection effects call an attention to the soft policy in Beijing. ► The necessity of package policy on saving Beijing residents’ energy use is confirmed.

Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds : Multiple-Choice Versus Constructed-Response Training Items

NARCIS (Netherlands)

Stevenson, C.E.; Heiser, W.J.; Resing, W.C.M.

2016-01-01

Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC

MEDICAL STUDENTS’ FEEDBACK ABOUT FORMATIVE ASSESSMENT PATTERN

Directory of Open Access Journals (Sweden)

Navajothi

2016-03-01

Full Text Available BACKGROUND Pharmacology is the toughest subject in the II MBBS syllabus. Students have to memorise a lot about the drugs’ name and classification. We are conducting internal assessment exams after completion of each system. Number of failures will be more than 60% in the internal assessments conducted during first six months of II MBBS course. AIM To assess the formative assessment pattern followed in our institution with the students’ feedback and modify the pattern according to the students’ feedback. SETTINGS & DESIGN Prospective Observational Study conducted at Department of Pharmacology, Government Sivagangai Medical College, Sivagangai, Tamil Nadu. MATERIALS AND METHODS Questionnaire was prepared and distributed to the 300 students of Government Sivagangai Medical College and feedback was collected. Data collected was analysed in Microsoft Excel 2007 version. RESULTS Received feedback from 274 students. Most (80% of the students wanted to attend the tests in all systems. Monthly assessment test was preferred by 47% of the students. Students who preferred to finish tests before holidays was 57%. Most (56% of the students preferred tests for 1 hour. Multiple choice question (MCQ type was preferred by 43%, which is not a routine question pattern. Only 7% preferred viva. Recall type of questions was preferred by 41% of the students. CONCLUSION In our institution, internal assessment is conducted as per the students’ mind setup. As the feedback has been the generally followed one, we will add MCQs in the forthcoming tests. Application type questions will be asked for more marks than Recall type of questions.

Early Clinical Exposure as a Learning Tool to Teach Neuroanatomy for First Year MBBS Students.

Science.gov (United States)

Kar, Maitreyee; Kar, Chinmaya; Roy, Hironmoy; Goyal, Parmod

2017-12-01

Early clinical exposure (ECE) is one of the important tools to teach basic science to the MBBS students. It is one form of vertical integration between basic science and clinical subjects. This study is an effort at exploring the use of ECE as a motivational tool toward better learning in neuroanatomy for first year MBBS students. This study aims to make the students interested and motivated to study neuroanatomy by using ECE as learning tool in neuroanatomy and to make the students enable to retain the knowledge of neuroanatomy more efficiently and correlate the knowledge of neuroanatomy with neuromedicine. This study was conducted in collaboration with the Departments of Anatomy, General Medicine and Medical Education Unit in the year 2016. This was cross-sectional study. One hundred and fifty students of 1 st Professional MBBS were subdivided into two groups. After preliminary classes on brain, brainstem, and spinal cord for both groups, conventional lecture classes were taken for Group A only on upper motor neuron (UMN) and lower motor neuron (LMN) paralysis, and only Group B visited General Medicine ward where HOD, General Medicine showed and examined patients of UMN paralysis and LMN paralysis, elicited different symptoms, and discussed different investigation. It was followed by assessment of all by problem-based multiple choice questions (MCQ) and short answer questions. Then, Group B attended lecture class on different cranial nerve palsy whereas Group A visited medicine ward. It was followed by assessment of both groups by problem-based MCQ and short answer questions. The performance was compared. Then, the feedback of the students on ECE was collected by means of reflection writing followed by administration of questionnaire. Then, the perception of teachers regarding ECE was recorded by focused group discussion. Student's t -test was used to compare the performance of both batches. Reflection writing and focus group discussion were analyzed

Working with interpreters: an interactive Web-based learning module.

Science.gov (United States)

Kalet, Adina; Gany, Francesca; Senter, Lindsay

2002-09-01

Medical students are presented with unique challenges when they care for patients with limited English proficiency. Students must learn a complex set of skills needed to care for patients across cultural and language barriers and to understand the impact of their own attitudes and beliefs about caring for these patients. We developed and piloted a multimedia interactive Web-based module aimed at teaching students effective strategies for working with interpreters and diverse patient populations, and at raising their awareness of important legal, ethical, and cultural issues. First the learner completes a 37-multiple-choice-question (MCQ) pre-test that assesses attitudes, factual knowledge, and ability to analyze written clinical scenarios relevant to the module's content. Learners are then shown a series of professionally produced video vignettes, which reflect diverse patient populations, interpreters, and effectiveness of interpretation strategies (e.g., a Russian-speaking woman with chest pain whose daughter interprets, a medical student interpreting for a Chinese-speaking man using herbal medication, a Haitian woman told of an abnormal mammogram through a trained simultaneous interpreter). In each case, learners submit short answers to on-screen questions analyzing the effectiveness of the interpretation strategies demonstrated. Immediate feedback is given comparing student responses with those of experts. At any time during the module, the learners may view video commentary by legal, ethics, and cultural experts, or access a glossary and Web site links. Students conclude the module by again taking the MCQ test. A final screen compares their pre- and post-MCQ test responses and shows best answers, allowing them to assess their learning. The learners also complete a survey, providing personal cultural information and feedback on the module. All 160 first-year medical students completed the module and evaluated its effectiveness this year. On average, students

Multiple-Choice Testing Using Immediate Feedback--Assessment Technique (IF AT®) Forms: Second-Chance Guessing vs. Second-Chance Learning?

Science.gov (United States)

Merrel, Jeremy D.; Cirillo, Pier F.; Schwartz, Pauline M.; Webb, Jeffrey A.

2015-01-01

Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…

Comparison of the Impact of Wikipedia, UpToDate, and a Digital Textbook on Short-Term Knowledge Acquisition Among Medical Students: Randomized Controlled Trial of Three Web-Based Resources.

Science.gov (United States)

Scaffidi, Michael A; Khan, Rishad; Wang, Christopher; Keren, Daniela; Tsui, Cindy; Garg, Ankit; Brar, Simarjeet; Valoo, Kamesha; Bonert, Michael; de Wolff, Jacob F; Heilman, James; Grover, Samir C

2017-10-31

Web-based resources are commonly used by medical students to supplement curricular material. Three commonly used resources are UpToDate (Wolters Kluwer Inc), digital textbooks, and Wikipedia; there are concerns, however, regarding Wikipedia's reliability and accuracy. The aim of this study was to evaluate the impact of Wikipedia use on medical students' short-term knowledge acquisition compared with UpToDate and a digital textbook. This was a prospective, nonblinded, three-arm randomized trial. The study was conducted from April 2014 to December 2016. Preclerkship medical students were recruited from four Canadian medical schools. Convenience sampling was used to recruit participants through word of mouth, social media, and email. Participants must have been enrolled in their first or second year of medical school at a Canadian medical school. After recruitment, participants were randomized to one of the three Web-based resources: Wikipedia, UpToDate, or a digital textbook. During testing, participants first completed a multiple-choice questionnaire (MCQ) of 25 questions emulating a Canadian medical licensing examination. During the MCQ, participants took notes on topics to research. Then, participants researched topics and took written notes using their assigned resource. They completed the same MCQ again while referencing their notes. Participants also rated the importance and availability of five factors pertinent to Web-based resources. The primary outcome measure was knowledge acquisition as measured by posttest scores. The secondary outcome measures were participants' perceptions of importance and availability of each resource factor. A total of 116 medical students were recruited. Analysis of variance of the MCQ scores demonstrated a significant interaction between time and group effects (P<.001, η g 2 =0.03), with the Wikipedia group scoring higher on the MCQ posttest compared with the textbook group (P<.001, d=0.86). Access to hyperlinks, search

Wh-question intonation in Peninsular Spanish: Multiple contours and the effect of task type

Directory of Open Access Journals (Sweden)

Nicholas C. Henriksen

2009-06-01

Full Text Available This paper reports on an experimental investigation of wh-question intonation in Peninsular Spanish. Speech data were collected from six León, Spain Peninsular Spanish speakers, and oral production data were elicited under two conditions: a computerized sentence reading task and an information gap task-oriented dialogue. The latter task was an adaptation of the HCRC Map Task method (cf. Anderson et al., 1991 and was designed to elicit multiple wh-question productions in an unscripted and more spontaneous speech style than the standard sentence reading task. Results indicate that four contours exist in the tonal inventory of the six speakers. The two most frequent contours were a final rise contour and a nuclear circumflex contour. Systematic task-based differences were found for four of the six speakers, indicating that sentence reading task data alone may not accurately reflect spontaneous speech tonal patterns (cf. Cruttenden, 2007; but see also Lickley, Schepman, & Ladd, 2005. The experimental findings serve to clarify a number of assumptions about the syntax-prosody interface underlying wh-question utterance signaling; they also have implications for research methods in intonation and task-based variation in laboratory phonology.

Are groups more likely to defer choice than their members?

Directory of Open Access Journals (Sweden)

Chris M. White

2011-04-01

Full Text Available When faced with a choice, people can normally select no option, i.e., defer choice. Previous research has investigated when and why individuals defer choice, but has almost never looked at these questions when groups of people make choices. Separate reasons predict that groups may be equally likely, more likely, or less likely than individuals to defer choice. We re-analyzed some previously published data and conducted a new experiment to address this question. We found that small groups of people tended to defer choice more often than their members would. Assuming that the groups used a plurality rule but gave additional weight to individual preferences to defer choice allowed the groups' responses to be predicted quite well. We discuss several possible explanations of these findings.

The impact of presentation format on visual attention and choice in discrete choice experiments

DEFF Research Database (Denmark)

Mueller Loose, Simone; Orquin, Jacob Lund

in the product mock-up presentation required significantly fewer fixations and less decision time, and more within-alternative transitions were observed compared to the verbal and visual presentation formats. Attributes presented visually or at larger size had a higher impact on participants’ choices......Objectives. Discrete choice experiments in which participants choose between alternatives differing on attribute levels are an important research method for preference elicitation. In such experiments choice stimuli is typically presented in tables with verbally described attributes, in tables...... with visual attributes, or as product mock-ups simulating realistic products as close as possible. So far little is known about how presentation formats affect visual attention patterns and choice behavior. This study addresses the question by analysing visual attention and part-worth utilities in choice...

Decision making under internal uncertainty: the case of multiple-choice tests with different scoring rules.

Science.gov (United States)

Bereby-Meyer, Yoella; Meyer, Joachim; Budescu, David V

2003-02-01

This paper assesses framing effects on decision making with internal uncertainty, i.e., partial knowledge, by focusing on examinees' behavior in multiple-choice (MC) tests with different scoring rules. In two experiments participants answered a general-knowledge MC test that consisted of 34 solvable and 6 unsolvable items. Experiment 1 studied two scoring rules involving Positive (only gains) and Negative (only losses) scores. Although answering all items was the dominating strategy for both rules, the results revealed a greater tendency to answer under the Negative scoring rule. These results are in line with the predictions derived from Prospect Theory (PT) [Econometrica 47 (1979) 263]. The second experiment studied two scoring rules, which allowed respondents to exhibit partial knowledge. Under the Inclusion-scoring rule the respondents mark all answers that could be correct, and under the Exclusion-scoring rule they exclude all answers that might be incorrect. As predicted by PT, respondents took more risks under the Inclusion rule than under the Exclusion rule. The results illustrate that the basic process that underlies choice behavior under internal uncertainty and especially the effect of framing is similar to the process of choice under external uncertainty and can be described quite accurately by PT. Copyright 2002 Elsevier Science B.V.

Commitment-based action: Rational choice theory and contrapreferential choice

Directory of Open Access Journals (Sweden)

Radovanović Bojana

2014-01-01

Full Text Available This paper focuses on Sen’s concept of contrapreferential choice. Sen has developed this concept in order to overcome weaknesses of the rational choice theory. According to rational choice theory a decision-maker can be always seen as someone who maximises utility, and each choice he makes as the one that brings to him the highest level of personal wellbeing. Sen argues that in some situations we chose alternatives that bring us lower level of wellbeing than we could achieve if we had chosen some other alternative available to us. This happens when we base our decisions on moral principles, when we act out of duty. Sen calls such action a commitment-based action. When we act out of commitment we actually neglect our preferences and thus we make a contrapreferential choice, as Sen argues. This paper shows that, contrary to Sen, a commitment-based action can be explained within the framework of rational choice theory. However, when each choice we make can be explained within the framework of rational choice theory, when in everything we do maximisation principle can be loaded, then the variety of our motives and traits is lost, and the explanatory power of the rational choice theory is questionable. [Projekat Ministarstva nauke Republike Srbije, br. 47009: Evropske integracije i društveno-ekonomske promene privrede Srbije na putu ka EU i br. 179015: Izazovi i perspektive strukturnih promena u Srbiji: Strateški pravci ekonomskog razvoja i usklađivanje sa zahtevima EU

Consumer Choice of Modularized Products : A Conjoint Choice Experiment Approach

NARCIS (Netherlands)

Dellaert, B.G.C.; Borgers, A.W.J.; Louviere, J.; Timmermans, H.J.P.

1998-01-01

Recent increases in flexibility and automation in the production of goods and services allow a growing number of suppliers to offer their products in flexible sets of modules from which consumers can create their own individualized packages. This paper addresses the question how consumer choices of

Loci of Causality and Orientation in Occupational and Educational Choices

Directory of Open Access Journals (Sweden)

Kalervo Friberg

2013-06-01

Full Text Available A student self-determination profile of occupational and educational choices was examined through the concepts of Locus of Causality and Locus of Orientation. Research questions associated with respondents’ certainty of occupation and orientation to vocational education were answered. The tested hypotheses were as follows: (a Independence, initiative, self-guidance, choice of discussion forums, and gender are related to certainty of future occupation choice and choice of vocational education; (b certainty of occupation relates to choosing vocational education; (c negatively biased media lessens interest in vocational education; and (d vocational education choices are related to gender. A survey of ninth-grade students in Finnish comprehensive school was conducted after implementation of a work-orientation program defined in the national comprehensive school curriculum. At the local school system level, 649 subjects of the mean ages of 16.0 years participated in an Internet survey in two school districts in southwestern Finland in 2008. The variables were inserted in Linear Multiple Regression Analysis in IBM SPSS. The means of vocational school choice and certainty of occupation, and vocational school choice and negative media image were compared in SPSS means. An independent-samples t test for vocational school choice and sex was conducted. Statistically significant regression models of loci of orientation and locus of causality were found. The more the respondents were certain of their occupation choice, the more they expressed their secondary education orientation to be vocational school. When students discussed their choices less at home, their orientation to vocational education weakened. A negative media image was not associated with vocational school choice in this data. The measured means for girls’ and boys’ orientations to vocational school did not show statistically significant differences.

An active-learning assignment requiring pharmacy students to write medicinal chemistry examination questions.

Science.gov (United States)

Kolluru, Srikanth

2012-08-10

To implement and assess the effectiveness of an assignment requiring doctor of pharmacy (PharmD) students to write examination questions for the medicinal chemistry sections of a pharmacotherapeutics course. Students were divided into groups of 5-6 and given detailed instructions and grading rubrics for writing multiple-choice examination questions on medicinal chemistry topics. The compiled student-written questions for each examination were provided to the entire class as a study aid. Approximately 5% of the student-written questions were used in course examinations. Student appreciation of and performance in the medicinal chemistry portion of the course was significantly better than that of the previous year's class. Also, students' responses on a qualitative survey instrument indicated that the assignment provided students' guidance on which concepts to focus on, helped them retain knowledge better, and fostered personal exploration of the content, which led to better performance on examinations. Adding an active-learning assignment in which students write examination questions for the medicinal chemistry portion of a pharmacotherapeutics course was an effective means of increasing students engagement in the class and knowledge of the course material.

The influence of question design on the response to self-assessment in www.elearnSCI.org: a submodule pilot study.

Science.gov (United States)

Liu, N; Li, X-W; Zhou, M-W; Biering-Sørensen, F

2015-08-01

This is an interventional training session. The objective of this study was to investigate the difference in response to self-assessment questions in the original and an adjusted version for a submodule of www.elearnSCI.org for student nurses. The study was conducted in a teaching hospital affiliated to Peking University, China. In all, 28 student nurses divided into two groups (groups A and B; 14 in each) received a print-out of a Chinese translation of the slides from the 'Maintaining skin integrity following spinal cord injury' submodule in www.elearnSCI.org for self-study. Both groups were then tested using the 10 self-assessment multiple-choice questions (MCQs) related to the same submodule. Group A used the original questions, whereas group B received an adjusted questionnaire. The responses to four conventional single-answer MCQs were nearly all correct in both groups. However, in three questions, group A, with the option 'All of the above', had a higher number of correct answers than group B, with multiple-answer MCQs. In addition, in another three questions, group A, using the original multiple-answer MCQs, had fewer correct answers than group B, where it was only necessary to tick a single incorrect answer. Variations in design influence the response to questions. The use of conventional single-answer MCQs should be reconsidered, as they only examine the recall of isolated knowledge facts. The 'All of the above' option should be avoided because it would increase the number of correct answers arrived at by guessing. When using multiple-answer MCQs, it is recommended that the questions asked should be in accordance with the content within the www.elearnSCI.org.

Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds: Multiple-Choice versus Constructed-Response Training Items

Science.gov (United States)

Stevenson, Claire E.; Heiser, Willem J.; Resing, Wilma C. M.

2016-01-01

Multiple-choice (MC) analogy items are often used in cognitive assessment. However, in dynamic testing, where the aim is to provide insight into potential for learning and the learning process, constructed-response (CR) items may be of benefit. This study investigated whether training with CR or MC items leads to differences in the strategy…

Impact of online toxicology training on health professionals: the Global Educational Toxicology Uniting Project (GETUP).

Science.gov (United States)

Wong, Anselm; Vohra, Rais; Dawson, Andrew H; Stolbach, Andrew

2017-11-01

The Global Educational Toxicology Uniting Project (GETUP), supported by the American College of Medical Toxicology, links countries with and without toxicology services via distance education with the aim to improve education. Due to the lack of toxicology services in some countries there is a knowledge gap in the management of poisonings. We describe our experience with the worldwide delivery of an online introductory toxicology curriculum to emergency doctors and other health professionals treating poisoned patients. We delivered a 15-module introductory Internet-based toxicology curriculum to emergency doctors and health professionals, conducted from August to December 2016. This Internet-based curriculum was adapted from one used to teach emergency residents toxicology in the United States. Modules covered themes such as pharmaceutical (n = 8), toxidromes (n = 2) and agrochemicals (n = 5) poisoning. Participants completed pre-test and post-test multiple choice questions (MCQs) before and after completing the online module, respectively, throughout the course. We collected information on participant demographics, education and training, and perception of relevance of the curriculum. Participants gave feedback on the course and how it affected their practice. One hundred and thirty-six health professionals from 33 countries participated in the course: 98 emergency doctors/medical officers, 25 physicians, eight pharmacists/poisons information specialists, two toxicologists, two medical students and one nurse. Median age of participants was 34 years. Median number of years postgraduate was seven. Ninety (65%) had access to either a poisons information centre over the phone or toxicologist and 48 (35%) did not. All participants expected the course to help improve their knowledge. Overall median pre-module MCQ scores were 56% (95%CI: 38, 75%) compared to post-module MCQ scores median 89% (95% CI: 67, 100%) (p education to health professionals treating

Flipping the advanced cardiac life support classroom with team-based learning: comparison of cognitive testing performance for medical students at the University of California, Irvine, United States

Directory of Open Access Journals (Sweden)

Megan Boysen-Osborn

2016-02-01

Full Text Available Purpose: It aimed to find if written test results improved for advanced cardiac life support (ACLS taught in flipped classroom/team-based Learning (FC/TBL vs. lecture-based (LB control in University of California-Irvine School of Medicine, USA. Methods: Medical students took 2010 ACLS with FC/TBL (2015, compared to 3 classes in LB (2012-14 format. There were 27.5 hours of instruction for FC/TBL model (TBL 10.5, podcasts 9, small-group simulation 8 hours, and 20 (12 lecture, simulation 8 hours in LB. TBL covered 13 cardiac cases; LB had none. Seven simulation cases and didactic content were the same by lecture (2012-14 or podcast (2015 as was testing: 50 multiple-choice questions (MCQ, 20 rhythm matchings, and 7 fill-in clinical cases. Results: 354 students took the course (259 [73.1%] in LB in 2012-14, and 95 [26.9%] in FC/TBL in 2015. Two of 3 tests (MCQ and fill-in improved for FC/TBL. Overall, median scores increased from 93.5% (IQR 90.6, 95.4 to 95.1% (92.8, 96.7, P=0.0001. For the fill-in test: 94.1% for LB (89.6, 97.2 to 96.6% for FC/TBL (92.4, 99.20 P=0.0001. For MC: 88% for LB (84, 92 to 90% for FC/TBL (86, 94, P=0.0002. For the rhythm test: median 100% for both formats. More students failed 1 of 3 tests with LB vs. FC/TBL (24.7% vs. 14.7%, and 2 or 3 components (8.1% vs. 3.2%, P=0.006. Conversely, 82.1% passed all 3 with FC/TBL vs. 67.2% with LB (difference 14.9%, 95% CI 4.8-24.0%. Conclusion: A FC/TBL format for ACLS marginally improved written test results.

Two Philosophical Errors Concerning School Choice.

Science.gov (United States)

Brighouse, Harry

1997-01-01

Argues, in contrast to David Hargreaves, that libertarianism implies a mild presumption against school choice, and that notions of common good are significant to educational decision making only when deciding between sets of institutions that perform equally well at delivering their obligations. Links these issues to questions about school choice.…

Work Values and College Major Choice

Science.gov (United States)

Balsamo, Michela; Lauriola, Marco; Saggino, Aristide

2013-01-01

Our study sought to clarify the nature of the known individual differences in work values associated with academic college major choice, specifically the question whether these precede or follow the choice of an academic major. To rule out environmental influences during academic study, group differences in five value orientations were evaluated…

Evaluating the quality of medical multiple-choice items created with automated processes.

Science.gov (United States)

Gierl, Mark J; Lai, Hollis

2013-07-01

Computerised assessment raises formidable challenges because it requires large numbers of test items. Automatic item generation (AIG) can help address this test development problem because it yields large numbers of new items both quickly and efficiently. To date, however, the quality of the items produced using a generative approach has not been evaluated. The purpose of this study was to determine whether automatic processes yield items that meet standards of quality that are appropriate for medical testing. Quality was evaluated firstly by subjecting items created using both AIG and traditional processes to rating by a four-member expert medical panel using indicators of multiple-choice item quality, and secondly by asking the panellists to identify which items were developed using AIG in a blind review. Fifteen items from the domain of therapeutics were created in three different experimental test development conditions. The first 15 items were created by content specialists using traditional test development methods (Group 1 Traditional). The second 15 items were created by the same content specialists using AIG methods (Group 1 AIG). The third 15 items were created by a new group of content specialists using traditional methods (Group 2 Traditional). These 45 items were then evaluated for quality by a four-member panel of medical experts and were subsequently categorised as either Traditional or AIG items. Three outcomes were reported: (i) the items produced using traditional and AIG processes were comparable on seven of eight indicators of multiple-choice item quality; (ii) AIG items can be differentiated from Traditional items by the quality of their distractors, and (iii) the overall predictive accuracy of the four expert medical panellists was 42%. Items generated by AIG methods are, for the most part, equivalent to traditionally developed items from the perspective of expert medical reviewers. While the AIG method produced comparatively fewer plausible

[Towards a pedagogical e-learning approach to improve preparation for medical school curriculum in Grenoble: results over the 10 last years].

Science.gov (United States)

Gillois, Pierre; Pagonis, Daniel; Vuillez, Jean-Philippe; Bosson, Jean-Luc; Romanet, Jean-Paul

2013-02-01

Before 2005, at Grenoble, the teaching of the first year of medicine satisfied neither the students, nor the teachers anxious to exempt a correctly targeted effective teaching. By 2006, the Grenoble-native teaching method was reformed in-depth with the introduction of information and communication technology (ICT) in education. Each sequence was over 4 weeks connecting: self- learning using multi-media resources, questions submitted online, meetings with teaching staff for interactive question-answer sessions in the presence of the teacher,) tutorials animated by older students for Multiple Choice Question (MCQ) training in preparation for the exams. The whole health formation was structured in 12 cycles of this same structured sequence. Since 2010, this method was extended from the faculty of medicine to the faculty of pharmacy and maieutic. Each year, more than 1600 students, 40 teachers and 140 tutors are concerned. The ICT laboratory was responsible for the production of the multi-media support, of the management of the questions online, the collection and the treatment of the evaluations of the lesson by the students. It also took part in the preparation of the MCQ trainings and after each sequence, delivered to students their personal ranking. Staffs between teachers and students are organized for the 12 cycles. The teachers' and students' opinions were analyzed to evaluate the reforms and allow teaching methods to be adapted accordingly. The expressed satisfaction' rate vary from 85% with more than 91% by students and teachers. The intensive use of new information and communication technologies is well accepted, by both sides: teachers and students. After each tutorial, students had their results and their rank, which are linked with the contest result. The mean of the 12 notes obtained during the tutorials is correlated with the note with the contest (R of Spearman=0.75). Student profiles at registration and success in the exams following the reform are

Gender and Ethnicity Differences in Multiple-Choice Testing. Effects of Self-Assessment and Risk-Taking Propensity

Science.gov (United States)

1993-05-01

correctness of the response provides I some advantages. They are: i 1. Increased reliability of the test; 2. Examinees pay more attention to the multiple...their choice 3 of test date. Each sign up sheet was divided into four cells: Non-Hispanic males and females and Hispanic males and females. 3 I I I...certain prestige and financial rewards; or entering a conservatory of music for advanced training with a well-known pianist . Mr. H realizes that even

Discrete choice models with multiplicative error terms

DEFF Research Database (Denmark)

Fosgerau, Mogens; Bierlaire, Michel

2009-01-01

The conditional indirect utility of many random utility maximization (RUM) discrete choice models is specified as a sum of an index V depending on observables and an independent random term ε. In general, the universe of RUM consistent models is much larger, even fixing some specification of V due...

Force Concept Inventory-based multiple-choice test for investigating students’ representational consistency

Directory of Open Access Journals (Sweden)

Pasi Nieminen

2010-08-01

Full Text Available This study investigates students’ ability to interpret multiple representations consistently (i.e., representational consistency in the context of the force concept. For this purpose we developed the Representational Variant of the Force Concept Inventory (R-FCI, which makes use of nine items from the 1995 version of the Force Concept Inventory (FCI. These original FCI items were redesigned using various representations (such as motion map, vectorial and graphical, yielding 27 multiple-choice items concerning four central concepts underpinning the force concept: Newton’s first, second, and third laws, and gravitation. We provide some evidence for the validity and reliability of the R-FCI; this analysis is limited to the student population of one Finnish high school. The students took the R-FCI at the beginning and at the end of their first high school physics course. We found that students’ (n=168 representational consistency (whether scientifically correct or not varied considerably depending on the concept. On average, representational consistency and scientifically correct understanding increased during the instruction, although in the post-test only a few students performed consistently both in terms of representations and scientifically correct understanding. We also compared students’ (n=87 results of the R-FCI and the FCI, and found that they correlated quite well.

The impact of presentation format on visual attention and choice in discrete choice experiments

DEFF Research Database (Denmark)

Mueller Loose, Simone; Orquin, Jacob Lund

with visual attributes, or as product mock-ups simulating realistic products as close as possible. So far little is known about how presentation formats affect visual attention patterns and choice behavior. This study addresses the question by analysing visual attention and part-worth utilities in choice...... experiments across three different presentation formats. Method. Participants’ visual attention was measured by means of eye tracking during a discrete choice experiment for yoghurt products varying on six attributes with two to four levels. The study used a mixed within-between subjects design in which...... the presentation format varied between a verbal information table, a table with visual attributes levels and a realistic product mock-up presentation. Results. A strong relationship between attention and choice was observed so that attributes with a higher importance for participant choices also received a higher...

Investigating the effect of question-driven pedagogy on the development of physics teacher candidates' pedagogical content knowledge

Science.gov (United States)

Milner-Bolotin, Marina; Egersdorfer, Davor; Vinayagam, Murugan

2016-12-01

This paper describes the second year of a multi-year study on the implementation of Peer Instruction and PeerWise-inspired pedagogies in a physics methods course in a teacher education program at a large research university in Western Canada. In the first year of this study, Peer Instruction was implemented consistently in the physics methods course and teacher candidates were asked to submit five conceptual multiple-choice questions as a final assignment. In the second year of the study we incorporated PeerWise online tool to facilitate teacher candidates' design of conceptual questions by allowing them to provide and receive feedback from their peers, and consequently improve their questions. We have found that as a result of this collaboration teacher candidates improved their pedagogical content knowledge as measured by the rubric developed for the study.

Investigating the effect of question-driven pedagogy on the development of physics teacher candidates’ pedagogical content knowledge

Directory of Open Access Journals (Sweden)

Marina Milner-Bolotin

2016-09-01

Full Text Available This paper describes the second year of a multi-year study on the implementation of Peer Instruction and PeerWise-inspired pedagogies in a physics methods course in a teacher education program at a large research university in Western Canada. In the first year of this study, Peer Instruction was implemented consistently in the physics methods course and teacher candidates were asked to submit five conceptual multiple-choice questions as a final assignment. In the second year of the study we incorporated PeerWise online tool to facilitate teacher candidates’ design of conceptual questions by allowing them to provide and receive feedback from their peers, and consequently improve their questions. We have found that as a result of this collaboration teacher candidates improved their pedagogical content knowledge as measured by the rubric developed for the study.

A Difficult Choice? : A study of which factors influence the choice of auditor

OpenAIRE

Embretzén, Johanna; Nilsson, Marie; Olofsson, Sandra

2007-01-01

Because all joint-stock companies in Sweden need to have an auditor we thought it would be interesting to study how companies choose their auditor and which factors influence their choice. Therefore our research question is: “Which factors influence joint-stock companies in their choice of auditor?” The main purpose of the study is to get a better and deeper understanding of the subject, in order to clarify the purpose we established three sub purposes: • Establish which determinants that pla...

More than the Verbal Stimulus Matters: Visual Attention in Language Assessment for People with Aphasia Using Multiple-Choice Image Displays

Science.gov (United States)

Heuer, Sabine; Ivanova, Maria V.; Hallowell, Brooke

2017-01-01

Purpose: Language comprehension in people with aphasia (PWA) is frequently evaluated using multiple-choice displays: PWA are asked to choose the image that best corresponds to the verbal stimulus in a display. When a nontarget image is selected, comprehension failure is assumed. However, stimulus-driven factors unrelated to linguistic…

Improving large class performance and engagement through student-generated question banks.

Science.gov (United States)

Hancock, Dale; Hare, Nicole; Denny, Paul; Denyer, Gareth

2018-03-12

Disciplines such as Biochemistry and Molecular Biology, which involve concepts not included in the high-school curriculum, are very challenging for many first year university students. These subjects are particularly difficult for students accustomed to surface learning strategies involving memorization and recall of facts, as a deeper understanding of the relationship between concepts is needed for successful transfer to related areas and subsequent study. In this article, we explore an activity in a very large first year Molecular Biology course, in which students create multiple-choice questions related to targeted learning outcomes, and then answer and evaluate one another's questions. This activity encompasses elements of both self- and peer-assessment and the generative tasks of creating questions and producing written feedback may contribute to a deeper understanding of the material. We make use of a free online platform to facilitate all aspects of the process and analyze the effect of student engagement with the task on overall course performance. When compared to previous semester's cohorts, we observe a pronounced improvement in class performance on exam questions targeting similar concepts to the student-generated questions. In addition, those students that engage to a greater extent with the activity perform significantly better on the targeted exam questions than those who are less active, yet all students perform similarly on a set of isolated control questions appearing on the same exam. © 2018 by The International Union of Biochemistry and Molecular Biology, 2018. © 2018 The International Union of Biochemistry and Molecular Biology.

Choice, internal consistency, and rationality

OpenAIRE

Aditi Bhattacharyya; Prasanta K. Pattanaik; Yongsheng Xu

2010-01-01

The classical theory of rational choice is built on several important internal consistency conditions. In recent years, the reasonableness of those internal consistency conditions has been questioned and criticized, and several responses to accommodate such criticisms have been proposed in the literature. This paper develops a general framework to accommodate the issues raised by the criticisms of classical rational choice theory, and examines the broad impact of these criticisms from both no...

Connecting cognition and consumer choice.

Science.gov (United States)

Bartels, Daniel M; Johnson, Eric J

2015-02-01

We describe what can be gained from connecting cognition and consumer choice by discussing two contexts ripe for interaction between the two fields. The first-context effects on choice-has already been addressed by cognitive science yielding insights about cognitive process but there is promise for more interaction. The second is learning and representation in choice where relevant theories in cognitive science could be informed by consumer choice, and in return, could pose and answer new questions. We conclude by discussing how these two fields of research stand to benefit from more interaction, citing examples of how interfaces of cognitive science with other fields have been illuminating for theories of cognition. Copyright © 2014 Elsevier B.V. All rights reserved.

The Policy Choices of Bureaucrats: an institutional analysis

NARCIS (Netherlands)

S. Naseer (Shaheen)

2018-01-01

textabstractThis dissertation analyzes the over-arching question of how the institutional and social context of public bureaucracy impact the choices of bureaucrats. These choices are introduced in the form of inertial-preferences and identity-driven preferences in the decision-making of

Phrasal Paraphrase Based Question Reformulation for Archived Question Retrieval.

Directory of Open Access Journals (Sweden)

Yu Zhang

Full Text Available Lexical gap in cQA search, resulted by the variability of languages, has been recognized as an important and widespread phenomenon. To address the problem, this paper presents a question reformulation scheme to enhance the question retrieval model by fully exploring the intelligence of paraphrase in phrase-level. It compensates for the existing paraphrasing research in a suitable granularity, which either falls into fine-grained lexical-level or coarse-grained sentence-level. Given a question in natural language, our scheme first detects the involved key-phrases by jointly integrating the corpus-dependent knowledge and question-aware cues. Next, it automatically extracts the paraphrases for each identified key-phrase utilizing multiple online translation engines, and then selects the most relevant reformulations from a large group of question rewrites, which is formed by full permutation and combination of the generated paraphrases. Extensive evaluations on a real world data set demonstrate that our model is able to characterize the complex questions and achieves promising performance as compared to the state-of-the-art methods.

Topical questions in magnetic resonance imaging

International Nuclear Information System (INIS)

Andrew, E.R.; Florida Univ., Gainesville, FL; Florida Univ., Gainesville, FL

1989-01-01

This paper examines a number of practical questions concerning magnetic resonance imaging. These include the choice of operating magnetic field strength, the problem of siting and screening, a procedure for securing precise slice selection and the use of paramagnetic contrast agents. (author). 5 refs

Solving the redundancy allocation problem with multiple strategy choices using a new simplified particle swarm optimization

International Nuclear Information System (INIS)

Kong, Xiangyong; Gao, Liqun; Ouyang, Haibin; Li, Steven

2015-01-01

In most research on redundancy allocation problem (RAP), the redundancy strategy for each subsystem is assumed to be predetermined and fixed. This paper focuses on a specific RAP with multiple strategy choices (RAP-MSC), in which both active redundancy and cold standby redundancy can be selected as an additional decision variable for individual subsystems. To do so, the component type, redundancy strategy and redundancy level for each subsystem should be chosen subject to the system constraints appropriately such that the system reliability is maximized. Meanwhile, imperfect switching for cold standby redundancy is considered and a k-Erlang distribution is introduced to model the time-to-failure component as well. Given the importance and complexity of RAP-MSC, we propose a new efficient simplified version of particle swarm optimization (SPSO) to solve such NP-hard problems. In this method, a new position updating scheme without velocity is presented with stochastic disturbance and a low probability. Moreover, it is compared with several well-known PSO variants and other state-of-the-art approaches in the literature to evaluate its performance. The experiment results demonstrate the superiority of SPSO as an alternative for solving the RAP-MSC. - Highlights: • A more realistic RAP form with multiple strategy choices is focused. • Redundancy strategies are to be selected rather than fixed in general RAP. • A new simplified particle swarm optimization is proposed. • Higher reliabilities are achieved than the state-of-the-art approaches.

Solving the Single-Sink, Fixed-Charge, Multiple-Choice Transportation Problem by Dynamic Programming

DEFF Research Database (Denmark)

Rauff Lind Christensen, Tue; Klose, Andreas; Andersen, Kim Allan

important aspects of supplier selection, an important application of the SSFCTP, this does not reflect the real life situation. First, transportation costs faced by many companies are in fact piecewise linear. Secondly, when suppliers offer discounts, either incremental or all-unit discounts, such savings......The Single-Sink, Fixed-Charge, Multiple-Choice Transportation Problem (SSFCMCTP) is a problem with versatile applications. This problem is a generalization of the Single-Sink, Fixed-Charge Transportation Problem (SSFCTP), which has a fixed-charge, linear cost structure. However, in at least two...... are neglected in the SSFCTP. The SSFCMCTP overcome this problem by incorporating a staircase cost structure in the cost function instead of the usual one used in SSFCTP. We present a dynamic programming algorithm for the resulting problem. To enhance the performance of the generic algorithm a number...

Solving the Single-Sink, Fixed-Charge, Multiple-Choice Transportation Problem by Dynamic Programming

DEFF Research Database (Denmark)

Christensen, Tue; Andersen, Kim Allan; Klose, Andreas

2013-01-01

This paper considers a minimum-cost network flow problem in a bipartite graph with a single sink. The transportation costs exhibit a staircase cost structure because such types of transportation cost functions are often found in practice. We present a dynamic programming algorithm for solving...... this so-called single-sink, fixed-charge, multiple-choice transportation problem exactly. The method exploits heuristics and lower bounds to peg binary variables, improve bounds on flow variables, and reduce the state-space variable. In this way, the dynamic programming method is able to solve large...... instances with up to 10,000 nodes and 10 different transportation modes in a few seconds, much less time than required by a widely used mixed-integer programming solver and other methods proposed in the literature for this problem....

Dynamic Portfolio Choice with Frictions

DEFF Research Database (Denmark)

Garleanu, Nicolae; Heje Pedersen, Lasse

2016-01-01

We show how portfolio choice can be modeled in continuous time with transitory and persistent transaction costs, multiple assets, multiple signals predicting returns, and general signal dynamics. The objective function is derived from the limit of discrete-time models with endogenous transaction...

Constructing food choice decisions.

Science.gov (United States)

Sobal, Jeffery; Bisogni, Carole A

2009-12-01

Food choice decisions are frequent, multifaceted, situational, dynamic, and complex and lead to food behaviors where people acquire, prepare, serve, give away, store, eat, and clean up. Many disciplines and fields examine decision making. Several classes of theories are applicable to food decision making, including social behavior, social facts, and social definition perspectives. Each offers some insights but also makes limiting assumptions that prevent fully explaining food choice decisions. We used constructionist social definition perspectives to inductively develop a food choice process model that organizes a broad scope of factors and dynamics involved in food behaviors. This food choice process model includes (1) life course events and experiences that establish a food choice trajectory through transitions, turning points, timing, and contexts; (2) influences on food choices that include cultural ideals, personal factors, resources, social factors, and present contexts; and (3) a personal system that develops food choice values, negotiates and balances values, classifies foods and situations, and forms/revises food choice strategies, scripts, and routines. The parts of the model dynamically interact to make food choice decisions leading to food behaviors. No single theory can fully explain decision making in food behavior. Multiple perspectives are needed, including constructionist thinking.

Angelina′s choice

Directory of Open Access Journals (Sweden)

Nishu Singh Goel

2013-01-01

Full Text Available This is an opinion piece on how a celebrity′s personal choice to undergo prophylactic mastectomy on discovery of an aberrant gene, when publicly promoted, carries in itself the power to influence and impact healthcare trends and decisions. When celebrities advocate causes that are universally and uniformly acceptable and indisputable as the best in the realm of healthcare and cure (e.g. no smoking, it creates well-being and awareness in society at large. But those which are personal choices made out of a repertoire of other available and effective options may, because of celebrity preference, don the mantle of a norm. They thus run the danger of being blindly replicated by others without proper awareness and knowledge of the true potential of disease, risk factors, and other existing remedial or risk-reducing measures. Society should thus be encouraged to question, debate, and understand the validity, authenticity, and reason of the choices, especially those with a medical basis. This tempering of information with intelligence and rationale and making informed choices based on facts will serve humanity as a whole.

Simultaneous modeling of visual saliency and value computation improves predictions of economic choice.

Science.gov (United States)

Towal, R Blythe; Mormann, Milica; Koch, Christof

2013-10-01

Many decisions we make require visually identifying and evaluating numerous alternatives quickly. These usually vary in reward, or value, and in low-level visual properties, such as saliency. Both saliency and value influence the final decision. In particular, saliency affects fixation locations and durations, which are predictive of choices. However, it is unknown how saliency propagates to the final decision. Moreover, the relative influence of saliency and value is unclear. Here we address these questions with an integrated model that combines a perceptual decision process about where and when to look with an economic decision process about what to choose. The perceptual decision process is modeled as a drift-diffusion model (DDM) process for each alternative. Using psychophysical data from a multiple-alternative, forced-choice task, in which subjects have to pick one food item from a crowded display via eye movements, we test four models where each DDM process is driven by (i) saliency or (ii) value alone or (iii) an additive or (iv) a multiplicative combination of both. We find that models including both saliency and value weighted in a one-third to two-thirds ratio (saliency-to-value) significantly outperform models based on either quantity alone. These eye fixation patterns modulate an economic decision process, also described as a DDM process driven by value. Our combined model quantitatively explains fixation patterns and choices with similar or better accuracy than previous models, suggesting that visual saliency has a smaller, but significant, influence than value and that saliency affects choices indirectly through perceptual decisions that modulate economic decisions.

A forecast of household ownership and use of alternative fuel vehicles: A multiple discrete-continuous choice approach

Energy Technology Data Exchange (ETDEWEB)

Ahn, Jiwoon [Korea Energy Economics Institute, Naeson 2-dong, Uiwang-si, Gyeonggi-do, 437-713 (Korea); Jeong, Gicheol [Technology Management, Economics and Policy Program, 37-402, College of Engineering, Seoul National University, San 56-1, Sillim-dong, Gwanak-gu, Seoul, 151-744 (Korea); Kim, Yeonbae [Technology Management, Economics and Policy Program, 37-318, College of Engineering, Seoul National University, San 56-1, Sillim-dong, Gwanak-gu, South Seoul, 151-744 (Korea)

2008-09-15

The paper analyzes how adding alternative fuel passenger cars to the market will affect patterns in demand for passenger cars. We use conjoint analysis and a multiple discrete-continuous choice model to estimate consumer preferences regarding alternative fuel vehicles, and based on the estimates we conduct a simulation to analyze changing rates of ownership and use of variously fueled passenger cars under the effect of the introduction of alternative fuel passenger cars. In addition, we estimate changes in overall fuel consumption and the emission of pollutants. The results show that gasoline-fueled cars will still be most consumers' first choice, but alternative fuel passenger cars will nevertheless compete and offer a substitute for the purchase and use of gasoline-fueled or diesel-fueled cars. Finally, results show that adding alternative fuel cars to the market would effectively lower gasoline and diesel fuel consumption and the emission of pollutants. (author)

A forecast of household ownership and use of alternative fuel vehicles: A multiple discrete-continuous choice approach

International Nuclear Information System (INIS)

Ahn, Jiwoon; Jeong, Gicheol; Kim, Yeonbae

2008-01-01

The paper analyzes how adding alternative fuel passenger cars to the market will affect patterns in demand for passenger cars. We use conjoint analysis and a multiple discrete-continuous choice model to estimate consumer preferences regarding alternative fuel vehicles, and based on the estimates we conduct a simulation to analyze changing rates of ownership and use of variously fueled passenger cars under the effect of the introduction of alternative fuel passenger cars. In addition, we estimate changes in overall fuel consumption and the emission of pollutants. The results show that gasoline-fueled cars will still be most consumers' first choice, but alternative fuel passenger cars will nevertheless compete and offer a substitute for the purchase and use of gasoline-fueled or diesel-fueled cars. Finally, results show that adding alternative fuel cars to the market would effectively lower gasoline and diesel fuel consumption and the emission of pollutants. (author)

Difficult Questions of Difficult Questions: The Role of The Researcher and Transcription Styles

Science.gov (United States)

Henderson, Holly

2018-01-01

This paper refracts a comparison of three distinct transcription styles through questions of researcher reflexivity. It uses the data from a single question asked by the researcher in multiple interviews for a small empirical project. These data are transcribed in three ways, and the resulting transcripts are discussed in relation to the analysis…

Rational Choice Theory in Sociology: A Methodological Argument

Directory of Open Access Journals (Sweden)

ALEXANDRA GHEONDEA-ELADI

2013-07-01

Full Text Available În the last years, rational choice theory (RCT took over a lot of the social sciences, almost polarizing discussions in sociology, such that I was able to hear questions like: are there any other theories in sociology, besides rational choice theory? Although the answer to this question is clearly yes, what seems to be important to avoid is that the moment when this theory monopolizes behavioural explanations in a multi-paradigmatic discipline should not come from partial or incomplete knowledge of it. Consequently, I decided to write this article with two goals in mind: one, to make a review of what rational choice theory is and means to sociology and secondly, to shortly present a research which questioned the structuring of social events according to this theory[1]. In the first part of this paper, I will present the main aspects of rational choice theory, such that I can argue for choosing one of its variants in the second section. In the last part I will present the methodology I used to explore the closeness of the Volunteer's Dilemma (as Diekmann (1985, 1993 proposed it to the volunteering situation in Romania. I shall do this by aid of institutional analysis and interview analysis. The results of the research will be briefly described, such that, in the end, the conclusions can summarize the main ideas about rational choice theory emerging from this article.

RATIONAL CHOICE THEORY IN SOCIOLOGY: A METHODOLOGICAL ARGUMENT

Directory of Open Access Journals (Sweden)

ALEXANDRA GHEONDEA-ELADI

2013-01-01

Full Text Available În the last years, rational choice theory (RCT took over a lot of the social sciences, almost polarizing discussions in sociology, such that I was able to hear questions like: are there any other theories in sociology, besides rational choice theory? Although the answer to this question is clearly yes, what seems to be important to avoid is that the moment when this theory monopolizes behavioural explanations in a multi-paradigmatic discipline should not come from partial or incomplete knowledge of it. Consequently, I decided to write this article with two goals in mind: one, to make a review of what rational choice theory is and means to sociology and secondly, to shortly present a research which questioned the structuring of social events according to this theory2. In the first part of this paper, I will present the main aspects of rational choice theory, such that I can argue for choosing one of its variants in the second section. In the last part I will present the methodology I used to explore the closeness of the Volunteer’s Dilemma (as Diekmann (1985, 1993 proposed it to the volunteering situation in Romania. I shall do this by aid of institutional analysis and interview analysis. The results of the research will be briefly described, such that, in the end, the conclusions can summarize the main ideas about rational choice theory emerging from this article

Post-Graduate Student Performance in "Supervised In-Class" vs. "Unsupervised Online" Multiple Choice Tests: Implications for Cheating and Test Security

Science.gov (United States)

Ladyshewsky, Richard K.

2015-01-01

This research explores differences in multiple choice test (MCT) scores in a cohort of post-graduate students enrolled in a management and leadership course. A total of 250 students completed the MCT in either a supervised in-class paper and pencil test or an unsupervised online test. The only statistically significant difference between the nine…

Change in hippocampal theta oscillation associated with multiple lever presses in a bimanual two-lever choice task for robot control in rats.

Directory of Open Access Journals (Sweden)

Norifumi Tanaka

Full Text Available Hippocampal theta oscillations have been implicated in working memory and attentional process, which might be useful for the brain-machine interface (BMI. To further elucidate the properties of the hippocampal theta oscillations that can be used in BMI, we investigated hippocampal theta oscillations during a two-lever choice task. During the task body-restrained rats were trained with a food reward to move an e-puck robot towards them by pressing the correct lever, ipsilateral to the robot several times, using the ipsilateral forelimb. The robot carried food and moved along a semicircle track set in front of the rat. We demonstrated that the power of hippocampal theta oscillations gradually increased during a 6-s preparatory period before the start of multiple lever pressing, irrespective of whether the correct lever choice or forelimb side were used. In addition, there was a significant difference in the theta power after the first choice, between correct and incorrect trials. During the correct trials the theta power was highest during the first lever-releasing period, whereas in the incorrect trials it occurred during the second correct lever-pressing period. We also analyzed the hippocampal theta oscillations at the termination of multiple lever pressing during the correct trials. Irrespective of whether the correct forelimb side was used, the power of hippocampal theta oscillations gradually decreased with the termination of multiple lever pressing. The frequency of theta oscillation also demonstrated an increase and decrease, before and after multiple lever pressing, respectively. There was a transient increase in frequency after the first lever press during the incorrect trials, while no such increase was observed during the correct trials. These results suggested that hippocampal theta oscillations reflect some aspects of preparatory and cognitive neural activities during the robot controlling task, which could be used for BMI.

Development and conceptual validation of a questionnaire to help contraceptive choice: CHLOE (Contraception: HeLping for wOmen's choicE).

Science.gov (United States)

Jamin, Christian Georges; Häusler, Gunther; Lobo Abascal, Paloma; Fiala, Christian; Lete Lasa, Luis Ignacio; Nappi, Rossella Elena; Micheletti, Marie-Christine; Fernández-Dorado, Ana; Pintiaux, Axelle; Chabbert-Buffet, Natalie

2017-08-01

The aim of this research was to develop a questionnaire to facilitate choice of the most appropriate contraceptive method for individual women. A literature review was conducted to identify key aspects influencing contraceptive choice and inform development of a questionnaire for online completion. Questionnaire development was overseen by a steering committee consisting of eight gynaecologists from across Europe. The initial draft underwent conceptual validation through cognitive debriefing interviews with six native English-speaking women. A qualitative content analysis was conducted to accurately identify potential issues and areas for questionnaire improvement. A revised version of the questionnaire then underwent face-to-face and online evaluation by 115 international gynaecologists/obstetricians with expertise in contraception, prior to development of a final version. The final conceptually validated Contraception: HeLping for wOmen's choicE (CHLOE) questionnaire takes ≤10 min to complete and includes three sections to elicit general information about the individual, the health conditions that might influence contraceptive choice, and the woman's needs and preferences that might influence contraceptive choice. The questionnaire captures the core aspects of personalisation, efficacy and safety, identified as key attributes influencing contraceptive choice, and consists of 24 closed-ended questions for online completion prior to a health care provider (HCP) consultation. The HCP receives a summary of the responses. The CHLOE questionnaire has been developed to help women choose the contraception that best suits their needs and situation while optimising the HCP's time.

Using peer discussion facilitated by clicker questions in an informal education setting: enhancing farmer learning of science.

Directory of Open Access Journals (Sweden)

Michelle K Smith

Full Text Available Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions.

Using Peer Discussion Facilitated by Clicker Questions in an Informal Education Setting: Enhancing Farmer Learning of Science

Science.gov (United States)

Smith, Michelle K.; Annis, Seanna L.; Kaplan, Jennifer J.; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions. PMID:23077638

Using peer discussion facilitated by clicker questions in an informal education setting: enhancing farmer learning of science.

Science.gov (United States)

Smith, Michelle K; Annis, Seanna L; Kaplan, Jennifer J; Drummond, Frank

2012-01-01

Blueberry growers in Maine attend annual Cooperative Extension presentations given by university faculty members. These presentations cover topics, such as, how to prevent plant disease and monitor for insect pests. In 2012, in order to make the sessions more interactive and promote learning, clicker questions and peer discussion were incorporated into the presentations. Similar to what has been shown at the undergraduate level, after peer discussion, more blueberry growers gave correct answers to multiple-choice questions than when answering independently. Furthermore, because blueberry growers are characterized by diverse levels of education, experience in the field etc., we were able to determine whether demographic factors were associated with changes in performance after peer discussion. Taken together, our results suggest that clicker questions and peer discussion work equally well with adults from a variety of demographic backgrounds without disadvantaging a subset of the population and provide an important learning opportunity to the least formally educated members. Our results also indicate that clicker questions with peer discussion were viewed as a positive addition to university-related informal science education sessions.

Behavioural social choice: a status report.

Science.gov (United States)

Regenwetter, Michel; Grofman, Bernard; Popova, Anna; Messner, William; Davis-Stober, Clintin P; Cavagnaro, Daniel R

2009-03-27

Behavioural social choice has been proposed as a social choice parallel to seminal developments in other decision sciences, such as behavioural decision theory, behavioural economics, behavioural finance and behavioural game theory. Behavioural paradigms compare how rational actors should make certain types of decisions with how real decision makers behave empirically. We highlight that important theoretical predictions in social choice theory change dramatically under even minute violations of standard assumptions. Empirical data violate those critical assumptions. We argue that the nature of preference distributions in electorates is ultimately an empirical question, which social choice theory has often neglected. We also emphasize important insights for research on decision making by individuals. When researchers aggregate individual choice behaviour in laboratory experiments to report summary statistics, they are implicitly applying social choice rules. Thus, they should be aware of the potential for aggregation paradoxes. We hypothesize that such problems may substantially mar the conclusions of a number of (sometimes seminal) papers in behavioural decision research.

Brief, cooperative peer-instruction sessions during lectures enhance student recall and comprehension*

Science.gov (United States)

Zhang, Niu; Henderson, Charles N.R.

2016-01-01

Objective: The objective of this study was to evaluate the academic impact of cooperative peer instruction during lecture pauses in an immunology/endocrinology course. Methods: Third-quarter students participated across iterations of the course. Each class offered 20 lectures of 50 minutes each. Classes were divided into a peer-instruction group incorporating cooperative peer instruction and a control group receiving traditional lectures. Peer-instruction group lectures were divided into 2–3 short presentations followed by a multiple-choice question (MCQ). Students recorded an initial answer and then had 1 minute to discuss answers with group peers. Following this, students could submit a revised answer. The control group received the same lecture material, but without MCQs or peer discussions. Final-exam scores were compared across study groups. A mixed-design analysis of covariance was used to analyze the data. Results: There was a statistically significant main effect for the peer-instruction activity (F(1, 93) = 6.573, p = .012, r = .257), with recall scores higher for MCQs asked after peer-instruction activities than for those asked before peer instruction. Final-exam scores at the end of term were greater in the peer-instruction group than the control group (F(1, 193) = 9.264, p = .003, r = .214; question type, F(1, 193) = 26.671, p = .000, r = .348). Conclusion: Lectures with peer-instruction pauses increase student recall and comprehension compared with traditional lectures. PMID:26967766

Can Facebook pages be a mode of blended learning to supplement in-class teaching in Saudi Arabia?

Science.gov (United States)

Anwar, Khurshid; Sajid, Muhammad Raihan; Cahusac, Peter; Shaikh, Abdul Ahad; Elgammal, Ahmad; Alshedoukhy, Ahlam; Kashir, Junaid

2017-09-01

The aim of this study was to examine the potential of a self-designed Facebook page on Neuroscience, to supplement in-class teaching as a mode of blended learning. Posts were split into multiple choice questions (MCQs), general interest articles, neuroscience-related external links and resources, and lecture notes and PowerPoint presentations. The study was divided into three distinct phases: before, during, and after the Neuroscience block. Student responses were evaluated via a self-developed questionnaire. Grades achieved by students undertaking the block in 2015 and 2014 were recorded, as were the grades achieved by the same cohort in concurrent blocks in the same year of study. Results showed that ~80% of students reported that use of the page enhanced their overall subject knowledge and exam preparation. Highest page activity occurred during the Neuroscience block. Peak activity occurred directly before summative assessments, with MCQ posts having the highest impact. The cohort of students with access to the Facebook page achieved better grades in the block compared with the previous cohort, despite similar average performance in other subjects. We demonstrate the utility of Facebook as a powerful tool for undergraduate education, supplementing in-class teaching, and assisting in exam preparation, potentially increasing average student performance. Copyright © 2017 the American Physiological Society.

Complement or Contamination: A Study of the Validity of Multiple-Choice Items when Assessing Reasoning Skills in Physics

OpenAIRE

Anders Jönsson; David Rosenlund; Fredrik Alvén

2017-01-01

The purpose of this study is to investigate the validity of using multiple-choice (MC) items as a complement to constructed-response (CR) items when making decisions about student performance on reasoning tasks. CR items from a national test in physics have been reformulated into MC items and students’ reasoning skills have been analyzed in two substudies. In the first study, 12 students answered the MC items and were asked to explain their answers orally. In the second study, 102 students fr...

Performance of Men and Women on Multiple-Choice and Constructed-Response Tests for Beginning Teachers. Research Report. ETS RR-04-48

Science.gov (United States)

Livingston, Samuel A.; Rupp, Stacie L.

2004-01-01

Some previous research results imply that women tend to perform better, relative to men, on constructed-response (CR) tests than on multiple-choice (MC) tests in the same subjects. An analysis of data from several tests used in the licensing of beginning teachers supported this hypothesis, to varying degrees, in most of the tests investigated. The…

Towards natural language question generation for the validation of ontologies and mappings.

Science.gov (United States)

Ben Abacha, Asma; Dos Reis, Julio Cesar; Mrabet, Yassine; Pruski, Cédric; Da Silveira, Marcos

2016-08-08

The increasing number of open-access ontologies and their key role in several applications such as decision-support systems highlight the importance of their validation. Human expertise is crucial for the validation of ontologies from a domain point-of-view. However, the growing number of ontologies and their fast evolution over time make manual validation challenging. We propose a novel semi-automatic approach based on the generation of natural language (NL) questions to support the validation of ontologies and their evolution. The proposed approach includes the automatic generation, factorization and ordering of NL questions from medical ontologies. The final validation and correction is performed by submitting these questions to domain experts and automatically analyzing their feedback. We also propose a second approach for the validation of mappings impacted by ontology changes. The method exploits the context of the changes to propose correction alternatives presented as Multiple Choice Questions. This research provides a question optimization strategy to maximize the validation of ontology entities with a reduced number of questions. We evaluate our approach for the validation of three medical ontologies. We also evaluate the feasibility and efficiency of our mappings validation approach in the context of ontology evolution. These experiments are performed with different versions of SNOMED-CT and ICD9. The obtained experimental results suggest the feasibility and adequacy of our approach to support the validation of interconnected and evolving ontologies. Results also suggest that taking into account RDFS and OWL entailment helps reducing the number of questions and validation time. The application of our approach to validate mapping evolution also shows the difficulty of adapting mapping evolution over time and highlights the importance of semi-automatic validation.

Ti praktiske, teoribaserede råd til planlaeggere af kliniske kurser

DEFF Research Database (Denmark)

Balslev, Thomas; Westphall, Ian; Blichfeldt, Susanne

2008-01-01

pattern recognition and hypothetic-deductive approaches. Interactive approaches, for example, questioning, quizzes or buzz groups imply active involvement and participation. Quizzes and MCQ-testing can provide a formative 'check-up' on learning and point to gaps in understanding for the teachers...

Test of understanding of vectors: A reliable multiple-choice vector concept test

Science.gov (United States)

Barniol, Pablo; Zavala, Genaro

2014-06-01

In this article we discuss the findings of our research on students' understanding of vector concepts in problems without physical context. First, we develop a complete taxonomy of the most frequent errors made by university students when learning vector concepts. This study is based on the results of several test administrations of open-ended problems in which a total of 2067 students participated. Using this taxonomy, we then designed a 20-item multiple-choice test [Test of understanding of vectors (TUV)] and administered it in English to 423 students who were completing the required sequence of introductory physics courses at a large private Mexican university. We evaluated the test's content validity, reliability, and discriminatory power. The results indicate that the TUV is a reliable assessment tool. We also conducted a detailed analysis of the students' understanding of the vector concepts evaluated in the test. The TUV is included in the Supplemental Material as a resource for other researchers studying vector learning, as well as instructors teaching the material.

Using New Mode Choice Model Nesting Structures to Address Emerging Policy Questions: A Case Study of the Pittsburgh Central Business District

Directory of Open Access Journals (Sweden)

Zulqarnain H. Khattak

2017-11-01

Full Text Available As transportation activities affect a region’s environmental quality, knowing why individuals prefer certain modes can help a region make judicious transportation investments. Using a nested logit model, this paper studies the behavior of commuters to downtown Pittsburgh who use auto, bus, light rail, walking, and biking. Although statistical measures influence the selection of a nesting structure, another criterion for model selection is the policy questions such models inform. Hence this paper demonstrates how an alternative model structure allows planners to consider new policy questions. For example, how might a change in parking fee affect greenhouse gas emission (GHGs? The proposed model showed that a 5%, 10% and 15% increase in parking cost reduces GHGs by 7.3%, 9% and 13.2%, respectively, through increasing carpoolers’ mode share. Because the proposed model forecasts mode choices of certain groups of travelers with higher accuracy (compared to an older model that did not consider the model selection criteria presented here, the proposed model strengthens policymakers’ ability to consider environmental impacts of interest to the region (in this case, GHGs. The paper does not suggest that one nesting structure is always preferable; rather the nesting structure must be chosen with the policy considerations in mind.

Simple model for multiple-choice collective decision making.

Science.gov (United States)

Lee, Ching Hua; Lucas, Andrew

2014-11-01

We describe a simple model of heterogeneous, interacting agents making decisions between n≥2 discrete choices. For a special class of interactions, our model is the mean field description of random field Potts-like models and is effectively solved by finding the extrema of the average energy E per agent. In these cases, by studying the propagation of decision changes via avalanches, we argue that macroscopic dynamics is well captured by a gradient flow along E. We focus on the permutation symmetric case, where all n choices are (on average) the same, and spontaneous symmetry breaking (SSB) arises purely from cooperative social interactions. As examples, we show that bimodal heterogeneity naturally provides a mechanism for the spontaneous formation of hierarchies between decisions and that SSB is a preferred instability to discontinuous phase transitions between two symmetric points. Beyond the mean field limit, exponentially many stable equilibria emerge when we place this model on a graph of finite mean degree. We conclude with speculation on decision making with persistent collective oscillations. Throughout the paper, we emphasize analogies between methods of solution to our model and common intuition from diverse areas of physics, including statistical physics and electromagnetism.

Answer selection in a multi-stream open domain question answering system

NARCIS (Netherlands)

Jijkoun, V.; de Rijke, M.; McDonald, S.; Tait, J.

2004-01-01

Question answering systems aim to meet users' information needs by returning exact answers in response to a question. Traditional open domain question answering systems are built around a single pipeline architecture. In an attempt to exploit multiple resources as well as multiple answering

What counts as a choice? U.S. Americans are more likely than Indians to construe actions as choices.

Science.gov (United States)

Savani, Krishna; Markus, Hazel Rose; Naidu, N V R; Kumar, Satishchandra; Berlia, Neha

2010-03-01

People everywhere select among multiple alternatives, but are they always making choices? In five studies, we found that people in U.S. American contexts, where the disjoint model of agency is prevalent, are more likely than those in Indian contexts to construe their own and other individuals' behaviors as choices, to construe ongoing behaviors and behaviors recalled from memory as choices, to construe naturally occurring and experimentally controlled behaviors as choices, to construe mundane and important actions as choices, and to construe personal and interpersonal actions as choices. Indians showed a greater tendency to construe actions as choices when these actions involved responding to other people than when they did not. These findings show that whether people construe actions as choices is significantly shaped by sociocultural systems of meanings and practices. Together, they suggest that the positive consequences associated with maximizing the availability of personal choice may not be universal and instead may be limited to North American contexts.

On Procedural Freedom of Choice

NARCIS (Netherlands)

Arlegi, R.; Dimitrov, D.A.

2004-01-01

Numerous works in the last decade have analyzed the question of how to compare opportunity sets as a way to measure and evaluate individual freedom of choice.This paper defends that, in many contexts, external procedural aspects that are associated to an opportunity set should be taken into account

Maternity experiences of mothers with multiple disadvantages in England: A qualitative study.

Science.gov (United States)

McLeish, Jenny; Redshaw, Maggie

2018-06-14

Disadvantaged mothers and their babies are at increased risk of poor perinatal outcomes and have less positive experiences of maternity care. To explore the maternity care experiences of mothers with multiple disadvantages. A qualitative descriptive study based on semi-structured interviews with 40 mothers with multiple disadvantages, using thematic analysis. Four themes emerged: 'A confusing and frightening time', 'Longing to be respected as an individual', 'The importance of choice and control', and 'Needing trust to feel safe'. Mothers brought feelings of powerlessness and low self-esteem to their encounters with maternity professionals, which could be significantly worsened by disrespectful care. They needed support to navigate the complex maternity system. Positive experiences were much more likely where the mother had received continuity of care from a specialist midwife or small team. Mothers with multiple disadvantages value being treated as an individual, making informed choices, and feeling safe, but they may lack the confidence to ask questions or challenge disrespectful treatment. Training and supervision should enable maternity professionals to understand how confusing maternity care can be to very disadvantaged mothers. It should emphasise the need to provide accessible and empowering information and guidance to enable all mothers to make choices and understand the system. Leaders of maternity services need to do more to challenge negative staff attitudes and ensure that that all mothers are treated at all times with kindness, respect and dignity. Specialist midwives can deliver a high quality service to mothers experiencing multiple disadvantages. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Predicting Social and Communicative Ability in School-Age Children with Autism Spectrum Disorder: A Pilot Study of the Social Attribution Task, Multiple Choice

Science.gov (United States)

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-01-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The…

Choosy but not chaste: multiple mating in human females.

Science.gov (United States)

Scelza, Brooke A

2013-01-01

When Charles Darwin set out to relate his theory of evolution by natural selection to humans he discovered that a complementary explanation was needed to properly understand the great variation seen in human behavior. The resulting work, The Descent of Man and Selection in Relation to Sex, laid out the defining principles and evidence of sexual selection. In brief, this work is best known for illuminating the typically male strategy of intrasexual competition and the typically female response of intersexual choice. While these sexual stereotypes were first laid out by Darwin, they grew in importance when, years later, A. J. Bateman, in a careful study of Drosophila mating strategies, noted that multiple mating appeared to provide great benefit to male reproductive success, but to have no such effect on females. As a result, female choice soon became synonymous with being coy, and only males were thought to gain from promiscuous behavior. However, the last thirty years of research have served to question much of the traditional wisdom about sex differences proposed by Darwin and Bateman, illuminating the many ways that women (and females more generally) can and do engage in multiple mating. Copyright © 2013 Wiley Periodicals, Inc.

Some open questions in 'wave chaos'

International Nuclear Information System (INIS)

Nonnenmacher, Stéphane

2008-01-01

The subject area referred to as 'wave chaos', 'quantum chaos' or 'quantum chaology' has been investigated mostly by the theoretical physics community in the last 30 years. The questions it raises have more recently also attracted the attention of mathematicians and mathematical physicists, due to connections with number theory, graph theory, Riemannian, hyperbolic or complex geometry, classical dynamical systems, probability, etc. After giving a rough account on 'what is quantum chaos?', I intend to list some pending questions, some of them having been raised a long time ago, some others more recent. The choice of problems (and of references) is of course partial and personal. (open problem)

THE RELIABILITY OF IDENTIFICATION EVIDENCE WITH MULTIPLE LINEUPS

Directory of Open Access Journals (Sweden)

Nick J. Broers

2013-01-01

Full Text Available This study aimed to establish the diagnostic value of multiple lineup decisions made for portrait, body, and profile lineups, including multiple target/suspect choices, rejections, foil choices, and don’t know answers. A total of 192 participants identified a thief and a victim of theft from independent simultaneous target-present or target-absent 6-person portrait, body and profile lineups after watching one of two stimulus films. As hypothesized, multiple target/suspect choices had incriminating value whereas multiple rejections, foil choices, and don’t know answers had mostly exonerating value. For suspect choices, the combination of all three lineup modes consistently elicited high diagnosticities across targets. Combinations of non-suspect choices (rejections, foil choices, or don’t know answers were less successful and the different combinations showed less consistency in terms of diagnosticity. It was concluded that the use of multiple lineups, such as different facial poses and different aspects of a person should be particularly beneficial in three situations: if a witness only saw the perpetrator from a pose different than the frontal view normally used for lineups; if one or more witnesses saw the perpetrator from more than one perspective; and if different witnesses saw the perpetrator from different perspectives.

Institutional Choice and Recognition in Development

DEFF Research Database (Denmark)

Rutt, Rebecca Leigh

Abstract This thesis concerns the role of local institutions in fostering development including natural resource management, and how this role is shaped by relations with higher scale institutions such as development agencies and national governments. Specifically, it examines the choice of local...... objective of this thesis was to contribute to understanding processes and outcomes of institutional choice and recognition. It employed mixed methods but primarily semi structured interviews in multiple sites across Nepal. In responding to specific objectives, namely to better understand: i) the rationales...... behind choices of local institutional counterparts, ii) the belonging and citizenship available with local institutions, iii) the dynamics and mutuality of recognition between higher and lower scale institutions, and iv) the social outcomes of choice and recognition, this thesis shows that the way choice...

"It's Our Best Choice Right Now": Exploring How Charter School Parents Choose

Science.gov (United States)

Villavicencio, Adriana

2013-01-01

One of the underlying premises of the charter school movement is that quality drives consumer choice. As educational consumers, parents are viewed as rational actors who, if given the choice, will select better performing school. In examining the choice processes of charter school parents, however, this study calls into question the extent to…

English, French, Spanish, Italian, Portuguese? Code Choice and Austrian Export

Science.gov (United States)

Lavric, Eva; Back, Bernhard

2009-01-01

This article deals with how "export oriented Austrian companies effect code choice in their business relationships with customers from Romance language speaking countries". The focus lies on the most widespread Romance languages, therefore on French, Spanish, Italian and Portuguese speaking customers.The question of code choice in export…

Combining food type(s) and food quantity choice in a new food choice paradigm based on vice-virtue bundles.

Science.gov (United States)

Haws, Kelly L; Liu, Peggy J

2016-08-01

Given the prevalence and rising rates of obesity in many countries, including the United States, much food decision-making research ultimately aims at understanding how consumers can make healthier choices. The two predominant choice paradigms used in food decision-making research ask consumers to choose (a) between a "vice" (or unhealthy food) and a "virtue" (or healthy food) or (b) among varying portion sizes of "vice." We propose a new food choice paradigm that encourages consumers to jointly consider both food type(s) choice and food portion size at each decision point. The purpose of this paradigm is two-fold. First, it aims to allow examination of more comprehensive eating behavior (e.g., to examine the overall composition of a plate of food rather than choice of a single food). Second, it aims to shift consumers towards including large proportions of virtues and smaller proportions of vice in their overall consumption portfolios. For this paradigm, we draw upon a recently introduced food product innovation called "vice-virtue bundles" (Liu et al., 2015) that illustrates the basis of this new food choice paradigm, in which food type(s) and portion decisions are made simultaneously. Accordingly, we first discuss relevant findings on vice-virtue bundles as well as the differences between simultaneous and sequential choice of multiple products. Second, we examine the benefits for managing and controlling one's consumption that are provided by vice-virtue bundles and this joint food choice paradigm more generally. Third and finally, we point out opportunities for future research by discussing (a) multiple factors that influence food choices, (b) decision processes affected by food choice paradigms, and (c) issues of generalizability related to the presence of vice-virtue bundles. Copyright © 2015 Elsevier Ltd. All rights reserved.

Acquisition of Multiple Questions in English, Russian, and Malayalam

Science.gov (United States)

Grebenyova, Lydia

2011-01-01

This article presents the results of four studies exploring the acquisition of the language-specific syntactic and semantic properties of multiple interrogatives in English, Russian, and Malayalam, languages that behave differently with respect to the syntax and semantics of multiple interrogatives. A corpus analysis investigated the frequency of…

Structured Attentions for Visual Question Answering

OpenAIRE

Zhu, Chen; Zhao, Yanpeng; Huang, Shuaiyi; Tu, Kewei; Ma, Yi

2017-01-01

Visual attention, which assigns weights to image regions according to their relevance to a question, is considered as an indispensable part by most Visual Question Answering models. Although the questions may involve complex relations among multiple regions, few attention models can effectively encode such cross-region relations. In this paper, we demonstrate the importance of encoding such relations by showing the limited effective receptive field of ResNet on two datasets, and propose to mo...

Development and Preliminary Testing of the Food Choice Priorities Survey (FCPS): Assessing the Importance of Multiple Factors on College Students' Food Choices.

Science.gov (United States)

Vilaro, Melissa J; Zhou, Wenjun; Colby, Sarah E; Byrd-Bredbenner, Carol; Riggsbee, Kristin; Olfert, Melissa D; Barnett, Tracey E; Mathews, Anne E

2017-12-01

Understanding factors that influence food choice may help improve diet quality. Factors that commonly affect adults' food choices have been described, but measures that identify and assess food choice factors specific to college students are lacking. This study developed and tested the Food Choice Priorities Survey (FCPS) among college students. Thirty-seven undergraduates participated in two focus groups ( n = 19; 11 in the male-only group, 8 in the female-only group) and interviews ( n = 18) regarding typical influences on food choice. Qualitative data informed the development of survey items with a 5-point Likert-type scale (1 = not important, 5 = extremely important). An expert panel rated FCPS items for clarity, relevance, representativeness, and coverage using a content validity form. To establish test-retest reliability, 109 first-year college students completed the 14-item FCPS at two time points, 0-48 days apart ( M = 13.99, SD = 7.44). Using Cohen's weighted κ for responses within 20 days, 11 items demonstrated moderate agreement and 3 items had substantial agreement. Factor analysis revealed a three-factor structure (9 items). The FCPS is designed for college students and provides a way to determine the factors of greatest importance regarding food choices among this population. From a public health perspective, practical applications include using the FCPS to tailor health communications and behavior change interventions to factors most salient for food choices of college students.

Using stop signals to reduce impulsive choices for palatable unhealthy foods

NARCIS (Netherlands)

Veling, H.P.; Aarts, H.A.G.; Stroebe, W.

2013-01-01

OBJECTIVE: Exposure to palatable foods in the environment can trigger impulsive reactions to obtain them, which may lead to unhealthy food choices and eating behaviour. Two studies tested the fundamental question whether impulsive unhealthy food choices can be altered by means of linking unhealthy

Age and choice in health insurance: evidence from a discrete choice experiment.

Science.gov (United States)

Becker, Karolin; Zweifel, Peter

2008-01-01

A uniform package of benefits and uniform cost sharing are elements of regulation inherent in most social health insurance systems. Both elements risk burdening the population with a welfare loss if preferences for risk and insurance attributes differ. This suggests the introduction of more choice in social health insurance packages may be advantageous; however, it is widely believed that this would not benefit the elderly.A representative telephone survey of 1000 people aged >24 years living in the German- and French-speaking parts of Switzerland was conducted. Participants were asked to compare the status quo (i.e. their current insurance contract) with ten hypothetical alternatives. In addition, participants were asked questions concerning utilization of healthcare services; overall satisfaction with the healthcare system, insurer and insurance policy; and a general preference for new elements in the insurance package. Socioeconomic variables surveyed were age, sex, total household income, education (seven categories ranging from primary school to university degree), place of residence, occupation, and marital status. To examine the relationship between age and willingness to pay (WTP) for additional options in Swiss social health insurance.A representative telephone survey of 1000 people aged >24 years living in the German- and French-speaking parts of Switzerland was conducted. Participants were asked to compare the status quo (i.e. their current insurance contract) with ten hypothetical alternatives. In addition, participants were asked questions concerning utilization of healthcare services; overall satisfaction with the healthcare system, insurer and insurance policy; and a general preference for new elements in the insurance package. Socioeconomic variables surveyed were age, sex, total household income, education (seven categories ranging from primary school to university degree), place of residence, occupation, and marital status. A discrete choice

Sources of Inspiration: The role of significant persons in young people's choice of science in higher education

Science.gov (United States)

Sjaastad, Jørgen

2012-07-01

The objectives of this article were to investigate to which extent and in what ways persons influence students' choice of science, technology, engineering, and mathematics (STEM) in tertiary education, and to assess the suitability of an analytical framework for describing this influence. In total, 5,007 Norwegian STEM students completed a questionnaire including multiple-choice as well as open-ended questions about sources of inspiration for their educational choice. Using the conceptualisation of significant persons suggested by Woelfel and Haller, the respondents' descriptions of parents and teachers are presented in order to elaborate on the different ways these significant persons influence a STEM-related educational choice. Parents engaged in STEM themselves are models, making the choice of STEM familiar, and they help youngsters define themselves through conversation and support, thus being definers. Teachers are models by displaying how STEM might bring fulfilment in someone's life and by giving pupils a positive experience with the subjects. They help young people discover their STEM abilities, thus being definers. Celebrities are reported to have minor influence on STEM-related educational choices. Both qualitative and quantitative analyses indicate that interpersonal relationships are key factors in order to inspire and motivate a choice of STEM education. Implications for recruitment issues and for research on interpersonal influence are discussed. It is suggested that initiatives to increase recruitment to STEM might be aimed at parents and other persons in interpersonal relationships with youth as a target group.

Children's Exhaustive Readings of Questions

Science.gov (United States)

Cremers, Alexandre; Tieu, Lyn; Chemla, Emmanuel

2017-01-01

Questions, just like plain declarative sentences, can give rise to multiple interpretations. As discussed by Spector & Egré (2015), among others, questions embedded under know are ambiguous between "weakly exhaustive" (WE), "intermediate exhaustive" (IE), and "strongly exhaustive" (SE) interpretations (for…

Woman, M.D.: issues, perceptions and choices.

OpenAIRE

Johns, C. J.

1996-01-01

I would end with some summarizing points and questions. 1. A majority of women identify gender-related issues influencing their career choices and pathways. 2. Women are diverse in their choices and priorities, with varying balances of personal and professional life. 3. Eighty-three percent of the women responding to the survey have married, and 82% of those married have children. They thus are likely to have two sets of seriously competing responsibilities. 4. It is possible to identify espe...

Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing.

Science.gov (United States)

Levy, Ifat; Lazzaro, Stephanie C; Rutledge, Robb B; Glimcher, Paul W

2011-01-05

Decision-making is often viewed as a two-stage process, where subjective values are first assigned to each option and then the option of the highest value is selected. Converging evidence suggests that these subjective values are represented in the striatum and medial prefrontal cortex (MPFC). A separate line of evidence suggests that activation in the same areas represents the values of rewards even when choice is not required, as in classical conditioning tasks. However, it is unclear whether the same neural mechanism is engaged in both cases. To address this question we measured brain activation with functional magnetic resonance imaging while human subjects passively viewed individual consumer goods. We then sampled activation from predefined regions of interest and used it to predict subsequent choices between the same items made outside of the scanner. Our results show that activation in the striatum and MPFC in the absence of choice predicts subsequent choices, suggesting that these brain areas represent value in a similar manner whether or not choice is required.

Examining the Psychometric Quality of Multiple-Choice Assessment Items using Mokken Scale Analysis.

Science.gov (United States)

Wind, Stefanie A

The concept of invariant measurement is typically associated with Rasch measurement theory (Engelhard, 2013). Concerned with the appropriateness of the parametric transformation upon which the Rasch model is based, Mokken (1971) proposed a nonparametric procedure for evaluating the quality of social science measurement that is theoretically and empirically related to the Rasch model. Mokken's nonparametric procedure can be used to evaluate the quality of dichotomous and polytomous items in terms of the requirements for invariant measurement. Despite these potential benefits, the use of Mokken scaling to examine the properties of multiple-choice (MC) items in education has not yet been fully explored. A nonparametric approach to evaluating MC items is promising in that this approach facilitates the evaluation of assessments in terms of invariant measurement without imposing potentially inappropriate transformations. Using Rasch-based indices of measurement quality as a frame of reference, data from an eighth-grade physical science assessment are used to illustrate and explore Mokken-based techniques for evaluating the quality of MC items. Implications for research and practice are discussed.

Climbing Bloom's Taxonomy Pyramid: Lessons from a Graduate Histology Course

Science.gov (United States)

Zaidi, Nikki B.; Hwang, Charles; Scott, Sara; Stallard, Stefanie; Purkiss, Joel; Hortsch, Michael

2017-01-01

Bloom's taxonomy was adopted to create a subject-specific scoring tool for histology multiple-choice questions (MCQs). This Bloom's Taxonomy Histology Tool (BTHT) was used to analyze teacher- and student-generated quiz and examination questions from a graduate level histology course. Multiple-choice questions using histological images were…

Factors Affecting Career Choice among Speech-Language Pathology and Audiology Students

Science.gov (United States)

Stone, Larissa; Pellowski, Mark W.

2016-01-01

This investigation assessed the factors affecting career choice among 474 current undergraduate and graduate speech-language pathology and audiology students (from four universities). A 14-item questionnaire was developed that included questions related to general influence of career choice and whether or not the participants had previously been,…

Using item response theory to explore the psychometric properties of extended matching questions examination in undergraduate medical education

Directory of Open Access Journals (Sweden)

Lawton Gemma

2005-03-01

Full Text Available Abstract Background As assessment has been shown to direct learning, it is critical that the examinations developed to test clinical competence in medical undergraduates are valid and reliable. The use of extended matching questions (EMQ has been advocated to overcome some of the criticisms of using multiple-choice questions to test factual and applied knowledge. Methods We analysed the results from the Extended Matching Questions Examination taken by 4th year undergraduate medical students in the academic year 2001 to 2002. Rasch analysis was used to examine whether the set of questions used in the examination mapped on to a unidimensional scale, the degree of difficulty of questions within and between the various medical and surgical specialties and the pattern of responses within individual questions to assess the impact of the distractor options. Results Analysis of a subset of items and of the full examination demonstrated internal construct validity and the absence of bias on the majority of questions. Three main patterns of response selection were identified. Conclusion Modern psychometric methods based upon the work of Rasch provide a useful approach to the calibration and analysis of EMQ undergraduate medical assessments. The approach allows for a formal test of the unidimensionality of the questions and thus the validity of the summed score. Given the metric calibration which follows fit to the model, it also allows for the establishment of items banks to facilitate continuity and equity in exam standards.

Predicting Dissertation Methodology Choice among Doctoral Candidates at a Faith-Based University

Science.gov (United States)

Lunde, Rebecca

2017-01-01

Limited research has investigated dissertation methodology choice and the factors that contribute to this choice. Quantitative research is based in mathematics and scientific positivism, and qualitative research is based in constructivism. These underlying philosophical differences posit the question if certain factors predict dissertation…

Kinetics of aggregation with choice.

Science.gov (United States)

Ben-Naim, E; Krapivsky, P L

2016-12-01

We generalize the ordinary aggregation process to allow for choice. In ordinary aggregation, two random clusters merge and form a larger aggregate. In our implementation of choice, a target cluster and two candidate clusters are randomly selected and the target cluster merges with the larger of the two candidate clusters. We study the long-time asymptotic behavior and find that as in ordinary aggregation, the size density adheres to the standard scaling form. However, aggregation with choice exhibits a number of different features. First, the density of the smallest clusters exhibits anomalous scaling. Second, both the small-size and the large-size tails of the density are overpopulated, at the expense of the density of moderate-size clusters. We also study the complementary case where the smaller candidate cluster participates in the aggregation process and find an abundance of moderate clusters at the expense of small and large clusters. Additionally, we investigate aggregation processes with choice among multiple candidate clusters and a symmetric implementation where the choice is between two pairs of clusters.

Team-based learning increases active engagement and enhances development of teamwork and communication skills in a first-year course for veterinary and animal science undergraduates.

Science.gov (United States)

Hazel, Susan J; Heberle, Nicole; McEwen, Margaret-Mary; Adams, Karen

2013-01-01

Team-based learning (TBL) was implemented into a first-year course (Principles in Animal Behaviour, Welfare and Ethics) for BSc Veterinary Bioscience (VB) and Animal Science (AS) students. TBL is now used widely in teaching medical students, but has had more limited uptake in veterinary education. This study reports its use over 2 years with cohorts of 126 and 138 students in 2011 and 2012, respectively. Average individual marks for multiple-choice question (MCQ) tests in the Readiness Assurance component of TBL were higher for the teams than for individuals for each session, explicitly demonstrating the advantages of teamwork. Students reported that they felt actively involved and that TBL helped them both with their learning and in developing other important skills, such as teamwork and communication. Qualitative analysis of written feedback from the students revealed positive themes of discussion, application, revelation, socializing, engagement, clarification, and retention/revision. In 2011 negative comments included the need to shorten the TBL sessions, but in 2012 tightening of the timelines meant that this was no longer a major concern. Requests to provide better introductory and background materials and ambiguity in questions in the TBL activities were what students least liked about the TBL. However, most comments were positive rather than negative in nature, and many students preferred the TBL to lectures. With requirements for curricula to teach professional skills, such as communication and teamwork, and the positive results from TBL's implementation, it is hoped that this study will encourage others to trial the use of TBL in veterinary education.

Using Narratives to Explore Other-Directed Occupational Choice and Academic Success

Science.gov (United States)

Rehfuss, Mark C.; Borges, Nicole J.

2006-01-01

The construct of "other-directed versus self-directed career choice" has existed for quite some time. The current focus of vocational psychologists and counselors has made them question the relevance of this construct for contemporary American society. Many counselors today challenge the assumption that a career choice based on others'…

Cross-Cultural Differences in Taste Thresholds and Food Choice Motives

DEFF Research Database (Denmark)

Dehlholm, Christian

2007-01-01

Psychophysical, physiological and behavioural aspects of taste perception and food choice were examined cross-culturally between Chinese people living in China (n=25), Chinese people living in Denmark (n=16) and Danish people living in Denmark (n=28). Groups were subdivided by males (n=26...... were found on average in each group with a mean diameter at 0.66mm for the Chinese and 0.72mm for the Danish. A questionnaire including general demographic questions, food frequency questions and the Food Choice Questionnaire (Steptoe et al., 1995) were completed by all subjects (n=69). The Danish...... subjects had a higher intake of sweets, tea and coffee and Chinese subject living in China had a higher intake of spicy food. All subject groups rated Sensory Appeal, Health and Price as very important food choice factors while dissimilarities between the groups were shown in rating the factors Mood...

Design and protocol of a randomized multiple behavior change trial: Make Better Choices 2 (MBC2).

Science.gov (United States)

Pellegrini, Christine A; Steglitz, Jeremy; Johnston, Winter; Warnick, Jennifer; Adams, Tiara; McFadden, H G; Siddique, Juned; Hedeker, Donald; Spring, Bonnie

2015-03-01

Suboptimal diet and inactive lifestyle are among the most prevalent preventable causes of premature death. Interventions that target multiple behaviors are potentially efficient; however the optimal way to initiate and maintain multiple health behavior changes is unknown. The Make Better Choices 2 (MBC2) trial aims to examine whether sustained healthful diet and activity change are best achieved by targeting diet and activity behaviors simultaneously or sequentially. Study design approximately 250 inactive adults with poor quality diet will be randomized to 3 conditions examining the best way to prescribe healthy diet and activity change. The 3 intervention conditions prescribe: 1) an increase in fruit and vegetable consumption (F/V+), decrease in sedentary leisure screen time (Sed-), and increase in physical activity (PA+) simultaneously (Simultaneous); 2) F/V+ and Sed- first, and then sequentially add PA+ (Sequential); or 3) Stress Management Control that addresses stress, relaxation, and sleep. All participants will receive a smartphone application to self-monitor behaviors and regular coaching calls to help facilitate behavior change during the 9 month intervention. Healthy lifestyle change in fruit/vegetable and saturated fat intakes, sedentary leisure screen time, and physical activity will be assessed at 3, 6, and 9 months. MBC2 is a randomized m-Health intervention examining methods to maximize initiation and maintenance of multiple healthful behavior changes. Results from this trial will provide insight about an optimal technology supported approach to promote improvement in diet and physical activity. Copyright © 2015 Elsevier Inc. All rights reserved.

To question of NPP power reactor choice for Kazakhstan

International Nuclear Information System (INIS)

Batyrbekov, G.A.; Makhanov, Y.M.; Reznikova, R.A.; Sidorenco, A.V.

2004-01-01

Full text: The requirements to NPP power reactors that will be under construction in Kazakhstan are proved and given in the report. A comparative analysis of the most advanced projects of power reactors with light and heavy water under pressure of large, medium and low power is carried out. Different reactors have been considered as follows: 1. Reactors with high-power (700 MW(el) and up) such as EPR, French - German reactor; CANDU-9, Canadian heavy-water reactor; System 80+, developed by ABB Combustion Engineering company, USA; KNGR, Korean reactor of the next generation; APWR, Japanese advanced reactor; WWER-1000 (V-392) - development of Atomenergoproect /Gydropress, Russian Federation; EP 1000, European passive reactor. 2. Reactors with medium power (300 MW (el) - 700 MW (el): AP-600, passive PWR of the Westinghouse company; CANDU-6, Canadian heavy-water reactor; AC-600, Chinese passive PWR; WWER-640, Russian passive reactor; MS-600 Japanese reactor of Mitsubishi Company; KSNP-600, South Korean reactor. 3. Reactors with low power (a few MW(el)- 300 MW(el)): IRIS, reactor of IV generation, developed by the International Corporation of 13 organizations from 7 countries, SMART, South Korean integrated reactor; CAREM, Argentina integrated reactor; MRX, Japanese integrated reactor; 'UNITERM', Russian NPP with integrated reactor, development of NIKIET; AHEC-80, Russian NPP, developed by OKBM. A comparison of the projects of the above-mentioned power reactors was carried out with respect to 15 criteria of nuclear, radiating, ecological safety and economic competitiveness, developed especially for this case. Data on a condition and prospects of power production and power consumption, stations and networks in Kazakhstan necessary for the choice of projects of NPP reactors for Kazakhstan are given. According to the data a balance of power production and power consumption as a whole in the country was received at the level of 59 milliard kw/h. However, strong dis balance

To question of NPP power reactor choice for Kazakhstan

International Nuclear Information System (INIS)

Batyrbekov, G.A.; Makhanov, Y.M.; Reznikova, R.A.; Sidorenco, A.V.

2004-01-01

The requirements to NPP power reactors that will be under construction in Kazakhstan are proved and given in the report. A comparative analysis of the most advanced projects of power reactors with light and heavy water under pressure of large, medium and low power is carried out. Different reactors have been considered as follows: 1. Reactors with high-power (700 MW(el) and up) such as EPR, French - German reactor; CANDU-9, Canadian heavy-water reactor; System 80+, developed by ABB Combustion Engineering company, USA; KNGR, Korean reactor of the next generation; APWR, Japanese advanced reactor; WWER-1000 (V-392) - development of Atomenergoproect /Gydropress, Russian Federation; EP 1000, European passive reactor. 2. Reactors with medium power (300 MW (el) - 700 MW (el): AP-600, passive PWR of the Westinghouse company; CANDU-6, Canadian heavy-water reactor; AC-600, Chinese passive PWR; WWER-640, Russian passive reactor; MS-600 Japanese reactor of Mitsubishi Company; KSNP-600, South Korean reactor. 3. Reactors with low power (a few MW(el)- 300 MW(el)): IRIS, reactor of IV generation, developed by the International Corporation of 13 organizations from 7 countries, SMART, South Korean integrated reactor; CAREM, Argentina integrated reactor; MRX, Japanese integrated reactor; 'UNITERM', Russian NPP with integrated reactor, development of NIKIET; AHEC-80, Russian NPP, developed by OKBM. A comparison of the projects of the above-mentioned power reactors was carried out with respect to 15 criteria of nuclear, radiating, ecological safety and economic competitiveness, developed especially for this case. Data on a condition and prospects of power production and power consumption, stations and networks in Kazakhstan necessary for the choice of projects of NPP reactors for Kazakhstan are given. According to the data a balance of power production and power consumption as a whole in the country was received at the level of 59 milliard kw/h. However, strong dis balance in the

Contextual and social influences on valuation and choice.

Science.gov (United States)

Engelmann, Jan B; Hein, Grit

2013-01-01

To survive in our complex environment, we have to adapt to changing contexts. Prior research that investigated how contextual changes are processed in the human brain has demonstrated important modulatory influences on multiple cognitive processes underlying decision-making, including perceptual judgments, working memory, as well as cognitive and attentional control. However, in everyday life, the importance of context is even more obvious during economic and social interactions, which often have implicit rule sets that need to be recognized by a decision-maker. Here, we review recent evidence from an increasing number of studies in the fields of Neuroeconomics and Social Neuroscience that investigate the neurobiological basis of contextual effects on valuation and social choice. Contrary to the assumptions of rational choice theory, multiple contextual factors, such as the availability of alternative choice options, shifts in reference point, and social context, have been shown to modulate behavior, as well as signals in task-relevant neural networks. A consistent picture that emerges from neurobiological results is that valuation-related activity in striatum and ventromedial prefrontal cortex is highly context dependent during both social and nonsocial choice. Alternative approaches to model and explain choice behavior, such as comparison-based choice models, as well as implications for future research are discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

"If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question". Evidence from a double-bounded dichotomous choice model with heterogeneous anchoring.

Science.gov (United States)

Schwarzinger, Michaël; Carrat, Fabrice; Luchini, Stéphane

2009-07-01

The small sample size of contingent valuation (CV) surveys conducted in patients may have limited the use of the single-bounded (SB) dichotomous choice format which is recommended in environmental economics. In this paper, we explore two ways to increase the statistical efficiency of the SB format: (1) by the inclusion of proxies in addition to patients; (2) by the addition of a follow-up dichotomous question, i.e. the double-bounded (DB) dichotomous choice format. We found that patients (n=223) and spouses (n=64) answering on behalf of the patient had on average a similar willingness-to-pay for earlier alleviation of flu symptoms. However, a patient was significantly more likely to anchor his/her answer on the first bid as compared to a spouse. Finally, our original DB model with shift effect and heterogeneous anchoring reconciled the discrepancies found in willingness-to-pay statistics between SB and DB models in keeping with increased statistical efficiency.

A simple test of choice stepping reaction time for assessing fall risk in people with multiple sclerosis.

Science.gov (United States)

Tijsma, Mylou; Vister, Eva; Hoang, Phu; Lord, Stephen R

2017-03-01

Purpose To determine (a) the discriminant validity for established fall risk factors and (b) the predictive validity for falls of a simple test of choice stepping reaction time (CSRT) in people with multiple sclerosis (MS). Method People with MS (n = 210, 21-74y) performed the CSRT, sensorimotor, balance and neuropsychological tests in a single session. They were then followed up for falls using monthly fall diaries for 6 months. Results The CSRT test had excellent discriminant validity with respect to established fall risk factors. Frequent fallers (≥3 falls) performed significantly worse in the CSRT test than non-frequent fallers (0-2 falls). With the odds of suffering frequent falls increasing 69% with each SD increase in CSRT (OR = 1.69, 95% CI: 1.27-2.26, p = falls in people with MS. This test may prove useful in documenting longitudinal changes in fall risk in relation to MS disease progression and effects of interventions. Implications for rehabilitation Good choice stepping reaction time (CSRT) is required for maintaining balance. A simple low-tech CSRT test has excellent discriminative and predictive validity in relation to falls in people with MS. This test may prove useful documenting longitudinal changes in fall risk in relation to MS disease progression and effects of interventions.

Consumers' food choice and quality perception

DEFF Research Database (Denmark)

Brunsø, Karen; Fjord, Thomas Ahle; Grunert, Klaus G.

to which the topic has been researched at MAPP. As a general framework for analysing consumer quality perception and choice of food products, MAPP has developed the Total Food Quality Model, which will be used to structure this overview. We start by presenting the Total Food Quality Model and an overview......There is a long tradition of research into consumers' food choice and quality perception. In the last few years, however, these topics have received even more attention due to the intense debate about such issues as ethical considerations in relation to food production and quality, food scandals...... and the resulting food scares among consumers, genetic modification of foods, and animal welfare (or, rather, non-welfare), which has made questions regarding food quality and consumers' supposedly rational or irrational food choices even more urgent. Increased interest in health and quality stands in stark...

Choice Orientations, Discussions, and Prospects.

Science.gov (United States)

Raywid, Mary Anne

1992-01-01

Examining the contemporary school choice debate yields arguments that are education, economics, governance, and policy driven. To "break the exclusive franchise," school districts are increasingly sponsoring school operation and education services supplied by multiple sources, and states are discussing sponsorship of schools by entities…

Managing the injury burden in Nepal.

Science.gov (United States)

Karmacharya, P C; Singh, G K; Singh, M P; Gautam, V G; Par, Andrew; Banskota, A K; Bajracharya, A; Shreshtha, A B; Mahara, Deepak

2008-10-01

Nepal loses about 530,000 disability adjusted life years (DALYs) per year to injury, predominantly due to falls. It takes 30,000 Nepali rupees (NR), or approximately US$430 at 70 rupees per $US saved per DALY to achieve primary prevention and 6000 NR per DALY if we invest in hospitals, versus 1000 NR invested in prehospital care, because simpler less expensive actions performed early have a greater impact on outcome than more complex measures later. A system for prehospital services was planned for medical emergencies at a national level meeting at the Medical University of Nepal to promote healthcare to victims in inaccessible regions by empowered or enlightened citizens. Feasible actions for common emergencies were defined and a tutorial required to help the majority of such victims was created and packaged. The knowledge and attitude component of the tutorial will be delivered through a web site to citizens motivated to learn and help with emergencies. The knowledge will be tested through a net-based Multiple Choice Questions (MCQ) test. Practical training in medical triage skills will be provided to those who qualify for the test at the University or its designated affiliates. A mobile phone-based information system will be created and used to make these enlightened citizens available to the victim at the site/time of the emergency.

Exploring problem solving strategies on multiple-choice science items: Comparing native Spanish-speaking English Language Learners and mainstream monolinguals

Science.gov (United States)

Kachchaf, Rachel Rae

The purpose of this study was to compare how English language learners (ELLs) and monolingual English speakers solved multiple-choice items administered with and without a new form of testing accommodation---vignette illustration (VI). By incorporating theories from second language acquisition, bilingualism, and sociolinguistics, this study was able to gain more accurate and comprehensive input into the ways students interacted with items. This mixed methods study used verbal protocols to elicit the thinking processes of thirty-six native Spanish-speaking English language learners (ELLs), and 36 native-English speaking non-ELLs when solving multiple-choice science items. Results from both qualitative and quantitative analyses show that ELLs used a wider variety of actions oriented to making sense of the items than non-ELLs. In contrast, non-ELLs used more problem solving strategies than ELLs. There were no statistically significant differences in student performance based on the interaction of presence of illustration and linguistic status or the main effect of presence of illustration. However, there were significant differences based on the main effect of linguistic status. An interaction between the characteristics of the students, the items, and the illustrations indicates considerable heterogeneity in the ways in which students from both linguistic groups think about and respond to science test items. The results of this study speak to the need for more research involving ELLs in the process of test development to create test items that do not require ELLs to carry out significantly more actions to make sense of the item than monolingual students.

Introducing Standardized EFL/ESL Exams

Science.gov (United States)

Laborda, Jesus Garcia

2007-01-01

This article presents the features, and a brief comparison, of some of the most well-known high-stakes exams. They are classified in the following fashion: tests that only include multiple-choice questions, tests that include writing and multiple-choice questions, and tests that include speaking questions. The tests reviewed are: BULATS, IELTS,…

Measuring the Consistency in Change in Hepatitis B Knowledge among Three Different Types of Tests: True/False, Multiple Choice, and Fill in the Blanks Tests.

Science.gov (United States)

Sahai, Vic; Demeyere, Petra; Poirier, Sheila; Piro, Felice

1998-01-01

The recall of information about Hepatitis B demonstrated by 180 seventh graders was tested with three test types: (1) short-answer; (2) true/false; and (3) multiple-choice. Short answer testing was the most reliable. Suggestions are made for the use of short-answer tests in evaluating student knowledge. (SLD)

The Impact of Board Interlocks on Auditor Choice and Audit Fees

DEFF Research Database (Denmark)

Riise Johansen, Thomas; Pettersson, Kim

2013-01-01

Research Question/Issue This paper uses unique Danish data to examine whether non-executive directors draw on both direct and indirect ties in the network of interlocking directorates to impact auditor choice, and whether this impact has consequences for audit fees. Research Findings/Insight The ......Research Question/Issue This paper uses unique Danish data to examine whether non-executive directors draw on both direct and indirect ties in the network of interlocking directorates to impact auditor choice, and whether this impact has consequences for audit fees. Research Findings....../Insight The paper finds clear evidence that non-executive directors draw on their networks to impact auditor choice, and evidence that clients pay an audit fee premium when non-executive directors are connected to audit firms outside the focal company. The relationship between non-executive directors and auditors...... of the non-executive director–auditor relationship and the role that board networks have in governing auditor choice decisions. The study identifies interlocks as an infrastructure for differentiation in the audit market and determines that such differentiation is associated with an audit fee premium...

To the question of definition of fissile material mass and neutron multiplication in deep sub-critical systems

International Nuclear Information System (INIS)

Dulin, V.V.

2006-01-01

A method of determination neutrons multiplication in deep sub-critical multiplying media has been developed. It is based on a modified of Rossi - alpha method. It will consist in use of integral on time (a method of the areas) from correlated parts of distribution and integral in area, independent of time a part of distribution (area of a constant background). It allows to spend the calculated analysis, using the integrated equation on time for a neutrons flux and to not use representation of point kinetic model. A calculation spatially-correlation factor the adjoint (relative the detector count rate) inhomogeneous equation is used. Its calculation takes into account fission both in multiplying media and in a spontaneous neutron source. Measurements with plutonium-steel and uranium-steel blocks, and blocks from uranium and plutonium dioxide of different enrichment are have been carried out. The measured values of neutrons multiplication in a range 1.03-1.82 will be well coordinated to results of calculations. The question on an opportunity of definition of weight of the measured blocks of fissile material is considered [ru

Choices and Changes: Eccles’ Expectancy-Value Model and Upper-Secondary School Students’ Longitudinal Reflections about their Choice of a STEM Education

DEFF Research Database (Denmark)

Lykkegaard, Eva; Ulriksen, Lars

2016-01-01

During the past 30 years, Eccles’ comprehensive social-psychological Expectancy-Value Model of Motivated Behavioural Choices (EV-MBC model) has been proven suitable for studying educational choices related to Science, Technology, Engineering and/or Mathematics (STEM). The reflections of 15 students...... in their last year in upper-secondary school concerning their choice of tertiary education were examined using quantitative EV-MBC surveys and repeated qualitative interviews. This article presents the analyses of three cases in detail. The analytical focus was whether the factors indicated in the EV-MBC model......, and that significant changes in the students’ reflections were not captured by the factors of the EV-MBC model. This questions the validity of the EVMBC surveys. Moreover, the quantitative factors from the EV-MBC model did not sufficiently explain students’ dynamical educational choice processes where students...

Understanding the formation and influence of attitudes in patients' treatment choices for lower back pain: Testing the benefits of a hybrid choice model approach

DEFF Research Database (Denmark)

Kløjgaard, Mirja Elisabeth; Hess, S.

2014-01-01

A growing number of studies across different fields are making use of a new class of choice models, labelled variably as hybrid model structures or integrated choice and latent variable models, and incorporating the role of attitudes in decision making. To date, this technique has not been used...... in spring/summer 2012. We show how the hybrid model structure is able to make a link between attitudinal questions and treatment choices, and also explains variation of these attitudes across key socio-demographic groups. However, we also show how, in this case, only a small share of the overall...

A Study of the Factors Influencing Parental Choice of a Charter School

Science.gov (United States)

Ekanem, Imaobong Columba

2013-01-01

The study discussed in this dissertation identified and examined the factors that influence parent charter school choice. The study was conducted for a rural K-8 charter school in Delaware. The survey instrument used was a parent questionnaire which contained questions that examined the reasons for parent charter school choice, the features of…

Survey of diagnostic and treatment practices for multiple sclerosis in Europe.

Science.gov (United States)

Fernández, O; Delvecchio, M; Edan, G; Fredrikson, S; Gionvannoni, G; Hartung, H-P; Havrdova, E; Kappos, L; Pozzilli, C; Soerensen, P S; Tackenberg, B; Vermersch, P; Comi, G

2017-03-01

Up-to-date information is needed on the extent to which neurologists treating multiple sclerosis (MS) in Europe are integrating rapidly evolving diagnostic criteria, disease-modifying therapies and recommendations for monitoring disease activity into their clinical practice. A steering committee of MS neurologists used a modified Delphi process to develop case- and practice-based questions for two sequential surveys distributed to MS neurologists throughout Europe. Case-based questions were developed for radiologically isolated syndrome (RIS), clinically isolated syndrome (CIS), relapsing-remitting MS (RRMS) and RRMS with breakthrough disease. Multiple sclerosis neurologists from 11 European countries responded to survey 1 (n = 233) and survey 2 (n = 171). Respondents agreed that they would not treat the patients in the RIS or CIS cases but would treat a patient with a relatively mild form of RRMS. Choice of treatment was evenly distributed among first-line injectables and oral treatments for mild RRMS, and moved to second-line treatment as the RRMS case increased in severity. Additional results on RRMS with breakthrough disease are presented. Although there was general agreement on some aspects of treatment, responses to other management and clinical practice questions varied considerably. These results, which reflect current clinical practice patterns, highlight the need for additional MS treatment education and awareness and may help inform the development of MS practice guidelines in Europe. © 2017 EAN.

Statistical Efficiency of Double-Bounded Dichotomous Choice Contingent Valuation

OpenAIRE

Michael Hanemann; John Loomis; Barbara Kanninen

1991-01-01

The statistical efficiency of conventional dichotomous choice contingent valuation surveys can be improved by asking each respondent a second dichotomous choice question which depends on the response to the first question—if the first response is "yes," the second bid is some amount greater than the first bid; while, if the first response is "no," the second bid is some amount smaller. This "double-bounded" approach is shown to be asymptotically more efficient than the conventional, "singlebo...

A Common Mechanism Underlying Food Choice and Social Decisions

Science.gov (United States)

Krajbich, Ian; Hare, Todd; Bartling, Björn; Morishima, Yosuke; Fehr, Ernst

2015-01-01

People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others’ benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making. PMID:26460812

A Common Mechanism Underlying Food Choice and Social Decisions.

Science.gov (United States)

Krajbich, Ian; Hare, Todd; Bartling, Björn; Morishima, Yosuke; Fehr, Ernst

2015-10-01

People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others' benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making.

Computer-based testing of the modified essay question: the Singapore experience.

Science.gov (United States)

Lim, Erle Chuen-Hian; Seet, Raymond Chee-Seong; Oh, Vernon M S; Chia, Boon-Lock; Aw, Marion; Quak, Seng-Hock; Ong, Benjamin K C

2007-11-01

The modified essay question (MEQ), featuring an evolving case scenario, tests a candidate's problem-solving and reasoning ability, rather than mere factual recall. Although it is traditionally conducted as a pen-and-paper examination, our university has run the MEQ using computer-based testing (CBT) since 2003. We describe our experience with running the MEQ examination using the IVLE, or integrated virtual learning environment (https://ivle.nus.edu.sg), provide a blueprint for universities intending to conduct computer-based testing of the MEQ, and detail how our MEQ examination has evolved since its inception. An MEQ committee, comprising specialists in key disciplines from the departments of Medicine and Paediatrics, was formed. We utilized the IVLE, developed for our university in 1998, as the online platform on which we ran the MEQ. We calculated the number of man-hours (academic and support staff) required to run the MEQ examination, using either a computer-based or pen-and-paper format. With the support of our university's information technology (IT) specialists, we have successfully run the MEQ examination online, twice a year, since 2003. Initially, we conducted the examination with short-answer questions only, but have since expanded the MEQ examination to include multiple-choice and extended matching questions. A total of 1268 man-hours was spent in preparing for, and running, the MEQ examination using CBT, compared to 236.5 man-hours to run it using a pen-and-paper format. Despite being more labour-intensive, our students and staff prefer CBT to the pen-and-paper format. The MEQ can be conducted using a computer-based testing scenario, which offers several advantages over a pen-and-paper format. We hope to increase the number of questions and incorporate audio and video files, featuring clinical vignettes, to the MEQ examination in the near future.

Linking neuroscientific research on decision making to the educational context of novice students assigned to a multiple-choice scientific task involving common misconceptions about electrical circuits

Directory of Open Access Journals (Sweden)

Patrice ePotvin

2014-01-01

Full Text Available Functional magnetic resonance imaging was used to identify the brain-based mechanisms of uncertainty and certainty associated with answers to multiple-choice questions involving common misconceptions about electric circuits. Twenty-two (22 scientifically novice participants (humanities and arts college students were asked, in an fMRI study, whether or not they thought the light bulbs in images presenting electric circuits were lighted up correctly, and if they were certain or uncertain of their answers. When participants reported that they were unsure of their responses, analyses revealed significant activations in brain areas typically involved in uncertainty (anterior cingulate cortex, anterior insula cortex, and superior/dorsomedial frontal cortex and in the left middle/superior temporal lobe. Certainty was associated with large bilateral activations in the occipital and parietal regions usually involved in visuospatial processing. Correct-and-certain answers were associated with activations that suggest a stronger mobilization of visual attention resources when compared to incorrect-and-certain answers. These findings provide insights into brain-based mechanisms of uncertainty that are activated when common misconceptions, identified as such by science education research literature, interfere in decision making in a school-like task. We also discuss the implications of these results from an educational perspective.

Dual processing theory and experts' reasoning: exploring thinking on national multiple-choice questions

NARCIS (Netherlands)

Durning, S.J.; Dong, T.; Artino, A.R.; Vleuten, C. van der; Holmboe, E.; Schuwirth, L.

2015-01-01

BACKGROUND: An ongoing debate exists in the medical education literature regarding the potential benefits of pattern recognition (non-analytic reasoning), actively comparing and contrasting diagnostic options (analytic reasoning) or using a combination approach. Studies have not, however, explicitly

Professional choice early education teachers’ views

Directory of Open Access Journals (Sweden)

Ive Carina Rodrigues Lima Brasil

2012-05-01

Full Text Available This qualitative and exploratory research aimed at investigating the underlying reasons for the professional choice of teachers who work with early education. 17 teachers (7 from public schools and 10 from private schools were interviewed in depth in a semi-structured manner. Questions concerned the reasons that guided participants’ professional choice. According to the results, the main reasons for choosing to work with children were associated with love for children, family influence, opportunity, idealism, enchantment and special talent to work with children. Some of the interviewees’ had working with children as a professional option consciously made, whether others were merely taken by the circumstances. Stereotyped views of the profession (feminine profession are also addressed.

Who Knows? Question Format and Political Knowledge

DEFF Research Database (Denmark)

Robison, Joshua

2015-01-01

Political knowledge is one of the most influential variables in political science. However, scholars still grapple with its theoretical meaning and how to measure it best. I address the deeply contested issue of whether knowledge should be measured with either an open-ended or closed-choice measure......, the results reported here raise important questions about the validity of knowledge indices and also have implications for the general study of political attitudes and behavior....

Use of flawed multiple-choice items by the New England Journal of Medicine for continuing medical education.

Science.gov (United States)

Stagnaro-Green, Alex S; Downing, Steven M

2006-09-01

Physicians in the United States are required to complete a minimum number of continuing medical education (CME) credits annually. The goal of CME is to ensure that physicians maintain their knowledge and skills throughout their medical career. The New England Journal of Medicine (NEJM) provides its readers with the opportunity to obtain weekly CME credits. Deviation from established item-writing principles may result in a decrease in validity evidence for tests. This study evaluated the quality of 40 NEJM MCQs using the standard evidence-based principles of effective item writing. Each multiple-choice item reviewed had at least three item flaws, with a mean of 5.1 and a range of 3 to 7. The results of this study demonstrate that the NEJM uses flawed MCQs in its weekly CME program.

Making System Dynamics Cool IV : Teaching & Testing with Cases & Quizzes

NARCIS (Netherlands)

Pruyt, E.

2012-01-01

This follow-up paper presents cases and multiple choice questions for teaching and testing System Dynamics modeling. These cases and multiple choice questions were developed and used between January 2012 and April 2012 a large System Dynamics course (250+ 2nd year BSc and 40+ MSc students per year)

Reincarnation Revisited: Question format and the distribution of belief in reincarnation in survey research

OpenAIRE

Siegers, Pascal

2013-01-01

Comparing frequency of belief in reincarnation from different international survey projects (RAMP, EVS, ISSP) reveals differences of about 15 to 20 percent depending on the specific question format. If single binary questions are used, then belief in reincarnation is more often reported than if a forced-choice question is used which offers respondents alternatives to belief in reincarnation (e.g. resurrection). One possible explanation for this result is that respondents confuse reincarnation...

Renewable energy systems the choice and modeling of 100% renewable solutions

CERN Document Server

Lund, Henrik

2009-01-01

How can society quickly convert to renewable energy? Can worldwide energy needs ever be met through 100% renewable sources? The answers to these questions rest largely on the perception of choice in the energy arena. It is of pivotal importance that engineers, researchers and policymakers understand what choices are available, and reasonable, when considering the design and deployment of new energy systems. The mission of this new book, written by one of the world's foremost experts in renewable power, is to arm these professionals with the tools and methodologies necessary to make smart choic

Rational Choice, Consumer Vulnerability and Empowerment: Diverging Economic Perspectives and Issues for Debate

Directory of Open Access Journals (Sweden)

Mădălina Bălău-Ariton

2013-05-01

Full Text Available This paper discusses the issue of consumer choice seen from two quite diverging perspectives: rational choice theory and consumer empowerment as it is currently measured by available research at European Union level. The question we try to answer is: In what manner do the assumptions on consumer rational choice influence the actual understanding of choice and the improvement of the fairness of the choice? To this aim we review the basic theoretical ideas on rational choice and consumer empowerment, as well as the conclusions of previous research on Romanian consumers’ empowerment current situation. The main finding of this analysis is that Romanian consumer choice needs more awareness, an increase of consumer skills and more active individual involvement in discussing these issues.

Assessment of the Assessment Tool: Analysis of Items in a Non-MCQ Mathematics Exam

Science.gov (United States)

Khoshaim, Heba Bakr; Rashid, Saima

2016-01-01

Assessment is one of the vital steps in the teaching and learning process. The reported action research examines the effectiveness of an assessment process and inspects the validity of exam questions used for the assessment purpose. The instructors of a college-level mathematics course studied questions used in the final exams during the academic…

A Common Mechanism Underlying Food Choice and Social Decisions.

Directory of Open Access Journals (Sweden)

Ian Krajbich

2015-10-01

Full Text Available People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others' benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making.

Choices and changes: Eccles' Expectancy-Value model and upper-secondary school students' longitudinal reflections about their choice of a STEM education

Science.gov (United States)

Lykkegaard, Eva; Ulriksen, Lars

2016-03-01

During the past 30 years, Eccles' comprehensive social-psychological Expectancy-Value Model of Motivated Behavioural Choices (EV-MBC model) has been proven suitable for studying educational choices related to Science, Technology, Engineering and/or Mathematics (STEM). The reflections of 15 students in their last year in upper-secondary school concerning their choice of tertiary education were examined using quantitative EV-MBC surveys and repeated qualitative interviews. This article presents the analyses of three cases in detail. The analytical focus was whether the factors indicated in the EV-MBC model could be used to detect significant changes in the students' educational choice processes. An important finding was that the quantitative EV-MBC surveys and the qualitative interviews gave quite different results concerning the students' considerations about the choice of tertiary education, and that significant changes in the students' reflections were not captured by the factors of the EV-MBC model. This questions the validity of the EV-MBC surveys. Moreover, the quantitative factors from the EV-MBC model did not sufficiently explain students' dynamical educational choice processes where students in parallel considered several different potential educational trajectories. We therefore call for further studies of the EV-MBC model's use in describing longitudinal choice processes and especially in investigating significant changes.

The Effectiveness of Problem-Based Learning Approach Based on Multiple Intelligences in Terms of Student’s Achievement, Mathematical Connection Ability, and Self-Esteem

Science.gov (United States)

Kartikasari, A.; Widjajanti, D. B.

2017-02-01

The aim of this study is to explore the effectiveness of learning approach using problem-based learning based on multiple intelligences in developing student’s achievement, mathematical connection ability, and self-esteem. This study is experimental research with research sample was 30 of Grade X students of MIA III MAN Yogyakarta III. Learning materials that were implemented consisting of trigonometry and geometry. For the purpose of this study, researchers designed an achievement test made up of 44 multiple choice questions with respectively 24 questions on the concept of trigonometry and 20 questions for geometry. The researcher also designed a connection mathematical test and self-esteem questionnaire that consisted of 7 essay questions on mathematical connection test and 30 items of self-esteem questionnaire. The learning approach said that to be effective if the proportion of students who achieved KKM on achievement test, the proportion of students who achieved a minimum score of high category on the results of both mathematical connection test and self-esteem questionnaire were greater than or equal to 70%. Based on the hypothesis testing at the significance level of 5%, it can be concluded that the learning approach using problem-based learning based on multiple intelligences was effective in terms of student’s achievement, mathematical connection ability, and self-esteem.

Mexico's critical choices

International Nuclear Information System (INIS)

Marcos, E.

1990-01-01

In Mexico, the 1982 fall in international oil prices shook the national conscience and pushed the Mexican people in search of a new national image and toward the choices they must make to attain that image. But, according to the author of this paper, the country as a whole has already made critical choices for overall strategy and there are reasons for optimism. In the current economic environment of growing domestic demand and enhanced international competitiveness, the author sees PEMEX (the Mexican national oil company) facing not only the challenge of responding to the rapid changes taking place in the Mexican economy, but also making a significant contribution toward the solid and stable growth of the country. The relevant question is how PEMEX will live up to these expectations. This paper describes several steps PEMEX has taken already or is preparing to take in order to meet this challenge, including: investment in the domestic petrochemical industry; entry into the Eurobond market; development of new methods of project financing

Auction fever: exploring informational social influences on bidder choices.

Science.gov (United States)

Chen, Yi-Fen

2011-01-01

Previous investigations of herd behavior have identified the importance of informational social influences in consumer decision making. This research presents three studies examining herd behavior in online auctions. The three studies addressed the influence on bidder online choices of herd cues frequently found in online auctions, including bid number, feedback ratings, and number of questions and answers. This research also investigated the effect of different levels of herd cues on bidder online choices under high and low brand awareness in online auctions. The experimental results demonstrated that bidders use online herd cues when making decisions in online auctions. Additionally, different levels of herd cues influence bidder online choices in both high and low brand awareness product situations.

Actions and Beliefs : Estimating Distribution-Based Preferences Using a Large Scale Experiment with Probability Questions on Expectations

NARCIS (Netherlands)

Bellemare, C.; Kroger, S.; van Soest, A.H.O.

2005-01-01

We combine the choice data of proposers and responders in the ultimatum game, their expectations elicited in the form of subjective probability questions, and the choice data of proposers ("dictator") in a dictator game to estimate a structural model of decision making under uncertainty.We use a

Effects of Individual Differences in Working Memory on Plan Presentational Choices.

Science.gov (United States)

Tintarev, Nava; Masthoff, Judith

2016-01-01

This paper addresses research questions that are central to the area of visualization interfaces for decision support: (RQ1) whether individual user differences in working memory should be considered when choosing how to present visualizations; (RQ2) how to present the visualization to support effective decision making and processing; and (RQ3) how to evaluate the effectiveness of presentational choices. These questions are addressed in the context of presenting plans, or sequences of actions, to users. The experiments are conducted in several domains, and the findings are relevant to applications such as semi-autonomous systems in logistics. That is, scenarios that require the attention of humans who are likely to be interrupted, and require good performance but are not time critical. Following a literature review of different types of individual differences in users that have been found to affect the effectiveness of presentational choices, we consider specifically the influence of individuals' working memory (RQ1). The review also considers metrics used to evaluate presentational choices, and types of presentational choices considered. As for presentational choices (RQ2), we consider a number of variants including interactivity, aggregation, layout, and emphasis. Finally, to evaluate the effectiveness of plan presentational choices (RQ3) we adopt a layered-evaluation approach and measure performance in a dual task paradigm, involving both task interleaving and evaluation of situational awareness. This novel methodology for evaluating visualizations is employed in a series of experiments investigating presentational choices for a plan. A key finding is that emphasizing steps (by highlighting borders) can improve effectiveness on a primary task, but only when controlling for individual variation in working memory.

Effects of Individual Differences in Working Memory on Plan Presentational Choices

Directory of Open Access Journals (Sweden)

Nava Tintarev

2016-11-01

Full Text Available This paper addresses research questions that are central to the area of visualization interfaces for decision support: RQ1 whether individual user differences in working memory should be considered when making choosing how to present visualizations; RQ2 how to present the visualization to support effective decision making and processing; and RQ3 how to evaluate the effectiveness of presentational choices. These questions are addressed in the context of presenting plans, or sequences of actions, to users. The experiments are conducted in several domains, and the findings are relevant to applications such as semi-autonomous systems in logistics. That is, scenarios that require the attention of humans who are likely to be interrupted, and require good performance but are not time critical. Following a literature review of different types of individual differences in users that have been found to affect the effectiveness of presentational choices, we consider specifically the influence of individuals' working memory (RQ1. The review also considers metrics used to evaluate presentational choices, and types of presentational choices considered. As for presentational choices (RQ2, we consider a number of variants including interactivity, aggregation, layout, and emphasis. Finally, to evaluate the effectiveness of plan presentational choices (RQ3 we adopt a layered-evaluation approach and measure performance in a dual task paradigm, involving both task interleaving and evaluation of situational awareness. This novel methodology for evaluating visualizations is employed in a series of experiments investigating presentational choices for a plan. A key finding is that emphasizing steps (by highlighting borders can improve effectiveness on a primary task, but only when controlling for individual variation in working memory.

The social representations of the greenhouse effect (6. wave of questions)

International Nuclear Information System (INIS)

2005-01-01

Six waves of questions concerning the public opinion of the greenhouse effect, were realized by the ISL in May 2000, March 2001, July 2002, June 2003 and May 2004. This sixth wave was realized between June 14 and 25 2005. The report presents the questions asked and analyzes the answers. The concerned domains are the greenhouse effect, the causes, the consequences, the greenhouse effect remediation (technical and political choices), the climatic change, the confidence on the actors and the institutions. (A.L.B.)

Teaching Individuals with Profound Multiple Disabilities to Access Preferred Stimuli with Multiple Microswitches

Science.gov (United States)

Tam, Gee May; Phillips, Katrina J.; Mudford, Oliver C.

2011-01-01

We replicated and extended previous research on microswitch facilitated choice making by individuals with profound multiple disabilities. Following an assessment of stimulus preferences, we taught 6 adults with profound multiple disabilities to emit 2 different responses to activate highly preferred stimuli. All participants learnt to activate…

Identification of Misconceptions through Multiple Choice Tasks at Municipal Chemistry Competition Test

Directory of Open Access Journals (Sweden)

Dušica D Milenković

2016-01-01

Full Text Available In this paper, the level of conceptual understanding of chemical contents among seventh grade students who participated in the municipal Chemistry competition in Novi Sad, Serbia, in 2013 have been examined. Tests for the municipal chemistry competition were used as a measuring instrument, wherein only multiple choice tasks were considered and analyzed. Determination of the level of conceptual understanding of the tested chemical contents was based on the calculation of the frequency of choosing the correct answers. Thereby, identification of areas of satisfactory conceptual understanding, areas of roughly adequate performance, areas of inadequate performance, and areas of quite inadequate performance have been conducted. On the other hand, the analysis of misconceptions was based on the analysis of distractors. The results showed that satisfactory level of conceptual understanding and roughly adequate performance characterize majority of contents, which was expected since only the best students who took part in the contest were surveyed. However, this analysis identified a large number of misunderstandings, as well. In most of the cases, these misconceptions were related to the inability to distinguish elements, compounds, homogeneous and heterogeneous mixtures. Besides, it is shown that students are not familiar with crystal structure of the diamond, and with metric prefixes. The obtained results indicate insufficient visualization of the submicroscopic level in school textbooks, the imprecise use of chemical language by teachers and imprecise use of language in chemistry textbooks.

An Economic Analysis of Identity and Career Choice

DEFF Research Database (Denmark)

Humlum, Maria Knoth; Kleinjans, Kristin J.; Nielsen, Helena Skyt

2007-01-01

Standard economic models which focus on pecuniary payoffs cannot explain why there are highly able individuals who choose careers with low pecuniary re- turns. Therefore, financial incentives are unlikely to be effective in influencing career choices of these individuals. Based on Akerlof...... and Kranton (2000), we con- sider a model of career choice and identity where individuals derive non-pecuniary identity payoffs. Using factor analysis on a range of attitude questions, we find two factors related to identity (career orientation and social orientation), which are important for educational...... choices. The implication is that policymakers and institutions of higher education need to focus on identity related issues rather than just improved financial incentives if they aim at attracting the high ability youth to occupations with excess demand for labor....

Formatt: Correcting protein multiple structural alignments by incorporating sequence alignment

Directory of Open Access Journals (Sweden)

Daniels Noah M

2012-10-01

Full Text Available Abstract Background The quality of multiple protein structure alignments are usually computed and assessed based on geometric functions of the coordinates of the backbone atoms from the protein chains. These purely geometric methods do not utilize directly protein sequence similarity, and in fact, determining the proper way to incorporate sequence similarity measures into the construction and assessment of protein multiple structure alignments has proved surprisingly difficult. Results We present Formatt, a multiple structure alignment based on the Matt purely geometric multiple structure alignment program, that also takes into account sequence similarity when constructing alignments. We show that Formatt outperforms Matt and other popular structure alignment programs on the popular HOMSTRAD benchmark. For the SABMark twilight zone benchmark set that captures more remote homology, Formatt and Matt outperform other programs; depending on choice of embedded sequence aligner, Formatt produces either better sequence and structural alignments with a smaller core size than Matt, or similarly sized alignments with better sequence similarity, for a small cost in average RMSD. Conclusions Considering sequence information as well as purely geometric information seems to improve quality of multiple structure alignments, though defining what constitutes the best alignment when sequence and structural measures would suggest different alignments remains a difficult open question.

Impact of Students’ Class Attendance on Recalling Previously Acquired Information

Directory of Open Access Journals (Sweden)

Camellia Hemyari

2018-03-01

Full Text Available Background: In recent years, availability of class material including typed lectures, the professor’s Power Point slides, sound recordings, and even videos made a group of students feel that it is unnecessary to attend the classes. These students usually read and memorize typed lectures within two or three days prior to the exams and usually pass the tests even with low attendance rate. Thus, the question is how effective is this learning system and how long the one-night memorized lessons may last.Methods: A group of medical students (62 out of 106 students, with their class attendance and educational achievements in the Medical Mycology and Parasitology course being recorded since two years ago, was selected and their knowledge about this course was tested by multiple choice questions (MCQ designed based on the previous lectures.Results: Although the mean re-exam score of the students at the end of the externship was lower than the corresponding final score, a significant association was found between the scores of the students in these two exams (r=0.48, P=0.01. Moreover, a significant negative association was predicted between the number of absences and re-exam scores (r=-0.26, P=0.037.Conclusion: As our findings show, the phenomenon of recalling the acquired lessons is preserved for a long period of time and it is associated with the students’ attendance. Many factors including generation effect (by taking notes and cued-recall (via slide picture might play a significant role in the better recalling of the learned information in students with good class attendance.Keywords: STUDENT, MEMORY, LONG-TERM, RECALL, ABSENTEEISM, LEARNING

Using just-in-time teaching and peer instruction in a residency program's core curriculum: enhancing satisfaction, engagement, and retention.

Science.gov (United States)

Schuller, Mary C; DaRosa, Debra A; Crandall, Marie L

2015-03-01

To assess use of the combined just-in-time teaching (JiTT) and peer instruction (PI) instructional strategy in a residency program's core curriculum. In 2010-2011, JiTT/PI was piloted in 31 core curriculum sessions taught by 22 faculty in the Northwestern University Feinberg School of Medicine's general surgery residency program. JiTT/PI required preliminary and categorical residents (n=31) to complete Web-based study questions before weekly specialty topic sessions. Responses were examined by faculty members "just in time" to tailor session content to residents' learning needs. In the sessions, residents answered multiple-choice questions (MCQs) using clickers and engaged in PI. Participants completed surveys assessing their perceptions of JiTT/PI. Videos were coded to assess resident engagement time in JiTT/PI sessions versus prior lecture-based sessions. Responses to topic session MCQs repeated in review sessions were evaluated to study retention. More than 70% of resident survey respondents indicated that JiTT/PI aided in the learning of key points. At least 90% of faculty survey respondents reported positive perceptions of aspects of the JiTT/PI strategy. Resident engagement time for JiTT/PI sessions was significantly greater than for prior lecture-based sessions (z=-2.4, P=.016). Significantly more review session MCQ responses were correct for residents who had attended corresponding JiTT/PI sessions than for residents who had not (chi-square=13.7; df=1; P<.001). JiTT/PI increased learner participation, learner retention, and the amount of learner-centered time. JiTT/PI represents an effective approach for meaningful and active learning in core curriculum sessions.

Ant system for reliability optimization of a series system with multiple-choice and budget constraints

International Nuclear Information System (INIS)

Nahas, Nabil; Nourelfath, Mustapha

2005-01-01

Many researchers have shown that insect colonies behavior can be seen as a natural model of collective problem solving. The analogy between the way ants look for food and combinatorial optimization problems has given rise to a new computational paradigm, which is called ant system. This paper presents an application of ant system in a reliability optimization problem for a series system with multiple-choice constraints incorporated at each subsystem, to maximize the system reliability subject to the system budget. The problem is formulated as a nonlinear binary integer programming problem and characterized as an NP-hard problem. This problem is solved by developing and demonstrating a problem-specific ant system algorithm. In this algorithm, solutions of the reliability optimization problem are repeatedly constructed by considering the trace factor and the desirability factor. A local search is used to improve the quality of the solutions obtained by each ant. A penalty factor is introduced to deal with the budget constraint. Simulations have shown that the proposed ant system is efficient with respect to the quality of solutions and the computing time

Teaching of evidence-based medicine to medical students in Mexico: a randomized controlled trial

Directory of Open Access Journals (Sweden)

Sánchez-Mendiola Melchor

2012-11-01

Full Text Available Abstract Background Evidence-Based Medicine (EBM is an important competency for the healthcare professional. Experimental evidence of EBM educational interventions from rigorous research studies is limited. The main objective of this study was to assess EBM learning (knowledge, attitudes and self-reported skills in undergraduate medical students with a randomized controlled trial. Methods The educational intervention was a one-semester EBM course in the 5th year of a public medical school in Mexico. The study design was an experimental parallel group randomized controlled trial for the main outcome measures in the 5th year class (M5 EBM vs. M5 non-EBM groups, and quasi-experimental with static-groups comparisons for the 4th year (M4, not yet exposed and 6th year (M6, exposed 6 months to a year earlier groups. EBM attitudes, knowledge and self-reported skills were measured using Taylor’s questionnaire and a summative exam which comprised of a 100-item multiple-choice question (MCQ test. Results 289 Medical students were assessed: M5 EBM=48, M5 non-EBM=47, M4=87, and M6=107. There was a higher reported use of the Cochrane Library and secondary journals in the intervention group (M5 vs. M5 non-EBM. Critical appraisal skills and attitude scores were higher in the intervention group (M5 and in the group of students exposed to EBM instruction during the previous year (M6. The knowledge level was higher after the intervention in the M5 EBM group compared to the M5 non-EBM group (pd=0.88 with Taylor's instrument and 3.54 with the 100-item MCQ test. M6 Students that received the intervention in the previous year had a knowledge score higher than the M4 and M5 non-EBM groups, but lower than the M5 EBM group. Conclusions Formal medical student training in EBM produced higher scores in attitudes, knowledge and self-reported critical appraisal skills compared with a randomized control group. Data from the concurrent groups add validity evidence to the

Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial

Directory of Open Access Journals (Sweden)

Fischer Martin R

2006-10-01

Full Text Available Abstract Background Long-menu questions (LMQs are viewed as an alternative method for answering open-ended questions (OEQs in computerized assessment. So far this question type and its influence on examination scores have not been studied sufficiently. However, the increasing use of computerized assessments will also lead to an increasing use of this question type. Using a summative online key feature (KF examination we evaluated whether LMQs can be compared with OEQs in regard to the level of difficulty, performance and response times. We also evaluated the content for its suitability for LMQs. Methods We randomized 146 fourth year medical students into two groups. For the purpose of this study we created 7 peer-reviewed KF-cases with a total of 25 questions. All questions had the same content in both groups, but nine questions had a different answer type. Group A answered 9 questions with an LM type, group B with an OE type. In addition to the LM answer, group A could give an OE answer if the appropriate answer was not included in the list. Results The average number of correct answers for LMQs and OEQs showed no significant difference (p = 0.93. Among all 630 LM answers only one correct term (0.32% was not included in the list of answers. The response time for LMQs did not significantly differ from that of OEQs (p = 0.65. Conclusion LMQs and OEQs do not differ significantly. Compared to standard multiple-choice questions (MCQs, the response time for LMQs and OEQs is longer. This is probably due to the fact that they require active problem solving skills and more practice. LMQs correspond more suitable to Short answer questions (SAQ then to OEQ and should only be used when the answers can be clearly phrased, using only a few, precise synonyms. LMQs can decrease cueing effects and significantly simplify the scoring in computerized assessment.

Variation in choice of study design: findings from the Epidemiology Design Decision Inventory and Evaluation (EDDIE) survey.

Science.gov (United States)

Stang, Paul E; Ryan, Patrick B; Overhage, J Marc; Schuemie, Martijn J; Hartzema, Abraham G; Welebob, Emily

2013-10-01

Researchers using observational data to understand drug effects must make a number of analytic design choices that suit the characteristics of the data and the subject of the study. Review of the published literature suggests that there is a lack of consistency even when addressing the same research question in the same database. To characterize the degree of similarity or difference in the method and analysis choices made by observational database research experts when presented with research study scenarios. On-line survey using research scenarios on drug-effect studies to capture method selection and analysis choices that follow a dependency branching based on response to key questions. Voluntary participants experienced in epidemiological study design solicited for participation through registration on the Observational Medical Outcomes Partnership website, membership in particular professional organizations, or links in relevant newsletters. Description (proportion) of respondents selecting particular methods and making specific analysis choices based on individual drug-outcome scenario pairs. The number of questions/decisions differed based on stem questions of study design, time-at-risk, outcome definition, and comparator. There is little consistency across scenarios, by drug or by outcome of interest, in the decisions made for design and analyses in scenarios using large healthcare databases. The most consistent choice was the cohort study design but variability in the other critical decisions was common. There is great variation among epidemiologists in the design and analytical choices that they make when implementing analyses in observational healthcare databases. These findings confirm that it will be important to generate empiric evidence to inform these decisions and to promote a better understanding of the impact of standardization on research implementation.

Early Education and Professional Choice: Brazilian Teachers' Views

Science.gov (United States)

Galvão, Afonso; Brasil, Ive

2014-01-01

This qualitative and exploratory research is aimed at investigating the underlying reasons for the professional choice of Brazilian teachers who work within early education. Seventeen teachers (seven from public schools and 10 from private schools) were interviewed in depth in a semi-structured manner. Questions concerned the reasons that guided…

The axiom of multiple choice and models for constructive set theory

NARCIS (Netherlands)

van den Berg, B.; Moerdijk, I.

2014-01-01

We propose an extension of Aczel's constructive set theory CZF by an axiom for inductive types and a choice principle, and show that this extension has the following properties: it is interpretable in Martin-Löf's type theory (hence acceptable from a constructive and generalized-predicative

Gender and Performance in Accounting Examinations: Exploring the Impact of Examination Format

Science.gov (United States)

Arthur, Neal; Everaert, Patricia

2012-01-01

This paper addresses the question of whether the increasing use of multiple-choice questions will favour particular student groups, i.e. male or female students. Using data from Belgium, this paper empirically examines the existence of a gender effect by comparing the relative performance of male and female students in both multiple-choice and…

The framing of decisions and the psychology of choice.

Science.gov (United States)

Tversky, A; Kahneman, D

1981-01-30

The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways. Reversals of preference are demonstrated in choices regarding monetary outcomes, both hypothetical and real, and in questions pertaining to the loss of human lives. The effects of frames on preferences are compared to the effects of perspectives on perceptual appearance. The dependence of preferences on the formulation of decision problems is a significant concern for the theory of rational choice.

Effect of web-supported health education on knowledge of health and healthy-living behaviour of female staff in a Turkish university.

Science.gov (United States)

Nurgul, Keser; Nursan, Cinar; Dilek, Kose; Over, Ozcelik Tijen; Sevin, Altinkaynak

2015-01-01

Once limited with face-to face courses, health education has now moved into the web environment after new developments in information technology This study was carried out in order to give training to the university academic and administrative female staff who have difficulty in attending health education planned for specific times and places. The web-supported training focuses on healthy diet, the importance of physical activity, damage of smoking and stress management. The study was carried out in Sakarya University between the years 2012-2013 as a descriptive and quasi experimental study. The sample consisted of 30 participants who agreed to take part in the survey, filled in the forms and completed the whole training. The data were collected via a "Personel Information Form", "Health Promotion Life-Style Profile (HPLSP)", and "Multiple Choice Questionnaire (MCQ). There was a statistically significant difference between the total points from "Health Promotion Life-Style Profile" and the total points from the sub-scale after and before the training (t=3.63, p=0.001). When the points from the multiple choice questionnaire after and before training were compared, it was seen that the average points were higher after the training (t=8.57, ptraining has a positive effect on the healthy living behaviour of female staff working at a Turkish university and on their knowledge of health promotion.

The Relationship Between Personality Types and Career Choice of ...

African Journals Online (AJOL)

The study was carried out to investigate the Relationship between Personality Types and Career Choice of Secondary School Students in Nigeria. The researchers formulated one research question and one hypothesis to guide the study. The researchers employed two sampling techniques, cluster and random sampling ...

Questioning the Questions

Science.gov (United States)

Tienken, Christopher H.; Goldberg, Stephanie; DiRocco, Dominic

2010-01-01

Historical accounts of questioning used in the education process trace back to Socrates. One of the best examples of his use of questioning is found in Plato's "The Republic." Socrates used a series of strategic questions to help his student Glaucon come to understand the concept of justice. Socrates purposefully posed a series of…

Food Choices under Stress: Considering Internet Usage and Social Support

OpenAIRE

Drescher, Larissa S.; Hasselbach, Johanna

2014-01-01

It is a known fact that stress negatively affects food choices. Consequentially, this paper analyzes three different research questions using a sample of 330 international students in Germany. Firstly, it is observed if stress affects students’ motivations to eat, i.e. if it triggers changes in the motivation behind food choices. Results show that this is not the case. Secondly, it is tested if social support acts as a buffer on the relationship between stress and healthy eating, similarly to...

Multiple choice questions are superior to extended matching questions to identify medicine and biomedical sciences students who perform poorly.

NARCIS (Netherlands)

Eijsvogels, T.M.H.; Brand, T.L. van den; Hopman, M.T.E.

2013-01-01

In recent years, medical faculties at Dutch universities have implemented a legally binding study advice to students of medicine and biomedical sciences during their propaedeutic phase. Appropriate examination is essential to discriminate between poor (grade <6), moderate (grade 6-8) and excellent

Choice of forum in an area of freedom, security and justice

Directory of Open Access Journals (Sweden)

Michiel Luchtman

2011-01-01

Full Text Available This article deals with the question of which state, in the case of overlapping jurisdictions, should investigate, prosecute and try offences in the European area of freedom, security and justice (choice of forum. As binding instruments on the choice of forum currently have no priority for the European legislator, this issue is de facto left largely to the legislative and executive branches of the Member States. Yet the question of whether this Member State discretion is acceptable de iure remains unanswered. This article assesses the relevant EU instruments in light of the requirement of a 'tribunal established by law' (Article 6 ECHR; Article 47 CFR and addresses the issue of whether this requirement, in addition to its role in the national context, is also of relevance for the AFSJ as a whole. It is submitted that the choice of forum has a clear constitutional dimension, including a prominent role for the national and European judiciary as well. Only if concerns of losing national sovereignty are overcome will it be possible to start the debate on what actions must follow.

Sample selection and taste correlation in discrete choice transport modelling

DEFF Research Database (Denmark)

Mabit, Stefan Lindhard

2008-01-01

explain counterintuitive results in value of travel time estimation. However, the results also point at the difficulty of finding suitable instruments for the selection mechanism. Taste heterogeneity is another important aspect of discrete choice modelling. Mixed logit models are designed to capture...... the question for a broader class of models. It is shown that the original result may be somewhat generalised. Another question investigated is whether mode choice operates as a self-selection mechanism in the estimation of the value of travel time. The results show that self-selection can at least partly...... of taste correlation in willingness-to-pay estimation are presented. The first contribution addresses how to incorporate taste correlation in the estimation of the value of travel time for public transport. Given a limited dataset the approach taken is to use theory on the value of travel time as guidance...

Exploring how individuals complete the choice tasks in a discrete choice experiment: an interview study

Directory of Open Access Journals (Sweden)

Jorien Veldwijk

2016-04-01

Full Text Available Abstract Background To be able to make valid inferences on stated preference data from a Discrete Choice Experiment (DCE it is essential that researchers know if participants were actively involved, understood and interpreted the provided information correctly and whether they used complex decision strategies to make their choices and thereby acted in accordance with the continuity axiom. Methods During structured interviews, we explored how 70 participants evaluated and completed four discrete choice tasks aloud. Hereafter, additional questions were asked to further explore if participants understood the information that was provided to them and whether they used complex decision strategies (continuity axiom when making their choices. Two existing DCE questionnaires on rotavirus vaccination and prostate cancer-screening served as case studies. Results A large proportion of the participants was not able to repeat the exact definition of the risk attributes as explained to them in the introduction of the questionnaire. The majority of the participants preferred more optimal over less optimal risk attribute levels. Most participants (66 % mentioned three or more attributes when motivating their decisions, thereby acting in accordance with the continuity axiom. However, 16 out of 70 participants continuously mentioned less than three attributes when motivating their decision. Lower educated and less literate participants tended to mention less than three attributes when motivating their decision and used trading off between attributes less often as a decision-making strategy. Conclusion The majority of the participants seemed to have understood the provided information about the choice tasks, the attributes, and the levels. They used complex decision strategies (continuity axiom and are therefore capable to adequately complete a DCE. However, based on the participants’ age, educational level and health literacy additional, actions should be

Effect of herd cues and product involvement on bidder online choices.

Science.gov (United States)

Chen, Yi-Fen; Wang, Ya-Ju

2010-08-01

Previous works have shown that consumers are influenced by others in decision making. Herd behavior is common in situations in which consumers infer product quality from other consumer choices and incorporate that information into their own decision making. This research presents two studies examining herd effect and the moderating role of product involvement on bidder choices in online auctions. The two studies addressed the influence on bidder online choices of herd cues frequently found in online auctions, including feedback ratings and number of questions and answers. The experimental results demonstrated that bidders use online herd cues when making decisions in online auctions. Additionally, the effects of herd cues on bidder online choices were stronger in high-involvement than low-involvement participants. Results and implications are discussed.

Discrete Choice Experiments: A Guide to Model Specification, Estimation and Software.

Science.gov (United States)

Lancsar, Emily; Fiebig, Denzil G; Hole, Arne Risa

2017-07-01

We provide a user guide on the analysis of data (including best-worst and best-best data) generated from discrete-choice experiments (DCEs), comprising a theoretical review of the main choice models followed by practical advice on estimation and post-estimation. We also provide a review of standard software. In providing this guide, we endeavour to not only provide guidance on choice modelling but to do so in a way that provides a 'way in' for researchers to the practicalities of data analysis. We argue that choice of modelling approach depends on the research questions, study design and constraints in terms of quality/quantity of data and that decisions made in relation to analysis of choice data are often interdependent rather than sequential. Given the core theory and estimation of choice models is common across settings, we expect the theoretical and practical content of this paper to be useful to researchers not only within but also beyond health economics.

A Case Study of School Choice and Special Education in the 21st Century

Science.gov (United States)

Bernier, Lisa E.

2017-01-01

School choice is deeply rooted in the marketization theories originally presented by Milton Friedman in the 1950s. There are many school choice options available in Arizona. The purpose and primary research question of this case study explored how a Free Appropriate Public Education (FAPE) and other factors influenced the parents' decisions to…

Xhosa male initiation: freedom of choice versus the need to belong.

Science.gov (United States)

Venter, Rienie

2013-01-01

The question of choice and individual decision making in groups where a strong ideology exists has been repeatedly studied and debated. The objective of this paper is to highlight the aspects of influence pertaining to initiation in the life world of the Xhosa boy. The amaXhosa are speakers of Bantu languages traditionally living in south-east South-Africa, and in the last two centuries throughout the southern and central-southern parts of the country. To substantiate the literature study, a survey in the form of a questionnaire was done to establish the attitudes of Xhosa people regarding traditional male initiation. To gather in-depth information from persons who had personal contact with initiates, interviews were conducted with two selected people in helping professions. The author argues that the traditional custom of male initiation among the amaXhosa rests on an ideology that tolerates no dissent or critique and that deprives individuals of their decision-making power. It is further argued that the implication of not undergoing the ritual is so severe for Xhosa boys that the choice they are thought to have may not be a choice in practice. Questions were raised regarding the role of children and women in general in a patriarchal society. As an example of culture and religion as influencing factors in a group's reality, Xhosa male initiation was discussed. These arguments call for the raising of questions and identifying themes and discourse in the area of children's right to choice. The results indicate that, regardless of physical and psychological implications, the custom in its traditional form is still preferred by most respondents.

Infant male circumcision and the autonomy of the child: two ethical questions.

Science.gov (United States)

McMath, Akim

2015-08-01

Routine neonatal circumcision--the non-therapeutic circumcision of infant males--has generated considerable ethical controversy. In this article, I suggest that much of the disagreement results from conflicting ideas about the autonomy of the child. I examine two questions about autonomy. First, I ask whether we should be realists or idealists about the future autonomous choices of the child-that is, whether we should account for the fact that the child may not make the best choices in future, or whether we should assume that his future choices will reflect his best interests. Second, I ask whether the child has a right to autonomy with respect to circumcision, an interest in autonomy or neither--that is, whether respect for autonomy overrides considerations of interests, whether it counts as one interest among many or whether it counts for nothing. In response to the first question, I argue that we should be idealists when evaluating the child's own interests, but realists when evaluating public health justifications for circumcision. In response to the second question, I argue that the child has an interest in deciding whether or not to be circumcised, insofar as the decision is more likely to reflect his actual interests and his own values. Finally, I show how these findings may help to resolve some particular disputes over the ethics of infant male circumcision. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Putting Health Back Into Health Insurance Choice.

Science.gov (United States)

Atanasov, Pavel; Baker, Tom

2014-08-01

What are the barriers to voluntary take-up of high-deductible plans? We address this question using a large-scale employer survey conducted after an open-enrollment period in which a new high-deductible plan was first introduced. Only 3% of the employees chose this plan, despite the respondents' recognition of its financial advantages. Employees who believed that the high-deductible plan provided access to top physicians in the area were three times more likely to choose it than employees who did not share this belief. A framed field experiment using a similar choice menu showed that displaying additional financial information did not increase high-deductible plan take-up. However, when plans were presented as identical except for the deductible, respondents were highly likely to choose the high-deductible plan, especially in a two-way choice. These results suggest that informing plan choosers about high-deductible plans' health access provisions may affect choice more strongly than focusing on their financial advantages. © The Author(s) 2014.

The experience and expression of anger in posttraumatic stress disorder: the relationship with metacognition.

Science.gov (United States)

Leonhardt, Bethany L; Lysaker, Paul H; Vohs, Jenifer L; James, Alison V; Davis, Louanne W

2018-04-26

Anger experience and expression are a common issue in those experiencing PTSD. However, it remains unclear what variables affect anger and its expression in PTSD. To explore the relationships of synthetic forms of metacognition and metacognitive beliefs with anger experience and expression in PTSD, independent of the effects hyperarousal and depression symptoms. Participants were 51 veterans with diagnosed with PTSD. Metacognition was assessed using the Metacognition Assessment Scale-Abbreviated (MAS-A) and the Metacognitions Questionnaire (MCQ). Depression, PTSD symptom severity, and seven domains of anger expression were also assessed. Correlations showed after controlling for overall levels of hyperarousal, higher MAS-A total scores were related to lower levels of State Anger, Feeling Angry, Expressing Anger Physically, and Anger Expression in. Lower MCQ scores were related to lower State anger, Expressing anger verbally, and Expressing anger physically. Higher levels of depression were related to higher levels of Trait anger, Expressing anger physically, Anger expression out, and Anger expression in. Multiple regressions suggested that the MAS-A and MCQ predicted unique portions of the variance in anger experience and expression. Metacognitive deficits may affect anger experience and expression in those with PTSD and may be an important treatment target.

Students as Rational Decision-Makers: The Question of Beliefs and Attitudes

Science.gov (United States)

Sullivan, Alice

2006-01-01

Rational choice theorists have analysed rates of participation in post-compulsory education, and, in particular, class differentials in these rates. Various claims have been made about the motivations of student decision-makers, but these claims have not been grounded empirically. This paper will assess the question of whether students' attitudes…

The incidence of calorie labeling on fast food choices: A comparison between stated preferences and actual choices.

Science.gov (United States)

Loureiro, Maria L; Rahmani, Djamel

2016-09-01

In order to test the effect of calorie information on fast food choices, we conducted a questionnaire employing two types of stated preferences methods (the best-worst-scaling and intentional questions) and a follow-up randomized field experiment in a sample of 119 participants. This combined approach allowed us to test the internal validity of preferences for fast food meals across elicitation scenarios. The results showed that calorie information reduces the probability of selecting high calorie meals only in the questionnaire, while it did not have any significant impact on actual purchasing behavior in the field experiment. Thus, the findings show that there is a clear difference between the role of calorie information on immediate stated preference choices, and the relatively low level of responsiveness in real choices in a restaurant. We believe that the current results are quite suggestive, indicating the limits of predicting actual fast food behavior, and may open the way to using data sources that combine stated methods with field experiments. Copyright © 2016 Elsevier B.V. All rights reserved.

Addiction and choice: Theory and new data

Directory of Open Access Journals (Sweden)

Gene M Heyman

2013-05-01

Full Text Available Addiction’s biological basis has been the focus of much research. The findings have persuaded experts and the public that drug use in addicts is compulsive. But the word compulsive identifies patterns of behavior. Thus, the question is not whether addiction has a biology, but whether it is sensible to say that addicts use drugs compulsively. Research shows most of those who meet the American Psychiatric Association’s criteria for addiction quit using illegal drugs by age thirty, that they usually quit without professional help, and that the correlates of quitting include legal concerns, economic pressures, and the desire for respect, particularly from family members. That is, the correlates of quitting are the correlates of choice. However, addiction is, by definition, a disorder, and thereby not beneficial in the long run. This is precisely the pattern of choices predicted by quantitative choice principles, such as the matching law, melioration, and hyperbolic discounting. Although the brain disease model of addiction is perceived by many as received knowledge it is not supported by research or logic. In contrast, well established, quantitative choice principles predict both the possibility and the details of addiction.

Past-behavioural versus situational questions in a postgraduate admissions multiple mini-interview: a reliability and acceptability comparison.

Science.gov (United States)

Yoshimura, Hiroshi; Kitazono, Hidetaka; Fujitani, Shigeki; Machi, Junji; Saiki, Takuya; Suzuki, Yasuyuki; Ponnamperuma, Gominda

2015-04-14

The Multiple Mini-Interview (MMI) mostly uses 'Situational' Questions (SQs) as an interview format within a station, rather than 'Past-Behavioural' Questions (PBQs), which are most frequently adopted in traditional single-station personal interviews (SSPIs) for non-medical and medical selection. This study investigated reliability and acceptability of the postgraduate admissions MMI with PBQ and SQ interview formats within MMI stations. Twenty-six Japanese medical graduates, first completed the two-year national obligatory initial postgraduate clinical training programme and then applied to three specialty training programmes - internal medicine, general surgery, and emergency medicine - in a Japanese teaching hospital, where they underwent the Accreditation Council for Graduate Medical Education (ACGME)-competency-based MMI. This MMI contained five stations, with two examiners per station. In each station, a PBQ, and then an SQ were asked consecutively. PBQ and SQ interview formats were not separated into two different stations, or the order of questioning of PBQs and SQs in individual stations was not changed due to lack of space and experienced examiners. Reliability was analysed for the scores of these two MMI question types. Candidates and examiners were surveyed on this experience. The PBQ and SQ formats had generalisability coefficients of 0.822 and 0.821, respectively. With one examiner per station, seven stations could produce a reliability of more than 0.80 in both PBQ and SQ formats. More than 60% of both candidates and examiners felt positive about the overall candidates' ability. All participants liked the fairness of this MMI when compared with the previously experienced SSPI. SQs were perceived more favourable by candidates; in contrast, PBQs were perceived more relevant by examiners. Both PBQs and SQs are equally reliable and acceptable as station interview formats in the postgraduate admissions MMI. However, the use of the two formats within the

Managing Disease Risks from Trade: Strategic Behavior with Many Choices and Price Effects.

Science.gov (United States)

Chitchumnong, Piyayut; Horan, Richard D

2018-03-16

An individual's infectious disease risks, and hence the individual's incentives for risk mitigation, may be influenced by others' risk management choices. If so, then there will be strategic interactions among individuals, whereby each makes his or her own risk management decisions based, at least in part, on the expected decisions of others. Prior work has shown that multiple equilibria could arise in this setting, with one equilibrium being a coordination failure in which individuals make too few investments in protection. However, these results are largely based on simplified models involving a single management choice and fixed prices that may influence risk management incentives. Relaxing these assumptions, we find strategic interactions influence, and are influenced by, choices involving multiple management options and market price effects. In particular, we find these features can reduce or eliminate concerns about multiple equilibria and coordination failure. This has important policy implications relative to simpler models.

Which currency to set price? A model of multiple countries and risk averse firm

OpenAIRE

Jian Wang

2004-01-01

A crucial question centering many recent debates in the international macroeconomics is under which currency the price is sticky. This paper provides a microfoundation to study the firm¡¦s choice of price setting currency in the sticky price model. I first prove that the risk preference is a secondary consideration in the choice of the price setting currency. This result questions the claim that the currency forward market can change the currency choice of risk averse firms. Then I extend the...

Mode choice endogeneity in value of travel time estimation

DEFF Research Database (Denmark)

Mabit, Stefan Lindhard; Fosgerau, Mogens

The current way to estimate value of travel time is to use a mode-specific sample and hence to estimate mode-specific value of travel times. This approach raises certain questions concerning how to generalise the values to a population. A problem would be if there is an uncontrolled sample...... selection mechanism. This is the case if there is correlation between mode choice and the value of travel time that is not controlled for by explanatory variables. What could confuse the estimated values is the difficulty to separate mode effects from user effect. An example would be the effect of income...... of travel time we use a stated choice dataset. These data include binary choice within mode for car and bus. The first approach is to use a probit model to model mode choice using instruments and then use this in the estimation of the value of travel time. The second approach is based on the use of a very...

A labelled discrete choice experiment adds realism to the choices presented: preferences for surveillance tests for Barrett esophagus

Directory of Open Access Journals (Sweden)

Donkers Bas

2009-05-01

Full Text Available Abstract Background Discrete choice experiments (DCEs allow systematic assessment of preferences by asking respondents to choose between scenarios. We conducted a labelled discrete choice experiment with realistic choices to investigate patients' trade-offs between the expected health gains and the burden of testing in surveillance of Barrett esophagus (BE. Methods Fifteen choice scenarios were selected based on 2 attributes: 1 type of test (endoscopy and two less burdensome fictitious tests, 2 frequency of surveillance. Each test-frequency combination was associated with its own realistic decrease in risk of dying from esophageal adenocarcinoma. A conditional logit model was fitted. Results Of 297 eligible patients (155 BE and 142 with non-specific upper GI symptoms, 247 completed the questionnaire (84%. Patients preferred surveillance to no surveillance. Current surveillance schemes of once every 1–2 years were amongst the most preferred alternatives. Higher health gains were preferred over those with lower health gains, except when test frequencies exceeded once a year. For similar health gains, patients preferred video-capsule over saliva swab and least preferred endoscopy. Conclusion This first example of a labelled DCE using realistic scenarios in a healthcare context shows that such experiments are feasible. A comparison of labelled and unlabelled designs taking into account setting and research question is recommended.

How libraries make tough choices in difficult times purposeful abandonment

CERN Document Server

Stern, David

2013-01-01

Contemporary library managers face the need to make difficult choices regarding resource allocation in the modern business environment. How Libraries Make Tough Choices in Difficult Times is a practical guide for library managers, offering techniques to analyze existing and potential services, implement best practices for maximizing existing resources, and utilize pressing financial scenarios in order to justify making difficult reallocation decisions. The book begins by asking the fundamental questions of why, what, and how, moving on to look at how to manage expectations and report to both a

Linguistic Justice for which Demos? The Democratic Legitimacy of Language Regime Choices

Directory of Open Access Journals (Sweden)

Garcia Núria

2016-10-01

Full Text Available In the European Union language regime debate, theorists of multiculturalism and cosmopolitanism have framed their arguments in reference to different theories of justice and democracy. Philippe Van Parijs advocates the diffusion of a lingua franca, namely English, as means of changing the scale of the justificatory community to the European level and allowing the creation of a transnational demos. Paradoxically, one key dimension of democracy has hardly been addressed in this discussion: the question of the democratic legitimacy of language regime choices and citizens’ preferences on the different language regime scenarios. Addressing the question of the congruence of language policy choices operated by national and European elites and ordinary citizens’ preferences, this paper argues first that the dimension of democratic legitimacy is crucial and needs to be taken into account in discussions around linguistic justice. Criticizing the assumption of a direct correspondence between individuals’ language learning choices and citizens’ language regime preferences made by different authors, the analysis shows the ambivalence of citizens’ preferences measured by survey data. The article secondly raises the question of the boundaries of the political community at which the expression of citizens’ preferences should be measured and demonstrates that the outcome and the fairness of territorial linguistic regimes may vary significantly according to the level at which this democratic legitimacy is taken into account.

Women's choice of childbirth setting.

Science.gov (United States)

Mackey, M C

1990-01-01

As part of a larger study on women's views of the childbirth experience, this study was focused on women's choice of childbirth setting. Sixty-one Lamaze-prepared, married multigravidae between the ages of 21 and 37 and experiencing a normal pregnancy were interviewed twice: at 36-38 weeks gestation in their homes and during their postpartum stay in the hospital. Data were collected using (a) two semistructured interview guides consisting of open-ended questions about choosing a caregiver and the place of birth and about describing the actual childbirth experience, (b) a self-administered sociodemographic questionnaire, and (c) an obstetrical and infant data form. The tape-recorded interviews were transcribed verbatim. Qualitative data analysis was focused on reasons for choosing a hospital and a physician, reasons for choosing or not choosing a birthing room, and the outcomes of the decisions. An understanding of women's childbirth needs as reflected in their choices can suggest areas where flexibility might be built into maternity care programs.

Parental Choice of School, Class Strategies, and Educational Inequality: An Essay Review of "School Choice in China--A Different Tale?" (X. Wu, New York, NY: Routledge, 2014, 168 pp. ISBN 978-0-415-81769-1)

Science.gov (United States)

Liu, Shuning; Apple, Michael W.

2016-01-01

Given the increasingly global nature of marketized school choice policies, this makes it even more crucial to investigate how the multiple scales, forms, and emphases of school choice in different countries are influenced by particular political, economic, and cultural conditions. While much of the critical research on school choice policies has…

Human X-chromosome inactivation pattern distributions fit a model of genetically influenced choice better than models of completely random choice

Science.gov (United States)

Renault, Nisa K E; Pritchett, Sonja M; Howell, Robin E; Greer, Wenda L; Sapienza, Carmen; Ørstavik, Karen Helene; Hamilton, David C

2013-01-01

In eutherian mammals, one X-chromosome in every XX somatic cell is transcriptionally silenced through the process of X-chromosome inactivation (XCI). Females are thus functional mosaics, where some cells express genes from the paternal X, and the others from the maternal X. The relative abundance of the two cell populations (X-inactivation pattern, XIP) can have significant medical implications for some females. In mice, the ‘choice' of which X to inactivate, maternal or paternal, in each cell of the early embryo is genetically influenced. In humans, the timing of XCI choice and whether choice occurs completely randomly or under a genetic influence is debated. Here, we explore these questions by analysing the distribution of XIPs in large populations of normal females. Models were generated to predict XIP distributions resulting from completely random or genetically influenced choice. Each model describes the discrete primary distribution at the onset of XCI, and the continuous secondary distribution accounting for changes to the XIP as a result of development and ageing. Statistical methods are used to compare models with empirical data from Danish and Utah populations. A rigorous data treatment strategy maximises information content and allows for unbiased use of unphased XIP data. The Anderson–Darling goodness-of-fit statistics and likelihood ratio tests indicate that a model of genetically influenced XCI choice better fits the empirical data than models of completely random choice. PMID:23652377

Essays on portfolio choice with Bayesian methods

OpenAIRE

Kebabci, Deniz

2007-01-01

How investors should allocate assets to their portfolios in the presence of predictable components in asset returns is a question of great importance in finance. While early studies took the return generating process as given, recent studies have addressed issues such as parameter estimation and model uncertainty. My dissertation develops Bayesian methods for portfolio choice - and industry allocation in particular - under parameter and model uncertainty. The first chapter of my dissertation,...

75 FR 11553 - Final Fair Market Rents for the Housing Choice Voucher Program and Moderate Rehabilitation Single...

Science.gov (United States)

2010-03-11

... provided on the same website noted above. Any questions related to use of FMRs or voucher payment standards... the Housing Choice Voucher Program and Moderate Rehabilitation Single Room Occupancy Program for... County, ND. Both areas were having significant problems administering the Housing Choice Voucher program...

Is the interpretation of delayed-choice experiments misleading?

International Nuclear Information System (INIS)

Roussel, Pierre; Stefan, Iulian

2007-06-01

The interpretation of an experimental realization of Wheeler's delayed-choice Gedanken experiment is discussed and called into question. Once more, one finds that nature behaves in agreement with the prediction of quantum mechanics even in surprising situations where a tension with relativity seems to appear. If the experiment reported by Vincent Jacques et al (Science 315, 966.(2007)), which performs the Wheeler's Gedanken experiment, does not produce any 'delayed choice effect', it does exemplify the observation of a wave packet reduction in a very special situation: because of the short duration of the light pulse the wave packet is split into two parts with no connexity, which 'travel' separately along the spectrometer arms

Do pregnant women and their partners make an informed choice about first trimester risk assessment for Down syndrome, and are they satisfied with the choice?

DEFF Research Database (Denmark)

Bangsgaard, Louise; Tabor, Ann

2012-01-01

OBJECTIVE: All pregnant women in Denmark are offered risk assessment for Down syndrome. The aim of this study was to investigate whether women and partners make an informed choice about first trimester risk assessment, and their satisfaction with the choice. METHODS: A survey using multiple measure...... of knowledge (82% and 81%) and positive attitudes regarding risk assessment (97% and 98%), leading to 79% and 80% making an informed choice. Education predicted knowledge for women (odds ratio 3.42; 95% confidence interval 1.63-7.18) and partners (odds ratio 2.97; 95% confidence interval 1.37-6.45), country...... of origin predicted knowledge, attitude and informed choice among women. Three hundred thirty-two women (99%) and all partners were satisfied with having chosen risk assessment. CONCLUSIONS: Although 80% of pregnant women and partners make an informed choice about undergoing first trimester risk assessment...

Using non-food information to identify food-choice segment membership

NARCIS (Netherlands)

Kornelis, M.; Herpen, van E.; Lans, van der I.A.; Aramyan, L.H.

2010-01-01

Food companies, governments, and societal organizations use an increasing number of food-choice motives to persuade consumers to buy food products, and the question which combinations of motives matter for which type of consumer has become of central relevance. In this study, we use a concomitant

Questioning context: a set of interdisciplinary questions for investigating contextual factors affecting health decision making

Science.gov (United States)

Charise, Andrea; Witteman, Holly; Whyte, Sarah; Sutton, Erica J.; Bender, Jacqueline L.; Massimi, Michael; Stephens, Lindsay; Evans, Joshua; Logie, Carmen; Mirza, Raza M.; Elf, Marie

2011-01-01

Abstract Objective  To combine insights from multiple disciplines into a set of questions that can be used to investigate contextual factors affecting health decision making. Background  Decision‐making processes and outcomes may be shaped by a range of non‐medical or ‘contextual’ factors particular to an individual including social, economic, political, geographical and institutional conditions. Research concerning contextual factors occurs across many disciplines and theoretical domains, but few conceptual tools have attempted to integrate and translate this wide‐ranging research for health decision‐making purposes. Methods  To formulate this tool we employed an iterative, collaborative process of scenario development and question generation. Five hypothetical health decision‐making scenarios (preventative, screening, curative, supportive and palliative) were developed and used to generate a set of exploratory questions that aim to highlight potential contextual factors across a range of health decisions. Findings  We present an exploratory tool consisting of questions organized into four thematic domains – Bodies, Technologies, Place and Work (BTPW) – articulating wide‐ranging contextual factors relevant to health decision making. The BTPW tool encompasses health‐related scholarship and research from a range of disciplines pertinent to health decision making, and identifies concrete points of intersection between its four thematic domains. Examples of the practical application of the questions are also provided. Conclusions  These exploratory questions provide an interdisciplinary toolkit for identifying the complex contextual factors affecting decision making. The set of questions comprised by the BTPW tool may be applied wholly or partially in the context of clinical practice, policy development and health‐related research. PMID:21029277

Assessing the sensitivity of information distortion to four potential influences in studies of risky choice

Directory of Open Access Journals (Sweden)

Seth A. Miller

2013-11-01

Full Text Available The emergence of a leading alternative during the course of a decision is known to bias the evaluation of new information in a manner that favors that alternative. We report 3 studies that address the sensitivity of predecisional information distortion and its effects in hypothetical risky decisions with regard to 4 potential influences: choice domain, repeated choice, memory requirements, and intermediate progress questions. In Experiment 1 (N = 515, the magnitude of information distortion was similar in 5 choice domains (varied between participants involving monetary gambles, song downloads, frequent-flyer miles, political decisions, or medical decisions. Information distortion mediated the relationship between our manipulation of initial preferences and participants' final choices, with the magnitude of the indirect effect being roughly similar across domains. These results replicate and extend previous findings. Additionally, distortion decreased significantly over 4 similar decision problems (within participants, but remained significant in the fourth problem. In Experiment 2 (N = 214, information distortion increased significantly when previously viewed information remained available, apparently because reiterating that information strengthened emerging preferences. In Experiment 3 (N = 223, the removal of intermediate progress questions that measure information distortion and emerging preferences did not significantly affect final choices, again replicating previous results. We conclude that predecisional information distortion is a relatively stable and robust phenomenon that deserves a prominent role in descriptive theories of choice.

QTest: Quantitative Testing of Theories of Binary Choice.

Science.gov (United States)

Regenwetter, Michel; Davis-Stober, Clintin P; Lim, Shiau Hong; Guo, Ying; Popova, Anna; Zwilling, Chris; Cha, Yun-Shil; Messner, William

2014-01-01

The goal of this paper is to make modeling and quantitative testing accessible to behavioral decision researchers interested in substantive questions. We provide a novel, rigorous, yet very general, quantitative diagnostic framework for testing theories of binary choice. This permits the nontechnical scholar to proceed far beyond traditionally rather superficial methods of analysis, and it permits the quantitatively savvy scholar to triage theoretical proposals before investing effort into complex and specialized quantitative analyses. Our theoretical framework links static algebraic decision theory with observed variability in behavioral binary choice data. The paper is supplemented with a custom-designed public-domain statistical analysis package, the QTest software. We illustrate our approach with a quantitative analysis using published laboratory data, including tests of novel versions of "Random Cumulative Prospect Theory." A major asset of the approach is the potential to distinguish decision makers who have a fixed preference and commit errors in observed choices from decision makers who waver in their preferences.

QTest: Quantitative Testing of Theories of Binary Choice

Science.gov (United States)

Regenwetter, Michel; Davis-Stober, Clintin P.; Lim, Shiau Hong; Guo, Ying; Popova, Anna; Zwilling, Chris; Cha, Yun-Shil; Messner, William

2014-01-01

The goal of this paper is to make modeling and quantitative testing accessible to behavioral decision researchers interested in substantive questions. We provide a novel, rigorous, yet very general, quantitative diagnostic framework for testing theories of binary choice. This permits the nontechnical scholar to proceed far beyond traditionally rather superficial methods of analysis, and it permits the quantitatively savvy scholar to triage theoretical proposals before investing effort into complex and specialized quantitative analyses. Our theoretical framework links static algebraic decision theory with observed variability in behavioral binary choice data. The paper is supplemented with a custom-designed public-domain statistical analysis package, the QTest software. We illustrate our approach with a quantitative analysis using published laboratory data, including tests of novel versions of “Random Cumulative Prospect Theory.” A major asset of the approach is the potential to distinguish decision makers who have a fixed preference and commit errors in observed choices from decision makers who waver in their preferences. PMID:24999495

Drift: An Analysis of Outcome Framing in Intertemporal Choice

Science.gov (United States)

Read, Daniel; Frederick, Shane; Scholten, Marc

2013-01-01

People prefer to receive good outcomes immediately rather than wait, and they must be compensated for waiting. But what influences their decision about how much compensation is required for a given wait? To give a partial answer to this question, we develop the DRIFT model, a heuristic description of how framing influences intertemporal choice. We…

Social choice for one: On the rationality of intertemporal decisions.

Science.gov (United States)

Paglieri, Fabio

2016-06-01

When faced with an intertemporal choice between a smaller short-term reward and a larger long-term prize, is opting for the latter always indicative of delay tolerance? And is delay tolerance always to be regarded as a manifestation of self-control, and thus as a rational solution to intertemporal dilemmas? I argue in favor of a negative answer to both questions, based on evidence collected in the delay discounting literature. This highlights the need for a nuanced understanding of rationality in intertemporal choice, to capture also situations in which waiting is not the optimal strategy. This paper suggests that such an understanding is fostered by adopting social choice theory as a promising framework to model intertemporal decision making. Some preliminary results of this approach are discussed, and its potential is compared with a much more studied formal model for intertemporal choice, i.e. game theory. Copyright © 2016 Elsevier B.V. All rights reserved.

Student Mental Models of the Greenhouse Effect: Retention Months After Interventions

Science.gov (United States)

Harris, S. E.; Gold, A. U.

2013-12-01

Individual understanding of climate science, and the greenhouse effect in particular, is one factor important for societal decision-making. Ideally, learning opportunities about the greenhouse effect will not only move people toward expert-like ideas but will also have long-lasting effects for those individuals. We assessed university students' mental models of the greenhouse effect before and after specific learning experiences, on a final exam, then again a few months later. Our aim was to measure retention after students had not necessarily been thinking about, nor studying, the greenhouse effect recently. How sticky were the ideas learned? 164 students in an introductory science course participated in a sequence of two learning activities and assessments regarding the greenhouse effect. The first lesson involved the full class, then, for the second lesson, half the students completed a simulation-based activity and the other half completed a data-driven activity. We assessed student thinking through concept sketches, multiple choice and short answer questions. All students generated concept sketches four times, and completed a set of multiple choice (MCQs) and short answer questions twice. Later, 3-4 months after the course ended, 27 students ('retention students') completed an additional concept sketch and answered the questions again, as a retention assessment. These 27 students were nearly evenly split between the two contrasting second lessons in the sequence and included both high and low-achieving students. We then compared student sketches and scores to 'expert' answers. The general pattern over time showed a significant increase in student scores from before the lesson sequence to after, both on concept sketches and MCQs, then an additional increase in concept sketch score on the final exam (MCQs were not asked on the final exam). The scores for the retention students were not significantly different from the full class. Within the retention group

Acoustic Features Influence Musical Choices Across Multiple Genres.

Science.gov (United States)

Barone, Michael D; Bansal, Jotthi; Woolhouse, Matthew H

2017-01-01

Based on a large behavioral dataset of music downloads, two analyses investigate whether the acoustic features of listeners' preferred musical genres influence their choice of tracks within non-preferred, secondary musical styles. Analysis 1 identifies feature distributions for pairs of genre-defined subgroups that are distinct. Using correlation analysis, these distributions are used to test the degree of similarity between subgroups' main genres and the other music within their download collections. Analysis 2 explores the issue of main-to-secondary genre influence through the production of 10 feature-influence matrices, one per acoustic feature, in which cell values indicate the percentage change in features for genres and subgroups compared to overall population averages. In total, 10 acoustic features and 10 genre-defined subgroups are explored within the two analyses. Results strongly indicate that the acoustic features of people's main genres influence the tracks they download within non-preferred, secondary musical styles. The nature of this influence and its possible actuating mechanisms are discussed with respect to research on musical preference, personality, and statistical learning.

Choice certainty in Discrete Choice Experiments

DEFF Research Database (Denmark)

Uggeldahl, Kennet Christian; Jacobsen, Catrine; Lundhede, Thomas

2016-01-01

In this study, we conduct a Discrete Choice Experiment (DCE) using eye tracking technology to investigate if eye movements during the completion of choice sets reveal information about respondents’ choice certainty. We hypothesise that the number of times that respondents shift their visual...

Examining temporal effects of lifecycle events on transport mode choice decisions

NARCIS (Netherlands)

Verhoeven, M.; Arentze, T.A.; Timmermans, H.J.P.; Waerden, van der P.J.H.J.

2005-01-01

This paper describes the first results of a study on the impact of events on transport mode choice decisions. An Internet-based survey was designed to collect data concerning seven structural lifecycle events. In addition, respondents answered questions about personal and household characteristics,

VQABQ: Visual Question Answering by Basic Questions

KAUST Repository

Huang, Jia-Hong

2017-03-19

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a natural language question about an image, the first module takes the question as input and then outputs the basic questions of the main given question. The second module takes the main question, image and these basic questions as input and then outputs the text-based answer of the main question. We formulate the basic questions generation problem as a LASSO optimization problem, and also propose a criterion about how to exploit these basic questions to help answer main question. Our method is evaluated on the challenging VQA dataset and yields state-of-the-art accuracy, 60.34% in open-ended task.

VQABQ: Visual Question Answering by Basic Questions

KAUST Repository

Huang, Jia-Hong; Alfadly, Modar; Ghanem, Bernard

2017-01-01

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a natural language question about an image, the first module takes the question as input and then outputs the basic questions of the main given question. The second module takes the main question, image and these basic questions as input and then outputs the text-based answer of the main question. We formulate the basic questions generation problem as a LASSO optimization problem, and also propose a criterion about how to exploit these basic questions to help answer main question. Our method is evaluated on the challenging VQA dataset and yields state-of-the-art accuracy, 60.34% in open-ended task.

Search, Memory, and Choice Error: An Experiment.

Science.gov (United States)

Sanjurjo, Adam

2015-01-01

Multiple attribute search is a central feature of economic life: we consider much more than price when purchasing a home, and more than wage when choosing a job. An experiment is conducted in order to explore the effects of cognitive limitations on choice in these rich settings, in accordance with the predictions of a new model of search memory load. In each task, subjects are made to search the same information in one of two orders, which differ in predicted memory load. Despite standard models of choice treating such variations in order of acquisition as irrelevant, lower predicted memory load search orders are found to lead to substantially fewer choice errors. An implication of the result for search behavior, more generally, is that in order to reduce memory load (thus choice error) a limited memory searcher ought to deviate from the search path of an unlimited memory searcher in predictable ways-a mechanism that can explain the systematic deviations from optimal sequential search that have recently been discovered in peoples' behavior. Further, as cognitive load is induced endogenously (within the task), and found to affect choice behavior, this result contributes to the cognitive load literature (in which load is induced exogenously), as well as the cognitive ability literature (in which cognitive ability is measured in a separate task). In addition, while the information overload literature has focused on the detrimental effects of the quantity of information on choice, this result suggests that, holding quantity constant, the order that information is observed in is an essential determinant of choice failure.

Search, Memory, and Choice Error: An Experiment.

Directory of Open Access Journals (Sweden)

Adam Sanjurjo

Full Text Available Multiple attribute search is a central feature of economic life: we consider much more than price when purchasing a home, and more than wage when choosing a job. An experiment is conducted in order to explore the effects of cognitive limitations on choice in these rich settings, in accordance with the predictions of a new model of search memory load. In each task, subjects are made to search the same information in one of two orders, which differ in predicted memory load. Despite standard models of choice treating such variations in order of acquisition as irrelevant, lower predicted memory load search orders are found to lead to substantially fewer choice errors. An implication of the result for search behavior, more generally, is that in order to reduce memory load (thus choice error a limited memory searcher ought to deviate from the search path of an unlimited memory searcher in predictable ways-a mechanism that can explain the systematic deviations from optimal sequential search that have recently been discovered in peoples' behavior. Further, as cognitive load is induced endogenously (within the task, and found to affect choice behavior, this result contributes to the cognitive load literature (in which load is induced exogenously, as well as the cognitive ability literature (in which cognitive ability is measured in a separate task. In addition, while the information overload literature has focused on the detrimental effects of the quantity of information on choice, this result suggests that, holding quantity constant, the order that information is observed in is an essential determinant of choice failure.

Organizational Culture, Performance and Career Choices of Ph.D.s: A Case Study of Dutch Medical Researchers

Science.gov (United States)

van der Weijden, Inge; de Gilder, Dick; Groenewegen, Peter; Geerling, Maaike

2008-01-01

Increasing demands for accountability and applicability raise the question of how organizational factors affect researchers' performance and career choices. In a study of Dutch medical Ph.D. student's experiences, organizational culture and climate and attitudes towards research quality are related to performance and career choices. Ph.D.s who…

High Pressure Reform: Examining Urban Schools' Response to Multiple School Choice Policies

Science.gov (United States)

Holme, Jennifer Jellison; Carkhum, Rian; Rangel, Virginia Snodgrass

2013-01-01

Over the past several decades, policymakers have sought to address the problem of school failure by exposing traditional public schools to competitive market forces. In this analysis, we examine how two traditional public schools in a "high pressure/high choice" urban school cluster in Texas responded to a number of overlapping choice…

Are life-extending treatments for terminal illnesses a special case? Exploring choices and societal viewpoints.

Science.gov (United States)

McHugh, Neil; van Exel, Job; Mason, Helen; Godwin, Jon; Collins, Marissa; Donaldson, Cam; Baker, Rachel

2018-02-01

Criteria used by the National Institute for Health and Care Excellence (NICE) to assess life-extending, end-of-life (EoL) treatments imply that health gains from such treatments are valued more than other health gains. Despite claims that the policy is supported by societal values, evidence from preference elicitation studies is mixed and in-depth research has shown there are different societal viewpoints. Few studies elicit preferences for policies directly or combine different approaches to understand preferences. Survey questions were designed to investigate support for NICE EoL guidance at national and regional levels. These 'Decision Rule' and 'Treatment Choice' questions were administered to an online sample of 1496 UK respondents in May 2014. The same respondents answered questions designed to elicit their agreement with three viewpoints (previously identified and described) in relation to provision of EoL treatments for terminally ill patients. We report the findings of these choice questions and examine how they relate to each other and respondents' viewpoints. The Decision Rule questions described three policies: DA - a standard 'value for money' test, applied to all health technologies; DB - giving special consideration to all treatments for terminal illnesses; and DC - giving special consideration to specific categories of treatments for terminal illnesses e.g. life extension (as in NICE EoL guidance) or those that improve quality-of-life (QoL). Three Treatment Choices were presented: TA - improving QoL for patients with a non-terminal illness; TB - extending life for EoL patients; and TC - improving QoL at the EoL. DC received most support (45%) with most respondents giving special consideration to EoL only when treatments improved QoL. The most commonly preferred treatment choices were TA (51%) and TC (43%). Overall, this study challenges claims about public support for NICE's EoL guidance and the focus on life extension at EoL and substantiates

Is the interpretation of delayed-choice experiments misleading?

Energy Technology Data Exchange (ETDEWEB)

Roussel, Pierre; Stefan, Iulian [Institut de Physique nucleaire, Universite Paris XI, CNRS, IN2P3, F-91406 Orsay Cedex (France)

2007-06-15

The interpretation of an experimental realization of Wheeler's delayed-choice Gedanken experiment is discussed and called into question. Once more, one finds that nature behaves in agreement with the prediction of quantum mechanics even in surprising situations where a tension with relativity seems to appear. If the experiment reported by Vincent Jacques et al (Science 315, 966.(2007)), which performs the Wheeler's Gedanken experiment, does not produce any 'delayed choice effect', it does exemplify the observation of a wave packet reduction in a very special situation: because of the short duration of the light pulse the wave packet is split into two parts with no connexity, which 'travel' separately along the spectrometer arms.

Modeling route choice criteria from home to major streets: A discrete choice approach

Directory of Open Access Journals (Sweden)

Jose Osiris Vidana-Bencomo

2018-03-01

Full Text Available A discrete choice model that consists of three sub-models was developed to investigates the route choice criteria of drivers who travel from their homes in the morning to the access point along the major streets that bound the Traffic Analysis Zones (TAZs. The first sub-model is a Nested Logit Model (NLM that estimates the probability of a driver has or has no multiple routes, and if the driver has multiple routes, the route selection criteria are based on the access point’s intersection control type or other factors. The second sub-model is a Mixed Logit (MXL model. It estimates the probabilities of the type of intersection control preferred by a driver. The third sub-model is a NLM that estimates the probabilities of a driver selecting his/her route for its shortest travel time or to avoid pedestrian, and if the aim is to take the fastest route, the decision criteria is based on the shortest distance or minimum stops and turns. Data gathered in a questionnaire survey were used to estimate the sub-models. The attributes of the utility functions of the sub-models are the driver’s demographic and trip characteristics. The model provides a means for transportation planners to distribute the total number of home-based trips generated within a TAZ to the access points along the major streets that bound the TAZ.

Analysis of the benefits of designing and implementing a virtual didactic model of multiple choice exam and problem-solving heuristic report, for first year engineering students

OpenAIRE

Bennun, Leonardo; Santibanez, Mauricio

2015-01-01

Improvements in performance and approval obtained by first year engineering students from University of Concepcion, Chile, were studied, once a virtual didactic model of multiple-choice exam, was implemented. This virtual learning resource was implemented in the Web ARCO platform and allows training, by facing test models comparable in both time and difficulty to those that they will have to solve during the course. It also provides a feedback mechanism for both: 1) The students, since they c...

Freedom of choice and bounded rationality: a brief appraisal of behavioral economists' plea for light paternalism

Directory of Open Access Journals (Sweden)

Roberta Muramatsu

2012-09-01

Full Text Available Behavioral economics has addressed interesting positive and normative questions underlying the standard rational choice theory. More recently, it suggests that, in a real world of boundedly rational agents, economists could help people to improve the quality of their choices without any harm to autonomy and freedom of choice. This paper aims to scrutinize available arguments for and against current proposals of light paternalistic interventions mainly in the domain of intertemporal choice. It argues that incorporating the notion of bounded rationality in economic analysis and empirical findings of cognitive biases and self-control problems cannot make an indisputable case for paternalism.

Community-based participatory research (CBPR) in South Africa: engaging multiple constituents to shape the research question.

Science.gov (United States)

Mosavel, Maghboeba; Simon, Christian; van Stade, Debbie; Buchbinder, Mara

2005-12-01

Community engagement is an on-going, arduous, and necessary process for developing effective health promotion programs. The challenges are amplified when the particular health issue or research question is not prominent in the consciousness of the targeted community. In this paper, we explore the community-based participatory research (CBPR) model as a means to negotiate a mutual agenda between communities and researchers. The paper is focused on the (perceived) need for cervical cancer screening in an under-resourced community in Cape Town, South Africa. Cervical cancer is a significant health problem in this community and elsewhere in South Africa. Unlike HIV-AIDS, however, many Black South Africans have not been educated about cervical cancer and the importance of obtaining screening. Many may not consider screening a priority in their lives. Our research included extensive consultations and informal interviews with diverse community and regional stakeholders. Following these, we conducted 27 focus groups and 106 demographic surveys with randomly selected youth, parents, local health care personnel, educators and school staff. Focus group data were summarized and analyzed cross-sectionally. Community stakeholders were involved throughout this research. Our consultations, interviews, and focus group data were key in identifying the concerns and priorities of the community. By engaging community stakeholders, we developed a research framework that incorporated the community's concerns and priorities, and stressed the intersecting roles of poverty, violence, and other cultural forces in shaping community members' health and wellbeing. Community members helped to refocus our research from cervical cancer to 'cervical health,' a concept that acknowledged the impact on women's bodies and lives of HIV-AIDS and STDs, sexual violence, poverty, and multiple social problems. We conclude that the research agenda and questions in community-based health research should not be

Exclusive queueing model including the choice of service windows

Science.gov (United States)

Tanaka, Masahiro; Yanagisawa, Daichi; Nishinari, Katsuhiro

2018-01-01

In a queueing system involving multiple service windows, choice behavior is a significant concern. This paper incorporates the choice of service windows into a queueing model with a floor represented by discrete cells. We contrived a logit-based choice algorithm for agents considering the numbers of agents and the distances to all service windows. Simulations were conducted with various parameters of agent choice preference for these two elements and for different floor configurations, including the floor length and the number of service windows. We investigated the model from the viewpoint of transit times and entrance block rates. The influences of the parameters on these factors were surveyed in detail and we determined that there are optimum floor lengths that minimize the transit times. In addition, we observed that the transit times were determined almost entirely by the entrance block rates. The results of the presented model are relevant to understanding queueing systems including the choice of service windows and can be employed to optimize facility design and floor management.

Intrinsic Variability in Multiple Systems and Clusters: Open Questions

Science.gov (United States)

Lampens, P.

2006-04-01

It is most interesting and rewarding to probe the stellar structure of stars which belong to a system originating from the same parent cloud as this provides additional and more accurate constraints for the models. New results on pulsating components in multiple systems and clusters are beginning to emerge regularly. Based on concrete studies, I will present still unsolved problems and discuss some of the issues which may affect our understanding of the pulsation physics in such systems but also in general.

Interspecific competition in plants: how well do current methods answer fundamental questions?

Science.gov (United States)

Connolly, J; Wayne, P; Bazzaz, F A

2001-02-01

Accurately quantifying and interpreting the processes and outcomes of competition among plants is essential for evaluating theories of plant community organization and evolution. We argue that many current experimental approaches to quantifying competitive interactions introduce size bias, which may significantly impact the quantitative and qualitative conclusions drawn from studies. Size bias generally arises when estimates of competitive ability are erroneously influenced by the initial size of competing individuals. We employ a series of quantitative thought experiments to demonstrate the potential for size bias in analysis of four traditional experimental designs (pairwise, replacement series, additive series, and response surfaces) either when only final measurements are available or when both initial and final measurements are collected. We distinguish three questions relevant to describing competitive interactions: Which species dominates? Which species gains? and How do species affect each other? The choice of experimental design and measurements greatly influences the scope of inference permitted. Conditions under which the latter two questions can give biased information are tabulated. We outline a new approach to characterizing competition that avoids size bias and that improves the concordance between research question and experimental design. The implications of the choice of size metrics used to quantify both the initial state and the responses of elements in interspecific mixtures are discussed. The relevance of size bias in competition studies with organisms other than plants is also discussed.

Incorporation of core competency questions into an annual national self-assessment examination for residents in physical medicine and rehabilitation: results and implications.

Science.gov (United States)

Webster, Joseph B

2009-03-01

To determine the performance and change over time when incorporating questions in the core competency domains of practice-based learning and improvement (PBLI), systems-based practice (SBP), and professionalism (PROF) into the national PM&R Self-Assessment Examination for Residents (SAER). Prospective, longitudinal analysis. The national Self-Assessment Examination for Residents (SAER) in Physical Medicine and Rehabilitation, which is administered annually. Approximately 1100 PM&R residents who take the examination annually. Inclusion of progressively more challenging questions in the core competency domains of PBLI, SBP, and PROF. Individual test item level of difficulty (P value) and discrimination (point biserial index). Compared with the overall test, questions in the subtopic areas of PBLI, SBP, and PROF were relatively easier and less discriminating (correlation of resident performance on these domains compared with that on the total test). These differences became smaller during the 3-year time period. The difficulty level of the questions in each of the subtopic domains was raised during the 3 year period to a level close to the overall exam. Discrimination of the test items improved or remained stable. This study demonstrates that, with careful item writing and review, multiple-choice items in the PBLI, SBP, and PROF domains can be successfully incorporated into an annual, national self-assessment examination for residents. The addition of these questions had value in assessing competency while not compromising the overall validity and reliability of the exam. It is yet to be determined if resident performance on these questions corresponds to performance on other measures of competency in the areas of PBLI, SBP, and PROF.

Conducting seedling stock type trials: A new approach to an old question

Science.gov (United States)

Jeremiah R. Pinto; R. Kasten Dumroese; Anthony S. Davis; Thomas D. Landis

2011-01-01

Seedlings for reforestation and restoration come in many shapes and sizes, i.e., a variety of stocktypes. With so many choices available, land managers commonly ask which stocktype will best meet their management objectives. For years, stocktype studies have been initiated in search of an answer to this question, but few have been done without some degree of...

The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form.

Science.gov (United States)

Johannesen, Jason K; Lurie, Jessica B; Fiszdon, Joanna M; Bell, Morris D

2013-01-01

The Social Attribution Task-Multiple Choice (SAT-MC) uses a 64-second video of geometric shapes set in motion to portray themes of social relatedness and intentions. Considered a test of "Theory of Mind," the SAT-MC assesses implicit social attribution formation while reducing verbal and basic cognitive demands required of other common measures. We present a comparability analysis of the SAT-MC and the new SAT-MC-II, an alternate form created for repeat testing, in a university sample (n = 92). Score distributions and patterns of association with external validation measures were nearly identical between the two forms, with convergent and discriminant validity supported by association with affect recognition ability and lack of association with basic visual reasoning. Internal consistency of the SAT-MC-II was superior (alpha = .81) to the SAT-MC (alpha = .56). Results support the use of SAT-MC and new SAT-MC-II as equivalent test forms. Demonstrating relatively higher association to social cognitive than basic cognitive abilities, the SAT-MC may provide enhanced sensitivity as an outcome measure of social cognitive intervention trials.

Do framing effects reveal irrational choice?

Science.gov (United States)

Mandel, David R

2014-06-01

Framing effects have long been viewed as compelling evidence of irrationality in human decision making, yet that view rests on the questionable assumption that numeric quantifiers used to convey the expected values of choice options are uniformly interpreted as exact values. Two experiments show that when the exactness of such quantifiers is made explicit by the experimenter, framing effects vanish. However, when the same quantifiers are given a lower bound (at least) meaning, the typical framing effect is found. A 3rd experiment confirmed that most people spontaneously interpret the quantifiers in standard framing tests as lower bounded and that their interpretations strongly moderate the framing effect. Notably, in each experiment, a significant majority of participants made rational choices, either choosing the option that maximized expected value (i.e., lives saved) or choosing consistently across frames when the options were of equal expected value. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Questioning Questions: Elementary Teachers' Adaptations of Investigation Questions Across the Inquiry Continuum

Science.gov (United States)

Biggers, Mandy

2018-02-01

Questioning is a central practice in science classrooms. However, not every question translates into a "good" science investigation. Questions that drive science investigations can be provided by many sources including the teacher, the curriculum, or the student. The variations in the source of investigation questions were explored in this study. A dataset of 120 elementary science classroom videos and associated lesson plans from 40 elementary teachers (K-5) across 21 elementary school campuses were scored on an instrument measuring the amount of teacher-direction or student-direction of the lessons' investigation questions. Results indicated that the investigation questions were overwhelmingly teacher directed in nature, with no opportunities for students to develop their own questions for investigation. This study has implications for researchers and practitioners alike, calling attention to the teacher-directed nature of investigation questions in existing science curriculum materials, and the need for teacher training in instructional strategies to adapt their existing curriculum materials across the continuum of teacher-directed and student-directed investigation questions. Teachers need strategies for adapting the teacher-directed questions provided in their existing curriculum materials in order to allow students the opportunity to engage in this essential scientific practice.

Effects of Daily Morphine Administration and Deprivation on Choice and Demand for Remifentanil and Cocaine in Rhesus Monkeys

Science.gov (United States)

Wade-Galuska, Tammy; Galuska, Chad M.; Winger, Gail

2011-01-01

Choice procedures have indicated that the relative reinforcing effectiveness of opioid drugs increases during opioid withdrawal. The demand curve, an absolute measure of reinforcer value, has not been applied to this question. The present study assessed whether mild morphine withdrawal would increase demand for or choice of remifentanil or…

Mind map our way into effective student questioning: A principle-based scenario

NARCIS (Netherlands)

Stokhof, Harry; De Vries, Bregje; Bastiaens, Theo; Martens, Rob

2017-01-01

Student questioning is an important self-regulative strategy and has multiple benefits for teaching and learning science. Teachers, however, need support to align student questioning to curricular goals. This study tests a prototype of a principle-based scenario that supports teachers in guiding

Sexual Orientation as Interpretation? Sexual Desires, Concepts, and Choice

Directory of Open Access Journals (Sweden)

Díaz-León E.

2017-07-01

Full Text Available Are sexual orientations freely chosen? The idea that someone’s sexual orientation is not a choice is very influential in the mainstream LGBT political movement. But do we have good reasons to believe it is not a choice? Going against the orthodoxy, William Wilkerson has recently argued that sexual orientation is partly constituted by our interpretations of our own sexual desires, and we choose these interpretations, so sexual orientation is partly constituted by choice. In this paper I aim to examine the question of whether our interpretations of our own sexual desires are constitutive of our sexual orientations. I will argue that whereas Wilkerson’s argument for the claim that sexual orientations are in part constituted by our chosen interpretations of our sexual desires is not sound, there are good reasons for endorsing a weaker claim, namely, that there are different but equally apt descriptions of the same sexual desires, depending on which concepts we have.

A comparison of two methods of teaching. Computer managed instruction and keypad questions versus traditional classroom lecture.

Science.gov (United States)

Halloran, L

1995-01-01

Computers increasingly are being integrated into nursing education. One method of integration is through computer managed instruction (CMI). Recently, technology has become available that allows the integration of keypad questions into CMI. This brings a new type of interactivity between students and teachers into the classroom. The purpose of this study was to evaluate differences in achievement between a control group taught by traditional classroom lecture (TCL) and an experimental group taught using CMI and keypad questions. Both control and experimental groups consisted of convenience samples of junior nursing students in a baccalaureate program taking a medical/surgical nursing course. Achievement was measured by three instructor-developed multiple choice examinations. Findings demonstrated that although the experimental group demonstrated increasingly higher test scores as the semester progressed, no statistical difference was found in achievement between the two groups. One reason for this may be phenomenon of vampire video. Initially, the method of presentation overshadowed the content. As students became desensitized to the method, they were able to focus and absorb more content. This study suggests that CMI and keypads are a viable teaching option for nursing education. It is equal to TCL in student achievement and provides a new level of interaction in the classroom setting.

Metacognitions and emotional schemas: a new cognitive perspective for the distinction between unipolar and bipolar depression.

Science.gov (United States)

Batmaz, Sedat; Ulusoy Kaymak, Semra; Kocbiyik, Sibel; Turkcapar, Mehmet Hakan

2014-10-01

Clinicians need to make the differential diagnosis of unipolar and bipolar depression to guide their treatment choices. Looking at the differences observed in the metacognitions, and the emotional schemas, might help with this differentiation, and might provide information about the distinct psychotherapeutical targets. Three groups of subjects (166 unipolar depressed, 140 bipolar depressed, and 151 healthy controls) were asked to fill out the Metacognitions Questionnaire-30 (MCQ-30), and the Leahy Emotional Schema Scale (LESS). The clinicians diagnosed the volunteers according to the criteria of DSM-IV-TR with a structured clinical interview (MINI), and rated the moods of the subjects with the Montgomery Asberg Depression Rating Scale (MADRS), and the Young Mania Rating Scale (YMRS). Statistical analyses were undertaken to identify the group differences on the MCQ-30, and the LESS. The bipolar and unipolar depressed patients' scores on the MCQ-30 were significantly different from the healthy controls, but not from each other. On the LESS dimensions of guilt, duration, blame, validation, and acceptance of feelings, all three groups significantly differed from each other. There were no statistically different results on the LESS dimensions of comprehensibility, consensus, and expression. The mood disordered groups scored significantly different than the healthy controls on the LESS dimensions of simplistic view of emotions, numbness, rationality, rumination, higher values, and control. These results suggest that the metacognitive model of unipolar depression might be extrapolated for patients with bipolar depression. These results are also compatible to a great extent with the emotional schema theory of depression. Copyright © 2014 Elsevier Inc. All rights reserved.

Longitud (número de preguntas y resultado de un examen Length (number of questions and exams results

Directory of Open Access Journals (Sweden)

R. Sarrias-Ramis

2010-09-01

Full Text Available Objetivo. Este artículo presenta dos estudios sobre la relación entre el número de preguntas de un examen y sus resultados. Estos dos estudios se realizaron en respuesta a dos problemas concretos presentados en dos facultades de ciencias de la salud de dos universidades catalanas. Sujetos y métodos. El primer estudio, realizado en la Facultad de Medicina de la Universitat Autònoma de Barcelona, compara los resultados reales obtenidos en pruebas de elección múltiple en tres asignaturas con los resultados que hubieran obtenido los estudiantes con la mitad de las preguntas. La dificultad del examen en ambas situaciones fue prácticamente la misma y los resultados académicos también fueron similares. El segundo estudio, llevado a cabo en la Facultad de Ciencias de la Salud y de la Vida de la Universitat Pompeu Fabra de Barcelona, compara los resultados reales obtenidos en pruebas de ensayo de dos asignaturas de los estudios de Biología con los hipotéticos que se hubieran obtenido con la mitad de las preguntas. Los resultados obtenidos globalmente fueron muy parecidos. Conclusión. La conclusión general del estudio es que la evaluación del rendimiento académico no dependería fundamentalmente del número de preguntas y que sería más importante buscar la representatividad y relevancia de éstas.Aim. This paper resents two studies about the relationship between the number of questions that appear in an exam and their results. These studies have been done in response to two concrete problems found in two Spanish universities. Subjects and methods. The first study, done at the Faculty of Medicine of the Autonomous University of Barcelona, compared the real results achieved in three subjects which use MCQ-tests with the theoretical results which the students would have achieved if half of the questions had been used. The difficulty of the exams in both situations was practically the same and the student's academic results were very similar

Fairness hypothesis and managing the risks of societal technology choices

International Nuclear Information System (INIS)

Cantor, R.; Rayner, S.

1986-08-01

Much of the literature on risk perception and management has asked how society should resolve the question, ''How safe is safe enough'' There has been political and technical disagreement over the types of answers that may be given, as well as over the social values attached to perceived probabilities and magnitudes of various outcomes. Despite controversy, there seems to have been a large measure of consensus that, ''How safe is safe enough'' is the right question to ask. This paper sets out to question that assumption. Various ingenious techniques of risk analysis have sought to discover the real risks inherent in various activities, but from a sociocultural viewpoint it can be seen that no single answer can be given to the problem of adequate safety in a complex society which contains a wide variety of perceptual biases about danger, expectations of the good life, and levels of demand for safety. The paper argues that, from a societal risk-management perspective, we should be addressing a different range of questions that views societal risk as a whole rather than as the sum of individual hazards. Resolving the question, ''How safe is safe enough'' is less important in making societal technology choices than ''How fair is safe enough?'' A recent empirical pilot study is reported which explored the fairness hypotheses in the context of nuclear power. The results indicate that the process of technology choice should recognize explicitly the preferred principles different parties hold with respect to obtaining consent from those affected by the risks, distributing the liabilities, and justifying trust in the relevant institutions. The paper closes with a discussion of future prospects for the fairness approach in areas such as noxious facility siting

75 FR 61253 - Final Fair Market Rents for Fiscal Year 2011 for the Housing Choice Voucher Program and Moderate...

Science.gov (United States)

2010-10-04

.... Any questions related to use of FMRs or voucher payment standards should be directed to the respective... Housing Choice Voucher program, the FMR is the basis for determining the ``payment standard amount'' used... for the Housing Choice Voucher Program and Moderate Rehabilitation Single Room Occupancy Program...

Hybrid corporate governance: a choice for Poland?

OpenAIRE

Samól, Katarzyna A.

2014-01-01

The purpose of the research investigation is to consider the potential opportunities through which corporate governance may be developed to better suit the developing commercial culture within Poland. In order to do this, I formulate the following research questions: ‘What are the weaknesses of the Polish corporate governance system?’, ‘What changes should be made to corporate governance in Poland?’, and ‘Is a hybrid corporate governance model a choice for Poland?’ The concept of hybridisatio...

Multiple electromagnetic excitations of relativistic projectiles

International Nuclear Information System (INIS)

Llope, W.J.; Braun-Munzinger, P.

1992-01-01

Conditions optimum for the first experimental verification of the multiplication electromagnetic excitations of nuclei in relativistic nucleus-nucleus collisions are described. The relative magnitudes of three important physical processes that might interfere with such a measurement are compared to the predicted strengths for the single and multiple electromagnetic excitations for various choices of the projectile mass and beam energy. Strategies are presented for making inferences concerning the presence of multiple excitation strength in experimental data

Multiple Personality Domains in Relation to Occupational Choice and Performance among Established Teachers. Research Report. ETS RR-04-41

Science.gov (United States)

Emmerich, Walter; Rock, Donald A.; Trapani, Catherine S.

2004-01-01

Does personality impact differently on occupational choice and occupational performance? In a study of established teachers, interests, the Five-Factor Model, and attributions were examined in relation to occupational choice and performance. Attributions were assessed using a new instrument designed for teachers. Choice of teaching specialty was…

Dynamic learning and context-dependence in sequential, attribute-based, stated-preference valuation questions

Science.gov (United States)

Thomas P. Holmes; Kevin J. Boyle

2005-01-01

A hybrid stated-preference model is presented that combines the referendum contingent valuation response format with an experimentally designed set of attributes. A sequence of valuation questions is asked to a random sample in a mailout mail-back format. Econometric analysis shows greater discrimination between alternatives in the final choice in the sequence, and the...

Woman, M.D.: issues, perceptions and choices.

Science.gov (United States)

Johns, C J

1996-01-01

I would end with some summarizing points and questions. 1. A majority of women identify gender-related issues influencing their career choices and pathways. 2. Women are diverse in their choices and priorities, with varying balances of personal and professional life. 3. Eighty-three percent of the women responding to the survey have married, and 82% of those married have children. They thus are likely to have two sets of seriously competing responsibilities. 4. It is possible to identify especially promising women during residency or fellowship. Exploring their priorities and values with good mentors will be important to avoid short-changing academic medicine of competent women. 5. Men and women need to be SUPERCHOOSERS in making the choices right for that individual, rather than superwomen or supermen. 6. We can question whether the development and potential of women (and some men) in academic medicine could be enhanced by: a. Consideration of guidance or support for child care resources? b. Flexibility in the system (tenure clock, etc.)? c. Identification of limited full-time clinical or research opportunities for faculty with young children or unusual family demands? d. Facilitation of bridging after a period of part-time activity or re-entry after limited participation? e. Consideration of part-time work at home and flexible on-site work hours for periods of special family demands? Finally, a supportive work environment is important for both men and women in medicine and is an essential priority in academic medicine. Medicine is a wonderful field. Academic medicine on my terms, to include family, has been very rewarding. Sometimes there also have been disappointments, in that I have fallen short of some of my aspirations. However, I must accept the responsibility for my choices. I owe a great debt to many of the men and women of the American Clinical and Climatological Association and of Johns Hopkins who are both friends and colleagues and especially to my

Small group learning: effect on item analysis and accuracy of self-assessment of medical students.

Science.gov (United States)

Biswas, Shubho Subrata; Jain, Vaishali; Agrawal, Vandana; Bindra, Maninder

2015-01-01

Small group sessions are regarded as a more active and student-centered approach to learning. Item analysis provides objective evidence of whether such sessions improve comprehension and make the topic easier for students, in addition to assessing the relative benefit of the sessions to good versus poor performers. Self-assessment makes students aware of their deficiencies. Small group sessions can also help students develop the ability to self-assess. This study was carried out to assess the effect of small group sessions on item analysis and students' self-assessment. A total of 21 female and 29 male first year medical students participated in a small group session on topics covered by didactic lectures two weeks earlier. It was preceded and followed by two multiple choice question (MCQ) tests, in which students were asked to self-assess their likely score. The MCQs used were item analyzed in a previous group and were chosen of matching difficulty and discriminatory indices for the pre- and post-tests. The small group session improved the marks of both genders equally, but female performance was better. The session made the items easier; increasing the difficulty index significantly but there was no significant alteration in the discriminatory index. There was overestimation in the self-assessment of both genders, but male overestimation was greater. The session improved the self-assessment of students in terms of expected marks and expectation of passing. Small group session improved the ability of students to self-assess their knowledge and increased the difficulty index of items reflecting students' better performance.

Marketing foods to children: are we asking the right questions?

Science.gov (United States)

Elliott, Charlene

2012-06-01

The childhood obesity epidemic has prompted a range of regulatory initiatives that seek to reduce the impact of food marketing on children. Policy recommendations by government and public health organizations have suggested regulating the promotion of high-sugar, -fat, and/or -salt foods to children, while the food industry has created voluntary nutrition guidelines to channel child-targeted marketing toward only "better-for-you" products. This article argues that the overarching focus on the nutrient profile of foods (nutritionism) is wrong-headed: The slippage in terms from "better-for-you" foods to "healthy dietary choices" is problematic and also makes it difficult for children to identify the healthy choice. Nutritionism further works to sidestep important questions pertaining to the ethics of food marketing, not to mention the way that marketing foods as fun and entertainment works to encourage overeating in children.

CURBSIDE CONSULTATION OF THE ACL: 49 CLINICAL QUESTIONS

Directory of Open Access Journals (Sweden)

Bernard R. Bach

2008-09-01

Full Text Available DESCRIPTION A unique reference that offers opinions, preferences and expert advice associated with management of ACL injuries in the questions and answers format which enhanced by images, diagrams and references. PURPOSE "Curbside Consultation of the ACL" aims to provide some knowledge more than the basic information in the evaluation and the management of ACL injuries. This information is based on the opinion or the advice of an expert. Quick access of audience to these pearl and pit-falls and evidence-based expert advice for complicated cases in ACL reconstruction in the form of brief answers including current concepts is targeted by the authors. FEATURES 49 Clinical questions are outlined in 5 sections. In the first section is about preoperative questions including indications, diagnostic measures, combined ligament injuries, graft choice, preparation before surgery, avulsion of the eminence, examination in posterolateral corner injury. In the second section is preoperative questions are subjected including dropping the graft to the floor, posterior wall blowout, knees without hamstring tendon, graft amputation by interference screw, to avoid vertical tunnel in tibia, fixation methods of graft, femoral and tibial tunnel positioning. Third section is about postoperative questions including postoperative management, differences in postoperative rehabilitation protocols in different type of grafts, postoperative man-agement of meniscal repair, management in difficulties in gaining extension, infection, patellar pain, timing of reop-eration in motion problems, criteria returning to sports, outcome measures, outcome in using different grafts, role of bracing. The fourth section is about failed ACL recon-struction including causes, indications for revision, ex-panded tunnels, graft choice in revision surgery, contro-lateral patellar tendon graft for revision, rehab protocol after revision surgery, hardware removal, early degenera-tive joint disease

Mathematics and language skills and the choice of science subjects in secondary education

NARCIS (Netherlands)

Uerz, D.C.; Dekkers, H.P.J.M.; Béguin, A.A.

2004-01-01

A growing shortage of technical and science graduates means that the question of determinants of differences in performance and choices in that field based, among other things, on social background characteristics (gender, socioeconomic status, ethnic origin, family composition) remains a topical

The impact of choice context on consumers' choice heuristics

DEFF Research Database (Denmark)

Mueller Loose, Simone; Scholderer, Joachim; Corsi, Armando M.

2012-01-01

Context effects in choice settings have received recent attention but little is known about the impact of context on choice consistency and the extent to which consumers apply choice heuristics. The sequence of alternatives in a choice set is examined here as one specific context effect. We compare...... how a change from a typical price order to a sensory order in wine menus affects consumer choice. We use pre-specified latent heuristic classes to analyse the existence of different choice processes, which begins to untangle the ‘black box’ of how consumers choose. Our findings indicate...... that in the absence of price order, consumers are less price-sensitive, pay more attention to visually salient cues, are less consistent in their choices and employ other simple choice heuristics more frequently than price. Implications for consumer research, marketing and consumer policy are discussed....

Tax Reform in Brazil: a Public Choice Theory approach

Directory of Open Access Journals (Sweden)

Allan Silveira dos Santos

2013-12-01

Full Text Available This article aims to analyze tax reform necessity and the barriers to the implementation of tax reform at the light of public choice theory. The research identifies the arguments that provides the explanation for the tax reform does not occur in Brazil. The question that the article searches to answer is: what are the justifications for the Brazil not have done tax reform? The literature review addresses the failures of government, public choice theory and the theory of optimal taxation. The evidence and studies show that there are reasons to think about a tax system more consistent with the Brazilian reality, indicating the existence of "government failures" that may be the probable cause of impairment of the tax reform.

Negative Marking and the Student Physician–-A Descriptive Study of Nigerian Medical Schools

Directory of Open Access Journals (Sweden)

Ikenna Kingsley Ndu

2016-01-01

Full Text Available Background There is considerable debate about the two most commonly used scoring methods, namely, the formula scoring (popularly referred to as negative marking method in our environment and number right scoring methods. Although the negative marking scoring system attempts to discourage students from guessing in order to increase test reliability and validity, there is the view that it is an excessive and unfair penalty that also increases anxiety. Feedback from students is part of the education process; thus, this study assessed the perception of medical students about negative marking method for multiple choice question (MCQ examination formats and also the effect of gender and risk-taking behavior on scores obtained with this assessment method. Methods This was a prospective multicenter survey carried out among fifth year medical students in Enugu State University and the University of Nigeria. A structured questionnaire was administered to 175 medical students from the two schools, while a class test was administered to medical students from Enugu State University. Qualitative statistical methods including frequencies, percentages, and chi square were used to analyze categorical variables. Quantitative statistics using analysis of variance was used to analyze continuous variables. Results Inquiry into assessment format revealed that most of the respondents preferred MCQs (65.9%. One hundred and thirty students (74.3% had an unfavorable perception of negative marking. Thirty-nine students (22.3% agreed that negative marking reduces the tendency to guess and increases the validity of MCQs examination format in testing knowledge content of a subject compared to 108 (61.3% who disagreed with this assertion (χ 2 = 23.0, df = 1, P = 0.000. The median score of the students who were not graded with negative marking was significantly higher than the score of the students graded with negative marking ( P = 0.001. There was no statistically

Electronic voting to encourage interactive lectures: a randomised trial

Science.gov (United States)

2007-01-01

Background Electronic Voting Systems have been used for education in a variety of disciplines. Outcomes from these studies have been mixed. Because results from these studies have been mixed, we examined whether an EVS system could enhance a lecture's effect on educational outcomes. Methods A cohort of 127 Year 5 medical students at the University of Adelaide was stratified by gender, residency status and academic record then randomised into 2 groups of 64 and 63 students. Each group received consecutive 40-minute lectures on two clinical topics. One group received the EVS for both topics. The other group received traditional teaching only. Evaluation was undertaken with two, 15-question multiple-choice questionnaires (MCQ) assessing knowledge and problem solving and undertaken as a written paper immediately before and after the lectures and repeated online 8–12 weeks later. Standardised institutional student questionnaires were completed for each lecture and independent observers assessed student behaviour during the lectures. Lecturer's opinions were assessed by a questionnaire developed for this study. Results Two-thirds of students randomised to EVS and 59% of students randomised to traditional lectures attended. One-half of the students in the EVS group and 41% in the traditional group completed all questionnaires. There was no difference in MCQ scores between EVS and traditional lectures (p = 0.785). The cervical cancer lectures showed higher student ranking in favour of EVS in all parameters. The breast cancer lectures showed higher ranking in favour of traditional lectures in 5 of 7 parameters (p lecturer-students interactions were increased in the EVS lecture for one lecturer and reduced for the other. Both lecturers felt that the EVS lectures were difficult to prepare, that they were able to keep to time in the traditional lectures, that the educational value of both lecture styles was similar, and that they were neutral-to-slightly favourably disposed

The mediating role of metacognitive variables in the relationship between Thought-Action Fusion and obsessive-compulsive symptomatology

Directory of Open Access Journals (Sweden)

Paula Odriozola-González

2016-07-01

Full Text Available Diverse studies support the central role of Thought-Action Fusion (TAF and other metacognitive variables in the understanding of obsessive-compulsive disorder (OCD symptomatology. However, a more detailed study of the involvement of these variables is needed. This article seeks to assess the possible mediating role of the factors of the Metacognitions Questionnaire (MCQ in the relationship between TAF and OCD symptoms both in clinical and non-clinical samples. A cross-sectional design was used in which 120 participants, divided into three groups (two clinical and one non-clinical, completed the questionnaires assessing the constructs of interest. The mediational findings generally supported the proposed mediation model. Specifically, the mediational analyses focused on negative beliefs and the need to control (metacognitive factors of the MCQ showed that MCQ Negative beliefs mediated the effects of TAF-Total and TAF factors (except for the TAF-Moral on OCD symptomatology in the OCD group. The MCQ Need to control was non-significant as a mediator of the relationships between TAF and OCD. However, it was observed that this mediation approached significance, with considerable effect sizes. In the clinical-control group, the analyses showed that MCQ Negative beliefs mediated the effects of TAF-Likelihood-Oneself on OCD symptoms. In the remaining group, neither MCQ Negative beliefs nor MCQ Need to control were found to be significant mediators. It is generally concluded that certain beliefs, such as TAF, can evolve toward more complex metacognitive beliefs, which ultimately lead to the development of OCD symptoms.

Impact of the second semester University Modeling Instruction course on students’ representation choices

Directory of Open Access Journals (Sweden)

Daryl McPadden

2017-11-01

Full Text Available Representation use is a critical skill for learning, problem solving, and communicating in science, especially in physics where multiple representations often scaffold the understanding of a phenomenon. University Modeling Instruction, which is an active-learning, research-based introductory physics curriculum centered on students’ use of scientific models, has made representation use a primary learning goal with explicit class time devoted to introducing and coordinating representations as part of the model building process. However, because of the semester break, the second semester course, Modeling Instruction-Electricity and Magnetism (MI-EM, contains a mixture of students who are returning from the Modeling Instruction-mechanics course (to whom we refer to as “returning students” and students who are new to Modeling Instruction with the MI-EM course (to whom we refer to as “new students”. In this study, we analyze the impact of MI-EM on students’ representation choices across the introductory physics content for these different groups of students by examining both what individual representations students choose and their average number of representations on a modified card-sort survey with a variety of mechanics and EM questions. Using Wilcoxon-signed-rank tests, Wilcoxon-Mann-Whitney tests, Cliff’s delta effect sizes, and box plots, we compare students’ representation choices from pre- to postsemester, from new and returning students, and from mechanics and EM content. We find that there is a significant difference between returning and new students’ representation choices, which serves as a baseline comparison between Modeling Instruction and traditional lecture-based physics classes. We also find that returning students maintain a high representation use across the MI-EM semester, while new students see significant growth in their representation use regardless of content.

The Essence of Man’s Future as a Personal Choice of the Individual