WorldWideScience

Sample records for reward-based decision making

  1. Reactivation of Reward-Related Patterns from Single Past Episodes Supports Memory-Based Decision Making.

    Science.gov (United States)

    Wimmer, G Elliott; Büchel, Christian

    2016-03-09

    Rewarding experiences exert a strong influence on later decision making. While decades of neuroscience research have shown how reinforcement gradually shapes preferences, decisions are often influenced by single past experiences. Surprisingly, relatively little is known about the influence of single learning episodes. Although recent work has proposed a role for episodes in decision making, it is largely unknown whether and how episodic experiences contribute to value-based decision making and how the values of single episodes are represented in the brain. In multiple behavioral experiments and an fMRI experiment, we tested whether and how rewarding episodes could support later decision making. Participants experienced episodes of high reward or low reward in conjunction with incidental, trial-unique neutral pictures. In a surprise test phase, we found that participants could indeed remember the associated level of reward, as evidenced by accurate source memory for value and preferences to re-engage with rewarded objects. Further, in a separate experiment, we found that high-reward objects shown as primes before a gambling task increased financial risk taking. Neurally, re-exposure to objects in the test phase led to significant reactivation of reward-related patterns. Importantly, individual variability in the strength of reactivation predicted value memory performance. Our results provide a novel demonstration that affect-related neural patterns are reactivated during later experience. Reactivation of value information represents a mechanism by which memory can guide decision making. Copyright © 2016 the authors 0270-6474/16/362868-13$15.00/0.

  2. Adults with autism spectrum disorders exhibit decreased sensitivity to reward parameters when making effort-based decisions

    Directory of Open Access Journals (Sweden)

    Damiano Cara R

    2012-05-01

    Full Text Available Abstract Background Efficient effort expenditure to obtain rewards is critical for optimal goal-directed behavior and learning. Clinical observation suggests that individuals with autism spectrum disorders (ASD may show dysregulated reward-based effort expenditure, but no behavioral study to date has assessed effort-based decision-making in ASD. Methods The current study compared a group of adults with ASD to a group of typically developing adults on the Effort Expenditure for Rewards Task (EEfRT, a behavioral measure of effort-based decision-making. In this task, participants were provided with the probability of receiving a monetary reward on a particular trial and asked to choose between either an “easy task” (less motoric effort for a small, stable reward or a “hard task” (greater motoric effort for a variable but consistently larger reward. Results Participants with ASD chose the hard task more frequently than did the control group, yet were less influenced by differences in reward value and probability than the control group. Additionally, effort-based decision-making was related to repetitive behavior symptoms across both groups. Conclusions These results suggest that individuals with ASD may be more willing to expend effort to obtain a monetary reward regardless of the reward contingencies. More broadly, results suggest that behavioral choices may be less influenced by information about reward contingencies in individuals with ASD. This atypical pattern of effort-based decision-making may be relevant for understanding the heightened reward motivation for circumscribed interests in ASD.

  3. Decision-making based on emotional images.

    Science.gov (United States)

    Katahira, Kentaro; Fujimura, Tomomi; Okanoya, Kazuo; Okada, Masato

    2011-01-01

    The emotional outcome of a choice affects subsequent decision making. While the relationship between decision making and emotion has attracted attention, studies on emotion and decision making have been independently developed. In this study, we investigated how the emotional valence of pictures, which was stochastically contingent on participants' choices, influenced subsequent decision making. In contrast to traditional value-based decision-making studies that used money or food as a reward, the "reward value" of the decision outcome, which guided the update of value for each choice, is unknown beforehand. To estimate the reward value of emotional pictures from participants' choice data, we used reinforcement learning models that have successfully been used in previous studies for modeling value-based decision making. Consequently, we found that the estimated reward value was asymmetric between positive and negative pictures. The negative reward value of negative pictures (relative to neutral pictures) was larger in magnitude than the positive reward value of positive pictures. This asymmetry was not observed in valence for an individual picture, which was rated by the participants regarding the emotion experienced upon viewing it. These results suggest that there may be a difference between experienced emotion and the effect of the experienced emotion on subsequent behavior. Our experimental and computational paradigm provides a novel way for quantifying how and what aspects of emotional events affect human behavior. The present study is a first step toward relating a large amount of knowledge in emotion science and in taking computational approaches to value-based decision making.

  4. Decision making based on emotional images

    Directory of Open Access Journals (Sweden)

    Kentaro eKatahira

    2011-10-01

    Full Text Available The emotional outcome of a choice affects subsequent decision making. While the relationship between decision making and emotion has attracted attention, studies on emotion and decision making have been independently developed. In this study, we investigated how the emotional valence of pictures, which was stochastically contingent on participants’ choices, influenced subsequent decision making. In contrast to traditional value-based decision-making studies that used money or food as a reward, the reward value of the decision outcome, which guided the update of value for each choice, is unknown beforehand. To estimate the reward value of emotional pictures from participants’ choice data, we used reinforcement learning models that have success- fully been used in previous studies for modeling value-based decision making. Consequently, we found that the estimated reward value was asymmetric between positive and negative pictures. The negative reward value of negative pictures (relative to neutral pictures was larger in magnitude than the positive reward value of positive pictures. This asymmetry was not observed in valence for an individual picture, which was rated by the participants regarding the emotion experienced upon viewing it. These results suggest that there may be a difference between experienced emotion and the effect of the experienced emotion on subsequent behavior. Our experimental and computational paradigm provides a novel way for quantifying how and what aspects of emotional events affect human behavior. The present study is a first step toward relating a large amount of knowledge in emotion science and in taking computational approaches to value-based decision making.

  5. Influence of dopaminergically mediated reward on somatosensory decision-making.

    Directory of Open Access Journals (Sweden)

    Burkhard Pleger

    2009-07-01

    Full Text Available Reward-related dopaminergic influences on learning and overt behaviour are well established, but any influence on sensory decision-making is largely unknown. We used functional magnetic resonance imaging (fMRI while participants judged electric somatosensory stimuli on one hand or other, before being rewarded for correct performance at trial end via a visual signal, at one of four anticipated financial levels. Prior to the procedure, participants received either placebo (saline, a dopamine agonist (levodopa, or an antagonist (haloperidol.higher anticipated reward improved tactile decisions. Visually signalled reward reactivated primary somatosensory cortex for the judged hand, more strongly for higher reward. After receiving a higher reward on one trial, somatosensory activations and decisions were enhanced on the next trial. These behavioural and neural effects were all enhanced by levodopa and attenuated by haloperidol, indicating dopaminergic dependency. Dopaminergic reward-related influences extend even to early somatosensory cortex and sensory decision-making.

  6. The alcoholic brain: neural bases of impaired reward-based decision-making in alcohol use disorders.

    Science.gov (United States)

    Galandra, Caterina; Basso, Gianpaolo; Cappa, Stefano; Canessa, Nicola

    2018-03-01

    Neuroeconomics is providing insights into the neural bases of decision-making in normal and pathological conditions. In the neuropsychiatric domain, this discipline investigates how abnormal functioning of neural systems associated with reward processing and cognitive control promotes different disorders, and whether such evidence may inform treatments. This endeavor is crucial when studying different types of addiction, which share a core promoting mechanism in the imbalance between impulsive subcortical neural signals associated with immediate pleasurable outcomes and inhibitory signals mediated by a prefrontal reflective system. The resulting impairment in behavioral control represents a hallmark of alcohol use disorders (AUDs), a chronic relapsing disorder characterized by excessive alcohol consumption despite devastating consequences. This review aims to summarize available magnetic resonance imaging (MRI) evidence on reward-related decision-making alterations in AUDs, and to envision possible future research directions. We review functional MRI (fMRI) studies using tasks involving monetary rewards, as well as MRI studies relating decision-making parameters to neurostructural gray- or white-matter metrics. The available data suggest that excessive alcohol exposure affects neural signaling within brain networks underlying adaptive behavioral learning via the implementation of prediction errors. Namely, weaker ventromedial prefrontal cortex activity and altered connectivity between ventral striatum and dorsolateral prefrontal cortex likely underpin a shift from goal-directed to habitual actions which, in turn, might underpin compulsive alcohol consumption and relapsing episodes despite adverse consequences. Overall, these data highlight abnormal fronto-striatal connectivity as a candidate neurobiological marker of impaired choice in AUDs. Further studies are needed, however, to unveil its implications in the multiple facets of decision-making.

  7. Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward.

    Science.gov (United States)

    McMurray, Matthew S; Conway, Sineadh M; Roitman, Jamie D

    2017-01-01

    Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

  8. A model of reward- and effort-based optimal decision making and motor control.

    Directory of Open Access Journals (Sweden)

    Lionel Rigoux

    Full Text Available Costs (e.g. energetic expenditure and benefits (e.g. food are central determinants of behavior. In ecology and economics, they are combined to form a utility function which is maximized to guide choices. This principle is widely used in neuroscience as a normative model of decision and action, but current versions of this model fail to consider how decisions are actually converted into actions (i.e. the formation of trajectories. Here, we describe an approach where decision making and motor control are optimal, iterative processes derived from the maximization of the discounted, weighted difference between expected rewards and foreseeable motor efforts. The model accounts for decision making in cost/benefit situations, and detailed characteristics of control and goal tracking in realistic motor tasks. As a normative construction, the model is relevant to address the neural bases and pathological aspects of decision making and motor control.

  9. Decision-Making Based on Emotional Images

    OpenAIRE

    Katahira, Kentaro; Fujimura, Tomomi; Okanoya, Kazuo; Okada, Masato

    2011-01-01

    The emotional outcome of a choice affects subsequent decision making. While the relationship between decision making and emotion has attracted attention, studies on emotion and decision making have been independently developed. In this study, we investigated how the emotional valence of pictures, which was stochastically contingent on participants’ choices, influenced subsequent decision making. In contrast to traditional value-based decision-making studies that used money or food as a reward...

  10. Decision making based on emotional images

    OpenAIRE

    Kentaro eKatahira; Kentaro eKatahira; Kentaro eKatahira; Tomomi eFujimura; Tomomi eFujimura; Kazuo eOkanoya; Kazuo eOkanoya; Kazuo eOkanoya; Masato eOkada; Masato eOkada; Masato eOkada

    2011-01-01

    The emotional outcome of a choice affects subsequent decision making. While the relationship between decision making and emotion has attracted attention, studies on emotion and decision making have been independently developed. In this study, we investigated how the emotional valence of pictures, which was stochastically contingent on participants’ choices, influenced subsequent decision making. In contrast to traditional value-based decision-making studies that used money or food as a reward...

  11. Balancing risk and reward: a rat model of risky decision making.

    Science.gov (United States)

    Simon, Nicholas W; Gilbert, Ryan J; Mayse, Jeffrey D; Bizon, Jennifer L; Setlow, Barry

    2009-09-01

    We developed a behavioral task in rats to assess the influence of risk of punishment on decision making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, 'safe' food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, 'risky' reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (ie, it made rats more risk averse). Cocaine did not cause a shift in reward choice, but instead impaired the rats' sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction.

  12. Dopaminergic modulation of reward-guided decision making in alcohol-preferring AA rats.

    Science.gov (United States)

    Oinio, Ville; Bäckström, Pia; Uhari-Väänänen, Johanna; Raasmaja, Atso; Piepponen, Petteri; Kiianmaa, Kalervo

    2017-05-30

    R**esults from animal gambling models have highlighted the importance of dopaminergic neurotransmission in modulating decision making when large sucrose rewards are combined with uncertainty. The majority of these models use food restriction as a tool to motivate animals to accomplish operant behavioral tasks, in which sucrose is used as a reward. As enhanced motivation to obtain sucrose due to hunger may impact its reward-seeking effect, we wanted to examine the decision-making behavior of rats in a situation where rats were fed ad libitum. For this purpose, we chose alcohol-preferring AA (alko alcohol) rats, as these rats have been shown to have high preference for sweet agents. In the present study, AA rats were trained to self-administer sucrose pellet rewards in a two-lever choice task (one pellet vs. three pellets). Once rational choice behavior had been established, the probability of gaining three pellets was decreased over time (50%, 33%, 25% then 20%). The effect of d-amphetamine on decision making was studied at every probability level, as well as the effect of the dopamine D 1 receptor agonist SKF-81297 and D 2 agonist quinpirole at probability levels of 100% and 25%. d-Amphetamine increased unprofitable choices in a dose-dependent manner at the two lowest probability levels. Quinpirole increased the frequency of unprofitable decisions at the 25% probability level, and SKF-82197 did not affect choice behavior. These results mirror the findings of probabilistic discounting studies using food-restricted rats. Based on this, the use of AA rats provides a new approach for studies on reward-guided decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

  13. Vicarious Effort-Based Decision-Making in Autism Spectrum Disorders.

    Science.gov (United States)

    Mosner, Maya G; Kinard, Jessica L; McWeeny, Sean; Shah, Jasmine S; Markiewitz, Nathan D; Damiano-Goodwin, Cara R; Burchinal, Margaret R; Rutherford, Helena J V; Greene, Rachel K; Treadway, Michael T; Dichter, Gabriel S

    2017-10-01

    This study investigated vicarious effort-based decision-making in 50 adolescents with autism spectrum disorders (ASD) compared to 32 controls using the Effort Expenditure for Rewards Task. Participants made choices to win money for themselves or for another person. When choosing for themselves, the ASD group exhibited relatively similar patterns of effort-based decision-making across reward parameters. However, when choosing for another person, the ASD group demonstrated relatively decreased sensitivity to reward magnitude, particularly in the high magnitude condition. Finally, patterns of responding in the ASD group were related to individual differences in consummatory pleasure capacity. These findings indicate atypical vicarious effort-based decision-making in ASD and more broadly add to the growing body of literature addressing social reward processing deficits in ASD.

  14. Impaired Flexible Reward-Based Decision-Making in Binge Eating Disorder: Evidence from Computational Modeling and Functional Neuroimaging.

    Science.gov (United States)

    Reiter, Andrea M F; Heinze, Hans-Jochen; Schlagenhauf, Florian; Deserno, Lorenz

    2017-02-01

    Despite its clinical relevance and the recent recognition as a diagnostic category in the DSM-5, binge eating disorder (BED) has rarely been investigated from a cognitive neuroscientific perspective targeting a more precise neurocognitive profiling of the disorder. BED patients suffer from a lack of behavioral control during recurrent binge eating episodes and thus fail to adapt their behavior in the face of negative consequences, eg, high risk for obesity. To examine impairments in flexible reward-based decision-making, we exposed BED patients (n=22) and matched healthy individuals (n=22) to a reward-guided decision-making task during functional resonance imaging (fMRI). Performing fMRI analysis informed via computational modeling of choice behavior, we were able to identify specific signatures of altered decision-making in BED. On the behavioral level, we observed impaired behavioral adaptation in BED, which was due to enhanced switching behavior, a putative deficit in striking a balance between exploration and exploitation appropriately. This was accompanied by diminished activation related to exploratory decisions in the anterior insula/ventro-lateral prefrontal cortex. Moreover, although so-called model-free reward prediction errors remained intact, representation of ventro-medial prefrontal learning signatures, incorporating inference on unchosen options, was reduced in BED, which was associated with successful decision-making in the task. On the basis of a computational psychiatry account, the presented findings contribute to defining a neurocognitive phenotype of BED.

  15. Chronic motivational state interacts with task reward structure in dynamic decision-making.

    Science.gov (United States)

    Cooper, Jessica A; Worthy, Darrell A; Maddox, W Todd

    2015-12-01

    Research distinguishes between a habitual, model-free system motivated toward immediately rewarding actions, and a goal-directed, model-based system motivated toward actions that improve future state. We examined the balance of processing in these two systems during state-based decision-making. We tested a regulatory fit hypothesis (Maddox & Markman, 2010) that predicts that global trait motivation affects the balance of habitual- vs. goal-directed processing but only through its interaction with the task framing as gain-maximization or loss-minimization. We found support for the hypothesis that a match between an individual's chronic motivational state and the task framing enhances goal-directed processing, and thus state-based decision-making. Specifically, chronic promotion-focused individuals under gain-maximization and chronic prevention-focused individuals under loss-minimization both showed enhanced state-based decision-making. Computational modeling indicates that individuals in a match between global chronic motivational state and local task reward structure engaged more goal-directed processing, whereas those in a mismatch engaged more habitual processing. Copyright © 2015 Elsevier Inc. All rights reserved.

  16. Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia.

    Science.gov (United States)

    Stopper, Colin M; Floresco, Stan B

    2015-01-01

    Abnormal reinforcement learning and representations of reward value are present in schizophrenia, and these impairments can manifest as deficits in risk/reward decision making. These abnormalities may be due in part to dopaminergic dysfunction within cortico-limbic-striatal circuitry. Evidence from studies with laboratory animal have revealed that normal DA activity within different nodes of these circuits is critical for mediating dissociable processes that can refine decision biases. Moreover, both phasic and tonic dopamine transmission appear to play separate yet complementary roles in these processes. Tonic dopamine release within the prefrontal cortex and nucleus accumbens, serves as a "running rate-meter" of reward and reflects contextual information such as reward uncertainty and overt choice behavior. On the other hand, manipulations of outcome-related phasic dopamine bursts and dips suggest these signals provide rapid feedback to allow for quick adjustments in choice as reward contingencies change. The lateral habenula is a key input to the DA system that phasic signals is necessary for expressing subjective decision biases; as suppression of activity within this nucleus leads to catastrophic impairments in decision making and random patterns of choice behavior. As schizophrenia is characterized by impairments in using positive and negative feedback to appropriately guide decision making, these findings suggest that these deficits in these processes may be mediated, at least in part, by abnormalities in both tonic and phasic dopamine transmission. © The Author 2014. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

  17. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.

    Science.gov (United States)

    Schönberg, Tom; Daw, Nathaniel D; Joel, Daphna; O'Doherty, John P

    2007-11-21

    The computational framework of reinforcement learning has been used to forward our understanding of the neural mechanisms underlying reward learning and decision-making behavior. It is known that humans vary widely in their performance in decision-making tasks. Here, we used a simple four-armed bandit task in which subjects are almost evenly split into two groups on the basis of their performance: those who do learn to favor choice of the optimal action and those who do not. Using models of reinforcement learning we sought to determine the neural basis of these intrinsic differences in performance by scanning both groups with functional magnetic resonance imaging. We scanned 29 subjects while they performed the reward-based decision-making task. Our results suggest that these two groups differ markedly in the degree to which reinforcement learning signals in the striatum are engaged during task performance. While the learners showed robust prediction error signals in both the ventral and dorsal striatum during learning, the nonlearner group showed a marked absence of such signals. Moreover, the magnitude of prediction error signals in a region of dorsal striatum correlated significantly with a measure of behavioral performance across all subjects. These findings support a crucial role of prediction error signals, likely originating from dopaminergic midbrain neurons, in enabling learning of action selection preferences on the basis of obtained rewards. Thus, spontaneously observed individual differences in decision making performance demonstrate the suggested dependence of this type of learning on the functional integrity of the dopaminergic striatal system in humans.

  18. Reward-related decision making in older adults: relationship to clinical presentation of depression.

    Science.gov (United States)

    McGovern, Amanda R; Alexopoulos, George S; Yuen, Genevieve S; Morimoto, Sarah Shizuko; Gunning-Dixon, Faith M

    2014-11-01

    Impairment in reward processes has been found in individuals with depression and in the aging population. The purpose of this study was twofold: (1) to use an affective neuroscience probe to identify abnormalities in reward-related decision making in late-life depression; and (2) to examine the relationship of reward-related decision making abnormalities in depressed, older adults to the clinical expression of apathy in depression. We hypothesized that relative to older, healthy subjects, depressed, older patients would exhibit impaired decision making and that apathetic, depressed patients would show greater impairment in decision making than non-apathetic, depressed patients. We used the Iowa Gambling Task to examine reward-related decision making in 60 non-demented, older patients with non-psychotic major depression and 36 older, psychiatrically healthy participants. Apathy was quantified using the Apathy Evaluation Scale. Of those with major depression, 18 individuals reported clinically significant apathy, whereas 42 participants did not have apathy. Older adults with depression and healthy comparison participants did not differ in their performance on the Iowa Gambling Task. However, apathetic, depressed older adults adopted an advantageous strategy and selected cards from the conservative decks compared with non-apathetic, depressed older adults. Non-apathetic, depressed patients showed a failure to adopt a conservative strategy and persisted in making risky decisions throughout the task. This study indicates that apathy in older, depressed adults is associated with a conservative response style on a behavioral probe of the systems involved in reward-related decision making. This conservative response style may be the result of reduced sensitivity to rewards in apathetic individuals. Copyright © 2014 John Wiley & Sons, Ltd.

  19. Incidental rewarding cues influence economic decision-making in obesity

    Directory of Open Access Journals (Sweden)

    Jakob eSimmank

    2015-10-01

    Full Text Available Recent research suggests that obesity is linked to prominent alterations in learning and decision-making. This general difference may also underlie the preference for immediately consumable, highly palatable but unhealthy and high-calorie foods. Such poor food-related inter-temporal decision-making can explain weight gain; however, it is not yet clear whether this deficit can be generalized to other domains of inter-temporal decision-making, for example financial decisions. Further, little is known about the stability of decision-making behavior in obesity, especially in the presence of rewarding cues. To answer these questions, obese and lean participants (n=52 completed two sessions of a novel priming paradigm including a computerized monetary delay discounting task. In the first session, general differences between groups in financial delay discounting were measured. In the second session, we tested the general stability of discounting rates. Additionally, participants were primed by affective visual cues of different contextual categories before the financial decision. We found that the obese group showed stronger discounting of future monetary rewards than the lean group, but groups did not differ in their general stability between sessions nor in their sensitivity towards changes in reward magnitude. In the obese group, a fast decrease of subjective value over time was directly related to a higher tendency for opportunistic eating. Obese in contrast to lean people were primed by the affective cues, showing a sex-specific pattern of priming direction. Our findings demonstrate that environments rich of cues, aiming at inducing unhealthy consumer decisions, can be highly detrimental for obese people. It also underscores that obesity is not merely a medical condition but has a strong cognitive component, meaning that current dietary and medical treatment strategies may fall too short.

  20. Exploiting risk-reward structures in decision making under uncertainty.

    Science.gov (United States)

    Leuker, Christina; Pachur, Thorsten; Hertwig, Ralph; Pleskac, Timothy J

    2018-06-01

    People often have to make decisions under uncertainty-that is, in situations where the probabilities of obtaining a payoff are unknown or at least difficult to ascertain. One solution to this problem is to infer the probability from the magnitude of the potential payoff and thus exploit the inverse relationship between payoffs and probabilities that occurs in many domains in the environment. Here, we investigated how the mind may implement such a solution: (1) Do people learn about risk-reward relationships from the environment-and if so, how? (2) How do learned risk-reward relationships impact preferences in decision-making under uncertainty? Across three experiments (N = 352), we found that participants can learn risk-reward relationships from being exposed to choice environments with a negative, positive, or uncorrelated risk-reward relationship. They were able to learn the associations both from gambles with explicitly stated payoffs and probabilities (Experiments 1 & 2) and from gambles about epistemic events (Experiment 3). In subsequent decisions under uncertainty, participants often exploited the learned association by inferring probabilities from the magnitudes of the payoffs. This inference systematically influenced their preferences under uncertainty: Participants who had been exposed to a negative risk-reward relationship tended to prefer the uncertain option over a smaller sure option for low payoffs, but not for high payoffs. This pattern reversed in the positive condition and disappeared in the uncorrelated condition. This adaptive change in preferences is consistent with the use of the risk-reward heuristic. Copyright © 2018 Elsevier B.V. All rights reserved.

  1. Decision-making patterns and sensitivity to reward and punishment in children with attention-deficit hyperactivity disorder.

    Science.gov (United States)

    Masunami, Taiji; Okazaki, Shinji; Maekawa, Hisao

    2009-06-01

    Earlier studies have demonstrated that attention-deficit hyperactivity disorder (ADHD) is associated with aberrant sensitivity to rewards and punishments. Although some studies have focused on real-life decision making in children with ADHD using the Iowa gambling task, the number of good deck choices, a frequently used index of decision-making ability in the gambling task, is insufficient for investigating the complex decision-making strategies in subjects. In the present study, we investigated decision-making strategies in ADHD children, analyzing T-patterns with rewards, with punishments, and without rewards and punishments during the gambling task, and examined the relationship between decision-making strategies and skin conductance responses (SCRs) to rewards and punishments. We hypothesized that ADHD children and normal children would employ different decision-making strategies depending on their sensitivity to rewards and punishments in the gambling task. Our results revealed that ADHD children had fewer T-patterns with punishments and exhibited a significant tendency to have many T-patterns with rewards, thus supporting our hypothesis. Moreover, in contrast to normal children, ADHD children failed to demonstrate differences between reward and punishment SCRs, supporting the idea that they had an aberrant sensitivity to rewards and punishments. Therefore, we concluded that ADHD children would be impaired in decision-making strategies depending on their aberrant sensitivity to rewards and punishments. However, we were unable to specify whether large reward SCRs or small punishment SCRs is generated in ADHD children.

  2. Reversible inactivation of the lateral hypothalamus reversed high reward choices in cost-benefit decision-making in rats.

    Science.gov (United States)

    Karimi, Sara; Mesdaghinia, Azam; Farzinpour, Zahra; Hamidi, Gholamali; Haghparast, Abbas

    2017-11-01

    The Lateral hypothalamus (LH) is an important component of the networks underlying the control of feeding and other motivated behaviors. Cost-benefit decision-making is mediated largely by the prefrontal cortex (PFC) which strongly innervates the LH. Therefore, in the current study, we conducted a series of experiments to elucidate the role of the perifornical area of the lateral hypothalamus (PeF-LH) in effort and/or delay-based decision-making. We trained different groups of rats in a delay-based and/or an effort-based form of cost-benefit T-maze decision- making task in which they could either choose to pay the cost to obtain a high reward in one arm or could obtain a low reward in the other arm with no cost. During test days, the rats received local injections of either vehicle or lidocaine4% (0.5 μl/side), in the PeF-LH. In an effort-based decision task, PeF-LH inactivation led to decrease in high reward choice. Similarly, in a delay-based decision task animals' preference changed to a low but immediately available reward. This was not caused by a spatial memory or motor deficit. PeF-LH inactivation modified decision behavior. The results imply that PeF-LH is important for allowing the animal to pay a cost to acquire greater rewards. Copyright © 2017 Elsevier Inc. All rights reserved.

  3. Brain mechanisms for perceptual and reward-related decision-making.

    Science.gov (United States)

    Deco, Gustavo; Rolls, Edmund T; Albantakis, Larissa; Romo, Ranulfo

    2013-04-01

    Phenomenological models of decision-making, including the drift-diffusion and race models, are compared with mechanistic, biologically plausible models, such as integrate-and-fire attractor neuronal network models. The attractor network models show how decision confidence is an emergent property; and make testable predictions about the neural processes (including neuronal activity and fMRI signals) involved in decision-making which indicate that the medial prefrontal cortex is involved in reward value-based decision-making. Synaptic facilitation in these models can help to account for sequential vibrotactile decision-making, and for how postponed decision-related responses are made. The randomness in the neuronal spiking-related noise that makes the decision-making probabilistic is shown to be increased by the graded firing rate representations found in the brain, to be decreased by the diluted connectivity, and still to be significant in biologically large networks with thousands of synapses onto each neuron. The stability of these systems is shown to be influenced in different ways by glutamatergic and GABAergic efficacy, leading to a new field of dynamical neuropsychiatry with applications to understanding schizophrenia and obsessive-compulsive disorder. The noise in these systems is shown to be advantageous, and to apply to similar attractor networks involved in short-term memory, long-term memory, attention, and associative thought processes. Copyright © 2012 Elsevier Ltd. All rights reserved.

  4. Modulation of risk/reward decision making by dopaminergic transmission within the basolateral amygdala.

    Science.gov (United States)

    Larkin, Joshua D; Jenni, Nicole L; Floresco, Stan B

    2016-01-01

    Dopamine (DA) transmission within cortico-limbic-striatal circuitry is integral in modulating decisions involving reward uncertainty. The basolateral amygdala (BLA) also plays a role in these processes, yet how DA transmission within this nucleus regulates cost/benefit decision making is unknown. We investigated the contribution of DA transmission within the BLA to risk/reward decision making assessed with a probabilistic discounting task. Rats were well-trained to choose between a small/certain reward and a large/risky reward, with the probability of obtaining the larger reward decreasing (100-12.5 %) or increasing (12.5-100 %) over a session. We examined the effects of antagonizing BLA D1 (SCH 23390, 0.1-1 μg) or D2 (eticlopride, 0.1-1 μg) receptors, as well as intra-BLA infusions of agonists for D1 (SKF 81297, 0.1-1 μg) and D2 (quinpirole, 1-10 μg) receptors. We also assessed how DA receptor stimulation may induce differential effects related to baseline levels of risky choice. BLA D1 receptor antagonism reduced risky choice by decreasing reward sensitivity, whereas D2 antagonism did not affect overall choice patterns. Stimulation of BLA D1 receptors optimized decision making in a baseline-dependent manner: in risk-averse rats, infusions of a lower dose of SKF81297 increased risky choice when reward probabilities were high (50 %), whereas in risk-prone rats, this drug reduced risky choice when probabilities were low (12.5 %). Quinpirole reduced risky choice in risk-prone rats, enhancing lose-shift behavior. These data highlight previously uncharacterized roles for BLA DA D1 and D2 receptors in biasing choice during risk/reward decision making through mediation of reward/negative feedback sensitivity.

  5. Risk, reward, and decision-making in a rodent model of cognitive aging.

    Science.gov (United States)

    Gilbert, Ryan J; Mitchell, Marci R; Simon, Nicholas W; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L

    2011-01-01

    Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 months) and aged (23-25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost-benefit decision-making.

  6. Risk, reward, and decision-making in a rodent model of cognitive aging

    Directory of Open Access Journals (Sweden)

    Ryan J Gilbert

    2012-01-01

    Full Text Available Impaired decision-making in aging can directly impact factors (financial security, quality of healthcare that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 mo. and aged (23-25 mo. male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (1 food pellet and a large but uncertain reward (2 food pellets with varying probabilities of delivery ranging from 100% to 0%. Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the smaller but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for costs (i.e., delay, probability. These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct neural mechanisms that can impact cost

  7. Decision making in the reward and punishment variants of the iowa gambling task: evidence of "foresight" or "framing"?

    Science.gov (United States)

    Singh, Varsha; Khan, Azizuddin

    2012-01-01

    Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment), the order in which the frame was triggered (order type: reward-punishment or punishment-reward), and the four types of instructions that delineated motivation toward reward from that of punishment (reward, punishment, reward and punishment, and no-hint) were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p decision making in the two IGT variants (p decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision making framework. Benefits of integrating findings from behavioral studies in decision neuroscience are discussed, and a need to investigate cultural differences in the IGT studies is pointed out.

  8. The role of the striatum in effort-based decision-making in the absence of reward.

    Science.gov (United States)

    Schouppe, Nathalie; Demanet, Jelle; Boehler, Carsten N; Ridderinkhof, K Richard; Notebaert, Wim

    2014-02-05

    Decision-making involves weighing costs against benefits, for instance, in terms of the effort it takes to obtain a reward of a given magnitude. This evaluation process has been linked to the dorsal anterior cingulate cortex (dACC) and the striatum, with activation in these brain structures reflecting the discounting effect of effort on reward. Here, we investigate how cognitive effort influences neural choice processes in the absence of an extrinsic reward. Using functional magnetic resonance imaging in humans, we used an effort-based decision-making task in which participants were required to choose between two options for a subsequent flanker task that differed in the amount of cognitive effort. Cognitive effort was manipulated by varying the proportion of incongruent trials associated with each choice option. Choice-locked activation in the striatum was higher when participants chose voluntarily for the more effortful alternative but displayed the opposite trend on forced-choice trials. The dACC revealed a similar, yet only trend-level significant, activation pattern. Our results imply that activation levels in the striatum reflect a cost-benefit analysis, in which a balance is made between effort discounting and the intrinsic motivation to choose a cognitively challenging task. Moreover, our findings indicate that it matters whether this challenge is voluntarily chosen or externally imposed. As such, the present findings contrast with classical findings on effort discounting that found reductions in striatum activation for higher effort by finding enhancements of the same neural circuits when a cognitively challenging task is voluntarily selected and does not entail the danger of losing reward.

  9. Towards a cognitive robotics methodology for reward-based decision-making: dynamical systems modelling of the Iowa Gambling Task

    Science.gov (United States)

    Lowe, Robert; Ziemke, Tom

    2010-09-01

    The somatic marker hypothesis (SMH) posits that the role of emotions and mental states in decision-making manifests through bodily responses to stimuli of import to the organism's welfare. The Iowa Gambling Task (IGT), proposed by Bechara and Damasio in the mid-1990s, has provided the major source of empirical validation to the role of somatic markers in the service of flexible and cost-effective decision-making in humans. In recent years the IGT has been the subject of much criticism concerning: (1) whether measures of somatic markers reveal that they are important for decision-making as opposed to behaviour preparation; (2) the underlying neural substrate posited as critical to decision-making of the type relevant to the task; and (3) aspects of the methodological approach used, particularly on the canonical version of the task. In this paper, a cognitive robotics methodology is proposed to explore a dynamical systems approach as it applies to the neural computation of reward-based learning and issues concerning embodiment. This approach is particularly relevant in light of a strongly emerging alternative hypothesis to the SMH, the reversal learning hypothesis, which links, behaviourally and neurocomputationally, a number of more or less complex reward-based decision-making tasks, including the 'A-not-B' task - already subject to dynamical systems investigations with a focus on neural activation dynamics. It is also suggested that the cognitive robotics methodology may be used to extend systematically the IGT benchmark to more naturalised, but nevertheless controlled, settings that might better explore the extent to which the SMH, and somatic states per se, impact on complex decision-making.

  10. Opioid Modulation of Value-Based Decision-Making in Healthy Humans.

    Science.gov (United States)

    Eikemo, Marie; Biele, Guido; Willoch, Frode; Thomsen, Lotte; Leknes, Siri

    2017-08-01

    Modifying behavior to maximize reward is integral to adaptive decision-making. In rodents, the μ-opioid receptor (MOR) system encodes motivation and preference for high-value rewards. Yet it remains unclear whether and how human MORs contribute to value-based decision-making. We reasoned that if the human MOR system modulates value-based choice, this would be reflected by opposite effects of agonist and antagonist drugs. In a double-blind pharmacological cross-over study, 30 healthy men received morphine (10 mg), placebo, and the opioid antagonist naltrexone (50 mg). They completed a two-alternative decision-making task known to induce a considerable bias towards the most frequently rewarded response option. To quantify MOR involvement in this bias, we fitted accuracy and reaction time data with the drift-diffusion model (DDM) of decision-making. The DDM analysis revealed the expected bidirectional drug effects for two decision subprocesses. MOR stimulation with morphine increased the preference for the stimulus with high-reward probability (shift in starting point). Compared to placebo, morphine also increased, and naltrexone reduced, the efficiency of evidence accumulation. Since neither drug affected motor-coordination, speed-accuracy trade-off, or subjective state (indeed participants were still blinded after the third session), we interpret the MOR effects on evidence accumulation efficiency as a consequence of changes in effort exerted in the task. Together, these findings support a role for the human MOR system in value-based choice by tuning decision-making towards high-value rewards across stimulus domains.

  11. Effort-Based Decision-Making in Schizophrenia.

    Science.gov (United States)

    Culbreth, Adam J; Moran, Erin K; Barch, Deanna M

    2018-08-01

    Motivational impairment has long been associated with schizophrenia but the underlying mechanisms are not clearly understood. Recently, a small but growing literature has suggested that aberrant effort-based decision-making may be a potential contributory mechanism for motivational impairments in psychosis. Specifically, multiple reports have consistently demonstrated that individuals with schizophrenia are less willing than healthy controls to expend effort to obtain rewards. Further, this effort-based decision-making deficit has been shown to correlate with severity of negative symptoms and level of functioning, in many but not all studies. In the current review, we summarize this literature and discuss several factors that may underlie aberrant effort-based decision-making in schizophrenia.

  12. Dopamine and Effort-Based Decision Making

    Directory of Open Access Journals (Sweden)

    Irma Triasih Kurniawan

    2011-06-01

    Full Text Available Motivational theories of choice focus on the influence of goal values and strength of reinforcement to explain behavior. By contrast relatively little is known concerning how the cost of an action, such as effort expended, contributes to a decision to act. Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. Here we review behavioral and neurobiological data regarding the representation of effort as action cost, and how this impacts on decision making. Although organisms expend effort to obtain a desired reward there is a striking sensitivity to the amount of effort required, such that the net preference for an action decreases as effort cost increases. We discuss the contribution of the neurotransmitter dopamine (DA towards overcoming response costs and in enhancing an animal’s motivation towards effortful actions. We also consider the contribution of brain structures, including the basal ganglia (BG and anterior cingulate cortex (ACC, in the internal generation of action involving a translation of reward expectation into effortful action.

  13. Decision making in the reward and punishment variants of the Iowa gambling task: Evidence of foresight or framing?

    Directory of Open Access Journals (Sweden)

    Varsha eSingh

    2012-07-01

    Full Text Available Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160. It was contended that risk-aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment, the order in which the frame was triggered (order type: reward–punishment or punishment–reward, and the four types of instructions that delineated motivation towards reward from that of punishment (reward, punishment, reward and punishment, and no-hint were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p < 0.001. The order in which a variant was presented, and the type of the instructions that were used both had an effect on long-term decision making in the two IGT variants (p < 0.05. A post hoc test suggested that the instructions that differentiated between reward and punishment resulted in greater foresight than the commonly used IGT instructions that fail to distinguish between reward and punishment. As observed in previous studies, there were more number of participants (60% who showed greater foresight in the punishment variant than in the reward variant (p< 0.001. The results suggest that foresight in IGT decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision-making framework. Benefits of integrating findings from behavioral studies

  14. Individual differences in decision making: Drive and reward responsiveness affect strategic bargaining in economic games

    Directory of Open Access Journals (Sweden)

    Sanfey Alan G

    2006-10-01

    Full Text Available Abstract Background In the growing body of literature on economic decision making, the main focus has typically been on explaining aggregate behavior, with little interest in individual differences despite considerable between-subject variability in decision responses. In this study, we were interested in asking to what degree individual differences in fundamental psychological processes can mediate economic decision-making behavior. Methods Specifically, we studied a personality dimension that may influence economic decision-making, the Behavioral Activation System, (BAS which is composed of three components: Reward Responsiveness, Drive, and Fun Seeking. In order to assess economic decision making, we utilized two commonly-used tasks, the Ultimatum Game and Dictator Game. Individual differences in BAS were measured by completion of the BIS/BAS Scales, and correlations between the BAS scales and monetary offers made in the two tasks were computed. Results We found that higher scores on BAS Drive and on BAS Reward Responsiveness were associated with a pattern of higher offers on the Ultimatum Game, lower offers on the Dictator Game, and a correspondingly larger discrepancy between Ultimatum Game and Dictator Game offers. Conclusion These findings are consistent with an interpretation that high scores on Drive and Reward Responsiveness are associated with a strategy that first seeks to maximize the likelihood of reward, and then to maximize the amount of reward. More generally, these results suggest that there are additional factors other than empathy, fairness and selfishness that contribute to strategic decision-making.

  15. Individual differences in decision making: Drive and Reward Responsiveness affect strategic bargaining in economic games.

    Science.gov (United States)

    Scheres, Anouk; Sanfey, Alan G

    2006-10-18

    In the growing body of literature on economic decision making, the main focus has typically been on explaining aggregate behavior, with little interest in individual differences despite considerable between-subject variability in decision responses. In this study, we were interested in asking to what degree individual differences in fundamental psychological processes can mediate economic decision-making behavior. Specifically, we studied a personality dimension that may influence economic decision-making, the Behavioral Activation System, (BAS) which is composed of three components: Reward Responsiveness, Drive, and Fun Seeking. In order to assess economic decision making, we utilized two commonly-used tasks, the Ultimatum Game and Dictator Game. Individual differences in BAS were measured by completion of the BIS/BAS Scales, and correlations between the BAS scales and monetary offers made in the two tasks were computed. We found that higher scores on BAS Drive and on BAS Reward Responsiveness were associated with a pattern of higher offers on the Ultimatum Game, lower offers on the Dictator Game, and a correspondingly larger discrepancy between Ultimatum Game and Dictator Game offers. These findings are consistent with an interpretation that high scores on Drive and Reward Responsiveness are associated with a strategy that first seeks to maximize the likelihood of reward, and then to maximize the amount of reward. More generally, these results suggest that there are additional factors other than empathy, fairness and selfishness that contribute to strategic decision-making.

  16. Activation of the cannabinoid system in the nucleus accumbens affects effort-based decision making.

    Science.gov (United States)

    Fatahi, Zahra; Haghparast, Abbas

    2018-02-01

    Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. The nucleus accumbens (NAc) is implicated in allowing an animal to overcome effort constraints to obtain greater benefits, and it has been previously shown that cannabis derivatives may affect such processes. Therefore, in this study, we intend to evaluate the involvement of the cannabinoid system in the entire NAc on effort-based decision making. Rats were trained in a T-maze cost-benefit decision making the task in which they could choose either to climb a barrier to obtain a large reward in one arm or run into the other arm without a barrier to obtaining a small reward. Following training, the animals were bilaterally implanted with guide cannulae in the NAc. On test day, rats received cannabinoid agonist (Win 55,212-2; 2, 10 and 50μM) and/or antagonist (AM251; 45μM), afterward percentage of large reward choice and latency of reward attainment were investigated. Results revealed that the administration of cannabinoid agonist led to decrease of large reward choice percentage such that the animals preferred to receive a small reward with low effort instead of receiving a large reward with high effort. The administration of antagonist solely did not affect effort-based decision making, but did attenuate the Win 55,212-2-induced impairments in effort allocation. In agonist-treated animals, the latency of reward collection increased. Moreover, when the effort was equated on both arms, the animals returned to choosing large reward showing that obtained results were not caused by spatial memory impairment. Our finding suggested that activation of the cannabinoid system in the NAc impaired effort-based decision making and led to rats were less willing to invest the physical effort to gain large reward. Copyright © 2017 Elsevier Inc. All rights reserved.

  17. Differential Contributions of Nucleus Accumbens Subregions to Cue-Guided Risk/Reward Decision Making and Implementation of Conditional Rules.

    Science.gov (United States)

    Floresco, Stan B; Montes, David R; Tse, Maric M T; van Holstein, Mieke

    2018-02-21

    The nucleus accumbens (NAc) is a key node within corticolimbic circuitry for guiding action selection and cost/benefit decision making in situations involving reward uncertainty. Preclinical studies have typically assessed risk/reward decision making using assays where decisions are guided by internally generated representations of choice-outcome contingencies. Yet, real-life decisions are often influenced by external stimuli that inform about likelihoods of obtaining rewards. How different subregions of the NAc mediate decision making in such situations is unclear. Here, we used a novel assay colloquially termed the "Blackjack" task that models these types of situations. Male Long-Evans rats were trained to choose between one lever that always delivered a one-pellet reward and another that delivered four pellets with different probabilities [either 50% (good-odds) or 12.5% (poor-odds)], which were signaled by one of two auditory cues. Under control conditions, rats selected the large/risky option more often on good-odds versus poor-odds trials. Inactivation of the NAc core caused indiscriminate choice patterns. In contrast, NAc shell inactivation increased risky choice, more prominently on poor-odds trials. Additional experiments revealed that both subregions contribute to auditory conditional discrimination. NAc core or shell inactivation reduced Pavlovian approach elicited by an auditory CS+, yet shell inactivation also increased responding during presentation of a CS-. These data highlight distinct contributions for NAc subregions in decision making and reward seeking guided by discriminative stimuli. The core is crucial for implementation of conditional rules, whereas the shell refines reward seeking by mitigating the allure of larger, unlikely rewards and reducing expression of inappropriate or non-rewarded actions. SIGNIFICANCE STATEMENT Using external cues to guide decision making is crucial for adaptive behavior. Deficits in cue-guided behavior have been

  18. Acquisition of decision making criteria: reward rate ultimately beats accuracy.

    Science.gov (United States)

    Balci, Fuat; Simen, Patrick; Niyogi, Ritwik; Saxe, Andrew; Hughes, Jessica A; Holmes, Philip; Cohen, Jonathan D

    2011-02-01

    Speed-accuracy trade-offs strongly influence the rate of reward that can be earned in many decision-making tasks. Previous reports suggest that human participants often adopt suboptimal speed-accuracy trade-offs in single session, two-alternative forced-choice tasks. We investigated whether humans acquired optimal speed-accuracy trade-offs when extensively trained with multiple signal qualities. When performance was characterized in terms of decision time and accuracy, our participants eventually performed nearly optimally in the case of higher signal qualities. Rather than adopting decision criteria that were individually optimal for each signal quality, participants adopted a single threshold that was nearly optimal for most signal qualities. However, setting a single threshold for different coherence conditions resulted in only negligible decrements in the maximum possible reward rate. Finally, we tested two hypotheses regarding the possible sources of suboptimal performance: (1) favoring accuracy over reward rate and (2) misestimating the reward rate due to timing uncertainty. Our findings provide support for both hypotheses, but also for the hypothesis that participants can learn to approach optimality. We find specifically that an accuracy bias dominates early performance, but diminishes greatly with practice. The residual discrepancy between optimal and observed performance can be explained by an adaptive response to uncertainty in time estimation.

  19. Dynamic integration of reward and stimulus information in perceptual decision-making.

    Science.gov (United States)

    Gao, Juan; Tortell, Rebecca; McClelland, James L

    2011-03-03

    In perceptual decision-making, ideal decision-makers should bias their choices toward alternatives associated with larger rewards, and the extent of the bias should decrease as stimulus sensitivity increases. When responses must be made at different times after stimulus onset, stimulus sensitivity grows with time from zero to a final asymptotic level. Are decision makers able to produce responses that are more biased if they are made soon after stimulus onset, but less biased if they are made after more evidence has been accumulated? If so, how close to optimal can they come in doing this, and how might their performance be achieved mechanistically? We report an experiment in which the payoff for each alternative is indicated before stimulus onset. Processing time is controlled by a "go" cue occurring at different times post stimulus onset, requiring a response within msec. Reward bias does start high when processing time is short and decreases as sensitivity increases, leveling off at a non-zero value. However, the degree of bias is sub-optimal for shorter processing times. We present a mechanistic account of participants' performance within the framework of the leaky competing accumulator model [1], in which accumulators for each alternative accumulate noisy information subject to leakage and mutual inhibition. The leveling off of accuracy is attributed to mutual inhibition between the accumulators, allowing the accumulator that gathers the most evidence early in a trial to suppress the alternative. Three ways reward might affect decision making in this framework are considered. One of the three, in which reward affects the starting point of the evidence accumulation process, is consistent with the qualitative pattern of the observed reward bias effect, while the other two are not. Incorporating this assumption into the leaky competing accumulator model, we are able to provide close quantitative fits to individual participant data.

  20. Reward processing and intertemporal decision making in adults and adolescents: the role of impulsivity and decision consistency.

    Science.gov (United States)

    Ripke, Stephan; Hübner, Thomas; Mennigen, Eva; Müller, Kathrin U; Rodehacke, Sarah; Schmidt, Dirk; Jacob, Mark J; Smolka, Michael N

    2012-10-10

    Several studies report differences between adults and adolescents in reward processing and impulsivity. Consistently, adolescents are more impulsive in their decision making, as measured by intertemporal choice tasks. Since impulsivity affects an individual's perception and neural processing of rewards, it is unclear whether previously reported differences in brain activation between adults and adolescents are primarily due to maturation of the brain reward system or differences in impulsivity (i.e. discounting behaviour). To disentangle this, we analysed data from 235 adolescents and 29 adults who performed an intertemporal choice task in which monetary rewards were adapted to individual impulsivity. Using functional magnetic resonance imaging (fMRI), we measured brain activity and assessed impulsivity and consistency of choices at the behavioural level. Although adolescents discounted delayed rewards more steeply than adults, when controlling for impulsivity, neural processing of reward value did not differ between groups. However, more impulsive subjects showed a lower brain response to delayed rewards, independent of age. Concerning decision making, adolescents exhibited a lower consistency of choices and less brain activity in the parietal network than adults. We conclude that processing of the value of prospective delayed rewards is more sensitive to discounting behaviour than to chronological age. Lower consistency of intertemporal choices might indicate ongoing maturation of parietal brain areas in adolescents. Copyright © 2012 Elsevier B.V. All rights reserved.

  1. Episodic memories predict adaptive value-based decision-making

    Science.gov (United States)

    Murty, Vishnu; FeldmanHall, Oriel; Hunter, Lindsay E.; Phelps, Elizabeth A; Davachi, Lila

    2016-01-01

    Prior research illustrates that memory can guide value-based decision-making. For example, previous work has implicated both working memory and procedural memory (i.e., reinforcement learning) in guiding choice. However, other types of memories, such as episodic memory, may also influence decision-making. Here we test the role for episodic memory—specifically item versus associative memory—in supporting value-based choice. Participants completed a task where they first learned the value associated with trial unique lotteries. After a short delay, they completed a decision-making task where they could choose to re-engage with previously encountered lotteries, or new never before seen lotteries. Finally, participants completed a surprise memory test for the lotteries and their associated values. Results indicate that participants chose to re-engage more often with lotteries that resulted in high versus low rewards. Critically, participants not only formed detailed, associative memories for the reward values coupled with individual lotteries, but also exhibited adaptive decision-making only when they had intact associative memory. We further found that the relationship between adaptive choice and associative memory generalized to more complex, ecologically valid choice behavior, such as social decision-making. However, individuals more strongly encode experiences of social violations—such as being treated unfairly, suggesting a bias for how individuals form associative memories within social contexts. Together, these findings provide an important integration of episodic memory and decision-making literatures to better understand key mechanisms supporting adaptive behavior. PMID:26999046

  2. Decision Making under Uncertainty: A Neural Model based on Partially Observable Markov Decision Processes

    Directory of Open Access Journals (Sweden)

    Rajesh P N Rao

    2010-11-01

    Full Text Available A fundamental problem faced by animals is learning to select actions based on noisy sensory information and incomplete knowledge of the world. It has been suggested that the brain engages in Bayesian inference during perception but how such probabilistic representations are used to select actions has remained unclear. Here we propose a neural model of action selection and decision making based on the theory of partially observable Markov decision processes (POMDPs. Actions are selected based not on a single optimal estimate of state but on the posterior distribution over states (the belief state. We show how such a model provides a unified framework for explaining experimental results in decision making that involve both information gathering and overt actions. The model utilizes temporal difference (TD learning for maximizing expected reward. The resulting neural architecture posits an active role for the neocortex in belief computation while ascribing a role to the basal ganglia in belief representation, value computation, and action selection. When applied to the random dots motion discrimination task, model neurons representing belief exhibit responses similar to those of LIP neurons in primate neocortex. The appropriate threshold for switching from information gathering to overt actions emerges naturally during reward maximization. Additionally, the time course of reward prediction error in the model shares similarities with dopaminergic responses in the basal ganglia during the random dots task. For tasks with a deadline, the model learns a decision making strategy that changes with elapsed time, predicting a collapsing decision threshold consistent with some experimental studies. The model provides a new framework for understanding neural decision making and suggests an important role for interactions between the neocortex and the basal ganglia in learning the mapping between probabilistic sensory representations and actions that maximize

  3. Value-based attentional capture influences context-dependent decision-making

    Science.gov (United States)

    Cha, Kexin; Rangsipat, Napat; Serences, John T.

    2015-01-01

    Normative theories posit that value-based decision-making is context independent. However, decisions between two high-value options can be suboptimally biased by the introduction of a third low-value option. This context-dependent modulation is consistent with the divisive normalization of the value of each stimulus by the total value of all stimuli. In addition, an independent line of research demonstrates that pairing a stimulus with a high-value outcome can lead to attentional capture that can mediate the efficiency of visual information processing. Here we tested the hypothesis that value-based attentional capture interacts with value-based normalization to influence the optimality of decision-making. We used a binary-choice paradigm in which observers selected between two targets and the color of each target indicated the magnitude of their reward potential. Observers also had to simultaneously ignore a task-irrelevant distractor rendered in a color that was previously associated with a specific reward magnitude. When the color of the task-irrelevant distractor was previously associated with a high reward, observers responded more slowly and less optimally. Moreover, as the learned value of the distractor increased, electrophysiological data revealed an attenuation of the lateralized N1 and N2Pc responses evoked by the relevant choice stimuli and an attenuation of the late positive deflection (LPD). Collectively, these behavioral and electrophysiological data suggest that value-based attentional capture and value-based normalization jointly mediate the influence of context on free-choice decision-making. PMID:25995350

  4. Rewards boost sustained attention through higher effort: A value-based decision making approach.

    Science.gov (United States)

    Massar, Stijn A A; Lim, Julian; Sasmita, Karen; Chee, Michael W L

    2016-10-01

    Maintaining sustained attention over time is an effortful process limited by finite cognitive resources. Recent theories describe the role of motivation in the allocation of such resources as a decision process: the costs of effortful performance are weighed against its gains. We examined this hypothesis by combining methods from attention research and decision neuroscience. Participants first performed a sustained attention task at different levels of reward. They then performed a reward-discounting task, measuring the subjective costs of performance. Results demonstrated that higher rewards led to improved performance (Exp 1-3), and enhanced attentional effort (i.e. pupil diameter; Exp 2 & 3). Moreover, discounting curves constructed from the choice task indicated that subjects devalued rewards that came at the cost of staying vigilant for a longer duration (Exp 1 & 2). Motivation can thus boost sustained attention through increased effort, while sustained performance is regarded as a cost against which rewards are discounted. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

  5. Perturbations in reward-related decision-making induced by reduced prefrontal cortical GABA transmission: Relevance for psychiatric disorders.

    Science.gov (United States)

    Piantadosi, Patrick T; Khayambashi, Shahin; Schluter, Magdalen G; Kutarna, Agnes; Floresco, Stan B

    2016-02-01

    The prefrontal cortex (PFC) is critical for higher-order cognitive functions, including decision-making. In psychiatric conditions such as schizophrenia, prefrontal dysfunction co-occurs with pronounced alterations in decision-making ability. These alterations include a diminished ability to utilize probabilistic reinforcement in guiding future choice, and a reduced willingness to expend effort to receive reward. Among the neurochemical abnormalities observed in the PFC of individuals with schizophrenia are alterations in the production and function of the inhibitory neurotransmitter gamma-aminobutyric acid (GABA). To probe how PFC GABA hypofunction may contribute to alterations in cost/benefit decision-making, we assessed the effects GABAA-receptor antagonist bicuculline (BIC; 50 ng in 0.5 μl saline/hemisphere) infusion in the medial PFC of rats during performance on a series of well-validated cost/benefit decision-making tasks. Intra-PFC BIC reduced risky choice and reward sensitivity during probabilistic discounting and decreased the preference for larger rewards associated with a greater effort cost, similar to the behavioral sequelae observed in schizophrenia. Additional experiments revealed that these treatments did not alter instrumental responding on a progressive ratio schedule, nor did they impair the ability to discriminate between reward and no reward. However, BIC induced a subtle but consistent impairment in preference for larger vs. smaller rewards of equal cost. BIC infusion also increased decision latencies and impaired the ability to "stay on task" as indexed by reduced rates of instrumental responding. Collectively, these results implicate prefrontal GABAergic dysfunction as a key contributing factor to abnormal decision-making observed in schizophrenia and other neuropsychiatric conditions with similar neurobiological and behavioral alterations. Copyright © 2015 Elsevier Ltd. All rights reserved.

  6. Reward optimization in the primate brain: a probabilistic model of decision making under uncertainty.

    Directory of Open Access Journals (Sweden)

    Yanping Huang

    Full Text Available A key problem in neuroscience is understanding how the brain makes decisions under uncertainty. Important insights have been gained using tasks such as the random dots motion discrimination task in which the subject makes decisions based on noisy stimuli. A descriptive model known as the drift diffusion model has previously been used to explain psychometric and reaction time data from such tasks but to fully explain the data, one is forced to make ad-hoc assumptions such as a time-dependent collapsing decision boundary. We show that such assumptions are unnecessary when decision making is viewed within the framework of partially observable Markov decision processes (POMDPs. We propose an alternative model for decision making based on POMDPs. We show that the motion discrimination task reduces to the problems of (1 computing beliefs (posterior distributions over the unknown direction and motion strength from noisy observations in a bayesian manner, and (2 selecting actions based on these beliefs to maximize the expected sum of future rewards. The resulting optimal policy (belief-to-action mapping is shown to be equivalent to a collapsing decision threshold that governs the switch from evidence accumulation to a discrimination decision. We show that the model accounts for both accuracy and reaction time as a function of stimulus strength as well as different speed-accuracy conditions in the random dots task.

  7. Involvement of cannabinoid system in the nucleus accumbens on delay-based decision making in the rat.

    Science.gov (United States)

    Fatahi, Zahra; Sadeghi, Bahman; Haghparast, Abbas

    2018-01-30

    The nucleus accumbens (NAc) plays a fundamental role in decision making and anticipation of reward. In addition, exogenous cannabinoids affect the behavior of humans and animals including disruption of short-term memory and cognitive impairments. Therefore, in this study, cannabinoid agonist and antagonist were administrated into the NAc to determine the effect of cannabinoid activation in the entire NAc on delay-based decision making. Rats were trained on a cost-benefit T-maze decision making task in which the animals were well-trained to choose between a small/immediate reward and a large/delay reward. After training, the animals were implanted with guide cannulae in the NAc. On test day, they received cannabinoid agonist (Win 55,212-2; 10, 50 and 100μM) and/or antagonist (AM251; 45μM) into the NAc. Percentage of high reward choice and latency of reward achievement were evaluated. Results showed that cannabinoid agonist administration caused a decrease in high reward choice such that rats selected small/immediate reward instead of large/delay reward. Moreover, in agonist-treated animals latency of reward achievement increased. Effects of cannabinoid activation on delay-based decision making with equivalent delays demonstrated that if the delay was equated on both arm goals, animals still had a preference for the high/delay reward, showing the results was not caused by an impairment of spatial preference or memory. These finding clarified that cannabinoid system activation in the entire NAc plays a critical role in the regulation of delay-based decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

  8. Value-based attentional capture influences context-dependent decision-making.

    Science.gov (United States)

    Itthipuripat, Sirawaj; Cha, Kexin; Rangsipat, Napat; Serences, John T

    2015-07-01

    Normative theories posit that value-based decision-making is context independent. However, decisions between two high-value options can be suboptimally biased by the introduction of a third low-value option. This context-dependent modulation is consistent with the divisive normalization of the value of each stimulus by the total value of all stimuli. In addition, an independent line of research demonstrates that pairing a stimulus with a high-value outcome can lead to attentional capture that can mediate the efficiency of visual information processing. Here we tested the hypothesis that value-based attentional capture interacts with value-based normalization to influence the optimality of decision-making. We used a binary-choice paradigm in which observers selected between two targets and the color of each target indicated the magnitude of their reward potential. Observers also had to simultaneously ignore a task-irrelevant distractor rendered in a color that was previously associated with a specific reward magnitude. When the color of the task-irrelevant distractor was previously associated with a high reward, observers responded more slowly and less optimally. Moreover, as the learned value of the distractor increased, electrophysiological data revealed an attenuation of the lateralized N1 and N2Pc responses evoked by the relevant choice stimuli and an attenuation of the late positive deflection (LPD). Collectively, these behavioral and electrophysiological data suggest that value-based attentional capture and value-based normalization jointly mediate the influence of context on free-choice decision-making. Copyright © 2015 the American Physiological Society.

  9. Sensitivity and bias in decision-making under risk: evaluating the perception of reward, its probability and value.

    Directory of Open Access Journals (Sweden)

    Madeleine E Sharp

    Full Text Available BACKGROUND: There are few clinical tools that assess decision-making under risk. Tests that characterize sensitivity and bias in decisions between prospects varying in magnitude and probability of gain may provide insights in conditions with anomalous reward-related behaviour. OBJECTIVE: We designed a simple test of how subjects integrate information about the magnitude and the probability of reward, which can determine discriminative thresholds and choice bias in decisions under risk. DESIGN/METHODS: Twenty subjects were required to choose between two explicitly described prospects, one with higher probability but lower magnitude of reward than the other, with the difference in expected value between the two prospects varying from 3 to 23%. RESULTS: Subjects showed a mean threshold sensitivity of 43% difference in expected value. Regarding choice bias, there was a 'risk premium' of 38%, indicating a tendency to choose higher probability over higher reward. An analysis using prospect theory showed that this risk premium is the predicted outcome of hypothesized non-linearities in the subjective perception of reward value and probability. CONCLUSIONS: This simple test provides a robust measure of discriminative value thresholds and biases in decisions under risk. Prospect theory can also make predictions about decisions when subjective perception of reward or probability is anomalous, as may occur in populations with dopaminergic or striatal dysfunction, such as Parkinson's disease and schizophrenia.

  10. Sensitivity and Bias in Decision-Making under Risk: Evaluating the Perception of Reward, Its Probability and Value

    Science.gov (United States)

    Sharp, Madeleine E.; Viswanathan, Jayalakshmi; Lanyon, Linda J.; Barton, Jason J. S.

    2012-01-01

    Background There are few clinical tools that assess decision-making under risk. Tests that characterize sensitivity and bias in decisions between prospects varying in magnitude and probability of gain may provide insights in conditions with anomalous reward-related behaviour. Objective We designed a simple test of how subjects integrate information about the magnitude and the probability of reward, which can determine discriminative thresholds and choice bias in decisions under risk. Design/Methods Twenty subjects were required to choose between two explicitly described prospects, one with higher probability but lower magnitude of reward than the other, with the difference in expected value between the two prospects varying from 3 to 23%. Results Subjects showed a mean threshold sensitivity of 43% difference in expected value. Regarding choice bias, there was a ‘risk premium’ of 38%, indicating a tendency to choose higher probability over higher reward. An analysis using prospect theory showed that this risk premium is the predicted outcome of hypothesized non-linearities in the subjective perception of reward value and probability. Conclusions This simple test provides a robust measure of discriminative value thresholds and biases in decisions under risk. Prospect theory can also make predictions about decisions when subjective perception of reward or probability is anomalous, as may occur in populations with dopaminergic or striatal dysfunction, such as Parkinson's disease and schizophrenia. PMID:22493669

  11. Deep brain stimulation of the subthalamic nucleus improves reward-based decision-learning in Parkinson's disease

    NARCIS (Netherlands)

    van Wouwe, N.C.; Ridderinkhof, K.R.; van den Wildenberg, W.P.M.; Band, G.P.H.; Abisogun, A.; Elias, W.J.; Frysinger, R.; Wylie, S.A.

    2011-01-01

    Recently, the subthalamic nucleus (STN) has been shown to be critically involved in decision-making, action selection, and motor control. Here we investigate the effect of deep brain stimulation (DBS) of the STN on reward-based decision-learning in patients diagnosed with Parkinson's disease (PD).

  12. Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward?

    Science.gov (United States)

    Bechara, Antoine; Dolan, Sara; Hindes, Andrea

    2002-01-01

    On a decision-making instrument known as the "gambling task" (GT), a subgroup of substance dependent individuals (SDI) opted for choices that yield high immediate gains in spite of higher future losses. This resembles the behavior of patients with ventromedial (VM) prefrontal cortex lesions. In this study, we addressed the possibility that hypersensitivity to reward may account for the "myopia" for the future in this subgroup of SDI. We used a variant version of the GT, in which the good decks yielded high immediate punishment but higher delayed reward. The bad decks yielded low immediate punishment and lower delayed reward. We measured the skin conductance response (SCR) of subjects after receiving reward (reward SCR) and during their pondering from which deck to choose (anticipatory SCR). A subgroup of SDI who was not impaired on the original GT performed normally on the variant GT. The subgroup of SDI who was impaired on the original GT showed two levels of performance on the variant GT. One subgroup (36% of the sample) performed poorly on the variant GT, and showed similar behavioral and physiological impairments to VM patients. The other subgroup of SDI (64% of the sample) performed normally on the variant task, but had abnormally large physiological responses to reward, i.e. large SCR after receiving reward (reward SCR) and large SCR in anticipation of outcomes that yield large reward. Thus, the combined cognitive and physiological approach of assessing decision-making characterizes three sub-populations of SDI. One sub-population is without impairments that can be detected by any measure of the GT paradigm. Another sub-population is similar to VM patients in that they are insensitive to the future, both positive and negative. A third sub-population is hypersensitive to reward, so that the presence or the prospect of receiving, reward dominates their behavior.

  13. An ecologically based model of alcohol-consumption decision making: evidence for the discriminative and predictive role of contextual reward and punishment information.

    Science.gov (United States)

    Bogg, Tim; Finn, Peter R

    2009-05-01

    Using insights from Ecological Systems Theory and Reinforcement Sensitivity Theory, the current study assessed the utility of a series of hypothetical role-based alcohol-consumption scenarios that varied in their presentation of rewarding and punishing information. The scenarios, along with measures of impulsive sensation seeking and a self-report of weekly alcohol consumption, were administered to a sample of alcohol-dependent and non-alcohol-dependent college-age individuals (N = 170). The results showed scenario attendance decisions were largely unaffected by alcohol-dependence status and variations in contextual reward and punishment information. In contrast to the attendance findings, the results for the alcohol-consumption decisions showed alcohol-dependent individuals reported a greater frequency of deciding to drink, as well as indicating greater alcohol consumption in the contexts of complementary rewarding or nonpunishing information. Regression results provided evidence for the criterion-related validity of scenario outcomes in an account of diagnostic alcohol problems. The results are discussed in terms of the conceptual and predictive gains associated with an assessment approach to alcohol-consumption decision making that combines situational information organized and balanced through the frameworks of Ecological Systems Theory and Reinforcement Sensitivity Theory.

  14. The Impact of Corporate Culture, the Reward System, and Perceived Moral Intensity on Marketing Students' Ethical Decision Making

    Science.gov (United States)

    Nill, Alexander; Schibrowsky, John A.

    2005-01-01

    An experiment was conducted to study how marketing students' ethical decision making was influenced by their perceived moral intensity (PMI), corporate culture, and the reward system. The findings indicate that levels of awareness of the ethical consequences of a decision, the corporate culture, and the reward system all significantly affect…

  15. Effects of Emotion on Prospection During Decision-Making

    Directory of Open Access Journals (Sweden)

    Darrell A. Worthy

    2014-06-01

    Full Text Available In two experiments we examined the role of emotion, specifically worry, anxiety and mood, on prospection during decision-making. Worry is a particularly relevant emotion to study in the context of prospection because high levels of worry may make individuals more aversive toward the uncertainty associated with the prospect of obtaining future improvements in rewards or states. Thus, high levels of worry might lead to reduced prospection during decision-making and enhance preference for immediate over delayed rewards. In Experiment 1 participants performed a two-choice dynamic decision-making task where they were required to choose between one option (the decreasing option which provided larger immediate rewards but declines in future states, and another option (the increasing option which provided smaller immediate rewards but improvements in future states, making it the optimal choice. High levels of worry were associated with poorer performance in the task. Additionally, fits of a sophisticated reinforcement-learning model that incorporated both reward-based and state-based information suggested that individuals reporting high levels of worry gave greater weight to the immediate rewards they would receive on each trial than to the degree to which each action would lead to improvements in their future state. In Experiment 2 we found that high levels of worry were associated with greater delay discounting using a standard delay discounting task. Combined, the results suggest that high levels of worry are associated with reduced prospection during decision-making. We attribute these results to high worriers’ aversion toward the greater uncertainty associated with attempting to improve future rewards than to maximize immediate reward. These results have implications for researchers interested in the effects of emotion on cognition, and suggest that emotion strongly affects the focus on temporal outcomes during decision-making.

  16. Effects of emotion on prospection during decision-making.

    Science.gov (United States)

    Worthy, Darrell A; Byrne, Kaileigh A; Fields, Sherecce

    2014-01-01

    In two experiments we examined the role of emotion, specifically worry, anxiety, and mood, on prospection during decision-making. Worry is a particularly relevant emotion to study in the context of prospection because high levels of worry may make individuals more aversive toward the uncertainty associated with the prospect of obtaining future improvements in rewards or states. Thus, high levels of worry might lead to reduced prospection during decision-making and enhance preference for immediate over delayed rewards. In Experiment 1 participants performed a two-choice dynamic decision-making task where they were required to choose between one option (the decreasing option) which provided larger immediate rewards but declines in future states, and another option (the increasing option) which provided smaller immediate rewards but improvements in future states, making it the optimal choice. High levels of worry were associated with poorer performance in the task. Additionally, fits of a sophisticated reinforcement-learning model that incorporated both reward-based and state-based information suggested that individuals reporting high levels of worry gave greater weight to the immediate rewards they would receive on each trial than to the degree to which each action would lead to improvements in their future state. In Experiment 2 we found that high levels of worry were associated with greater delay discounting using a standard delay discounting task. Combined, the results suggest that high levels of worry are associated with reduced prospection during decision-making. We attribute these results to high worriers' aversion toward the greater uncertainty associated with attempting to improve future rewards than to maximize immediate reward. These results have implications for researchers interested in the effects of emotion on cognition, and suggest that emotion strongly affects the focus on temporal outcomes during decision-making.

  17. Distinct effects of apathy and dopamine on effort-based decision-making in Parkinson's disease.

    Science.gov (United States)

    Le Heron, Campbell; Plant, Olivia; Manohar, Sanjay; Ang, Yuen-Siang; Jackson, Matthew; Lennox, Graham; Hu, Michele T; Husain, Masud

    2018-05-01

    Effort-based decision-making is a cognitive process crucial to normal motivated behaviour. Apathy is a common and disabling complication of Parkinson's disease, but its aetiology remains unclear. Intriguingly, the neural substrates associated with apathy also subserve effort-based decision-making in animal models and humans. Furthermore, the dopaminergic system plays a core role in motivating effortful behaviour for reward, and its dysfunction has been proposed to play a crucial role in the aetiology of apathy in Parkinson's disease. We hypothesized that disrupted effort-based decision-making underlies the syndrome of apathy in Parkinson's disease, and that this disruption may be modulated by the dopaminergic system. An effort-based decision-making task was administered to 39 patients with Parkinson's disease, with and without clinical apathy, ON and OFF their normal dopaminergic medications across two separate sessions, as well as 32 healthy age- and gender-matched controls. On a trial-by-trial basis, participants decided whether to accept or reject offers of monetary reward in return for exerting different levels of physical effort via handheld, individually calibrated dynamometers. Effort and reward were manipulated independently, such that offers spanned the full range of effort/reward combinations. Apathy was assessed using the Lille apathy rating scale. Motor effects of the dopamine manipulation were assessed using the Unified Parkinson's Disease Rating Scale part three motor score. The primary outcome variable was choice (accept/decline offer) analysed using a hierarchical generalized linear mixed effects model, and the vigour of squeeze (Newtons exerted above required force). Both apathy and dopamine depletion were associated with reduced acceptance of offers. However, these effects were driven by dissociable patterns of responding. While apathy was characterized by increased rejection of predominantly low reward offers, dopamine increased responding to

  18. Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans.

    Directory of Open Access Journals (Sweden)

    Aaron M Bornstein

    Full Text Available How do we use our memories of the past to guide decisions we've never had to make before? Although extensive work describes how the brain learns to repeat rewarded actions, decisions can also be influenced by associations between stimuli or events not directly involving reward - such as when planning routes using a cognitive map or chess moves using predicted countermoves - and these sorts of associations are critical when deciding among novel options. This process is known as model-based decision making. While the learning of environmental relations that might support model-based decisions is well studied, and separately this sort of information has been inferred to impact decisions, there is little evidence concerning the full cycle by which such associations are acquired and drive choices. Of particular interest is whether decisions are directly supported by the same mnemonic systems characterized for relational learning more generally, or instead rely on other, specialized representations. Here, building on our previous work, which isolated dual representations underlying sequential predictive learning, we directly demonstrate that one such representation, encoded by the hippocampal memory system and adjacent cortical structures, supports goal-directed decisions. Using interleaved learning and decision tasks, we monitor predictive learning directly and also trace its influence on decisions for reward. We quantitatively compare the learning processes underlying multiple behavioral and fMRI observables using computational model fits. Across both tasks, a quantitatively consistent learning process explains reaction times, choices, and both expectation- and surprise-related neural activity. The same hippocampal and ventral stream regions engaged in anticipating stimuli during learning are also engaged in proportion to the difficulty of decisions. These results support a role for predictive associations learned by the hippocampal memory system to

  19. Deep brain stimulation of the subthalamic nucleus improves reward-based decision-learning in Parkinson’s disease

    NARCIS (Netherlands)

    Wouwe, N.C. van; Ridderinkhof, K.R.; Wildenberg, W.P.M. van den; Band, G.P.H.; Abisogun, A.; Elias, W.J.; Frysinger, R.; Wylie, S.A.

    2011-01-01

    Recently, the subthalamic nucleus (STN) has been shown to be critically involved in decision-making, action selection, and motor control. Here we investigate the effect of deep brain stimulation (DBS) of the STN on reward-based decision-learning in patients diagnosed with Parkinson’s disease (PD).

  20. Motivational states influence effort-based decision making in rats: the role of dopamine in the nucleus accumbens.

    Science.gov (United States)

    Mai, Bettina; Sommer, Susanne; Hauber, Wolfgang

    2012-03-01

    Decision-making policies are subject to modulation by changing motivational states. However, so far, little is known about the neurochemical mechanisms that bridge motivational states with decision making. Here we examined whether dopamine (DA) in the nucleus accumbens core (AcbC) modulates the effects of motivational states on effort-based decision making. Using a cost-benefit T-maze task in rats, we examined the effects of AcbC DA depletions on effort-based decision making, in particular on the sensitivity of effort-based decision making to a shift from a hungry to a sated state. The results demonstrated that, relative to sham controls, rats with AcbC DA depletion in a hungry as well as in a sated state had a reduced preference for effortful but large-reward action. This finding provides further support for the notion that AcbC DA regulates how much effort to invest for rewards. Importantly, our results further revealed that effort-based decision making in lesioned rats, as in sham controls, was still sensitive to a shift from a hungry to a sated state; that is, their preferences for effortful large-reward actions became lower after a shift from a restricted to a free-feeding regimen. These finding indicate that AcbC DA is not necessarily involved in mediating the effects of a shift in motivational state on decision-making policies.

  1. Vicarious Effort-Based Decision-Making in Autism Spectrum Disorders

    Science.gov (United States)

    Mosner, Maya G.; Kinard, Jessica L.; McWeeny, Sean; Shah, Jasmine S.; Markiewitz, Nathan D.; Damiano-Goodwin, Cara R.; Burchinal, Margaret R.; Rutherford, Helena J. V.; Greene, Rachel K.; Treadway, Michael T.; Dichter, Gabriel S.

    2017-01-01

    This study investigated vicarious effort-based decision-making in 50 adolescents with autism spectrum disorders (ASD) compared to 32 controls using the Effort Expenditure for Rewards Task. Participants made choices to win money for themselves or for another person. When choosing for themselves, the ASD group exhibited relatively similar patterns…

  2. Dysfunctional involvement of emotion and reward brain regions on social decision making in excess weight adolescents.

    Science.gov (United States)

    Verdejo-García, Antonio; Verdejo-Román, Juan; Rio-Valle, Jacqueline S; Lacomba, Juan A; Lagos, Francisco M; Soriano-Mas, Carles

    2015-01-01

    Obese adolescents suffer negative social experiences, but no studies have examined whether obesity is associated with dysfunction of the social brain or whether social brain abnormalities relate to disadvantageous traits and social decisions. We aimed at mapping functional activation differences in the brain circuitry of social decision making in adolescents with excess versus normal weight, and at examining whether these separate patterns correlate with reward/punishment sensitivity, disordered eating features, and behavioral decisions. In this fMRI study, 80 adolescents aged 12 to 18 years old were classified in two groups based on age adjusted body mass index (BMI) percentiles: normal weight (n = 44, BMI percentiles 5th-84th) and excess weight (n = 36, BMI percentile ≥ 85th). Participants were scanned while performing a social decision-making task (ultimatum game) in which they chose to "accept" or "reject" offers to split monetary stakes made by another peer. Offers varied in fairness (Fair vs. Unfair) but in all cases "accepting" meant both players win the money, whereas "rejecting" meant both lose it. We showed that adolescents with excess weight compared to controls display significantly decreased activation of anterior insula, anterior cingulate, and midbrain during decisions about Unfair versus Fair offers. Moreover, excess weight subjects show lower sensitivity to reward and more maturity fears, which correlate with insula activation. Indeed, blunted insula activation accounted for the relationship between maturity fears and acceptance of unfair offers. Excess weight adolescents have diminished activation of brain regions essential for affective tracking of social decision making, which accounts for the association between maturity fears and social decisions. © 2014 Wiley Periodicals, Inc.

  3. Decision Making in the Reward and Punishment Variants of the Iowa Gambling Task: Evidence of “Foresight” or “Framing”?

    OpenAIRE

    Singh, Varsha; Khan, Azizuddin

    2012-01-01

    Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision m...

  4. Motivational deficits in effort-based decision making in individuals with subsyndromal depression, first-episode and remitted depression patients.

    Science.gov (United States)

    Yang, Xin-Hua; Huang, Jia; Zhu, Cui-Ying; Wang, Ye-Fei; Cheung, Eric F C; Chan, Raymond C K; Xie, Guang-Rong

    2014-12-30

    Anhedonia is a hallmark symptom of major depressive disorder (MDD). Preliminary findings suggest that anhedonia is characterized by reduced reward anticipation and motivation of obtaining reward. However, relatively little is known about reward-based decision-making in depression. We tested the hypothesis that anhedonia in MDD may reflect specific impairments in motivation on reward-based decision-making and the deficits might be associated with depressive symptoms severity. In study 1, individuals with and without depressive symptoms performed the modified version of the Effort Expenditure for Rewards Task (EEfRT), a behavioral measure of cost/benefit decision-making. In study 2, MDD patients, remitted MDD patients and healthy controls were recruited for the same procedures. We found evidence for decreased willingness to make effort for rewards among individuals with subsyndromal depression; the effect was amplified in MDD patients, but dissipated in patients with remitted depression. We also found that reduced anticipatory and consummatory pleasure predicted decreased willingness to expend efforts to obtain rewards in MDD patients. For individuals with subsyndromal depression, the impairments were correlated with anticipatory anhedonia but not consummatory anhedonia. These data offer novel evidence that motivational deficits in MDD are correlated with depression severity and predicted by self-reported anhedonia. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  5. State-based versus reward-based motivation in younger and older adults.

    Science.gov (United States)

    Worthy, Darrell A; Cooper, Jessica A; Byrne, Kaileigh A; Gorlick, Marissa A; Maddox, W Todd

    2014-12-01

    Recent decision-making work has focused on a distinction between a habitual, model-free neural system that is motivated toward actions that lead directly to reward and a more computationally demanding goal-directed, model-based system that is motivated toward actions that improve one's future state. In this article, we examine how aging affects motivation toward reward-based versus state-based decision making. Participants performed tasks in which one type of option provided larger immediate rewards but the alternative type of option led to larger rewards on future trials, or improvements in state. We predicted that older adults would show a reduced preference for choices that led to improvements in state and a greater preference for choices that maximized immediate reward. We also predicted that fits from a hybrid reinforcement-learning model would indicate greater model-based strategy use in younger than in older adults. In line with these predictions, older adults selected the options that maximized reward more often than did younger adults in three of the four tasks, and modeling results suggested reduced model-based strategy use. In the task where older adults showed similar behavior to younger adults, our model-fitting results suggested that this was due to the utilization of a win-stay-lose-shift heuristic rather than a more complex model-based strategy. Additionally, within older adults, we found that model-based strategy use was positively correlated with memory measures from our neuropsychological test battery. We suggest that this shift from state-based to reward-based motivation may be due to age related declines in the neural structures needed for more computationally demanding model-based decision making.

  6. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Science.gov (United States)

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  7. AN EXTENDED REINFORCEMENT LEARNING MODEL OF BASAL GANGLIA TO UNDERSTAND THE CONTRIBUTIONS OF SEROTONIN AND DOPAMINE IN RISK-BASED DECISION MAKING, REWARD PREDICTION, AND PUNISHMENT LEARNING

    Directory of Open Access Journals (Sweden)

    Pragathi Priyadharsini Balasubramani

    2014-04-01

    Full Text Available Although empirical and neural studies show that serotonin (5HT plays many functional roles in the brain, prior computational models mostly focus on its role in behavioral inhibition. In this study, we present a model of risk based decision making in a modified Reinforcement Learning (RL-framework. The model depicts the roles of dopamine (DA and serotonin (5HT in Basal Ganglia (BG. In this model, the DA signal is represented by the temporal difference error (δ, while the 5HT signal is represented by a parameter (α that controls risk prediction error. This formulation that accommodates both 5HT and DA reconciles some of the diverse roles of 5HT particularly in connection with the BG system. We apply the model to different experimental paradigms used to study the role of 5HT: 1 Risk-sensitive decision making, where 5HT controls risk assessment, 2 Temporal reward prediction, where 5HT controls time-scale of reward prediction, and 3 Reward/Punishment sensitivity, in which the punishment prediction error depends on 5HT levels. Thus the proposed integrated RL model reconciles several existing theories of 5HT and DA in the BG.

  8. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Directory of Open Access Journals (Sweden)

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  9. Learning to maximize reward rate: a model based on semi-Markov decision processes.

    Science.gov (United States)

    Khodadadi, Arash; Fakhari, Pegah; Busemeyer, Jerome R

    2014-01-01

    WHEN ANIMALS HAVE TO MAKE A NUMBER OF DECISIONS DURING A LIMITED TIME INTERVAL, THEY FACE A FUNDAMENTAL PROBLEM: how much time they should spend on each decision in order to achieve the maximum possible total outcome. Deliberating more on one decision usually leads to more outcome but less time will remain for other decisions. In the framework of sequential sampling models, the question is how animals learn to set their decision threshold such that the total expected outcome achieved during a limited time is maximized. The aim of this paper is to provide a theoretical framework for answering this question. To this end, we consider an experimental design in which each trial can come from one of the several possible "conditions." A condition specifies the difficulty of the trial, the reward, the penalty and so on. We show that to maximize the expected reward during a limited time, the subject should set a separate value of decision threshold for each condition. We propose a model of learning the optimal value of decision thresholds based on the theory of semi-Markov decision processes (SMDP). In our model, the experimental environment is modeled as an SMDP with each "condition" being a "state" and the value of decision thresholds being the "actions" taken in those states. The problem of finding the optimal decision thresholds then is cast as the stochastic optimal control problem of taking actions in each state in the corresponding SMDP such that the average reward rate is maximized. Our model utilizes a biologically plausible learning algorithm to solve this problem. The simulation results show that at the beginning of learning the model choses high values of decision threshold which lead to sub-optimal performance. With experience, however, the model learns to lower the value of decision thresholds till finally it finds the optimal values.

  10. Effort-Based Decision Making in Schizophrenia: Evaluation of Paradigms to Measure Motivational Deficits.

    Science.gov (United States)

    Green, Michael F; Horan, William P

    2015-09-01

    Effort-based decision making requires one to decide how much effort to expend for a certain amount of reward. As the amount of reward goes up most people are willing to exert more effort. This relationship between reward level and effort expenditure can be measured in specialized performance-based tasks that have only recently been applied to schizophrenia. Such tasks provide a way to measure objectively motivational deficits in schizophrenia, which now are only assessed with clinical interviews of negative symptoms. The articles in this theme provide reviews of the relevant animal and human literatures (first 2 articles), and then a psychometric evaluation of 5 effort-based decision making paradigms (last 2 articles). This theme section is intended to stimulate interest in this emerging area among basic scientists developing paradigms for preclinical studies, human experimentalists trying to disentangle factors that contribute to performance on effort-based tasks, and investigators looking for objective endpoints for clinical trials of negative symptoms in schizophrenia. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

  11. The neural basis of decision-making and reward processing in adults with euthymic bipolar disorder or attention-deficit/hyperactivity disorder (ADHD.

    Directory of Open Access Journals (Sweden)

    Agustin Ibanez

    Full Text Available BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD and bipolar disorder (BD share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. METHODOLOGY/PRINCIPAL FINDINGS: We used the Iowa gambling task (IGT, a task of rational decision-making under risk (RDMUR and a rapid-decision gambling task (RDGT which elicits behavioral measures as well as event-related potentials (ERPs: fERN and P3 in connection to the motivational impact of events. We did not observe between-group differences for decision-making under risk or ambiguity (RDMUR and IGT; however, there were significant differences for the ERP-assessed RDGT. Compared to controls, the ADHD group showed a pattern of impaired learning by feedback (fERN and insensitivity to reward magnitude (P3. This ERP pattern (fERN and P3 was associated with impulsivity, hyperactivity, executive function and working memory. Compared to controls, the BD group showed fERN- and P3-enhanced responses to reward magnitude regardless of valence. This ERP pattern (fERN and P3 was associated with mood and inhibitory control. Consistent with the ERP findings, an analysis of source location revealed reduced responses of the cingulate cortex to the valence and magnitude of rewards in patients with ADHD and BD. CONCLUSIONS/SIGNIFICANCE: Our data suggest that neurophysiological (ERPs paradigms such as the RDGT are well suited to assess subclinical decision-making processes in patients with ADHD and BD as well as for linking the cingulate cortex with action monitoring systems.

  12. The neural basis of decision-making and reward processing in adults with euthymic bipolar disorder or attention-deficit/hyperactivity disorder (ADHD).

    Science.gov (United States)

    Ibanez, Agustin; Cetkovich, Marcelo; Petroni, Agustin; Urquina, Hugo; Baez, Sandra; Gonzalez-Gadea, Maria Luz; Kamienkowski, Juan Esteban; Torralva, Teresa; Torrente, Fernando; Strejilevich, Sergio; Teitelbaum, Julia; Hurtado, Esteban; Guex, Raphael; Melloni, Margherita; Lischinsky, Alicia; Sigman, Mariano; Manes, Facundo

    2012-01-01

    Attention-deficit/hyperactivity disorder (ADHD) and bipolar disorder (BD) share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. We used the Iowa gambling task (IGT), a task of rational decision-making under risk (RDMUR) and a rapid-decision gambling task (RDGT) which elicits behavioral measures as well as event-related potentials (ERPs: fERN and P3) in connection to the motivational impact of events. We did not observe between-group differences for decision-making under risk or ambiguity (RDMUR and IGT); however, there were significant differences for the ERP-assessed RDGT. Compared to controls, the ADHD group showed a pattern of impaired learning by feedback (fERN) and insensitivity to reward magnitude (P3). This ERP pattern (fERN and P3) was associated with impulsivity, hyperactivity, executive function and working memory. Compared to controls, the BD group showed fERN- and P3-enhanced responses to reward magnitude regardless of valence. This ERP pattern (fERN and P3) was associated with mood and inhibitory control. Consistent with the ERP findings, an analysis of source location revealed reduced responses of the cingulate cortex to the valence and magnitude of rewards in patients with ADHD and BD. Our data suggest that neurophysiological (ERPs) paradigms such as the RDGT are well suited to assess subclinical decision-making processes in patients with ADHD and BD as well as for linking the cingulate cortex with action monitoring systems.

  13. Goal-Directed Decision Making with Spiking Neurons.

    Science.gov (United States)

    Friedrich, Johannes; Lengyel, Máté

    2016-02-03

    Behavioral and neuroscientific data on reward-based decision making point to a fundamental distinction between habitual and goal-directed action selection. The formation of habits, which requires simple updating of cached values, has been studied in great detail, and the reward prediction error theory of dopamine function has enjoyed prominent success in accounting for its neural bases. In contrast, the neural circuit mechanisms of goal-directed decision making, requiring extended iterative computations to estimate values online, are still unknown. Here we present a spiking neural network that provably solves the difficult online value estimation problem underlying goal-directed decision making in a near-optimal way and reproduces behavioral as well as neurophysiological experimental data on tasks ranging from simple binary choice to sequential decision making. Our model uses local plasticity rules to learn the synaptic weights of a simple neural network to achieve optimal performance and solves one-step decision-making tasks, commonly considered in neuroeconomics, as well as more challenging sequential decision-making tasks within 1 s. These decision times, and their parametric dependence on task parameters, as well as the final choice probabilities match behavioral data, whereas the evolution of neural activities in the network closely mimics neural responses recorded in frontal cortices during the execution of such tasks. Our theory provides a principled framework to understand the neural underpinning of goal-directed decision making and makes novel predictions for sequential decision-making tasks with multiple rewards. Goal-directed actions requiring prospective planning pervade decision making, but their circuit-level mechanisms remain elusive. We show how a model circuit of biologically realistic spiking neurons can solve this computationally challenging problem in a novel way. The synaptic weights of our network can be learned using local plasticity rules

  14. Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards

    Science.gov (United States)

    O'Hora, Denis; Carey, Rachel; Kervick, Aoife; Crowley, David; Dabrowski, Maciej

    2016-02-01

    People tend to discount rewards or losses that occur in the future. Such delay discounting has been linked to many behavioral and health problems, since people choose smaller short-term gains over greater long-term gains. We investigated whether the effect of delays on the subjective value of rewards is expressed in how people move when they make choices. Over 600 patrons of the RISK LAB exhibition hosted by the Science Gallery DublinTM played a short computer game in which they used a computer mouse to choose between amounts of money at various delays. Typical discounting effects were observed and decision dynamics indicated that choosing smaller short-term rewards became easier (i.e., shorter response times, tighter trajectories, less vacillation) as the delays until later rewards increased. Based on a sequence of choices, subjective values of delayed outcomes were estimated and decision dynamics during initial choices predicted these values. Decision dynamics are affected by subjective values of available options and thus provide a means to estimate such values.

  15. Continuous track paths reveal additive evidence integration in multistep decision making.

    Science.gov (United States)

    Buc Calderon, Cristian; Dewulf, Myrtille; Gevers, Wim; Verguts, Tom

    2017-10-03

    Multistep decision making pervades daily life, but its underlying mechanisms remain obscure. We distinguish four prominent models of multistep decision making, namely serial stage, hierarchical evidence integration, hierarchical leaky competing accumulation (HLCA), and probabilistic evidence integration (PEI). To empirically disentangle these models, we design a two-step reward-based decision paradigm and implement it in a reaching task experiment. In a first step, participants choose between two potential upcoming choices, each associated with two rewards. In a second step, participants choose between the two rewards selected in the first step. Strikingly, as predicted by the HLCA and PEI models, the first-step decision dynamics were initially biased toward the choice representing the highest sum/mean before being redirected toward the choice representing the maximal reward (i.e., initial dip). Only HLCA and PEI predicted this initial dip, suggesting that first-step decision dynamics depend on additive integration of competing second-step choices. Our data suggest that potential future outcomes are progressively unraveled during multistep decision making.

  16. Effects of pulvinar inactivation on spatial decision-making between equal and asymmetric reward options.

    Science.gov (United States)

    Wilke, Melanie; Kagan, Igor; Andersen, Richard A

    2013-08-01

    The ability to selectively process visual inputs and to decide between multiple movement options in an adaptive manner is critical for survival. Such decisions are known to be influenced by factors such as reward expectation and visual saliency. The dorsal pulvinar connects to a multitude of cortical areas that are involved in visuospatial memory and integrate information about upcoming eye movements with expected reward values. However, it is unclear whether the dorsal pulvinar is critically involved in spatial memory and reward-based oculomotor decision behavior. To examine this, we reversibly inactivated the dorsal portion of the pulvinar while monkeys performed a delayed memory saccade task that included choices between equally or unequally rewarded options. Pulvinar inactivation resulted in a delay of saccade initiation toward memorized contralesional targets but did not affect spatial memory. Furthermore, pulvinar inactivation caused a pronounced choice bias toward the ipsilesional hemifield when the reward value in the two hemifields was equal. However, this choice bias could be alleviated by placing a high reward target into the contralesional hemifield. The bias was less affected by the manipulation of relative visual saliency between the two competing targets. These results suggest that the dorsal pulvinar is involved in determining the behavioral desirability of movement goals while being less critical for spatial memory and reward processing.

  17. Reward-dependent learning in neuronal networks for planning and decision making.

    Science.gov (United States)

    Dehaene, S; Changeux, J P

    2000-01-01

    Neuronal network models have been proposed for the organization of evaluation and decision processes in prefrontal circuitry and their putative neuronal and molecular bases. The models all include an implementation and simulation of an elementary reward mechanism. Their central hypothesis is that tentative rules of behavior, which are coded by clusters of active neurons in prefrontal cortex, are selected or rejected based on an evaluation by this reward signal, which may be conveyed, for instance, by the mesencephalic dopaminergic neurons with which the prefrontal cortex is densely interconnected. At the molecular level, the reward signal is postulated to be a neurotransmitter such as dopamine, which exerts a global modulatory action on prefrontal synaptic efficacies, either via volume transmission or via targeted synaptic triads. Negative reinforcement has the effect of destabilizing the currently active rule-coding clusters; subsequently, spontaneous activity varies again from one cluster to another, giving the organism the chance to discover and learn a new rule. Thus, reward signals function as effective selection signals that either maintain or suppress currently active prefrontal representations as a function of their current adequacy. Simulations of this variation-selection have successfully accounted for the main features of several major tasks that depend on prefrontal cortex integrity, such as the delayed-response test, the Wisconsin card sorting test, the Tower of London test and the Stroop test. For the more complex tasks, we have found it necessary to supplement the external reward input with a second mechanism that supplies an internal reward; it consists of an auto-evaluation loop which short-circuits the reward input from the exterior. This allows for an internal evaluation of covert motor intentions without actualizing them as behaviors, by simply testing them covertly by comparison with memorized former experiences. This element of architecture

  18. Rodent models of adaptive decision making.

    Science.gov (United States)

    Izquierdo, Alicia; Belcher, Annabelle M

    2012-01-01

    Adaptive decision making affords the animal the ability to respond quickly to changes in a dynamic environment: one in which attentional demands, cost or effort to procure the reward, and reward contingencies change frequently. The more flexible the organism is in adapting choice behavior, the more command and success the organism has in navigating its environment. Maladaptive decision making is at the heart of much neuropsychiatric disease, including addiction. Thus, a better understanding of the mechanisms that underlie normal, adaptive decision making helps achieve a better understanding of certain diseases that incorporate maladaptive decision making as a core feature. This chapter presents three general domains of methods that the experimenter can manipulate in animal decision-making tasks: attention, effort, and reward contingency. Here, we present detailed methods of rodent tasks frequently employed within these domains: the Attentional Set-Shift Task, Effortful T-maze Task, and Visual Discrimination Reversal Learning. These tasks all recruit regions within the frontal cortex and the striatum, and performance is heavily modulated by the neurotransmitter dopamine, making these assays highly valid measures in the study of psychostimulant addiction.

  19. Emotion-based decision-making in healthy subjects: short-term effects of reducing dopamine levels.

    Science.gov (United States)

    Sevy, Serge; Hassoun, Youssef; Bechara, Antoine; Yechiam, Eldad; Napolitano, Barbara; Burdick, Katherine; Delman, Howard; Malhotra, Anil

    2006-10-01

    Converging evidences from animal and human studies suggest that addiction is associated with dopaminergic dysfunction in brain reward circuits. So far, it is unclear what aspects of addictive behaviors are related to a dopaminergic dysfunction. We hypothesize that a decrease in dopaminergic activity impairs emotion-based decision-making. To demonstrate this hypothesis, we investigated the effects of a decrease in dopaminergic activity on the performance of an emotion-based decision-making task, the Iowa gambling task (IGT), in 11 healthy human subjects. We used a double-blind, placebo-controlled, within-subject design to examine the effect of a mixture containing the branched-chain amino acids (BCAA) valine, isoleucine and leucine on prolactin, IGT performance, perceptual competency and visual aspects of visuospatial working memory, visual attention and working memory, and verbal memory. The expectancy-valence model was used to determine the relative contributions of distinct IGT components (attention to past outcomes, relative weight of wins and losses, and choice strategies) in the decision-making process. Compared to placebo, the BCAA mixture increased prolactin levels and impaired IGT performance. BCAA administration interfered with a particular component process of decision-making related to attention to more recent events as compared to more distant events. There were no differences between placebo and BCAA conditions for other aspects of cognition. Our results suggest a direct link between a reduced dopaminergic activity and poor emotion-based decision-making characterized by shortsightedness, and thus difficulties resisting short-term reward, despite long-term negative consequences. These findings have implications for behavioral and pharmacological interventions targeting impaired emotion-based decision-making in addictive disorders.

  20. A general theory of intertemporal decision-making and the perception of time

    Directory of Open Access Journals (Sweden)

    Vijay Mohan eK Namboodiri

    2014-02-01

    Full Text Available Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier versus later rewards (intertemporal decision-making is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory—Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR—that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval—over which experienced reward rate is estimated—as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the nonlinearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception.

  1. A general theory of intertemporal decision-making and the perception of time.

    Science.gov (United States)

    Namboodiri, Vijay M K; Mihalas, Stefan; Marton, Tanya M; Hussain Shuler, Marshall G

    2014-01-01

    Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory-Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)-that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval-over which experienced reward rate is estimated-as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception.

  2. Decision-making in social contexts in youth with ADHD

    NARCIS (Netherlands)

    Ma, I.; Lambregts-Rommelse, N.N.J.; Buitelaar, J.K.; Cillessen, A.H.N.; Scheres, A.P.J.

    2017-01-01

    This study examined reward-related decision-making in children and adolescents with ADHD in a social context, using economic games. We furthermore examined the role of individual differences in reward-related decision-making, specifically, the roles of reward sensitivity and prosocial skills.

  3. The role of cognitive effort in subjective reward devaluation and risky decision-making.

    Science.gov (United States)

    Apps, Matthew A J; Grima, Laura L; Manohar, Sanjay; Husain, Masud

    2015-11-20

    Motivation is underpinned by cost-benefit valuations where costs-such as physical effort or outcome risk-are subjectively weighed against available rewards. However, in many environments risks pertain not to the variance of outcomes, but to variance in the possible levels of effort required to obtain rewards (effort risks). Moreover, motivation is often guided by the extent to which cognitive-not physical-effort devalues rewards (effort discounting). Yet, very little is known about the mechanisms that underpin the influence of cognitive effort risks or discounting on motivation. We used two cost-benefit decision-making tasks to probe subjective sensitivity to cognitive effort (number of shifts of spatial attention) and to effort risks. Our results show that shifts of spatial attention when monitoring rapidly presented visual stimuli are perceived as effortful and devalue rewards. Additionally, most people are risk-averse, preferring safe, known amounts of effort over risky offers. However, there was no correlation between their effort and risk sensitivity. We show for the first time that people are averse to variance in the possible amount of cognitive effort to be exerted. These results suggest that cognitive effort sensitivity and risk sensitivity are underpinned by distinct psychological and neurobiological mechanisms.

  4. Social anxiety, acute social stress, and reward parameters interact to predict risky decision-making among adolescents.

    Science.gov (United States)

    Richards, Jessica M; Patel, Nilam; Daniele-Zegarelli, Teresa; MacPherson, Laura; Lejuez, C W; Ernst, Monique

    2015-01-01

    Risk-taking behavior increases during adolescence, leading to potentially disastrous consequences. Social anxiety emerges in adolescence and may compound risk-taking propensity, particularly during stress and when reward potential is high. However, the manner in which social anxiety, stress, and reward parameters interact to impact adolescent risk-taking is unclear. To clarify this question, a community sample of 35 adolescents (15-18yo), characterized as having high or low social anxiety, participated in a study over two separate days, during each of which they were exposed to either a social stress or a control condition, while performing a risky decision-making task. The task manipulated, orthogonally, reward magnitude and probability across trials. Three findings emerged. First, reward magnitude had a greater impact on the rate of risky decisions in high social anxiety (HSA) than low social anxiety (LSA) adolescents. Second, reaction times (RTs) were similar during the social stress and the control conditions for the HSA group, whereas the LSA group's RTs differed between conditions. Third, HSA adolescents showed the longest RTs on the most negative trials. These findings suggest that risk-taking in adolescents is modulated by context and reward parameters differentially as a function of social anxiety. Published by Elsevier Ltd.

  5. Social Anxiety, Acute Social Stress, and Reward Parameters Interact to Predict Risky Decision-Making among Adolescents

    Science.gov (United States)

    Richards, Jessica M.; Patel, Nilam; Daniele, Teresa; MacPherson, Laura; Lejuez, C.W.; Ernst, Monique

    2014-01-01

    Risk-taking behavior increases during adolescence, leading to potentially disastrous consequences. Social anxiety emerges in adolescence and may compound risk-taking propensity, particularly during stress and when reward potential is high. However, the manner in which social anxiety, stress, and reward parameters interact to impact adolescent risk-taking is unclear. To clarify this question, a community sample of 35 adolescents (15 to 18 yo), characterized as having high or low social anxiety, participated in a 2-day study, during each of which they were exposed to either a social stress or a control condition, while performing a risky decision-making task. The task manipulated, orthogonally, reward magnitude and probability across trials. Three findings emerged. First, reward magnitude had a greater impact on the rate of risky decisions in high social anxiety (HSA) than low social anxiety (LSA) adolescents. Second, reaction times (RTs) were similar during the social stress and the control conditions for the HSA group, whereas the LSA group’s RTs differed between conditions. Third, HSA adolescents showed the longest RTs on the most negative trials. These findings suggest that risk-taking in adolescents is modulated by context and reward parameters differentially as a function of social anxiety. PMID:25465884

  6. Decision making in young people at familial risk of depression.

    Science.gov (United States)

    Mannie, Z N; Williams, C; Browning, M; Cowen, P J

    2015-01-01

    Major depression is associated with abnormalities in reward processing at neural and behavioural levels. Neural abnormalities in reward have been described in young people at familial risk of depression but behavioural changes in reward-based decision making have been less studied in this group. We studied 63 young people (mean age 18.9 years) with a parent with a diagnosis of major depression but who had never been depressed themselves, that is with a positive family history of depression (the FH+ group). Participants performed the Cambridge Gambling Task (CGT), which provides several measures of decision making including deliberation time, quality of decision making, risk taking, risk adjustment and delay aversion. A control group of 49 age- and gender-matched young people with no history of mood disorder in a first-degree relative undertook the same task. Both FH+ participants and controls had low and equivalent scores on anxiety and depression self-rating scales. Compared to controls, the FH+ participants showed overall lower risk taking, although like controls they made more risky choices as the odds of a favourable outcome increased. No other measures of decision making differed between the two groups. Young people at increased familial risk of depression have altered risk taking that is not accounted for by current affective symptomatology. Lowered risk taking might represent an impairment in reward seeking, which is one of several changes in reward-based behaviours seen in acutely depressed patients; however, our findings suggest that decreased reward seeking could be part of a risk endophenotype for depression.

  7. Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males

    DEFF Research Database (Denmark)

    Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E

    2014-01-01

    the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation....... to placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making...... functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine...

  8. The Neural Basis of Decision-Making and Reward Processing in Adults with Euthymic Bipolar Disorder or Attention-Deficit/Hyperactivity Disorder (ADHD)

    OpenAIRE

    Ibanez, Agustin; Cetkovich, Marcelo; Petroni, Agustin; Urquina, Hugo; Baez, Sandra; Gonzalez-Gadea, Maria Luz; Kamienkowski, Juan Esteban; Torralva, Teresa; Torrente, Fernando; Strejilevich, Sergio; Teitelbaum, Julia; Hurtado, Esteban; Guex, Raphael; Melloni, Margherita; Lischinsky, Alicia

    2012-01-01

    BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD) and bipolar disorder (BD) share DSM-IV criteria in adults and cause problems in decision-making. Nevertheless, no previous report has assessed a decision-making task that includes the examination of the neural correlates of reward and gambling in adults with ADHD and those with BD. METHODOLOGY/PRINCIPAL FINDINGS: We used the Iowa gambling task (IGT), a task of rational decision-making under risk (RDMUR) and a rapid-decision gambling ...

  9. [Mathematical models of decision making and learning].

    Science.gov (United States)

    Ito, Makoto; Doya, Kenji

    2008-07-01

    Computational models of reinforcement learning have recently been applied to analysis of brain imaging and neural recording data to identity neural correlates of specific processes of decision making, such as valuation of action candidates and parameters of value learning. However, for such model-based analysis paradigms, selecting an appropriate model is crucial. In this study we analyze the process of choice learning in rats using stochastic rewards. We show that "Q-learning," which is a standard reinforcement learning algorithm, does not adequately reflect the features of choice behaviors. Thus, we propose a generalized reinforcement learning (GRL) algorithm that incorporates the negative reward effect of reward loss and forgetting of values of actions not chosen. Using the Bayesian estimation method for time-varying parameters, we demonstrated that the GRL algorithm can predict an animal's choice behaviors as efficiently as the best Markov model. The results suggest the usefulness of the GRL for the model-based analysis of neural processes involved in decision making.

  10. Flexible emotion-based decision-making behavior varies in current and former smokers.

    Science.gov (United States)

    Briggs, Zoe; O'Connor, Martin; Jollans, Emily K; O'Halloran, Laura; Dymond, Simon; Whelan, Robert

    2015-06-01

    Suboptimal decision-making is a feature in the initiation and maintenance of substance use, often manifested in choosing for short-term benefits rather than long-term gain, and the failure to display cognitive flexibility, respectively. Studies of nicotine users typically focus on characterizing those who are already addicted; less is known about decision-making in former smokers. Non- (n=21), former daily- (n=23) and current daily smokers (n=24), completed the contingency-shifting variant Iowa Gambling Task (csIGT), in which the reward and punishment contingencies of the decks are systematically varied after 100 trials of the 'standard' IGT. Scores on the standard blocks of the csIGT provided an index of emotion-based decision-making, while the contingency-shifting blocks assessed flexible decision-making. Subjective ratings were also recorded at 20-trial intervals. Both current and former smokers showed significantly impaired performance relative to non-smokers when making decisions during the standard blocks of the csIGT. Both former and non-smokers' awareness of the reward/punishment contingencies was significantly higher than those of current smokers at the end of the standard IGT. Both former and non-smokers had significantly better performance on the contingency shifting blocks, relative to current smokers. The findings indicate that both current and former smokers display a suboptimal pattern of decision-making than non-smokers during the standard IGT. However, with respect to the ability to change behavior following reversed contingencies, former smokers are more similar to non-smokers than to current smokers. Former smokers were also more aware of the contingencies than current smokers. Copyright © 2015 Elsevier Ltd. All rights reserved.

  11. Altered Decision-Making under Risk in Obesity.

    Directory of Open Access Journals (Sweden)

    Juan F Navas

    Full Text Available The negative consequences of energy dense foods are well known, yet people increasingly make unhealthy food choices leading to obesity (i.e., risky decisions. The aims of this study were: [1] to compare performance in decision-making tasks under risk and under ambiguity between individuals with obesity, overweight and normal weight; [2] to examine the associations between body mass index (BMI and decision-making, and the degree to which these associations are modulated by reward sensitivity.Seventy-nine adults were recruited and classified in three groups according to their BMI: obesity, overweight and normal-weight. Groups were similar in terms of age, education and socio-economic status, and were screened for comorbid medical and mental health conditions. Decision-making under risk was measured via the Wheel of Fortune Task (WoFT and decision-making under ambiguity via the Iowa Gambling Task (IGT. Reward sensitivity was indicated by the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ.Individuals with obesity made riskier choices in the WoFT, specifically in choices with an expected value close to zero and in the propensity to risk index. No differences were found in IGT performance or SPSRQ scores. BMI was associated with risk-taking (WoFT performance, independently of reward sensitivity.Obesity is linked to a propensity to make risky decisions in experimental conditions analogous to everyday food choices.

  12. Affective and cognitive mechanisms of risky decision making.

    Science.gov (United States)

    Shimp, Kristy G; Mitchell, Marci R; Beas, B Sofia; Bizon, Jennifer L; Setlow, Barry

    2015-01-01

    The ability to make advantageous decisions under circumstances in which there is a risk of adverse consequences is an important component of adaptive behavior; however, extremes in risk taking (either high or low) can be maladaptive and are characteristic of a number of neuropsychiatric disorders. To better understand the contributions of various affective and cognitive factors to risky decision making, cohorts of male Long-Evans rats were trained in a "Risky Decision making Task" (RDT), in which they made discrete trial choices between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of footshock. Experiment 1 evaluated the relative contributions of the affective stimuli (i.e., punishment vs. reward) to RDT performance by parametrically varying the magnitudes of the footshock and large reward. Varying the shock magnitude had a significant impact on choice of the large, "risky" reward, such that greater magnitudes were associated with reduced choice of the large reward. In contrast, varying the large, "risky" reward magnitude had minimal influence on reward choice. Experiment 2 compared individual variability in RDT performance with performance in an attentional set shifting task (assessing cognitive flexibility), a delayed response task (assessing working memory), and a delay discounting task (assessing impulsive choice). Rats characterized as risk averse in the RDT made more perseverative errors on the set shifting task than did their risk taking counterparts, whereas RDT performance was not related to working memory abilities or impulsive choice. In addition, rats that showed greater delay discounting (greater impulsive choice) showed corresponding poorer performance in the working memory task. Together, these results suggest that reward-related decision making under risk of punishment is more strongly influenced by the punishment than by the reward, and that risky and impulsive decision making are associated with

  13. Rule-based decision making model

    International Nuclear Information System (INIS)

    Sirola, Miki

    1998-01-01

    A rule-based decision making model is designed in G2 environment. A theoretical and methodological frame for the model is composed and motivated. The rule-based decision making model is based on object-oriented modelling, knowledge engineering and decision theory. The idea of safety objective tree is utilized. Advanced rule-based methodologies are applied. A general decision making model 'decision element' is constructed. The strategy planning of the decision element is based on e.g. value theory and utility theory. A hypothetical process model is built to give input data for the decision element. The basic principle of the object model in decision making is division in tasks. Probability models are used in characterizing component availabilities. Bayes' theorem is used to recalculate the probability figures when new information is got. The model includes simple learning features to save the solution path. A decision analytic interpretation is given to the decision making process. (author)

  14. Enhancing emotion-based learning in decision-making under uncertainty.

    Science.gov (United States)

    Alarcón, David; Amián, Josué G; Sánchez-Medina, José A

    2015-01-01

    The Iowa Gambling Task (IGT) is widely used to study decision-making differences between several clinical and healthy populations. Unlike the healthy participants, clinical participants have difficulty choosing between advantageous options, which yield long-term benefits, and disadvantageous options, which give high immediate rewards but lead to negative profits. However, recent studies have found that healthy participants avoid the options with a higher frequency of losses regardless of whether or not they are profitable in the long run. The aim of this study was to control for the confounding effect of the frequency of losses between options to improve the performance of healthy participants on the IGT. Eighty healthy participants were randomly assigned to the original IGT or a modified version of the IGT that diminished the gap in the frequency of losses between options. The participants who used the modified IGT version learned to make better decisions based on long-term profit, as indicated by an earlier ability to discriminate good from bad options, and took less time to make their choices. This research represents an advance in the study of decision making under uncertainty by showing that emotion-based learning is improved by controlling for the loss-frequency bias effect.

  15. Decision-making in the adolescent brain.

    Science.gov (United States)

    Blakemore, Sarah-Jayne; Robbins, Trevor W

    2012-09-01

    Adolescence is characterized by making risky decisions. Early lesion and neuroimaging studies in adults pointed to the ventromedial prefrontal cortex and related structures as having a key role in decision-making. More recent studies have fractionated decision-making processes into its various components, including the representation of value, response selection (including inter-temporal choice and cognitive control), associative learning, and affective and social aspects. These different aspects of decision-making have been the focus of investigation in recent studies of the adolescent brain. Evidence points to a dissociation between the relatively slow, linear development of impulse control and response inhibition during adolescence versus the nonlinear development of the reward system, which is often hyper-responsive to rewards in adolescence. This suggests that decision-making in adolescence may be particularly modulated by emotion and social factors, for example, when adolescents are with peers or in other affective ('hot') contexts.

  16. Acute Stress Induces Selective Alterations in Cost/Benefit Decision-Making

    Science.gov (United States)

    Shafiei, Naghmeh; Gray, Megan; Viau, Victor; Floresco, Stan B

    2012-01-01

    Acute stress can exert beneficial or detrimental effects on different forms of cognition. In the present study, we assessed the effects of acute restraint stress on different forms of cost/benefit decision-making, and some of the hormonal and neurochemical mechanisms that may underlie these effects. Effort-based decision-making was assessed where rats chose between a low effort/reward (1 press=2 pellets) or high effort/reward option (4 pellets), with the effort requirement increasing over 4 blocks of trials (2, 5, 10, and 20 lever presses). Restraint stress for 1 h decreased preference for the more costly reward and induced longer choice latencies. Control experiments revealed that the effects on decision-making were not mediated by general reductions in motivation or preference for larger rewards. In contrast, acute stress did not affect delay-discounting, when rats chose between a small/immediate vs larger/delayed reward. The effects of stress on decision-making were not mimicked by treatment with physiological doses of corticosterone (1–3 mg/kg). Blockade of dopamine receptors with flupenthixol (0.25 mg/kg) before restraint did not attenuate stress-induced effects on effort-related choice, but abolished effects on choice latencies. These data suggest that acute stress interferes somewhat selectively with cost/benefit evaluations concerning effort costs. These effects do not appear to be mediated solely by enhanced glucocorticoid activity, whereas dopaminergic activation may contribute to increased deliberation times induced by stress. These findings may provide insight into impairments in decision-making and anergia associated with stress-related disorders, such as depression. PMID:22569506

  17. Acute stress induces selective alterations in cost/benefit decision-making.

    Science.gov (United States)

    Shafiei, Naghmeh; Gray, Megan; Viau, Victor; Floresco, Stan B

    2012-09-01

    Acute stress can exert beneficial or detrimental effects on different forms of cognition. In the present study, we assessed the effects of acute restraint stress on different forms of cost/benefit decision-making, and some of the hormonal and neurochemical mechanisms that may underlie these effects. Effort-based decision-making was assessed where rats chose between a low effort/reward (1 press=2 pellets) or high effort/reward option (4 pellets), with the effort requirement increasing over 4 blocks of trials (2, 5, 10, and 20 lever presses). Restraint stress for 1 h decreased preference for the more costly reward and induced longer choice latencies. Control experiments revealed that the effects on decision-making were not mediated by general reductions in motivation or preference for larger rewards. In contrast, acute stress did not affect delay-discounting, when rats chose between a small/immediate vs larger/delayed reward. The effects of stress on decision-making were not mimicked by treatment with physiological doses of corticosterone (1-3 mg/kg). Blockade of dopamine receptors with flupenthixol (0.25 mg/kg) before restraint did not attenuate stress-induced effects on effort-related choice, but abolished effects on choice latencies. These data suggest that acute stress interferes somewhat selectively with cost/benefit evaluations concerning effort costs. These effects do not appear to be mediated solely by enhanced glucocorticoid activity, whereas dopaminergic activation may contribute to increased deliberation times induced by stress. These findings may provide insight into impairments in decision-making and anergia associated with stress-related disorders, such as depression.

  18. A tribute to Charlie Chaplin: Induced positive affect improves reward-based decision-learning in Parkinson’s Disease

    Directory of Open Access Journals (Sweden)

    K. Richard eRidderinkhof

    2012-06-01

    Full Text Available Reward-based decision-learning refers to the process of learning to select those actions that lead to rewards while avoiding actions that lead to punishments. This process, known to rely on dopaminergic activity in striatal brain regions, is compromised in Parkinson’s disease (PD. We hypothesized that such decision-learning deficits are alleviated by induced positive affect, which is thought to incur transient boosts in midbrain and striatal dopaminergic activity. Computational measures of probabilistic reward-based decision-learning were determined for 51 patients diagnosed with PD. Previous work has shown these measures to rely on the nucleus caudatus (outcome evaluation during the early phases of learning and the putamen (reward prediction during later phases of learning. We observed that induced positive affect facilitated learning, through its effects on reward prediction rather than outcome evaluation. Viewing a few minutes of comedy clips served to remedy dopamine-related problems in putamen-based frontostriatal circuitry and, consequently, in learning to predict which actions will yield reward.

  19. Irrational time allocation in decision-making.

    Science.gov (United States)

    Oud, Bastiaan; Krajbich, Ian; Miller, Kevin; Cheong, Jin Hyun; Botvinick, Matthew; Fehr, Ernst

    2016-01-13

    Time is an extremely valuable resource but little is known about the efficiency of time allocation in decision-making. Empirical evidence suggests that in many ecologically relevant situations, decision difficulty and the relative reward from making a correct choice, compared to an incorrect one, are inversely linked, implying that it is optimal to use relatively less time for difficult choice problems. This applies, in particular, to value-based choices, in which the relative reward from choosing the higher valued item shrinks as the values of the other options get closer to the best option and are thus more difficult to discriminate. Here, we experimentally show that people behave sub-optimally in such contexts. They do not respond to incentives that favour the allocation of time to choice problems in which the relative reward for choosing the best option is high; instead they spend too much time on problems in which the reward difference between the options is low. We demonstrate this by showing that it is possible to improve subjects' time allocation with a simple intervention that cuts them off when their decisions take too long. Thus, we provide a novel form of evidence that organisms systematically spend their valuable time in an inefficient way, and simultaneously offer a potential solution to the problem. © 2016 The Author(s).

  20. Capturing a Commander's decision making style

    Science.gov (United States)

    Santos, Eugene; Nguyen, Hien; Russell, Jacob; Kim, Keumjoo; Veenhuis, Luke; Boparai, Ramnjit; Stautland, Thomas Kristoffer

    2017-05-01

    A Commander's decision making style represents how he weighs his choices and evaluates possible solutions with regards to his goals. Specifically, in the naval warfare domain, it relates the way he processes a large amount of information in dynamic, uncertain environments, allocates resources, and chooses appropriate actions to pursue. In this paper, we describe an approach to capture a Commander's decision style by creating a cognitive model that captures his decisionmaking process and evaluate this model using a set of scenarios using an online naval warfare simulation game. In this model, we use the Commander's past behaviors and generalize Commander's actions across multiple problems and multiple decision making sequences in order to recommend actions to a Commander in a manner that he may have taken. Our approach builds upon the Double Transition Model to represent the Commander's focus and beliefs to estimate his cognitive state. Each cognitive state reflects a stage in a Commander's decision making process, each action reflects the tasks that he has taken to move himself closer to a final decision, and the reward reflects how close he is to achieving his goal. We then use inverse reinforcement learning to compute a reward for each of the Commander's actions. These rewards and cognitive states are used to compare between different styles of decision making. We construct a set of scenarios in the game where rational, intuitive and spontaneous decision making styles will be evaluated.

  1. Deficient neural activity subserving decision-making during reward waiting time in intertemporal choice in adult attention-deficit hyperactivity disorder.

    Science.gov (United States)

    Todokoro, Ayako; Tanaka, Saori C; Kawakubo, Yuki; Yahata, Noriaki; Ishii-Takahashi, Ayaka; Nishimura, Yukika; Kano, Yukiko; Ohtake, Fumio; Kasai, Kiyoto

    2018-04-24

    Impulsivity, which significantly affects social adaptation, is an important target behavioral characteristic in interventions for attention-deficit hyperactivity disorder (ADHD). Typically, people are willing to wait longer to acquire greater rewards. Impulsivity in ADHD may be associated with brain dysfunction in decision-making involving waiting behavior under such situations. We tested the hypothesis that brain circuitry during a period of waiting (i.e., prior to the acquisition of reward) is altered in adults with ADHD. The participants included 14 medication-free adults with ADHD and 16 healthy controls matched for age, sex, IQ, and handedness. The behavioral task had participants choose between a delayed, larger monetary reward and an immediate, smaller monetary reward, where the reward waiting time actually occurred during functional magnetic resonance imaging measurement. We tested for group differences in the contrast values of blood-oxygen-level dependent signals associated with the length of waiting time, calculated using the parametric modulation method. While the two groups did not differ in the time discounting rate, the delay-sensitive contrast values were significantly lower in the caudate and visual cortex in individuals with ADHD. The higher impulsivity scores were significantly associated with lower delay-sensitive contrast values in the caudate and visual cortex. These results suggest that deficient neural activity affects decision-making involving reward waiting time during intertemporal choice tasks, and provide an explanation for the basis of impulsivity in adult ADHD. © 2018 The Author. Psychiatry and Clinical Neurosciences © 2018 Japanese Society of Psychiatry and Neurology.

  2. Reduced sensitivity to sooner reward during intertemporal decision-making following insula damage in humans

    Directory of Open Access Journals (Sweden)

    Manuela eSellitto

    2016-01-01

    Full Text Available During intertemporal choice, humans tend to prefer small-sooner rewards over larger-delayed rewards, reflecting temporal discounting (TD of delayed outcomes. Functional neuroimaging evidence has implicated the insular cortex in time-sensitive decisions, yet it is not clear whether activity in this brain region is crucial for, or merely associated with, TD behaviour. Here, patients with damage to the insula (Insular patients, control patients with lesions outside the insula, and healthy individuals chose between smaller-sooner and larger-later monetary rewards. Insular patients were less sensitive to sooner rewards than were the control groups, exhibiting reduced TD. A Voxel-based Lesion-Symptom Mapping (VLSM analysis confirmed a statistically significant association between insular damage and reduced TD. These results indicate that the insular cortex is crucial for intertemporal choice. We suggest that he insula may be necessary to anticipate the bodily/emotional effects of receiving rewards at different delays, influencing the computation of their incentive value. Devoid of such input, insular patients’ choices would be governed by a heuristic of quantity, allowing patients to wait for larger options.

  3. The amygdala and decision-making.

    Science.gov (United States)

    Gupta, Rupa; Koscik, Timothy R; Bechara, Antoine; Tranel, Daniel

    2011-03-01

    Decision-making is a complex process that requires the orchestration of multiple neural systems. For example, decision-making is believed to involve areas of the brain involved in emotion (e.g., amygdala, ventromedial prefrontal cortex) and memory (e.g., hippocampus, dorsolateral prefrontal cortex). In this article, we will present findings related to the amygdala's role in decision-making, and differentiate the contributions of the amygdala from those of other structurally and functionally connected neural regions. Decades of research have shown that the amygdala is involved in associating a stimulus with its emotional value. This tradition has been extended in newer work, which has shown that the amygdala is especially important for decision-making, by triggering autonomic responses to emotional stimuli, including monetary reward and punishment. Patients with amygdala damage lack these autonomic responses to reward and punishment, and consequently, cannot utilize "somatic marker" type cues to guide future decision-making. Studies using laboratory decision-making tests have found deficient decision-making in patients with bilateral amygdala damage, which resembles their real-world difficulties with decision-making. Additionally, we have found evidence for an interaction between sex and laterality of amygdala functioning, such that unilateral damage to the right amygdala results in greater deficits in decision-making and social behavior in men, while left amygdala damage seems to be more detrimental for women. We have posited that the amygdala is part of an "impulsive," habit type system that triggers emotional responses to immediate outcomes. Copyright © 2010 Elsevier Ltd. All rights reserved.

  4. Effort-based decision making as an objective paradigm for the assessment of motivational deficits in schizophrenia.

    Science.gov (United States)

    Fervaha, Gagan; Duncan, Mark; Foussias, George; Agid, Ofer; Faulkner, Guy E; Remington, Gary

    2015-10-01

    Negative symptoms and motivational deficits are prevalent features of schizophrenia, and represent robust predictors of real-world functional outcomes. The standard for assessment of these symptoms is clinical interview and severity ratings on standardized rating scales. In the present study we examined the psychometric properties of a performance-based measure of motivational deficits in patients with schizophrenia. Ninety-seven patients with schizophrenia were included in this investigation. Patients' willingness to expend effort for reward (i.e., motivation) was evaluated using an effort-based decision making paradigm where participants chose over a series of trials whether to expend a greater amount of effort for a larger monetary reward versus less effort for a smaller reward. Effort performance was evaluated twice, separated by a two-week interval. Patients with schizophrenia opted to expend greater effort for trials with higher reward value and greater likelihood of reward receipt. Patients did not find the task overly difficult and reported being motivated to perform well, underscoring the tolerability of the task for patients. Test-retest consistency was good and there was only minimal change in scores over time. Effort performance was not related to sociodemographic or clinical variables (e.g., positive symptoms); however, deficit syndrome patients exerted effort for reward at a significantly lower rate than nondeficit patients. The effort-based decision making task used in the present study represents an objective paradigm that can be used to evaluate motivational impairments in patients with schizophrenia. Such performance-based measures of motivation may also serve as viable endpoints in clinical trials. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Working-memory load and temporal myopia in dynamic decision making.

    Science.gov (United States)

    Worthy, Darrell A; Otto, A Ross; Maddox, W Todd

    2012-11-01

    We examined the role of working memory (WM) in dynamic decision making by having participants perform decision-making tasks under single-task or dual-task conditions. In 2 experiments participants performed dynamic decision-making tasks in which they chose 1 of 2 options on each trial. The decreasing option always gave a larger immediate reward but caused future rewards for both options to decrease. The increasing option always gave a smaller immediate reward but caused future rewards for both options to increase. In each experiment we manipulated the reward structure such that the decreasing option was the optimal choice in 1 condition and the increasing option was the optimal choice in the other condition. Behavioral results indicated that dual-task participants selected the immediately rewarding decreasing option more often, and single-task participants selected the increasing option more often, regardless of which option was optimal. Thus, dual-task participants performed worse on 1 type of task but better on the other type. Modeling results showed that single-task participants' data were most often best fit by a win-stay, lose-shift (WSLS) rule-based model that tracked differences across trials, and dual-task participants' data were most often best fit by a Softmax reinforcement learning model that tracked recency-weighted average rewards for each option. This suggests that manipulating WM load affects the degree to which participants focus on the immediate versus delayed consequences of their actions and whether they employ a rule-based WSLS strategy, but it does not necessarily affect how well people weigh the immediate versus delayed benefits when determining the long-term utility of each option.

  6. Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions.

    Science.gov (United States)

    Simen, Patrick; Contreras, David; Buck, Cara; Hu, Peter; Holmes, Philip; Cohen, Jonathan D

    2009-12-01

    The drift-diffusion model (DDM) implements an optimal decision procedure for stationary, 2-alternative forced-choice tasks. The height of a decision threshold applied to accumulating information on each trial determines a speed-accuracy tradeoff (SAT) for the DDM, thereby accounting for a ubiquitous feature of human performance in speeded response tasks. However, little is known about how participants settle on particular tradeoffs. One possibility is that they select SATs that maximize a subjective rate of reward earned for performance. For the DDM, there exist unique, reward-rate-maximizing values for its threshold and starting point parameters in free-response tasks that reward correct responses (R. Bogacz, E. Brown, J. Moehlis, P. Holmes, & J. D. Cohen, 2006). These optimal values vary as a function of response-stimulus interval, prior stimulus probability, and relative reward magnitude for correct responses. We tested the resulting quantitative predictions regarding response time, accuracy, and response bias under these task manipulations and found that grouped data conformed well to the predictions of an optimally parameterized DDM.

  7. Incidental rewarding cues influence economic decisions in people with obesity

    Science.gov (United States)

    Simmank, Jakob; Murawski, Carsten; Bode, Stefan; Horstmann, Annette

    2015-01-01

    Recent research suggests that obesity is linked to prominent alterations in learning and decision-making. This general difference may also underlie the preference for immediately consumable, highly palatable but unhealthy and high-calorie foods. Such poor food-related inter-temporal decision-making can explain weight gain; however, it is not yet clear whether this deficit can be generalized to other domains of inter-temporal decision-making, for example financial decisions. Further, little is known about the stability of decision-making behavior in obesity, especially in the presence of rewarding cues. To answer these questions, obese and lean participants (n = 52) completed two sessions of a novel priming paradigm including a computerized monetary delay discounting task. In the first session, general differences between groups in financial delay discounting were measured. In the second session, we tested the general stability of discount rates. Additionally, participants were primed by affective visual cues of different contextual categories before making financial decisions. We found that the obese group showed stronger discounting of future monetary rewards than the lean group, but groups did not differ in their general stability between sessions nor in their sensitivity toward changes in reward magnitude. In the obese group, a fast decrease of subjective value over time was directly related to a higher tendency for opportunistic eating. Obese in contrast to lean people were primed by the affective cues, showing a sex-specific pattern of priming direction. Our findings demonstrate that environments rich of cues, aiming at inducing unhealthy consumer decisions, can be highly detrimental for obese people. It also underscores that obesity is not merely a medical condition but has a strong cognitive component, meaning that current dietary and medical treatment strategies may fall too short. PMID:26528158

  8. Of goals and habits: Age-related and individual differences in goal-directed decision-making

    Directory of Open Access Journals (Sweden)

    Ben eEppinger

    2013-12-01

    Full Text Available In this study we investigated age-related and individual differences in habitual (model-free and goal-directed (model-based decision-making. Specifically, we were interested in three questions. First, does age affect the balance between model-based and model-free decision mechanisms? Second, are these age-related changes due to age differences in working memory (WM capacity? Third, can model-based behavior be affected by manipulating the distinctiveness of the reward value of choice options? To answer these questions we used a two-stage Markov decision task in in combination with computational modeling to dissociate model-based and model-free decision mechanisms. To affect model-based behavior in this task we manipulated the distinctiveness of reward probabilities of choice options. The results show age-related deficits in model-based decision-making, which are particularly pronounced if unexpected reward indicates the need for a shift in decision strategy. In this situation younger adults explore the task structure, whereas older adults show perseverative behavior. Consistent with previous findings, these results indicate that older adults have deficits in the representation and updating of expected reward value. We also observed substantial individual differences in model-based behavior. In younger adults high WM capacity is associated with greater model-based behavior and this effect is further elevated when reward probabilities are more distinct. However, in older adults we found no effect of WM capacity. Moreover, age differences in model-based behavior remained statistically significant, even after controlling for WM capacity. Thus, factors other than decline in WM, such as deficits in the in the integration of expected reward value into strategic decisions may contribute to the observed impairments in model-based behavior in older adults.

  9. Optimal policy for value-based decision-making.

    Science.gov (United States)

    Tajima, Satohiro; Drugowitsch, Jan; Pouget, Alexandre

    2016-08-18

    For decades now, normative theories of perceptual decisions, and their implementation as drift diffusion models, have driven and significantly improved our understanding of human and animal behaviour and the underlying neural processes. While similar processes seem to govern value-based decisions, we still lack the theoretical understanding of why this ought to be the case. Here, we show that, similar to perceptual decisions, drift diffusion models implement the optimal strategy for value-based decisions. Such optimal decisions require the models' decision boundaries to collapse over time, and to depend on the a priori knowledge about reward contingencies. Diffusion models only implement the optimal strategy under specific task assumptions, and cease to be optimal once we start relaxing these assumptions, by, for example, using non-linear utility functions. Our findings thus provide the much-needed theory for value-based decisions, explain the apparent similarity to perceptual decisions, and predict conditions under which this similarity should break down.

  10. Elucidating poor decision-making in a rat gambling task.

    Directory of Open Access Journals (Sweden)

    Marion Rivalan

    Full Text Available Although poor decision-making is a hallmark of psychiatric conditions such as attention deficit/hyperactivity disorder, pathological gambling or substance abuse, a fraction of healthy individuals exhibit similar poor decision-making performances in everyday life and specific laboratory tasks such as the Iowa Gambling Task. These particular individuals may provide information on risk factors or common endophenotypes of these mental disorders. In a rodent version of the Iowa gambling task--the Rat Gambling Task (RGT, we identified a population of poor decision makers, and assessed how these rats scored for several behavioral traits relevant to executive disorders: risk taking, reward seeking, behavioral inflexibility, and several aspects of impulsivity. First, we found that poor decision-making could not be well predicted by single behavioral and cognitive characteristics when considered separately. By contrast, a combination of independent traits in the same individual, namely risk taking, reward seeking, behavioral inflexibility, as well as motor impulsivity, was highly predictive of poor decision-making. Second, using a reinforcement-learning model of the RGT, we confirmed that only the combination of extreme scores on these traits could induce maladaptive decision-making. Third, the model suggested that a combination of these behavioral traits results in an inaccurate representation of rewards and penalties and inefficient learning of the environment. Poor decision-making appears as a consequence of the over-valuation of high-reward-high-risk options in the task. Such a specific psychological profile could greatly impair clinically healthy individuals in decision-making tasks and may predispose to mental disorders with similar symptoms.

  11. Executive function and decision-making in women with fibromyalgia.

    Science.gov (United States)

    Verdejo-García, Antonio; López-Torrecillas, Francisca; Calandre, Elena Pita; Delgado-Rodríguez, Antonia; Bechara, Antoine

    2009-02-01

    Patients with fibromyalgia (FM) typically report cognitive problems, and they state that these deficits are disturbing in everyday life. Despite these substantial subjective complaints by FM patients, very few studies have addressed objectively the effect of such aversive states on neuropsychological performance. In this study we aimed to examine possible impairment of executive function and decision-making in a sample of 36 women diagnosed with FM and 36 healthy women matched in age, education, and socio-economic status. We contrasted performance of both groups on two measures of executive functioning: the Wisconsin Card Sorting Test (WCST), which assesses cognitive flexibility skills, and the Iowa Gambling Tasks (IGT; original and variant versions), which assess emotion-based decision-making. We also examined the relationship between executive function performance and pain experience, and between executive function and personality traits of novelty-seeking, harm avoidance, reward dependence, and persistence (measured by the Temperament and Character Inventory-Revised). Results showed that on the WCST, FM women showed poorer performance than healthy comparison women on the number of categories and non-perseverative errors, but not on perseverative errors. FM patients also showed altered learning curve in the original IGT (where reward is immediate and punishment is delayed), suggesting compromised emotion-based decision-making; but not in the variant IGT (where punishment is immediate but reward is delayed), suggesting hypersensitivity to reward. Personality variables were very mildly associated with cognitive performance in FM women.

  12. Cortical Brain Activity Reflecting Attentional Biasing Toward Reward-Predicting Cues Covaries with Economic Decision-Making Performance.

    Science.gov (United States)

    San Martín, René; Appelbaum, Lawrence G; Huettel, Scott A; Woldorff, Marty G

    2016-01-01

    Adaptive choice behavior depends critically on identifying and learning from outcome-predicting cues. We hypothesized that attention may be preferentially directed toward certain outcome-predicting cues. We studied this possibility by analyzing event-related potential (ERP) responses in humans during a probabilistic decision-making task. Participants viewed pairs of outcome-predicting visual cues and then chose to wager either a small (i.e., loss-minimizing) or large (i.e., gain-maximizing) amount of money. The cues were bilaterally presented, which allowed us to extract the relative neural responses to each cue by using a contralateral-versus-ipsilateral ERP contrast. We found an early lateralized ERP response, whose features matched the attention-shift-related N2pc component and whose amplitude scaled with the learned reward-predicting value of the cues as predicted by an attention-for-reward model. Consistently, we found a double dissociation involving the N2pc. Across participants, gain-maximization positively correlated with the N2pc amplitude to the most reliable gain-predicting cue, suggesting an attentional bias toward such cues. Conversely, loss-minimization was negatively correlated with the N2pc amplitude to the most reliable loss-predicting cue, suggesting an attentional avoidance toward such stimuli. These results indicate that learned stimulus-reward associations can influence rapid attention allocation, and that differences in this process are associated with individual differences in economic decision-making performance. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  13. Measuring Motivation and Reward-Related Decision Making in the Rodent Operant Touchscreen System.

    Science.gov (United States)

    Heath, Christopher J; Phillips, Benjamin U; Bussey, Timothy J; Saksida, Lisa M

    2016-01-04

    This unit is designed to facilitate implementation of the fixed and progressive ratio paradigms and the effort-related choice task in the rodent touchscreen apparatus to permit direct measurement of motivation and reward-related decision making in this equipment. These protocols have been optimized for use in the mouse and reliably yield stable performance levels that can be enhanced or suppressed by systemic pharmacological manipulation. Instructions are also provided for the adjustment of task parameters to permit use in mouse models of neurodegenerative disease. These tasks expand the utility of the rodent touchscreen apparatus beyond the currently available battery of cognitive assessment paradigms. Copyright © 2016 John Wiley & Sons, Inc.

  14. Anticipatory stress restores decision-making deficits in heavy drinkers by increasing sensitivity to losses.

    Science.gov (United States)

    Gullo, Matthew J; Stieger, Adam A

    2011-09-01

    Substance abusers are characterized by hypersensitivity to reward. This leads to maladaptive decisions generally, as well as those on laboratory-based decision-making tasks, such as the Iowa Gambling Task (IGT). Negative affect has also been shown to disrupt the decision-making of healthy individuals, particularly decisions made under uncertainty. Neuropsychological theories of learning, including the Somatic Marker Hypothesis (SMH), argue this occurs by amplifying affective responses to punishment. In substance abusers, this might serve to rebalance their sensitivity to reward with punishment, and improve decision-making. Before completing the IGT, 45 heavy and 47 light drinkers were randomly assigned to a control condition, or led to believe they had to give a stressful public speech. IGT performance was analyzed with the Expectancy-Valence (EV) learning model. Working memory and IQ were also assessed. Heavy drinkers made more disadvantageous decisions than light drinkers, due to higher attention to gains (versus losses) on the IGT. Anticipatory stress increased participants' attention to losses, significantly improving heavy drinkers' decision-making. Anticipatory stress increased attention to losses, effectively restoring decision-making deficits in heavy drinkers by rebalancing their reward sensitivity with punishment sensitivity. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  15. Disruptions in effort-based decision-making and consummatory behavior following antagonism of the dopamine D2 receptor.

    Science.gov (United States)

    Robles, Cindee F; Johnson, Alexander W

    2017-03-01

    Dopamine is known to influence motivational processes, however the precise role of this neurotransmitter remains a contentious issue. In the current study we sought to further characterize dopamine signaling in reward-based decision-making and consummatory behavior in mice, via lateral ventricle infusion of the dopamine D2 receptor antagonist eticlopride. In Experiment 1, we examined effort-based decision-making, in which mice had a choice between one lever, where a single response led to the delivery of a low value reward (2% sucrose); and a second lever, which led to a higher value reward (20% sucrose) that gradually required more effort to obtain. As the response schedule for the high value reward became more strict, low dose (4μg in 0.5μl) central infusions of eticlopride biased preference away from the high value reward, and toward the lever that led to the low value reward. Similarly, a higher dose of eticlopride (8μg in 0.5μl) also disrupted choice responding for the high value reward, however it did so by increasing omissions. In Experiment 2, we assessed the effects of eticlopride on consumption of 20% sucrose. The antagonist led to a dose-dependent reduction in intake, and through an analysis of licking microstructure, it was revealed that this in part reflected a reduction in the motivation to engage in consummatory behavior, rather than alterations in the evaluation of the reward. These results suggest that disruptions in D2 receptor signaling reduce the willingness to engage in effortful operant responding and consumption of a desirable outcome. Copyright © 2016 Elsevier B.V. All rights reserved.

  16. The neuroscience of social decision-making.

    Science.gov (United States)

    Rilling, James K; Sanfey, Alan G

    2011-01-01

    Given that we live in highly complex social environments, many of our most important decisions are made in the context of social interactions. Simple but sophisticated tasks from a branch of experimental economics known as game theory have been used to study social decision-making in the laboratory setting, and a variety of neuroscience methods have been used to probe the underlying neural systems. This approach is informing our knowledge of the neural mechanisms that support decisions about trust, reciprocity, altruism, fairness, revenge, social punishment, social norm conformity, social learning, and competition. Neural systems involved in reward and reinforcement, pain and punishment, mentalizing, delaying gratification, and emotion regulation are commonly recruited for social decisions. This review also highlights the role of the prefrontal cortex in prudent social decision-making, at least when social environments are relatively stable. In addition, recent progress has been made in understanding the neural bases of individual variation in social decision-making.

  17. Effort-Based Decision Making: A Novel Approach for Assessing Motivation in Schizophrenia.

    Science.gov (United States)

    Green, Michael F; Horan, William P; Barch, Deanna M; Gold, James M

    2015-09-01

    Because negative symptoms, including motivational deficits, are a critical unmet need in schizophrenia, there are many ongoing efforts to develop new pharmacological and psychosocial interventions for these impairments. A common challenge of these studies involves how to evaluate and select optimal endpoints. Currently, all studies of negative symptoms in schizophrenia depend on ratings from clinician-conducted interviews. Effort-based decision-making tasks may provide a more objective, and perhaps more sensitive, endpoint for trials of motivational negative symptoms. These tasks assess how much effort a person is willing to exert for a given level of reward. This area has been well-studied with animal models of effort and motivation, and effort-based decision-making tasks have been adapted for use in humans. Very recently, several studies have examined physical and cognitive types of effort-based decision-making tasks in cross-sectional studies of schizophrenia, providing evidence for effort-related impairment in this illness. This article covers the theoretical background on effort-based decision-making tasks to provide a context for the subsequent articles in this theme section. In addition, we review the existing literature of studies using these tasks in schizophrenia, consider some practical challenges in adapting them for use in clinical trials in schizophrenia, and discuss interpretive challenges that are central to these types of tasks. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

  18. Dopaminergic Modulation of Risky Decision-Making

    Science.gov (United States)

    Simon, Nicholas W.; Montgomery, Karienn S.; Beas, Blanca S.; Mitchell, Marci R.; LaSarge, Candi L.; Mendez, Ian A.; Bañuelos, Cristina; Vokes, Colin M.; Taylor, Aaron B.; Haberman, Rebecca P.; Bizon, Jennifer L.; Setlow, Barry

    2012-01-01

    Many psychiatric disorders are characterized by abnormal risky decision-making and dysregulated dopamine receptor expression. The current study was designed to determine how different dopamine receptor subtypes modulate risk-taking in young adult rats, using a “Risky Decision-making Task” that involves choices between small “safe” rewards and large “risky” rewards accompanied by adverse consequences. Rats showed considerable, stable individual differences in risk preference in the task, which were not related to multiple measures of reward motivation, anxiety, or pain sensitivity. Systemic activation of D2-like receptors robustly attenuated risk-taking, whereas drugs acting on D1-like receptors had no effect. Systemic amphetamine also reduced risk-taking, an effect which was attenuated by D2-like (but not D1-like) receptor blockade. Dopamine receptor mRNA expression was evaluated in a separate cohort of drug-naive rats characterized in the task. D1 mRNA expression in both nucleus accumbens shell and insular cortex was positively associated with risk-taking, while D2 mRNA expression in orbitofrontal and medial prefrontal cortex predicted risk preference in opposing nonlinear patterns. Additionally, lower levels of D2 mRNA in dorsal striatum were associated with greater risk-taking. These data strongly implicate dopamine signaling in prefrontal corticalstriatal circuitry in modulating decision-making processes involving integration of reward information with risks of adverse consequences. PMID:22131407

  19. Navy Inventory Management Decision-Making

    National Research Council Canada - National Science Library

    MacDonald, Steven

    1997-01-01

    .... This thesis asserts that Navy inventory managers do not have a general tendency to overbuy items, but rather make rational purchasing decisions influenced and motivated by the environment of rewards...

  20. Myopia for the future or hypersensitivity to reward? Age-related changes in decision making on the Iowa Gambling Task.

    Science.gov (United States)

    Bauer, A S; Timpe, J; Edmonds, E C; Bechara, A; Tranel, D; Denburg, N L

    2013-02-01

    It has been shown that older adults perform less well than younger adults on the Iowa Gambling Task (IGT), a real-world type decision-making task that factors together reward, punishment, and uncertainty. To explore the reasons behind this age-related decrement, we administered to an adult life span sample of 265 healthy participants (Mdn age = 62.00 +/- 16.17 years; range [23-88]) 2 versions of the IGT, which have different contingencies for successful performance: A'B'C'D' requires choosing lower immediate reward (paired with lower delayed punishment); E'F'G'H' requires choosing higher immediate punishment (paired with higher delayed reward). There was a significant negative correlation between age and performance on the A'B'C'D' version of the IGT (r = -.16, p = .01), while there was essentially no correlation between age and performance on the E'F'G'H' version (r = -.07, p = .24). In addition, the rate of impaired performance in older participants was significantly higher for the A'B'C'D' version (23%) compared with the E'F'G'H' version (13%). A parsimonious account of these findings is an age-related increase in hypersensitivity to reward, whereby the decisions of older adults are disproportionately influenced by prospects of receiving reward, irrespective of the presence or degree of punishment. PsycINFO Database Record (c) 2013 APA, all rights reserved.

  1. Functional specialization of the primate frontal cortex during decision making.

    Science.gov (United States)

    Lee, Daeyeol; Rushworth, Matthew F S; Walton, Mark E; Watanabe, Masataka; Sakagami, Masamichi

    2007-08-01

    Economic theories of decision making are based on the principle of utility maximization, and reinforcement-learning theory provides computational algorithms that can be used to estimate the overall reward expected from alternative choices. These formal models not only account for a large range of behavioral observations in human and animal decision makers, but also provide useful tools for investigating the neural basis of decision making. Nevertheless, in reality, decision makers must combine different types of information about the costs and benefits associated with each available option, such as the quality and quantity of expected reward and required work. In this article, we put forward the hypothesis that different subdivisions of the primate frontal cortex may be specialized to focus on different aspects of dynamic decision-making processes. In this hypothesis, the lateral prefrontal cortex is primarily involved in maintaining the state representation necessary to identify optimal actions in a given environment. In contrast, the orbitofrontal cortex and the anterior cingulate cortex might be primarily involved in encoding and updating the utilities associated with different sensory stimuli and alternative actions, respectively. These cortical areas are also likely to contribute to decision making in a social context.

  2. The influence of emotion regulation on decision-making under risk.

    Science.gov (United States)

    Martin, Laura N; Delgado, Mauricio R

    2011-09-01

    Cognitive strategies typically involved in regulating negative emotions have recently been shown to also be effective with positive emotions associated with monetary rewards. However, it is less clear how these strategies influence behavior, such as preferences expressed during decision-making under risk, and the underlying neural circuitry. That is, can the effective use of emotion regulation strategies during presentation of a reward-conditioned stimulus influence decision-making under risk and neural structures involved in reward processing such as the striatum? To investigate this question, we asked participants to engage in imagery-focused regulation strategies during the presentation of a cue that preceded a financial decision-making phase. During the decision phase, participants then made a choice between a risky and a safe monetary lottery. Participants who successfully used cognitive regulation, as assessed by subjective ratings about perceived success and facility in implementation of strategies, made fewer risky choices in comparison with trials where decisions were made in the absence of cognitive regulation. Additionally, BOLD responses in the striatum were attenuated during decision-making as a function of successful emotion regulation. These findings suggest that exerting cognitive control over emotional responses can modulate neural responses associated with reward processing (e.g., striatum) and promote more goal-directed decision-making (e.g., less risky choices), illustrating the potential importance of cognitive strategies in curbing risk-seeking behaviors before they become maladaptive (e.g., substance abuse).

  3. The Influence of Emotion Regulation on Decision-making under Risk

    Science.gov (United States)

    Martin, Laura N.; Delgado, Mauricio R.

    2011-01-01

    Cognitive strategies typically involved in regulating negative emotions have recently been shown to also be effective with positive emotions associated with monetary rewards. However, it is less clear how these strategies influence behavior, such as preferences expressed during decision-making under risk, and the underlying neural circuitry. That is, can the effective use of emotion regulation strategies during presentation of a reward-conditioned stimulus influence decision-making under risk and neural structures involved in reward processing such as the striatum? To investigate this question, we asked participants to engage in imagery-focused regulation strategies during the presentation of a cue that preceded a financial decision-making phase. During the decision phase, participants then made a choice between a risky and a safe monetary lottery. Participants who successfully used cognitive regulation, as assessed by subjective ratings about perceived success and facility in implementation of strategies, made fewer risky choices in comparison to trials where decisions were made in the absence of cognitive regulation. Additionally, blood-oxygen-level-dependent (BOLD) responses in the striatum were attenuated during decision-making as a function of successful emotion regulation. These findings suggest that exerting cognitive control over emotional responses can modulate neural responses associated with reward processing (e.g., striatum), and promote more goal-directed decision-making (e.g., less risky choices), illustrating the potential importance of cognitive strategies in curbing risk-seeking behaviors before they become maladaptive (e.g., substance abuse). PMID:21254801

  4. A Reward-Maximizing Spiking Neuron as a Bounded Rational Decision Maker.

    Science.gov (United States)

    Leibfried, Felix; Braun, Daniel A

    2015-08-01

    Rate distortion theory describes how to communicate relevant information most efficiently over a channel with limited capacity. One of the many applications of rate distortion theory is bounded rational decision making, where decision makers are modeled as information channels that transform sensory input into motor output under the constraint that their channel capacity is limited. Such a bounded rational decision maker can be thought to optimize an objective function that trades off the decision maker's utility or cumulative reward against the information processing cost measured by the mutual information between sensory input and motor output. In this study, we interpret a spiking neuron as a bounded rational decision maker that aims to maximize its expected reward under the computational constraint that the mutual information between the neuron's input and output is upper bounded. This abstract computational constraint translates into a penalization of the deviation between the neuron's instantaneous and average firing behavior. We derive a synaptic weight update rule for such a rate distortion optimizing neuron and show in simulations that the neuron efficiently extracts reward-relevant information from the input by trading off its synaptic strengths against the collected reward.

  5. Decision-making in social contexts in youth with ADHD.

    Science.gov (United States)

    Ma, Ili; Lambregts-Rommelse, Nanda N J; Buitelaar, Jan K; Cillessen, Antonius H N; Scheres, Anouk P J

    2017-03-01

    This study examined reward-related decision-making in children and adolescents with ADHD in a social context, using economic games. We furthermore examined the role of individual differences in reward-related decision-making, specifically, the roles of reward sensitivity and prosocial skills. Children and adolescents (9-17 years) with ADHD-combined subtype (n = 29; 20 boys) and healthy controls (n = 38; 20 boys) completed the ultimatum game and dictator game as measures of reward-related decision-making in social contexts. Prosocial skills were measured with the Interpersonal Reactivity Index. The ADHD group had a larger discrepancy between ultimatum game and dictator game offers than controls, indicating strategic rather than fairness driven decisions. This finding was supported by self-reports showing fewer individuals with ADHD than controls who considered fairness as motive for the decisions. Perspective taking or empathic concern did not differ between groups and was not significantly associated with offers. In conclusion, the results suggest that rather than a failure to understand the perspective of others, children and adolescents with ADHD were less motivated by fairness than controls in simple social situations. Results encourage the use of economic games in ADHD research.

  6. Aging and the neuroeconomics of decision making: A review.

    Science.gov (United States)

    Brown, Stephen B R E; Ridderinkhof, K Richard

    2009-12-01

    Neuroeconomics refers to a combination of paradigms derived from neuroscience, psychology, and economics for the study of decision making and is an area that has received considerable scientific attention in the recent literature. Using realistic laboratory tasks, researchers seek to study the neurocognitive processes underlying economic decision making and outcome-based decision learning, as well as individual differences in these processes and the social and affective factors that modulate them. To this point, one question has remained largely unanswered: What happens to decision-making processes and their neural substrates during aging? After all, aging is associated with neurocognitive change, which may affect outcome-based decision making. In our study, we use the subjective expected utility model-a well-established decision-making model in economics-as a descriptive framework. After a short survey of the brain areas and neurotransmitter systems associated with outcome-based decision making-and of the effects of aging thereon-we review a number of decision-making studies. Their general data pattern indicates that the decision-making process is changed by age: The elderly perform less efficiently than younger participants, as demonstrated, for instance, by the smaller total rewards that the elderly acquire in lab tasks. These findings are accounted for in terms of age-related deficiencies in the probability and value parameters of the subjective expected utility model. Finally, we discuss some implications and suggestions for future research.

  7. Diminished caudate and superior temporal gyrus responses to effort-based decision making in patients with first-episode major depressive disorder.

    Science.gov (United States)

    Yang, Xin-hua; Huang, Jia; Lan, Yong; Zhu, Cui-ying; Liu, Xiao-qun; Wang, Ye-fei; Cheung, Eric F C; Xie, Guang-rong; Chan, Raymond C K

    2016-01-04

    Anhedonia, the loss of interest or pleasure in reward processing, is a hallmark feature of major depressive disorder (MDD), but its underlying neurobiological mechanism is largely unknown. The present study aimed to examine the underlying neural mechanism of reward-related decision-making in patients with MDD. We examined behavioral and neural responses to rewards in patients with first-episode MDD (N=25) and healthy controls (N=25) using the Effort-Expenditure for Rewards Task (EEfRT). The task involved choices about possible rewards of varying magnitude and probability. We tested the hypothesis that individuals with MDD would exhibit a reduced neural response in reward-related brain structures involved in cost-benefit decision-making. Compared with healthy controls, patients with MDD showed significantly weaker responses in the left caudate nucleus when contrasting the 'high reward'-'low reward' condition, and blunted responses in the left superior temporal gyrus and the right caudate nucleus when contrasting high and low probabilities. In addition, hard tasks chosen during high probability trials were negatively correlated with superior temporal gyrus activity in MDD patients, while the same choices were negatively correlated with caudate nucleus activity in healthy controls. These results indicate that reduced caudate nucleus and superior temporal gyrus activation may underpin abnormal cost-benefit decision-making in MDD. Copyright © 2015 Elsevier Inc. All rights reserved.

  8. Frontal cortex electrophysiology in reward- and punishment-related feedback processing during advice-guided decision making: An interleaved EEG-DC stimulation study.

    Science.gov (United States)

    Wischnewski, Miles; Bekkering, Harold; Schutter, Dennis J L G

    2018-04-01

    During decision making, individuals are prone to rely on external cues such as expert advice when the outcome is not known. However, the electrophysiological correlates associated with outcome uncertainty and the use of expert advice are not completely understood. The feedback-related negativity (FRN), P3a, and P3b are event-related brain potentials (ERPs) linked to dissociable stages of feedback and attentional processing during decision making. Even though these ERPs are influenced by both reward- and punishment-related feedback, it remains unclear how extrinsic information during uncertainty modulates these brain potentials. In this study, the effects of advice cues on decision making were investigated in two separate experiments. In the first experiment, electroencephalography (EEG) was recorded in healthy volunteers during a decision-making task in which the participants received reward or punishment feedback preceded by novice, amateur, or expert advice. The results showed that the P3a component was significantly influenced by the subjective predictive value of an advice cue, whereas the FRN and P3b were unaffected by the advice cues. In the second, sham-controlled experiment, cathodal transcranial direct current stimulation (ctDCS) was administered in conjunction with EEG in order to explore the direct contributions of the frontal cortex to these brain potentials. Results showed no significant change in either advice-following behavior or decision times. However, ctDCS did decrease FRN amplitudes as compared to sham, with no effect on the P3a or P3b. Together, these findings suggest that advice information may act primarily on attention allocation during feedback processing, whereas the electrophysiological correlates of the detection and updating of internal prediction models are not affected.

  9. Bayesian deterministic decision making: A normative account of the operant matching law and heavy-tailed reward history dependency of choices

    Directory of Open Access Journals (Sweden)

    Hiroshi eSaito

    2014-03-01

    Full Text Available The decision making behaviors of humans and animals adapt and then satisfy an ``operant matching law'' in certain type of tasks. This was first pointed out by Herrnstein in his foraging experiments on pigeons. The matching law has been one landmark for elucidating the underlying processes of decision making and its learning in the brain. An interesting question is whether decisions are made deterministically or probabilistically. Conventional learning models of the matching law are based on the latter idea; they assume that subjects learn choice probabilities of respective alternatives and decide stochastically with the probabilities. However, it is unknown whether the matching law can be accounted for by a deterministic strategy or not. To answer this question, we propose several deterministic Bayesian decision making models that have certain incorrect beliefs about an environment. We claim that a simple model produces behavior satisfying the matching law in static settings of a foraging task but not in dynamic settings. We found that the model that has a belief that the environment is volatile works well in the dynamic foraging task and exhibits undermatching, which is a slight deviation from the matching law observed in many experiments. This model also demonstrates the double-exponential reward history dependency of a choice and a heavier-tailed run-length distribution, as has recently been reported in experiments on monkeys.

  10. How decisions emerge: action dynamics in intertemporal decision making.

    Science.gov (United States)

    Dshemuchadse, Maja; Scherbaum, Stefan; Goschke, Thomas

    2013-02-01

    In intertemporal decision making, individuals prefer smaller rewards delivered sooner over larger rewards delivered later, often to an extent that seems irrational from an economical perspective. This behavior has been attributed to a lack of self-control and reflection, the nonlinearity of human time perception, and several other sources. Although an increasing number of models propose different mathematical descriptions of temporal discounting, the dynamics of the decision process behind temporal discounting are much less clear. In this study, we obtained further insights into the mechanisms of intertemporal decisions by observing choice action dynamics via a novel combination of continuously recorded mouse movements and a multiple regression approach. Participants had to choose between two hypothetical options (sooner/smaller vs. later/larger) by moving the mouse cursor from the bottom of the screen either to the top left or to the top right. We observed less direct mouse movements when participants chose later/larger rewards, indicating that participants had to overcome the attraction of the sooner/smaller reward first. Additionally, our results suggest that framing time information differently changes the weighting of value. We conclude that using a continuous process-oriented approach could further advance the understanding of intertemporal choice beyond the identification of the best fitted mathematical description of the discounting function by uncovering the way intertemporal decisions are performed. 2013 APA, all rights reserved

  11. Sensorimotor learning biases choice behavior: a learning neural field model for decision making.

    Directory of Open Access Journals (Sweden)

    Christian Klaes

    Full Text Available According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action

  12. The role of self-reported impulsivity and reward sensitivity versus neurocognitive measures of disinhibition and decision-making in the prediction of relapse in pathological gamblers.

    Science.gov (United States)

    Goudriaan, A E; Oosterlaan, J; De Beurs, E; Van Den Brink, W

    2008-01-01

    Disinhibition and decision-making skills play an important role in theories on the cause and outcome of addictive behaviors such as substance use disorders and pathological gambling. In recent studies, both disinhibition and disadvantageous decision-making strategies, as measured by neurocognitive tests, have been found to influence the course of substance use disorders. Research on factors affecting relapse in pathological gambling is scarce. This study investigated the effect of both self-reported impulsivity and reward sensitivity, and neurocognitively assessed disinhibition and decision-making under conflicting contingencies, on relapse in a group of 46 pathological gamblers. Logistic regression analysis indicated that longer duration of the disorder and neurocognitive indicators of disinhibition (Stop Signal Reaction Time) and decision-making (Card Playing Task) were significant predictors of relapse (explaining 53% of the variance in relapse), whereas self-reported impulsivity and reward sensitivity did not significantly predict relapse. Overall classification accuracy was 76%, with a positive classification accuracy of 76% and a negative classification accuracy of 75%. Duration of the disorder and neurocognitive measures of disinhibition and decision-making are powerful predictors of relapse in pathological gambling. The results suggest that endophenotypical neurocognitive characteristics are more promising in the prediction of relapse in pathological gambling than phenotypical personality characteristics. Neurocognitive predictors may be useful to guide treatment planning of follow-up contacts and booster sessions.

  13. Neural substrates of approach-avoidance conflict decision-making

    Science.gov (United States)

    Aupperle, Robin L.; Melrose, Andrew J.; Francisco, Alex; Paulus, Martin P.; Stein, Murray B.

    2014-01-01

    Animal approach-avoidance conflict paradigms have been used extensively to operationalize anxiety, quantify the effects of anxiolytic agents, and probe the neural basis of fear and anxiety. Results from human neuroimaging studies support that a frontal-striatal-amygdala neural circuitry is important for approach-avoidance learning. However, the neural basis of decision-making is much less clear in this context. Thus, we combined a recently developed human approach-avoidance paradigm with functional magnetic resonance imaging (fMRI) to identify neural substrates underlying approach-avoidance conflict decision-making. Fifteen healthy adults completed the approach-avoidance conflict (AAC) paradigm during fMRI. Analyses of variance were used to compare conflict to non-conflict (avoid-threat and approach-reward) conditions and to compare level of reward points offered during the decision phase. Trial-by-trial amplitude modulation analyses were used to delineate brain areas underlying decision-making in the context of approach/avoidance behavior. Conflict trials as compared to the non-conflict trials elicited greater activation within bilateral anterior cingulate cortex (ACC), anterior insula, and caudate, as well as right dorsolateral prefrontal cortex. Right caudate and lateral PFC activation was modulated by level of reward offered. Individuals who showed greater caudate activation exhibited less approach behavior. On a trial-by-trial basis, greater right lateral PFC activation related to less approach behavior. Taken together, results suggest that the degree of activation within prefrontal-striatal-insula circuitry determines the degree of approach versus avoidance decision-making. Moreover, the degree of caudate and lateral PFC activation is related to individual differences in approach-avoidance decision-making. Therefore, the AAC paradigm is ideally suited to probe anxiety-related processing differences during approach-avoidance decision-making. PMID:25224633

  14. Misfortune may be a blessing in disguise: Fairness perception and emotion modulate decision making.

    Science.gov (United States)

    Liu, Hong-Hsiang; Hwang, Yin-Dir; Hsieh, Ming H; Hsu, Yung-Fong; Lai, Wen-Sung

    2017-08-01

    Fairness perception and equality during social interactions frequently elicit affective arousal and affect decision making. By integrating the dictator game and a probabilistic gambling task, this study aimed to investigate the effects of a negative experience induced by perceived unfairness on decision making using behavioral, model fitting, and electrophysiological approaches. Participants were randomly assigned to the neutral, harsh, or kind groups, which consisted of various asset allocation scenarios to induce different levels of perceived unfairness. The monetary gain was subsequently considered the initial asset in a negatively rewarded, probabilistic gambling task in which the participants were instructed to maintain as much asset as possible. Our behavioral results indicated that the participants in the harsh group exhibited increased levels of negative emotions but retained greater total game scores than the participants in the other two groups. Parameter estimation of a reinforcement learning model using a Bayesian approach indicated that these participants were more loss aversive and consistent in decision making. Data from simultaneous ERP recordings further demonstrated that these participants exhibited larger feedback-related negativity to unexpected outcomes in the gambling task, which suggests enhanced reward sensitivity and signaling of reward prediction error. Collectively, our study suggests that a negative experience may be an advantage in the modulation of reward-based decision making. © 2017 Society for Psychophysiological Research.

  15. Performance-based Reward Administration Enhancing Employees’ Feelings of Interactional Justice

    Directory of Open Access Journals (Sweden)

    Azman Ismail

    2017-04-01

    Full Text Available The transformation in international business landscape has changed organizational management especially reward administration. This is done in order to maintain the organization’s competitiveness in global market place. In the field of reward administration, an emerging trend can be observed whereby most organizations are moving toward the application of psychological elements in administering organizational reward system. The ultimate objective of this study is to investigate the association between performance-based reward administration and interactional justice. The proposed model was empirically tested using a sample of 113 employees from fire and rescue agency in Peninsular Malaysia. This study found an evidence that performance-based reward administration (i.e., communication, participation and performance appraisal is positively and significantly associated with interactional justice. This findings proves that the ability of administrators to appropriately implement communication openness, inspire participative decision-making and organize fairness performance appraisal in administering performance-based reward have significantly evoked the feeling of interactional justice when employees perceived that they are being fairly treated in the reward system.

  16. Activation of cannabinoid system in anterior cingulate cortex and orbitofrontal cortex modulates cost-benefit decision making.

    Science.gov (United States)

    Khani, Abbas; Kermani, Mojtaba; Hesam, Soghra; Haghparast, Abbas; Argandoña, Enrike G; Rainer, Gregor

    2015-06-01

    Despite the evidence for altered decision making in cannabis abusers, the role of the cannabinoid system in decision-making circuits has not been studied. Here, we examined the effects of cannabinoid modulation during cost-benefit decision making in the anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC), key brain areas involved in decision making. We trained different groups of rats in a delay-based and an effort-based form of cost-benefit T-maze decision-making task. During test days, the rats received local injections of either vehicle or ACEA, a cannabinoid type-1 receptor (CB1R) agonist in the ACC or OFC. We measured spontaneous locomotor activity following the same treatments and characterized CB1Rs localization on different neuronal populations within these regions using immunohistochemistry. We showed that CB1R activation in the ACC impaired decision making such that rats were less willing to invest physical effort to gain high reward. Similarly, CB1R activation in the OFC induced impulsive pattern of choice such that rats preferred small immediate rewards to large delayed rewards. Control tasks ensured that the effects were specific for differential cost-benefit tasks. Furthermore, we characterized widespread colocalizations of CB1Rs on GABAergic axonal ends but few colocalizations on glutamatergic, dopaminergic, and serotonergic neuronal ends. These results provide first direct evidence that the cannabinoid system plays a critical role in regulating cost-benefit decision making in the ACC and OFC and implicate cannabinoid modulation of synaptic ends of predominantly interneurons and to a lesser degree other neuronal populations in these two frontal regions.

  17. Acute and chronic effects of cannabinoids on effort-related decision-making and reward learning: an evaluation of the cannabis 'amotivational' hypotheses.

    Science.gov (United States)

    Lawn, Will; Freeman, Tom P; Pope, Rebecca A; Joye, Alyssa; Harvey, Lisa; Hindocha, Chandni; Mokrysz, Claire; Moss, Abigail; Wall, Matthew B; Bloomfield, Michael Ap; Das, Ravi K; Morgan, Celia Ja; Nutt, David J; Curran, H Valerie

    2016-10-01

    Anecdotally, both acute and chronic cannabis use have been associated with apathy, amotivation, and other reward processing deficits. To date, empirical support for these effects is limited, and no previous studies have assessed both acute effects of Δ-9-tetrahydrocannabinol (THC) and cannabidiol (CBD), as well as associations with cannabis dependence. The objectives of this study were (1) to examine acute effects of cannabis with CBD (Cann + CBD) and without CBD (Cann-CBD) on effort-related decision-making and (2) to examine associations between cannabis dependence, effort-related decision-making and reward learning. In study 1, 17 participants each received three acute vaporized treatments, namely Cann-CBD (8 mg THC), Cann + CBD (8 mg THC + 10 mg CBD) and matched placebo, followed by a 50 % dose top-up 1.5 h later, and completed the Effort Expenditure for Rewards Task (EEfRT). In study 2, 20 cannabis-dependent participants were compared with 20 non-dependent, drug-using control participants on the EEfRT and the Probabilistic Reward Task (PRT) in a non-intoxicated state. Cann-CBD reduced the likelihood of high-effort choices relative to placebo (p = 0.042) and increased sensitivity to expected value compared to both placebo (p = 0.014) and Cann + CBD (p = 0.006). The cannabis-dependent and control groups did not differ on the EEfRT. However, the cannabis-dependent group exhibited a weaker response bias than the control group on the PRT (p = 0.007). Cannabis acutely induced a transient amotivational state and CBD influenced the effects of THC on expected value. In contrast, cannabis dependence was associated with preserved motivation alongside impaired reward learning, although confounding factors, including depression, cannot be disregarded. This is the first well powered, fully controlled study to objectively demonstrate the acute amotivational effects of THC.

  18. Neural basis of decision making guided by emotional outcomes

    OpenAIRE

    Katahira, Kentaro; Matsuda, Yoshi-Taka; Fujimura, Tomomi; Ueno, Kenichi; Asamizuya, Takeshi; Suzuki, Chisato; Cheng, Kang; Okanoya, Kazuo; Okada, Masato

    2015-01-01

    Emotional events resulting from a choice influence an individual's subsequent decision making. Although the relationship between emotion and decision making has been widely discussed, previous studies have mainly investigated decision outcomes that can easily be mapped to reward and punishment, including monetary gain/loss, gustatory stimuli, and pain. These studies regard emotion as a modulator of decision making that can be made rationally in the absence of emotions. In our daily lives, how...

  19. The role of moral utility in decision making: an interdisciplinary framework.

    Science.gov (United States)

    Tobler, Philippe N; Kalis, Annemarie; Kalenscher, Tobias

    2008-12-01

    What decisions should we make? Moral values, rules, and virtues provide standards for morally acceptable decisions, without prescribing how we should reach them. However, moral theories do assume that we are, at least in principle, capable of making the right decisions. Consequently, an empirical investigation of the methods and resources we use for making moral decisions becomes relevant. We consider theoretical parallels of economic decision theory and moral utilitarianism and suggest that moral decision making may tap into mechanisms and processes that have originally evolved for nonmoral decision making. For example, the computation of reward value occurs through the combination of probability and magnitude; similar computation might also be used for determining utilitarian moral value. Both nonmoral and moral decisions may resort to intuitions and heuristics. Learning mechanisms implicated in the assignment of reward value to stimuli, actions, and outcomes may also enable us to determine moral value and assign it to stimuli, actions, and outcomes. In conclusion, we suggest that moral capabilities can employ and benefit from a variety of nonmoral decision-making and learning mechanisms.

  20. Reasoning in explanation-based decision making.

    Science.gov (United States)

    Pennington, N; Hastie, R

    1993-01-01

    A general theory of explanation-based decision making is outlined and the multiple roles of inference processes in the theory are indicated. A typology of formal and informal inference forms, originally proposed by Collins (1978a, 1978b), is introduced as an appropriate framework to represent inferences that occur in the overarching explanation-based process. Results from the analysis of verbal reports of decision processes are presented to demonstrate the centrality and systematic character of reasoning in a representative legal decision-making task.

  1. Dopaminergic influences on emotional decision making in euthymic bipolar patients.

    Science.gov (United States)

    Burdick, Katherine E; Braga, Raphael J; Gopin, Chaya B; Malhotra, Anil K

    2014-01-01

    We recently reported that the D2/D3 agonist pramipexole may have pro-cognitive effects in euthymic patients with bipolar disorder (BPD); however, the emergence of impulse-control disorders has been documented in Parkinson's disease (PD) after pramipexole treatment. Performance on reward-based tasks is altered in healthy subjects after a single dose of pramipexole, but its potential to induce abnormalities in BPD patients is unknown. We assessed reward-dependent decision making in euthymic BPD patients pre- and post 8 weeks of treatment with pramipexole or placebo by using the Iowa Gambling Task (IGT). The IGT requires subjects to choose among four card decks (two risky and two conservative) and is designed to promote learning to make advantageous (conservative) choices over time. Thirty-four BPD patients completed both assessments (18 placebo and 16 pramipexole). Baseline performance did not differ by treatment group (F=0.63; p=0.64); however, at week 8, BPD patients on pramipexole demonstrated a significantly greater tendency to make increasingly high-risk, high-reward choices across the five blocks, whereas the placebo group's pattern was similar to that reported in healthy individuals (treatment × time × block interaction, pinfluences risk-associated decision-making performance in euthymic BPD. The clinical implications remain unknown.

  2. Staged decision making based on probabilistic forecasting

    Science.gov (United States)

    Booister, Nikéh; Verkade, Jan; Werner, Micha; Cranston, Michael; Cumiskey, Lydia; Zevenbergen, Chris

    2016-04-01

    Flood forecasting systems reduce, but cannot eliminate uncertainty about the future. Probabilistic forecasts explicitly show that uncertainty remains. However, as - compared to deterministic forecasts - a dimension is added ('probability' or 'likelihood'), with this added dimension decision making is made slightly more complicated. A technique of decision support is the cost-loss approach, which defines whether or not to issue a warning or implement mitigation measures (risk-based method). With the cost-loss method a warning will be issued when the ratio of the response costs to the damage reduction is less than or equal to the probability of the possible flood event. This cost-loss method is not widely used, because it motivates based on only economic values and is a technique that is relatively static (no reasoning, yes/no decision). Nevertheless it has high potential to improve risk-based decision making based on probabilistic flood forecasting because there are no other methods known that deal with probabilities in decision making. The main aim of this research was to explore the ways of making decision making based on probabilities with the cost-loss method better applicable in practice. The exploration began by identifying other situations in which decisions were taken based on uncertain forecasts or predictions. These cases spanned a range of degrees of uncertainty: from known uncertainty to deep uncertainty. Based on the types of uncertainties, concepts of dealing with situations and responses were analysed and possible applicable concepts where chosen. Out of this analysis the concepts of flexibility and robustness appeared to be fitting to the existing method. Instead of taking big decisions with bigger consequences at once, the idea is that actions and decisions are cut-up into smaller pieces and finally the decision to implement is made based on economic costs of decisions and measures and the reduced effect of flooding. The more lead-time there is in

  3. Why we stay with our social partners: Neural mechanisms of stay/leave decision-making.

    Science.gov (United States)

    Heijne, Amber; Rossi, Filippo; Sanfey, Alan G

    2017-09-03

    How do we decide to keep interacting (e.g., stay) with a social partner or to switch (e.g., leave) to another? This paper investigated the neural mechanisms of stay/leave decision-making. We hypothesized that these decisions fit within a framework of value-based decision-making, and explored four potential mechanisms underlying a hypothesized bias to stay. Twenty-six participants underwent functional Magnetic Resonance Imaging (fMRI) while completing social and nonsocial versions of a stay/leave decision-making task. On each trial, participants chose between four alternative options, after which they received a monetary reward. Crucially, in the social condition, reward magnitude was ostensibly determined by the generosity of social partners, whereas in the nonsocial condition, reward amounts were ostensibly determined in a pre-programmed manner. Results demonstrated that participants were more likely to stay with options of relatively high expected value, with these values updated through Reinforcement Learning mechanisms and represented neurally within ventromedial prefrontal cortex. Moreover, we demonstrated that greater brain activity in ventromedial prefrontal cortex, caudate nucleus, and septo-hypothalamic regions for social versus nonsocial decisions to stay may underlie a bias towards staying with social partners in particular. These findings complement existing social psychological theories by investigating the neural mechanisms of actual stay/leave decisions.

  4. Rational Decision-Making in Inhibitory Control

    Science.gov (United States)

    Shenoy, Pradeep; Yu, Angela J.

    2011-01-01

    An important aspect of cognitive flexibility is inhibitory control, the ability to dynamically modify or cancel planned actions in response to changes in the sensory environment or task demands. We formulate a probabilistic, rational decision-making framework for inhibitory control in the stop signal paradigm. Our model posits that subjects maintain a Bayes-optimal, continually updated representation of sensory inputs, and repeatedly assess the relative value of stopping and going on a fine temporal scale, in order to make an optimal decision on when and whether to go on each trial. We further posit that they implement this continual evaluation with respect to a global objective function capturing the various reward and penalties associated with different behavioral outcomes, such as speed and accuracy, or the relative costs of stop errors and go errors. We demonstrate that our rational decision-making model naturally gives rise to basic behavioral characteristics consistently observed for this paradigm, as well as more subtle effects due to contextual factors such as reward contingencies or motivational factors. Furthermore, we show that the classical race model can be seen as a computationally simpler, perhaps neurally plausible, approximation to optimal decision-making. This conceptual link allows us to predict how the parameters of the race model, such as the stopping latency, should change with task parameters and individual experiences/ability. PMID:21647306

  5. Rational decision-making in inhibitory control.

    Science.gov (United States)

    Shenoy, Pradeep; Yu, Angela J

    2011-01-01

    An important aspect of cognitive flexibility is inhibitory control, the ability to dynamically modify or cancel planned actions in response to changes in the sensory environment or task demands. We formulate a probabilistic, rational decision-making framework for inhibitory control in the stop signal paradigm. Our model posits that subjects maintain a Bayes-optimal, continually updated representation of sensory inputs, and repeatedly assess the relative value of stopping and going on a fine temporal scale, in order to make an optimal decision on when and whether to go on each trial. We further posit that they implement this continual evaluation with respect to a global objective function capturing the various reward and penalties associated with different behavioral outcomes, such as speed and accuracy, or the relative costs of stop errors and go errors. We demonstrate that our rational decision-making model naturally gives rise to basic behavioral characteristics consistently observed for this paradigm, as well as more subtle effects due to contextual factors such as reward contingencies or motivational factors. Furthermore, we show that the classical race model can be seen as a computationally simpler, perhaps neurally plausible, approximation to optimal decision-making. This conceptual link allows us to predict how the parameters of the race model, such as the stopping latency, should change with task parameters and individual experiences/ability.

  6. Health decision making: lynchpin of evidence-based practice.

    Science.gov (United States)

    Spring, Bonnie

    2008-01-01

    Health decision making is both the lynchpin and the least developed aspect of evidence-based practice. The evidence-based practice process requires integrating the evidence with consideration of practical resources and patient preferences and doing so via a process that is genuinely collaborative. Yet, the literature is largely silent about how to accomplish integrative, shared decision making. for evidence-based practice are discussed for 2 theories of clinician decision making (expected utility and fuzzy trace) and 2 theories of patient health decision making (transtheoretical model and reasoned action). Three suggestions are offered. First, it would be advantageous to have theory-based algorithms that weight and integrate the 3 data strands (evidence, resources, preferences) in different decisional contexts. Second, patients, not providers, make the decisions of greatest impact on public health, and those decisions are behavioral. Consequently, theory explicating how provider-patient collaboration can influence patient lifestyle decisions made miles from the provider's office is greatly needed. Third, although the preponderance of data on complex decisions supports a computational approach, such an approach to evidence-based practice is too impractical to be widely applied at present. More troublesomely, until patients come to trust decisions made computationally more than they trust their providers' intuitions, patient adherence will remain problematic. A good theory of integrative, collaborative health decision making remains needed.

  7. Protocol-based care: the standardisation of decision-making?

    Science.gov (United States)

    Rycroft-Malone, Jo; Fontenla, Marina; Seers, Kate; Bick, Debra

    2009-05-01

    To explore how protocol-based care affects clinical decision-making. In the context of evidence-based practice, protocol-based care is a mechanism for facilitating the standardisation of care and streamlining decision-making through rationalising the information with which to make judgements and ultimately decisions. However, whether protocol-based care does, in the reality of practice, standardise decision-making is unknown. This paper reports on a study that explored the impact of protocol-based care on nurses' decision-making. Theoretically informed by realistic evaluation and the promoting action on research implementation in health services framework, a case study design using ethnographic methods was used. Two sites were purposively sampled; a diabetic and endocrine unit and a cardiac medical unit. Within each site, data collection included observation, postobservation semi-structured interviews with staff and patients, field notes, feedback sessions and document review. Data were inductively and thematically analysed. Decisions made by nurses in both sites were varied according to many different and interacting factors. While several standardised care approaches were available for use, in reality, a variety of information sources informed decision-making. The primary approach to knowledge exchange and acquisition was person-to-person; decision-making was a social activity. Rarely were standardised care approaches obviously referred to; nurses described following a mental flowchart, not necessarily linked to a particular guideline or protocol. When standardised care approaches were used, it was reported that they were used flexibly and particularised. While the logic of protocol-based care is algorithmic, in the reality of clinical practice, other sources of information supported nurses' decision-making process. This has significant implications for the political goal of standardisation. The successful implementation and judicious use of tools such as

  8. Applications of decision theory to test-based decision making

    NARCIS (Netherlands)

    van der Linden, Willem J.

    1987-01-01

    The use of Bayesian decision theory to solve problems in test-based decision making is discussed. Four basic decision problems are distinguished: (1) selection; (2) mastery; (3) placement; and (4) classification, the situation where each treatment has its own criterion. Each type of decision can be

  9. Perturbations in different forms of cost/benefit decision making induced by repeated amphetamine exposure.

    Science.gov (United States)

    Floresco, Stan B; Whelan, Jennifer M

    2009-08-01

    Psychostimulant abuse has been linked to impairments in cost-benefit decision making. We assessed the effects of repeated amphetamine (AMPH) treatment in rodents on two distinct forms of decision making. Separate groups of rats were trained for 26 days on either a probabilistic (risk) or effort-discounting task, each consisting of four discrete blocks of ten choice trials. One lever always delivered a smaller reward (one or two pellets), whereas another lever delivered a four-pellet reward. For risk-discounting, the probability of receiving the larger reward decreased across trial blocks (100-12.5%), whereas on the effort task, four pellets could be obtained after a ratio of presses that increased across blocks (2-20). After training, rats received 15 saline or AMPH injections (escalating from 1 to 5 mg/kg) and were then retested during acute and long-term withdrawal. Repeated AMPH administration increased risky choice 2-3 weeks after drug exposure, whereas these treatments did not alter effort-based decision making in a separate group of animals. However, prior AMPH exposure sensitized the effects of acute AMPH on both forms of decision making, whereby lower doses were effective at inducing "risky" and "lazy" patterns of choice. Repeated AMPH exposure leads to relatively long-lasting increases in risky choice, as well as sensitization to the effects of acute AMPH on different forms of cost/benefit decision making. These findings suggest that maladaptive decision-making processes exhibited by psychostimulant abusers may be caused in part by repeated drug exposure.

  10. Exogenous cortisol acutely influences motivated decision making in healthy young men.

    Science.gov (United States)

    Putman, Peter; Antypa, Niki; Crysovergi, Panagiota; van der Does, Willem A J

    2010-02-01

    The glucocorticoid (GC) hormone cortisol is the end product of the hypothalamic-pituitary-adrenal axis (HPA axis). Acute psychological stress increases HPA activity and GC release. In humans, chronic disturbances in HPA activity have been observed in affective disorders and in addictive behaviour. Recent research indicates that acute effects of GCs may be anxiolytic and increase reward sensitivity. Furthermore, cortisol acutely influences early cognitive processing of emotional stimuli. In order to extend such findings to more complex emotional-cognitive behaviour, the present study tested acute effects of 40 mg cortisol on motivated decision making in 30 healthy young men. Results showed that cortisol indeed increased risky decision making, as predicted. This effect occurred for decisions where making a risky choice could potentially yield a big reward. These results are discussed with respect to currently proposed mechanisms for cortisol's potential anxiolytic effect and GCs' involvement in reward systems.

  11. Different roads to the same destination - The impact of impulsivity on decision-making processes under risk within a rewarding context in a healthy male sample.

    Science.gov (United States)

    Dinu-Biringer, Ramona; Nees, Frauke; Falquez, Rosalux; Berger, Moritz; Barnow, Sven

    2016-02-28

    The results of research about the influences of impulsivity on decision-making in situations of risk have been inconsistent. In this study, we used functional magnetic resonance imaging to examine the neural correlates of decision-making under risk in 12 impulsive, as defined by the Barratt Impulsiveness Scale-11, and 13 normal men. Although both groups showed similar decision-making behavior, neural activation regarding decision-making processes differed significantly. Impulsive persons revealed stronger activation in the (ventro-) medial prefrontal cortex and less deactivation of the orbitofrontal cortex while playing for potential gains. These brain regions might be associated with the emotional components of decision-making processes. Significant differences in brain areas linked to cognitive decision-making components were not found. This activation pattern might be seen as an indication for a hypersensitivity to rewarding cues in impulsive persons and might be linked to the propensity for inappropriate risk-taking behavior in persons with more extreme impulsivity levels, especially in situations in which they have a strong emotional involvement in the decision process. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  12. Decision-making in schizophrenia: A predictive-coding perspective.

    Science.gov (United States)

    Sterzer, Philipp; Voss, Martin; Schlagenhauf, Florian; Heinz, Andreas

    2018-05-31

    Dysfunctional decision-making has been implicated in the positive and negative symptoms of schizophrenia. Decision-making can be conceptualized within the framework of hierarchical predictive coding as the result of a Bayesian inference process that uses prior beliefs to infer states of the world. According to this idea, prior beliefs encoded at higher levels in the brain are fed back as predictive signals to lower levels. Whenever these predictions are violated by the incoming sensory data, a prediction error is generated and fed forward to update beliefs encoded at higher levels. Well-documented impairments in cognitive decision-making support the view that these neural inference mechanisms are altered in schizophrenia. There is also extensive evidence relating the symptoms of schizophrenia to aberrant signaling of prediction errors, especially in the domain of reward and value-based decision-making. Moreover, the idea of altered predictive coding is supported by evidence for impaired low-level sensory mechanisms and motor processes. We review behavioral and neural findings from these research areas and provide an integrated view suggesting that schizophrenia may be related to a pervasive alteration in predictive coding at multiple hierarchical levels, including cognitive and value-based decision-making processes as well as sensory and motor systems. We relate these findings to decision-making processes and propose that varying degrees of impairment in the implicated brain areas contribute to the variety of psychotic experiences. Copyright © 2018 Elsevier Inc. All rights reserved.

  13. Reason, emotion and decision-making: risk and reward computation with feeling.

    Science.gov (United States)

    Quartz, Steven R

    2009-05-01

    Many models of judgment and decision-making posit distinct cognitive and emotional contributions to decision-making under uncertainty. Cognitive processes typically involve exact computations according to a cost-benefit calculus, whereas emotional processes typically involve approximate, heuristic processes that deliver rapid evaluations without mental effort. However, it remains largely unknown what specific parameters of uncertain decision the brain encodes, the extent to which these parameters correspond to various decision-making frameworks, and their correspondence to emotional and rational processes. Here, I review research suggesting that emotional processes encode in a precise quantitative manner the basic parameters of financial decision theory, indicating a reorientation of emotional and cognitive contributions to risky choice.

  14. Neural and sympathetic activity associated with exploration in decision-making: Further evidence for involvement of insula

    Directory of Open Access Journals (Sweden)

    Hideki eOhira

    2014-11-01

    Full Text Available We previously reported that sympathetic activity was associated with exploration in decision-making indexed by entropy, which is a concept in information theory and indexes randomness of choices or the degree of deviation from sticking to recent experiences of gains and losses, and that activation of the anterior insula mediated this association. The current study aims to replicate and to expand these findings in a situation where contingency between options and outcomes is manipulated. Sixteen participants performed a stochastic decision-making task in which we manipulated a condition with low uncertainty of gain/loss (contingent-reward condition and a condition with high uncertainty of gain/loss (random-reward condition. Regional cerebral blood flow was measured by 15O-water positron emission tomography (PET, and cardiovascular parameters and catecholamine in the peripheral blood were measured, during the task. In the contingent-reward condition, norepinephrine as an index of sympathetic activity was positively correlated with entropy indicating exploration in decision-making. Norepinephrine was negatively correlated with neural activity in the right posterior insula, rostral anterior cingulate cortex, and dorsal pons, suggesting neural bases for detecting changes of bodily states. Furthermore, right anterior insular activity was negatively correlated with entropy, suggesting influences on exploration in decision-making. By contrast, in the random-reward condition, entropy correlated with activity in the dorsolateral prefrontal and parietal cortices but not with sympathetic activity. These findings suggest that influences of sympathetic activity on exploration in decision-making and its underlying neural mechanisms might be dependent on the degree of uncertainty of situations.

  15. Dysfunctional decision-making in pathological gambling: pattern specificity and the role of impulsivity.

    Science.gov (United States)

    Kräplin, Anja; Dshemuchadse, Maja; Behrendt, Silke; Scherbaum, Stefan; Goschke, Thomas; Bühringer, Gerhard

    2014-03-30

    Dysfunctional decision-making in individuals with pathological gambling (PGs) may result from dominating reward-driven processes, indicated by higher impulsivity. In the current study we examined (1) if PGs show specific decision-making impairments related to dominating reward-driven processes rather than to strategic planning deficits and (2) whether these impairments are related to impulsivity. Nineteen PGs according to DSM-IV and 19 matched control subjects undertook the Cambridge Gambling Task (CGT) to assess decision-making. The delay discounting paradigm (DDP) as well as the UPPS Impulsive Behavior Scale (measuring urgency, premeditation, perseverance and sensation seeking) were administered as multidimensional measures of impulsivity. Results revealed that (1) PGs exhibited higher risk seeking and an immediate reward focus in the CGT and, in contrast, comparable strategic planning to the control group. (2) Decision-making impairments were related to more severe delay discounting and, specifically, to increased urgency and less premeditation. Our findings suggest (1) the necessity to disentangle decision-making components in order to improve etiological models of PGs, and (2) that urgency and premeditation are specifically related to disadvantageous decision-making and should be tackled in intervention strategies focusing on emotion tolerance and control strategies. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  16. Excessive Internet gaming and decision making: do excessive World of Warcraft players have problems in decision making under risky conditions?

    Science.gov (United States)

    Pawlikowski, Mirko; Brand, Matthias

    2011-08-15

    The dysfunctional behavior of excessive Internet gamers, such as preferring the immediate reward (to play World of Warcraft) despite the negative long-term consequences may be comparable with the dysfunctional behavior in substance abusers or individuals with behavioral addictions, e.g. pathological gambling. In these disorders, general decision-making deficits have been demonstrated. Hence, the aim of the present work was to examine decision-making competences of excessive World of Warcraft players. Nineteen excessive Internet gamers (EIG) and a control group (CG) consisting of 19 non-gamers were compared with respect to decision-making abilities. The Game of Dice Task (GDT) was applied to measure decision-making under risky conditions. Furthermore psychological-psychiatric symptoms were assessed in both groups. The EIG showed a reduced decision-making ability in the GDT. Furthermore the EIG group showed a higher psychological-psychiatric symptomatology in contrast to the CG. The results indicate that the reduced decision-making ability of EIG is comparable with patients with other forms of behavioral addiction (e.g. pathological gambling), impulse control disorders or substance abusers. Thus, these results suggest that excessive Internet gaming may be based on a myopia for the future, meaning that EIG prefer to play World of Warcraft despite the negative long-term consequences in social or work domains of life. 2011 Elsevier Ltd. All rights reserved.

  17. Neural basis of decision making guided by emotional outcomes.

    Science.gov (United States)

    Katahira, Kentaro; Matsuda, Yoshi-Taka; Fujimura, Tomomi; Ueno, Kenichi; Asamizuya, Takeshi; Suzuki, Chisato; Cheng, Kang; Okanoya, Kazuo; Okada, Masato

    2015-05-01

    Emotional events resulting from a choice influence an individual's subsequent decision making. Although the relationship between emotion and decision making has been widely discussed, previous studies have mainly investigated decision outcomes that can easily be mapped to reward and punishment, including monetary gain/loss, gustatory stimuli, and pain. These studies regard emotion as a modulator of decision making that can be made rationally in the absence of emotions. In our daily lives, however, we often encounter various emotional events that affect decisions by themselves, and mapping the events to a reward or punishment is often not straightforward. In this study, we investigated the neural substrates of how such emotional decision outcomes affect subsequent decision making. By using functional magnetic resonance imaging (fMRI), we measured brain activities of humans during a stochastic decision-making task in which various emotional pictures were presented as decision outcomes. We found that pleasant pictures differentially activated the midbrain, fusiform gyrus, and parahippocampal gyrus, whereas unpleasant pictures differentially activated the ventral striatum, compared with neutral pictures. We assumed that the emotional decision outcomes affect the subsequent decision by updating the value of the options, a process modeled by reinforcement learning models, and that the brain regions representing the prediction error that drives the reinforcement learning are involved in guiding subsequent decisions. We found that some regions of the striatum and the insula were separately correlated with the prediction error for either pleasant pictures or unpleasant pictures, whereas the precuneus was correlated with prediction errors for both pleasant and unpleasant pictures. Copyright © 2015 the American Physiological Society.

  18. Neural basis of decision making guided by emotional outcomes

    Science.gov (United States)

    Matsuda, Yoshi-Taka; Fujimura, Tomomi; Ueno, Kenichi; Asamizuya, Takeshi; Suzuki, Chisato; Cheng, Kang; Okanoya, Kazuo; Okada, Masato

    2015-01-01

    Emotional events resulting from a choice influence an individual's subsequent decision making. Although the relationship between emotion and decision making has been widely discussed, previous studies have mainly investigated decision outcomes that can easily be mapped to reward and punishment, including monetary gain/loss, gustatory stimuli, and pain. These studies regard emotion as a modulator of decision making that can be made rationally in the absence of emotions. In our daily lives, however, we often encounter various emotional events that affect decisions by themselves, and mapping the events to a reward or punishment is often not straightforward. In this study, we investigated the neural substrates of how such emotional decision outcomes affect subsequent decision making. By using functional magnetic resonance imaging (fMRI), we measured brain activities of humans during a stochastic decision-making task in which various emotional pictures were presented as decision outcomes. We found that pleasant pictures differentially activated the midbrain, fusiform gyrus, and parahippocampal gyrus, whereas unpleasant pictures differentially activated the ventral striatum, compared with neutral pictures. We assumed that the emotional decision outcomes affect the subsequent decision by updating the value of the options, a process modeled by reinforcement learning models, and that the brain regions representing the prediction error that drives the reinforcement learning are involved in guiding subsequent decisions. We found that some regions of the striatum and the insula were separately correlated with the prediction error for either pleasant pictures or unpleasant pictures, whereas the precuneus was correlated with prediction errors for both pleasant and unpleasant pictures. PMID:25695644

  19. The role of risk aversion in non-conscious decision making.

    Science.gov (United States)

    Wang, Shuo; Krajbich, Ian; Adolphs, Ralph; Tsuchiya, Naotsugu

    2012-01-01

    To what extent can people choose advantageously without knowing why they are making those choices? This hotly debated question has capitalized on the Iowa Gambling Task (IGT), in which people often learn to choose advantageously without appearing to know why. However, because the IGT is unconstrained in many respects, this finding remains debated and other interpretations are possible (e.g., risk aversion, ambiguity aversion, limits of working memory, or insensitivity to reward/punishment can explain the finding of the IGT). Here we devised an improved variant of the IGT in which the deck-payoff contingency switches after subjects repeatedly choose from a good deck, offering the statistical power of repeated within-subject measures based on learning the reward contingencies associated with each deck. We found that participants exhibited low confidence in their choices, as probed with post-decision wagering, despite high accuracy in selecting advantageous decks in the task, which is putative evidence for non-conscious decision making. However, such a behavioral dissociation could also be explained by risk aversion, a tendency to avoid risky decisions under uncertainty. By explicitly measuring risk aversion for each individual, we predicted subjects' post-decision wagering using Bayesian modeling. We found that risk aversion indeed does play a role, but that it did not explain the entire effect. Moreover, independently measured risk aversion was uncorrelated with risk aversion exhibited during our version of the IGT, raising the possibility that the latter risk aversion may be non-conscious. Our findings support the idea that people can make optimal choices without being fully aware of the basis of their decision. We suggest that non-conscious decision making may be mediated by emotional feelings of risk that are based on mechanisms distinct from those that support cognitive assessment of risk.

  20. Willed action, free will, and the stochastic neurodynamics of decision-making

    Directory of Open Access Journals (Sweden)

    Edmund eRolls

    2012-09-01

    Full Text Available It is shown that the randomness of the firing times of neurons in decision-making attractor neuronal networks that is present before the decision cues are applied can cause statistical fluctuations that influence the decision that will be taken. In this rigorous sense, it is possible to partially predict decisions before they are made. This raises issues about free will and determinism. There are many decision-making networks in the brain. Some decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty (in for example the peacock’s tail. Other processes capable of planning ahead with multiple steps held in working memory may require correction by higher order thoughts that may involve explicit, conscious, processing. The explicit system can allow the gene-specified rewards not to be selected or deferred. The decisions between the selfish gene-specified rewards, and the explicitly calculated rewards that are in the interests of the individual, the phenotype, may themselves be influenced by noise in the brain. When the explicit planning system does take the decision, it can report on its decision-making, and can provide a causal account rather than a confabulation about the decision process. We might use the terms ‘willed action’ and ‘free will’ to refer to the operation of the planning system that can think ahead over several steps held in working memory with which it can take explicit decisions. Reduced connectivity in some of the default mode cortical regions including the precuneus that are active during self-initiated action appears to be related to the reduction in the sense of self and agency, of causing willed actions, that can be present in schizophrenia.

  1. Optimal decision making and matching are tied through diminishing returns.

    Science.gov (United States)

    Kubanek, Jan

    2017-08-08

    How individuals make decisions has been a matter of long-standing debate among economists and researchers in the life sciences. In economics, subjects are viewed as optimal decision makers who maximize their overall reward income. This framework has been widely influential, but requires a complete knowledge of the reward contingencies associated with a given choice situation. Psychologists and ecologists have observed that individuals tend to use a simpler "matching" strategy, distributing their behavior in proportion to relative rewards associated with their options. This article demonstrates that the two dominant frameworks of choice behavior are linked through the law of diminishing returns. The relatively simple matching can in fact provide maximal reward when the rewards associated with decision makers' options saturate with the invested effort. Such saturating relationships between reward and effort are hallmarks of the law of diminishing returns. Given the prevalence of diminishing returns in nature and social settings, this finding can explain why humans and animals so commonly behave according to the matching law. The article underscores the importance of the law of diminishing returns in choice behavior.

  2. Individual differences in decision making and reward processing predict changes in cannabis use: a prospective functional magnetic resonance imaging study.

    Science.gov (United States)

    Cousijn, Janna; Wiers, Reinout W; Ridderinkhof, K Richard; van den Brink, Wim; Veltman, Dick J; Porrino, Linda J; Goudriaan, Anna E

    2013-11-01

    Decision-making deficits are thought to play an important role in the development and persistence of substance use disorders. Individual differences in decision-making abilities and their underlying neurocircuitry may, therefore, constitute an important predictor for the course of substance use and the development of substance use disorders. Here, we investigate the predictive value of decision making and neural mechanisms underlying decision making for future cannabis use and problem severity in a sample of heavy cannabis users. Brain activity during a monetary decision-making task (Iowa gambling task) was compared between 32 heavy cannabis users and 41 matched non-using controls using functional magnetic resonance imaging. In addition, within the group of heavy cannabis users, associations were examined between task-related brain activations, cannabis use and cannabis use-related problems at baseline, and change in cannabis use and problem severity after a 6-month follow-up. Despite normal task performance, heavy cannabis users compared with controls showed higher activation during wins in core areas associated with decision making. Moreover, within the group of heavy cannabis users, win-related activity and activity anticipating loss outcomes in areas generally involved in executive functions predicted change in cannabis use after 6 months. These findings are consistent with previous studies and point to abnormal processing of motivational information in heavy cannabis users. A new finding is that individuals who are biased toward immediate rewards have a higher probability of increasing drug use, highlighting the importance of the relative balance between motivational processes and regulatory executive processes in the development of substance use disorders. © 2012 The Authors, Addiction Biology © 2012 Society for the Study of Addiction.

  3. MYOPIA FOR THE FUTURE OR HYPERSENSITIVITY TO REWARD? AGE-RELATED CHANGES IN DECISION-MAKING ON THE IOWA GAMBLING TASK

    OpenAIRE

    Bauer, A. S.; Timpe, J.; Edmonds, E.C.; Bechara, A.; Tranel, D.; Denburg, N.L.

    2012-01-01

    It has been shown that older adults perform less well than younger adults on the Iowa Gambling Task (IGT), a real-world type decision-making task that factors together reward, punishment, and uncertainty. To explore the reasons behind this age-related decrement, we administered to an adult life-span sample of 265 healthy participants (median age = 62.00 +/− 16.17 years; range [23–88]) two versions of the IGT, which have different contingencies for successful performance: A'B'C'D' requires cho...

  4. Role of delay-based reward in the spatial cooperation

    Science.gov (United States)

    Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

    2017-01-01

    Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

  5. Ventral striatal activity links adversity and reward processing in children

    Directory of Open Access Journals (Sweden)

    Niki H. Kamkar

    2017-08-01

    Full Text Available Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain’s sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children.

  6. Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models.

    Science.gov (United States)

    Orsini, Caitlin A; Moorman, David E; Young, Jared W; Setlow, Barry; Floresco, Stan B

    2015-11-01

    Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals. Copyright © 2015 Elsevier Ltd. All rights reserved.

  7. The roles of the anterior cingulate cortex and its dopamine receptors in self-paced cost-benefit decision making in rats.

    Science.gov (United States)

    Wang, Shuai; Hu, Shan-Hu; Shi, Yi; Li, Bao-Ming

    2017-03-01

    It has been shown that the anterior cingulate cortex (ACC) and its dopamine system are crucial for decision making that requires physical/emotional effort, but not for all forms of cost-benefit decision making. Previous studies had mostly employed behavioral tasks with two competing cost-reward options that were preset by the experimenters. However, few studies have been conducted using scenarios in which the subjects have full control over the energy/time expenditure required to obtain a proportional reward. Here, we assessed the roles of the ACC and its dopamine system in cost-benefit decision making by utilizing a "do more get more" (DMGM) task and a time-reward trade-off (TRTO) task, wherein the animals were able to self-determine how much effort or time to expend at a nosepoke operandum for a proportional reward. Our results showed that (1) ACC inactivation severely impaired DMGM task performance, with a reduction in the rate of correct responses and a decrease in the effort expended, but did not affect the TRTO task; and (2) blocking ACC D2 receptors had no impact on DMGM task performance in the baseline cost-benefit scenario, but it significantly reduced the attempts to invest increased effort for a large reward when the benefit-cost ratio was reduced by half. In contrast, blocking ACC D1 receptors had no effect on DMGM task performance. These findings suggest that the ACC is required for self-paced effort-based but not for time-reward trade-off decision making. Furthermore, ACC dopamine D2 but not D1 receptors are involved in DMGM decision making.

  8. A Dynamic Bayesian Model for Characterizing Cross-Neuronal Interactions During Decision-Making.

    Science.gov (United States)

    Zhou, Bo; Moorman, David E; Behseta, Sam; Ombao, Hernando; Shahbaba, Babak

    2016-01-01

    The goal of this paper is to develop a novel statistical model for studying cross-neuronal spike train interactions during decision making. For an individual to successfully complete the task of decision-making, a number of temporally-organized events must occur: stimuli must be detected, potential outcomes must be evaluated, behaviors must be executed or inhibited, and outcomes (such as reward or no-reward) must be experienced. Due to the complexity of this process, it is likely the case that decision-making is encoded by the temporally-precise interactions between large populations of neurons. Most existing statistical models, however, are inadequate for analyzing such a phenomenon because they provide only an aggregated measure of interactions over time. To address this considerable limitation, we propose a dynamic Bayesian model which captures the time-varying nature of neuronal activity (such as the time-varying strength of the interactions between neurons). The proposed method yielded results that reveal new insight into the dynamic nature of population coding in the prefrontal cortex during decision making. In our analysis, we note that while some neurons in the prefrontal cortex do not synchronize their firing activity until the presence of a reward, a different set of neurons synchronize their activity shortly after stimulus onset. These differentially synchronizing sub-populations of neurons suggests a continuum of population representation of the reward-seeking task. Secondly, our analyses also suggest that the degree of synchronization differs between the rewarded and non-rewarded conditions. Moreover, the proposed model is scalable to handle data on many simultaneously-recorded neurons and is applicable to analyzing other types of multivariate time series data with latent structure. Supplementary materials (including computer codes) for our paper are available online.

  9. Reason, emotion and decision-making: risk and reward computation with feeling

    OpenAIRE

    Quartz, Steven R.

    2009-01-01

    Many models of judgment and decision-making posit distinct cognitive and emotional contributions to decision-making under uncertainty. Cognitive processes typically involve exact computations according to a cost-benefit calculus, whereas emotional processes typically involve approximate, heuristic processes that deliver rapid evaluations without mental effort. However, it remains largely unknown what specific parameters of uncertain decision the brain encodes, the extent to which these parame...

  10. Decision-making under risk and ambiguity in low-birth-weight pigs.

    Science.gov (United States)

    Murphy, Eimear; Kraak, Lynn; van den Broek, Jan; Nordquist, Rebecca E; van der Staay, Franz Josef

    2015-03-01

    Low birth weight (LBW) in humans is a risk factor for later cognitive, behavioural and emotional problems. In pigs, LBW is associated with higher mortality, but little is known about consequences for surviving piglets. Alteration in hypothalamic-pituitary-adrenal axis function in LBW pigs suggests altered emotionality, but no behavioural indicators have been studied. Decision-making under uncertain conditions, e.g., risk or ambiguity, is susceptible to emotional influences and may provide a means of assessing long-term effects of LBW in piglets. We tested LBW (N = 8) and normal-birth-weight (NBW; N = 8) male pigs in two decision-making tasks. For decision-making under risk, we developed a simple two-choice probabilistic task, the Pig Gambling Task (PGT), where an 'advantageous' option offered small but frequent rewards and a 'disadvantageous' option offered large but infrequent rewards. The advantageous option offered greater overall gain. For decision-making under ambiguity, we used a Judgement Bias Task (JBT) where pigs were trained to make an active response to 'positive' and 'negative' tone cues (signalling large and small rewards, respectively). Responses to ambiguous tone cues were rated as more or less optimistic. LBW pigs chose the advantageous option more often in later blocks of the PGT, and were scored as less optimistic in the JBT, than NBW pigs. Our findings demonstrate that LBW pigs have developed different behavioural strategies with respect to decision-making. We propose that this is guided by changes in emotionality in LBW piglets, and we provide behavioural evidence of increased negative affect in LBW piglets.

  11. From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex.

    Science.gov (United States)

    Silvetti, Massimo; Alexander, William; Verguts, Tom; Brown, Joshua W

    2014-10-01

    The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

  12. Effect of social influence on effort-allocation for monetary rewards.

    Science.gov (United States)

    Gilman, Jodi M; Treadway, Michael T; Curran, Max T; Calderon, Vanessa; Evins, A Eden

    2015-01-01

    Though decades of research have shown that people are highly influenced by peers, few studies have directly assessed how the value of social conformity is weighed against other types of costs and benefits. Using an effort-based decision-making paradigm with a novel social influence manipulation, we measured how social influence affected individuals' decisions to allocate effort for monetary rewards during trials with either high or low probability of receiving a reward. We found that information about the effort-allocation of peers modulated participant choices, specifically during conditions of low probability of obtaining a reward. This suggests that peer influence affects effort-based choices to obtain rewards especially under conditions of risk. This study provides evidence that people value social conformity in addition to other costs and benefits when allocating effort, and suggests that neuroeconomic studies that assess trade-offs between effort and reward should consider social environment as a factor that can influence decision-making.

  13. Effect of social influence on effort-allocation for monetary rewards.

    Directory of Open Access Journals (Sweden)

    Jodi M Gilman

    Full Text Available Though decades of research have shown that people are highly influenced by peers, few studies have directly assessed how the value of social conformity is weighed against other types of costs and benefits. Using an effort-based decision-making paradigm with a novel social influence manipulation, we measured how social influence affected individuals' decisions to allocate effort for monetary rewards during trials with either high or low probability of receiving a reward. We found that information about the effort-allocation of peers modulated participant choices, specifically during conditions of low probability of obtaining a reward. This suggests that peer influence affects effort-based choices to obtain rewards especially under conditions of risk. This study provides evidence that people value social conformity in addition to other costs and benefits when allocating effort, and suggests that neuroeconomic studies that assess trade-offs between effort and reward should consider social environment as a factor that can influence decision-making.

  14. Not all effort is equal: the role of the anterior cingulate cortex in different forms of effort-reward decisions

    Directory of Open Access Journals (Sweden)

    Victoria eHolec

    2014-01-01

    Full Text Available The rat anterior cingulate cortex (ACC mediates effort-based decision making when the task requires the physical effort of climbing a ramp. Normal rats will readily climb a barrier leading to high reward whereas rats with ACC lesions will opt instead for an easily obtained small reward. The present study explored whether the role of ACC in cost-benefit decisions extends beyond climbing by testing its role in ramp climbing as well as two novel cost-benefit decision tasks, one involving the physical effort of lifting weights and the other the emotional cost of overcoming fear (i.e., courage. As expected, rats with extensive ACC lesions tested on a ramp-climbing task were less likely to choose a high-reward/high-effort arm than sham controls. However, during the first few trials, lesioned rats were as likely as controls to initially turn into the high-reward arm but far less likely to actually climb the barrier, suggesting that the role of the ACC is not in deciding which course of action to pursue, but rather in maintaining a course of action in the face of countervailing forces. In the effort-reward decision task involving weight lifting, some lesion animals behaved like controls while others avoided the high reward arm. However, the results were not statistically significant and a follow-up study using incremental increasing effort failed to show any difference between lesion and control groups. The results suggest that the ACC is not needed for effort-reward decisions involving weight lifting but may affect motor abilities. Finally, a courage task explored the willingness of rats to overcome the fear of crossing an open, exposed arm to obtain a high reward. Both sham and ACC-lesioned animals exhibited equal tendencies to enter the open arm. However, whereas sham animals gradually improved on the task, ACC-lesioned rats did not. Taken together, the results suggest that the role of the ACC in effort-reward decisions may be limited to certain

  15. Decision-making, somatic markers and emotion processing in opiate users.

    Science.gov (United States)

    Biernacki, Kathryn; Terrett, Gill; McLennan, Skye N; Labuschagne, Izelle; Morton, Phoebe; Rendell, Peter G

    2018-01-01

    Opiate use is associated with deficits in decision-making. A possible explanation for these deficits is provided by the somatic marker hypothesis, which suggests that substance users may experience abnormal emotional responses during decision-making involving reward and punishment. This in turn may interfere with the brief physiological arousal, i.e. somatic markers that normally occur in anticipation of risky decisions. To date, the applicability of the somatic marker hypothesis to explain decision-making deficits has not been investigated in opiate users. This study assessed whether decision-making deficits in opiate users were related to abnormal emotional responses and reduced somatic markers. Opiate users enrolled in an opiate substitute treatment program (n = 28) and healthy controls (n = 32) completed the Iowa Gambling Task (IGT) while their skin conductance responses (SCRs) were recorded. Participants' emotional responses to emotion-eliciting videos were also recorded using SCRs and subjective ratings. Opiate users displayed poorer decision-making on the IGT than did controls. However, there were no differences between the groups in SCRs; both groups displayed stronger SCRs following punishment than following reward, and both groups displayed stronger anticipatory SCRs prior to disadvantageous decisions than advantageous decisions. There were no group differences in objective or subjective measures of emotional responses to the videos. The results suggest that deficits in emotional responsiveness are not apparent in opiate users who are receiving pharmacological treatment. Thus, the somatic marker hypothesis does not provide a good explanation for the decision-making deficits in this group.

  16. Ventral striatal activity links adversity and reward processing in children.

    Science.gov (United States)

    Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

    2017-08-01

    Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  17. [Value-based cancer care. From traditional evidence-based decision making to balanced decision making within frameworks of shared values].

    Science.gov (United States)

    Palazzo, Salvatore; Filice, Aldo; Mastroianni, Candida; Biamonte, Rosalbino; Conforti, Serafino; Liguori, Virginia; Turano, Salvatore; De Simone, Rosanna; Rovito, Antonio; Manfredi, Caterina; Minardi, Stefano; Vilardo, Emmanuelle; Loizzo, Monica; Oriolo, Carmela

    2016-04-01

    Clinical decision making in oncology is based so far on the evidence of efficacy from high-quality clinical research. Data collection and analysis from experimental studies provide valuable insight into response rates and progression-free or overall survival. Data processing generates valuable information for medical professionals involved in cancer patient care, enabling them to make objective and unbiased choices. The increased attention of many scientific associations toward a more rational resource consumption in clinical decision making is mirrored in the Choosing Wisely campaign against the overuse or misuse of exams and procedures of little or no benefit for the patient. This cultural movement has been actively promoting care solutions based on the concept of "value". As a result, the value-based decision-making process for cancer care should not be dissociated from economic sustainability and from ethics of the affordability, also given the growing average cost of the most recent cancer drugs. In support of this orientation, the National Comprehensive Cancer Network (NCCN) has developed innovative and "complex" guidelines based on values, defined as "evidence blocks", with the aim of assisting the medical community in making overall sustainable choices.

  18. Contributions of the Medial Prefrontal Cortex to Social Influence in Economic Decision-Making.

    Science.gov (United States)

    Apps, M A J; Ramnani, N

    2017-09-01

    Economic decisions are guided by highly subjective reward valuations (SVs). Often these SVs are over-ridden when individuals conform to social norms. Yet, the neural mechanisms that underpin the distinct processing of such normative reward valuations (NVs) are poorly understood. The dorsomedial and ventromedial portions of the prefrontal cortex (dmPFC/vmPFC) are putatively key regions for processing social and economic information respectively. However, the contribution of these regions to economic decisions guided by social norms is unclear. Using functional magnetic resonance imaging and computational modeling we examine the neural mechanisms underlying the processing of SVs and NVs. Subjects (n = 15) indicated either their own economic preferences or made similar choices based on a social norm-learnt during a training session. We found that that the vmPFC and dmPFC make dissociable contributions to the processing of SV and NV. Regions of the dmPFC processed "only" the value of rewards when making normative choices. In contrast, we identify a novel mechanism in the vmPFC for the coding of value. This region signaled both subjective and normative valuations, but activity was scaled positively for SV and negatively for NV. These results highlight some of the key mechanisms that underpin conformity and social influence in economic decision-making. © The Author 2017. Published by Oxford University Press.

  19. A Game-Chain-Based Approach for Decision Making

    OpenAIRE

    An, Tingyu; Watanabe, tsunami

    2009-01-01

    Nowadays, with the rapid development of information society, decision-making problems become more and more complicated especially in large scale systems such as infrastructure, environmental and industrial fields, which are usually accompanied by psychological competition between involved parties in a complicated, uncertain and dynamic situation. From a holistic perspective of system, a specific decision-making method which is described as game-chain-based decision making has been proposed in...

  20. An Online Experimental Framework for Cooperative Relationships With a Real-Time Decision-Making and Rewarding Environment

    Directory of Open Access Journals (Sweden)

    Reiji Suzuki

    2018-06-01

    Full Text Available This paper investigates interactions between game theoretical strategies and social relationships in real-time decision-making and rewarding environments. We propose an experimental framework based on techniques of web-based multiplayer online games for this purpose. In our framework, multiple human players, represented as particles in a two-dimensional space of social interactions, can modify their positions and game strategies for the prisoner's dilemma in real time, and receive benefit or cost emerging from both game theoretical and social relationships with neighboring players. We report on experiments with human participants in different conditions of the payoff matrix, which reflects game structures, and the speed of each player, which reflects the ability to change her social relationship. We show that cooperative relationships emerge in real human groups regardless of experimental settings, and show their basic behavioral patterns. We further discuss relationships between behavioral characters of participants in the experiments and their psychological characters to see how their personalities can be reflected in their behavior in such a game theoretical framework, and show that a few psychological characters of participants might reflect their behavioral characters at least in part, but there were variations in these relationships between experimental groups.

  1. Harm to self outweighs benefit to others in moral decision making.

    Science.gov (United States)

    Volz, Lukas J; Welborn, B Locke; Gobel, Matthias S; Gazzaniga, Michael S; Grafton, Scott T

    2017-07-25

    How we make decisions that have direct consequences for ourselves and others forms the moral foundation of our society. Whereas economic theory contends that humans aim at maximizing their own gains, recent seminal psychological work suggests that our behavior is instead hyperaltruistic: We are more willing to sacrifice gains to spare others from harm than to spare ourselves from harm. To investigate how such egoistic and hyperaltruistic tendencies influence moral decision making, we investigated trade-off decisions combining monetary rewards and painful electric shocks, administered to the participants themselves or an anonymous other. Whereas we replicated the notion of hyperaltruism (i.e., the willingness to forego reward to spare others from harm), we observed strongly egoistic tendencies in participants' unwillingness to harm themselves for others' benefit. The moral principle guiding intersubject trade-off decision making observed in our study is best described as egoistically biased altruism, with important implications for our understanding of economic and social interactions in our society.

  2. Retrospective revaluation in sequential decision making: a tale of two systems.

    Science.gov (United States)

    Gershman, Samuel J; Markman, Arthur B; Otto, A Ross

    2014-02-01

    Recent computational theories of decision making in humans and animals have portrayed 2 systems locked in a battle for control of behavior. One system--variously termed model-free or habitual--favors actions that have previously led to reward, whereas a second--called the model-based or goal-directed system--favors actions that causally lead to reward according to the agent's internal model of the environment. Some evidence suggests that control can be shifted between these systems using neural or behavioral manipulations, but other evidence suggests that the systems are more intertwined than a competitive account would imply. In 4 behavioral experiments, using a retrospective revaluation design and a cognitive load manipulation, we show that human decisions are more consistent with a cooperative architecture in which the model-free system controls behavior, whereas the model-based system trains the model-free system by replaying and simulating experience.

  3. A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task

    Directory of Open Access Journals (Sweden)

    Varsha eSingh

    2013-12-01

    Full Text Available The Iowa Gambling Task (IGT is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit. It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type and task motivation (instruction type. The effects of IGT variant type (reward vs. punishment and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

  4. A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task.

    Science.gov (United States)

    Singh, Varsha

    2013-01-01

    The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type) and task motivation (instruction type). The effects of IGT variant type (reward vs. punishment) and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint) on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

  5. Reward and decision processes in the brains of humans and nonhuman primates.

    Science.gov (United States)

    Sirigu, Angela; Duhamel, Jean-René

    2016-03-01

    Choice behavior requires weighing multiple decision variables, such as utility, uncertainty, delay, or effort, that combine to define a subjective value for each considered option or course of action. This capacity is based on prior learning about potential rewards (and punishments) that result from prior actions. When made in a social context, decisions can involve strategic thinking about the intentions of others and about the impact of others' behavior on one's own outcome. Valuation is also influenced by different emotions that serve to adaptively regulate our choices in order to, for example, stay away from excessively risky gambles, prevent future regrets, or avoid personal rejection or conflicts. Drawing on economic theory and on advances in the study of neuronal mechanisms, we review relevant recent experiments in nonhuman primates and clinical observations made in neurologically impaired patients suffering from impaired decision-making capacities.

  6. Reward/Punishment reversal learning in older suicide attempters.

    Science.gov (United States)

    Dombrovski, Alexandre Y; Clark, Luke; Siegle, Greg J; Butters, Meryl A; Ichikawa, Naho; Sahakian, Barbara J; Szanto, Katalin

    2010-06-01

    Suicide rates are high in old age, and the contribution of cognitive risk factors remains poorly understood. Suicide may be viewed as an outcome of an altered decision process. The authors hypothesized that impairment in reward/punishment-based learning, a component of affective decision making, is associated with attempted suicide in late-life depression. They expected that suicide attempters would discount past reward/punishment history, focusing excessively on the most recent rewards and punishments. The authors further hypothesized that this impairment could be dissociated from executive abilities, such as forward planning. The authors assessed reward/punishment-based learning using the probabilistic reversal learning task in 65 individuals age 60 and older: suicide attempters, suicide ideators, nonsuicidal depressed elderly, and nondepressed comparison subjects. The authors used a reinforcement learning computational model to decompose reward/punishment processing over time. The Stockings of Cambridge test served as a control measure of executive function. Suicide attempters but not suicide ideators showed impaired probabilistic reversal learning compared to both nonsuicidal depressed elderly and nondepressed comparison subjects, after controlling for effects of education, global cognitive function, and substance use. Model-based analyses revealed that suicide attempters discounted previous history to a higher degree relative to comparison subjects, basing their choice largely on reward/punishment received on the last trial. Groups did not differ in their performance on the Stockings of Cambridge test. Older suicide attempters display impaired reward/punishment-based learning. The authors propose a hypothesis that older suicide attempters make overly present-focused decisions, ignoring past experiences. Modification of this "myopia for the past" may have therapeutic potential.

  7. Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment.

    Science.gov (United States)

    Orsini, Caitlin A; Trotta, Rose T; Bizon, Jennifer L; Setlow, Barry

    2015-01-28

    Several neuropsychiatric disorders are associated with abnormal decision-making involving risk of punishment, but the neural basis of this association remains poorly understood. Altered activity in brain systems including the basolateral amygdala (BLA) and orbitofrontal cortex (OFC) can accompany these same disorders, and these structures are implicated in some forms of decision-making. The current study investigated the role of the BLA and OFC in decision-making under risk of explicit punishment. Rats were trained in the risky decision-making task (RDT), in which they chose between two levers, one that delivered a small safe reward, and the other that delivered a large reward accompanied by varying risks of footshock punishment. Following training, they received sham or neurotoxic lesions of BLA or OFC, followed by RDT retesting. BLA lesions increased choice of the large risky reward (greater risk-taking) compared to both prelesion performance and sham controls. When reward magnitudes were equated, both BLA lesion and control groups shifted their choice to the safe (no shock) reward lever, indicating that the lesions did not impair punishment sensitivity. In contrast to BLA lesions, OFC lesions significantly decreased risk-taking compared with sham controls, but did not impair discrimination between different reward magnitudes or alter baseline levels of anxiety. Finally, neither lesion significantly affected food-motivated lever pressing under various fixed ratio schedules, indicating that lesion-induced alterations in risk-taking were not secondary to changes in appetitive motivation. Together, these findings indicate distinct roles for the BLA and OFC in decision-making under risk of explicit punishment. Copyright © 2015 the authors 0270-6474/15/351368-12$15.00/0.

  8. The orbitofrontal cortex and beyond: from affect to decision-making.

    Science.gov (United States)

    Rolls, Edmund T; Grabenhorst, Fabian

    2008-11-01

    The orbitofrontal cortex represents the reward or affective value of primary reinforcers including taste, touch, texture, and face expression. It learns to associate other stimuli with these to produce representations of the expected reward value for visual, auditory, and abstract stimuli including monetary reward value. The orbitofrontal cortex thus plays a key role in emotion, by representing the goals for action. The learning process is stimulus-reinforcer association learning. Negative reward prediction error neurons are related to this affective learning. Activations in the orbitofrontal cortex correlate with the subjective emotional experience of affective stimuli, and damage to the orbitofrontal cortex impairs emotion-related learning, emotional behaviour, and subjective affective state. With an origin from beyond the orbitofrontal cortex, top-down attention to affect modulates orbitofrontal cortex representations, and attention to intensity modulates representations in earlier cortical areas of the physical properties of stimuli. Top-down word-level cognitive inputs can bias affective representations in the orbitofrontal cortex, providing a mechanism for cognition to influence emotion. Whereas the orbitofrontal cortex provides a representation of reward or affective value on a continuous scale, areas beyond the orbitofrontal cortex such as the medial prefrontal cortex area 10 are involved in binary decision-making when a choice must be made. For this decision-making, the orbitofrontal cortex provides a representation of each specific reward in a common currency.

  9. Neural substrates of the impaired effort expenditure decision making in schizophrenia.

    Science.gov (United States)

    Huang, Jia; Yang, Xin-Hua; Lan, Yong; Zhu, Cui-Ying; Liu, Xiao-Qun; Wang, Ye-Fei; Cheung, Eric F C; Xie, Guang-Rong; Chan, Raymond C K

    2016-09-01

    Unwillingness to expend more effort to pursue high value rewards has been associated with motivational anhedonia in schizophrenia (SCZ) and abnormal dopamine activity in the nucleus accumbens (NAcc). The authors hypothesized that dysfunction of the NAcc and the associated forebrain regions are involved in the impaired effort expenditure decision-making of SCZ. A 2 (reward magnitude: low vs. high) × 3 (probability: 20% vs. 50% vs. 80%) event-related fMRI design in the effort-expenditure for reward task (EEfRT) was used to examine the neural response of 23 SCZ patients and 23 demographically matched control participants when the participants made effort expenditure decisions to pursue uncertain rewards. SCZ patients were significantly less likely to expend high level of effort in the medium (50%) and high (80%) probability conditions than healthy controls. The neural response in the NAcc, the posterior cingulate gyrus and the left medial frontal gyrus in SCZ patients were weaker than healthy controls and did not linearly increase with an increase in reward magnitude and probability. Moreover, NAcc activity was positively correlated with the willingness to expend high-level effort and concrete consummatory pleasure experience. NAcc and posterior cingulate dysfunctions in SCZ patients may be involved in their impaired effort expenditure decision-making. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

  10. Decision-Making Under Risk, but Not Under Ambiguity, Predicts Pathological Gambling in Discrete Types of Abstinent Substance Users.

    Science.gov (United States)

    Wilson, Michael J; Vassileva, Jasmin

    2018-01-01

    This study explored how different forms of reward-based decision-making are associated with pathological gambling (PG) among abstinent individuals with prior dependence on different classes of drugs. Participants had lifetime histories of either "pure" heroin dependence ( n = 64), "pure" amphetamine dependence ( n = 51), or polysubstance dependence ( n = 89), or had no history of substance dependence ( n = 133). Decision-making was assessed via two neurocognitive tasks: (1) the Iowa Gambling Task (IGT), a measure of decision-making under ambiguity (i.e., uncertain risk contingencies); and (2) the Cambridge Gambling task (CGT), a measure of decision-making under risk (i.e., explicit risk contingencies). The main effects of neurocognitive performance and drug class on PG (defined as ≥3 DSM-IV PG symptoms) as well as their interactional effects were assessed via multiple linear regression. Two CGT indices of decision-making under risk demonstrated positive main effects on PG. Interaction effects indicated that the effects of decision-making under risk on PG were largely consistent across participant groups. Notably, a linear relationship between greater CGT Risk-Taking and PG symptoms was not observed among amphetamine users, whereas IGT performance was selectively and positively associated with PG in polysubstance users. Overall, results indicate that reward-based decision-making under risk may represent a risk factor for PG across substance users, with some variations in these relationships influenced by specific class of substance of abuse.

  11. Evidence for the speed-value trade-off: human and monkey decision making is magnitude sensitive.

    Science.gov (United States)

    Pirrone, Angelo; Azab, Habiba; Hayden, Benjamin Y; Stafford, Tom; Marshall, James A R

    2018-04-01

    Complex natural systems from brains to bee swarms have evolved to make adaptive multifactorial decisions. Recent theoretical and empirical work suggests that many evolved systems may take advantage of common motifs across multiple domains. We are particularly interested in value sensitivity (i.e., sensitivity to the magnitude or intensity of the stimuli or reward under consideration) as a mechanism to resolve deadlocks adaptively. This mechanism favours long-term reward maximization over accuracy in a simple manner, because it avoids costly delays associated with ambivalence between similar options; speed-value trade-offs have been proposed to be evolutionarily advantageous for many kinds of decision. A key prediction of the value-sensitivity hypothesis is that choices between equally-valued options will proceed faster when the options have a high value than when they have a low value. However, value-sensitivity is not part of idealised choice models such as diffusion to bound. Here we examine two different choice behaviours in two different species, perceptual decisions in humans and economic choices in rhesus monkeys, to test this hypothesis. We observe the same value sensitivity in both human perceptual decisions and monkey value-based decisions. These results endorse the idea that neural decision systems make use of the same basic principle of value-sensitivity in order to resolve costly deadlocks and thus improve long-term reward intake.

  12. Always gamble on an empty stomach: hunger is associated with advantageous decision making.

    Directory of Open Access Journals (Sweden)

    Denise de Ridder

    Full Text Available Three experimental studies examined the counterintuitive hypothesis that hunger improves strategic decision making, arguing that people in a hot state are better able to make favorable decisions involving uncertain outcomes. Studies 1 and 2 demonstrated that participants with more hunger or greater appetite made more advantageous choices in the Iowa Gambling Task compared to sated participants or participants with a smaller appetite. Study 3 revealed that hungry participants were better able to appreciate future big rewards in a delay discounting task; and that, in spite of their perception of increased rewarding value of both food and monetary objects, hungry participants were not more inclined to take risks to get the object of their desire. Together, these studies for the first time provide evidence that hot states improve decision making under uncertain conditions, challenging the conventional conception of the detrimental role of impulsivity in decision making.

  13. Always gamble on an empty stomach: hunger is associated with advantageous decision making.

    Science.gov (United States)

    de Ridder, Denise; Kroese, Floor; Adriaanse, Marieke; Evers, Catharine

    2014-01-01

    Three experimental studies examined the counterintuitive hypothesis that hunger improves strategic decision making, arguing that people in a hot state are better able to make favorable decisions involving uncertain outcomes. Studies 1 and 2 demonstrated that participants with more hunger or greater appetite made more advantageous choices in the Iowa Gambling Task compared to sated participants or participants with a smaller appetite. Study 3 revealed that hungry participants were better able to appreciate future big rewards in a delay discounting task; and that, in spite of their perception of increased rewarding value of both food and monetary objects, hungry participants were not more inclined to take risks to get the object of their desire. Together, these studies for the first time provide evidence that hot states improve decision making under uncertain conditions, challenging the conventional conception of the detrimental role of impulsivity in decision making.

  14. Entrepreneurial decision-making using the knightian uncertainty approach

    Directory of Open Access Journals (Sweden)

    Maria Sylvia Macchione Saes

    2013-12-01

    Full Text Available The article discusses the behavioral aspects that affect the entrepreneurs' decision making under the Knightian uncertainty approach. Since the profit arising from entrepreneurial activity represents the reward of an immeasurable and subjective risk, it has been hypothesized that innovative entrepreneurs have excessive optimism and confidence, which leads them to invest in high-risk activities. A behavioral model of decision making under uncertainty is used to test the hypothesis of overconfidence. This model is based on Bayesian inference, which allows us to model the assumption that these entrepreneurs are overconfident. We conclude that, under the hypothesis of overconfidence, these entrepreneurs decide to invest, despite the fact that the expected utility model indicates the contrary. This theoretical finding could explain why there are a large number of business failures in the first years of activity.

  15. Decision-making without a brain: how an amoeboid organism solves the two-armed bandit.

    Science.gov (United States)

    Reid, Chris R; MacDonald, Hannelore; Mann, Richard P; Marshall, James A R; Latty, Tanya; Garnier, Simon

    2016-06-01

    Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems. © 2016 The Authors.

  16. Emotion, Decision-Making and Substance Dependence: A Somatic-Marker Model of Addiction

    Science.gov (United States)

    Verdejo-García, A; Pérez-García, M; Bechara, A

    2006-01-01

    Similar to patients with orbitofrontal cortex lesions, substance dependent individuals (SDI) show signs of impairments in decision-making, characterised by a tendency to choose the immediate reward at the expense of severe negative future consequences. The somatic-marker hypothesis proposes that decision-making depends in many important ways on neural substrates that regulate homeostasis, emotion and feeling. According to this model, there should be a link between abnormalities in experiencing emotions in SDI, and their severe impairments in decision-making in real-life. Growing evidence from neuroscientific studies suggests that core aspects of substance addiction may be explained in terms of abnormal emotional guidance of decision-making. Behavioural studies have revealed emotional processing and decision-making deficits in SDI. Combined neuropsychological and physiological assessment has demonstrated that the poorer decision-making of SDI is associated with altered reactions to reward and punishing events. Imaging studies have shown that impaired decision-making in addiction is associated with abnormal functioning of a distributed neural network critical for the processing of emotional information, including the ventromedial cortex, the amygdala, the striatum, the anterior cingulate cortex, and the insular/somato-sensory cortices, as well as non-specific neurotransmitter systems that modulate activities of neural processes involved in decision-making. The aim of this paper is to review this growing evidence, and to examine the extent of which these studies support a somatic-marker model of addiction. PMID:18615136

  17. Perturbations in Effort-Related Decision-Making Driven by Acute Stress and Corticotropin-Releasing Factor.

    Science.gov (United States)

    Bryce, Courtney A; Floresco, Stan B

    2016-07-01

    Acute stress activates numerous systems in a coordinated effort to promote homeostasis, and can exert differential effects on mnemonic and cognitive functions depending on a myriad of factors. Stress can alter different forms of cost/benefit decision-making, yet the mechanisms that drive these effects, remain unclear. In the present study, we probed how corticotropin-releasing factor (CRF) may contribute to stress-induced alterations in cost/benefit decision-making, using an task where well-trained rats chose between a low effort/low reward lever (LR; two pellets) and a high effort/high reward lever (HR; four pellets), with the effort requirement increasing over a session (2, 5, 10, and 20 presses). One-hour restraint stress markedly reduced preference for the HR option, but this effect was attenuated by infusions of the CRF antagonist, alpha-helical CRF. Conversely, central CRF infusion mimicked the effect of stress on decision-making, as well as increased decision latencies and reduced response vigor. CRF infusions did not alter preference for larger vs smaller rewards, but did reduce responding for food delivered on a progressive ratio, suggesting that these treatments may amplify perceived effort costs that may be required to obtain rewards. CRF infusions into the ventral tegmental area recapitulated the effect of central CRF treatment and restraint on choice behavior, suggesting that these effects may be mediated by perturbations in dopamine transmission. These findings highlight the involvement of CRF in regulating effort-related decisions and suggest that increased CRF activity may contribute to motivational impairments and abnormal decision-making associated with stress-related psychiatric disorders such as depression.

  18. Advances in the application of decision theory to test-based decision making

    NARCIS (Netherlands)

    van der Linden, Willem J.

    This paper reviews recent research in the Netherlands on the application of decision theory to test-based decision making about personnel selection and student placement. The review is based on an earlier model proposed for the classification of decision problems, and emphasizes an empirical

  19. The involvement of the striatum in decision making

    Science.gov (United States)

    Goulet-Kennedy, Julie; Labbe, Sara; Fecteau, Shirley

    2016-01-01

    Decision making has been extensively studied in the context of economics and from a group perspective, but still little is known on individual decision making. Here we discuss the different cognitive processes involved in decision making and its associated neural substrates. The putative conductors in decision making appear to be the prefrontal cortex and the striatum. Impaired decision-making skills in various clinical populations have been associated with activity in the prefrontal cortex and in the striatum. We highlight the importance of strengthening the degree of integration of both cognitive and neural substrates in order to further our understanding of decision-making skills. In terms of cognitive paradigms, there is a need to improve the ecological value of experimental tasks that assess decision making in various contexts and with rewards; this would help translate laboratory learnings into real-life benefits. In terms of neural substrates, the use of neuroimaging techniques helps characterize the neural networks associated with decision making; more recently, ways to modulate brain activity, such as in the prefrontal cortex and connected regions (eg, striatum), with noninvasive brain stimulation have also shed light on the neural and cognitive substrates of decision making. Together, these cognitive and neural approaches might be useful for patients with impaired decision-making skills. The drive behind this line of work is that decision-making abilities underlie important aspects of wellness, health, security, and financial and social choices in our daily lives. PMID:27069380

  20. Influence of branding on preference-based decision making.

    Science.gov (United States)

    Philiastides, Marios G; Ratcliff, Roger

    2013-07-01

    Branding has become one of the most important determinants of consumer choices. Intriguingly, the psychological mechanisms of how branding influences decision making remain elusive. In the research reported here, we used a preference-based decision-making task and computational modeling to identify which internal components of processing are affected by branding. We found that a process of noisy temporal integration of subjective value information can model preference-based choices reliably and that branding biases are explained by changes in the rate of the integration process itself. This result suggests that branding information and subjective preference are integrated into a single source of evidence in the decision-making process, thereby altering choice behavior.

  1. Predicting Motivation: Computational Models of PFC Can Explain Neural Coding of Motivation and Effort-based Decision-making in Health and Disease.

    Science.gov (United States)

    Vassena, Eliana; Deraeve, James; Alexander, William H

    2017-10-01

    Human behavior is strongly driven by the pursuit of rewards. In daily life, however, benefits mostly come at a cost, often requiring that effort be exerted to obtain potential benefits. Medial PFC (MPFC) and dorsolateral PFC (DLPFC) are frequently implicated in the expectation of effortful control, showing increased activity as a function of predicted task difficulty. Such activity partially overlaps with expectation of reward and has been observed both during decision-making and during task preparation. Recently, novel computational frameworks have been developed to explain activity in these regions during cognitive control, based on the principle of prediction and prediction error (predicted response-outcome [PRO] model [Alexander, W. H., & Brown, J. W. Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338-1344, 2011], hierarchical error representation [HER] model [Alexander, W. H., & Brown, J. W. Hierarchical error representation: A computational model of anterior cingulate and dorsolateral prefrontal cortex. Neural Computation, 27, 2354-2410, 2015]). Despite the broad explanatory power of these models, it is not clear whether they can also accommodate effects related to the expectation of effort observed in MPFC and DLPFC. Here, we propose a translation of these computational frameworks to the domain of effort-based behavior. First, we discuss how the PRO model, based on prediction error, can explain effort-related activity in MPFC, by reframing effort-based behavior in a predictive context. We propose that MPFC activity reflects monitoring of motivationally relevant variables (such as effort and reward), by coding expectations and discrepancies from such expectations. Moreover, we derive behavioral and neural model-based predictions for healthy controls and clinical populations with impairments of motivation. Second, we illustrate the possible translation to effort-based behavior of the HER model, an extended version of PRO

  2. Selecting a risk-based tool to aid in decision making

    Energy Technology Data Exchange (ETDEWEB)

    Bendure, A.O.

    1995-03-01

    Selecting a risk-based tool to aid in decision making is as much of a challenge as properly using the tool once it has been selected. Failure to consider customer and stakeholder requirements and the technical bases and differences in risk-based decision making tools will produce confounding and/or politically unacceptable results when the tool is used. Selecting a risk-based decisionmaking tool must therefore be undertaken with the same, if not greater, rigor than the use of the tool once it is selected. This paper presents a process for selecting a risk-based tool appropriate to a set of prioritization or resource allocation tasks, discusses the results of applying the process to four risk-based decision-making tools, and identifies the ``musts`` for successful selection and implementation of a risk-based tool to aid in decision making.

  3. Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 2—External Validity and Correlates.

    Science.gov (United States)

    Horan, William P; Reddy, L Felice; Barch, Deanna M; Buchanan, Robert W; Dunayevich, Eduardo; Gold, James M; Marder, Steven R; Wynn, Jonathan K; Young, Jared W; Green, Michael F

    2015-09-01

    Effort-based decision making has strong conceptual links to the motivational disturbances that define a key subdomain of negative symptoms. However, the extent to which effort-based decision-making performance relates to negative symptoms, and other clinical and functionally important variables has yet to be systematically investigated. In 94 clinically stable outpatients with schizophrenia, we examined the external validity of 5 effort-based paradigms, including the Effort Expenditure for Rewards, Balloon Effort, Grip Strength Effort, Deck Choice Effort, and Perceptual Effort tasks. These tasks covered 3 types of effort: physical, cognitive, and perceptual. Correlations between effort related performance and 6 classes of variables were examined, including: (1) negative symptoms, (2) clinically rated motivation and community role functioning, (3) self-reported motivational traits, (4) neurocognition, (5) other psychiatric symptoms and clinical/demographic characteristics, and (6) subjective valuation of monetary rewards. Effort paradigms showed small to medium relationships to clinical ratings of negative symptoms, motivation, and functioning, with the pattern more consistent for some measures than others. They also showed small to medium relations with neurocognitive functioning, but were generally unrelated to other psychiatric symptoms, self-reported traits, antipsychotic medications, side effects, and subjective valuation of money. There were relatively strong interrelationships among the effort measures. In conjunction with findings from a companion psychometric article, all the paradigms warrant further consideration and development, and 2 show the strongest potential for clinical trial use at this juncture. © The Author 2015. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

  4. An Intelligent Fleet Condition-Based Maintenance Decision Making Method Based on Multi-Agent

    Directory of Open Access Journals (Sweden)

    Bo Sun

    2012-01-01

    Full Text Available According to the demand for condition-based maintenance online decision making among a mission oriented fleet, an intelligent maintenance decision making method based on Multi-agent and heuristic rules is proposed. The process of condition-based maintenance within an aircraft fleet (each containing one or more Line Replaceable Modules based on multiple maintenance thresholds is analyzed. Then the process is abstracted into a Multi-Agent Model, a 2-layer model structure containing host negotiation and independent negotiation is established, and the heuristic rules applied to global and local maintenance decision making is proposed. Based on Contract Net Protocol and the heuristic rules, the maintenance decision making algorithm is put forward. Finally, a fleet consisting of 10 aircrafts on a 3-wave continuous mission is illustrated to verify this method. Simulation results indicate that this method can improve the availability of the fleet, meet mission demands, rationalize the utilization of support resources and provide support for online maintenance decision making among a mission oriented fleet.

  5. Feasibility of neuro-morphic computing to emulate error-conflict based decision making.

    Energy Technology Data Exchange (ETDEWEB)

    Branch, Darren W.

    2009-09-01

    A key aspect of decision making is determining when errors or conflicts exist in information and knowing whether to continue or terminate an action. Understanding the error-conflict processing is crucial in order to emulate higher brain functions in hardware and software systems. Specific brain regions, most notably the anterior cingulate cortex (ACC) are known to respond to the presence of conflicts in information by assigning a value to an action. Essentially, this conflict signal triggers strategic adjustments in cognitive control, which serve to prevent further conflict. The most probable mechanism is the ACC reports and discriminates different types of feedback, both positive and negative, that relate to different adaptations. Unique cells called spindle neurons that are primarily found in the ACC (layer Vb) are known to be responsible for cognitive dissonance (disambiguation between alternatives). Thus, the ACC through a specific set of cells likely plays a central role in the ability of humans to make difficult decisions and solve challenging problems in the midst of conflicting information. In addition to dealing with cognitive dissonance, decision making in high consequence scenarios also relies on the integration of multiple sets of information (sensory, reward, emotion, etc.). Thus, a second area of interest for this proposal lies in the corticostriatal networks that serve as an integration region for multiple cognitive inputs. In order to engineer neurological decision making processes in silicon devices, we will determine the key cells, inputs, and outputs of conflict/error detection in the ACC region. The second goal is understand in vitro models of corticostriatal networks and the impact of physical deficits on decision making, specifically in stressful scenarios with conflicting streams of data from multiple inputs. We will elucidate the mechanisms of cognitive data integration in order to implement a future corticostriatal-like network in silicon

  6. Ventral striatal activity links adversity and reward processing in children

    NARCIS (Netherlands)

    Kamkar, N.H.; Lewis, D.J.; van den Bos, W.; Morton, J.B.

    2017-01-01

    Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive

  7. Prefrontal Cortical Inactivations Decrease Willingness to Expend Cognitive Effort on a Rodent Cost/Benefit Decision-Making Task.

    Science.gov (United States)

    Hosking, Jay G; Cocker, Paul J; Winstanley, Catharine A

    2016-04-01

    Personal success often necessitates expending greater effort for greater reward but, equally important, also requires judicious use of our limited cognitive resources (e.g., attention). Previous animal models have shown that the prelimbic (PL) and infralimbic (IL) regions of the prefrontal cortex (PFC) are not involved in (physical) effort-based choice, whereas human studies have demonstrated PFC contributions to (mental) effort. Here, we utilize the rat Cognitive Effort Task (rCET) to probe PFC's role in effort-based decision making. In the rCET, animals can choose either an easy trial, where the attentional demand is low but the reward (sugar) is small or a difficult trial on which both the attentional demand and reward are greater. Temporary inactivation of PL and IL decreased all animals' willingness to expend mental effort and increased animals' distractibility; PL inactivations more substantially affected performance (i.e., attention), whereas IL inactivations increased motor impulsivity. These data imply that the PFC contributes to attentional resources, and when these resources are diminished, animals shift their choice (via other brain regions) accordingly. Thus, one novel therapeutic approach to deficits in effort expenditure may be to focus on the resources that such decision making requires, rather than the decision-making process per se. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  8. Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males

    DEFF Research Database (Denmark)

    Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E

    2014-01-01

    the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation.......Selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine are commonly prescribed antidepressant drugs targeting the dysfunctional serotonin (5-HT) system, yet little is known about the functional effects of prolonged serotonin reuptake inhibition in healthy individuals. Here we used...... functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine...

  9. Efficient decision-making by volume-conserving physical object

    International Nuclear Information System (INIS)

    Kim, Song-Ju; Aono, Masashi; Nameda, Etsushi

    2015-01-01

    Decision-making is one of the most important intellectual abilities of not only humans but also other biological organisms, helping their survival. This ability, however, may not be limited to biological systems and may be exhibited by physical systems. Here we demonstrate that any physical object, as long as its volume is conserved when coupled with suitable operations, provides a sophisticated decision-making capability. We consider the multi-armed bandit problem (MBP), the problem of finding, as accurately and quickly as possible, the most profitable option from a set of options that gives stochastic rewards. Efficient MBP solvers are useful for many practical applications, because MBP abstracts a variety of decision-making problems in real-world situations in which an efficient trial-and-error is required. These decisions are made as dictated by a physical object, which is moved in a manner similar to the fluctuations of a rigid body in a tug-of-war (TOW) game. This method, called ‘TOW dynamics’, exhibits higher efficiency than conventional reinforcement learning algorithms. We show analytical calculations that validate statistical reasons for TOW dynamics to produce the high performance despite its simplicity. These results imply that various physical systems in which some conservation law holds can be used to implement an efficient ‘decision-making object’. The proposed scheme will provide a new perspective to open up a physics-based analog computing paradigm and to understanding the biological information-processing principles that exploit their underlying physics. (paper)

  10. A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour.

    Science.gov (United States)

    Stott, Jeffrey J; Redish, A David

    2014-11-05

    Both orbitofrontal cortex (OFC) and ventral striatum (vStr) have been identified as key structures that represent information about value in decision-making tasks. However, the dynamics of how this information is processed are not yet understood. We recorded ensembles of cells from OFC and vStr in rats engaged in the spatial adjusting delay-discounting task, a decision-making task that involves a trade-off between delay to and magnitude of reward. Ventral striatal neural activity signalled information about reward before the rat's decision, whereas such reward-related signals were absent in OFC until after the animal had committed to its decision. These data support models in which vStr is directly involved in action selection, but OFC processes decision-related information afterwards that can be used to compare the predicted and actual consequences of behaviour. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

  11. Acute Stress Influences Neural Circuits of Reward Processing

    Directory of Open Access Journals (Sweden)

    Anthony John Porcelli

    2012-11-01

    Full Text Available People often make decisions under aversive conditions such as acute stress. Yet, less is known about the process in which acute stress can influence decision-making. A growing body of research has established that reward-related information associated with the outcomes of decisions exerts a powerful influence over the choices people make and that an extensive network of brain regions, prominently featuring the striatum, is involved in the processing of this reward-related information. Thus, an important step in research on the nature of acute stress’ influence over decision-making is to examine how it may modulate responses to rewards and punishments within reward-processing neural circuitry. In the current experiment, we employed a simple reward processing paradigm – where participants received monetary rewards and punishments – known to evoke robust striatal responses. Immediately prior to performing each of two task runs, participants were exposed to acute stress (i.e., cold pressor or a no stress control procedure in a between-subjects fashion. No stress group participants exhibited a pattern of activity within the dorsal striatum and orbitofrontal cortex consistent with past research on outcome processing – specifically, differential responses for monetary rewards over punishments. In contrast, acute stress group participants’ dorsal striatum and orbitofrontal cortex demonstrated decreased sensitivity to monetary outcomes and a lack of differential activity. These findings provide insight into how neural circuits may process rewards and punishments associated with simple decisions under acutely stressful conditions.

  12. School-Based Decision-Making: The Canadian Perspective.

    Science.gov (United States)

    Peters, Frank

    1997-01-01

    In Canada, school-based decision making is a political expedient to co-opt public support for public education at the same time as financial resources to schools are being curtailed. School councils are advisory in nature and have no statutory position in either school or school-system decisions. (17 references) (MLF)

  13. Contingency Management and deliberative decision-making processes

    Directory of Open Access Journals (Sweden)

    Paul S. Regier

    2015-06-01

    Full Text Available Contingency Management is an effective treatment for drug addiction. The current explanation for its success is rooted in alternative reinforcement theory. We suggest that alternative reinforcement theory is inadequate to explain the success of Contingency Management and produce a model based on demand curves that show how little the monetary rewards offered in this treatment would affect drug use. Instead, we offer an explanation of its success based on the concept that it accesses deliberative decision-making processes. We suggest that Contingency Management is effective because it offers a concrete and immediate alternative to using drugs, which engages deliberative processes, improves the ability of those deliberative processes to attend to non-drug options, and offsets more automatic action-selection systems. This theory makes explicit predictions that can be tested, suggests which users will be most helped by Contingency Management, and suggests improvements in its implementation.

  14. Contingency Management and Deliberative Decision-Making Processes.

    Science.gov (United States)

    Regier, Paul S; Redish, A David

    2015-01-01

    Contingency management is an effective treatment for drug addiction. The current explanation for its success is rooted in alternative reinforcement theory. We suggest that alternative reinforcement theory is inadequate to explain the success of contingency management and produce a model based on demand curves that show how little the monetary rewards offered in this treatment would affect drug use. Instead, we offer an explanation of its success based on the concept that it accesses deliberative decision-making processes. We suggest that contingency management is effective because it offers a concrete and immediate alternative to using drugs, which engages deliberative processes, improves the ability of those deliberative processes to attend to non-drug options, and offsets more automatic action-selection systems. This theory makes explicit predictions that can be tested, suggests which users will be most helped by contingency management, and suggests improvements in its implementation.

  15. How social cognition can inform social decision making

    Science.gov (United States)

    Lee, Victoria K.; Harris, Lasana T.

    2013-01-01

    Social decision-making is often complex, requiring the decision-maker to make inferences of others' mental states in addition to engaging traditional decision-making processes like valuation and reward processing. A growing body of research in neuroeconomics has examined decision-making involving social and non-social stimuli to explore activity in brain regions such as the striatum and prefrontal cortex, largely ignoring the power of the social context. Perhaps more complex processes may influence decision-making in social vs. non-social contexts. Years of social psychology and social neuroscience research have documented a multitude of processes (e.g., mental state inferences, impression formation, spontaneous trait inferences) that occur upon viewing another person. These processes rely on a network of brain regions including medial prefrontal cortex (MPFC), superior temporal sulcus (STS), temporal parietal junction, and precuneus among others. Undoubtedly, these social cognition processes affect social decision-making since mental state inferences occur spontaneously and automatically. Few studies have looked at how these social inference processes affect decision-making in a social context despite the capability of these inferences to serve as predictions that can guide future decision-making. Here we review and integrate the person perception and decision-making literatures to understand how social cognition can inform the study of social decision-making in a way that is consistent with both literatures. We identify gaps in both literatures—while behavioral economics largely ignores social processes that spontaneously occur upon viewing another person, social psychology has largely failed to talk about the implications of social cognition processes in an economic decision-making context—and examine the benefits of integrating social psychological theory with behavioral economic theory. PMID:24399928

  16. How social cognition can inform social decision making.

    Science.gov (United States)

    Lee, Victoria K; Harris, Lasana T

    2013-12-25

    Social decision-making is often complex, requiring the decision-maker to make inferences of others' mental states in addition to engaging traditional decision-making processes like valuation and reward processing. A growing body of research in neuroeconomics has examined decision-making involving social and non-social stimuli to explore activity in brain regions such as the striatum and prefrontal cortex, largely ignoring the power of the social context. Perhaps more complex processes may influence decision-making in social vs. non-social contexts. Years of social psychology and social neuroscience research have documented a multitude of processes (e.g., mental state inferences, impression formation, spontaneous trait inferences) that occur upon viewing another person. These processes rely on a network of brain regions including medial prefrontal cortex (MPFC), superior temporal sulcus (STS), temporal parietal junction, and precuneus among others. Undoubtedly, these social cognition processes affect social decision-making since mental state inferences occur spontaneously and automatically. Few studies have looked at how these social inference processes affect decision-making in a social context despite the capability of these inferences to serve as predictions that can guide future decision-making. Here we review and integrate the person perception and decision-making literatures to understand how social cognition can inform the study of social decision-making in a way that is consistent with both literatures. We identify gaps in both literatures-while behavioral economics largely ignores social processes that spontaneously occur upon viewing another person, social psychology has largely failed to talk about the implications of social cognition processes in an economic decision-making context-and examine the benefits of integrating social psychological theory with behavioral economic theory.

  17. How Social Cognition Can Inform Social Decision Making

    Directory of Open Access Journals (Sweden)

    Victoria eLee

    2013-12-01

    Full Text Available Social decision-making is often complex, requiring the decision-maker to make inferences of others’ mental states in addition to engaging traditional decision-making processes like valuation and reward processing. A growing body of research in neuroeconomics has examined decision- making involving social and nonsocial stimuli to explore activity in brain regions such as the striatum and prefrontal cortex, largely ignoring the power of the social context. Perhaps more complex processes may influence decision-making in social versus nonsocial contexts. Years of social psychology and social neuroscience research have documented a multitude of processes (e.g. mental state inferences, impression formation, spontaneous trait inferences that occur upon viewing another person. These processes rely on a network of brain regions including medial prefrontal cortex, superior temporal sulcus, temporal parietal junction, and precuneus among others. Undoubtedly, these social cognition processes affect social decision-making since mental state inferences occur spontaneously and automatically. Few studies have looked at how these social inference processes affect decision-making in a social context despite the capability of these inferences to serve as predictions that can guide future decision-making. Here we review and integrate the person perception and decision-making literatures to understand how social cognition can inform the study of social decision-making in a way that is consistent with both literatures. We identify gaps in both literatures—while behavioral economics largely ignores social processes that spontaneously occur upon viewing another person, social psychology has largely failed to talk about the implications of social cognition processes in an economic decision-making context—and examine the benefits of integrating social psychological theory with behavioral economic theory.

  18. Impairment of decision-making in multiple sclerosis: A neuroeconomic approach.

    Science.gov (United States)

    Sepúlveda, Maria; Fernández-Diez, Begoña; Martínez-Lapiscina, Elena H; Llufriu, Sara; Sola-Valls, Nuria; Zubizarreta, Irati; Blanco, Yolanda; Saiz, Albert; Levy, Dino; Glimcher, Paul; Villoslada, Pablo

    2017-11-01

    To assess the decision-making impairment in patients with multiple sclerosis (MS) and how they relate to other cognitive domains. We performed a cross-sectional analysis in 84 patients with MS, and 21 matched healthy controls using four tasks taken from behavioral economics: (1) risk preferences, (2) choice consistency, (3) delay of gratification, and (4) rate of learning. All tasks were conducted using real-world reward outcomes (food or money) in different real-life conditions. Participants underwent cognitive examination using the Brief Repeatable Battery-Neuropsychology. Patients showed higher risk aversion (general propensity to choose the lottery was 0.51 vs 0.64, p = 0.009), a trend to choose more immediate rewards over larger but delayed rewards ( p = 0.108), and had longer reactions times ( p = 0.033). Choice consistency and learning rates were not different between groups. Progressive patients chose slower than relapsing patients. In relation to general cognitive impairments, we found correlations between impaired decision-making and impaired verbal memory ( r = 0.29, p = 0.009), visual memory ( r = -0.37, p = 0.001), and reduced processing speed ( r = -0.32, p = 0.001). Normalized gray matter volume correlated with deliberation time ( r = -0.32, p = 0.005). Patients with MS suffer significant decision-making impairments, even at the early stages of the disease, and may affect patients' quality and social life.

  19. Risk-Based Decision Making for Deterioration Processes Using POMDP

    DEFF Research Database (Denmark)

    Nielsen, Jannie Sønderkær; Sørensen, John Dalsgaard

    2015-01-01

    This paper proposes a method for risk-based decision making for maintenance of deteriorating components, based on the partially observable Markov decision process (POMDP). Unlike most methods, the decision polices do not need to be stationary and can vary according to seasons and near the end...

  20. Scaffolding across the lifespan in history-dependent decision-making.

    Science.gov (United States)

    Cooper, Jessica A; Worthy, Darrell A; Gorlick, Marissa A; Maddox, W Todd

    2013-06-01

    We examined the relationship between pressure and age-related changes in decision-making using a task for which currently available rewards depend on the participant's previous history of choices. Optimal responding in this task requires the participant to learn how his or her current choices affect changes in the future rewards given for each option. Building on the scaffolding theory of aging and cognition, we predicted that when additional frontal resources are available, compensatory recruitment leads to increased monitoring and increased use of heuristic-based strategies, ultimately leading to better performance. Specifically, we predicted that scaffolding would result in an age-related performance advantage under no pressure conditions. We also predicted that, although younger adults would engage in scaffolding under pressure, older adults would not have additional resources available for increased scaffolding under pressure-packed conditions, leading to an age-related performance deficit. Both predictions were supported by the data. In addition, computational models were used to evaluate decision-making strategies employed by each participant group. As expected, older adults under no pressure conditions and younger adults under pressure conditions showed increased use of heuristic-based strategies relative to older adults under pressure and younger adults under no pressure, respectively. These results are consistent with the notion that scaffolding can occur across the life span in the face of an environmental challenge. PsycINFO Database Record (c) 2013 APA, all rights reserved.

  1. Grey situation group decision-making method based on prospect theory.

    Science.gov (United States)

    Zhang, Na; Fang, Zhigeng; Liu, Xiaqing

    2014-01-01

    This paper puts forward a grey situation group decision-making method on the basis of prospect theory, in view of the grey situation group decision-making problems that decisions are often made by multiple decision experts and those experts have risk preferences. The method takes the positive and negative ideal situation distance as reference points, defines positive and negative prospect value function, and introduces decision experts' risk preference into grey situation decision-making to make the final decision be more in line with decision experts' psychological behavior. Based on TOPSIS method, this paper determines the weight of each decision expert, sets up comprehensive prospect value matrix for decision experts' evaluation, and finally determines the optimal situation. At last, this paper verifies the effectiveness and feasibility of the method by means of a specific example.

  2. Developmental changes in autonomic responses are associated with future reward/punishment expectations: A study of sympathetic skin responses in the Markov decision task.

    Science.gov (United States)

    Hosaka, Hiromi; Aoyagi, Kakuro; Kaga, Yoshimi; Kanemura, Hideaki; Sugita, Kanji; Aihara, Masao

    2017-08-01

    Autonomic nervous system activity is recognized as a major component of emotional responses. Future reward/punishment expectations depend upon the process of decision making in the frontal lobe, which is considered to play an important role in executive function. The aim of this study was to investigate the relationship between autonomic responses and decision making during reinforcement tasks using sympathetic skin responses (SSR). Nine adult and 9 juvenile (mean age, 10.2years) volunteers were enrolled in this study. SSRs were measured during the Markov decision task (MDT), which is a reinforcement task. In this task, subjects must endure a small immediate loss to ultimately get a large reward. The subjects had to undergo three sets of tests and their scores in these tests were assessed and evaluated. All adults showed gradually increasing scores for the MDT from the first to third set. As the trial progressed from the first to second set in adults, SSR appearance ratios remarkably increased for both punishment and reward expectations. In comparison with adults, children showed decreasing scores from the first to second set. There were no significant inter-target differences in the SSR appearance ratio in the first and second set in children. In the third set, the SSR appearance ratio for reward expectations was higher than that in the neutral condition. In reinforcement tasks, such as MDT, autonomic responses play an important role in decision making. We assume that SSRs are elicited during efficient decision making tasks associated with future reward/punishment expectations, which demonstrates the importance of autonomic function. In contrast, in children around the age of 10years, the autonomic system does not react as an organized response specific to reward/punishment expectations. This suggests the immaturity of the future reward/punishment expectations process in children. Copyright © 2017 The Japanese Society of Child Neurology. Published by Elsevier B

  3. An Intuitionistic Fuzzy Stochastic Decision-Making Method Based on Case-Based Reasoning and Prospect Theory

    Directory of Open Access Journals (Sweden)

    Peng Li

    2017-01-01

    Full Text Available According to the case-based reasoning method and prospect theory, this paper mainly focuses on finding a way to obtain decision-makers’ preferences and the criterion weights for stochastic multicriteria decision-making problems and classify alternatives. Firstly, we construct a new score function for an intuitionistic fuzzy number (IFN considering the decision-making environment. Then, we aggregate the decision-making information in different natural states according to the prospect theory and test decision-making matrices. A mathematical programming model based on a case-based reasoning method is presented to obtain the criterion weights. Moreover, in the original decision-making problem, we integrate all the intuitionistic fuzzy decision-making matrices into an expectation matrix using the expected utility theory and classify or rank the alternatives by the case-based reasoning method. Finally, two illustrative examples are provided to illustrate the implementation process and applicability of the developed method.

  4. Evidence-based decision making in health care settings: from theory to practice.

    Science.gov (United States)

    Kohn, Melanie Kazman; Berta, Whitney; Langley, Ann; Davis, David

    2011-01-01

    The relatively recent attention that evidence-based decision making has received in health care management has been at least in part due to the profound influence of evidence-based medicine. The result has been several comparisons in the literature between the use of evidence in health care management decisions and the use of evidence in medical decision making. Direct comparison, however, may be problematic, given the differences between medicine and management as they relate to (1) the nature of evidence that is brought to bear on decision making; (2) the maturity of empirical research in each field (in particular, studies that have substantiated whether or not and how evidence-based decision making is enacted); and (3) the context within which evidence-based decisions are made. By simultaneously reviewing evidence-based medicine and management, this chapter aims to inform future theorizing and empirical research on evidence-based decision making in health care settings.

  5. Implementing shared decision-making: consider all the consequences.

    Science.gov (United States)

    Elwyn, Glyn; Frosch, Dominick L; Kobrin, Sarah

    2016-08-08

    The ethical argument that shared decision-making is "the right" thing to do, however laudable, is unlikely to change how healthcare is organized, just as evidence alone will be an insufficient factor: practice change is governed by factors such as cost, profit margin, quality, and efficiency. It is helpful, therefore, when evaluating new approaches such as shared decision-making to conceptualize potential consequences in a way that is broad, long-term, and as relevant as possible to multiple stakeholders. Yet, so far, evaluation metrics for shared decision-making have been mostly focused on short-term outcomes, such as cognitive or affective consequences in patients. The goal of this article is to hypothesize a wider set of consequences, that apply over an extended time horizon, and include outcomes at interactional, team, organizational and system levels, and to call for future research to study these possible consequences. To date, many more studies have evaluated patient decision aids rather than other approaches to shared decision-making, and the outcomes measured have typically been focused on short-term cognitive and affective outcomes, for example knowledge and decisional conflict. From a clinicians perspective, the shared decision-making process could be viewed as either intrinsically rewarding and protective, or burdensome and impractical, yet studies have not focused on the impact on professionals, either positive or negative. At interactional levels, group, team, and microsystem, the potential long-term consequences could include the development of a culture where deliberation and collaboration are regarded as guiding principles, where patients are coached to assess the value of interventions, to trade-off benefits versus harms, and assess their burdens-in short, to new social norms in the clinical workplace. At organizational levels, consistent shared decision-making might boost patient experience evaluations and lead to fewer complaints and legal

  6. Now or not-now? The influence of alexithymia on intertemporal decision-making.

    Science.gov (United States)

    Scarpazza, Cristina; Sellitto, Manuela; di Pellegrino, Giuseppe

    2017-06-01

    Optimal intertemporal decisions arise from the balance between an emotional-visceral component, signaling the need for immediate gratification, and a rational, long-term oriented component. Alexithymia, a personality construct characterized by amplified sensitivity to internal bodily signals of arousal, may result in enhanced activation of the emotional-visceral component over the cognitive-rational one. To test this hypothesis, participants with high- and low-alexithymia level were compared at an intertemporal decision-making task, and their choice behavior correlated with their interoceptive sensitivity. We show that high-alexithymic tend to behave more impatiently than low-alexithymic in intertemporal decisions, particularly when the sooner reward is immediately available. Moreover, the greater their sensitivity to their own visceral sensations, the greater the impatience. Together, these results suggest a disproportionate valuation of reward available immediately in high alexithymia, possibly reflecting heightened perception of bodily physiological signals, which ultimately would bias their intertemporal decision-making. Copyright © 2017 Elsevier Inc. All rights reserved.

  7. Decision Making under Ambiguity and Objective Risk in Higher Age - A Review on Cognitive and Emotional Contributions.

    Science.gov (United States)

    Liebherr, Magnus; Schiebener, Johannes; Averbeck, Heike; Brand, Matthias

    2017-01-01

    The ability of decision making plays a highly relevant role in our survival, but is adversely affected during the process of aging. The present review aims to provide a better understanding of age-related differences in decision making and the role of cognitive and emotional factors in this context. We reviewed the literature about age-effects on decision-making performance, focusing on decision making under ambiguous and objective risk. In decisions under ambiguous risks, as measured by the Iowa Gambling Task, decisions are based on the experiences with consequences. In this case, many articles have attributed age-related impairments in decision making to changes in emotional and somatic reward- and punishment processing. In decisions under objective risks, as measured for example by the Game of Dice Task, decisions can be based on explicit information about risks and consequences. In this case, age-related changes have been attributed mainly to a cognitive decline, particularly impaired executive functions. However, recent findings challenge these conclusions. The present review summarizes neuropsychological and neurophysiological findings of age-related differences in decision making under ambiguous and objective risk. In this context, the relevance of learning, but also of cognitive and emotional contributors - responsible for age-related differences in decision making - are additionally pointed out.

  8. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex.

    Science.gov (United States)

    Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John

    2013-02-13

    A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity.

  9. Think twice: Impulsivity and decision making in obsessive-compulsive disorder

    NARCIS (Netherlands)

    Grassi, Giacomo; Pallanti, Stefano; Righi, Lorenzo; Figee, Martijn; Mantione, Mariska; Denys, Damiaan; Piccagliani, Daniele; Rossi, Alessandro; Stratta, Paolo

    2015-01-01

    Recent studies have challenged the anxiety-avoidance model of obsessive-compulsive disorder (OCD), linking OCD to impulsivity, risky-decision-making and reward-system dysfunction, which can also be found in addiction and might support the conceptualization of OCD as a behavioral addiction. Here, we

  10. An Exploration of Dual Systems via Time Pressure Manipulation in Decision-making Problems

    Science.gov (United States)

    Guo, Lisa

    Every day, decisions need to be made where time is a limiting factor. Regardless of situation, time constraints often place a premium on rapid decision-making. Researchers have been interested in studying this human behavior and understanding its underlying cognitive processes. In previous studies, scientists have believed that the cognitive processes underlying decision-making behavior were consistent with dual-process modes of thinking. Critics of dual-process theory question the vagueness of its definition, and claim that single-process accounts can explain the data just as well. My aim is to elucidate the cognitive processes that underlie decisions which involve some level of risk through the experimental manipulation of time pressure. Using this method, I hope to distinguish between competing hypotheses related to the origin of the effect. I will explore three types of decisions that illustrate these concepts: risky decision-making involving gambles, intertemporal choice, and one-shot public goods games involving social cooperation. In our experiments, participants made decisions about gambles framed as either gains or losses; decided upon intertemporal choices for smaller but sooner rewards or larger but later rewards; and played a one-shot public goods game involving social cooperation and contributing an amount of money to a group. In each case, we experimentally manipulated time pressure, either within subjects or among individuals. Results showed under time pressure, increased framing effects under in both hypothetical and incentivized choices; and greater contributions and cooperation among individuals, lending support to the dual process hypothesis that these effects arise from a fast, intuitive system. However, our intertemporal choice experiment showed that time constraints led to increased selection of the larger but later options, which suggests that the magnitude of the reward may play larger role in choice selection under cognitive load than

  11. Think twice: Impulsivity and decision making in obsessive-compulsive disorder.

    Science.gov (United States)

    Grassi, Giacomo; Pallanti, Stefano; Righi, Lorenzo; Figee, Martijn; Mantione, Mariska; Denys, Damiaan; Piccagliani, Daniele; Rossi, Alessandro; Stratta, Paolo

    2015-12-01

    Recent studies have challenged the anxiety-avoidance model of obsessive-compulsive disorder (OCD), linking OCD to impulsivity, risky-decision-making and reward-system dysfunction, which can also be found in addiction and might support the conceptualization of OCD as a behavioral addiction. Here, we conducted an exploratory investigation of the behavioral addiction model of OCD by assessing whether OCD patients are more impulsive, have impaired decision-making, and biased probabilistic reasoning, three core dimensions of addiction, in a sample of OCD patients and healthy controls. We assessed these dimensions on 38 OCD patients and 39 healthy controls with the Barratt Impulsiveness Scale (BIS-11), the Iowa Gambling Task (IGT) and the Beads Task. OCD patients had significantly higher BIS-11 scores than controls, in particular on the cognitive subscales. They performed significantly worse than controls on the IGT preferring immediate reward despite negative future consequences, and did not learn from losses. Finally, OCD patients demonstrated biased probabilistic reasoning as reflected by significantly fewer draws to decision than controls on the Beads Task. OCD patients are more impulsive than controls and demonstrate risky decision-making and biased probabilistic reasoning. These results might suggest that other conceptualizations of OCD, such as the behavioral addiction model, may be more suitable than the anxiety-avoidance one. However, further studies directly comparing OCD and behavioral addiction patients are needed in order to scrutinize this model.

  12. The role of muscarinic cholinergic signaling in cost-benefit decision making

    Science.gov (United States)

    Fobbs, Wambura

    Animals regularly face decisions that affect both their immediate success and long term survival. Such decisions typically involve some form of cost-benefit analysis and engage a number of high level cognitive processes, including learning, memory and motivational influences. While decision making has been a focus of study for over a century, it's only in the last 20 years that researchers have begun to identify functional neural circuits that subserve different forms of cost-benefit decision making. Even though the cholinergic system is both functionally and anatomically positioned to modulate cost-benefit decision circuits, the contribution of the cholinergic system to decision making has been little studied. In this thesis, I investigated the cognitive and neural contribution of muscarinic cholinergic signaling to cost-benefit decision making. I, first, re-examined the effects of systemic administration of 0.3 mg/kg atropine on delay and probability discounting tasks and found that blockade of muscarinic acetylcholine receptors by atropine induced suboptimal choices (impulsive and risky) in both tasks. Since the effect on delay discounting was restricted to the No Cue version of the delay discounting task, I concluded that muscarinic cholinergic signaling mediates both forms of cost-benefit decision making and is selectively engaged when decisions require valuation of reward options whose costs are not externally signified. Second, I assessed the impact of inactivating the nucleus basalis (NBM) on both forms decision making and the effect of injecting atropine locally into the orbitofrontal cortex (OFC), basolateral amygdala (BLA), or nucleus accumbens (NAc) core during the No Cue version of the delay discounting task. I discovered that although NBM inactivation failed to affect delay discounting, it induced risk aversion in the probability discounting task; and blockade of intra- NAc core, but not intra-OFC or intra-BLA, muscarinic cholinergic signaling lead to

  13. Promotion of technical harmonisation on risk-based decision making

    International Nuclear Information System (INIS)

    Kirchsteiger, Christian; Cojazzi, Giacomo

    2000-01-01

    The EC-JRC International Workshop on Promotion of Technical Harmonisation on Risk-Based Decision Making, held at Stresa and Ispra, Italy, 22-25 May 2000, was an experts meeting to discuss the possible need of developing an internationally accepted generic 'standard' for risk-based decision making.This paper briefly describes the workshop background, its organisation and summarises its main results and conclusions; it reflects the personal opinions of the authors and in no way commits the European Commission. (author)

  14. Decision Making under Ambiguity and Objective Risk in Higher Age – A Review on Cognitive and Emotional Contributions

    Directory of Open Access Journals (Sweden)

    Magnus Liebherr

    2017-12-01

    Full Text Available The ability of decision making plays a highly relevant role in our survival, but is adversely affected during the process of aging. The present review aims to provide a better understanding of age-related differences in decision making and the role of cognitive and emotional factors in this context. We reviewed the literature about age-effects on decision-making performance, focusing on decision making under ambiguous and objective risk. In decisions under ambiguous risks, as measured by the Iowa Gambling Task, decisions are based on the experiences with consequences. In this case, many articles have attributed age-related impairments in decision making to changes in emotional and somatic reward- and punishment processing. In decisions under objective risks, as measured for example by the Game of Dice Task, decisions can be based on explicit information about risks and consequences. In this case, age-related changes have been attributed mainly to a cognitive decline, particularly impaired executive functions. However, recent findings challenge these conclusions. The present review summarizes neuropsychological and neurophysiological findings of age-related differences in decision making under ambiguous and objective risk. In this context, the relevance of learning, but also of cognitive and emotional contributors – responsible for age-related differences in decision making – are additionally pointed out.

  15. Decision Making under Ambiguity and Objective Risk in Higher Age – A Review on Cognitive and Emotional Contributions

    Science.gov (United States)

    Liebherr, Magnus; Schiebener, Johannes; Averbeck, Heike; Brand, Matthias

    2017-01-01

    The ability of decision making plays a highly relevant role in our survival, but is adversely affected during the process of aging. The present review aims to provide a better understanding of age-related differences in decision making and the role of cognitive and emotional factors in this context. We reviewed the literature about age-effects on decision-making performance, focusing on decision making under ambiguous and objective risk. In decisions under ambiguous risks, as measured by the Iowa Gambling Task, decisions are based on the experiences with consequences. In this case, many articles have attributed age-related impairments in decision making to changes in emotional and somatic reward- and punishment processing. In decisions under objective risks, as measured for example by the Game of Dice Task, decisions can be based on explicit information about risks and consequences. In this case, age-related changes have been attributed mainly to a cognitive decline, particularly impaired executive functions. However, recent findings challenge these conclusions. The present review summarizes neuropsychological and neurophysiological findings of age-related differences in decision making under ambiguous and objective risk. In this context, the relevance of learning, but also of cognitive and emotional contributors – responsible for age-related differences in decision making – are additionally pointed out. PMID:29270145

  16. Individual differences in voluntary alcohol intake in rats : relationship with impulsivity, decision making and Pavlovian conditioned approach

    NARCIS (Netherlands)

    Spoelder, Marcia; Flores Dourojeanni, Jacques P; de Git, Kathy C G; Baars, Annemarie M; Lesscher, Heidi M B; Vanderschuren, Louk J M J

    RATIONALE: Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood. OBJECTIVES: This study aims to assess decision making,

  17. Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach

    NARCIS (Netherlands)

    Spoelder, M.; Dourojeanni, J.P.F.; Git, K.C.G. de; Baars, A.M.; Lesscher, H.M.; Vanderschuren, L.

    2017-01-01

    RATIONALE: Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood. OBJECTIVES: This study aims to assess decision making,

  18. Cognitive schema and naturalistic decision making in evidence-based practices.

    Science.gov (United States)

    Falzer, Paul R

    2004-04-01

    A recent article in this journal proposed a naturalistic approach to decision making that overcomes problems intrinsic to classical decision theory. The approach emphasizes cognitive and multi-level processes, the development of expert reasoning, and the role of decision support in individual and organizational decision making. The current paper builds on this effort by suggesting a naturalistic, multi-level, theory that can facilitate the dissemination of evidence-based practices (EBPs). The paper presents "Image Theory," a theory that has been extensively investigated in other disciplines, but has yet to be utilized in medical decision research. It is suggested that its rich, empirically tested, distinctions among kinds of cognitive and organizational processes and types of decisions and tasks make Image Theory especially valuable in describing impediments to implementing EBPs. The paper discusses how naturalistic theory can assist clinicians, administrators, researchers, and policy makers in achieving a balance between evidence-based medicine and patient-centered practice.

  19. Purchase decision-making is modulated by vestibular stimulation.

    Science.gov (United States)

    Preuss, Nora; Mast, Fred W; Hasler, Gregor

    2014-01-01

    Purchases are driven by consumers' product preferences and price considerations. Using caloric vestibular stimulation (CVS), we investigated the role of vestibular-affective circuits in purchase decision-making. CVS is an effective noninvasive brain stimulation method, which activates vestibular and overlapping emotional circuits (e.g., the insular cortex and the anterior cingulate cortex (ACC)). Subjects were exposed to CVS and sham stimulation while they performed two purchase decision-making tasks. In Experiment 1 subjects had to decide whether to purchase or not. CVS significantly reduced probability of buying a product. In Experiment 2 subjects had to rate desirability of the products and willingness to pay (WTP) while they were exposed to CVS and sham stimulation. CVS modulated desirability of the products but not WTP. The results suggest that CVS interfered with emotional circuits and thus attenuated the pleasant and rewarding effect of acquisition, which in turn reduced purchase probability. The present findings contribute to the rapidly growing literature on the neural basis of purchase decision-making.

  20. Insular neural system controls decision-making in healthy and methamphetamine-treated rats.

    Science.gov (United States)

    Mizoguchi, Hiroyuki; Katahira, Kentaro; Inutsuka, Ayumu; Fukumoto, Kazuya; Nakamura, Akihiro; Wang, Tian; Nagai, Taku; Sato, Jun; Sawada, Makoto; Ohira, Hideki; Yamanaka, Akihiro; Yamada, Kiyofumi

    2015-07-21

    Patients suffering from neuropsychiatric disorders such as substance-related and addictive disorders exhibit altered decision-making patterns, which may be associated with their behavioral abnormalities. However, the neuronal mechanisms underlying such impairments are largely unknown. Using a gambling test, we demonstrated that methamphetamine (METH)-treated rats chose a high-risk/high-reward option more frequently and assigned higher value to high returns than control rats, suggestive of changes in decision-making choice strategy. Immunohistochemical analysis following the gambling test revealed aberrant activation of the insular cortex (INS) and nucleus accumbens in METH-treated animals. Pharmacological studies, together with in vivo microdialysis, showed that the insular neural system played a crucial role in decision-making. Moreover, manipulation of INS activation using designer receptor exclusively activated by designer drug technology resulted in alterations to decision-making. Our findings suggest that the INS is a critical region involved in decision-making and that insular neural dysfunction results in risk-taking behaviors associated with altered decision-making.

  1. Medical decision-making in children and adolescents: developmental and neuroscientific aspects.

    Science.gov (United States)

    Grootens-Wiegers, Petronella; Hein, Irma M; van den Broek, Jos M; de Vries, Martine C

    2017-05-08

    Various international laws and guidelines stress the importance of respecting the developing autonomy of children and involving minors in decision-making regarding treatment and research participation. However, no universal agreement exists as to at what age minors should be deemed decision-making competent. Minors of the same age may show different levels of maturity. In addition, patients deemed rational conversation-partners as a child can suddenly become noncompliant as an adolescent. Age, context and development all play a role in decision-making competence. In this article we adopt a perspective on competence that specifically focuses on the impact of brain development on the child's decision-making process. We believe that the discussion on decision-making competence of minors can greatly benefit from a multidisciplinary approach. We adopted such an approach in order to contribute to the understanding on how to deal with children in decision-making situations. Evidence emerging from neuroscience research concerning the developing brain structures in minors is combined with insights from various other fields, such as psychology, decision-making science and ethics. Four capacities have been described that are required for (medical) decision-making: (1) communicating a choice; (2) understanding; (3) reasoning; and (4) appreciation. Each capacity is related to a number of specific skills and abilities that need to be sufficiently developed to support the capacity. Based on this approach it can be concluded that at the age of 12 children can have the capacity to be decision-making competent. However, this age coincides with the onset of adolescence. Early development of the brain's reward system combined with late development of the control system diminishes decision-making competence in adolescents in specific contexts. We conclude that even adolescents possessing capacities required for decision-making, may need support of facilitating environmental factors

  2. Agent-Based Modeling of Consumer Decision making Process Based on Power Distance and Personality

    NARCIS (Netherlands)

    Roozmand, O.; Ghasem-Aghaee, N.; Hofstede, G.J.; Nematbakhsh, M.A.; Baraani, A.; Verwaart, T.

    2011-01-01

    Simulating consumer decision making processes involves different disciplines such as: sociology, social psychology, marketing, and computer science. In this paper, we propose an agent-based conceptual and computational model of consumer decision-making based on culture, personality and human needs.

  3. Memory Effect on Adaptive Decision Making with a Chaotic Semiconductor Laser

    Directory of Open Access Journals (Sweden)

    Takatomo Mihana

    2018-01-01

    Full Text Available We investigate the effect of a memory parameter on the performance of adaptive decision making using a tug-of-war method with the chaotic oscillatory dynamics of a semiconductor laser. We experimentally generate chaotic temporal waveforms of the semiconductor laser with optical feedback and apply them for adaptive decision making in solving a multiarmed bandit problem that aims at maximizing the total reward from slot machines whose hit probabilities are dynamically switched. We examine the dependence of making correct decisions on different values of the memory parameter. The degree of adaptivity is found to be enhanced with a smaller memory parameter, whereas the degree of convergence to the correct decision is higher for a larger memory parameter. The relations among the adaptivity, environmental changes, and the difficulties of the problem are also discussed considering the requirement of past decisions. This examination of ultrafast adaptive decision making highlights the importance of memorizing past events and paves the way for future photonic intelligence.

  4. Building bridges between perceptual and economic decision-making: neural and computational mechanisms

    Directory of Open Access Journals (Sweden)

    Christopher eSummerfield

    2012-05-01

    Full Text Available Investigation into the neural and computational bases of decision-making has proceeded in two parallel but distinct streams. Perceptual decision making (PDM is concerned with how observers detect, discriminate and categorise noisy sensory information. Economic decision making (EDM explores how options are selected on the basis of their reinforcement history. Traditionally, the subfields of PDM and EDM have employed different paradigms, proposed different mechanistic models, explored different brain regions, disagreed about whether decisions approach optimality. Nevertheless, we argue that there is a common framework for understanding decisions made in both domains, under which an agent has to combine sensory information (what is the stimulus with value information (what is it worth. We review computational models of the decision process typically used in PDM, based around the idea that decisions involve a serial integration of evidence, and assess their applicability to decisions between good and gambles. Subsequently, we consider the contribution of three key brain regions – the parietal cortex, the basal ganglia, and the orbitofrontal cortex – to perceptual and economic decision-making, with a focus on the mechanisms by which sensory and reward information are integrated during choice. We find that although the parietal cortex is often implicated in the integration of sensory evidence, there is evidence for its role in encoding the expected value of a decision. Similarly, although much research has emphasised the role of the striatum and orbitofrontal cortex in value-guided choices, they may play an important role in categorisation of perceptual information. In conclusion, we consider how findings from the two fields might be brought together, in order to move towards a general framework for understanding decision-making in humans and other primates.

  5. Supporting decision-making processes for evidence-based mental health promotion.

    Science.gov (United States)

    Jané-Llopis, Eva; Katschnig, Heinz; McDaid, David; Wahlbeck, Kristian

    2011-12-01

    The use of evidence is critical in guiding decision-making, but evidence from effect studies will be only one of a number of factors that will need to be taken into account in the decision-making processes. Equally important for policymakers will be the use of different types of evidence including implementation essentials and other decision-making principles such as social justice, political, ethical, equity issues, reflecting public attitudes and the level of resources available, rather than be based on health outcomes alone. This paper, aimed to support decision-makers, highlights the importance of commissioning high-quality evaluations, the key aspects to assess levels of evidence, the importance of supporting evidence-based implementation and what to look out for before, during and after implementation of mental health promotion and mental disorder prevention programmes.

  6. Is it Worth the Effort? Novel Insights into Obesity-Associated Alterations in Cost-Benefit Decision-Making

    OpenAIRE

    Mathar, David; Horstmann, Annette; Pleger, Burkhard; Villringer, Arno; Neumann, Jane

    2016-01-01

    Cost-benefit decision-making entails the process of evaluating potential actions according to the trade-off between the expected reward (benefit) and the anticipated effort (costs). Recent research revealed that dopaminergic transmission within the fronto-striatal circuitry strongly modulates cost-benefit decision-making. Alterations within the dopaminergic fronto-striatal system have been associated with obesity, but little is known about cost-benefit decision-making differences in obese com...

  7. Reconciliation of Decision-Making Heuristics Based on Decision Trees Topologies and Incomplete Fuzzy Probabilities Sets.

    Science.gov (United States)

    Doubravsky, Karel; Dohnal, Mirko

    2015-01-01

    Complex decision making tasks of different natures, e.g. economics, safety engineering, ecology and biology, are based on vague, sparse, partially inconsistent and subjective knowledge. Moreover, decision making economists / engineers are usually not willing to invest too much time into study of complex formal theories. They require such decisions which can be (re)checked by human like common sense reasoning. One important problem related to realistic decision making tasks are incomplete data sets required by the chosen decision making algorithm. This paper presents a relatively simple algorithm how some missing III (input information items) can be generated using mainly decision tree topologies and integrated into incomplete data sets. The algorithm is based on an easy to understand heuristics, e.g. a longer decision tree sub-path is less probable. This heuristic can solve decision problems under total ignorance, i.e. the decision tree topology is the only information available. But in a practice, isolated information items e.g. some vaguely known probabilities (e.g. fuzzy probabilities) are usually available. It means that a realistic problem is analysed under partial ignorance. The proposed algorithm reconciles topology related heuristics and additional fuzzy sets using fuzzy linear programming. The case study, represented by a tree with six lotteries and one fuzzy probability, is presented in details.

  8. Reconciliation of Decision-Making Heuristics Based on Decision Trees Topologies and Incomplete Fuzzy Probabilities Sets.

    Directory of Open Access Journals (Sweden)

    Karel Doubravsky

    Full Text Available Complex decision making tasks of different natures, e.g. economics, safety engineering, ecology and biology, are based on vague, sparse, partially inconsistent and subjective knowledge. Moreover, decision making economists / engineers are usually not willing to invest too much time into study of complex formal theories. They require such decisions which can be (rechecked by human like common sense reasoning. One important problem related to realistic decision making tasks are incomplete data sets required by the chosen decision making algorithm. This paper presents a relatively simple algorithm how some missing III (input information items can be generated using mainly decision tree topologies and integrated into incomplete data sets. The algorithm is based on an easy to understand heuristics, e.g. a longer decision tree sub-path is less probable. This heuristic can solve decision problems under total ignorance, i.e. the decision tree topology is the only information available. But in a practice, isolated information items e.g. some vaguely known probabilities (e.g. fuzzy probabilities are usually available. It means that a realistic problem is analysed under partial ignorance. The proposed algorithm reconciles topology related heuristics and additional fuzzy sets using fuzzy linear programming. The case study, represented by a tree with six lotteries and one fuzzy probability, is presented in details.

  9. Decision making generalized by a cumulative probability weighting function

    Science.gov (United States)

    dos Santos, Lindomar Soares; Destefano, Natália; Martinez, Alexandre Souto

    2018-01-01

    Typical examples of intertemporal decision making involve situations in which individuals must choose between a smaller reward, but more immediate, and a larger one, delivered later. Analogously, probabilistic decision making involves choices between options whose consequences differ in relation to their probability of receiving. In Economics, the expected utility theory (EUT) and the discounted utility theory (DUT) are traditionally accepted normative models for describing, respectively, probabilistic and intertemporal decision making. A large number of experiments confirmed that the linearity assumed by the EUT does not explain some observed behaviors, as nonlinear preference, risk-seeking and loss aversion. That observation led to the development of new theoretical models, called non-expected utility theories (NEUT), which include a nonlinear transformation of the probability scale. An essential feature of the so-called preference function of these theories is that the probabilities are transformed by decision weights by means of a (cumulative) probability weighting function, w(p) . We obtain in this article a generalized function for the probabilistic discount process. This function has as particular cases mathematical forms already consecrated in the literature, including discount models that consider effects of psychophysical perception. We also propose a new generalized function for the functional form of w. The limiting cases of this function encompass some parametric forms already proposed in the literature. Far beyond a mere generalization, our function allows the interpretation of probabilistic decision making theories based on the assumption that individuals behave similarly in the face of probabilities and delays and is supported by phenomenological models.

  10. An Intelligent Fleet Condition-Based Maintenance Decision Making Method Based on Multi-Agent

    OpenAIRE

    Bo Sun; Qiang Feng; Songjie Li

    2012-01-01

    According to the demand for condition-based maintenance online decision making among a mission oriented fleet, an intelligent maintenance decision making method based on Multi-agent and heuristic rules is proposed. The process of condition-based maintenance within an aircraft fleet (each containing one or more Line Replaceable Modules) based on multiple maintenance thresholds is analyzed. Then the process is abstracted into a Multi-Agent Model, a 2-layer model structure containing host negoti...

  11. Tactical decision making under stress (TADMUS) decision support system

    OpenAIRE

    Morrison, Jeffrey G.; Kelly, Richard T.; Moore, Ronald A.; Hutchins, Susan G.

    1996-01-01

    A prototype decision support system (DSS) was developed to enhance Navy tactical decision making based on naturalistic decision processes. Displays were developed to support critical decision making tasks through recognition-primed and explanation-based reasoning processes and cognitive analysis of the decision making problems faced by Navy tactical officers in a shipboard Combat Information Center. Baseline testing in high intensity, peace keeping, littoral scenarios indicated...

  12. Sleep-dependent modulation of affectively guided decision-making.

    Science.gov (United States)

    Pace-Schott, Edward F; Nave, Genevieve; Morgan, Alexandra; Spencer, Rebecca M C

    2012-02-01

    A question of great interest in current sleep research is whether and how sleep might facilitate complex cognitive skills such as decision-making. The Iowa Gambling Task (IGT) was used to investigate effects of sleep on affect-guided decision-making. After a brief standardized preview of the IGT that was insufficient to learn its underlying rule, participants underwent a 12-h delay containing either a normal night's sleep (Sleep group; N = 28) or continuous daytime wake (Wake group; N = 26). Following the delay, both groups performed the full IGT. To control for circadian effects, two additional groups performed both the preview and the full task either in the morning (N = 17) or the evening (N = 21). In the IGT, four decks of cards were presented. Draws from two 'advantageous decks' yielded low play-money rewards, occasional low losses and, over multiple draws, a net gain. Draws from 'disadvantageous' decks yielded high rewards, occasional high losses and, over multiple draws, a net loss. Participants were instructed to win and avoid losing as much as possible, and better performance was defined as more advantageous draws. Relative to the wake group, the sleep group showed both superior behavioral outcome (more advantageous draws) and superior rule understanding (blindly judged from statements written at task completion). Neither measure differentiated the two control groups. These results illustrate a role of sleep in optimizing decision-making, a benefit that may be brought about by changes in underlying emotional or cognitive processes. © 2011 European Sleep Research Society.

  13. The Effect of Conflict Theory Based Decision-Making Skill Training Psycho-Educational Group Experience on Decision Making Styles of Adolescents

    Science.gov (United States)

    Colakkadioglu, Oguzhan; Gucray, S. Sonay

    2012-01-01

    In this study, the effect of conflict theory based decision making skill training group applications on decision making styles of adolescents was investigated. A total of 36 students, including 18 students in experimental group and 18 students in control group, participated in the research. When assigning students to experimental group or control…

  14. Implications of Decision Making Research for Decision Support and Displays

    OpenAIRE

    Morrison, Jeffrey G.; Kelly, Richard T.; Moore, Ronald A.; Hutchins, Susan G.

    1998-01-01

    To appear in J. A. Cannon-Bowers & E. Salas (Eds.), Decision Making Under Stress: Implications for Training and Simulation. A prototype decision support system (DSS) was developed to enhance Navy tactical decision making based on naturalistic decision processes. Displays were developed to support critical decision making tasks through recognition-primed and explanation-based reasoning processes, and cognitive analysis was conducted of the decision making problems faced by Navy ...

  15. Knowledge, decision making, and uncertainty

    International Nuclear Information System (INIS)

    Fox, J.

    1986-01-01

    Artificial intelligence (AI) systems depend heavily upon the ability to make decisions. Decisions require knowledge, yet there is no knowledge-based theory of decision making. To the extent that AI uses a theory of decision-making it adopts components of the traditional statistical view in which choices are made by maximizing some function of the probabilities of decision options. A knowledge-based scheme for reasoning about uncertainty is proposed, which extends the traditional framework but is compatible with it

  16. Decision Making Analysis: Critical Factors-Based Methodology

    Science.gov (United States)

    2010-04-01

    the pitfalls associated with current wargaming methods such as assuming a western view of rational values in decision - making regardless of the cultures...Utilization theory slightly expands the rational decision making model as it states that “actors try to maximize their expected utility by weighing the...items to categorize the decision - making behavior of political leaders which tend to demonstrate either a rational or cognitive leaning. Leaders

  17. Decision Making Under Objective Risk Conditions-a Review of Cognitive and Emotional Correlates, Strategies, Feedback Processing, and External Influences.

    Science.gov (United States)

    Schiebener, Johannes; Brand, Matthias

    2015-06-01

    While making decisions under objective risk conditions, the probabilities of the consequences of the available options are either provided or calculable. Brand et al. (Neural Networks 19:1266-1276, 2006) introduced a model describing the neuro-cognitive processes involved in such decisions. In this model, executive functions associated with activity in the fronto-striatal loop are important for developing and applying decision-making strategies, and for verifying, adapting, or revising strategies according to feedback. Emotional rewards and punishments learned from such feedback accompany these processes. In this literature review, we found support for the role of executive functions, but also found evidence for the importance of further cognitive abilities in decision making. Moreover, in addition to reflective processing (driven by cognition), decisions can be guided by impulsive processing (driven by anticipation of emotional reward and punishment). Reflective and impulsive processing may interact during decision making, affecting the evaluation of available options, as both processes are affected by feedback. Decision-making processes are furthermore modulated by individual attributes (e.g., age), and external influences (e.g., stressors). Accordingly, we suggest a revised model of decision making under objective risk conditions.

  18. Ethical Decision Making

    DEFF Research Database (Denmark)

    Lauesen, Linne Marie

    2012-01-01

    of the interaction between a corporation and its stakeholders. Methodology/approach: This paper offers a theoretical 'Organic Stakeholder Model' based on decision making theory, risk assessment and adaption to a rapidly changing world combined with appropriate stakeholder theory for ethical purposes in decision...... applicable): The Model is based on case studies, but the limited scope of the length of the paper did not leave room to show the empirical evidence, but only the theoretical study. Originality / value of a paper: The model offers a new way of combining risk management with ethical decision-making processes...... by the inclusion of multiple stakeholders. The conceptualization of the model enhances business ethics in decision making by managing and balancing stakeholder concerns with the same concerns as the traditional risk management models does – for the sake of the wider social responsibilities of the businesses...

  19. Further evidence of close correspondence for alcohol demand decision making for hypothetical and incentivized rewards.

    Science.gov (United States)

    Amlung, Michael; MacKillop, James

    2015-04-01

    Alcohol purchase tasks (APTs) are increasingly being used to assess behavioral economic demand for alcohol. Prior studies utilizing APTs have typically assessed demand for hypothetical outcomes, making the extent to which these hypothetical measures reflect preferences when actual rewards are at stake an important empirical question. This study examined alcohol demand across hypothetical and incentivized APTs. Nineteen male heavy drinkers completed two APTs - one for hypothetical alcohol and another in which one randomly-selected outcome was provided. Participants were given an opportunity to consume the alcohol associated with their choice on the incentivized APT during a self-administration period in a simulated bar environment. Results indicated generally close correspondence between APT versions, though participants were more sensitive to increases in price and tended to consume more at low prices on the incentivized version. Estimated consumption on the incentivized APT was highly correlated with the amount of alcohol consumed in the laboratory (r=.87, pdecision-making when rewards are hypothetical vs. actually available. Implications for behavioral economic approaches to addictive behavior and directions for future research are discussed. Copyright © 2015 Elsevier B.V. All rights reserved.

  20. Research-based-decision-making in Canadian health organizations: a behavioural approach.

    Science.gov (United States)

    Jbilou, Jalila; Amara, Nabil; Landry, Réjean

    2007-06-01

    Decision making in Health sector is affected by a several elements such as economic constraints, political agendas, epidemiologic events, managers' values and environment... These competing elements create a complex environment for decision making. Research-Based-Decision-Making (RBDM) offers an opportunity to reduce the generated uncertainty and to ensure efficacy and efficiency in health administrations. We assume that RBDM is dependant on decision makers' behaviour and the identification of the determinants of this behaviour can help to enhance research results utilization in health sector decision making. This paper explores the determinants of RBDM as a personal behaviour among managers and professionals in health administrations in Canada. From the behavioural theories and the existing literature, we build a model measuring "RBDM" as an index based on five items. These items refer to the steps accomplished by a decision maker while developing a decision which is based on evidence. The determinants of RBDM behaviour are identified using data collected from 942 health care decision makers in Canadian health organizations. Linear regression is used to model the behaviour RBDM. Determinants of this behaviour are derived from Triandis Theory and Bandura's construct "self-efficacy." The results suggest that to improve research use among managers in Canadian governmental health organizations, strategies should focus on enhancing exposition to evidence through facilitating communication networks, partnerships and links between researchers and decision makers, with the key long-term objective of developing a culture that supports and values the contribution that research can make to decision making in governmental health organizations. Nevertheless, depending on the organizational level, determinants of RBDM are different. This difference has to be taken into account if RBDM adoption is desired. Decision makers in Canadian health organizations (CHO) can help to build

  1. Developmental changes of neuronal networks associated with strategic social decision-making.

    Science.gov (United States)

    Steinmann, Elisabeth; Schmalor, Antonia; Prehn-Kristensen, Alexander; Wolff, Stephan; Galka, Andreas; Möhring, Jan; Gerber, Wolf-Dieter; Petermann, Franz; Stephani, Ulrich; Siniatchkin, Michael

    2014-04-01

    One of the important prerequisites for successful social interaction is the willingness of each individual to cooperate socially. Using the ultimatum game, several studies have demonstrated that the process of decision-making to cooperate or to defeat in interaction with a partner is associated with activation of the dorsolateral prefrontal cortex (DLPFC), anterior cingulate cortex (ACC), anterior insula (AI), and inferior frontal cortex (IFC). This study investigates developmental changes in this neuronal network. 15 healthy children (8-12 years), 15 adolescents (13-18 years) and 15 young adults (19-28 years) were investigated using the ultimatum game. Neuronal networks representing decision-making based on strategic thinking were characterized using functional MRI. In all age groups, the process of decision-making in reaction to unfair offers was associated with hemodynamic changes in similar regions. Compared with children, however, healthy adults and adolescents revealed greater activation in the IFC and the fusiform gyrus, as well as the nucleus accumbens. In contrast, healthy children displayed more activation in the AI, the dorsal part of the ACC, and the DLPFC. There were no differences in brain activations between adults and adolescents. The neuronal mechanisms underlying strategic social decision making are already developed by the age of eight. Decision-making based on strategic thinking is associated with age-dependent involvement of different brain regions. Neuronal networks underlying theory of mind and reward anticipation are more activated in adults and adolescents with regard to the increasing perspective taking with age. In relation to emotional reactivity and respective compensatory coping in younger ages, children have higher activations in a neuronal network associated with emotional processing and executive control. Copyright © 2014 Elsevier Ltd. All rights reserved.

  2. Gray matter volume and rapid decision-making in major depressive disorder.

    Science.gov (United States)

    Nakano, Masayuki; Matsuo, Koji; Nakashima, Mami; Matsubara, Toshio; Harada, Kenichiro; Egashira, Kazuteru; Masaki, Hiroaki; Takahashi, Kanji; Watanabe, Yoshifumi

    2014-01-03

    Reduced motivation and blunted decision-making are key features of major depressive disorder (MDD). Patients with MDD show abnormal decision-making when given negative feedback regarding a reward. The brain mechanisms underpinning this behavior remain unclear. In the present study, we examined the association between rapid decision-making with negative feedback and brain volume in MDD. Thirty-six patients with MDD and 54 age-, sex- and IQ-matched healthy subjects were studied. Subjects performed a rapid decision-making monetary task in which participants could make high- or low-risk choices. We compared between the 2 groups the probability that a high-risk choice followed negative feedback. In addition, we used voxel-based morphometry (VBM) to compare between group differences in gray matter volume, and the correlation between the probability for high-risk choices and brain volume. Compared to the healthy group, the MDD group showed significantly lower probabilities for high-risk choices following negative feedback. VBM analysis revealed that the MDD group had less gray matter volume in the right medial prefrontal cortex and orbitofrontal cortex (OFC) compared to the healthy group. The right OFC volume was negatively correlated with the probability that a high-risk choice followed negative feedback in patients with MDD. We did not observe these trends in healthy subjects. Patients with MDD show reduced motivation for monetary incentives when they were required to make rapid decisions following negative feedback. We observed a correlation between this reduced motivation and gray matter volume in the medial and ventral prefrontal cortex, which suggests that these brain regions are likely involved in the pathophysiology of aberrant decision-making in MDD. © 2013.

  3. A Costing Analysis for Decision Making Grid Model in Failure-Based Maintenance

    Directory of Open Access Journals (Sweden)

    Burhanuddin M. A.

    2011-01-01

    Full Text Available Background. In current economic downturn, industries have to set good control on production cost, to maintain their profit margin. Maintenance department as an imperative unit in industries should attain all maintenance data, process information instantaneously, and subsequently transform it into a useful decision. Then act on the alternative to reduce production cost. Decision Making Grid model is used to identify strategies for maintenance decision. However, the model has limitation as it consider two factors only, that is, downtime and frequency of failures. We consider third factor, cost, in this study for failure-based maintenance. The objective of this paper is to introduce the formulae to estimate maintenance cost. Methods. Fish bone analysis conducted with Ishikawa model and Decision Making Grid methods are used in this study to reveal some underlying risk factors that delay failure-based maintenance. The goal of the study is to estimate the risk factor that is, repair cost to fit in the Decision Making Grid model. Decision Making grid model consider two variables, frequency of failure and downtime in the analysis. This paper introduces third variable, repair cost for Decision Making Grid model. This approaches give better result to categorize the machines, reduce cost, and boost the earning for the manufacturing plant. Results. We collected data from one of the food processing factories in Malaysia. From our empirical result, Machine C, Machine D, Machine F, and Machine I must be in the Decision Making Grid model even though their frequency of failures and downtime are less than Machine B and Machine N, based on the costing analysis. The case study and experimental results show that the cost analysis in Decision Making Grid model gives more promising strategies in failure-based maintenance. Conclusions. The improvement of Decision Making Grid model for decision analysis with costing analysis is our contribution in this paper for

  4. Dissociable contributions of anterior cingulate cortex and basolateral amygdala on a rodent cost/benefit decision-making task of cognitive effort.

    Science.gov (United States)

    Hosking, Jay G; Cocker, Paul J; Winstanley, Catharine A

    2014-06-01

    Personal success often requires the choice to expend greater effort for larger rewards, and deficits in such effortful decision making accompany a number of illnesses including depression, schizophrenia, and attention-deficit/hyperactivity disorder. Animal models have implicated brain regions such as the basolateral amygdala (BLA) and anterior cingulate cortex (ACC) in physical effort-based choice, but disentangling the unique contributions of these two regions has proven difficult, and effort demands in industrialized society are predominantly cognitive in nature. Here we utilize the rodent cognitive effort task (rCET), a modification of the five-choice serial reaction-time task, wherein animals can choose to expend greater visuospatial attention to obtain larger sucrose rewards. Temporary inactivation (via baclofen-muscimol) of BLA and ACC showed dissociable effects: BLA inactivation caused hard-working rats to 'slack off' and 'slacker' rats to work harder, whereas ACC inactivation caused all animals to reduce willingness to expend mental effort. Furthermore, BLA inactivation increased the time needed to make choices, whereas ACC inactivation increased motor impulsivity. These data illuminate unique contributions of BLA and ACC to effort-based decision making, and imply overlapping yet distinct circuitry for cognitive vs physical effort. Our understanding of effortful decision making may therefore require expanding our models beyond purely physical costs.

  5. Long-term heavy marijuana users make costly decisions on a gambling task.

    Science.gov (United States)

    Whitlow, Christopher T; Liguori, Anthony; Livengood, L Brooke; Hart, Stephanie L; Mussat-Whitlow, Becky J; Lamborn, Corey M; Laurienti, Paul J; Porrino, Linda J

    2004-10-05

    Chronic marijuana use has been associated with impairments of learning, memory, and executive functions. Little is known, however, about the effects of marijuana use on other cognitive domains, such as decision-making, which are thought to play an important role in addiction and drug abuse. The purpose of the present study was to determine if long-term heavy marijuana users employ different decision-making strategies than individuals with minimal marijuana exposure. Volunteers were assigned to a cannabis (n = 10) or control group (n = 10) based upon history of prior marijuana use. Demographic and neuropsychological variables were evaluated, and a decision-making task--the gambling task (GT) was administered. Although few demographic and neuropsychological differences were noted between groups, marijuana users made more decisions that led to larger immediate gains despite more costly losses than controls. These data suggest that long-term heavy marijuana users may have specific deficits in the ability to balance rewards and punishments that may contribute to continued drug-taking behavior. It is unknown, however, whether the basis for such deficits might be attributed directly to marijuana exposure or pre-existing genetic or behavioral differences.

  6. Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach.

    Science.gov (United States)

    Spoelder, Marcia; Flores Dourojeanni, Jacques P; de Git, Kathy C G; Baars, Annemarie M; Lesscher, Heidi M B; Vanderschuren, Louk J M J

    2017-07-01

    Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood. This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol. LD and HD were tested in the rat gambling task (rGT) or the delayed reward task (DRT). Next, the effect of alcohol (0-1.0 g/kg) was tested in these tasks. Pavlovian-conditioned approach (PCA) was assessed both prior to and after intermittent alcohol access (IAA). Principal component analyses were performed to identify relationships between the most important behavioral parameters. HD showed more optimal decision making in the rGT. In the DRT, HD transiently showed reduced impulsive choice. In both LD and HD, alcohol treatment increased optimal decision making in the rGT and increased impulsive choice in the DRT. PCA prior to and after IAA was comparable for LD and HD. When PCA was tested after IAA only, HD showed a more sign-tracking behavior. The principal component analyses indicated dimensional relationships between alcohol intake, impulsivity, and sign-tracking behavior in the PCA task after IAA. HD showed a more efficient performance in the rGT and DRT. Moreover, alcohol consumption enhanced approach behavior to reward-predictive cues, but sign-tracking did not predict the level of alcohol consumption. Taken together, these findings suggest that high levels of voluntary alcohol intake are associated with enhanced cue- and reward-driven behavior.

  7. Effects of Methadone Maintenance Treatment on Decision-Making Processes in Heroin-Abusers: A Cognitive Modeling Analysis

    Directory of Open Access Journals (Sweden)

    Arash Khodadadi

    2010-05-01

    Full Text Available A B S T R A C TIntroduction: Although decision-making processes have become a principal target of study among addiction researchers, few researches are published according to effects of different treatment methods on the cognitive processes underlying decision making up to now. Utilizing cognitive modeling method, in this paper we examine the effects of Methadone maintenance treatment (MMT on cognitive processes underlying decision-making disorders in heroin-abusers. Methods: For this purpose, for the first time, we use the balloon analog risk task (BART to assess the decision-making ability of heroin-abusers before and after treatment and compare it to the non heroin-dependent subjects. Results: Results demonstrate that heroin-abusers show more risky behavior than other groups. But, there is no difference between the performance of heroin-abusers after 6 months of MMT and control group. Modeling subjects’ behavior in BART reveals that poor performance in heroin-abusers is due to reward-dependency and insensitivity to evaluation. Discussion: Results show that 6 months of MMT decreases reward-dependency and increases sensitivity to evaluation.

  8. Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

    Science.gov (United States)

    Fouragnan, Elsa; Retzler, Chris; Mullinger, Karen; Philiastides, Marios G

    2015-09-08

    Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

  9. Serotonin shapes risky decision making in monkeys.

    Science.gov (United States)

    Long, Arwen B; Kuhn, Cynthia M; Platt, Michael L

    2009-12-01

    Some people love taking risks, while others avoid gambles at all costs. The neural mechanisms underlying individual variation in preference for risky or certain outcomes, however, remain poorly understood. Although behavioral pathologies associated with compulsive gambling, addiction and other psychiatric disorders implicate deficient serotonin signaling in pathological decision making, there is little experimental evidence demonstrating a link between serotonin and risky decision making, in part due to the lack of a good animal model. We used dietary rapid tryptophan depletion (RTD) to acutely lower brain serotonin in three macaques performing a simple gambling task for fluid rewards. To confirm the efficacy of RTD experiments, we measured total plasma tryptophan using high-performance liquid chromatography (HPLC) with electrochemical detection. Reducing brain serotonin synthesis decreased preference for the safe option in a gambling task. Moreover, lowering brain serotonin function significantly decreased the premium required for monkeys to switch their preference to the risky option, suggesting that diminished serotonin signaling enhances the relative subjective value of the risky option. These results implicate serotonin in risk-sensitive decision making and, further, suggest pharmacological therapies for treating pathological risk preferences in disorders such as problem gambling and addiction.

  10. Corticosterone and decision-making in male Wistar rats: the effect of corticosterone application in the infralimbic and orbitofrontal cortex.

    Science.gov (United States)

    Koot, Susanne; Koukou, Magdalini; Baars, Annemarie; Hesseling, Peter; van 't Klooster, José; Joëls, Marian; van den Bos, Ruud

    2014-01-01

    Corticosteroid hormones, released after stress, are known to influence neuronal activity and produce a wide range of effects upon the brain. They affect cognitive tasks including decision-making. Recently it was shown that systemic injections of corticosterone (CORT) disrupt reward-based decision-making in rats when tested in a rat model of the Iowa Gambling Task (rIGT), i.e., rats do not learn across trial blocks to avoid the long-term disadvantageous option. This effect was associated with a change in neuronal activity in prefrontal brain areas, i.e., the infralimbic (IL), lateral orbitofrontal (lOFC) and insular cortex, as assessed by changes in c-Fos expression. Here, we studied whether injections of CORT directly into the IL and lOFC lead to similar changes in decision-making. As in our earlier study, CORT was injected during the final 3 days of the behavioral paradigm, 25 min prior to behavioral testing. Infusions of vehicle into the IL led to a decreased number of visits to the disadvantageous arm across trial blocks, while infusion with CORT did not. Infusions into the lOFC did not lead to differences in the number of visits to the disadvantageous arm between vehicle treated and CORT treated rats. However, compared to vehicle treated rats of the IL group, performance of vehicle treated rats of the lOFC group was impaired, possibly due to cannulation/infusion-related damage of the lOFC affecting decision-making. Overall, these results show that infusions with CORT into the IL are sufficient to disrupt decision-making performance, pointing to a critical role of the IL in corticosteroid effects on reward-based decision-making. The data do not directly support that the same holds true for infusions into the lOFC.

  11. Metabolic state alters economic decision making under risk in humans.

    Directory of Open Access Journals (Sweden)

    Mkael Symmonds

    2010-06-01

    Full Text Available Animals' attitudes to risk are profoundly influenced by metabolic state (hunger and baseline energy stores. Specifically, animals often express a preference for risky (more variable food sources when below a metabolic reference point (hungry, and safe (less variable food sources when sated. Circulating hormones report the status of energy reserves and acute nutrient intake to widespread targets in the central nervous system that regulate feeding behaviour, including brain regions strongly implicated in risk and reward based decision-making in humans. Despite this, physiological influences per se have not been considered previously to influence economic decisions in humans. We hypothesised that baseline metabolic reserves and alterations in metabolic state would systematically modulate decision-making and financial risk-taking in humans.We used a controlled feeding manipulation and assayed decision-making preferences across different metabolic states following a meal. To elicit risk-preference, we presented a sequence of 200 paired lotteries, subjects' task being to select their preferred option from each pair. We also measured prandial suppression of circulating acyl-ghrelin (a centrally-acting orexigenic hormone signalling acute nutrient intake, and circulating leptin levels (providing an assay of energy reserves. We show both immediate and delayed effects on risky decision-making following a meal, and that these changes correlate with an individual's baseline leptin and changes in acyl-ghrelin levels respectively.We show that human risk preferences are exquisitely sensitive to current metabolic state, in a direction consistent with ecological models of feeding behaviour but not predicted by normative economic theory. These substantive effects of state changes on economic decisions perhaps reflect shared evolutionarily conserved neurobiological mechanisms. We suggest that this sensitivity in human risk-preference to current metabolic state has

  12. Maintenance planning support method for nuclear power plants based on collective decision making

    International Nuclear Information System (INIS)

    Shimizu, Shunichi; Sakurai, Shoji; Takaoka, Kazushi; Kanemoto, Shigeru; Fukutomi, Shigeki

    1992-01-01

    Inspection and maintenance planning in nuclear power plants is conducted by decision making based on experts' collective consensus. However, since a great deal of time and effort is required to reach a consensus among expert judgments, the establishment of effective decision making methods is necessary. Therefore, the authors developed a method for supporting collective decision making, based on a combination of three types of decision making methods; the Characteristic Diagram method, Interpretative Structural Modeling method, and the Analytic Hierarchy Process method. The proposed method enables us to determine the evaluation criteria systematically for collective decision making, and also allows extracting collective decisions using simplified questionnaires. The proposed method can support reaching a consensus of groups effectively through the evaluation of collective decision structural models and their characteristics. In this paper, the effectiveness of the proposed method was demonstrated through its application to the decision making problem concerning whether or not the improved ultrasonic testing equipment should be adopted at nuclear power plants. (author)

  13. The Nature of Belief-Directed Exploratory Choice in Human Decision-Making

    Directory of Open Access Journals (Sweden)

    W. Bradley Knox

    2012-01-01

    Full Text Available In non-stationary environments, there is a conflict between exploiting currently favored options and gaining information by exploring lesser-known options that in the past have proven less rewarding. Optimal decision making in such tasks requires considering future states of the environment (i.e., planning and properly updating beliefs about the state of environment after observing outcomes associated with choices. Optimal belief-updating is reflective in that beliefs can change without directly observing environmental change. For example, after ten seconds elapse, one might correctly believe that a traffic light last observed to be red is now more likely to be green. To understand human decision-making when rewards associated with choice options change over time, we develop a variant of the classic bandit task that is both rich enough to encompass relevant phenomena and sufficiently tractable to allow for ideal actor analysis of sequential choice behavior. We evaluate whether people update beliefs about the state of environment in a reflexive (i.e., only in response to observed changes in reward structure or reflective manner. In contrast to purely "random" accounts of exploratory behavior, model-based analyses of the subjects’ choices and latencies indicate that people are reflective belief-updaters. However, unlike the Ideal Actor model, our analyses indicate that people's choice behavior does not reflect consideration of future environmental states. Thus, although people update beliefs in a reflective manner consistent with the ideal actor, they do not engage in optimal long-term planning, but instead myopically choose the option on every trial that is believed to have the highest immediate payoff.

  14. The Nature of Belief-Directed Exploratory Choice in Human Decision-Making

    Science.gov (United States)

    Knox, W. Bradley; Otto, A. Ross; Stone, Peter; Love, Bradley C.

    2011-01-01

    In non-stationary environments, there is a conflict between exploiting currently favored options and gaining information by exploring lesser-known options that in the past have proven less rewarding. Optimal decision-making in such tasks requires considering future states of the environment (i.e., planning) and properly updating beliefs about the state of the environment after observing outcomes associated with choices. Optimal belief-updating is reflective in that beliefs can change without directly observing environmental change. For example, after 10 s elapse, one might correctly believe that a traffic light last observed to be red is now more likely to be green. To understand human decision-making when rewards associated with choice options change over time, we develop a variant of the classic “bandit” task that is both rich enough to encompass relevant phenomena and sufficiently tractable to allow for ideal actor analysis of sequential choice behavior. We evaluate whether people update beliefs about the state of environment in a reflexive (i.e., only in response to observed changes in reward structure) or reflective manner. In contrast to purely “random” accounts of exploratory behavior, model-based analyses of the subjects’ choices and latencies indicate that people are reflective belief updaters. However, unlike the Ideal Actor model, our analyses indicate that people’s choice behavior does not reflect consideration of future environmental states. Thus, although people update beliefs in a reflective manner consistent with the Ideal Actor, they do not engage in optimal long-term planning, but instead myopically choose the option on every trial that is believed to have the highest immediate payoff. PMID:22319503

  15. Impaired decision-making under risk in individuals with alcohol dependence

    Science.gov (United States)

    Brevers, Damien; Bechara, Antoine; Cleeremans, Axel; Kornreich, Charles; Verbanck, Paul; Noël, Xavier

    2014-01-01

    Background Alcohol dependence is associated with poor decision-making under ambiguity, that is, when decisions are to be made in the absence of known probabilities of reward and loss. However, little is known regarding decisions made by individuals with alcohol dependence in the context of known probabilities (decision under risk). In this study, we investigated the relative contribution of these distinct aspects of decision making to alcohol dependence. Methods Thirty recently detoxified and sober asymptomatic alcohol-dependent individuals, and thirty healthy control participants were tested for decision-making under ambiguity (using the Iowa Gambling Task), and decision-making under-risk (using the Cups Task and Coin Flipping Task). We also tested their capacities for working memory storage (Digit-span Forward), and dual-tasking (Operation-span Task). Results Compared to healthy control participants, alcohol-dependent individuals made disadvantageous decisions on the Iowa Gambling Task, reflecting poor decisions under ambiguity. They also made more risky choices on the Cups and Coin Flipping Tasks reflecting poor decision-making under risk. In addition, alcohol-dependent participants showed some working memory impairments, as measured by the dual tasking, and the degree of this impairment correlated with high-risk decision-making, thus suggesting a relationship between processes sub-serving working memory and risky decisions. Conclusion These results suggest that alcohol dependent individuals are impaired in their ability to decide optimally in multiple facets of uncertainty (i.e., both risk and ambiguity), and that at least some aspects of these deficits are linked to poor working memory processes. PMID:24948198

  16. Make or buy decision considering uncertainty based on fuzzy logic using simulation and multiple criteria decision making

    Directory of Open Access Journals (Sweden)

    Ali Mohtashami

    2013-01-01

    Full Text Available Decision making on making/buying problem has always been a challenge to decision makers. In this paper a methodology has been proposed to resolve this challenge. This methodology is capable of evaluating making/buying decision making under uncertainty. For uncertainty, the fuzzy logic and simulation approaches have been used. The proposed methodology can be applied to parts with multi stage manufacturing processes and different suppliers. Therefore this methodology provides a scale for decision making from full outsourcing to full manufacturing and with selecting appropriate supplier.

  17. Rationality versus reality: the challenges of evidence-based decision making for health policy makers.

    Science.gov (United States)

    McCaughey, Deirdre; Bruning, Nealia S

    2010-05-26

    Current healthcare systems have extended the evidence-based medicine (EBM) approach to health policy and delivery decisions, such as access-to-care, healthcare funding and health program continuance, through attempts to integrate valid and reliable evidence into the decision making process. These policy decisions have major impacts on society and have high personal and financial costs associated with those decisions. Decision models such as these function under a shared assumption of rational choice and utility maximization in the decision-making process. We contend that health policy decision makers are generally unable to attain the basic goals of evidence-based decision making (EBDM) and evidence-based policy making (EBPM) because humans make decisions with their naturally limited, faulty, and biased decision-making processes. A cognitive information processing framework is presented to support this argument, and subtle cognitive processing mechanisms are introduced to support the focal thesis: health policy makers' decisions are influenced by the subjective manner in which they individually process decision-relevant information rather than on the objective merits of the evidence alone. As such, subsequent health policy decisions do not necessarily achieve the goals of evidence-based policy making, such as maximizing health outcomes for society based on valid and reliable research evidence. In this era of increasing adoption of evidence-based healthcare models, the rational choice, utility maximizing assumptions in EBDM and EBPM, must be critically evaluated to ensure effective and high-quality health policy decisions. The cognitive information processing framework presented here will aid health policy decision makers by identifying how their decisions might be subtly influenced by non-rational factors. In this paper, we identify some of the biases and potential intervention points and provide some initial suggestions about how the EBDM/EBPM process can be

  18. Rationality versus reality: the challenges of evidence-based decision making for health policy makers

    Directory of Open Access Journals (Sweden)

    Bruning Nealia S

    2010-05-01

    Full Text Available Abstract Background Current healthcare systems have extended the evidence-based medicine (EBM approach to health policy and delivery decisions, such as access-to-care, healthcare funding and health program continuance, through attempts to integrate valid and reliable evidence into the decision making process. These policy decisions have major impacts on society and have high personal and financial costs associated with those decisions. Decision models such as these function under a shared assumption of rational choice and utility maximization in the decision-making process. Discussion We contend that health policy decision makers are generally unable to attain the basic goals of evidence-based decision making (EBDM and evidence-based policy making (EBPM because humans make decisions with their naturally limited, faulty, and biased decision-making processes. A cognitive information processing framework is presented to support this argument, and subtle cognitive processing mechanisms are introduced to support the focal thesis: health policy makers' decisions are influenced by the subjective manner in which they individually process decision-relevant information rather than on the objective merits of the evidence alone. As such, subsequent health policy decisions do not necessarily achieve the goals of evidence-based policy making, such as maximizing health outcomes for society based on valid and reliable research evidence. Summary In this era of increasing adoption of evidence-based healthcare models, the rational choice, utility maximizing assumptions in EBDM and EBPM, must be critically evaluated to ensure effective and high-quality health policy decisions. The cognitive information processing framework presented here will aid health policy decision makers by identifying how their decisions might be subtly influenced by non-rational factors. In this paper, we identify some of the biases and potential intervention points and provide some initial

  19. Rationality versus reality: the challenges of evidence-based decision making for health policy makers

    Science.gov (United States)

    2010-01-01

    Background Current healthcare systems have extended the evidence-based medicine (EBM) approach to health policy and delivery decisions, such as access-to-care, healthcare funding and health program continuance, through attempts to integrate valid and reliable evidence into the decision making process. These policy decisions have major impacts on society and have high personal and financial costs associated with those decisions. Decision models such as these function under a shared assumption of rational choice and utility maximization in the decision-making process. Discussion We contend that health policy decision makers are generally unable to attain the basic goals of evidence-based decision making (EBDM) and evidence-based policy making (EBPM) because humans make decisions with their naturally limited, faulty, and biased decision-making processes. A cognitive information processing framework is presented to support this argument, and subtle cognitive processing mechanisms are introduced to support the focal thesis: health policy makers' decisions are influenced by the subjective manner in which they individually process decision-relevant information rather than on the objective merits of the evidence alone. As such, subsequent health policy decisions do not necessarily achieve the goals of evidence-based policy making, such as maximizing health outcomes for society based on valid and reliable research evidence. Summary In this era of increasing adoption of evidence-based healthcare models, the rational choice, utility maximizing assumptions in EBDM and EBPM, must be critically evaluated to ensure effective and high-quality health policy decisions. The cognitive information processing framework presented here will aid health policy decision makers by identifying how their decisions might be subtly influenced by non-rational factors. In this paper, we identify some of the biases and potential intervention points and provide some initial suggestions about how the

  20. Decision Making Based On Management Information System and Decision Support System

    Directory of Open Access Journals (Sweden)

    Şükrü Ada

    2015-04-01

    Full Text Available Information hasbecome an essentialresource for managing modern organizations. This is so because today’sbusiness environment is volatile, dynamic, turbulent and necessitates the burgeoning demand for accurate, relevant, complete,timely and economical information needed to drive the decision-making process in order to accentuate organizational abilities to manage opportunities and threat. MIS work on online mode with an average processing speed. Generally, it is used by low level management. Decision support system are powerful tool that assist corporate executives, administrators and other senior officials in making decision regarding the problem. Management Information Systems is a useful tool that provided organized and summarized information in a proper time to decision makers and enable making accurate decision for managers in organizations. This paper will discuss the concept, characteristics, types of MIS, the MIS model, and in particular it will highlight the impact and role of MIS on decision making.

  1. Motivation, working memory, and decision making: a cognitive-motivational theory of personality vulnerability to alcoholism.

    Science.gov (United States)

    Finn, Peter R

    2002-09-01

    This article presents a cognitive-motivational theory (CMT) of the mechanisms associated with three basic dimensions of personality vulnerability to alcoholism, impulsivity/novelty seeking, harm avoidance, and excitement seeking. CMT describes the interrelationships between activity in basic motivational systems and attentional, decision-making and working memory processes as the mechanisms associated with variation in each personality trait. Impulsivity/novelty seeking reflects activity in both appetitive and inhibitory motivational systems, greater attention to reward cues, and increased emotional reactivity to reward and frustration. Harm avoidance reflects individual differences in fearfulness and activity in specific inhibitory systems. Excitement seeking reflects the need to engage in appetitive behaviors in less predictable environments to experience positive affect. CMT also describes the impact of working memory and the specific motivational processes underlying each trait dimension on the dynamics of decision making from the perspective of decision field theory.

  2. The detrimental effects of emotional process dysregulation on decision-making in substance dependence

    Science.gov (United States)

    Murphy, Anna; Taylor, Eleanor; Elliott, Rebecca

    2012-01-01

    Substance dependence is complex and multifactorial, with many distinct pathways involved in both the development and subsequent maintenance of addictive behaviors. Various cognitive mechanisms have been implicated, including impulsivity, compulsivity, and impaired decision-making. These mechanisms are modulated by emotional processes, resulting in increased likelihood of initial drug use, sustained substance dependence, and increased relapse during periods of abstinence. Emotional traits, such as sensation-seeking, are risk factors for substance use, and chronic drug use can result in further emotional dysregulation via effects on reward, motivation, and stress systems. We will explore theories of hyper and hypo sensitivity of the brain reward systems that may underpin motivational abnormalities and anhedonia. Disturbances in these systems contribute to the biasing of emotional processing toward cues related to drug use at the expense of natural rewards, which serves to maintain addictive behavior, via enhanced drug craving. We will additionally focus on the sensitization of the brain stress systems that result in negative affect states that continue into protracted abstinence that is may lead to compulsive drug-taking. We will explore how these emotional dysregulations impact upon decision-making controlled by goal-directed and habitual action selections systems, and, in combination with a failure of prefrontal inhibitory control, mediate maladaptive decision-making observed in substance dependent individuals such that they continue drug use in spite of negative consequences. An understanding of the emotional impacts on cognition in substance dependent individuals may guide the development of more effective therapeutic interventions. PMID:23162443

  3. Defining decision making: a qualitative study of international experts' views on surgical trainee decision making.

    Science.gov (United States)

    Rennie, Sarah C; van Rij, Andre M; Jaye, Chrystal; Hall, Katherine H

    2011-06-01

    Decision making is a key competency of surgeons; however, how best to assess decisions and decision makers is not clearly established. The aim of the present study was to identify criteria that inform judgments about surgical trainees' decision-making skills. A qualitative free text web-based survey was distributed to recognized international experts in Surgery, Medical Education, and Cognitive Research. Half the participants were asked to identify features of good decisions, characteristics of good decision makers, and essential factors for developing good decision-making skills. The other half were asked to consider these areas in relation to poor decision making. Template analysis of free text responses was performed. Twenty-nine (52%) experts responded to the survey, identifying 13 categories for judging a decision and 14 for judging a decision maker. Twelve features/characteristics overlapped (considered, informed, well timed, aware of limitations, communicated, knowledgeable, collaborative, patient-focused, flexible, able to act on the decision, evidence-based, and coherent). Fifteen categories were generated for essential factors leading to development of decision-making skills that fall into three major themes (personal qualities, training, and culture). The categories compiled from the perspectives of good/poor were predominantly the inverse of each other; however, the weighting given to some categories varied. This study provides criteria described by experts when considering surgical decisions, decision makers, and development of decision-making skills. It proposes a working definition of a good decision maker. Understanding these criteria will enable clinical teachers to better recognize and encourage good decision-making skills and identify poor decision-making skills for remediation.

  4. Neuromodulatory Adaptive Combination of Correlation-based Learning in Cerebellum and Reward-based Learning in Basal Ganglia for Goal-directed Behavior Control

    DEFF Research Database (Denmark)

    Dasgupta, Sakyasingha; Wörgötter, Florentin; Manoonpong, Poramate

    2014-01-01

    Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational...... and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role...... in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We...

  5. Orbitofrontal cortex, emotional decision-making and response to cognitive behavioural therapy for psychosis.

    Science.gov (United States)

    Premkumar, Preethi; Fannon, Dominic; Sapara, Adegboyega; Peters, Emmanuelle R; Anilkumar, Anantha P; Simmons, Andrew; Kuipers, Elizabeth; Kumari, Veena

    2015-03-30

    Grey matter volume (GMV) in the orbitofrontal cortex (OFC) may relate to better response to cognitive behavioural therapy for psychosis (CBTp) because of the region׳s role in emotional decision-making and cognitive flexibility. This study aimed to determine the relation between pre-therapy OFC GMV or asymmetry, emotional decision-making and CBTp responsiveness. Emotional decision-making was measured by the Iowa Gambling task (IGT). Thirty patients received CBTp+standard care (CBTp+SC; 25 completers) for 6-8 months. All patients (before receiving CBTp) and 25 healthy participants underwent structural magnetic resonance imaging. Patients׳ symptoms were assessed before and after therapy. Pre-therapy OFC GMV was measured using a region-of-interest approach, and IGT performance was measured as overall learning, attention to reward, memory for past outcomes and choice consistency. Both these measures, were comparable between patient and healthy groups. In the CBTp+SC group, greater OFC GMV correlated with positive symptom improvement, specifically hallucinations and persecution. Greater rightward OFC asymmetry correlated with improvement in several negative and general psychopathology symptoms. Greater left OFC GMV was associated with lower IGT attention to reward. The findings suggest that greater OFC volume and rightward asymmetry, which maintain the OFC׳s function in emotional decision-making and cognitive flexibility, are beneficial for CBTp responsiveness. Copyright © 2015 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

  6. The effect of acute tyrosine phenylalanine depletion on emotion-based decision-making in healthy adults.

    Science.gov (United States)

    Vrshek-Schallhorn, Suzanne; Wahlstrom, Dustin; White, Tonya; Luciana, Monica

    2013-04-01

    Despite interest in dopamine's role in emotion-based decision-making, few reports of the effects of dopamine manipulations are available in this area in humans. This study investigates dopamine's role in emotion-based decision-making through a common measure of this construct, the Iowa Gambling Task (IGT), using Acute Tyrosine Phenylalanine Depletion (ATPD). In a between-subjects design, 40 healthy adults were randomized to receive either an ATPD beverage or a balanced amino acid beverage (a control) prior to completing the IGT, as well as pre- and post-manipulation blood draws for the neurohormone prolactin. Together with conventional IGT performance metrics, choice selections and response latencies were examined separately for good and bad choices before and after several key punishment events. Changes in response latencies were also used to predict total task performance. Prolactin levels increased significantly in the ATPD group but not in the control group. However, no significant group differences in performance metrics were detected, nor were there sex differences in outcome measures. However, the balanced group's bad deck latencies speeded up across the task, while the ATPD group's latencies remained adaptively hesitant. Additionally, modulation of latencies to the bad decks predicted total score for the ATPD group only. One interpretation is that ATPD subtly attenuated reward salience and altered the approach by which individuals achieved successful performance, without resulting in frank group differences in task performance. Copyright © 2013 Elsevier Inc. All rights reserved.

  7. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

    Science.gov (United States)

    Schultz, Wolfram

    2004-04-01

    Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

  8. Diffusion Modelling Reveals the Decision Making Processes Underlying Negative Judgement Bias in Rats.

    Directory of Open Access Journals (Sweden)

    Claire A Hales

    Full Text Available Human decision making is modified by emotional state. Rodents exhibit similar biases during interpretation of ambiguous cues that can be altered by affective state manipulations. In this study, the impact of negative affective state on judgement bias in rats was measured using an ambiguous-cue interpretation task. Acute treatment with an anxiogenic drug (FG7142, and chronic restraint stress and social isolation both induced a bias towards more negative interpretation of the ambiguous cue. The diffusion model was fit to behavioural data to allow further analysis of the underlying decision making processes. To uncover the way in which parameters vary together in relation to affective state manipulations, independent component analysis was conducted on rate of information accumulation and distances to decision threshold parameters for control data. Results from this analysis were applied to parameters from negative affective state manipulations. These projected components were compared to control components to reveal the changes in decision making processes that are due to affective state manipulations. Negative affective bias in rodents induced by either FG7142 or chronic stress is due to a combination of more negative interpretation of the ambiguous cue, reduced anticipation of the high reward and increased anticipation of the low reward.

  9. Diffusion Modelling Reveals the Decision Making Processes Underlying Negative Judgement Bias in Rats.

    Science.gov (United States)

    Hales, Claire A; Robinson, Emma S J; Houghton, Conor J

    2016-01-01

    Human decision making is modified by emotional state. Rodents exhibit similar biases during interpretation of ambiguous cues that can be altered by affective state manipulations. In this study, the impact of negative affective state on judgement bias in rats was measured using an ambiguous-cue interpretation task. Acute treatment with an anxiogenic drug (FG7142), and chronic restraint stress and social isolation both induced a bias towards more negative interpretation of the ambiguous cue. The diffusion model was fit to behavioural data to allow further analysis of the underlying decision making processes. To uncover the way in which parameters vary together in relation to affective state manipulations, independent component analysis was conducted on rate of information accumulation and distances to decision threshold parameters for control data. Results from this analysis were applied to parameters from negative affective state manipulations. These projected components were compared to control components to reveal the changes in decision making processes that are due to affective state manipulations. Negative affective bias in rodents induced by either FG7142 or chronic stress is due to a combination of more negative interpretation of the ambiguous cue, reduced anticipation of the high reward and increased anticipation of the low reward.

  10. Beyond Bioethics: A Child Rights-Based Approach to Complex Medical Decision-Making.

    Science.gov (United States)

    Wade, Katherine; Melamed, Irene; Goldhagen, Jeffrey

    2016-01-01

    This analysis adopts a child rights approach-based on the principles, standards, and norms of child rights and the U.N. Convention on the Rights of the Child (CRC)-to explore how decisions could be made with regard to treatment of a severely impaired infant (Baby G). While a child rights approach does not provide neat answers to ethically complex issues, it does provide a framework for decision-making in which the infant is viewed as an independent rights-holder. The state has obligations to develop the capacity of those who make decisions for infants in such situations to meet their obligations to respect, protect, and fulfill their rights as delineated in the CRC. Furthermore, a child rights approach requires procedural clarity and transparency in decision-making processes. As all rights in the CRC are interdependent and indivisible, all must be considered in the process of ethical decision-making, and the reasons for decisions must be delineated by reference to how these rights were considered. It is also important that decisions that are made in this context be monitored and reviewed to ensure consistency. A rights-based framework ensures decision-making is child-centered and that there are transparent criteria and legitimate procedures for making decisions regarding the child's most basic human right: the right to life, survival, and development.

  11. [Evidence-based Risk and Benefit Communication for Shared Decision Making].

    Science.gov (United States)

    Nakayama, Takeo

    2018-01-01

     Evidence-based medicine (EBM) can be defined as "the integration of the best research evidence with clinical expertise and a patient's unique values and circumstances". However, even with the best research evidence, many uncertainties can make clinical decisions difficult. As the social requirement of respecting patient values and preferences has been increasingly recognized, shared decision making (SDM) and consensus development between patients and clinicians have attracted attention. SDM is a process by which patients and clinicians make decisions and arrive at a consensus through interactive conversations and communications. During the process of SDM, patients and clinicians share information with each other on the goals they hope to achieve and responsibilities in meeting those goals. From the clinician's standpoint, information regarding the benefits and risks of potential treatment options based on current evidence and professional experience is provided to patients. From the patient's standpoint, information on personal values, preferences, and social roles is provided to clinicians. SDM is a sort of "wisdom" in the context of making autonomous decisions in uncertain, difficult situations through interactions and cooperation between patients and clinicians. Joint development of EBM and SDM will help facilitate patient-clinician relationships and improve the quality of healthcare.

  12. Neural representation of cost-benefit selections in rat anterior cingulate cortex in self-paced decision making.

    Science.gov (United States)

    Wang, Shuai; Shi, Yi; Li, Bao-Ming

    2017-03-01

    The anterior cingulate cortex (ACC) is crucial for decision making which involves the processing of cost-benefit information. Our previous study has shown that ACC is essential for self-paced decision making. However, it is unclear how ACC neurons represent cost-benefit selections during the decision-making process. In the present study, we trained rats on the same "Do More Get More" (DMGM) task as in our previous work. In each trial, the animals stand upright and perform a sustained nosepoke of their own will to earn a water reward, with the amount of reward positively correlated to the duration of the nosepoke (i.e., longer nosepokes earn larger rewards). We then recorded ACC neuronal activity on well-trained rats while they were performing the DMGM task. Our results show that (1) approximately 3/5 ACC neurons (296/496, 59.7%) exhibited changes in firing frequency that were temporally locked with the main events of the DMGM task; (2) about 1/5 ACC neurons (101/496, 20.4%) or 1/3 of the event-modulated neurons (101/296, 34.1%) showed differential firing rate changes for different cost-benefit selections; and (3) many ACC neurons exhibited linear encoding of the cost-benefit selections in the DMGM task events. These results suggest that ACC neurons are engaged in encoding cost-benefit information, thus represent the selections in self-paced decision making. Copyright © 2016 Elsevier Inc. All rights reserved.

  13. From Career Decision-Making Styles to Career Decision-Making Profiles: A Multidimensional Approach

    Science.gov (United States)

    Gati, Itamar; Landman, Shiri; Davidovitch, Shlomit; Asulin-Peretz, Lisa; Gadassi, Reuma

    2010-01-01

    Previous research on individual differences in career decision-making processes has often focused on classifying individuals into a few types of decision-making "styles" based on the most dominant trait or characteristic of their approach to the decision process (e.g., rational, intuitive, dependent; Harren, 1979). In this research, an…

  14. Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats.

    Science.gov (United States)

    Mendez, Ian A; Gilbert, Ryan J; Bizon, Jennifer L; Setlow, Barry

    2012-12-01

    Alterations in cost-benefit decision making accompany numerous neuropsychiatric conditions, including schizophrenia, attention deficit hyperactivity disorder, and addiction. Central cholinergic systems have been linked to the etiology and/or treatment of many of these conditions, but little is known about the role of cholinergic signaling in cost-benefit decision making. The goal of these experiments was to determine how cholinergic signaling is involved in cost-benefit decision making, using a behavioral pharmacological approach. Male Long-Evans rats were trained in either "probability discounting" or "delay discounting" tasks, in which rats made discrete-trial choices between a small food reward and a large food reward associated with either varying probabilities of omission or varying delays to delivery, respectively. The effects of acute administration of different doses of nicotinic and muscarinic acetylcholine receptor agonists and antagonists were assessed in each task. In the probability discounting task, acute nicotine administration (1.0 mg/kg) significantly increased choice of the large risky reward, and control experiments suggested that this was due to robust nicotine-induced impairments in behavioral flexibility. In the delay discounting task, the muscarinic antagonists scopolamine (0.03, 0.1, and 0.3 mg/kg) and atropine (0.3 mg/kg) both significantly increased choice of the small immediate reward. Neither mecamylamine nor oxotremorine produced reliable effects on either of the decision making tasks. These data suggest that cholinergic receptors play multiple roles in decision making contexts which include consideration of reward delay or probability. These roles should be considered when targeting these receptors for therapeutic purposes.

  15. The effects of juvenile stress on anxiety, cognitive bias and decision making in adulthood: a rat model.

    Directory of Open Access Journals (Sweden)

    Nichola M Brydges

    Full Text Available Stress experienced in childhood is associated with an increased risk of developing psychiatric disorders in adulthood. These disorders are particularly characterized by disturbances to emotional and cognitive processes, which are not currently fully modeled in animals. Assays of cognitive bias have recently been used with animals to give an indication of their emotional/cognitive state. We used a cognitive bias test, alongside a traditional measure of anxiety (elevated plus maze, to investigate the effects of juvenile stress (JS on adulthood behaviour using a rodent model. During the cognitive bias test, animals were trained to discriminate between two reward bowls based on a stimulus (rough/smooth sandpaper encountered before they reached the bowls. One stimulus (e.g. rough was associated with a lower value reward than the other (e.g. smooth. Once rats were trained, their cognitive bias was explored through the presentation of an ambiguous stimulus (intermediate grade sandpaper: a rat was classed as optimistic if it chose the bowl ordinarily associated with the high value reward. JS animals were lighter than controls, exhibited increased anxiety-like behaviour in the elevated plus maze and were more optimistic in the cognitive bias test. This increased optimism may represent an optimal foraging strategy for these underweight animals. JS animals were also faster than controls to make a decision when presented with an ambiguous stimulus, suggesting altered decision making. These results demonstrate that stress in the juvenile phase can increase anxiety-like behaviour and alter cognitive bias and decision making in adulthood in a rat model.

  16. Decision making and executive function in male adolescents with early-onset or adolescence-onset conduct disorder and control subjects.

    Science.gov (United States)

    Fairchild, Graeme; van Goozen, Stephanie H M; Stollery, Sarah J; Aitken, Michael R F; Savage, Justin; Moore, Simon C; Goodyer, Ian M

    2009-07-15

    Although conduct disorder (CD) is associated with an increased susceptibility to substance use disorders, little is known about decision-making processes or reward mechanisms in CD. This study investigated decision making under varying motivational conditions in CD. Performances on the Risky Choice Task (RCT) and the Wisconsin Card Sorting Test (WCST) were assessed in 156 adolescents (84 control subjects, 34 with adolescence-onset CD, and 38 with early-onset CD). The RCT was performed twice, once under normal motivational conditions and once under conditions of increased motivation and psychosocial stress. Increased motivation and stress led to more cautious decision making and changes in framing effects on the RCT in all groups, although such effects were least pronounced in the early-onset CD group. Participants from both CD subgroups selected the risky choice more frequently than control subjects. Under normal motivational conditions, early-onset CD participants chose the risky choice more frequently in trials occurring after small gains, relative to control subjects and adolescence-onset CD participants. Following adjustment for IQ differences, the groups did not differ significantly in terms of WCST performance. Differences in decision making between control subjects and individuals with CD suggest that the balance between sensitivity to reward and punishment is shifted in this disorder, particularly the early-onset form. Our data on modulation of decision making according to previous outcomes suggest altered reward mechanisms in early-onset CD. The WCST data suggest that impairments in global executive function do not underlie altered decision making in CD.

  17. Abnormal decision-making in generalized anxiety disorder: Aversion of risk or stimulus-reinforcement impairment?

    OpenAIRE

    Teng, Cindy; Otero, Marcela; Geraci, Marilla; Blair, R.J.R.; Pine, Daniel S.; Grillon, Christian; Blair, Karina S.

    2016-01-01

    There is preliminary data indicating that patients with generalized anxiety disorder (GAD) show impairment on decision-making tasks requiring the appropriate representation of reinforcement value. The current study aimed to extend this literature using the passive avoidance (PA) learning task, where the participant has to learn to respond to stimuli that engender reward and avoid responding to stimuli that engender punishment. Six stimuli engendering reward and six engendering punishment are ...

  18. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence.

    Directory of Open Access Journals (Sweden)

    Matthew L Dixon

    Full Text Available Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task and created novel 'free-choice' versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.

  19. Prosocial reward learning in children and adolescents

    Directory of Open Access Journals (Sweden)

    Youngbin Kwak

    2016-10-01

    Full Text Available Adolescence is a period of increased sensitivity to social contexts. To evaluate how social context sensitivity changes over development – and influences reward learning – we investigated how children and adolescents perceive and integrate rewards for oneself and others during a dynamic risky-decision-making task. Children and adolescents (N=75, 8-16 yrs performed the Social Gambling Task (SGT, (Kwak et al., 2014 and completed a set of questionnaires measuring other-regarding behavior. In the SGT, participants choose amongst four card decks that have different payout structures for oneself and for a charity. We examined patterns of choices, overall decision strategies, and how reward outcomes led to trial-by-trial adjustments in behavior, as estimated using a reinforcement-learning model. Performance of children and adolescents was compared to data from a previously collected sample of adults (N=102 performing the identical task. We found that that children/adolescents were not only more sensitive to rewards directed to the charity than self but also showed greater prosocial tendencies on independent measures of other-regarding behavior. Children and adolescents also showed less use of a strategy that prioritizes rewards for self at the expense of rewards for others. These results support the conclusion that, compared to adults, children and adolescents show greater sensitivity to outcomes for others when making decisions and learning about potential rewards.

  20. Α4β2 and α7 nicotinic acetylcholine receptor binding predicts choice preference in two cost benefit decision-making tasks.

    Science.gov (United States)

    Mendez, I A; Damborsky, J C; Winzer-Serhan, U H; Bizon, J L; Setlow, B

    2013-01-29

    Nicotinic receptors have been linked to a wide range of cognitive and behavioral functions, but surprisingly little is known about their involvement in cost benefit decision making. The goal of these experiments was to determine how nicotinic acetylcholine receptor (nAChR) expression is related to two forms of cost benefit decision making. Male Long Evans rats were tested in probability- and delay-discounting tasks, which required discrete trial choices between a small reward and a large reward associated with varying probabilities of omission and varying delays to reward delivery, respectively. Following testing, radioligand binding to α4β2 and α7 nAChR subtypes in brain regions implicated in cost benefit decision making was examined. Significant linear relationships were observed between choice of the large delayed reward in the delay discounting task and α4β2 receptor binding in both the dorsal and ventral hippocampus. Additionally, trends were found suggesting that choice of the large costly reward in both discounting tasks was inversely related to α4β2 receptor binding in the medial prefrontal cortex and nucleus accumbens shell. Similar trends suggested that choice of the large delayed reward in the delay discounting task was inversely related to α4β2 receptor binding in the orbitofrontal cortex, nucleus accumbens core, and basolateral amygdala, as well as to α7 receptor binding in the basolateral amygdala. These data suggest that nAChRs (particularly α4β2) play both unique and common roles in decisions that require consideration of different types of reward costs. Copyright © 2012 IBRO. Published by Elsevier Ltd. All rights reserved.

  1. Data-Based Decision-Making: Developing a Method for Capturing Teachers' Understanding of CBM Graphs

    Science.gov (United States)

    Espin, Christine A.; Wayman, Miya Miura; Deno, Stanley L.; McMaster, Kristen L.; de Rooij, Mark

    2017-01-01

    In this special issue, we explore the decision-making aspect of "data-based decision-making". The articles in the issue address a wide range of research questions, designs, methods, and analyses, but all focus on data-based decision-making for students with learning difficulties. In this first article, we introduce the topic of…

  2. Hesitant Fuzzy Thermodynamic Method for Emergency Decision Making Based on Prospect Theory.

    Science.gov (United States)

    Ren, Peijia; Xu, Zeshui; Hao, Zhinan

    2017-09-01

    Due to the timeliness of emergency response and much unknown information in emergency situations, this paper proposes a method to deal with the emergency decision making, which can comprehensively reflect the emergency decision making process. By utilizing the hesitant fuzzy elements to represent the fuzziness of the objects and the hesitant thought of the experts, this paper introduces the negative exponential function into the prospect theory so as to portray the psychological behaviors of the experts, which transforms the hesitant fuzzy decision matrix into the hesitant fuzzy prospect decision matrix (HFPDM) according to the expectation-levels. Then, this paper applies the energy and the entropy in thermodynamics to take the quantity and the quality of the decision values into account, and defines the thermodynamic decision making parameters based on the HFPDM. Accordingly, a whole procedure for emergency decision making is conducted. What is more, some experiments are designed to demonstrate and improve the validation of the emergency decision making procedure. Last but not the least, this paper makes a case study about the emergency decision making in the firing and exploding at Port Group in Tianjin Binhai New Area, which manifests the effectiveness and practicability of the proposed method.

  3. The Interplay of Hippocampus and Ventromedial Prefrontal Cortex in Memory-Based Decision Making

    Directory of Open Access Journals (Sweden)

    Regina A. Weilbächer

    2016-12-01

    Full Text Available Episodic memory and value-based decision making are two central and intensively studied research domains in cognitive neuroscience, but we are just beginning to understand how they interact to enable memory-based decisions. The two brain regions that have been associated with episodic memory and value-based decision making are the hippocampus and the ventromedial prefrontal cortex, respectively. In this review article, we first give an overview of these brain–behavior associations and then focus on the mechanisms of potential interactions between the hippocampus and ventromedial prefrontal cortex that have been proposed and tested in recent neuroimaging studies. Based on those possible interactions, we discuss several directions for future research on the neural and cognitive foundations of memory-based decision making.

  4. Functional disconnection of the orbitofrontal cortex and basolateral amygdala impairs acquisition of a rat gambling task and disrupts animals' ability to alter decision-making behavior after reinforcer devaluation.

    Science.gov (United States)

    Zeeb, Fiona D; Winstanley, Catharine A

    2013-04-10

    An inability to adjust choice preferences in response to changes in reward value may underlie key symptoms of many psychiatric disorders, including chemical and behavioral addictions. We developed the rat gambling task (rGT) to investigate the neurobiology underlying complex decision-making processes. As in the Iowa Gambling task, the optimal strategy is to avoid choosing larger, riskier rewards and to instead favor options associated with smaller rewards but less loss and, ultimately, greater long-term gain. Given the demonstrated importance of the orbitofrontal cortex (OFC) and basolateral amygdala (BLA) in acquisition of the rGT and Iowa Gambling task, we used a contralateral disconnection lesion procedure to assess whether functional connectivity between these regions is necessary for optimal decision-making. Disrupting the OFC-BLA pathway retarded acquisition of the rGT. Devaluing the reinforcer by inducing sensory-specific satiety altered decision-making in control groups. In contrast, disconnected rats did not update their choice preference following reward devaluation, either when the devalued reward was still delivered or when animals needed to rely on stored representations of reward value (i.e., during extinction). However, all rats exhibited decreased premature responding and slower response latencies after satiety manipulations. Hence, disconnecting the OFC and BLA did not affect general behavioral changes caused by reduced motivation, but instead prevented alterations in the value of a specific reward from contributing appropriately to cost-benefit decision-making. These results highlight the role of the OFC-BLA pathway in the decision-making process and suggest that communication between these areas is vital for the appropriate assessment of reward value to influence choice.

  5. Decision-making Under Risk in Children, Adolescents, and Adults

    Directory of Open Access Journals (Sweden)

    David ePaulsen

    2011-04-01

    Full Text Available Adolescents often make risky and impulsive decisions. Such behavior has led to the common assumption that a dysfunction in risk-related decision-making peaks during this age. Differences in how risk has been defined across studies, however, make it difficult to draw conclusions about developmental changes in risky decision-making. Here, we developed a non-symbolic economic decision-making task that can be used across a wide age span and that uses coefficient of variation (CV in reward as an index of risk. We found that young children showed the strongest preference for risky compared to sure bet options of equal expected value, adolescents were intermediate in their risk preference, and young adults showed the strongest risk aversion. Furthermore, children’s preference for the risky option increased for larger CVs, while adolescents and young adults showed the opposite pattern, favoring the sure bet more often as CV increased. Finally, when faced with two gambles in a risk-return tradeoff, all three age groups exhibited a greater preference for the option with the lower risk and return as the disparity in risk between the two options increased. These findings demonstrate clear age-related differences in economic risk preferences that vary with choice set and risk. Importantly, adolescence appears to represent an intermediate decision-making phenotype along the transition from childhood to adulthood, rather than an age of heightened preference for economic risk.

  6. Impaired decision-making and selective cortical frontal thinning in Cushing's syndrome.

    Science.gov (United States)

    Crespo, Iris; Esther, Granell-Moreno; Santos, Alicia; Valassi, Elena; Yolanda, Vives-Gilabert; De Juan-Delago, Manel; Webb, Susan M; Gómez-Ansón, Beatriz; Resmini, Eugenia

    2014-12-01

    Cushing's syndrome (CS) is caused by a glucocorticoid excess. This hypercortisolism can damage the prefrontal cortex, known to be important in decision-making. Our aim was to evaluate decision-making in CS and to explore cortical thickness. Thirty-five patients with CS (27 cured, eight medically treated) and thirty-five matched controls were evaluated using Iowa gambling task (IGT) and 3 Tesla magnetic resonance imaging (MRI) to assess cortical thickness. The IGT evaluates decision-making, including strategy and learning during the test. Cortical thickness was determined on MRI using freesurfer software tools, including a whole-brain analysis. There were no differences between medically treated and cured CS patients. They presented an altered decision-making strategy compared to controls, choosing a lower number of the safer cards (P behaviour was driven by short-term reward and long-term punishment, indicating learning problems because they did not use previous experience as a feedback factor to regulate their choices. These alterations in decision-making and the decreased cortical thickness in frontal areas suggest that chronic hypercortisolism promotes brain changes which are not completely reversible after endocrine remission. © 2014 John Wiley & Sons Ltd.

  7. Reward-related learning via multiple memory systems.

    Science.gov (United States)

    Delgado, Mauricio R; Dickerson, Kathryn C

    2012-07-15

    The application of a neuroeconomic approach to the study of reward-related processes has provided significant insights in our understanding of human learning and decision making. Much of this research has focused primarily on the contributions of the corticostriatal circuitry, involved in trial-and-error reward learning. As a result, less consideration has been allotted to the potential influence of different neural mechanisms such as the hippocampus or to more common ways in human society in which information is acquired and utilized to reach a decision, such as through explicit instruction rather than trial-and-error learning. This review examines the individual contributions of multiple learning and memory neural systems and their interactions during human decision making in both normal and neuropsychiatric populations. Specifically, the anatomical and functional connectivity across multiple memory systems are highlighted to suggest that probing the role of the hippocampus and its interactions with the corticostriatal circuitry via the application of model-based neuroeconomic approaches may provide novel insights into neuropsychiatric populations that suffer from damage to one of these structures and as a consequence have deficits in learning, memory, or decision making. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  8. Decision-Making under Criteria Uncertainty

    Science.gov (United States)

    Kureychik, V. M.; Safronenkova, I. B.

    2018-05-01

    Uncertainty is an essential part of a decision-making procedure. The paper deals with the problem of decision-making under criteria uncertainty. In this context, decision-making under uncertainty, types and conditions of uncertainty were examined. The decision-making problem under uncertainty was formalized. A modification of the mathematical decision support method under uncertainty via ontologies was proposed. A critical distinction of the developed method is ontology usage as its base elements. The goal of this work is a development of a decision-making method under criteria uncertainty with the use of ontologies in the area of multilayer board designing. This method is oriented to improvement of technical-economic values of the examined domain.

  9. Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost–benefit decision making tasks in rats

    Science.gov (United States)

    Mendez, Ian A.; Gilbert, Ryan J.; Bizon, Jennifer L.

    2012-01-01

    Rationale Alterations in cost–benefit decision making accompany numerous neuropsychiatric conditions, including schizophrenia, attention deficit hyperactivity disorder, and addiction. Central cholinergic systems have been linked to the etiology and/or treatment of many of these conditions, but little is known about the role of cholinergic signaling in cost–benefit decision making. Objectives The goal of these experiments was to determine how cholinergic signaling is involved in cost–benefit decision making, using a behavioral pharmacological approach. Methods Male Long-Evans rats were trained in either “probability discounting” or “delay discounting” tasks, in which rats made discrete-trial choices between a small food reward and a large food reward associated with either varying probabilities of omission or varying delays to delivery, respectively. The effects of acute administration of different doses of nicotinic and muscarinic acetylcholine receptor agonists and antagonists were assessed in each task. Results In the probability discounting task, acute nicotine administration (1.0 mg/kg) significantly increased choice of the large risky reward, and control experiments suggested that this was due to robust nicotine-induced impairments in behavioral flexibility. In the delay discounting task, the muscarinic antagonists scopolamine (0.03, 0.1, and 0.3 mg/kg) and atropine (0.3 mg/kg) both significantly increased choice of the small immediate reward. Neither mecamylamine nor oxotremorine produced reliable effects on either of the decision making tasks. Conclusions These data suggest that cholinergic receptors play multiple roles in decision making contexts which include consideration of reward delay or probability. These roles should be considered when targeting these receptors for therapeutic purposes. PMID:22760484

  10. The detrimental effects of emotional process dysregulation on decision making in substance dependence

    Directory of Open Access Journals (Sweden)

    Anna eMurphy

    2012-11-01

    Full Text Available Substance dependence is complex and multifactorial, with many distinct pathways involved in both the development and subsequent maintenance of addictive behaviours. Various cognitive mechanisms have been implicated, including impulsivity, compulsivity and impaired decision-making. These mechanisms are modulated by emotional processes, resulting in increased likelihood of initial drug use, sustained substance dependence, and increased relapse during periods of abstinence. Emotional traits, such as sensation seeking, are risk factors for substance use, and chronic drug use can result in further emotional dysregulation via effects on reward, motivation and stress systems. We will explore theories of hyper and hypo sensitivity of the brain reward systems that may underpin motivational abnormalities and anhedonia. Disturbances in these systems contribute to the biasing of emotional processing toward cues related to drug use at the expense of natural rewards, which serves to maintain addictive behaviour, via enhanced drug craving. We will additionally focus on the sensitization of the brain stress systems that result in negative affect states that continue into protracted abstinence that is may lead to compulsive drug taking. We will explore how these emotional dysregulations impact upon decision-making controlled by goal-directed and habitual action selections systems, and, in combination with a failure of prefrontal inhibitory control, mediate maladaptive decision-making observed in substance dependent individuals such that they continue drug use in spite of negative consequences. An understanding of the emotional impacts on cognition in substance dependent individuals may guide the development of more effective therapeutic interventions.

  11. A big data analysis of the relationship between future thinking and decision-making.

    Science.gov (United States)

    Thorstad, Robert; Wolff, Phillip

    2018-02-20

    We use big data methods to investigate how decision-making might depend on future sightedness (that is, on how far into the future people's thoughts about the future extend). In study 1, we establish a link between future thinking and decision-making at the population level in showing that US states with citizens having relatively far future sightedness, as reflected in their tweets, take fewer risks than citizens in states having relatively near future sightedness. In study 2, we analyze people's tweets to confirm a connection between future sightedness and decision-making at the individual level in showing that people with long future sightedness are more likely to choose larger future rewards over smaller immediate rewards. In study 3, we show that risk taking decreases with increases in future sightedness as reflected in people's tweets. The ability of future sightedness to predict decisions suggests that future sightedness is a relatively stable cognitive characteristic. This implication was supported in an analysis of tweets by over 38,000 people that showed that future sightedness has both state and trait characteristics (study 4). In study 5, we provide evidence for a potential mechanism by which future sightedness can affect decisions in showing that far future sightedness can make the future seem more connected to the present, as reflected in how people refer to the present, past, and future in their tweets over the course of several minutes. Our studies show how big data methods can be applied to naturalistic data to reveal underlying psychological properties and processes.

  12. Impairment of probabilistic reward-based learning in schizophrenia.

    Science.gov (United States)

    Weiler, Julia A; Bellebaum, Christian; Brüne, Martin; Juckel, Georg; Daum, Irene

    2009-09-01

    Recent models assume that some symptoms of schizophrenia originate from defective reward processing mechanisms. Understanding the precise nature of reward-based learning impairments might thus make an important contribution to the understanding of schizophrenia and the development of treatment strategies. The present study investigated several features of probabilistic reward-based stimulus association learning, namely the acquisition of initial contingencies, reversal learning, generalization abilities, and the effects of reward magnitude. Compared to healthy controls, individuals with schizophrenia exhibited attenuated overall performance during acquisition, whereas learning rates across blocks were similar to the rates of controls. On the group level, persons with schizophrenia were, however, unable to learn the reversal of the initial reward contingencies. Exploratory analysis of only the subgroup of individuals with schizophrenia who showed significant learning during acquisition yielded deficits in reversal learning with low reward magnitudes only. There was further evidence of a mild generalization impairment of the persons with schizophrenia in an acquired equivalence task. In summary, although there was evidence of intact basic processing of reward magnitudes, individuals with schizophrenia were impaired at using this feedback for the adaptive guidance of behavior.

  13. Lone ranger decision making versus consensus decision making: Descriptive analysis

    OpenAIRE

    Maite Sara Mashego

    2015-01-01

    Consensus decision making, concerns group members make decisions together with the requirement of reaching a consensus that is all members abiding by the decision outcome. Lone ranging worked for sometime in a autocratic environment. Researchers are now pointing to consensus decision-making in organizations bringing dividend to many organizations. This article used a descriptive analysis to compare the goodness of consensus decision making and making lone ranging decision management. This art...

  14. Decision-making under risk in children, adolescents, and young adults.

    Science.gov (United States)

    Paulsen, David J; Platt, Michael L; Huettel, Scott A; Brannon, Elizabeth M

    2011-01-01

    Adolescents often make risky and impulsive decisions. Such behavior has led to the common assumption that a dysfunction in risk-related decision-making peaks during this age. Differences in how risk has been defined across studies, however, make it difficult to draw conclusions about developmental changes in risky decision-making. Here, we developed a non-symbolic economic decision-making task that can be used across a wide age span and that uses coefficient of variation (CV) in reward as an index of risk. We found that young children showed the strongest preference for risky compared to sure bet options of equal expected value, adolescents were intermediate in their risk preference, and young adults showed the strongest risk aversion. Furthermore, children's preference for the risky option increased for larger CVs, while adolescents and young adults showed the opposite pattern, favoring the sure bet more often as CV increased. Finally, when faced with two gambles in a risk-return tradeoff, all three age groups exhibited a greater preference for the option with the lower risk and return as the disparity in risk between the two options increased. These findings demonstrate clear age-related differences in economic risk preferences that vary with choice set and risk. Importantly, adolescence appears to represent an intermediate decision-making phenotype along the transition from childhood to adulthood, rather than an age of heightened preference for economic risk.

  15. On a triadic neurocognitive approach of decision-making to addiction

    Directory of Open Access Journals (Sweden)

    Xavier Noël

    2015-04-01

    Full Text Available Paradoxical behaviours characterizing an addiction could be understood as the result of a combination between an attempt to cope with dominant painful feelings (e.g., anxiety with low self-esteem and sub-optimal decision-making prioritizing short-term over long-term consequences. This article focused on decision-making and emphasized that addicts’ decisions are determined by immediate outcomes because of abnormal interactions between key neural and cognitive systems: (1 an automatic, habitual and salient information processing mediated by amygdala-striatum dependent system; (2 an intention self-regulatory system forecasting the future consequences of a choice; (3 a interoceptive signals processing system which generates feeling states and in turn plays a strong influential role in decision-making and impulse control processes related to uncertainty, risk, and reward. As a whole, sub-optimal interactions such as a too strong automatic stimulus-driven actions associated with poor intentional control and a state of stress or craving are thought to result in prioritizing short-term consequences at the detriment of the necessary forecast of delayed consequences.

  16. Is it Worth the Effort? Novel Insights into Obesity-Associated Alterations in Cost-Benefit Decision-Making.

    Science.gov (United States)

    Mathar, David; Horstmann, Annette; Pleger, Burkhard; Villringer, Arno; Neumann, Jane

    2015-01-01

    Cost-benefit decision-making entails the process of evaluating potential actions according to the trade-off between the expected reward (benefit) and the anticipated effort (costs). Recent research revealed that dopaminergic transmission within the fronto-striatal circuitry strongly modulates cost-benefit decision-making. Alterations within the dopaminergic fronto-striatal system have been associated with obesity, but little is known about cost-benefit decision-making differences in obese compared with lean individuals. With a newly developed experimental task we investigate obesity-associated alterations in cost-benefit decision-making, utilizing physical effort by handgrip-force exertion and both food and non-food rewards. We relate our behavioral findings to alterations in local gray matter volume assessed by structural MRI. Obese compared with lean subjects were less willing to engage in physical effort in particular for high-caloric sweet snack food. Further, self-reported body dissatisfaction negatively correlated with the willingness to invest effort for sweet snacks in obese men. On a structural level, obesity was associated with reductions in gray matter volume in bilateral prefrontal cortex. Nucleus accumbens volume positively correlated with task induced implicit food craving. Our results challenge the common notion that obese individuals are willing to work harder to obtain high-caloric food and emphasize the need for further exploration of the underlying neural mechanisms regarding cost-benefit decision-making differences in obesity.

  17. Risk-based decision making for terrorism applications.

    Science.gov (United States)

    Dillon, Robin L; Liebe, Robert M; Bestafka, Thomas

    2009-03-01

    This article describes the anti-terrorism risk-based decision aid (ARDA), a risk-based decision-making approach for prioritizing anti-terrorism measures. The ARDA model was developed as part of a larger effort to assess investments for protecting U.S. Navy assets at risk and determine whether the most effective anti-terrorism alternatives are being used to reduce the risk to the facilities and war-fighting assets. With ARDA and some support from subject matter experts, we examine thousands of scenarios composed of 15 attack modes against 160 facility types on two installations and hundreds of portfolios of 22 mitigation alternatives. ARDA uses multiattribute utility theory to solve some of the commonly identified challenges in security risk analysis. This article describes the process and documents lessons learned from applying the ARDA model for this application.

  18. Decision-Making in Patients with Hyperthyroidism: A Neuropsychological Study.

    Science.gov (United States)

    Yuan, Lili; Tian, Yanghua; Zhang, Fangfang; Ma, Huijuan; Chen, Xingui; Dai, Fang; Wang, Kai

    2015-01-01

    Cognitive and behavioral impairments are common in patients with abnormal thyroid function; these impairments cause a reduction in their quality of life. The current study investigates the decision making performance in patients with hyperthyroidism to explore the possible mechanism of their cognitive and behavioral impairments. Thirty-eight patients with hyperthyroidism and forty healthy control subjects were recruited to perform the Iowa Gambling Task (IGT), which assessed decision making under ambiguous conditions. Patients with hyperthyroidism had a higher score on the Zung Self-Rating Anxiety Scale (Z-SAS), and exhibited poorer executive function and IGT performance than did healthy control subjects. The patients preferred to choose decks with a high immediate reward, despite a higher future punishment, and were not capable of effectively using feedback information from previous choices. No clinical characteristics were associated with the total net score of the IGT in the current study. Patients with hyperthyroidism had decision-making impairment under ambiguous conditions. The deficits may result from frontal cortex and limbic system metabolic disorders and dopamine dysfunction.

  19. Decision-Making in Patients with Hyperthyroidism: A Neuropsychological Study

    Science.gov (United States)

    Zhang, Fangfang; Ma, Huijuan; Chen, Xingui; Dai, Fang; Wang, Kai

    2015-01-01

    Introduction Cognitive and behavioral impairments are common in patients with abnormal thyroid function; these impairments cause a reduction in their quality of life. The current study investigates the decision making performance in patients with hyperthyroidism to explore the possible mechanism of their cognitive and behavioral impairments. Methods Thirty-eight patients with hyperthyroidism and forty healthy control subjects were recruited to perform the Iowa Gambling Task (IGT), which assessed decision making under ambiguous conditions. Results Patients with hyperthyroidism had a higher score on the Zung Self-Rating Anxiety Scale (Z-SAS), and exhibited poorer executive function and IGT performance than did healthy control subjects. The patients preferred to choose decks with a high immediate reward, despite a higher future punishment, and were not capable of effectively using feedback information from previous choices. No clinical characteristics were associated with the total net score of the IGT in the current study. Conclusions Patients with hyperthyroidism had decision-making impairment under ambiguous conditions. The deficits may result from frontal cortex and limbic system metabolic disorders and dopamine dysfunction. PMID:26090955

  20. Modelling decision-making by pilots

    Science.gov (United States)

    Patrick, Nicholas J. M.

    1993-01-01

    Our scientific goal is to understand the process of human decision-making. Specifically, a model of human decision-making in piloting modern commercial aircraft which prescribes optimal behavior, and against which we can measure human sub-optimality is sought. This model should help us understand such diverse aspects of piloting as strategic decision-making, and the implicit decisions involved in attention allocation. Our engineering goal is to provide design specifications for (1) better computer-based decision-aids, and (2) better training programs for the human pilot (or human decision-maker, DM).

  1. Temporal characteristics of the influence of punishment on perceptual decision making in the human brain

    OpenAIRE

    Blank, H.; Guido, B.; Heekeren, H.R.; Philiastides, M.G.

    2013-01-01

    Perceptual decision making is the process by which information from sensory systems is combined and used to influence our behavior. In addition to the sensory input, this process can be affected by other factors, such as reward and punishment for correct and incorrect responses. To investigate the temporal dynamics of how monetary punishment influences perceptual decision making in humans, we collected electroencephalography (EEG) data during a perceptual categorization task whereby the punis...

  2. Interval-Valued Intuitionistic Fuzzy Multicriteria Group Decision Making Based on VIKOR and Choquet Integral

    Directory of Open Access Journals (Sweden)

    Chunqiao Tan

    2013-01-01

    Full Text Available An effective decision making approach based on VIKOR and Choquet integral is developed to solve multicriteria group decision making problem with conflicting criteria and interdependent subjective preference of decision makers in a fuzzy environment where preferences of decision makers with respect to criteria are represented by interval-valued intuitionistic fuzzy sets. First, an interval-valued intuitionistic fuzzy Choquet integral operator is given. Some of its properties are investigated in detail. The extended VIKOR decision procedure based on the proposed operator is developed for solving the multicriteria group decision making problem where the interactive criteria weight is measured by Shapley value. An illustrative example is given for demonstrating the applicability of the proposed decision procedure for solving the multi-criteria group decision making problem in interval-valued intuitionistic fuzzy environment.

  3. Multi-objective decision-making model based on CBM for an aircraft fleet

    Science.gov (United States)

    Luo, Bin; Lin, Lin

    2018-04-01

    Modern production management patterns, in which multi-unit (e.g., a fleet of aircrafts) are managed in a holistic manner, have brought new challenges for multi-unit maintenance decision making. To schedule a good maintenance plan, not only does the individual machine maintenance have to be considered, but also the maintenance of the other individuals have to be taken into account. Since most condition-based maintenance researches for aircraft focused on solely reducing maintenance cost or maximizing the availability of single aircraft, as well as considering that seldom researches concentrated on both the two objectives: minimizing cost and maximizing the availability of a fleet (total number of available aircraft in fleet), a multi-objective decision-making model based on condition-based maintenance concentrated both on the above two objectives is established. Furthermore, in consideration of the decision maker may prefer providing the final optimal result in the form of discrete intervals instead of a set of points (non-dominated solutions) in real decision-making problem, a novel multi-objective optimization method based on support vector regression is proposed to solve the above multi-objective decision-making model. Finally, a case study regarding a fleet is conducted, with the results proving that the approach efficiently generates outcomes that meet the schedule requirements.

  4. Separate neural mechanisms underlie choices and strategic preferences in risky decision making.

    Science.gov (United States)

    Venkatraman, Vinod; Payne, John W; Bettman, James R; Luce, Mary Frances; Huettel, Scott A

    2009-05-28

    Adaptive decision making in real-world contexts often relies on strategic simplifications of decision problems. Yet, the neural mechanisms that shape these strategies and their implementation remain largely unknown. Using an economic decision-making task, we dissociate brain regions that predict specific choices from those predicting an individual's preferred strategy. Choices that maximized gains or minimized losses were predicted by functional magnetic resonance imaging activation in ventromedial prefrontal cortex or anterior insula, respectively. However, choices that followed a simplifying strategy (i.e., attending to overall probability of winning) were associated with activation in parietal and lateral prefrontal cortices. Dorsomedial prefrontal cortex, through differential functional connectivity with parietal and insular cortex, predicted individual variability in strategic preferences. Finally, we demonstrate that robust decision strategies follow from neural sensitivity to rewards. We conclude that decision making reflects more than compensatory interaction of choice-related regions; in addition, specific brain systems potentiate choices depending on strategies, traits, and context.

  5. Multiattribute Decision Making Based on Entropy under Interval-Valued Intuitionistic Fuzzy Environment

    Directory of Open Access Journals (Sweden)

    Yingjun Zhang

    2013-01-01

    Full Text Available Multiattribute decision making (MADM is one of the central problems in artificial intelligence, specifically in management fields. In most cases, this problem arises from uncertainty both in the data derived from the decision maker and the actions performed in the environment. Fuzzy set and high-order fuzzy sets were proven to be effective approaches in solving decision-making problems with uncertainty. Therefore, in this paper, we investigate the MADM problem with completely unknown attribute weights in the framework of interval-valued intuitionistic fuzzy (IVIF set (IVIFS. We first propose a new definition of IVIF entropy and some calculation methods for IVIF entropy. Furthermore, we propose an entropy-based decision-making method to solve IVIF MADM problems with completely unknown attribute weights. Particular emphasis is put on assessing the attribute weights based on IVIF entropy. Instead of the traditional methods, which use divergence among attributes or the probabilistic discrimination of attributes to obtain attribute weights, we utilize the IVIF entropy to assess the attribute weights based on the credibility of the decision-making matrix for solving the problem. Finally, a supplier selection example is given to demonstrate the feasibility and validity of the proposed MADM method.

  6. Strategic decision making

    NARCIS (Netherlands)

    Stokman, Frans N.; Assen, Marcel A.L.M. van; Knoop, Jelle van der; Oosten, Reinier C.H. van

    2000-01-01

    This paper introduces a methodology for strategic intervention in collective decision making.The methodology is based on (1) a decomposition of the problem into a few main controversial issues, (2) systematic interviews of subject area specialists to obtain a specification of the decision

  7. Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

    Science.gov (United States)

    Dasgupta, Sakyasingha; Wörgötter, Florentin; Manoonpong, Poramate

    2014-01-01

    Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.

  8. Impulsivity and decision-making in obsessive-compulsive disorder after effective deep brain stimulation or treatment as usual.

    Science.gov (United States)

    Grassi, Giacomo; Figee, Martijn; Ooms, Pieter; Righi, Lorenzo; Nakamae, Takashi; Pallanti, Stefano; Schuurman, Rick; Denys, Damiaan

    2018-06-04

    Impulsivity and impaired decision-making have been proposed as obsessive-compulsive disorder (OCD) endophenotypes, running in OCD and their healthy relatives independently of symptom severity and medication status. Deep brain stimulation (DBS) targeting the ventral limb of the internal capsule (vALIC) and the nucleus accumbens (Nacc) is an effective treatment strategy for treatment-refractory OCD. The effectiveness of vALIC-DBS for OCD has been linked to its effects on a frontostriatal network that is also implicated in reward, impulse control, and decision-making. While vALIC-DBS has been shown to restore reward dysfunction in OCD patients, little is known about the effects of vALIC-DBS on impulsivity and decision-making. The aim of the study was to compare cognitive impulsivity and decision-making between OCD patients undergoing effective vALIC-DBS or treatment as usual (TAU), and healthy controls. We used decision-making performances under ambiguity on the Iowa Gambling Task and reflection impulsivity on the Beads Task to compare 20 OCD patients effectively treated with vALIC-DBS, 40 matched OCD patients undergoing effective TAU (medication and/or cognitive behavioural therapy), and 40 healthy subjects. Effective treatment was defined as at least 35% improvement of OCD symptoms. OCD patients, irrespective of treatment modality (DBS or TAU), showed increased reflection impulsivity and impaired decision-making compared to healthy controls. No differences were observed between OCD patients treated with DBS or TAU. OCD patients effectively treated with vALIC-DBS or TAU display increased reflection impulsivity and impaired decision-making independent of the type of treatment.

  9. The impact of disappointment in decision making: Inter-individual differences and electrical neuroimaging

    Directory of Open Access Journals (Sweden)

    Helène eTzieropoulos

    2011-01-01

    Full Text Available Disappointment, the emotion experienced when faced to reward prediction errors, considerably impact decision making. Individuals tend to modify their behavior in an often unpredictable way just to avoid experiencing negative emotions. Despite its importance, disappointment remains much less studied than regret and its impact on upcoming decisions largely unexplored. Here, we adapted the Trust Game to effectively elicit, quantify and isolate disappointment by relying on the formal definition provided by Bell’s in economics. We evaluated the effects of experienced disappointment and elation on future cooperation and trust as well as the rationality and utility of the different behavioral and neural mechanisms used to cope with disappointment. All participants in our game trusted less and particularly expected less from unknown opponents as a result of disappointing outcomes in the previous trial but not necessarily after elation indicating that behavioral consequences of positive and negative reward prediction errors are not the same. A large variance in the tolerance to disappointment was observed across subjects, with some participants needing only a small disappointment to impulsively bias their subsequent decisions. As revealed by high-density EEG recordings the most tolerant individuals - who thought twice before making a decision and earned more money – relied on different neural generators to contend with neutral and unexpected outcomes. This study thus provide some support to the idea that different neural systems underlie reflexive and reflective decisions within the same individuals as predicted by the dual-system theory of social judgment and decision making.

  10. The Fox and the Grapes-How Physical Constraints Affect Value Based Decision Making.

    Directory of Open Access Journals (Sweden)

    Jörg Gross

    Full Text Available One fundamental question in decision making research is how humans compute the values that guide their decisions. Recent studies showed that people assign higher value to goods that are closer to them, even when physical proximity should be irrelevant for the decision from a normative perspective. This phenomenon, however, seems reasonable from an evolutionary perspective. Most foraging decisions of animals involve the trade-off between the value that can be obtained and the associated effort of obtaining. Anticipated effort for physically obtaining a good could therefore affect the subjective value of this good. In this experiment, we test this hypothesis by letting participants state their subjective value for snack food while the effort that would be incurred when reaching for it was manipulated. Even though reaching was not required in the experiment, we find that willingness to pay was significantly lower when subjects wore heavy wristbands on their arms. Thus, when reaching was more difficult, items were perceived as less valuable. Importantly, this was only the case when items were physically in front of the participants but not when items were presented as text on a computer screen. Our results suggest automatic interactions of motor and valuation processes which are unexplored to this date and may account for irrational decisions that occur when reward is particularly easy to reach.

  11. The Fox and the Grapes-How Physical Constraints Affect Value Based Decision Making.

    Science.gov (United States)

    Gross, Jörg; Woelbert, Eva; Strobel, Martin

    2015-01-01

    One fundamental question in decision making research is how humans compute the values that guide their decisions. Recent studies showed that people assign higher value to goods that are closer to them, even when physical proximity should be irrelevant for the decision from a normative perspective. This phenomenon, however, seems reasonable from an evolutionary perspective. Most foraging decisions of animals involve the trade-off between the value that can be obtained and the associated effort of obtaining. Anticipated effort for physically obtaining a good could therefore affect the subjective value of this good. In this experiment, we test this hypothesis by letting participants state their subjective value for snack food while the effort that would be incurred when reaching for it was manipulated. Even though reaching was not required in the experiment, we find that willingness to pay was significantly lower when subjects wore heavy wristbands on their arms. Thus, when reaching was more difficult, items were perceived as less valuable. Importantly, this was only the case when items were physically in front of the participants but not when items were presented as text on a computer screen. Our results suggest automatic interactions of motor and valuation processes which are unexplored to this date and may account for irrational decisions that occur when reward is particularly easy to reach.

  12. Video-based training to improve perceptual-cognitive decision-making performance of Australian football umpires.

    Science.gov (United States)

    Larkin, Paul; Mesagno, Christopher; Berry, Jason; Spittle, Michael; Harvey, Jack

    2018-02-01

    Decision-making is a central component of the in-game performance of Australian football umpires; however, current umpire training focuses largely on physiological development with decision-making skills development conducted via explicit lecture-style meetings with limited practice devoted to making actual decisions. Therefore, this study investigated the efficacy of a video-based training programme, aimed to provide a greater amount of contextualised visual experiences without explicit instruction, to improve decision-making skills of umpires. Australian football umpires (n = 52) were recruited from metropolitan and regional Division 1 competitions. Participants were randomly assigned to an intervention or control group and classified according to previous umpire game experience (i.e., experienced; less experienced). The intervention group completed a 12-week video-based decision-making training programme, with decision-making performance assessed at pre-training, and 1-week retention and 3-week retention periods. The control group did not complete any video-based training. Results indicated a significant Group (intervention; Control) × Test interaction (F(1, 100) = 3.98; P = 0.02, partial ῆ 2  = 0.074), with follow-up pairwise comparisons indicating significant within-group differences over time for the intervention group. In addition, decision-making performance of the less experienced umpires in the intervention group significantly improved (F(2, 40) = 5.03, P = 0.01, partial ῆ 2  = 0.201). Thus, video-based training programmes may be a viable adjunct to current training programmes to hasten decision-making development, especially for less experienced umpires.

  13. NATO Guide for Judgement-Based Operational Analysis in Defence Decision Making : Executive Leaflet

    NARCIS (Netherlands)

    Wijnmalen, D.J.D.; et al

    2012-01-01

    Judgment plays an important role in all Operational Analysis (OA). NATO practitioners have determined that approaches in OA that are based on human judgement are increasingly critical to defence decision making. The purpose of the NATO Guide for Judgement-Based OA in Defence Decision Making is to

  14. A Multiple Criteria Decision Making Method Based on Relative Value Distances

    Directory of Open Access Journals (Sweden)

    Shyur Huan-jyh

    2015-12-01

    Full Text Available This paper proposes a new multiple criteria decision-making method called ERVD (election based on relative value distances. The s-shape value function is adopted to replace the expected utility function to describe the risk-averse and risk-seeking behavior of decision makers. Comparisons and experiments contrasting with the TOPSIS (Technique for Order Preference by Similarity to the Ideal Solution method are carried out to verify the feasibility of using the proposed method to represent the decision makers’ preference in the decision making process. Our experimental results show that the proposed approach is an appropriate and effective MCDM method.

  15. Frontal, Striatal, and Medial Temporal Sensitivity to Value Distinguishes Risk-Taking from Risk-Aversive Older Adults during Decision Making.

    Science.gov (United States)

    Goh, Joshua O S; Su, Yu-Shiang; Tang, Yong-Jheng; McCarrey, Anna C; Tereshchenko, Alexander; Elkins, Wendy; Resnick, Susan M

    2016-12-07

    Aging compromises the frontal, striatal, and medial temporal areas of the reward system, impeding accurate value representation and feedback processing critical for decision making. However, substantial variability characterizes age-related effects on the brain so that some older individuals evince clear neurocognitive declines whereas others are spared. Moreover, the functional correlates of normative individual differences in older-adult value-based decision making remain unclear. We performed a functional magnetic resonance imaging study in 173 human older adults during a lottery choice task in which costly to more desirable stakes were depicted using low to high expected values (EVs) of points. Across trials that varied in EVs, participants decided to accept or decline the offered stakes to maximize total accumulated points. We found that greater age was associated with less optimal decisions, accepting stakes when losses were likely and declining stakes when gains were likely, and was associated with increased frontal activity for costlier stakes. Critically, risk preferences varied substantially across older adults and neural sensitivity to EVs in the frontal, striatal, and medial temporal areas dissociated risk-aversive from risk-taking individuals. Specifically, risk-averters increased neural responses to increasing EVs as stakes became more desirable, whereas risk-takers increased neural responses with decreasing EV as stakes became more costly. Risk preference also modulated striatal responses during feedback with risk-takers showing more positive responses to gains compared with risk-averters. Our findings highlight the frontal, striatal, and medial temporal areas as key neural loci in which individual differences differentially affect value-based decision-making ability in older adults. Frontal, striatal, and medial temporal functions implicated in value-based decision processing of rewards and costs undergo substantial age-related changes. However, age

  16. How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.

    Science.gov (United States)

    Krigolson, Olav E; Hassall, Cameron D; Handy, Todd C

    2014-03-01

    Our ability to make decisions is predicated upon our knowledge of the outcomes of the actions available to us. Reinforcement learning theory posits that actions followed by a reward or punishment acquire value through the computation of prediction errors-discrepancies between the predicted and the actual reward. A multitude of neuroimaging studies have demonstrated that rewards and punishments evoke neural responses that appear to reflect reinforcement learning prediction errors [e.g., Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. Learning to become an expert: Reinforcement learning and the acquisition of perceptual expertise. Journal of Cognitive Neuroscience, 21, 1833-1840, 2009; Bayer, H. M., & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141, 2005; O'Doherty, J. P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776, 2004; Holroyd, C. B., & Coles, M. G. H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002]. Here, we used the brain ERP technique to demonstrate that not only do rewards elicit a neural response akin to a prediction error but also that this signal rapidly diminished and propagated to the time of choice presentation with learning. Specifically, in a simple, learnable gambling task, we show that novel rewards elicited a feedback error-related negativity that rapidly decreased in amplitude with learning. Furthermore, we demonstrate the existence of a reward positivity at choice presentation, a previously unreported ERP component that has a similar timing and topography as the feedback error-related negativity that increased in amplitude with learning. The pattern of results we observed mirrored the output of a computational model that we implemented to compute reward

  17. Optimal decision making on the basis of evidence represented in spike trains.

    Science.gov (United States)

    Zhang, Jiaxiang; Bogacz, Rafal

    2010-05-01

    Experimental data indicate that perceptual decision making involves integration of sensory evidence in certain cortical areas. Theoretical studies have proposed that the computation in neural decision circuits approximates statistically optimal decision procedures (e.g., sequential probability ratio test) that maximize the reward rate in sequential choice tasks. However, these previous studies assumed that the sensory evidence was represented by continuous values from gaussian distributions with the same variance across alternatives. In this article, we make a more realistic assumption that sensory evidence is represented in spike trains described by the Poisson processes, which naturally satisfy the mean-variance relationship observed in sensory neurons. We show that for such a representation, the neural circuits involving cortical integrators and basal ganglia can approximate the optimal decision procedures for two and multiple alternative choice tasks.

  18. Decision Making in Action

    Science.gov (United States)

    Orasanu, Judith; Statler, Irving C. (Technical Monitor)

    1994-01-01

    The importance of decision-making to safety in complex, dynamic environments like mission control centers and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. A similar observation has been made in nuclear power plants. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multidimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication

  19. Tools for collaborative decision-making

    CERN Document Server

    Zaraté, Pascale

    2013-01-01

    Decision-making has evolved recently thanks to the introduction of information and communication technologies in many organizations, which has led to new kinds of decision-making processes, called "collaborative decision-making", at the organizational and cognitive levels. This book looks at the development of the decision-making process in organizations. Decision-aiding and its paradigm of problem solving are defined, showing how decision-makers now need to work in a cooperative way. Definitions of cooperation and associated concepts such as collaboration and coordination are given and a framework of cooperative decision support systems is presented, including intelligent DSS, cooperative knowledge-based systems, workflow, group support systems, collaborative engineering, integrating with a collaborative decision-making model in part or being part of global projects. Several models and experimental studies are also included showing that these new processes have to be supported by new types of tools, several ...

  20. Nuclear regulatory decision making

    International Nuclear Information System (INIS)

    Wieland, Patricia; Almeida, Ivan Pedro Salati de

    2011-01-01

    The scientific considerations upon which the nuclear regulations are based provide objective criteria for decisions on nuclear safety matters. However, the decisions that a regulatory agency takes go far beyond granting or not an operating license based on assessment of compliance. It may involve decisions about hiring experts or research, appeals, responses to other government agencies, international agreements, etc.. In all cases, top management of the regulatory agency should hear and decide the best balance between the benefits of regulatory action and undue risks and other associated impacts that may arise, including issues of credibility and reputation. The establishment of a decision framework based on well established principles and criteria ensures performance stability and consistency, preventing individual subjectivity. This article analyzes the challenges to the decision-making by regulatory agencies to ensure coherence and consistency in decisions, even in situations where there is uncertainty, lack of reliable information and even divergence of opinions among experts. The article explores the basic elements for a framework for regulatory decision-making. (author)

  1. A meta-analysis of decision-making and attention in adults with ADHD.

    Science.gov (United States)

    Mowinckel, Athanasia M; Pedersen, Mads Lund; Eilertsen, Espen; Biele, Guido

    2015-05-01

    Deficient reward processing has gained attention as an important aspect of ADHD, but little is known about reward-based decision-making (DM) in adults with ADHD. This article summarizes research on DM in adult ADHD and contextualizes DM deficits by comparing them to attention deficits. Meta-analytic methods were used to calculate average effect sizes for different DM domains and continuous performance task (CPT) measures. None of the 59 included studies (DM: 12 studies; CPT: 43; both: 4) had indications of publication bias. DM and CPT measures showed robust, small to medium effects. Large effect sizes were found for a drift diffusion model analysis of the CPT. The results support the existence of DM deficits in adults with ADHD, which are of similar magnitude as attention deficits. These findings warrant further examination of DM in adults with ADHD to improve the understanding of underlying neurocognitive mechanisms. © 2014 SAGE Publications.

  2. Permutation based decision making under fuzzy environment using Tabu search

    Directory of Open Access Journals (Sweden)

    Mahdi Bashiri

    2012-04-01

    Full Text Available One of the techniques, which are used for Multiple Criteria Decision Making (MCDM is the permutation. In the classical form of permutation, it is assumed that weights and decision matrix components are crisp. However, when group decision making is under consideration and decision makers could not agree on a crisp value for weights and decision matrix components, fuzzy numbers should be used. In this article, the fuzzy permutation technique for MCDM problems has been explained. The main deficiency of permutation is its big computational time, so a Tabu Search (TS based algorithm has been proposed to reduce the computational time. A numerical example has illustrated the proposed approach clearly. Then, some benchmark instances extracted from literature are solved by proposed TS. The analyses of the results show the proper performance of the proposed method.

  3. Medial prefrontal cortex lesions impair decision-making on a rodent gambling task: reversal by D1 receptor antagonist administration.

    Science.gov (United States)

    Paine, Tracie A; Asinof, Samuel K; Diehl, Geoffrey W; Frackman, Anna; Leffler, Joseph

    2013-04-15

    Decision-making is a complex cognitive process that is impaired in a number of psychiatric disorders. In the laboratory, decision-making is frequently assessed using "gambling" tasks that are designed to simulate real-life decisions in terms of uncertainty, reward and punishment. Here, we investigate whether lesions of the medial prefrontal cortex (PFC) cause impairments in decision-making using a rodent gambling task (rGT). In this task, rats have to decide between 1 of 4 possible options: 2 options are considered "advantageous" and lead to greater net rewards (food pellets) than the other 2 "disadvantageous" options. Once rats attained stable levels of performance on the rGT they underwent sham or excitoxic lesions of the medial PFC and were allowed to recover for 1 week. Following recovery, rats were retrained for 5 days and then the effects of a dopamine D1-like receptor antagonist (SCH23390) or a D2-like receptor antagonist (haloperidol) on performance were assessed. Lesioned rats exhibited impaired decision-making: they made fewer advantageous choices and chose the most optimal choice less frequently than did sham-operated rats. Administration of SCH23390 (0.03 mg/kg), but not haloperidol (0.015-0.03 mg/kg) attenuated the lesion-induced decision-making deficit. These results indicate that the medial PFC is important for decision-making and that excessive signaling at D1 receptors may contribute to decision-making impairments. Copyright © 2013 Elsevier B.V. All rights reserved.

  4. Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors

    Science.gov (United States)

    Braun, Erin Kendall; Daw, Nathaniel D.

    2014-01-01

    Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making. PMID:25378157

  5. Controlling Chronic Diseases Through Evidence-Based Decision Making: A Group-Randomized Trial.

    Science.gov (United States)

    Brownson, Ross C; Allen, Peg; Jacob, Rebekah R; deRuyter, Anna; Lakshman, Meenakshi; Reis, Rodrigo S; Yan, Yan

    2017-11-30

    Although practitioners in state health departments are ideally positioned to implement evidence-based interventions, few studies have examined how to build their capacity to do so. The objective of this study was to explore how to increase the use of evidence-based decision-making processes at both the individual and organization levels. We conducted a 2-arm, group-randomized trial with baseline data collection and follow-up at 18 to 24 months. Twelve state health departments were paired and randomly assigned to intervention or control condition. In the 6 intervention states, a multiday training on evidence-based decision making was conducted from March 2014 through March 2015 along with a set of supplemental capacity-building activities. Individual-level outcomes were evidence-based decision making skills of public health practitioners; organization-level outcomes were access to research evidence and participatory decision making. Mixed analysis of covariance models was used to evaluate the intervention effect by accounting for the cluster randomized trial design. Analysis was performed from March through May 2017. Participation 18 to 24 months after initial training was 73.5%. In mixed models adjusted for participant and state characteristics, the intervention group improved significantly in the overall skill gap (P = .01) and in 6 skill areas. Among the 4 organizational variables, only access to evidence and skilled staff showed an intervention effect (P = .04). Tailored and active strategies are needed to build capacity at the individual and organization levels for evidence-based decision making. Our study suggests several dissemination interventions for consideration by leaders seeking to improve public health practice.

  6. The role of the anterior cingulate cortex in women's sexual decision making.

    Science.gov (United States)

    Rupp, Heather A; James, Thomas W; Ketterson, Ellen D; Sengelaub, Dale R; Janssen, Erick; Heiman, Julia R

    2009-01-02

    Women's sexual decision making is a complex process balancing the potential rewards of conception and pleasure against the risks of possible low paternal care or sexually transmitted infection. Although neural processes underlying social decision making are suggested to overlap with those involved in economic decision making, the neural systems associated with women's sexual decision making are unknown. Using fMRI, we measured the brain activation of 12 women while they viewed photos of men's faces. Face stimuli were accompanied by information regarding each man's potential risk as a sexual partner, indicated by a written description of the man's number of previous sexual partners and frequency of condom use. Participants were asked to evaluate how likely they would be to have sex with the man depicted. Women reported that they would be more likely to have sex with low compared to high risk men. Stimuli depicting low risk men also elicited stronger activation in the anterior cingulate cortex (ACC), midbrain, and intraparietal sulcus, possibly reflecting an influence of sexual risk on women's attraction, arousal, and attention during their sexual decision making. Activation in the ACC was positively correlated with women's subjective evaluations of sex likelihood and response times during their evaluations of high, but not low risk men. These findings provide evidence that neural systems involved in sexual decision making in women overlap with those described previously to underlie nonsexual decision making.

  7. School characteristics influencing the implementation of a data-based decision making intervention

    NARCIS (Netherlands)

    van Geel, Marieke Johanna Maria; Visscher, Arend J.; Teunis, B.

    2017-01-01

    There is an increasing global emphasis on using data for decision making, with a growing body of research on interventions aimed at implementing and sustaining data-based decision making (DBDM) in schools. Yet, little is known about the school features that facilitate or hinder the implementation of

  8. The role of the dorsal raphé nucleus in reward-seeking behavior

    Directory of Open Access Journals (Sweden)

    Kae eNakamura

    2013-08-01

    Full Text Available Pharmacological experiments have shown that the modulation of brain serotonin levels has a strong impact on value-based decision making. Anatomical and physiological evidence also revealed that the dorsal raphé nucleus (DRN, a major source of serotonin, and the dopamine system receive common inputs from brain regions associated with appetitive and aversive information processing. The serotonin and dopamine systems also have reciprocal functional influences on each other. However, the specific mechanism by which serotonin affects value-based decision making is not clear.To understand the information carried by the DRN for reward-seeking behavior, we measured single neuron activity in the primate DRN during the performance of saccade tasks to obtain different amounts of a reward. We found that DRN neuronal activity was characterized by tonic modulation that was altered by the expected and received reward value. Consistent reward-dependent modulation across different task periods suggested that DRN activity kept track of the reward value throughout a trial. The DRN was also characterized by modulation of its activity in the opposite direction by different neuronal subgroups, one firing strongly for the prediction and receipt of large rewards, with the other firing strongly for small rewards. Conversely, putative dopamine neurons showed positive phasic responses to reward-indicating cues and the receipt of an unexpected reward amount, which supports the reward prediction error signal hypothesis of dopamine.I suggest that the tonic reward monitoring signal of the DRN, possibly together with its interaction with the dopamine system, reports a continuous level of motivation throughout the performance of a task. Such a signal may provide reward context information to the targets of DRN projections, where it may be integrated further with incoming motivationally salient information.

  9. Training attention improves decision making in individuals with elevated self-reported depressive symptoms.

    Science.gov (United States)

    Cooper, Jessica A; Gorlick, Marissa A; Denny, Taylor; Worthy, Darrell A; Beevers, Christopher G; Maddox, W Todd

    2014-06-01

    Depression is often characterized by attentional biases toward negative items and away from positive items, which likely affects reward and punishment processing. Recent work has reported that training attention away from negative stimuli reduced this bias and reduced depressive symptoms. However, the effect of attention training on subsequent learning has yet to be explored. In the present study, participants were required to learn to maximize reward during decision making. Undergraduates with elevated self-reported depressive symptoms received attention training toward positive stimuli prior to performing the decision-making task (n = 20; active training). The active-training group was compared to two other groups: undergraduates with elevated self-reported depressive symptoms who received placebo training (n = 22; placebo training) and a control group with low levels of depressive symptoms (n = 33; nondepressive control). The placebo-training depressive group performed worse and switched between options more than did the nondepressive controls on the reward maximization task. However, depressives that received active training performed as well as the nondepressive controls. Computational modeling indicated that the placebo-trained group learned more from negative than from positive prediction errors, leading to more frequent switching. The nondepressive control and active-training depressive groups showed similar learning from positive and negative prediction errors, leading to less-frequent switching and better performance. Our results indicate that individuals with elevated depressive symptoms are impaired at reward maximization, but that the deficit can be improved with attention training toward positive stimuli.

  10. Optogenetic Inhibition Reveals Distinct Roles for Basolateral Amygdala Activity at Discrete Time Points during Risky Decision Making.

    Science.gov (United States)

    Orsini, Caitlin A; Hernandez, Caesar M; Singhal, Sarthak; Kelly, Kyle B; Frazier, Charles J; Bizon, Jennifer L; Setlow, Barry

    2017-11-29

    Decision making is a multifaceted process, consisting of several distinct phases that likely require different cognitive operations. Previous work showed that the basolateral amygdala (BLA) is a critical substrate for decision making involving risk of punishment; however, it is unclear how the BLA is recruited at different stages of the decision process. To this end, the current study used optogenetics to inhibit the BLA during specific task phases in a model of risky decision making (risky decision-making task) in which rats choose between a small, "safe" reward and a large reward accompanied by varying probabilities of footshock punishment. Male Long-Evans rats received intra-BLA microinjections of viral vectors carrying either halorhodopsin (eNpHR3.0-mCherry) or mCherry alone (control) followed by optic fiber implants and were trained in the risky decision-making task. Laser delivery during the task occurred during intertrial interval, deliberation, or reward outcome phases, the latter of which was further divided into the three possible outcomes (small, safe; large, unpunished; large, punished). Inhibition of the BLA selectively during the deliberation phase decreased choice of the large, risky outcome (decreased risky choice). In contrast, BLA inhibition selectively during delivery of the large, punished outcome increased risky choice. Inhibition had no effect during the other phases, nor did laser delivery affect performance in control rats. Collectively, these data indicate that the BLA can either inhibit or promote choice of risky options, depending on the phase of the decision process in which it is active. SIGNIFICANCE STATEMENT To date, most behavioral neuroscience research on neural mechanisms of decision making has used techniques that preclude assessment of distinct phases of the decision process. Here we show that optogenetic inhibition of the BLA has opposite effects on choice behavior in a rat model of risky decision making, depending on the phase

  11. Decision-Making in Audiology: Balancing Evidence-Based Practice and Patient-Centered Care

    Science.gov (United States)

    Clemesha, Jennifer; Lundmark, Erik; Crome, Erica; Barr, Caitlin; McMahon, Catherine M.

    2017-01-01

    Health-care service delivery models have evolved from a practitioner-centered approach toward a patient-centered ideal. Concurrently, increasing emphasis has been placed on the use of empirical evidence in decision-making to increase clinical accountability. The way in which clinicians use empirical evidence and client preferences to inform decision-making provides an insight into health-care delivery models utilized in clinical practice. The present study aimed to investigate the sources of information audiologists use when discussing rehabilitation choices with clients, and discuss the findings within the context of evidence-based practice and patient-centered care. To assess the changes that may have occurred over time, this study uses a questionnaire based on one of the few studies of decision-making behavior in audiologists, published in 1989. The present questionnaire was completed by 96 audiologists who attended the World Congress of Audiology in 2014. The responses were analyzed using qualitative and quantitative approaches. Results suggest that audiologists rank clinical test results and client preferences as the most important factors for decision-making. Discussion with colleagues or experts was also frequently reported as an important source influencing decision-making. Approximately 20% of audiologists mentioned utilizing research evidence to inform decision-making when no clear solution was available. Information shared at conferences was ranked low in terms of importance and reliability. This study highlights an increase in awareness of concepts associated with evidence-based practice and patient-centered care within audiology settings, consistent with current research-to-practice dissemination pathways. It also highlights that these pathways may not be sufficient for an effective clinical implementation of these practices. PMID:28752808

  12. Emotional decision-making and its dissociable components in schizophrenia and schizoaffective disorder: a behavioural and MRI investigation.

    Science.gov (United States)

    Premkumar, Preethi; Fannon, Dominic; Kuipers, Elizabeth; Simmons, Andrew; Frangou, Sophia; Kumari, Veena

    2008-01-01

    Cognitive decision-making is known to be deficient, but relatively less is known about emotional decision-making in schizophrenia. The Iowa gambling task (IGT) is considered a reliable probe of emotional decision-making and believed to reflect orbitofrontal cortex (OFC) function. The expectancy-valence model of IGT performance implicates three dissociable components, namely, attention to reward, memory for past, relative to recent, outcomes and impulsivity in emotional decision-making. We examined IGT performance, its three components, and their grey matter volume (GMV) correlates in 75 stable patients with schizophrenia, relative to 25 healthy individuals. Patients, relative to controls, showed impaired IGT performance and poor memory for past, relative to recent, outcomes. IGT performance correlated with GMV in the OFC in controls, but not patients. There were associations between (a) attention to reward and GMV in the frontal, temporal, parietal and striatal regions in controls, and in the temporal and thalamic regions in patients, (b) memory for past outcomes and GMV in the temporal region in controls, and the frontal and temporal regions in patients, and (c) low impulsivity and greater GMV in the frontal, temporal, posterior cingulate and occipital regions in controls, and in the frontal, temporal and posterior cingulate regions in patients. Most IGT-GMV associations were stronger in controls. It is concluded that (i) poor memory, rather than less attention to reward or impulsivity, contributes to IGT performance deficit, and (ii) the relationship of IGT performance and its components with GMVs especially in the frontal and temporal lobes is lost or attenuated in schizophrenia.

  13. Can Decision Making Research Provide a Better Understanding of Chemical and Behavioral Addictions?

    Science.gov (United States)

    Engel, Anzhelika; Cáceda, Ricardo

    2015-01-01

    We reviewed the cognitive and neurobiological commonalities between chemical and behavioral addictions. Poor impulse control, limited executive function and abnormalities in reward processing are seen in both group of entities. Brain imaging shows consistent abnormalities in frontoparietal regions and the limbic system. In drug addiction, exaggerated risk taking behavior and temporal discounting may reflect an imbalance between a hyperactive mesolimbic and hypoactive executive systems. Several cognitive distortions are found in pathological gambling that seems to harness the brain reward system that has evolved to face situations related to skill, not random chance. Abnormalities in risk assessment and impulsivity are found in variety of eating disorders, in particularly related to eating behavior. Corresponding findings in eating disorder patients include abnormalities in the limbic system, i.e. orbitofrontal cortex (OFC), striatum and insula. Similarly, internet addiction disorder is associated with risky decision making and increased choice impulsivity with corresponding discrepant activation in the dorsolateral prefrontal cortex, OFC, anterior cingulate cortex, caudate and insula. Sexual addictions are in turn associated with exaggerated impulsive choice and suggestive evidence of abnormalities in reward processing. In sum, exploration of executive function and decision making abnormalities in chemical and behavioral addictions may increase understanding in their psychopathology and yield valuable targets for therapeutic interventions.

  14. Argumentation and Multi-Agent Decision Making

    OpenAIRE

    Parsons, S.; Jennings, N. R.

    1998-01-01

    This paper summarises our on-going work on mixed- initiative decision making which extends both classical decision theory and a symbolic theory of decision making based on argumentation to a multi-agent domain.

  15. Reward-based training of recurrent neural networks for cognitive and value-based tasks.

    Science.gov (United States)

    Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing

    2017-01-13

    Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal's internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task.

  16. Differential impairments underlying decision making in anorexia nervosa and bulimia nervosa: a cognitive modeling analysis.

    Science.gov (United States)

    Chan, Trista Wai Sze; Ahn, Woo-Young; Bates, John E; Busemeyer, Jerome R; Guillaume, Sebastien; Redgrave, Graham W; Danner, Unna N; Courtet, Philippe

    2014-03-01

    This study examined the underlying processes of decision-making impairments in individuals with anorexia nervosa (AN) and bulimia nervosa (BN). We deconstructed their performance on the widely used decision task, the Iowa Gambling Task (IGT) into cognitive, motivational, and response processes using cognitive modeling analysis. We hypothesized that IGT performance would be characterized by impaired memory functions and heightened punishment sensitivity in AN, and by elevated sensitivity to reward as opposed to punishment in BN. We analyzed trial-by-trial data of IGT obtained from 224 individuals: 94 individuals with AN, 63 with BN, and 67 healthy comparison individuals (HC). The prospect valence learning model was used to assess cognitive, motivational, and response processes underlying IGT performance. Individuals with AN showed marginally impaired IGT performance compared to HC. Their performance was characterized by impairments in memory functions. Individuals with BN showed significantly impaired IGT performance compared to HC. They showed greater relative sensitivity to gains as opposed to losses than HC. Memory functions in AN were positively correlated with body mass index. This study identified differential impairments underlying IGT performance in AN and BN. Findings suggest that impaired decision making in AN might involve impaired memory functions. Impaired decision making in BN might involve altered reward and punishment sensitivity. Copyright © 2013 Wiley Periodicals, Inc.

  17. Is it worth the effort? Novel insights into obesity-associated alterations in cost-benefit decision-making

    Directory of Open Access Journals (Sweden)

    David eMathar

    2016-01-01

    Full Text Available Cost-benefit decision-making entails the process of evaluating potential actions according to the trade-off between the expected benefit (reward and the anticipated costs (effort. Recent research revealed that dopaminergic transmission within the fronto-striatal circuitry strongly modulates cost-benefit decision-making. Alterations within the dopaminergic fronto-striatal system have been associated with obesity, but little is known about cost-benefit decision-making differences in obese compared with lean individuals. With a newly developed experimental task we investigate obesity-associated alterations in cost-benefit decision-making, utilizing physical effort by handgrip-force exertion and both food and non-food rewards. We relate our behavioral findings to alterations in local grey matter volume assessed by structural MRI. Obese compared with lean subjects were less willing to engage in physical effort in particular for high-caloric sweet snack food. The amount of effort exertion was thereby negatively associated with subjects’ individual levels of chronic stress and punishment sensitivity. Further, self-reported body dissatisfaction negatively correlated with the willingness to invest effort for sweet snacks in obese men. On a structural level, obesity was associated with reductions in grey matter volume in bilateral prefrontal cortex. Nucleus accumbens volume positively correlated with task-induced implicit food craving. Our results challenge the common notion that obese individuals are willing to work harder to obtain high-caloric food and emphasize the need for further exploration of the underlying neural mechanisms regarding cost-benefit decision-making differences in obesity.

  18. The anterior insula bidirectionally modulates cost-benefit decision-making on a rodent gambling task.

    Science.gov (United States)

    Daniel, M L; Cocker, P J; Lacoste, J; Mar, A C; Houeto, J L; Belin-Rauscent, A; Belin, D

    2017-11-01

    Deficits in cost-benefit decision-making, as assessed in the Iowa Gambling Task (IGT), are commonly observed in neuropsychiatric disorders such as addiction. There is considerable variation in the maximization of rewards on such tasks, both in the general population and in rodent models, suggesting individual differences in decision-making may represent a key endophenotype for vulnerability to neuropsychiatric disorders. Increasing evidence suggests that the insular cortex, which is involved in interoception and emotional processes in humans, may be a key neural locus in the control of decision-making processes. However, the extent to which the insula contributes to individual differences in cost-benefit decision-making remains unknown. Using male Sprague Dawley rats, we first assessed individual differences in the performance over the course of a single session on a rodent analogue of the IGT (rGT). Rats were matched for their ability to maximize reward and received bilateral excitotoxic or sham lesions of the anterior insula cortex (AIC). Animals were subsequently challenged on a second rGT session with altered contingencies. Finally, animals were also assessed for instrumental conditioning and reversal learning. AIC lesions produced bidirectional alterations on rGT performance; rats that had performed optimally prior to surgery subsequently showed impairments, and animals that had performed poorly showed improvements in comparison with sham-operated controls. These bidirectional effects were not attributable to alterations in behavioural flexibility or in motivation. These data suggest that the recruitment of the AIC during decision-making may be state-dependent and help guide response selection towards subjectively favourable options. © 2017 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

  19. Decision Making

    Directory of Open Access Journals (Sweden)

    Pier Luigi Baldi

    2006-06-01

    Full Text Available This article points out some conditions which significantly exert an influence upon decision and compares decision making and problem solving as interconnected processes. Some strategies of decision making are also examined.

  20. Seasonality in communication and collective decision-making in ants.

    Science.gov (United States)

    Stroeymeyt, N; Jordan, C; Mayer, G; Hovsepian, S; Giurfa, M; Franks, N R

    2014-04-07

    The ability of animals to adjust their behaviour according to seasonal changes in their ecology is crucial for their fitness. Eusocial insects display strong collective behavioural seasonality, yet the mechanisms underlying such changes are poorly understood. We show that nest preference by emigrating Temnothorax albipennis ant colonies is influenced by a season-specific modulatory pheromone that may help tune decision-making according to seasonal constraints. The modulatory pheromone triggers aversion towards low-quality nests and enhances colony cohesion in summer and autumn, but not after overwintering-in agreement with reports that field colonies split in spring and reunite in summer. Interestingly, we show that the pheromone acts by downgrading the perceived value of marked nests by informed and naive individuals. This contrasts with theories of collective intelligence, stating that accurate collective decision-making requires independent evaluation of options by individuals. The violation of independence highlighted here was accordingly shown to increase error rate during emigrations. However, this is counterbalanced by enhanced cohesion and the transmission of valuable information through the colony. Our results support recent claims that optimal decisions are not necessarily those that maximize accuracy. Other criteria-such as cohesion or reward rate-may be more relevant in animal decision-making.

  1. Grey Language Hesitant Fuzzy Group Decision Making Method Based on Kernel and Grey Scale.

    Science.gov (United States)

    Li, Qingsheng; Diao, Yuzhu; Gong, Zaiwu; Hu, Aqin

    2018-03-02

    Based on grey language multi-attribute group decision making, a kernel and grey scale scoring function is put forward according to the definition of grey language and the meaning of the kernel and grey scale. The function introduces grey scale into the decision-making method to avoid information distortion. This method is applied to the grey language hesitant fuzzy group decision making, and the grey correlation degree is used to sort the schemes. The effectiveness and practicability of the decision-making method are further verified by the industry chain sustainable development ability evaluation example of a circular economy. Moreover, its simplicity and feasibility are verified by comparing it with the traditional grey language decision-making method and the grey language hesitant fuzzy weighted arithmetic averaging (GLHWAA) operator integration method after determining the index weight based on the grey correlation.

  2. Apathy and Emotion-Based Decision-Making in Amnesic Mild Cognitive Impairment and Alzheimer's Disease

    OpenAIRE

    Bayard, Sophie; Jacus, Jean-Pierre; Raffard, Stéphane; Gely-Nargeot, Marie-Christine

    2014-01-01

    Background. Apathy and reduced emotion-based decision-making are two behavioral modifications independently described in Alzheimer’s disease (AD) and amnestic mild cognitive impairment (aMCI). Objectives. The aims of this study were to investigate decision-making based on emotional feedback processing in AD and aMCI and to study the impact of reduced decision-making performances on apathy. Methods. We recruited 20 patients with AD, 20 participants with aMCI, and 20 healthy controls. All parti...

  3. Impaired decision-making as a young adult outcome of girls diagnosed with attention-deficit/hyperactivity disorder in childhood.

    Science.gov (United States)

    Miller, Meghan; Sheridan, Margaret; Cardoos, Stephanie L; Hinshaw, Stephen P

    2013-01-01

    We examined decision-making in young adulthood in a follow-up study of females diagnosed with attention-deficit/hyperactivity disorder (ADHD) between 6 and 12 years. Participants with childhood ADHD (n = 114) and matched comparison females (n = 77), followed prospectively for 10 years, performed the Iowa Gambling Task (IGT) at ages 17-25 years. This task assesses preference for high-reward/high-risk chances that result in lower overall gains (disadvantageous decks of cards) compared to low-reward/low-risk chances that result in higher overall gains (advantageous decks of cards). Relative to comparison participants, young adult females with a history of ADHD did not increase their preference for advantageous decks across time blocks, suggesting difficulties in learning to change behavior over the course of the IGT. Overall, childhood diagnoses of ADHD were associated with disadvantageous decision-making in young adulthood. These results extend findings on decision-making in males with ADHD by demonstrating comparable levels of impairment in an all-female sample.

  4. Decision Making in the Balloon Analogue Risk Task (BART): Anterior Cingulate Cortex Signals Loss-Aversion but not the Infrequency of Risky Choices

    Science.gov (United States)

    Fukunaga, Rena; Brown, Joshua W.; Bogg, Tim

    2012-01-01

    The inferior frontal gyrus/anterior insula (IFG/AI) and anterior cingulate cortex (ACC) are key regions involved in risk appraisal during decision making, but accounts of how these regions contribute to decision-making under risk remain contested. To help clarify the roles of these and other related regions, we used a modified version of the Balloon Analogue Risk Task (Lejuez et al., 2002) to distinguish between decision-making and feedback-related processes when participants decided to pursue a gain as the probability of loss increased parametrically. Specifically, we set out to test whether ACC and IFG/AI regions correspond to loss-aversion at the time of decision making in a way that is not confounded with either reward-seeking or infrequency effects. When participants chose to discontinue inflating the balloon (win option), we observed greater ACC and mainly bilateral IFG/AI activity at the time of decision as the probability of explosion increased, consistent with increased loss-aversion but inconsistent with an infrequency effect. In contrast, we found robust vmPFC activity when participants chose to continue inflating the balloon (risky option), consistent with reward-seeking. However, in the cingulate and mainly bilateral IFG regions, BOLD activation decreased when participants chose to inflate the balloon as the probability of explosion increased, findings consistent with a reduced loss-aversion signal. Our results highlight the existence of distinct reward-seeking and loss-averse signals during decision-making, as well as the importance of distinguishing decision and feedback signals. PMID:22707378

  5. Decision making in the Balloon Analogue Risk Task (BART): anterior cingulate cortex signals loss aversion but not the infrequency of risky choices.

    Science.gov (United States)

    Fukunaga, Rena; Brown, Joshua W; Bogg, Tim

    2012-09-01

    The inferior frontal gyrus/anterior insula (IFG/AI) and anterior cingulate cortex (ACC) are key regions involved in risk appraisal during decision making, but accounts of how these regions contribute to decision making under risk remain contested. To help clarify the roles of these and other related regions, we used a modified version of the Balloon Analogue Risk Task (Lejuez et al., Journal of Experimental Psychology: Applied, 8, 75-84, 2002) to distinguish between decision-making and feedback-related processes when participants decided to pursue a gain as the probability of loss increased parametrically. Specifically, we set out to test whether the ACC and IFG/AI regions correspond to loss aversion at the time of decision making in a way that is not confounded with either reward-seeking or infrequency effects. When participants chose to discontinue inflating the balloon (win option), we observed greater ACC and mainly bilateral IFG/AI activity at the time of decision as the probability of explosion increased, consistent with increased loss aversion but inconsistent with an infrequency effect. In contrast, we found robust vmPFC activity when participants chose to continue inflating the balloon (risky option), consistent with reward seeking. However, in the cingulate and in mainly bilateral IFG regions, blood-oxygenation-level-dependent activation decreased when participants chose to inflate the balloon as the probability of explosion increased, findings that are consistent with a reduced loss aversion signal. Our results highlight the existence of distinct reward-seeking and loss-averse signals during decision making, as well as the importance of distinguishing between decision and feedback signals.

  6. Effects of plain packaging on decision-making and reward for nicotine cigarettes

    Directory of Open Access Journals (Sweden)

    Martin LE

    2014-05-01

    Full Text Available Laura E Martin1,21Hoglund Brain Imaging Center, 2Department of Preventive Medicine and Public Health, University of Kansas Medical Center, Kansas City, KS, USAAbstract: Cigarette smoking remains the leading preventable cause of death worldwide. Efforts to reduce smoking prevalence include changes to policies that are expected to have impacts on smoking behaviors. Plain packaging has been introduced as a method to reduce the appeal of smoking by removing such branding information as pack colors and brand logos from cigarette packages. Behavioral studies of plain packaging demonstrate reductions in the appeal of cigarette packages, changes in smoking behaviors, and expected reductions in smoking initiation. Neuroimaging studies of branding demonstrate that the neural systems of rewards and cognitive control are associated with processing brand information (eg, logos. Neuroimaging studies in smokers demonstrate that the neural systems of reward respond to images of cigarettes and are associated with reductions in cognitive control responses. The current review discusses the state of research on plain packaging in terms of a biopsychosocial model of addiction in which behavioral studies of plain packaging can identify psychological and social changes related to packaging, whereas neuroimaging studies can identify biological changes underlying the psychological and social impacts of packaging. Together, these studies show that plain packaging may reduce positive perceptions of smoking by reducing related reward responses in the brain, thus increasing the likelihood that smokers will be able to resist the urge to smoke, and perhaps quit smoking altogether.Keywords: smoking, plain packaging, neuroimaging, branding, reward

  7. Individual decision making, group decision making and deliberation

    Directory of Open Access Journals (Sweden)

    Radovanović Bojana

    2012-01-01

    Full Text Available Each of us makes a number of decisions, from the less important to those with far-reaching consequences. As members of different groups, we are also actors of group decision making. In order to make a rational decision, a choice-making procedure must satisfy a number of assumptions (conditions of rationality. In addition, when it comes to group decisions, those procedures should also be “fair.” However, it is not possible to define a procedure of choice-making that would transform individual orders of alternatives based on preferences of perfectly rational individuals into a single social order and still meet conditions of rationality and ethics. The theory of deliberative democracy appeared in response to the impossibility of Social Choice theory. The basic assumption of deliberative democracy is that individuals adjust their preferences taking into account interests of the community. They are open for discussion with other group members and are willing to change their attitudes in order to achieve common interests. Ideally, group members come to an agreement during public discussion (deliberation. Still, this concept cannot completely over­come all the difficulties posed by the theory of social choice. Specifically, there is no solution for strategic and manipulative behavior of individuals. Also, the concept of deliberative democracy faces certain problems particular to this approach, such as, to name but a few, problems with the establishment of equality of participants in the debate and their motivation, as well as problems with the organization of public hearings. [Projekat Ministarstva nauke Republike Srbije, br. 47009: Evropske integracije i društveno-ekonomske promene privrede Srbije na putu ka EU i br. 179015: Izazovi i perspektive strukturnih promena u Srbiji: Strateški pravci ekonomskog razvoja i usklađivanje sa zahtevima EU

  8. Prerequisites for data-based decision making in the classroom: Research evidence and practical illustrations

    NARCIS (Netherlands)

    Hoogland, Inge; Schildkamp, Kim; van der Kleij, Fabienne; Heitink, Maaike Christine; Kippers, Wilma Berdien; Veldkamp, Bernard P.; Dijkstra, Anne M.

    2016-01-01

    Data-based decision making can lead to increased student learning. The desired effects of increased student learning can only be realized if data-based decision making is implemented successfully. Therefore, a systematic literature review was conducted to identify prerequisites of such successful

  9. Factors influencing the surgical decision for the treatment of degenerative lumbar stenosis in a preference-based shared decision-making process.

    Science.gov (United States)

    Kim, Ho-Joong; Park, Jae-Young; Kang, Kyoung-Tak; Chang, Bong-Soon; Lee, Choon-Ki; Yeom, Jin S

    2015-02-01

    In a preference-based shared decision-making system, several subjective and/or objective factors such as pain severity, degree of disability, and the radiological severity of canal stenosis may influence the final surgical decision for the treatment of lumbar spinal stenosis (LSS). However, our understanding of the shared decision-making process and the significance of each factor remain primitive. In the present study, we aimed to investigate which factors influence the surgical decision for the treatment of LSS when using a preference-based, shared decision-making process. We included 555 patients, aged 45-80 years, who used a preference-based shared decision-making process and were treated conservatively or surgically for chronic leg and/or back pain caused by LSS from April 2012 to December 2012. Univariate and multivariable-adjusted logistic regression analyses were used to assess the association of surgical decision making with age, sex, body mass index, symptom duration, radiologic stenotic grade, Oswestry Disability Index (ODI), visual analog scale (VAS) scores for back and leg pain, Short Form-36 (SF-36) subscales, and motor weakness. In univariate analysis, the following variables were associated with a higher odds of a surgical decision for LSS: male sex; the VAS score for leg pain; ODI; morphological stenotic grades B, C, and D; motor weakness; and the physical function, physical role, bodily pain, social function, and emotional role of the SF-36 subscales. Multivariate analysis revealed that male sex, ODI, morphological stenotic grades C and D, and motor weakness were significantly associated with a higher possibility of a surgical decision. Motor weakness, male sex, morphological stenotic grade, and the amount of disability are critical factors leading to a surgical decision for LSS when using a preference-based shared decision-making process.

  10. Multi-criteria weighted order based maintenance decision making

    NARCIS (Netherlands)

    Dhanisetty, V.S.V.; Verhagen, W.J.C.; Curran, R.

    2017-01-01

    Decision making in daily maintenance requires consideration of multiple factors. The importance of each of the factors fluctuates depending on the repair scenario and the needs of the maintainer. In order to include the prioritisation of multiple criteria, a weighted decision making model is

  11. Medical decision making

    NARCIS (Netherlands)

    Stiggelbout, A.M.; Vries, M. de; Scherer, L.; Keren, G.; Wu, G.

    2016-01-01

    This chapter presents an overview of the field of medical decision making. It distinguishes the levels of decision making seen in health-care practice and shows how research in judgment and decision making support or improve decision making. Most of the research has been done at the micro level,

  12. Parabolic discounting of monetary rewards by physical effort

    NARCIS (Netherlands)

    Hartmann, M.N.; Hager, O.M.; Tobler, P.N.; Kaiser, S.

    2013-01-01

    When humans and other animals make decisions in their natural environments prospective rewards have to be weighed against costs. It is well established that increasing costs lead to devaluation or discounting of reward. While our knowledge about discount functions for time and probability costs is

  13. Tactical decision games - developing scenario-based training for decision-making in distributed teams

    NARCIS (Netherlands)

    Lauche, K.; Crichton, M.; Bayerl, P.S.

    2009-01-01

    Team training should reflect the increasing complexity of decision-making environments. Guidelines for scenario-based training were adopted for a distributed setting and tested in a pilot training session with a distributed team in the offshore oil industry. Participants valued the scenario as

  14. The Temporal Derivative of Expected Utility: A Neural Mechanism for Dynamic Decision-making

    Science.gov (United States)

    Zhang, Xian; Hirsch, Joy

    2012-01-01

    Real world tasks involving moving targets, such as driving a vehicle, are performed based on continuous decisions thought to depend upon the temporal derivative of the expected utility (∂V/∂t), where the expected utility (V) is the effective value of a future reward. However, those neural mechanisms that underlie dynamic decision-making are not well understood. This study investigates human neural correlates of both V and ∂V/∂t using fMRI and a novel experimental paradigm based on a pursuit-evasion game optimized to isolate components of dynamic decision processes. Our behavioral data show that players of the pursuit-evasion game adopt an exponential discounting function, supporting the expected utility theory. The continuous functions of V and ∂V/∂t were derived from the behavioral data and applied as regressors in fMRI analysis, enabling temporal resolution that exceeded the sampling rate of image acquisition, hyper-temporal resolution, by taking advantage of numerous trials that provide rich and independent manipulation of those variables. V and ∂V/∂t were each associated with distinct neural activity. Specifically, ∂V/∂t was associated with anterior and posterior cingulate cortices, superior parietal lobule, and ventral pallidum, whereas V was primarily associated with supplementary motor, pre and post central gyri, cerebellum, and thalamus. The association between the ∂V/∂t and brain regions previously related to decision-making is consistent with the primary role of the temporal derivative of expected utility in dynamic decision-making. PMID:22963852

  15. The temporal derivative of expected utility: a neural mechanism for dynamic decision-making.

    Science.gov (United States)

    Zhang, Xian; Hirsch, Joy

    2013-01-15

    Real world tasks involving moving targets, such as driving a vehicle, are performed based on continuous decisions thought to depend upon the temporal derivative of the expected utility (∂V/∂t), where the expected utility (V) is the effective value of a future reward. However, the neural mechanisms that underlie dynamic decision-making are not well understood. This study investigates human neural correlates of both V and ∂V/∂t using fMRI and a novel experimental paradigm based on a pursuit-evasion game optimized to isolate components of dynamic decision processes. Our behavioral data show that players of the pursuit-evasion game adopt an exponential discounting function, supporting the expected utility theory. The continuous functions of V and ∂V/∂t were derived from the behavioral data and applied as regressors in fMRI analysis, enabling temporal resolution that exceeded the sampling rate of image acquisition, hyper-temporal resolution, by taking advantage of numerous trials that provide rich and independent manipulation of those variables. V and ∂V/∂t were each associated with distinct neural activity. Specifically, ∂V/∂t was associated with anterior and posterior cingulate cortices, superior parietal lobule, and ventral pallidum, whereas V was primarily associated with supplementary motor, pre and post central gyri, cerebellum, and thalamus. The association between the ∂V/∂t and brain regions previously related to decision-making is consistent with the primary role of the temporal derivative of expected utility in dynamic decision-making. Copyright © 2012 Elsevier Inc. All rights reserved.

  16. A developmental study of risky decisions on the cake gambling task: age and gender analyses of probability estimation and reward evaluation.

    Science.gov (United States)

    Van Leijenhorst, Linda; Westenberg, P Michiel; Crone, Eveline A

    2008-01-01

    Decision making, or the process of choosing between competing courses of actions, is highly sensitive to age-related change, showing development throughout adolescence. In this study, we tested whether the development of decision making under risk is related to changes in risk-estimation abilities. Participants (N = 93) between ages 8-30 performed a child friendly gambling task, the Cake Gambling task, which was inspired by the Cambridge Gambling Task (Rogers et al., 1999), which has previously been shown to be sensitive to orbitofrontal cortex (OFC) damage. The task allowed comparisons of the contributions to risk perception of (1) the ability to estimate probabilities and (2) evaluate rewards. Adult performance patterns were highly similar to those found in previous reports, showing increased risk taking with increases in the probability of winning and the magnitude of potential reward. Behavioral patterns in children and adolescents did not differ from adult patterns, showing a similar ability for probability estimation and reward evaluation. These data suggest that participants 8 years and older perform like adults in a gambling task, previously shown to depend on the OFC in which all the information needed to make an advantageous decision is given on each trial and no information needs to be inferred from previous behavior. Interestingly, at all ages, females were more risk-averse than males. These results suggest that the increase in real-life risky behavior that is seen in adolescence is not a consequence of changes in risk perception abilities. The findings are discussed in relation to theories about the protracted development of the prefrontal cortex.

  17. Investigating decision rules with a new experimental design: the EXACT paradigm

    Science.gov (United States)

    Biscione, Valerio; Harris, Christopher M.

    2015-01-01

    In the decision-making field, it is important to distinguish between the perceptual process (how information is collected) and the decision rule (the strategy governing decision-making). We propose a new paradigm, called EXogenous ACcumulation Task (EXACT) to disentangle these two components. The paradigm consists of showing a horizontal gauge that represents the probability of receiving a reward at time t and increases with time. The participant is asked to press a button when they want to request a reward. Thus, the perceptual mechanism is hard-coded and does not need to be inferred from the data. Based on this paradigm, we compared four decision rules (Bayes Risk, Reward Rate, Reward/Accuracy, and Modified Reward Rate) and found that participants appeared to behave according to the Modified Reward Rate. We propose a new way of analysing the data by using the accuracy of responses, which can only be inferred in classic RT tasks. Our analysis suggests that several experimental findings such as RT distribution and its relationship with experimental conditions, usually deemed to be the result of a rise-to-threshold process, may be simply explained by the effect of the decision rule employed. PMID:26578916

  18. Multi-criteria clinical decision support: A primer on the use of multiple criteria decision making methods to promote evidence-based, patient-centered healthcare.

    Science.gov (United States)

    Dolan, James G

    2010-01-01

    Current models of healthcare quality recommend that patient management decisions be evidence-based and patient-centered. Evidence-based decisions require a thorough understanding of current information regarding the natural history of disease and the anticipated outcomes of different management options. Patient-centered decisions incorporate patient preferences, values, and unique personal circumstances into the decision making process and actively involve both patients along with health care providers as much as possible. Fundamentally, therefore, evidence-based, patient-centered decisions are multi-dimensional and typically involve multiple decision makers.Advances in the decision sciences have led to the development of a number of multiple criteria decision making methods. These multi-criteria methods are designed to help people make better choices when faced with complex decisions involving several dimensions. They are especially helpful when there is a need to combine "hard data" with subjective preferences, to make trade-offs between desired outcomes, and to involve multiple decision makers. Evidence-based, patient-centered clinical decision making has all of these characteristics. This close match suggests that clinical decision support systems based on multi-criteria decision making techniques have the potential to enable patients and providers to carry out the tasks required to implement evidence-based, patient-centered care effectively and efficiently in clinical settings.The goal of this paper is to give readers a general introduction to the range of multi-criteria methods available and show how they could be used to support clinical decision-making. Methods discussed include the balance sheet, the even swap method, ordinal ranking methods, direct weighting methods, multi-attribute decision analysis, and the analytic hierarchy process (AHP).

  19. The need to go beyond analysis in making risk-based decisions

    Energy Technology Data Exchange (ETDEWEB)

    Ahearne, J.F. [The Sigma XI Center, Research Triangle Park, NC (United States)

    1999-12-01

    As a physicist, I prefer the R = P x C, with the inclusion of a risk magnifier when appropriate. However, I also accept this is inadequate. For risk-based decisions to be acceptable in a democratic society, there must be widespread agreement on the criteria to be used, the process by which the decision is reached, and the linkage between the criteria and the decision. These demand a transparent process. Armour wrote: 'To date, efforts directed toward facility siting conflicts have focused almost exclusively on the 'public acceptance' factor (and neglected the legitimacy of the process] - the sad reality is that these strategies have not beenall that effective. Moreover, given that the underlying motivation is to 'gain public acceptance' such strategies have often worsened the facility siting problems when used by proponents who were unable, in appearance or in fact, to tread the fine line between manipulating public opinion and liberating it ... the issue of the legitimacy of the decision making process had tended to be taken for granted. Generally speaking, policy makers have failed to seriously question and have not responded well to others who have dared to question the established roles and principles of our conventional processes of decision making.' Finally, acceptance also requires agreement that the issues to be decided are the appropriate issues. Often the decision-makers concentrate on issues that are not the ones the public views as the most important. Sometimes it is because the public wants other alternatives examined. Sometimes it is because the public does not accept the necessity to decide now. And sometimes it is because the public does not trust those who have assumed responsibility for making the decision. The analytic community has grown in size and skill over the last 20 years. The science community has produced a better understanding of health effects and exposure pathways. The engineering community has designed

  20. The need to go beyond analysis in making risk-based decisions

    International Nuclear Information System (INIS)

    Ahearne, J.F.

    1999-01-01

    As a physicist, I prefer the R = P x C, with the inclusion of a risk magnifier when appropriate. However, I also accept this is inadequate. For risk-based decisions to be acceptable in a democratic society, there must be widespread agreement on the criteria to be used, the process by which the decision is reached, and the linkage between the criteria and the decision. These demand a transparent process. Armour wrote: 'To date, efforts directed toward facility siting conflicts have focused almost exclusively on the 'public acceptance' factor (and neglected the legitimacy of the process] - the sad reality is that these strategies have not been all that effective. Moreover, given that the underlying motivation is to 'gain public acceptance' such strategies have often worsened the facility siting problems when used by proponents who were unable, in appearance or in fact, to tread the fine line between manipulating public opinion and liberating it ... the issue of the legitimacy of the decision making process had tended to be taken for granted. Generally speaking, policy makers have failed to seriously question and have not responded well to others who have dared to question the established roles and principles of our conventional processes of decision making.' Finally, acceptance also requires agreement that the issues to be decided are the appropriate issues. Often the decision-makers concentrate on issues that are not the ones the public views as the most important. Sometimes it is because the public wants other alternatives examined. Sometimes it is because the public does not accept the necessity to decide now. And sometimes it is because the public does not trust those who have assumed responsibility for making the decision. The analytic community has grown in size and skill over the last 20 years. The science community has produced a better understanding of health effects and exposure pathways. The engineering community has designed safer systems. However, the

  1. Differentiated instruction in a data-based decision-making context

    NARCIS (Netherlands)

    Faber, Janke M.; Glas, Cees A.W.; Visscher, Adrie J.

    2018-01-01

    In this study, the relationship between differentiated instruction, as an element of data-based decision making, and student achievement was examined. Classroom observations (n = 144) were used to measure teachers’ differentiated instruction practices and to predict the mathematical achievement of

  2. Business making decisions

    Directory of Open Access Journals (Sweden)

    Enrique Benjamín Franklin Fincowsky

    2011-06-01

    Full Text Available People and organizations make better or get wrong as consequence of making decisions. Sometimes making decisions is just a trial and error process. Some others, decisions are good and the results profitable with a few of mistakes, most of the time because it’s considered the experience and the control of a specific field or the good intention of who makes them. Actually, all kinds of decisions bring learning. What is important is the intention, the attitude and the values considered in this process. People from different scenes face many facts and circumstances—almost always out of control—that affect the making decisions process. There is not a unique way to make decisions for all companies in many settings. The person who makes a decision should identify the problem, to solve it later using alternatives and solutions. Even though, follow all the steps it’s not easy as it seems. Looking back the conditions related to the decisions, we can mention the followings: uncertainty, risk and certainty. When people identify circumstances and facts, as well as its effects in a possible situation, they will make decisions with certainty. As long as the information decreases and it becomes ambiguous the risk becomes an important factor in the making decisions process because they are connected to probable objectives (clear or subjective (opinion judgment or intuition. To finish, uncertainty, involves people that make a decision with no or little information about circumstances or criteria with basis

  3. Robust Inventory System Optimization Based on Simulation and Multiple Criteria Decision Making

    Directory of Open Access Journals (Sweden)

    Ahmad Mortazavi

    2014-01-01

    Full Text Available Inventory management in retailers is difficult and complex decision making process which is related to the conflict criteria, also existence of cyclic changes and trend in demand is inevitable in many industries. In this paper, simulation modeling is considered as efficient tool for modeling of retailer multiproduct inventory system. For simulation model optimization, a novel multicriteria and robust surrogate model is designed based on multiple attribute decision making (MADM method, design of experiments (DOE, and principal component analysis (PCA. This approach as a main contribution of this paper, provides a framework for robust multiple criteria decision making under uncertainty.

  4. An Agent-Based Model of Farmer Decision Making in Jordan

    Science.gov (United States)

    Selby, Philip; Medellin-Azuara, Josue; Harou, Julien; Klassert, Christian; Yoon, Jim

    2016-04-01

    We describe an agent based hydro-economic model of groundwater irrigated agriculture in the Jordan Highlands. The model employs a Multi-Agent-Simulation (MAS) framework and is designed to evaluate direct and indirect outcomes of climate change scenarios and policy interventions on farmer decision making, including annual land use, groundwater use for irrigation, and water sales to a water tanker market. Land use and water use decisions are simulated for groups of farms grouped by location and their behavioural and economic similarities. Decreasing groundwater levels, and the associated increase in pumping costs, are important drivers for change within Jordan'S agricultural sector. We describe how this is considered by coupling of agricultural and groundwater models. The agricultural production model employs Positive Mathematical Programming (PMP), a method for calibrating agricultural production functions to observed planted areas. PMP has successfully been used with disaggregate models for policy analysis. We adapt the PMP approach to allow explicit evaluation of the impact of pumping costs, groundwater purchase fees and a water tanker market. The work demonstrates the applicability of agent-based agricultural decision making assessment in the Jordan Highlands and its integration with agricultural model calibration methods. The proposed approach is designed and implemented with software such that it could be used to evaluate a variety of physical and human influences on decision making in agricultural water management.

  5. Episodic memory encoding interferes with reward learning and decreases striatal prediction errors.

    Science.gov (United States)

    Wimmer, G Elliott; Braun, Erin Kendall; Daw, Nathaniel D; Shohamy, Daphna

    2014-11-05

    Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making. Copyright © 2014 the authors 0270-6474/14/3414901-12$15.00/0.

  6. The angular gyrus and visuospatial attention in decision-making under risk.

    Science.gov (United States)

    Studer, Bettina; Cen, Danlu; Walsh, Vincent

    2014-12-01

    Recent neuroimaging studies on decision-making under risk indicate that the angular gyrus (AG) is sensitive to the probability and variance of outcomes during choice. A separate body of research has established the AG as a key area in visual attention. The current study used repetitive transcranial magnetic stimulation (rTMS) in healthy volunteers to test whether the causal contribution of the AG to decision-making is independent of or linked to the guidance of visuospatial attention. A within-subject design compared decision making on a laboratory gambling task under three conditions: following rTMS to the AG, following rTMS to the premotor cortex (PMC, as an active control condition) and without TMS. The task presented two different trial types, 'visual' and 'auditory' trials, which entailed a high versus minimal demand for visuospatial attention, respectively. Our results showed a systematic effect of rTMS to the AG upon decision-making behavior in visual trials. Without TMS and following rTMS to the control region, decision latencies reflected the odds of winning; this relationship was disrupted by rTMS to the AG. In contrast, no significant effects of rTMS to the AG (or to the PMC) upon choice behavior in auditory trials were found. Thus, rTMS to the AG affected decision-making only in the task condition requiring visuospatial attention. The current findings suggest that the AG contributes to decision-making by guiding attention to relevant information about reward and punishment in the visual environment. Copyright © 2014. Published by Elsevier Inc.

  7. Dissolving decision making? : Models and their roles in decision-making processes and policy at large

    NARCIS (Netherlands)

    Zeiss, Ragna; van Egmond, S.

    2014-01-01

    This article studies the roles three science-based models play in Dutch policy and decision making processes. Key is the interaction between model construction and environment. Their political and scientific environments form contexts that shape the roles of models in policy decision making.

  8. Decision Making in the Airplane

    Science.gov (United States)

    Orasanu, Judith; Shafto, Michael G. (Technical Monitor)

    1995-01-01

    The Importance of decision-making to safety in complex, dynamic environments like mission control centers, aviation, and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. Yet laboratory research on decision making has not proven especially helpful In improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multi-dimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that

  9. Decision Making Under Uncertain Categorization

    Directory of Open Access Journals (Sweden)

    Stephanie Ying-Fen Chen

    2014-09-01

    Full Text Available Two experiments investigated how category information is used in decision making under uncertainty and whether the framing of category information influences how it is used. Subjects were presented with vignettes in which the categorization of a critical item was ambiguous and were asked to choose among a set of actions with the goal of attaining the desired outcome for the main character in the story. The normative decision making strategy was to base the decision on all possible categories; however, research on a related topic, category-based induction, has found that people often only consider a single category when making predictions when categorization is uncertain. These experiments found that subjects tend to consider multiple categories when making decisions, but do so both when it is and is not appropriate, suggesting that use of multiple categories is not driven by an understanding of what categories are and are not relevant to the decision. Similarly, although a framing manipulation increased the rate of multiple-category use, it did so in situations in which multiple-category use was and was not appropriate.

  10. Application of ann-based decision making pattern recognition to fishing operations

    Energy Technology Data Exchange (ETDEWEB)

    Akhlaghinia, M.; Torabi, F.; Wilton, R.R. [University of Regina, Saskatchewan (Canada). Faculty of Engineering. Dept. of Petroleum Engineering], e-mail: Farshid.Torabi@uregina.ca

    2010-10-15

    Decision making is a crucial part of fishing operations. Proper decisions should be made to prevent wasted time and associated costs on unsuccessful operations. This paper presents a novel model to help drilling managers decide when to commence and when to quit a fishing operation. A decision making model based on Artificial Neural Network (ANN) has been developed that utilizes Pattern Recognition based on 181 fishing incidents from one of the most fish-prone fields of the southwest of Iran. All parameters chosen to train the ANN-Based Pattern Recognition Tool are assumed to play a role in the success of the fishing operation and are therefore used to decide whether a fishing operation should be performed or not. If the tool deems the operation suitable for consideration, a cost analysis of the fishing operation can then be performed to justify its overall cost. (author)

  11. Multicriteria decision-making method based on a cosine similarity ...

    African Journals Online (AJOL)

    the cosine similarity measure is often used in information retrieval, citation analysis, and automatic classification. However, it scarcely deals with trapezoidal fuzzy information and multicriteria decision-making problems. For this purpose, a cosine similarity measure between trapezoidal fuzzy numbers is proposed based on ...

  12. NATO Guide for Judgement-Based Operational Analysis in Defence Decision Making : Client-Oriented Volume

    NARCIS (Netherlands)

    Wijnmalen, D.J.D.; et al

    2012-01-01

    Judgment plays an important role in all Operational Analysis (OA). NATO practitioners have determined that approaches in OA that are based on human judgement are increasingly critical to defence decision making. The purpose of the NATO Guide for Judgement-Based OA in Defence Decision Making is to

  13. A Common Mechanism Underlying Food Choice and Social Decisions

    Science.gov (United States)

    Krajbich, Ian; Hare, Todd; Bartling, Björn; Morishima, Yosuke; Fehr, Ernst

    2015-01-01

    People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others’ benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making. PMID:26460812

  14. A Common Mechanism Underlying Food Choice and Social Decisions.

    Science.gov (United States)

    Krajbich, Ian; Hare, Todd; Bartling, Björn; Morishima, Yosuke; Fehr, Ernst

    2015-10-01

    People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others' benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making.

  15. Individual differences in voluntary alcohol intake in rats : relationship with impulsivity, decision making and Pavlovian conditioned approach

    OpenAIRE

    Spoelder, Marcia; Flores Dourojeanni, Jacques P; de Git, Kathy C G; Baars, Annemarie M; Lesscher, Heidi M B; Vanderschuren, Louk J M J

    2017-01-01

    RATIONALE: Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood. OBJECTIVES: This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol. METHODS: LD and HD were tested in the rat gambling task (rGT) or the delayed...

  16. Risk-based decision making and risk management of European Union regional programs

    Directory of Open Access Journals (Sweden)

    Michalopoulos Evangelos

    2008-01-01

    Full Text Available This paper presents a generalized method for management decision making incorporating risk assessment techniques. The risk based decision making methodology is applied to European Union expenditure programs used to implement its regional policy, such as the community support framework, community initiatives, special initiatives and other European policies. An example is presented for the development of an audit (inspection program in the region of West Macedonia, Greece, during the implementation of the 3rd Community Structural Support Framework Operational Program. The generic nature of the method permits its use in the management of similar European regional programs in Greece and other European countries. It is also applicable to many other industries interested in applying risk-based management decisions to physical or process based systems. .

  17. GROUPS DECISION MAKING WITHIN THE ORGANIZATION

    Directory of Open Access Journals (Sweden)

    Anca Stan

    2008-12-01

    Full Text Available In a highly global market, organizations that have the ability to analyze and rapidly respond to the constantly changing marketplace will have the greatest chance of remaining competitive and profitable. Group decision making is the process of arriving at a judgment based upon the feedback of multiple individuals. Due to the importance of the group decision making process, decision making models can be used to establish a systematic means of developing effective group decision making. Once a decision has been made, the members of the group should be willing to accept it and support its implementations.

  18. Modafinil alters decision making based on feedback history - a randomized placebo-controlled double blind study in humans.

    Science.gov (United States)

    Bellebaum, Christian; Kuchinke, Lars; Roser, Patrik

    2017-02-01

    Modafinil is becoming increasingly popular as a cognitive enhancer. Research on the effects of modafinil on cognitive function have yielded mixed results, with negative findings for simple memory and attention tasks and enhancing effects for more complex tasks. In the present study we examined whether modafinil, due to its known effect on the dopamine level in the striatum, alters feedback-related choice behaviour. We applied a task that separately tests the choice of previously rewarded behaviours (approach) and avoidance of previously punished behaviours. 18 participants received a single dose of 200 mg modafinil. Their performance was compared to a group of 22 participants who received placebo in a double-blind design. Modafinil but not placebo induced a significant bias towards approach behaviour as compared to the frequency of avoidance behaviour. General attention, overall feedback-based acquisition of choice behaviour and reaction times in high vs low conflict choices were not significantly affected by modafinil. This finding suggests that modafinil has a specific effect on dopamine-mediated choice behaviour based on the history of feedback, while a contribution of noradrenaline is also conceivable. The described change in decision making cannot be considered as cognitive enhancement, but might rather have detrimental effects on decisions in everyday life.

  19. Translational Models of Gambling-Related Decision-Making.

    Science.gov (United States)

    Winstanley, Catharine A; Clark, Luke

    Gambling is a harmless, recreational pastime that is ubiquitous across cultures. However, for some, gambling becomes a maladaptive and compulsive, and this syndrome is conceptualized as a behavioural addiction. Laboratory models that capture the key cognitive processes involved in gambling behaviour, and that can be translated across species, have the potential to make an important contribution to both decision neuroscience and the study of addictive disorders. The Iowa gambling task has been widely used to assess human decision-making under uncertainty, and this paradigm can be successfully modelled in rodents. Similar neurobiological processes underpin choice behaviour in humans and rats, and thus, a preference for the disadvantageous "high-risk, high-reward" options may reflect meaningful vulnerability for mental health problems. However, the choice behaviour operationalized by these tasks does not necessarily approximate the vulnerability to gambling disorder (GD) per se. We consider a number of psychological challenges that apply to modelling gambling in a translational way, and evaluate the success of the existing models. Heterogeneity in the structure of gambling games, as well as in the motivations of individuals with GD, is highlighted. The potential issues with extrapolating too directly from established animal models of drug dependency are discussed, as are the inherent difficulties in validating animal models of GD in the absence of any approved treatments for GD. Further advances in modelling the cognitive biases endemic in human decision-making, which appear to be exacerbated in GD, may be a promising line of research.

  20. Causal knowledge and reasoning in decision making

    NARCIS (Netherlands)

    Hagmayer, Y.; Witteman, C.L.M.

    2017-01-01

    Normative causal decision theories argue that people should use their causal knowledge in decision making. Based on these ideas, we argue that causal knowledge and reasoning may support and thereby potentially improve decision making based on expected outcomes, narratives, and even cues. We will

  1. An intelligent, knowledge-based multiple criteria decision making advisor for systems design

    Science.gov (United States)

    Li, Yongchang

    of an appropriate decision making method. Furthermore, some DMs may be exclusively using one or two specific methods which they are familiar with or trust and not realizing that they may be inappropriate to handle certain classes of the problems, thus yielding erroneous results. These issues reveal that in order to ensure a good decision a suitable decision method should be chosen before the decision making process proceeds. The first part of this dissertation proposes an MCDM process supported by an intelligent, knowledge-based advisor system referred to as Multi-Criteria Interactive Decision-Making Advisor and Synthesis process (MIDAS), which is able to facilitate the selection of the most appropriate decision making method and which provides insight to the user for fulfilling different preferences. The second part of this dissertation presents an autonomous decision making advisor which is capable of dealing with ever-evolving real time information and making autonomous decisions under uncertain conditions. The advisor encompasses a Markov Decision Process (MDP) formulation which takes uncertainty into account when determines the best action for each system state. (Abstract shortened by UMI.)

  2. Decision making.

    Science.gov (United States)

    Chambers, David W

    2011-01-01

    A decision is a commitment of resources under conditions of risk in expectation of the best future outcome. The smart decision is always the strategy with the best overall expected value-the best combination of facts and values. Some of the special circumstances involved in decision making are discussed, including decisions where there are multiple goals, those where more than one person is involved in making the decision, using trigger points, framing decisions correctly, commitments to lost causes, and expert decision makers. A complex example of deciding about removal of asymptomatic third molars, with and without an EBD search, is discussed.

  3. Effectiveness of a Case-Based Computer Program on Students' Ethical Decision Making.

    Science.gov (United States)

    Park, Eun-Jun; Park, Mihyun

    2015-11-01

    The aim of this study was to test the effectiveness of a case-based computer program, using an integrative ethical decision-making model, on the ethical decision-making competency of nursing students in South Korea. This study used a pre- and posttest comparison design. Students in the intervention group used a computer program for case analysis assignments, whereas students in the standard group used a traditional paper assignment for case analysis. The findings showed that using the case-based computer program as a complementary tool for the ethics courses offered at the university enhanced students' ethical preparedness and satisfaction with the course. On the basis of the findings, it is recommended that nurse educators use a case-based computer program as a complementary self-study tool in ethics courses to supplement student learning without an increase in course hours, particularly in terms of analyzing ethics cases with dilemma scenarios and exercising ethical decision making. Copyright 2015, SLACK Incorporated.

  4. Ostracism Reduces Reliance on Poor Advice from Others during Decision Making.

    Science.gov (United States)

    Byrne, Kaileigh A; Tibbett, Thomas P; Laserna, Lauren N; Carter-Sowell, Adrienne R; Worthy, Darrell A

    2016-10-01

    Decision-making is rarely context-free, and often both social information and non-social information are weighed into one's decisions. Incorporating information into a decision can be influenced by previous experiences. Ostracism has extensive effects, including taxing cognitive resources and increasing social monitoring. In decision-making situations, individuals are often faced with both objective and social information and must choose which information to include or filter out. How will ostracism affect the reliance on objective and social information during decision-making? Participants ( N =245) in Experiment 1 were randomly assigned to be included or ostracized in a standardized, group task. They then performed a dynamic decision-making task that involved the presentation of either non-social (i.e. biased reward feedback) or social (i.e., poor advice from a previous participant) misleading information. In Experiment 2, participants ( N =105) completed either the ostracism non-social condition or social misleading information condition with explicit instructions stating that the advice given was from an individual who did not partake in the group task. Ostracized individuals relied more on non-social misleading information and performed worse than included individuals. However, ostracized individuals discounted misleading social information and outperformed included individuals. Results of Experiment 2 replicated the findings of Experiment 1. Across two experiments, ostracized individuals were more critical of advice from others, both individuals who may have ostracized them and unrelated individuals. In other words, compared to included individuals, ostracized individuals underweighted advice from another individual, but overweighted non-social information during decision-making. We conclude that when deceptive objective information is present, ostracism results in disadvantageous decision-making.

  5. Role of the medial prefrontal cortex in impaired decision making in juvenile attention-deficit/hyperactivity disorder.

    Science.gov (United States)

    Hauser, Tobias U; Iannaccone, Reto; Ball, Juliane; Mathys, Christoph; Brandeis, Daniel; Walitza, Susanne; Brem, Silvia

    2014-10-01

    Attention-deficit/hyperactivity disorder (ADHD) has been associated with deficient decision making and learning. Models of ADHD have suggested that these deficits could be caused by impaired reward prediction errors (RPEs). Reward prediction errors are signals that indicate violations of expectations and are known to be encoded by the dopaminergic system. However, the precise learning and decision-making deficits and their neurobiological correlates in ADHD are not well known. To determine the impaired decision-making and learning mechanisms in juvenile ADHD using advanced computational models, as well as the related neural RPE processes using multimodal neuroimaging. Twenty adolescents with ADHD and 20 healthy adolescents serving as controls (aged 12-16 years) were examined using a probabilistic reversal learning task while simultaneous functional magnetic resonance imaging and electroencephalogram were recorded. Learning and decision making were investigated by contrasting a hierarchical Bayesian model with an advanced reinforcement learning model and by comparing the model parameters. The neural correlates of RPEs were studied in functional magnetic resonance imaging and electroencephalogram. Adolescents with ADHD showed more simplistic learning as reflected by the reinforcement learning model (exceedance probability, Px = .92) and had increased exploratory behavior compared with healthy controls (mean [SD] decision steepness parameter β: ADHD, 4.83 [2.97]; controls, 6.04 [2.53]; P = .02). The functional magnetic resonance imaging analysis revealed impaired RPE processing in the medial prefrontal cortex during cue as well as during outcome presentation (P decision making and learning mechanisms in adolescents with ADHD are driven by impaired RPE processing in the medial prefrontal cortex. This novel, combined approach furthers the understanding of the pathomechanisms in ADHD and may advance treatment strategies.

  6. Mild cognitive impairment is associated with poorer decision-making in community-based older persons.

    Science.gov (United States)

    Han, S Duke; Boyle, Patricia A; James, Bryan D; Yu, Lei; Bennett, David A

    2015-04-01

    To test the hypothesis that mild cognitive impairment (MCI) is associated with poorer financial and healthcare decision-making. Community-based epidemiological cohort study. Communities throughout northeastern Illinois. Older persons without dementia from the Rush Memory and Aging Project (N = 730). All participants underwent a detailed clinical evaluation and decision-making assessment using a measure that closely approximates materials used in real-world financial and healthcare settings. This allowed for measurement of total decision-making and financial and healthcare decision-making. Regression models were used to examine whether MCI was associated with a lower level of decision-making. In subsequent analyses, the relationship between specific cognitive systems (episodic memory, semantic memory, working memory, perceptual speed, visuospatial ability) and decision-making was explored in participants with MCI. MCI was associated with lower total, financial, and healthcare decision-making scores after accounting for the effects of age, education, and sex. The effect of MCI on total decision-making was equivalent to the effect of more than 10 additional years of age. Additional models showed that, when considering multiple cognitive systems, perceptual speed accounted for the most variance in decision-making in participants with MCI. Persons with MCI may have poorer financial and healthcare decision-making in real-world situations, and perceptual speed may be an important contributor to poorer decision-making in persons with MCI. © 2015, Copyright the Authors Journal compilation © 2015, The American Geriatrics Society.

  7. Quantifying motivation with effort-based decision-making paradigms in health and disease.

    Science.gov (United States)

    Chong, T T-J; Bonnelle, V; Husain, M

    2016-01-01

    Motivation can be characterized as a series of cost-benefit valuations, in which we weigh the amount of effort we are willing to expend (the cost of an action) in return for particular rewards (its benefits). Human motivation has traditionally been measured with self-report and questionnaire-based tools, but an inherent limitation of these methods is that they are unable to provide a mechanistic explanation of the processes underlying motivated behavior. A major goal of current research is to quantify motivation objectively with effort-based decision-making paradigms, by drawing on a rich literature from nonhuman animals. Here, we review this approach by considering the development of these paradigms in the laboratory setting over the last three decades, and their more recent translation to understanding choice behavior in humans. A strength of this effort-based approach to motivation is that it is capable of capturing the wide range of individual differences, and offers the potential to dissect motivation into its component elements, thus providing the basis for more accurate taxonomic classifications. Clinically, modeling approaches might provide greater sensitivity and specificity to diagnosing disorders of motivation, for example, in being able to detect subclinical disorders of motivation, or distinguish a disorder of motivation from related but separate syndromes, such as depression. Despite the great potential in applying effort-based paradigms to index human motivation, we discuss several caveats to interpreting current and future studies, and the challenges in translating these approaches to the clinical setting. © 2016 Elsevier B.V. All rights reserved.

  8. Cognitive judgment bias interacts with risk based decision making and sensitivity to dopaminergic challenge in rats

    Directory of Open Access Journals (Sweden)

    Robert Drozd

    2016-08-01

    Full Text Available Although cognitive theory has implicated judgement bias in various psychopathologies, its role in decision making under risk remains relatively unexplored. In the present study we assessed the effects of cognitive judgment bias on risky choices in rats. First, we trained and tested the animals on the rat version of the probability-discounting task. During discrete trials, the rats chose between two levers; a press on the ‘small/certain’ lever always resulted in the delivery of one reward pellet, whereas a press on the ‘large/risky’ lever resulted in the delivery of four pellets. However, the probability of receiving a reward from the ‘large/risky’ lever gradually decreased over the four trial blocks. Subsequently, the rats were re-trained and evaluated on a series of ambiguous-cue interpretation tests, which permitted their classification according to the display of ‘optimistic’ or ‘pessimistic’ traits. Because dopamine has been implicated in both: risky choices and optimism, in the last experiment, we compared the reactivity of the dopaminergic system in the ‘optimistic’ and ‘pessimistic’ animals using the apomorphine (2mg/kg s.c. sensitivity test. We demonstrated that as risk increased, the proportion of risky lever choices decreased significantly slower in ‘optimists’ compared with ‘pessimists’ and that these differences between the two groups of rats were associated with different levels of dopaminergic system reactivity. Our findings suggest that cognitive judgement bias, risky decision-making and dopamine are linked, and they provide a foundation for further investigation of the behavioural traits and cognitive processes that influence risky choices in animal models.

  9. Chronic work stress and decreased vagal tone impairs decision making and reaction time in jockeys.

    Science.gov (United States)

    Landolt, Kathleen; Maruff, Paul; Horan, Ben; Kingsley, Michael; Kinsella, Glynda; O'Halloran, Paul D; Hale, Matthew W; Wright, Bradley J

    2017-10-01

    The inverse relationship between acute stress and decision-making is well documented, but few studies have investigated the impact of chronic stress. Jockeys work exhaustive schedules and have extremely dangerous occupations, with safe performance requiring quick reaction time and accurate decision-making. We used the effort reward imbalance (ERI) occupational stress model to assess the relationship of work stress with indices of stress physiology and decision-making and reaction time. Jockeys (N=32) completed computerised cognitive tasks (Cogstate) on two occasions; September and November (naturally occurring lower and higher stress periods), either side of an acute stress test. Higher ERI was correlated with the cortisol awakening responses (high stress r=-0.37; low stress r=0.36), and with decrements in decision-making comparable to having a blood alcohol concentration of 0.08 in the high stress period (pdecision-making. Potentially, this may be attributed to a 'tipping point' whereby the higher ERI reported by jockeys in the high stress period decreases vagal tone, which may contribute to reduced decision-making abilities. Copyright © 2017 Elsevier Ltd. All rights reserved.

  10. Multiple Attribute Decision Making Based on Cross-Evaluation with Uncertain Decision Parameters

    Directory of Open Access Journals (Sweden)

    Tao Ding

    2016-01-01

    Full Text Available Multiple attribute decision making (MADM problem is one of the most common and popular research fields in the theory of decision science. A variety of methods have been proposed to deal with such problems. Nevertheless, many of them assumed that attribute weights are determined by different types of additional preference information which will result in subjective decision making. In order to solve such problems, in this paper, we propose a novel MADM approach based on cross-evaluation with uncertain parameters. Specifically, the proposed approach assumes that all attribute weights are uncertain. It can overcome the drawback in prior research that the alternatives’ ranking may be determined by a single attribute with an overestimated weight. In addition, the proposed method can also balance the mean and deviation of each alternative’s cross-evaluation score to guarantee the stability of evaluation. Then, this method is extended to a more generalized situation where the attribute values are also uncertain. Finally, we illustrate the applicability of the proposed method by revisiting two reported studies and by a case study on the selection of community service companies in the city of Hefei in China.

  11. Neurobiological and Memory Models of Risky Decision Making in Adolescents versus Young Adults

    Science.gov (United States)

    Reyna, Valerie F.; Estrada, Steven M.; DeMarinis, Jessica A.; Myers, Regina M.; Stanisz, Janine M.; Mills, Britain A.

    2011-01-01

    Predictions of fuzzy-trace theory and neurobiological approaches are examined regarding risk taking in a classic decision-making task--the framing task--as well as in the context of real-life risk taking. We report the 1st study of framing effects in adolescents versus adults, varying risk and reward, and relate choices to individual differences,…

  12. Rough multiple objective decision making

    CERN Document Server

    Xu, Jiuping

    2011-01-01

    Rough Set TheoryBasic concepts and properties of rough sets Rough Membership Rough Intervals Rough FunctionApplications of Rough SetsMultiple Objective Rough Decision Making Reverse Logistics Problem with Rough Interval Parameters MODM based Rough Approximation for Feasible RegionEVRMCCRMDCRM Reverse Logistics Network Design Problem of Suji Renewable Resource MarketBilevel Multiple Objective Rough Decision Making Hierarchical Supply Chain Planning Problem with Rough Interval Parameters Bilevel Decision Making ModelBL-EVRM BL-CCRMBL-DCRMApplication to Supply Chain Planning of Mianyang Co., LtdStochastic Multiple Objective Rough Decision Multi-Objective Resource-Constrained Project Scheduling UnderRough Random EnvironmentRandom Variable Stochastic EVRM Stochastic CCRM Stochastic DCRM Multi-Objective rc-PSP/mM/Ro-Ra for Longtan Hydropower StationFuzzy Multiple Objective Rough Decision Making Allocation Problem under Fuzzy Environment Fuzzy Variable Fu-EVRM Fu-CCRM Fu-DCRM Earth-Rock Work Allocation Problem.

  13. Nuclear regulatory decision making

    International Nuclear Information System (INIS)

    2005-01-01

    The fundamental objective of all nuclear safety regulatory bodies is to ensure that nuclear utilities operate their plants at all times in an acceptably safe manner. In meeting this objective, the regulatory body should strive to ensure that its regulatory decisions are technically sound, consistent from case to case, and timely. In addition, the regulator must be aware that its decisions and the circumstances surrounding those decisions can affect how its stakeholders, such as government policy makers, the industry it regulates, and the public, view it as an effective and credible regulator. In order to maintain the confidence of those stakeholders, the regulator should make sure that its decisions are transparent, have a clear basis in law and regulations, and are seen by impartial observers to be fair to all parties. Based on the work of a Nuclear Energy Agency (NEA) expert group, this report discusses some of the basic principles and criteria that a regulatory body should consider in making decisions and describes the elements of an integrated framework for regulatory decision making. (author)

  14. Dynamic excitatory and inhibitory gain modulation can produce flexible, robust and optimal decision-making.

    Directory of Open Access Journals (Sweden)

    Ritwik K Niyogi

    Full Text Available Behavioural and neurophysiological studies in primates have increasingly shown the involvement of urgency signals during the temporal integration of sensory evidence in perceptual decision-making. Neuronal correlates of such signals have been found in the parietal cortex, and in separate studies, demonstrated attention-induced gain modulation of both excitatory and inhibitory neurons. Although previous computational models of decision-making have incorporated gain modulation, their abstract forms do not permit an understanding of the contribution of inhibitory gain modulation. Thus, the effects of co-modulating both excitatory and inhibitory neuronal gains on decision-making dynamics and behavioural performance remain unclear. In this work, we incorporate time-dependent co-modulation of the gains of both excitatory and inhibitory neurons into our previous biologically based decision circuit model. We base our computational study in the context of two classic motion-discrimination tasks performed in animals. Our model shows that by simultaneously increasing the gains of both excitatory and inhibitory neurons, a variety of the observed dynamic neuronal firing activities can be replicated. In particular, the model can exhibit winner-take-all decision-making behaviour with higher firing rates and within a significantly more robust model parameter range. It also exhibits short-tailed reaction time distributions even when operating near a dynamical bifurcation point. The model further shows that neuronal gain modulation can compensate for weaker recurrent excitation in a decision neural circuit, and support decision formation and storage. Higher neuronal gain is also suggested in the more cognitively demanding reaction time than in the fixed delay version of the task. Using the exact temporal delays from the animal experiments, fast recruitment of gain co-modulation is shown to maximize reward rate, with a timescale that is surprisingly near the

  15. The neural substrates of social influence on decision making.

    Science.gov (United States)

    Tomlin, Damon; Nedic, Andrea; Prentice, Deborah A; Holmes, Philip; Cohen, Jonathan D

    2013-01-01

    The mechanisms that govern human learning and decision making under uncertainty have been the focus of intense behavioral and, more recently, neuroscientific investigation. Substantial progress has been made in building models of the processes involved, and identifying underlying neural mechanisms using simple, two-alternative forced choice decision tasks. However, less attention has been given to how social information influences these processes, and the neural systems that mediate this influence. Here we sought to address these questions by using tasks similar to ones that have been used to study individual decision making behavior, and adding conditions in which participants were given trial-by-trial information about the performance of other individuals (their choices and/or their rewards) simultaneously playing the same tasks. We asked two questions: How does such information about the behavior of others influence performance in otherwise simple decision tasks, and what neural systems mediate this influence? We found that bilateral insula exhibited a parametric relationship to the degree of misalignment of the individual's performance with those of others in the group. Furthermore, activity in the bilateral insula significantly predicted participants' subsequent choices to align their behavior with others in the group when they were misaligned either in their choices (independent of success) or their degree of success (independent of specific choices). These findings add to the growing body of empirical data suggesting that the insula participates in an important way in social information processing and decision making.

  16. Emotional see-saw affects rationality of decision-making: Evidence for metacognitive impairments.

    Science.gov (United States)

    Folwarczny, Michał; Kaczmarek, Magdalena C; Doliński, Dariusz; Szczepanowski, Remigiusz

    2018-05-01

    This research investigated the cognitive mechanisms that underlie impairments in human reasoning triggered by the emotional see-saw technique. It has previously been stated that such manipulation is effective as it presumably induces a mindless state and cognitive deficits in compliant individuals. Based on the dual-system architecture of reasoning (system 2) and affective decision-making (system 1), we challenged the previous theoretical account by indicating that the main source of compliance is impairment of the meta-reasoning system when rapid affective changes occur. To examine this hypothesis, we manipulated affective feelings (system 1 processing) by violating participants' expectations regarding reward and performance in a go/no-go task in which individuals were to inhibit their responses to earn money. Aside from the go/no-go performance, we measured rationality (meta-reasoning system 2) in decision-making by asking participants to comply with a nonsensical request. We found that participants who were exposed to meta-reasoning impairments due to the emotional see-saw phenomenon exhibited mindless behavior. Copyright © 2018 Elsevier B.V. All rights reserved.

  17. Neuroanatomical basis for recognition primed decision making.

    Science.gov (United States)

    Hudson, Darren

    2013-01-01

    Effective decision making under time constraints is often overlooked in medical decision making. The recognition primed decision making (RPDM) model was developed by Gary Klein based on previous recognized situations to develop a satisfactory solution to the current problem. Bayes Theorem is the most popular decision making model in medicine but is limited by the need for adequate time to consider all probabilities. Unlike other decision making models, there is a potential neurobiological basis for RPDM. This model has significant implication for health informatics and medical education.

  18. Shared decision making

    Science.gov (United States)

    ... page: //medlineplus.gov/ency/patientinstructions/000877.htm Shared decision making To use the sharing features on this page, ... treatment you both support. When to use Shared Decision Making Shared decision making is often used when you ...

  19. A Common Mechanism Underlying Food Choice and Social Decisions.

    Directory of Open Access Journals (Sweden)

    Ian Krajbich

    2015-10-01

    Full Text Available People make numerous decisions every day including perceptual decisions such as walking through a crowd, decisions over primary rewards such as what to eat, and social decisions that require balancing own and others' benefits. The unifying principles behind choices in various domains are, however, still not well understood. Mathematical models that describe choice behavior in specific contexts have provided important insights into the computations that may underlie decision making in the brain. However, a critical and largely unanswered question is whether these models generalize from one choice context to another. Here we show that a model adapted from the perceptual decision-making domain and estimated on choices over food rewards accurately predicts choices and reaction times in four independent sets of subjects making social decisions. The robustness of the model across domains provides behavioral evidence for a common decision-making process in perceptual, primary reward, and social decision making.

  20. Modeling Human Elements of Decision-Making

    Science.gov (United States)

    2002-06-01

    include factors such as personality, emotion , and level of expertise, which vary from individual to individual. The process of decision - making during... rational choice theories such as utility theory, to more descriptive psychological models that focus more on the process of decision - making ...descriptive nature, they provide a more realistic representation of human decision - making than the rationally based models. However these models do

  1. [Cognitive errors in diagnostic decision making].

    Science.gov (United States)

    Gäbler, Martin

    2017-10-01

    Approximately 10-15% of our diagnostic decisions are faulty and may lead to unfavorable and dangerous outcomes, which could be avoided. These diagnostic errors are mainly caused by cognitive biases in the diagnostic reasoning process.Our medical diagnostic decision-making is based on intuitive "System 1" and analytical "System 2" diagnostic decision-making and can be deviated by unconscious cognitive biases.These deviations can be positively influenced on a systemic and an individual level. For the individual, metacognition (internal withdrawal from the decision-making process) and debiasing strategies, such as verification, falsification and rule out worst-case scenarios, can lead to improved diagnostic decisions making.

  2. Making the case for evidence-based design in healthcare: a descriptive case study of organizational decision making.

    Science.gov (United States)

    Shoemaker, Lorie K; Kazley, Abby Swanson; White, Andrea

    2010-01-01

    The aim of this study was to describe the organizational decision-making process used in the selection of evidence-based design (EBD) concepts, the criteria used to make these decisions, and the extent to which leadership style may have influenced the decision-making process. Five research questions were formulated to frame the direction of this study, including: (1) How did healthcare leaders learn of innovations in design? (2) How did healthcare leaders make decisions in the selection of healthcare design concepts? (3) What criteria did healthcare leaders use in the decision-making process? (4) How did healthcare leaders consider input from the staff in design decisions? and (5) To what extent did the leadership style of administrators affect the outcomes of the decision-making process? Current issues affecting healthcare in the community led the principal investigator's organization to undertake an ambitious facilities expansion project. As part of its planning process, the organization learned of EBD principles that seemingly had a positive impact on patient care and safety and staff working conditions. Although promising, a paucity of empirical research addressed the cost/benefit of incorporating many EBD concepts into one hospital setting, and there was no research that articulated the organizational decision-making process used by healthcare administrators when considering the use of EBD in expansion projects. A mixed-method, descriptive, qualitative, single-case study and quantitative design were used to address the five research questions. The Systems Research Organizing Model provided the theoretical framework. A variety of data collection methods was used, including interviews of key respondents, the review of documentary evidence, and the Multifactor Leadership Questionnaire. A participatory process was used throughout the design decision phases, involving staff at all levels of the organization. The Internet and architects facilitated learning about

  3. Serotonin and decision making processes.

    Science.gov (United States)

    Homberg, Judith R

    2012-01-01

    Serotonin (5-HT) is an important player in decision making. Serotonergic antidepressant, anxiolytic and antipsychotic drugs are extensively used in the treatment of neuropsychiatric disorders characterized by impaired decision making, and exert both beneficial and harmful effects in patients. Detailed insight into the serotonergic mechanisms underlying decision making is needed to strengthen the first and weaken the latter. Although much remains to be done to achieve this, accumulating studies begin to deliver a coherent view. Thus, high central 5-HT levels are generally associated with improved reversal learning, improved attentional set shifting, decreased delay discounting, and increased response inhibition, but a failure to use outcome representations. Based on 5-HT's evolutionary role, I hypothesize that 5-HT integrates expected, or changes in, relevant sensory and emotional internal/external information, leading to vigilance behaviour affecting various decision making processes. 5-HT receptor subtypes play distinctive roles in decision making. 5-HT(2A) agonists and 5-HT2c antagonists decrease compulsivity, whereas 5-HT(2A) antagonists and 5-HT(2C) agonists decrease impulsivity. 5-HT(6) antagonists univocally affect decision making processes. Copyright © 2011 Elsevier Ltd. All rights reserved.

  4. Handbook on Decision Making Vol 2 Risk Management in Decision Making

    CERN Document Server

    Lu, Jie; Zhang, Guangquan

    2012-01-01

    This book presents innovative theories, methodologies, and techniques in the field of risk management and decision making. It introduces new research developments and provides a comprehensive image of their potential applications to readers interested in the area. The collection includes: computational intelligence applications in decision making, multi-criteria decision making under risk, risk modelling,forecasting and evaluation, public security and community safety, risk management in supply chain and other business decision making, political risk management and disaster response systems. The book is directed to academic and applied researchers working on risk management, decision making, and management information systems.

  5. School Counselors and Ethical Decision Making

    Science.gov (United States)

    West, Dana R.

    2016-01-01

    Students and their parents/guardians rely on school counselors to provide counseling services based on ethically sound principles. However, there is a lack of empirical evidence about what influences a school counselor's ethical decision making. Ethical decision making for this study was defined as the degree to which decisions pertaining to…

  6. Disadvantageous decision-making in borderline personality disorder: Partial support from a meta-analytic review.

    Science.gov (United States)

    Paret, Christian; Jennen-Steinmetz, Christine; Schmahl, Christian

    2017-01-01

    To achieve long-term goals, organisms evaluate outcomes and expected consequences of their behaviors. Unfavorable decisions maintain many symptoms of borderline personality disorder (BPD); therefore, a better understanding of the mechanisms underlying decision-making in BPD is needed. In this review, the current literature comparing decision-making in patients with BPD versus healthy controls is analyzed. Twenty-eight empirical studies were identified through a structured literature search. The effect sizes from studies applying comparable experimental tasks were analyzed. It was found that (1) BPD patients discounted delayed rewards more strongly; (2) reversal learning was not significantly altered in BPD; and (3) BPD patients achieved lower net gains in the Iowa Gambling Task (IGT). Current psychotropic medication, sex and differences in age between the patient and control group moderated the IGT outcome. Altered decision-making in a variety of other tasks was supported by a qualitative review. In summary, current evidence supports the altered valuation of outcomes in BPD. A multifaceted influence on decision-making and adaptive learning is reflected in this literature. Copyright © 2016 Elsevier Ltd. All rights reserved.

  7. Mild Cognitive Impairment is Associated with PoorerDecision Making in Community-Based Older Persons

    Science.gov (United States)

    Duke Han, S.; Boyle, Patricia A.; James, Bryan D.; Yu, Lei; Bennett, David A.

    2015-01-01

    Background/Objectives Financial and healthcare decision making are important for maintaining wellbeing and independence in old age. We tested the hypothesis that Mild Cognitive Impairment (MCI) is associated with poorer decision making in financial and healthcare matters. Design Community-based epidemiologic cohort study. Setting Communities throughout Northeastern Illinois. Participants Participants were 730 older nondemented persons from the Rush Memory and Aging Project. Measurements All participants underwent a detailed clinical evaluation and decision making assessment using a measure that closely approximates materials utilized in real world financial and healthcare settings. This allowed for measurement of total decision making, as well as financial and healthcare decision making. Regression models were used to examine whether the presence of MCI was associated with a lower level of decision making. In subsequent analyses, we explored the relation of specific cognitive systems (i.e., episodic memory, semantic memory, working memory, perceptual speed, and visuospatial ability) with decision making in those with MCI. Results Results showed that MCI was associated with lower decision making total scores as well as financial and healthcare scores, respectively, after accounting for the effects of age, education, and sex. The effect of MCI on total decision making was equivalent to the effect of more than 10 additional years of age. Additional models showed that when considering multiple cognitive systems, perceptual speed accounted for the most variance in decision making among participants with MCI. Conclusion Results suggest that persons with MCI may exhibit poorer financial and healthcare decision making in real world situations, and that perceptual speed may be an important contributor to poorer decision making among persons with MCI. PMID:25850350

  8. Reward networks in the brain as captured by connectivity measures

    Directory of Open Access Journals (Sweden)

    Estela Camara

    2009-12-01

    Full Text Available An assortment of human behaviors is thought to be driven by rewards including reinforcement learning, novelty processing, learning, decision making, economic choice, incentive motivation, and addiction. In each case the ventral tegmental area / ventral striatum (Nucleus accumbens system (VTA-VS has been implicated as a key structure by functional imaging studies, mostly on the basis of standard, univariate analyses. Here we propose that standard fMRI analysis needs to be complemented by methods that take into account the differential connectivity of the VTA-VS system in the different behavioral contexts in order to describe reward based processes more appropriately. We first consider the wider network for reward processing as it emerged from animal experimentation. Subsequently, an example for a method to assess functional connectivity is given. Finally, we illustrate the usefulness of such analyses by examples regarding reward valuation, reward expectation and the role of reward in addiction.

  9. Apathy and emotion-based decision-making in amnesic mild cognitive impairment and Alzheimer's disease.

    Science.gov (United States)

    Bayard, Sophie; Jacus, Jean-Pierre; Raffard, Stéphane; Gely-Nargeot, Marie-Christine

    2014-01-01

    Apathy and reduced emotion-based decision-making are two behavioral modifications independently described in Alzheimer's disease (AD) and amnestic mild cognitive impairment (aMCI). The aims of this study were to investigate decision-making based on emotional feedback processing in AD and aMCI and to study the impact of reduced decision-making performances on apathy. We recruited 20 patients with AD, 20 participants with aMCI, and 20 healthy controls. All participants completed the Lille apathy rating scale (LARS) and the Iowa gambling task (IGT). Both aMCI and AD participants had reduced performances on the IGT and were more apathetic compared to controls without any difference between aMCI and AD groups. For the entire sample, LARS initiation dimension was related to IGT disadvantageous decision-making profile. We provide the first study showing that both aMCI and AD individuals make less profitable decisions than controls, whereas aMCI and AD did not differ. Disadvantageous decision-making profile on the IGT was associated with higher level of apathy on the action initiation dimension. The role of an abnormal IGT performance as a risk factor for the development of apathy needs to be investigated in other clinical populations and in normal aging.

  10. Leadership of risk decision making in a complex, technology organization: The deliberative decision making model

    Science.gov (United States)

    Flaming, Susan C.

    2007-12-01

    The continuing saga of satellite technology development is as much a story of successful risk management as of innovative engineering. How do program leaders on complex, technology projects manage high stakes risks that threaten business success and satellite performance? This grounded theory study of risk decision making portrays decision leadership practices at one communication satellite company. Integrated product team (IPT) leaders of multi-million dollar programs were interviewed and observed to develop an extensive description of the leadership skills required to navigate organizational influences and drive challenging risk decisions to closure. Based on the study's findings the researcher proposes a new decision making model, Deliberative Decision Making, to describe the program leaders' cognitive and organizational leadership practices. This Deliberative Model extends the insights of prominent decision making models including the rational (or classical) and the naturalistic and qualifies claims made by bounded rationality theory. The Deliberative Model describes how leaders proactively engage resources to play a variety of decision leadership roles. The Model incorporates six distinct types of leadership decision activities, undertaken in varying sequence based on the challenges posed by specific risks. Novel features of the Deliberative Decision Model include: an inventory of leadership methods for managing task challenges, potential stakeholder bias and debates; four types of leadership meta-decisions that guide decision processes, and aligned organizational culture. Both supporting and constraining organizational influences were observed as leaders managed major risks, requiring active leadership on the most difficult decisions. Although the company's engineering culture emphasized the importance of data-based decisions, the uncertainties intrinsic to satellite risks required expert engineering judgment to be exercised throughout. An investigation into

  11. Abstinent adult daily smokers show reduced anticipatory but elevated saccade-related brain responses during a rewarded antisaccade task.

    Science.gov (United States)

    Geier, Charles F; Sweitzer, Maggie M; Denlinger, Rachel; Sparacino, Gina; Donny, Eric C

    2014-08-30

    Chronic smoking may result in reduced sensitivity to non-drug rewards (e.g., money), a phenomenon particularly salient during abstinence. During a quit attempt, this effect may contribute to biased decision-making (smoking>alternative reinforcers) and relapse. Although relevant for quitting, characterization of reduced reward function in abstinent smokers remains limited. Moreover, how attenuated reward function affects other brain systems supporting decision-making has not been established. Here, we use a rewarded antisaccade (rAS) task to characterize non-drug reward processing and its influence on inhibitory control, key elements underlying decision-making, in abstinent smokers vs. non-smokers. Abstinent (12-hours) adult daily smokers (N=23) and non-smokers (N=11) underwent fMRI while performing the rAS. Behavioral performances improved on reward vs. neutral trials. Smokers showed attenuated activation in ventral striatum during the reward cue and in superior precentral sulcus and posterior parietal cortex during response preparation, but greater responses during the saccade response in posterior cingulate and parietal cortices. Smokers' attenuated anticipatory responses suggest reduced motivation from monetary reward, while heightened activation during the saccade response suggests that additional circuitry may be engaged later to enhance inhibitory task performance. Overall, this preliminary study highlights group differences in decision-making components and the utility of the rAS to characterize these effects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  12. Risk-based decision-making regarding mixed waste disposal systems

    International Nuclear Information System (INIS)

    Roberds, W.J.

    1991-01-01

    This paper reports on an efficient approach that has been developed for making rational and defensible decisions among a variety of options (e.g., remedial actions, engineered barriers designs/operational controls, inventory limitations, site investigations and research) for mixed-waste disposal systems, which consist of multiple interacting sites (active, inactive and/or future) with multiple pathways. Such decisions are based on maximizing the satisfaction of identified objectives (including the reliability vis a vis specified criteria), explicitly considering tradeoffs among objectives as well as uncertainties in the consequences of any option

  13. How do small groups make decisions?

    OpenAIRE

    Chahine, Saad; Cristancho, Sayra; Padgett, Jessica; Lingard, Lorelei

    2017-01-01

    In the competency-based medical education (CBME) approach, clinical competency committees are responsible for making decisions about trainees? competence. However, we currently lack a?theoretical model for group decision-making to inform this emerging assessment phenomenon. This paper proposes an organizing framework to study and guide the decision-making processes of clinical competency committees. This is an explanatory, non-exhaustive review, tailored to identify relevant theoretical and e...

  14. Managerial Decision Making in Traffic

    Directory of Open Access Journals (Sweden)

    Teodor Perić

    2003-11-01

    Full Text Available Decision-making is defined as a selection of a certain actionamong several alternatives. It is the essence of planning, asin the managerial sense there is no plan until a decision of engagementof resources, reputation and direction of activities ismade. Decision-making is, in fact, only a step in planning, evenwhen it is performed quickly and without special consideration.It is what we all experience every day. It is one of the most fascinatingbiological activities and the subject of frightening implicationsfor the whole human race. Since various techniques improvethe system and the quality of managerial decision-making,they are classified into three assumptions: risk analysis, decision-making trees, and the theory of revealed preference. Allof these are based on the interaction of a certain number of importantvariables out of which many contain the elements ofuncertainty, but maybe also high level of probability.

  15. Decision Making with Imperfect Decision Makers

    CERN Document Server

    Guy, Tatiana Valentine; Wolpert, David H

    2012-01-01

    Prescriptive Bayesian decision making has reached a high level of maturity and is well-supported algorithmically. However, experimental data shows that real decision makers choose such Bayes-optimal decisions surprisingly infrequently, often making decisions that are badly sub-optimal. So prevalent is such imperfect decision-making that it should be accepted as an inherent feature of real decision makers living within interacting societies. To date such societies have been investigated from an economic and gametheoretic perspective, and even to a degree from a physics perspective. However, lit

  16. Quantity judgements in the context of risk/reward decision making in striped field mice: First count, then hunt

    Directory of Open Access Journals (Sweden)

    Sofia ePanteleeva

    2013-02-01

    Full Text Available We simulated the vital situation of risky hunting in the striped field mouse Apodemus agrarius in order to examine whether these animals are able to make a choice between small and large quantities of live prey (ants. In the first (preliminary experiment we investigated to what extent mice were interested in ants as a live prey and how their hunting activity depended on the quantity of these edible but rather aggressive insects. We placed mice one by one into arenas together with ant groups of different size, from 10 to 60. Surprisingly, animals, both wild-caught and laboratory-reared, displayed rather skilled predatory attacks: mice killed and ate from 0.37±003 to 4±0.5 ants per minute. However, there was a threshold number of ants in the arenas when rodents expressed signs of discomfort and started to panic, because ants bit them. This threshold corresponds to the dynamic density (about 400 individuals per m 2per min in the vicinity of anthills and ants’ routes in natural environment. In the second experiment mice had to choose between different quantities of ants placed in two transparent tunnels. Ants here served both as food items and as a source of danger. As far as we know, this is the first experimental paradigm based on evaluation of quantity judgements in the context of risk/reward decision making where the animals face a trade-off between the hedonistic value of the prey and the danger it presents.. We found that when mice have to choose between 5 vs 15, 5 vs 30 and 10 vs 30 ants, they always tend to prefer the smaller quantity, thus displaying the capacity for distinguishing more from less in order to ensure comfortable hunting. The results of this study are ecologically relevant as they reflect situations and challenges faced by free-living small rodents.

  17. Adolescent neural response to reward is related to participant sex and task motivation.

    Science.gov (United States)

    Alarcón, Gabriela; Cservenka, Anita; Nagel, Bonnie J

    2017-02-01

    Risky decision making is prominent during adolescence, perhaps contributed to by heightened sensation seeking and ongoing maturation of reward and dopamine systems in the brain, which are, in part, modulated by sex hormones. In this study, we examined sex differences in the neural substrates of reward sensitivity during a risky decision-making task and hypothesized that compared with girls, boys would show heightened brain activation in reward-relevant regions, particularly the nucleus accumbens, during reward receipt. Further, we hypothesized that testosterone and estradiol levels would mediate this sex difference. Moreover, we predicted boys would make more risky choices on the task. While boys showed increased nucleus accumbens blood oxygen level-dependent (BOLD) response relative to girls, sex hormones did not mediate this effect. As predicted, boys made a higher percentage of risky decisions during the task. Interestingly, boys also self-reported more motivation to perform well and earn money on the task, while girls self-reported higher state anxiety prior to the scan session. Motivation to earn money partially mediated the effect of sex on nucleus accumbens activity during reward. Previous research shows that increased motivation and salience of reinforcers is linked with more robust striatal BOLD response, therefore psychosocial factors, in addition to sex, may play an important role in reward sensitivity. Elucidating neurobiological mechanisms that support adolescent sex differences in risky decision making has important implications for understanding individual differences that lead to advantageous and adverse behaviors that affect health outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

  18. Higher Trait Psychopathy Is Associated with Increased Risky Decision-Making and Less Coincident Insula and Striatal Activity

    Directory of Open Access Journals (Sweden)

    Matthew T. Sutherland

    2017-12-01

    Full Text Available Higher trait levels of psychopathy have been associated with both a tendency to maintain disadvantageous decision-making strategies and aberrant cortico-limbic neural activity. To explore the neural mechanisms associated with the psychopathy-related propensity to continue selecting risky choices, a non-forensic sample of participants completed a self-report psychopathy questionnaire and two runs of a risky decision-making task during H215O positron emission tomography (PET scanning. In this secondary data analysis study, we leveraged data previously collected to examine the impact of previous drug use on risky decision-making to explore the relations between self-reported psychopathy and behavioral and brain metrics during performance of the Cambridge Decision-Making Task (CDMT, in which volunteers chose between small/likely or large/unlikely potential reward outcomes. Behaviorally, we observed that psychopathy scores were differentially correlated with the percent of risky decisions made in run 1 vs. run 2 of the task. Specifically, higher levels of psychopathy, above and beyond that attributable to drug use or sex, were associated with greater tendencies to make risky selections only in the second half (run 2 of the task. In parallel, psychopathy scores negatively correlated with regional cerebral blood flow (rCBF in the right insula and right ventral striatum during run 2 of the CDMT. These exploratory outcomes suggest that greater levels of psychopathy may be associated with an inability to translate experience with negative outcomes into behavioral adaptations possibly due to decreased neural efficiency in regions related to somatic and/or reward feedback processes.

  19. A Multi-layer Dynamic Model for Coordination Based Group Decision Making in Water Resource Allocation and Scheduling

    Science.gov (United States)

    Huang, Wei; Zhang, Xingnan; Li, Chenming; Wang, Jianying

    Management of group decision-making is an important issue in water source management development. In order to overcome the defects in lacking of effective communication and cooperation in the existing decision-making models, this paper proposes a multi-layer dynamic model for coordination in water resource allocation and scheduling based group decision making. By introducing the scheme-recognized cooperative satisfaction index and scheme-adjusted rationality index, the proposed model can solve the problem of poor convergence of multi-round decision-making process in water resource allocation and scheduling. Furthermore, the problem about coordination of limited resources-based group decision-making process can be solved based on the effectiveness of distance-based group of conflict resolution. The simulation results show that the proposed model has better convergence than the existing models.

  20. Fuzzy Group Decision Making Approach for Ranking Work Stations Based on Physical Pressure

    Directory of Open Access Journals (Sweden)

    Hamed Salmanzadeh

    2014-06-01

    Full Text Available This paper proposes a Fuzzy Group Decision Making approach for ranking work stations based on physical pressure. Fuzzy group decision making approach allows experts to evaluate different ergonomic factors using linguistic terms such as very high, high, medium, low, very low, rather than precise numerical values. In this way, there is no need to measure parameters and evaluation can be easily made in a group. According to ergonomics much work contents and situations, accompanied with multiple parameters and uncertainties, fuzzy group decision making is the best way to evaluate such a chameleon of concept. A case study was down to utilize the approach and illustrate its application in ergonomic assessment and ranking the work stations based on work pressure and found that this approach provides flexibility, practicality, efficiency in making decision around ergonomics areas. The normalized defuzzification numbers which are resulted from this method are compared with result of quantitative assessment of Automotive Assembly Work Sheet auto, it’s demonstrated that the proposed method result is 10% less than Automotive Assembly Work Sheet, approximately.

  1. Genetic Factors of Individual Differences in Decision Making in Economic Behavior: A Japanese Twin Study using the Allais Problem

    OpenAIRE

    Shikishima, Chizuru; Hiraishi, Kai; Yamagata, Shinji; Ando, Juko; Okada, Mitsuhiro

    2015-01-01

    Why does decision making differ among individuals? People sometimes make seemingly inconsistent decisions with lower expected (monetary) utility even when objective information of probabilities and reward are provided. It is noteworthy, however, that a certain proportion of people do not provide anomalous responses, choosing the alternatives with higher expected utility, thus appearing to be more “rational.” We investigated the genetic and environmental influences on these types of individual...

  2. Cannabinoids and value-based decision making: Implications for neurodegenerative disorders

    NARCIS (Netherlands)

    Lee, AM; Oleson, E.B.; Diergaarde, L.; Cheer, J.F.; Pattij, T.

    2012-01-01

    In recent years, disturbances in cognitive function have been increasingly recognized as important symptomatic phenomena in neurodegenerative diseases, including Parkinson's disease (PD). Value-based decision making in particular is an important executive cognitive function that is not only impaired

  3. Effectiveness of a theoretically-based judgment and decision making intervention for adolescents.

    Science.gov (United States)

    Knight, Danica K; Dansereau, Donald F; Becan, Jennifer E; Rowan, Grace A; Flynn, Patrick M

    2015-05-01

    Although adolescents demonstrate capacity for rational decision making, their tendency to be impulsive, place emphasis on peers, and ignore potential consequences of their actions often translates into higher risk-taking including drug use, illegal activity, and physical harm. Problems with judgment and decision making contribute to risky behavior and are core issues for youth in treatment. Based on theoretical and empirical advances in cognitive science, the Treatment Readiness and Induction Program (TRIP) represents a curriculum-based decision making intervention that can be easily inserted into a variety of content-oriented modalities as well as administered as a separate therapeutic course. The current study examined the effectiveness of TRIP for promoting better judgment among 519 adolescents (37 % female; primarily Hispanic and Caucasian) in residential substance abuse treatment. Change over time in decision making and premeditation (i.e., thinking before acting) was compared among youth receiving standard operating practice (n = 281) versus those receiving standard practice plus TRIP (n = 238). Change in TRIP-specific content knowledge was examined among clients receiving TRIP. Premeditation improved among youth in both groups; TRIP clients showed greater improvement in decision making. TRIP clients also reported significant increases over time in self-awareness, positive-focused thinking (e.g., positive self-talk, goal setting), and recognition of the negative effects of drug use. While both genders showed significant improvement, males showed greater gains in metacognitive strategies (i.e., awareness of one's own cognitive process) and recognition of the negative effects of drug use. These results suggest that efforts to teach core thinking strategies and apply/practice them through independent intervention modules may benefit adolescents when used in conjunction with content-based programs designed to change problematic behaviors.

  4. Nurses' decision making in heart failure management based on heart failure certification status.

    Science.gov (United States)

    Albert, Nancy M; Bena, James F; Buxbaum, Denise; Martensen, Linda; Morrison, Shannon L; Prasun, Marilyn A; Stamp, Kelly D

    Research findings on the value of nurse certification were based on subjective perceptions or biased by correlations of certification status and global clinical factors. In heart failure, the value of certification is unknown. Examine the value of certification based nurses' decision-making. Cross-sectional study of nurses who completed heart failure clinical vignettes that reflected decision-making in clinical heart failure scenarios. Statistical tests included multivariable linear, logistic and proportional odds logistic regression models. Of nurses (N = 605), 29.1% were heart failure certified, 35.0% were certified in another specialty/job role and 35.9% were not certified. In multivariable modeling, nurses certified in heart failure (versus not heart failure certified) had higher clinical vignette scores (p = 0.002), reflecting higher evidence-based decision making; nurses with another specialty/role certification (versus no certification) did not (p = 0.62). Heart failure certification, but not in other specialty/job roles was associated with decisions that reflected delivery of high-quality care. Copyright © 2018 Elsevier Inc. All rights reserved.

  5. Decision Making and Cancer

    OpenAIRE

    Reyna, Valerie F.; Nelson, Wendy L.; Han, Paul K.; Pignone, Michael P.

    2015-01-01

    We review decision-making along the cancer continuum in the contemporary context of informed and shared decision making, in which patients are encouraged to take a more active role in their health care. We discuss challenges to achieving informed and shared decision making, including cognitive limitations and emotional factors, but argue that understanding the mechanisms of decision making offers hope for improving decision support. Theoretical approaches to decision making that explain cogni...

  6. A novel computer based expert decision making model for prostate cancer disease management.

    Science.gov (United States)

    Richman, Martin B; Forman, Ernest H; Bayazit, Yildirim; Einstein, Douglas B; Resnick, Martin I; Stovsky, Mark D

    2005-12-01

    We propose a strategic, computer based, prostate cancer decision making model based on the analytic hierarchy process. We developed a model that improves physician-patient joint decision making and enhances the treatment selection process by making this critical decision rational and evidence based. Two groups (patient and physician-expert) completed a clinical study comparing an initial disease management choice with the highest ranked option generated by the computer model. Participants made pairwise comparisons to derive priorities for the objectives and subobjectives related to the disease management decision. The weighted comparisons were then applied to treatment options to yield prioritized rank lists that reflect the likelihood that a given alternative will achieve the participant treatment goal. Aggregate data were evaluated by inconsistency ratio analysis and sensitivity analysis, which assessed the influence of individual objectives and subobjectives on the final rank list of treatment options. Inconsistency ratios less than 0.05 were reliably generated, indicating that judgments made within the model were mathematically rational. The aggregate prioritized list of treatment options was tabulated for the patient and physician groups with similar outcomes for the 2 groups. Analysis of the major defining objectives in the treatment selection decision demonstrated the same rank order for the patient and physician groups with cure, survival and quality of life being more important than controlling cancer, preventing major complications of treatment, preventing blood transfusion complications and limiting treatment cost. Analysis of subobjectives, including quality of life and sexual dysfunction, produced similar priority rankings for the patient and physician groups. Concordance between initial treatment choice and the highest weighted model option differed between the groups with the patient group having 59% concordance and the physician group having only 42

  7. Reward-based behaviors and emotional processing in human with narcolepsy-cataplexy

    Directory of Open Access Journals (Sweden)

    Sophie eBayard

    2013-05-01

    Full Text Available ajor advances in the past decade have led a better understanding of the pathophysiology of narcolepsy with cataplexy caused by the early loss of hypothalamic hypocretin neurons. Although a role for hypocretin in the regulation of sleep/wakefulness state is widely recognized, other functions, not necessarily related to arousal, have been identified. Hence, the hypocretin system enhances signaling in the mesolimbic pathways regulating reward processing, emotion and mood regulation, and addiction. Although studies on hypocretin-deficient mice have shown that hypocretin plays an essential role in reward-seeking, depression-like behavior and addiction, results in human narcolepsy remained subject to debate. Most of studies revealed that hypocretin-deficient narcolepsy patients either drug-free or medicated with psychostimulant had preferences towards risky choices in a decision-making task under ambiguity together with higher frequency of depressive symptoms and binge eating disorder compared to controls. However, human studies mostly reported the lack of association with pathological impulsivity and gambling, and substance and alcohol abuse in the context of narcolepsy-cataplexy. Prospective larger studies are required to confirm these findings in drug-free and medicated patients with narcolepsy. Inclusion of patients with other central hypersomnias without hypocretin deficiency will provide answer to the major question of the role of the hypocretin system in reward-based behaviors and emotional processing in humans.

  8. Data-based decision making for instructional improvement in primary education

    NARCIS (Netherlands)

    Gelderblom, Gerrit; Schildkamp, Kim; Pieters, Julius Marie; Ehren, Melanie Catharina Margaretha

    2016-01-01

    Data-based decision making can help teachers improve their instruction. Research shows that instruction has a strong impact on students' learning outcomes. This study investigates whether Dutch primary school teachers use data to improve their instruction. Four aspects of instruction were

  9. The anatomy of choice: dopamine and decision-making.

    Science.gov (United States)

    Friston, Karl; Schwartenbeck, Philipp; FitzGerald, Thomas; Moutoussis, Michael; Behrens, Timothy; Dolan, Raymond J

    2014-11-05

    This paper considers goal-directed decision-making in terms of embodied or active inference. We associate bounded rationality with approximate Bayesian inference that optimizes a free energy bound on model evidence. Several constructs such as expected utility, exploration or novelty bonuses, softmax choice rules and optimism bias emerge as natural consequences of free energy minimization. Previous accounts of active inference have focused on predictive coding. In this paper, we consider variational Bayes as a scheme that the brain might use for approximate Bayesian inference. This scheme provides formal constraints on the computational anatomy of inference and action, which appear to be remarkably consistent with neuroanatomy. Active inference contextualizes optimal decision theory within embodied inference, where goals become prior beliefs. For example, expected utility theory emerges as a special case of free energy minimization, where the sensitivity or inverse temperature (associated with softmax functions and quantal response equilibria) has a unique and Bayes-optimal solution. Crucially, this sensitivity corresponds to the precision of beliefs about behaviour. The changes in precision during variational updates are remarkably reminiscent of empirical dopaminergic responses-and they may provide a new perspective on the role of dopamine in assimilating reward prediction errors to optimize decision-making.

  10. Iowa pavement asset management decision-making framework.

    Science.gov (United States)

    2015-10-01

    Most local agencies in Iowa currently make their pavement treatment decisions based on their limited experience due primarily to : lack of a systematic decision-making framework and a decision-aid tool. The lack of objective condition assessment data...

  11. Functional brain networks involved in decision-making under certain and uncertain conditions

    Energy Technology Data Exchange (ETDEWEB)

    Farrar, Danielle C.; Moss, Mark B.; Killiany, Ronald J. [Boston University School of Medicine, Department of Anatomy and Neurobiology, Boston, MA (United States); Mian, Asim Z. [Boston University School of Medicine, Department of Radiology, Boston, MA (United States); Budson, Andrew E. [VA Boston Healthcare System, Boston, MA (United States)

    2018-01-15

    The aim of this study was to describe imaging markers of decision-making under uncertain conditions in normal individuals, in order to provide baseline activity to compare to impaired decision-making in pathological states. In this cross-sectional study, 19 healthy subjects ages 18-35 completed a novel decision-making card-matching task using a Phillips T3 Scanner and a 32-channel head coil. Functional data were collected in six functional runs. In one condition of the task, the participant was certain of the rule to apply to match the cards; in the other condition, the participant was uncertain. We performed cluster-based comparison of the two conditions using FSL fMRI Expert Analysis Tool and network-based analysis using MATLAB. The uncertain > certain comparison yielded three clusters - a midline cluster that extended through the midbrain, the thalamus, bilateral prefrontal cortex, the striatum, and bilateral parietal/occipital clusters. The certain > uncertain comparison yielded bilateral clusters in the insula, parietal and temporal lobe, as well as a medial frontal cluster. A larger, more connected functional network was found in the uncertain condition. The involvement of the insula, parietal cortex, temporal cortex, ventromedial prefrontal cortex, and orbitofrontal cortex of the certain condition reinforces the notion that certainty is inherently rewarding. For the uncertain condition, the involvement of the prefrontal cortex, parietal cortex, striatum, thalamus, amygdala, and hippocampal involvement was expected, as these are areas involved in resolving uncertainty and rule updating. The involvement of occipital cortical involvement and midbrain involvement may be attributed to increased visual attention and increased motor control. (orig.)

  12. Embodied Feeling and Reason in Decision-Making: Assessing the Somatic-Marker Hypothesis

    Directory of Open Access Journals (Sweden)

    Warren TenHouten

    2016-04-01

    Full Text Available Whether or not reason and affect are complementary depends on the task at hand. In ordinary circumstances, problemsolving and decision-making involve both somatic feelings and limbic-structure-based emotions. Feelings, experienced as states of the body, can contribute to decision-making by triggering heuristic cues and rapidly eliminating negative behavioral alternatives, in part by providing what Damasio call somatic markers (Damasio, Tranel and Damasio, 1991; Damasio, 1994, 1999, 2003. However, if task-performance is motivated by potentially large rewards, with high demands on short-term memory and on concentration, the dorsolateral prefrontal cortexcan inhibit affects manifested in the medial prefrontal cortex in order to carry out the necessary cognitive operations. We interpret these two different mental task situations using dual process models. Although experimental evidence from studies of normal subjects and frontal-lobe-damaged patients performing the Iowa Gambling Task has been interpreted as supportive of the somatic-marker hypothesis (SMH, we show that this evidence has been called into question due to faulty study designs. However, studies of normal and psychopathic subjects playing the ultimatum game show that pulse-rate deceleration occurring during the brief period preceding decision-making constitutes a somatic marker. Compared to normal controls, psychopaths show less somatic (electro dermal activity and act with cool, economic rationality, accepting unfair (<50/50 offers that normal subjects reject on the basis of non-economic values of fairness. The somatic-marker hypothesis is discussed and criticized, and various theories based on this hypothesis are identified.

  13. Functional brain networks involved in decision-making under certain and uncertain conditions

    International Nuclear Information System (INIS)

    Farrar, Danielle C.; Moss, Mark B.; Killiany, Ronald J.; Mian, Asim Z.; Budson, Andrew E.

    2018-01-01

    The aim of this study was to describe imaging markers of decision-making under uncertain conditions in normal individuals, in order to provide baseline activity to compare to impaired decision-making in pathological states. In this cross-sectional study, 19 healthy subjects ages 18-35 completed a novel decision-making card-matching task using a Phillips T3 Scanner and a 32-channel head coil. Functional data were collected in six functional runs. In one condition of the task, the participant was certain of the rule to apply to match the cards; in the other condition, the participant was uncertain. We performed cluster-based comparison of the two conditions using FSL fMRI Expert Analysis Tool and network-based analysis using MATLAB. The uncertain > certain comparison yielded three clusters - a midline cluster that extended through the midbrain, the thalamus, bilateral prefrontal cortex, the striatum, and bilateral parietal/occipital clusters. The certain > uncertain comparison yielded bilateral clusters in the insula, parietal and temporal lobe, as well as a medial frontal cluster. A larger, more connected functional network was found in the uncertain condition. The involvement of the insula, parietal cortex, temporal cortex, ventromedial prefrontal cortex, and orbitofrontal cortex of the certain condition reinforces the notion that certainty is inherently rewarding. For the uncertain condition, the involvement of the prefrontal cortex, parietal cortex, striatum, thalamus, amygdala, and hippocampal involvement was expected, as these are areas involved in resolving uncertainty and rule updating. The involvement of occipital cortical involvement and midbrain involvement may be attributed to increased visual attention and increased motor control. (orig.)

  14. Assessing Affective and Deliberative Decision-Making: Adaptation of the Columbia Card Task to Brazilian Portuguese.

    Science.gov (United States)

    Kluwe-Schiavon, Bruno; Sanvicente-Vieira, Breno; Viola, Thiago W; Veiga, Eduardo; Bortolotto, Vanessa; Grassi-Oliveira, Rodrigo

    2015-11-20

    The ability to predict reward and punishment is essential for decision-making and the ability to learn about an ever-changing environment. Therefore, efforts have been made in understanding the mechanisms underlying decision-making, especially regarding how affective and deliberative processes interact with risk behavior. To adapt to Brazilian Portuguese the Columbia Card Task (CCT) and investigate affective and deliberative processes involved in decision-making. This study had two main phases: (1) a transcultural adaptation and (2) a pilot study. The feedback manipulation among the three conditions of CCT had an effect on the risk-taking level (p accounting for 17% of the variance. The Brazilian CCT performs well and is a versatile method for the assessment of affective and deliberative decision-making under risk according to different feedback manipulation scenarios. This study goes further, comparing electrodermal activity during hot and warm conditions and addressing an advantageous level index analysis to asses deliberative processing.

  15. Sensitivity to cognitive effort mediates psychostimulant effects on a novel rodent cost/benefit decision-making task.

    Science.gov (United States)

    Cocker, Paul J; Hosking, Jay G; Benoit, James; Winstanley, Catharine A

    2012-07-01

    Amotivational states and insufficient recruitment of mental effort have been observed in a variety of clinical populations, including depression, traumatic brain injury, post-traumatic stress disorder, and attention deficit hyperactivity disorder. Previous rodent models of effort-based decision making have utilized physical costs whereas human studies of effort are primarily cognitive in nature, and it is unclear whether the two types of effortful decision making are underpinned by the same neurobiological processes. We therefore designed a novel rat cognitive effort task (rCET) based on the 5-choice serial reaction time task, a well-validated measure of attention and impulsivity. Within each trial of the rCET, rats are given the choice between an easy or hard visuospatial discrimination, and successful hard trials are rewarded with double the number of sugar pellets. Similar to previous human studies, stable individual variation in choice behavior was observed, with 'workers' choosing hard trials significantly more than their 'slacker' counterparts. Whereas workers 'slacked off' in response to administration of amphetamine and caffeine, slackers 'worked harder' under amphetamine, but not caffeine. Conversely, these stimulants increased motor impulsivity in all animals. Ethanol did not affect animals' choice but invigorated behavior. In sum, we have shown for the first time that rats are differentially sensitive to cognitive effort when making decisions, independent of other processes such as impulsivity, and these baseline differences can influence the cognitive response to psychostimulants. Such findings could inform our understanding of impairments in effort-based decision making and contribute to treatment development.

  16. Consumer Decision-Making Styles Extension to Trust-Based Product Comparison Site Usage Model

    Directory of Open Access Journals (Sweden)

    Radoslaw Macik

    2016-09-01

    Full Text Available The paper describes an implementation of extended consumer decision-making styles concept in explaining consumer choices made in product comparison site environment in the context of trust-based information technology acceptance model. Previous research proved that trust-based acceptance model is useful in explaining purchase intention and anticipated satisfaction in product comparison site environment, as an example of online decision shopping aids. Trust to such aids is important in explaining their usage by consumers. The connections between consumer decision-making styles, product and sellers opinions usage, cognitive and affective trust toward online product comparison site, as well as choice outcomes (purchase intention and brand choice are explored trough structural equation models using PLS-SEM approach, using a sample of 461 young consumers. Research confirmed the validity of research model in explaining product comparison usage, and some consumer decision-making styles influenced consumers’ choices and purchase intention. Product and sellers reviews usage were partially mediating mentioned relationships.

  17. Financing Target and Resale Pricing in Reward-Based Crowdfunding

    Directory of Open Access Journals (Sweden)

    Lei Xu

    2018-04-01

    Full Text Available Resale is an effective tool for reward-based crowdfunding creators to make more profit after crowdfunding successfully. On the one hand, funds raised during the crowdfunding affect the resale pricing as a capital constraint; on the other hand, backers’ strategic purchasing behavior in the resale stage can also disturb the creator’s financing target decision-making through affecting resale pricing. In view of this, this paper builds a two-stage crowdfunding model to examine the interaction between the financing target and resale pricing in the presence of strategic backers. The results show that a lower financing amount leads to higher prices in the resale stage due to the rationing effect, and suppresses price volatility due to strategic purchasing behavior. In contrast, a higher financing amount enables the creator to build a large capacity, which does not restrict the resale prices and profit. Besides, in the context of high unit production cost or high backer patience level, there is no need for the creator to set a high financing target at the risk of crowdfunding failure.

  18. Use of evidence-based management in healthcare administration decision-making.

    Science.gov (United States)

    Guo, Ruiling; Berkshire, Steven D; Fulton, Lawrence V; Hermanson, Patrick M

    2017-07-03

    Purpose The purpose of this paper is to examine whether healthcare leaders use evidence-based management (EBMgt) when facing major decisions and what types of evidence healthcare administrators consult during their decision-making. This study also intends to identify any relationship that might exist among adoption of EBMgt in healthcare management, attitudes towards EBMgt, demographic characteristics and organizational characteristics. Design/methodology/approach A cross-sectional study was conducted among US healthcare leaders. Spearman's correlation and logistic regression were performed using the Statistical Package for the Social Sciences (SPSS) 23.0. Findings One hundred and fifty-four healthcare leaders completed the survey. The study results indicated that 90 per cent of the participants self-reported having used an EBMgt approach for decision-making. Professional experiences (87 per cent), organizational data (84 per cent) and stakeholders' values (63 per cent) were the top three types of evidence consulted daily and weekly for decision-making. Case study (75 per cent) and scientific research findings (75 per cent) were the top two types of evidence consulted monthly or less than once a month. An exploratory, stepwise logistic regression model correctly classified 75.3 per cent of all observations for a dichotomous "use of EBMgt" response variable using three independent variables: attitude towards EBMgt, number of employees in the organization and the job position. Spearman's correlation indicated statistically significant relationships between healthcare leaders' use of EBMgt and healthcare organization bed size ( r s = 0.217, n = 152, p employees ( r s = 0.195, n = 152, p = 0.016). Originality/value This study generated new research findings on the practice of EBMgt in US healthcare administration decision-making.

  19. Complex Decision Making Theory and Practice

    CERN Document Server

    Qudrat-Ullah, Hassan; Spector, J Michael

    2007-01-01

    The increasingly complex environment of today's world, characterized by technological innovation and global communication, generates myriads of possible and actual interactions while limited physical and intellectual resources severely impinge on decision makers, be it in the public or private domains. At the core of the decision-making process is the need for quality information that allows the decision maker to better assess the impact of decisions in terms of outcomes, nonlinear feedback processes and time delays on the performance of the complex system invoked. This volume is a timely review on the principles underlying complex decision making, the handling of uncertainties in dynamic envrionments and of the various modeling approaches used. The book consists of five parts, each composed of several chapters: I: Complex Decision Making: Concepts, Theories and Empirical Evidence II: Tools and Techniques for Decision Making in Complex Environments and Systems III: System Dynamics and Agent-Based Modeling IV:...

  20. Strategic decision making

    OpenAIRE

    Stokman, Frans N.; Assen, Marcel A.L.M. van; Knoop, Jelle van der; Oosten, Reinier C.H. van

    2000-01-01

    This paper introduces a methodology for strategic intervention in collective decision making.The methodology is based on (1) a decomposition of the problem into a few main controversial issues, (2) systematic interviews of subject area specialists to obtain a specification of the decision setting,consisting of a list of stakeholders with their capabilities, positions, and salience on each of the issues; (3) computer simulation. The computer simulation models incorporate only the main processe...

  1. Agent-based Decision Support System for the Third Generation Distributed Dynamic Decision-making (DDD-III) Simulator

    National Research Council Canada - National Science Library

    Meirina, Candra; Ruan, Sui; Yu, Feili; Zhu, Liang; Pattipati, Krishna R; Kleinman, David L

    2004-01-01

    ...) based on the third-generation distributed dynamic decision-making (DDD-III) simulator and contingency theory to increase the organizational cognitive capacity and to facilitate the processes of adaptation...

  2. New Multi-Criteria Group Decision-Making Method Based on Vague Set Theory

    OpenAIRE

    Kuo-Sui Lin

    2016-01-01

    In light of the deficiencies and limitations for existing score functions, Lin has proposed a more effective and reasonable new score function for measuring vague values. By using Lin’s score function and a new weighted aggregation score function, an algorithm for multi-criteria group decision-making method was proposed to solve vague set based group decision-making problems under vague environments. Finally, a numerical example was illustrated to show the effectiveness of the proposed multi-...

  3. High reward makes items easier to remember, but harder to bind to a new temporal context

    Directory of Open Access Journals (Sweden)

    Christopher R Madan

    2012-08-01

    Full Text Available Learning through reward is central to adaptive behaviour. Indeed, items are remembered better if they are experienced while participants expect a reward, and people can deliberately prioritize memory for high- over low-valued items. Do memory advantages for high-valued items only emerge after deliberate prioritization in encoding? Or, do reward-based memory enhancements also apply to unrewarded memory tests and to implicit memory? First, we tested for a high-value memory advantage in unrewarded implicit and explicit tests (Exp 1. Participants first learned high or low reward values of 36 words, followed by unrewarded lexical decision and free recall tests. High-value words were judged faster in lexical decision, and more often recalled in free recall. These two memory advantages for high-value words were negatively correlated suggesting at least two mechanisms by which reward value can influence later item-memorability. The ease at which the values were originally acquired explained the negative correlation: People who learned values earlier showed reward effects in implicit memory while people who learned values later showed reward effects in explicit memory. We then asked whether a high-value advantage would persist if trained items were linked to a new context (Exps 2a,b. Following the same value training as in Exp 1, participants learned lists composed of previously trained words mixed with new words, each followed by free recall. Thus, participants had to retrieve words only from the most recent list, irrespective of their values. High- and low-value words were recalled equally, but low-value words were recalled earlier than high-value words and high-value words were more often intruded (proactive interference. Thus, the high-value advantage holds for implicit and explicit memory, but comes with a side effect: High-value items are more difficult to relearn in a new context. Similar to emotional arousal, reward value can both enhance and

  4. Categorization = Decision Making + Generalization

    Science.gov (United States)

    Seger, Carol A; Peterson, Erik J.

    2013-01-01

    We rarely, if ever, repeatedly encounter exactly the same situation. This makes generalization crucial for real world decision making. We argue that categorization, the study of generalizable representations, is a type of decision making, and that categorization learning research would benefit from approaches developed to study the neuroscience of decision making. Similarly, methods developed to examine generalization and learning within the field of categorization may enhance decision making research. We first discuss perceptual information processing and integration, with an emphasis on accumulator models. We then examine learning the value of different decision making choices via experience, emphasizing reinforcement learning modeling approaches. Next we discuss how value is combined with other factors in decision making, emphasizing the effects of uncertainty. Finally, we describe how a final decision is selected via thresholding processes implemented by the basal ganglia and related regions. We also consider how memory related functions in the hippocampus may be integrated with decision making mechanisms and contribute to categorization. PMID:23548891

  5. Neural Correlates of Feedback Processing in Decision Making under Risk

    Directory of Open Access Journals (Sweden)

    Beate eSchuermann

    2012-07-01

    Full Text Available Introduction. Event-related brain potentials (ERP provide important information about the sensitivity of the brain to process varying risks. The aim of the present study was to determine how different risk levels are reflected in decision-related ERPs, namely the feedback-related negativity (FRN and the P300. Material and Methods. 20 participants conducted a probabilistic two-choice gambling task while an electroencephalogram was recorded. Choices were provided between a low-risk option yielding low rewards and low losses and a high-risk option yielding high rewards and high losses. While options differed in expected risks, they were equal in expected values and in feedback probabilities. Results. At the behavioral level, participants were generally risk-averse but modulated their risk-taking behavior according to reward history. An early positivity (P200 was enhanced on negative feedbacks in high-risk compared to low-risk options. With regard to the FRN, there were significant amplitude differences between positive and negative feedbacks in high-risk options, but not in low-risk options. While the FRN on negative feedbacks did not vary with decision riskiness, reduced amplitudes were found for positive feedbacks in high-risk relative to low-risk choices. P300 amplitudes were larger in high-risk decisions, and in an additive way, after negative compared to positive feedback. Discussion. The present study revealed significant influences of risk and valence processing on ERPs. FRN findings suggest that the reward prediction error signal is increased after high-risk decisions. The increased P200 on negative feedback in risky decisions suggests that large negative prediction errors are processed as early as in the P200 time range. The later P300 amplitude is sensitive to feedback valence as well as to the risk of a decision. Thus, the P300 carries additional information for reward processing, mainly the enhanced motivational significance of risky

  6. An agent-based model for integrated emotion regulation and contagion in socially affected decision making

    OpenAIRE

    Manzoor, A.; Treur, J.

    2015-01-01

    This paper addresses an agent-based computational social agent model for the integration of emotion regulation, emotion contagion and decision making in a social context. The model integrates emotion-related valuing, in order to analyse the role of emotions in socially affected decision making. The agent-based model is illustrated for the interaction between two persons. Simulation experiments for different kinds of scenarios help to understand how decisions can be affected by regulating the ...

  7. Expected Utility Based Decision Making under Z-Information and Its Application.

    Science.gov (United States)

    Aliev, Rashad R; Mraiziq, Derar Atallah Talal; Huseynov, Oleg H

    2015-01-01

    Real-world decision relevant information is often partially reliable. The reasons are partial reliability of the source of information, misperceptions, psychological biases, incompetence, and so forth. Z-numbers based formalization of information (Z-information) represents a natural language (NL) based value of a variable of interest in line with the related NL based reliability. What is important is that Z-information not only is the most general representation of real-world imperfect information but also has the highest descriptive power from human perception point of view as compared to fuzzy number. In this study, we present an approach to decision making under Z-information based on direct computation over Z-numbers. This approach utilizes expected utility paradigm and is applied to a benchmark decision problem in the field of economics.

  8. A new web-based framework development for fuzzy multi-criteria group decision-making.

    Science.gov (United States)

    Hanine, Mohamed; Boutkhoum, Omar; Tikniouine, Abdessadek; Agouti, Tarik

    2016-01-01

    Fuzzy multi-criteria group decision making (FMCGDM) process is usually used when a group of decision-makers faces imprecise data or linguistic variables to solve the problems. However, this process contains many methods that require many time-consuming calculations depending on the number of criteria, alternatives and decision-makers in order to reach the optimal solution. In this study, a web-based FMCGDM framework that offers decision-makers a fast and reliable response service is proposed. The proposed framework includes commonly used tools for multi-criteria decision-making problems such as fuzzy Delphi, fuzzy AHP and fuzzy TOPSIS methods. The integration of these methods enables taking advantages of the strengths and complements each method's weakness. Finally, a case study of location selection for landfill waste in Morocco is performed to demonstrate how this framework can facilitate decision-making process. The results demonstrate that the proposed framework can successfully accomplish the goal of this study.

  9. Internet use and decision making in community-based older adults

    Directory of Open Access Journals (Sweden)

    Bryan David James

    2013-09-01

    Full Text Available Use of the internet may provide tools and resources for better decision making, yet little is known about the association of internet use with decision-making in older persons. We examined this relationship in 66190 community-dwelling older persons without dementia from the Rush Memory and Aging Project, an ongoing longitudinal study of aging. Participants were asked to report if they had access to the internet and how frequently they used the internet and email. A 12-item instrument was used to assess financial and healthcare decision making using materials designed to approximate those used in real world settings. Items were summed to yield a total decision-making score. Associations were tested via linear regression models adjusted for age, sex, race, education, and a measure of global cognitive function. Secondary models further adjusted for income, depression, loneliness, social networks, social support, chronic medical conditions, instrumental activities of daily living, life space size, and health and financial literacy. Interaction terms were used to test for effect modification. Almost 70% of participants had access to the internet, and of those with access, 55% used the internet at least several times a week. Higher frequency of internet use was associated with better financial and healthcare decision making (β=0.11, p=0.002. The association persisted in a fully adjusted model (β=0.08, p=0.024. Interaction models indicated that higher frequency of internet use attenuated the relationships of older age, poorer cognitive function, and lower levels of health and financial literacy with poorer healthcare and financial decision making. These findings indicate that internet use is associated with better health and financial decision making in older persons. Future research is required to understand whether promoting the use of the internet can produce improvements in healthcare and financial decision making.

  10. Non-clinical influences on clinical decision-making: a major challenge to evidence-based practice.

    Science.gov (United States)

    Hajjaj, F M; Salek, M S; Basra, M K A; Finlay, A Y

    2010-05-01

    This article reviews an aspect of daily clinical practice which is of critical importance in virtually every clinical consultation, but which is seldom formally considered. Non-clinical influences on clinical decision-making profoundly affect medical decisions. These influences include patient-related factors such as socioeconomic status, quality of life and patient's expectations and wishes, physician-related factors such as personal characteristics and interaction with their professional community, and features of clinical practice such as private versus public practice as well as local management policies. This review brings together the different strands of knowledge concerning non-clinical influences on clinical decision-making. This aspect of decision-making may be the biggest obstacle to the reality of practising evidence-based medicine. It needs to be understood in order to develop clinical strategies that will facilitate the practice of evidence-based medicine.

  11. Executive functions and risky decision-making in patients with opiate dependence.

    Science.gov (United States)

    Brand, Matthias; Roth-Bauer, Martina; Driessen, Martin; Markowitsch, Hans J

    2008-09-01

    Recent evidence suggests that individuals with opiate dependence may have cognitive dysfunctions particularly within the spectrum of executive functioning and emotional processing. Such dysfunctions can also compromise daily decisions associated with risk-taking behaviors. However, it remains unclear whether patients addicted to opiates show impaired decision-making on gambling tasks that specify explicit rules for rewards and punishments and provide information about probabilities associated with different long-term outcomes. In this study, we examined 18 individuals with opiate dependence and 18 healthy comparison subjects, matched for age, gender, and education with the Game of Dice Task (GDT). The GDT is a gambling task with explicit rules for gains and losses and fix winning probabilities. In addition, all subjects completed a neuropsychological test battery that primarily focused on executive functions and a personality questionnaire. On the GDT, patients chose the risky alternatives more frequently than the control group. Patients' GDT performance was related to executive functioning but not to other neuropsychological constructs, personality or dependence specific variables with one exception that is the number of days of abstinence. Thus, patients with opiate dependence demonstrate abnormalities in decision-making that might be neuropsychologically associated with dysfunctional behavior in patients' daily lives. Decision-making and other neuropsychological functioning should be considered in the treatment of opiate dependence.

  12. Data-Based Decision Making in Teams: Enablers and Barriers

    Science.gov (United States)

    Bolhuis, Erik; Schildkamp, Kim; Voogt, Joke

    2016-01-01

    Data use is becoming more important in higher education. In this case study, a team of teachers from a teacher education college was supported in data-based decision making by means of the data team procedure. This data team studied the reasons why students drop out. A team's success depends in part on whether the team is able to develop and apply…

  13. Decision-making deficits in pathological gambling: the role of executive functions, explicit knowledge and impulsivity in relation to decisions made under ambiguity and risk.

    Science.gov (United States)

    Ochoa, Cristian; Alvarez-Moya, Eva M; Penelo, Eva; Aymami, M Neus; Gómez-Peña, Mónica; Fernández-Aranda, Fernando; Granero, Roser; Vallejo-Ruiloba, Julio; Menchón, José Manuel; Lawrence, Natalia S; Jiménez-Murcia, Susana

    2013-01-01

    A variety of cognitive and emotional processes influence the decision-making deficits observed in pathological gambling (PG). This study investigated the role of immediate/delayed sensitivity to reward and punishment, executive functions, impulsivity and explicit knowledge in relation to decision-making performance on the original Iowa Gambling Task (IGT-ABCD) and a variant (IGT-EFGH). We assessed 131 consecutive patients with a diagnosis of PG by using executive functioning and decision-making tasks, self-report measures of impulsivity and explicit knowledge. The majority of pathological gamblers (PGs) showed deficits in decision-making, characterized mainly by myopia for the future. Decisions made under risk showed different predictors. Performance on the IGT-ABCD for decisions made under risk was predicted by medium and high levels of explicit knowledge of the task, as well as by scores on the Disorderliness subscale and the degree of Stroop interference. By contrast, IGT-EFGH results were only associated with self-report impulsivity measures. Decision making in PG involves distinct patterns of deficits, and the predictors differ depending on the reinforcement schedule. Decisions made under risk on the IGT-ABCD are associated with explicit knowledge, executive functions and impulsivity traits related to conscious awareness and control processes. On the IGT-EFGH, however, only impulsivity traits predict decision making. Copyright © American Academy of Addiction Psychiatry.

  14. A Review of the Impacts of Different Approaches for Diabetes Prevention and a Framework for Making Investment Decisions

    Directory of Open Access Journals (Sweden)

    Maria L. Alva

    2018-03-01

    Full Text Available This paper selectively reviews the economic research on individual (i.e., diabetes prevention programs and financial rewards for weight loss and population-wide based diabetes prevention interventions (such as food taxes, nutritional labeling, and worksite wellness programs that demonstrate a direct reduction in diabetes incidence or improvements in diabetes risk factors such as weight, glucose or glycated hemoglobin. The paper suggests a framework to guide decision makers on how to use the available evidence to determine the optimal allocation of resources across population-wide and individual-based interventions. This framework should also assist in the discussion of what parameters are needed from research to inform decision-making on what might be the optimal mix of strategies to reduce diabetes prevalence.

  15. A Review of the Impacts of Different Approaches for Diabetes Prevention and a Framework for Making Investment Decisions.

    Science.gov (United States)

    Alva, Maria L

    2018-03-15

    This paper selectively reviews the economic research on individual (i.e., diabetes prevention programs and financial rewards for weight loss) and population-wide based diabetes prevention interventions (such as food taxes, nutritional labeling, and worksite wellness programs) that demonstrate a direct reduction in diabetes incidence or improvements in diabetes risk factors such as weight, glucose or glycated hemoglobin. The paper suggests a framework to guide decision makers on how to use the available evidence to determine the optimal allocation of resources across population-wide and individual-based interventions. This framework should also assist in the discussion of what parameters are needed from research to inform decision-making on what might be the optimal mix of strategies to reduce diabetes prevalence.

  16. Intergroup conflict and rational decision making.

    Science.gov (United States)

    Martínez-Tur, Vicente; Peñarroja, Vicente; Serrano, Miguel A; Hidalgo, Vanesa; Moliner, Carolina; Salvador, Alicia; Alacreu-Crespo, Adrián; Gracia, Esther; Molina, Agustín

    2014-01-01

    The literature has been relatively silent about post-conflict processes. However, understanding the way humans deal with post-conflict situations is a challenge in our societies. With this in mind, we focus the present study on the rationality of cooperative decision making after an intergroup conflict, i.e., the extent to which groups take advantage of post-conflict situations to obtain benefits from collaborating with the other group involved in the conflict. Based on dual-process theories of thinking and affect heuristic, we propose that intergroup conflict hinders the rationality of cooperative decision making. We also hypothesize that this rationality improves when groups are involved in an in-group deliberative discussion. Results of a laboratory experiment support the idea that intergroup conflict -associated with indicators of the activation of negative feelings (negative affect state and heart rate)- has a negative effect on the aforementioned rationality over time and on both group and individual decision making. Although intergroup conflict leads to sub-optimal decision making, rationality improves when groups and individuals subjected to intergroup conflict make decisions after an in-group deliberative discussion. Additionally, the increased rationality of the group decision making after the deliberative discussion is transferred to subsequent individual decision making.

  17. Intergroup Conflict and Rational Decision Making

    Science.gov (United States)

    Martínez-Tur, Vicente; Peñarroja, Vicente; Serrano, Miguel A.; Hidalgo, Vanesa; Moliner, Carolina; Salvador, Alicia; Alacreu-Crespo, Adrián; Gracia, Esther; Molina, Agustín

    2014-01-01

    The literature has been relatively silent about post-conflict processes. However, understanding the way humans deal with post-conflict situations is a challenge in our societies. With this in mind, we focus the present study on the rationality of cooperative decision making after an intergroup conflict, i.e., the extent to which groups take advantage of post-conflict situations to obtain benefits from collaborating with the other group involved in the conflict. Based on dual-process theories of thinking and affect heuristic, we propose that intergroup conflict hinders the rationality of cooperative decision making. We also hypothesize that this rationality improves when groups are involved in an in-group deliberative discussion. Results of a laboratory experiment support the idea that intergroup conflict –associated with indicators of the activation of negative feelings (negative affect state and heart rate)– has a negative effect on the aforementioned rationality over time and on both group and individual decision making. Although intergroup conflict leads to sub-optimal decision making, rationality improves when groups and individuals subjected to intergroup conflict make decisions after an in-group deliberative discussion. Additionally, the increased rationality of the group decision making after the deliberative discussion is transferred to subsequent individual decision making. PMID:25461384

  18. Intergroup conflict and rational decision making.

    Directory of Open Access Journals (Sweden)

    Vicente Martínez-Tur

    Full Text Available The literature has been relatively silent about post-conflict processes. However, understanding the way humans deal with post-conflict situations is a challenge in our societies. With this in mind, we focus the present study on the rationality of cooperative decision making after an intergroup conflict, i.e., the extent to which groups take advantage of post-conflict situations to obtain benefits from collaborating with the other group involved in the conflict. Based on dual-process theories of thinking and affect heuristic, we propose that intergroup conflict hinders the rationality of cooperative decision making. We also hypothesize that this rationality improves when groups are involved in an in-group deliberative discussion. Results of a laboratory experiment support the idea that intergroup conflict -associated with indicators of the activation of negative feelings (negative affect state and heart rate- has a negative effect on the aforementioned rationality over time and on both group and individual decision making. Although intergroup conflict leads to sub-optimal decision making, rationality improves when groups and individuals subjected to intergroup conflict make decisions after an in-group deliberative discussion. Additionally, the increased rationality of the group decision making after the deliberative discussion is transferred to subsequent individual decision making.

  19. Apathy and Emotion-Based Decision-Making in Amnesic Mild Cognitive Impairment and Alzheimer’s Disease

    Directory of Open Access Journals (Sweden)

    Sophie Bayard

    2014-01-01

    Full Text Available Background. Apathy and reduced emotion-based decision-making are two behavioral modifications independently described in Alzheimer’s disease (AD and amnestic mild cognitive impairment (aMCI. Objectives. The aims of this study were to investigate decision-making based on emotional feedback processing in AD and aMCI and to study the impact of reduced decision-making performances on apathy. Methods. We recruited 20 patients with AD, 20 participants with aMCI, and 20 healthy controls. All participants completed the Lille apathy rating scale (LARS and the Iowa gambling task (IGT. Results. Both aMCI and AD participants had reduced performances on the IGT and were more apathetic compared to controls without any difference between aMCI and AD groups. For the entire sample, LARS initiation dimension was related to IGT disadvantageous decision-making profile. Conclusions. We provide the first study showing that both aMCI and AD individuals make less profitable decisions than controls, whereas aMCI and AD did not differ. Disadvantageous decision-making profile on the IGT was associated with higher level of apathy on the action initiation dimension. The role of an abnormal IGT performance as a risk factor for the development of apathy needs to be investigated in other clinical populations and in normal aging.

  20. Heuristic and optimal policy computations in the human brain during sequential decision-making.

    Science.gov (United States)

    Korn, Christoph W; Bach, Dominik R

    2018-01-23

    Optimal decisions across extended time horizons require value calculations over multiple probabilistic future states. Humans may circumvent such complex computations by resorting to easy-to-compute heuristics that approximate optimal solutions. To probe the potential interplay between heuristic and optimal computations, we develop a novel sequential decision-making task, framed as virtual foraging in which participants have to avoid virtual starvation. Rewards depend only on final outcomes over five-trial blocks, necessitating planning over five sequential decisions and probabilistic outcomes. Here, we report model comparisons demonstrating that participants primarily rely on the best available heuristic but also use the normatively optimal policy. FMRI signals in medial prefrontal cortex (MPFC) relate to heuristic and optimal policies and associated choice uncertainties. Crucially, reaction times and dorsal MPFC activity scale with discrepancies between heuristic and optimal policies. Thus, sequential decision-making in humans may emerge from integration between heuristic and optimal policies, implemented by controllers in MPFC.

  1. Constraints on decision making: implications from genetics, personality, and addiction.

    Science.gov (United States)

    Baker, Travis E; Stockwell, Tim; Holroyd, Clay B

    2013-09-01

    An influential neurocomputational theory of the biological mechanisms of decision making, the "basal ganglia go/no-go model," holds that individual variability in decision making is determined by differences in the makeup of a striatal system for approach and avoidance learning. The model has been tested empirically with the probabilistic selection task (PST), which determines whether individuals learn better from positive or negative feedback. In accordance with the model, in the present study we examined whether an individual's ability to learn from positive and negative reinforcement can be predicted by genetic factors related to the midbrain dopamine system. We also asked whether psychiatric and personality factors related to substance dependence and dopamine affect PST performance. Although we found characteristics that predicted individual differences in approach versus avoidance learning, these observations were qualified by additional findings that appear inconsistent with the predictions of the go/no-go model. These results highlight a need for future research to validate the PST as a measure of basal ganglia reward learning.

  2. A communication model of shared decision making: accounting for cancer treatment decisions.

    Science.gov (United States)

    Siminoff, Laura A; Step, Mary M

    2005-07-01

    The authors present a communication model of shared decision making (CMSDM) that explicitly identifies the communication process as the vehicle for decision making in cancer treatment. In this view, decision making is necessarily a sociocommunicative process whereby people enter into a relationship, exchange information, establish preferences, and choose a course of action. The model derives from contemporary notions of behavioral decision making and ethical conceptions of the doctor-patient relationship. This article briefly reviews the theoretical approaches to decision making, notes deficiencies, and embeds a more socially based process into the dynamics of the physician-patient relationship, focusing on cancer treatment decisions. In the CMSDM, decisions depend on (a) antecedent factors that have potential to influence communication, (b) jointly constructed communication climate, and (c) treatment preferences established by the physician and the patient.

  3. Decision making in patients with temporal lobe epilepsy.

    Science.gov (United States)

    Labudda, Kirsten; Frigge, Kristina; Horstmann, Simone; Aengenendt, Joerg; Woermann, Friedrich G; Ebner, Alois; Markowitsch, Hans J; Brand, Matthias

    2009-01-01

    The mesiotemporal lobe is involved in decision making processes because bilateral amygdala damage can cause impairments in decision making that is mainly based on the processing of emotional feedback. In addition to executive functions, previous studies have suggested the involvement of feedback processing in decision making under risk when explicit information about consequences and their probabilities is provided. In the current study, we investigated whether unilateral mesiotemporal damage, comprising of the hippocampus and/or the amygdala, results in alterations of both kinds of decision making. For this purpose, we preoperatively examined 20 patients with refractory unilateral mesiotemporal lobe epilepsy (TLE) and a comparison group (CG) of 20 healthy volunteers with the Iowa Gambling Task to assess decision making based on feedback processing, the Game of Dice Task to assess decision making under risk, and with a neuropsychological test battery. Results indicate that TLE patients performed normally in decision making under risk, but can exhibit disturbances in decision making on the Iowa Gambling Task. A subgroup analysis revealed that those patients with a preference for the disadvantageous alternatives performed worse on executive subcomponents and had seizure onset at an earlier age in comparison to the patient subgroup without disadvantageous decision making. Furthermore, disadvantageous decision making can emerge in patients with selective hippocampal sclerosis not extended to the amygdala. Thus, our results demonstrate for the first time that presurgical patients with TLE can have selective reductions in decision making and that these deficits can result from hippocampal lesions without structural amygdala abnormalities.

  4. Decision-making deficits in patients with chronic schizophrenia: Iowa Gambling Task and Prospect Valence Learning model

    Directory of Open Access Journals (Sweden)

    Kim MS

    2016-04-01

    Full Text Available Myung-Sun Kim,1 Bit-Na Kang,1 Jae Young Lim2 1Department of Psychology, Sungshin Women’s University, Seoul, Republic of Korea; 2Department of Psychiatry, Keyo Medical Foundation, Keyo Hospital, Uiwang, Republic of Korea Purpose: Decision-making is the process of forming preferences for possible options, selecting and executing actions, and evaluating the outcome. This study used the Iowa Gambling Task (IGT and the Prospect Valence Learning (PVL model to investigate deficits in risk-reward related decision-making in patients with chronic schizophrenia, and to identify decision-making processes that contribute to poor IGT performance in these patients. Materials and methods: Thirty-nine patients with schizophrenia and 31 healthy controls participated. Decision-making was measured by total net score, block net scores, and the total number of cards selected from each deck of the IGT. PVL parameters were estimated with the Markov chain Monte Carlo sampling scheme in OpenBugs and BRugs, its interface to R, and the estimated parameters were analyzed with the Mann–Whitney U-test.Results: The schizophrenia group received significantly lower total net scores compared to the control group. In terms of block net scores, an interaction effect of group × block was observed. The block net scores of the schizophrenia group did not differ across the five blocks, whereas those of the control group increased as the blocks progressed. The schizophrenia group obtained significantly lower block net scores in the fourth and fifth blocks of the IGT and selected cards from deck D (advantageous less frequently than the control group. Additionally, the schizophrenia group had significantly lower values on the utility-shape, loss-aversion, recency, and consistency parameters of the PVL model. Conclusion: These results indicate that patients with schizophrenia experience deficits in decision-making, possibly due to failure in learning the expected value of each deck

  5. Frontostriatal Dysfunction During Decision Making in Attention-Deficit/Hyperactivity Disorder and Obsessive-Compulsive Disorder.

    Science.gov (United States)

    Norman, Luke J; Carlisi, Christina O; Christakou, Anastasia; Murphy, Clodagh M; Chantiluke, Kaylita; Giampietro, Vincent; Simmons, Andrew; Brammer, Michael; Mataix-Cols, David; Rubia, Katya

    2018-03-24

    The aim of the current paper is to provide the first comparison of computational mechanisms and neurofunctional substrates in adolescents with attention-deficit/hyperactivity disorder (ADHD) and adolescents with obsessive-compulsive disorder (OCD) during decision making under ambiguity. Sixteen boys with ADHD, 20 boys with OCD, and 20 matched control subjects (12-18 years of age) completed a functional magnetic resonance imaging version of the Iowa Gambling Task. Brain activation was compared between groups using three-way analysis of covariance. Hierarchical Bayesian analysis was used to compare computational modeling parameters between groups. Patient groups shared reduced choice consistency and relied less on reinforcement learning during decision making relative to control subjects, while adolescents with ADHD alone demonstrated increased reward sensitivity. During advantageous choices, both disorders shared underactivation in ventral striatum, while OCD patients showed disorder-specific underactivation in the ventromedial orbitofrontal cortex. During outcome evaluation, shared underactivation to losses in patients relative to control subjects was found in the medial prefrontal cortex and shared underactivation to wins was found in the left putamen/caudate. ADHD boys showed disorder-specific dysfunction in the right putamen/caudate, which was activated more to losses in patients with ADHD but more to wins in control subjects. The findings suggest shared deficits in using learned reward expectancies to guide decision making, as well as shared dysfunction in medio-fronto-striato-limbic brain regions. However, findings of unique dysfunction in the ventromedial orbitofrontal cortex in OCD and in the right putamen in ADHD indicate additional, disorder-specific abnormalities and extend similar findings from inhibitory control tasks in the disorders to the domain of decision making under ambiguity. Copyright © 2018 Society of Biological Psychiatry. Published by

  6. Cognitive processes in anesthesiology decision making.

    Science.gov (United States)

    Stiegler, Marjorie Podraza; Tung, Avery

    2014-01-01

    The quality and safety of health care are under increasing scrutiny. Recent studies suggest that medical errors, practice variability, and guideline noncompliance are common, and that cognitive error contributes significantly to delayed or incorrect diagnoses. These observations have increased interest in understanding decision-making psychology.Many nonrational (i.e., not purely based in statistics) cognitive factors influence medical decisions and may lead to error. The most well-studied include heuristics, preferences for certainty, overconfidence, affective (emotional) influences, memory distortions, bias, and social forces such as fairness or blame.Although the extent to which such cognitive processes play a role in anesthesia practice is unknown, anesthesia care frequently requires rapid, complex decisions that are most susceptible to decision errors. This review will examine current theories of human decision behavior, identify effects of nonrational cognitive processes on decision making, describe characteristic anesthesia decisions in this context, and suggest strategies to improve decision making.

  7. Clinical data warehousing for evidence based decision making.

    Science.gov (United States)

    Narra, Lekha; Sahama, Tony; Stapleton, Peta

    2015-01-01

    Large volumes of heterogeneous health data silos pose a big challenge when exploring for information to allow for evidence based decision making and ensuring quality outcomes. In this paper, we present a proof of concept for adopting data warehousing technology to aggregate and analyse disparate health data in order to understand the impact various lifestyle factors on obesity. We present a practical model for data warehousing with detailed explanation which can be adopted similarly for studying various other health issues.

  8. Decision-Making Autonomy and Subsidiary Innovation

    DEFF Research Database (Denmark)

    Van Vo, Dut; Beugelsdijk, Sjoerd; de Jong, Gjalt

    2013-01-01

    This paper investigates how decision-making autonomy affects the possibility and intensity of innovation in subsidiaries of multinational enterprises (MNEs). Subsidiaries are increasingly identified as sources of innovation and as vehicles for cross-border transfer of new competences. The question...... of how much decision-making autonomy subsidiaries should have is a core issue in the management of headquarters-subsidiary relationships. Using two complementary theoretical perspectives, we hypothesize a non-linear relationship between subsidiary’s decision-making autonomy and innovation. We test our...... hypothesis in a multi-country and multiindustry database based on survey evidence of 134 subsidiaries located in five Central and Eastern European countries from 23 home countries. The empirical results provide support for a non-linear U shaped relationship between subsidiary decision-making autonomy...

  9. Needs for evidence-based road safety decision making in Europe.

    NARCIS (Netherlands)

    Dupont, E. Muhlrad, N. Buttler, I. Gitelman, V. Giustiniani, G. Jähi, H. Machata, K. Martensen, H. Papadimitriou, E. Persia, L. Talbot, R. Vallet, G. Wijnen, W. & Yannis, G.

    2012-01-01

    The objective of this research is the assessment of current needs for evidence-based road safety decision making in Europe, through the consultation of a panel of road safety experts. The members of this Experts Panel have extensive knowledge of road safety management processes and needs in their

  10. Couple decision making and use of cultural scripts in Malawi.

    Science.gov (United States)

    Mbweza, Ellen; Norr, Kathleen F; McElmurry, Beverly

    2008-01-01

    To examine the decision-making processes of husband and wife dyads in matrilineal and patrilineal marriage traditions of Malawi in the areas of money, food, pregnancy, contraception, and sexual relations. Qualitative grounded theory using simultaneous interviews of 60 husbands and wives (30 couples). Data were analyzed according to the guidelines of simultaneous data collection and analysis. The analysis resulted in development of core categories and categories of decision-making process. Data matrixes were used to identify similarities and differences within couples and across cases. Most couples reported using a mix of final decision-making approaches: husband-dominated, wife-dominated, and shared. Gender based and nongender based cultural scripts provided rationales for their approaches to decision making. Gender based cultural scripts (husband-dominant and wife-dominant) were used to justify decision-making approaches. Non-gender based cultural scripts (communicating openly, maintaining harmony, and children's welfare) supported shared decision making. Gender based cultural scripts were used in decision making more often among couples from the district with a patrilineal marriage tradition and where the husband had less than secondary school education and was not formally employed. Nongender based cultural scripts to encourage shared decision making can be used in designing culturally tailored reproductive health interventions for couples. Nurses who work with women and families should be aware of the variations that occur in actual couple decision-making approaches. Shared decision making can be used to encourage the involvement of men in reproductive health programs.

  11. A mapping of design decision-making

    DEFF Research Database (Denmark)

    Hansen, Claus Thorp; Andreasen, Mogens Myrup

    2004-01-01

    In this paper we present the decision score, which is a model of decision-making seen in the engineering designer's perspective of the design process dynamics, where a decision has multiple objects and where it is based on earlier decisions, prediction of consequences and design process progressi...

  12. Neural correlates of conventional and harm/welfare-based moral decision-making.

    Science.gov (United States)

    White, Stuart F; Zhao, Hui; Leong, Kelly Kimiko; Smetana, Judith G; Nucci, Larry P; Blair, R James R

    2017-12-01

    The degree to which social norms are processed by a unitary system or dissociable systems remains debated. Much research on children's social-cognitive judgments has supported the distinction between "moral" (harm/welfare-based) and "conventional" norms. However, the extent to which these norms are processed by dissociable neural systems remains unclear. To address this issue, 23 healthy participants were scanned with functional magnetic resonance imaging (fMRI) while they rated the wrongness of harm/welfare-based and conventional transgressions and neutral vignettes. Activation significantly greater than the neutral vignette baseline was observed in regions implicated in decision-making regions including rostral/ventral medial frontal, anterior insula and dorsomedial frontal cortices when evaluating both harm/welfare-based and social-conventional transgressions. Greater activation when rating harm/welfare-based relative to social-conventional transgressions was seen through much of ACC and bilateral inferior frontal gyrus. Greater activation was observed in superior temporal gyrus, bilateral middle temporal gyrus, left PCC, and temporal-parietal junction when rating social-conventional transgressions relative to harm/welfare-based transgressions. These data suggest that decisions regarding the wrongness of actions, irrespective of whether they involve care/harm-based or conventional transgressions, recruit regions generally implicated in affect-based decision-making. However, there is neural differentiation between harm/welfare-based and conventional transgressions. This may reflect the particular importance of processing the intent of transgressors of conventional norms and perhaps the greater emotional content or salience of harm/welfare-based transgressions.

  13. A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task

    OpenAIRE

    Singh, Varsha

    2013-01-01

    The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy mani...

  14. [Affective and cognitive decision making in major depression: influence of the prefrontal cortex, serotonin transporter genotype and personality traits].

    Science.gov (United States)

    Must, Anita; Horváth, Szatmár; Janka, Zoltán

    2008-05-30

    Patients with major depressive disorder (MDD) show neuropsychological impairments, including deficient executive functions and suboptimal decision-making strategies, which are mediated by several brain regions. In the development of these symptoms the pathology of the prefrontal cortex (PFC), including the dorsolateral, ventromedial and orbitofrontal regions, may also play an important role. Neuropsychological assessment is a useful tool in detecting and measuring these deficiencies, showing that patients with MDD exhibit altered sensitivity to reward and punishment. However, impairment of emotional decision-making strategies in MDD is influenced by genetic variations (5-HTTLPR polymorphism) and personality traits, which seem to have a higher predictive value on decision making performance than the clinical symptoms.

  15. Identity-specific coding of future rewards in the human orbitofrontal cortex.

    Science.gov (United States)

    Howard, James D; Gottfried, Jay A; Tobler, Philippe N; Kahnt, Thorsten

    2015-04-21

    Nervous systems must encode information about the identity of expected outcomes to make adaptive decisions. However, the neural mechanisms underlying identity-specific value signaling remain poorly understood. By manipulating the value and identity of appetizing food odors in a pattern-based imaging paradigm of human classical conditioning, we were able to identify dissociable predictive representations of identity-specific reward in orbitofrontal cortex (OFC) and identity-general reward in ventromedial prefrontal cortex (vmPFC). Reward-related functional coupling between OFC and olfactory (piriform) cortex and between vmPFC and amygdala revealed parallel pathways that support identity-specific and -general predictive signaling. The demonstration of identity-specific value representations in OFC highlights a role for this region in model-based behavior and reveals mechanisms by which appetitive behavior can go awry.

  16. Health technology assessment, value-based decision making, and innovation.

    Science.gov (United States)

    Henshall, Chris; Schuller, Tara

    2013-10-01

    Identifying treatments that offer value and value for money is becoming increasingly important, with interest in how health technology assessment (HTA) and decision makers can take appropriate account of what is of value to patients and to society, and in the relationship between innovation and assessments of value. This study summarizes points from an Health Technology Assessment International (HTAi) Policy Forum discussion, drawing on presentations, discussions among attendees, and background papers. Various perspectives on value were considered; most place patient health at the core of value. Wider elements of value comprise other benefits for: patients; caregivers; the health and social care systems; and society. Most decision-making systems seek to take account of similar elements of value, although they are assessed and combined in different ways. Judgment in decisions remains important and cannot be replaced by mathematical approaches. There was discussion of the value of innovation and of the effects of value assessments on innovation. Discussion also included moving toward "progressive health system decision making," an ongoing process whereby evidence-based decisions on use would be made at various stages in the technology lifecycle. Five actions are identified: (i) development of a general framework for the definition and assessment of value; development by HTA/coverage bodies and regulators of (ii) disease-specific guidance and (iii) further joint scientific advice for industry on demonstrating value; (iv) development of a framework for progressive licensing, usage, and reimbursement; and (v) promoting work to better adapt HTA, coverage, and procurement approaches to medical devices.

  17. Decision making and cancer.

    Science.gov (United States)

    Reyna, Valerie F; Nelson, Wendy L; Han, Paul K; Pignone, Michael P

    2015-01-01

    We review decision making along the cancer continuum in the contemporary context of informed and shared decision making in which patients are encouraged to take a more active role in their health care. We discuss challenges to achieving informed and shared decision making, including cognitive limitations and emotional factors, but argue that understanding the mechanisms of decision making offers hope for improving decision support. Theoretical approaches to decision making that explain cognition, emotion, and their interaction are described, including classical psychophysical approaches, dual-process approaches that focus on conflicts between emotion versus cognition (or reason), and modern integrative approaches such as fuzzy-trace theory. In contrast to the earlier emphasis on rote use of numerical detail, modern approaches emphasize understanding the bottom-line gist of options (which encompasses emotion and other influences on meaning) and retrieving relevant social and moral values to apply to those gist representations. Finally, research on interventions to support better decision making in clinical settings is reviewed, drawing out implications for future research on decision making and cancer. PsycINFO Database Record (c) 2015 APA, all rights reserved.

  18. Health economics and outcomes methods in risk-based decision-making for blood safety

    NARCIS (Netherlands)

    Custer, Brian; Janssen, Mart P.

    2015-01-01

    Analytical methods appropriate for health economic assessments of transfusion safety interventions have not previously been described in ways that facilitate their use. Within the context of risk-based decision-making (RBDM), health economics can be important for optimizing decisions among competing

  19. Hunger does not motivate reward in women remitted from anorexia nervosa.

    Science.gov (United States)

    Wierenga, Christina E; Bischoff-Grethe, Amanda; Melrose, A James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F; Simmons, Alan; Fudge, Julie L; McClure, Samuel M; Ely, Alice; Kaye, Walter H

    2015-04-01

    Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study investigated brain response to rewards during hunger and satiated states to examine whether diminished response to reward could underlie food restriction in AN. Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 women remitted from AN (RAN group; to reduce the confounding effects of starvation) with 17 healthy comparison women (CW group). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Interactions of Group (RAN, CW) × Visit (hunger, satiety) revealed that, for the CW group, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in the RAN group. A main effect of group revealed elevated response in the middle frontal gyrus for the RAN group compared with the CW group. Women remitted from AN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to the motivational drive of hunger may explain the ability of individuals with AN to restrict food when emaciated. Difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this disorder. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  20. Risk Decision Making Based on Decision-theoretic Rough Set: A Three-way View Decision Model

    OpenAIRE

    Huaxiong Li; Xianzhong Zhou

    2011-01-01

    Rough set theory has witnessed great success in data mining and knowledge discovery, which provides a good support for decision making on a certain data. However, a practical decision problem always shows diversity under the same circumstance according to different personality of the decision makers. A simplex decision model can not provide a full description on such diverse decisions. In this article, a review of Pawlak rough set models and probabilistic rough set models is presented, and a ...