WorldWideScience

Sample records for delayed reward discounting

  1. Discounting of Delayed Rewards Is Not Hyperbolic

    Science.gov (United States)

    Luhmann, Christian C.

    2013-01-01

    Delay discounting refers to decision-makers' tendency to value immediately available goods more than identical goods available only after some delay. In violation of standard economic theory, decision-makers frequently exhibit dynamic inconsistency; their preferences change simply due to the passage of time. The standard explanation for this…

  2. Sleep deprivation alters effort discounting but not delay discounting of monetary rewards.

    Science.gov (United States)

    Libedinsky, Camilo; Massar, Stijn A A; Ling, Aiqing; Chee, Weiyan; Huettel, Scott A; Chee, Michael W L

    2013-06-01

    To determine whether sleep deprivation would affect the discounting of delayed rewards, of rewards entailing the expense of effort, or both. We measured rates of two types of reward discounting under conditions of rested wakefulness (RW) and sleep deprivation (SD). Delay discounting was defined as the willingness to accept smaller monetary rewards sooner rather than larger monetary rewards later. Effort discounting was defined as the willingness to accept smaller rewards that require less effort to obtain (e.g., typing a small number of letter strings backward) over larger but more effortful rewards (e.g., typing more letter strings to receive the reward). The first two experiments used a crossover design in which one session was conducted after a normal night of sleep (RW), and the other after a night without sleep (SD). The first experiment evaluated only temporal discounting whereas the second evaluated temporal and effort discounting. In the second experiment, the discounting tasks were repeatedly administered prior to the state comparisons to minimize the effects of order and/or repeated testing. In a third experiment, participants were studied only once in a between-subject evaluation of discounting across states. The study took place in a research laboratory. Seventy-seven healthy young adult participants: 20 in Experiment 1, 27 in Experiment 2, and 30 in Experiment 3. N/A. Sleep deprivation elicited increased effort discounting but did not affect delay discounting. The dissociable effects of sleep deprivation on two forms of discounting behavior suggest that they may have differing underlying neural mechanisms.

  3. Age and educational track influence adolescent discounting of delayed rewards

    Directory of Open Access Journals (Sweden)

    Nikki Christina Lee

    2013-12-01

    Full Text Available This study examined age-related changes in a specific aspect of adolescent decision-making, namely the preference for future versus immediate outcomes. A sample of 622 Dutch adolescents aged 12 -17 years completed a temporal discounting task. Participants were asked to choose between a delayed reward of €50 or an immediate reward of lower value. The delay interval was varied in three blocks (1 week, 1 month, 6 months. Results showed that preferences for large delayed rewards over smaller immediate rewards increased with age: late adolescents made more long-term decisions than early adolescents. This change was related to educational track. In the lower educational track, an age-related decrease in discounting was found for all three delay intervals. In the higher educational track this decrease only occurred for the six month delay interval. However, across all delay intervals enrolment in a higher level educational track was associated with an increased preference for long-term rewards. These results suggest that late adolescents are less susceptible to the competing presence of an immediate reward when making long-term decisions, a skill which becomes increasingly important as they transition into adulthood.

  4. Exchanging the liquidity hypothesis: Delay discounting of money and self-relevant non-money rewards.

    Science.gov (United States)

    Stuppy-Sullivan, Allison M; Tormohlen, Kayla N; Yi, Richard

    2016-01-01

    Evidence that primary rewards (e.g., food and drugs of abuse) are discounted more than money is frequently attributed to money's high degree of liquidity, or exchangeability for many commodities. The present study provides some evidence against this liquidity hypothesis by contrasting delay discounting of monetary rewards (liquid) and non-monetary commodities (non-liquid) that are self-relevant and utility-matched. Ninety-seven (97) undergraduate students initially completed a conventional binary-choice delay discounting of money task. Participants returned one week later and completed a self-relevant commodity delay discounting task. Both conventional hypothesis testing and more-conservative tests of statistical equivalence revealed correspondence in rate of delay discounting of money and self-relevant commodities, and in one magnitude condition, less discounting for the latter. The present results indicate that liquidity of money cannot fully account for the lower rate of delay discounting compared to non-money rewards.

  5. Trading Later Rewards for Current Pleasure: Pornography Consumption and Delay Discounting.

    Science.gov (United States)

    Negash, Sesen; Sheppard, Nicole Van Ness; Lambert, Nathaniel M; Fincham, Frank D

    2016-01-01

    Internet pornography is a multi-billion-dollar industry that has grown increasingly accessible. Delay discounting involves devaluing larger, later rewards in favor of smaller, more immediate rewards. The constant novelty and primacy of sexual stimuli as particularly strong natural rewards make Internet pornography a unique activator of the brain's reward system, thereby having implications for decision-making processes. Based on theoretical studies of evolutionary psychology and neuroeconomics, two studies tested the hypothesis that consuming Internet pornography would relate to higher rates of delay discounting. Study 1 used a longitudinal design. Participants completed a pornography use questionnaire and a delay discounting task at Time 1 and then again four weeks later. Participants reporting higher initial pornography use demonstrated a higher delay discounting rate at Time 2, controlling for initial delay discounting. Study 2 tested for causality with an experimental design. Participants were randomly assigned to abstain from either their favorite food or pornography for three weeks. Participants who abstained from pornography use demonstrated lower delay discounting than participants who abstained from their favorite food. The finding suggests that Internet pornography is a sexual reward that contributes to delay discounting differently than other natural rewards. Theoretical and clinical implications of these studies are highlighted.

  6. OPPORTUNITY COSTS OF REWARD DELAYS AND THE DISCOUNTING OF HYPOTHETICAL MONEY AND CIGARETTES

    Science.gov (United States)

    Johnson, Patrick S.; Herrmann, Evan S.; Johnson, Matthew W.

    2015-01-01

    Humans are reported to discount delayed rewards at lower rates than nonhumans. However, nonhumans are studied in tasks that restrict reinforcement during delays, whereas humans are typically studied in tasks that do not restrict reinforcement during delays. In nonhuman tasks, the opportunity cost of restricted reinforcement during delays may increase delay discounting rates. The present within-subjects study used online crowdsourcing (Amazon Mechanical Turk, or MTurk) to assess the discounting of hypothetical delayed money (and cigarettes in smokers) under four hypothetical framing conditions differing in the availability of reinforcement during delays. At one extreme, participants were free to leave their computer without returning, and engage in any behavior during reward delays (modeling typical human tasks). At the opposite extreme, participants were required to stay at their computer and engage in little other behavior during reward delays (modeling typical nonhuman tasks). Discounting rates increased as an orderly function of opportunity cost. Results also indicated predominantly hyperbolic discounting, the “magnitude effect,” steeper discounting of cigarettes than money, and positive correlations between discounting rates of these commodities. This is the first study to test the effects of opportunity costs on discounting, and suggests that procedural differences may partially account for observed species differences in discounting. PMID:25388973

  7. Intact Reward Learning but Elevated Delay Discounting in Parkinson's Disease Patients With Impulsive-Compulsive Spectrum Behaviors

    National Research Council Canada - National Science Library

    Housden, Charlotte R; O'Sullivan, Sean S; Joyce, Eileen M; Lees, Andrew J; Roiser, Jonathan P

    2010-01-01

    ... impulsively discount future rewards. To test these hypotheses, we investigated whether 36 medicated PD patients with and without ICBs differed from controls on measures of stimulus-reinforcement learning and delay discounting...

  8. Interrelationships between marijuana demand and discounting of delayed rewards: Convergence in behavioral economic methods.

    Science.gov (United States)

    Aston, Elizabeth R; Metrik, Jane; Amlung, Michael; Kahler, Christopher W; MacKillop, James

    2016-12-01

    Distinct behavioral economic domains, including high perceived drug value (demand) and delay discounting (DD), have been implicated in the initiation of drug use and the progression to dependence. However, it is unclear whether frequent marijuana users conform to a "reinforcer pathology" addiction model wherein marijuana demand and DD jointly increase risk for problematic marijuana use and cannabis dependence (CD). Participants (n=88, 34% female, 14% cannabis dependent) completed a marijuana purchase task at baseline. A delay discounting task was completed following placebo marijuana cigarette (0% THC) administration during a separate experimental session. Marijuana demand and DD were quantified using area under the curve (AUC). In multiple regression models, demand uniquely predicted frequency of marijuana use while DD did not. In contrast, DD uniquely predicted CD symptom count while demand did not. There were no significant interactions between demand and DD in either model. These findings suggest that frequent marijuana users exhibit key constituents of the reinforcer pathology model: high marijuana demand and steep discounting of delayed rewards. However, demand and DD appear to be independent rather than synergistic risk factors for elevated marijuana use and risk for progression to CD. Findings also provide support for using AUC as a singular marijuana demand metric, particularly when also examining other behavioral economic constructs that apply similar statistical approaches, such as DD, to support analytic methodological convergence. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  9. Impaired executive control and reward circuit in Internet gaming addicts under a delay discounting task: independent component analysis.

    Science.gov (United States)

    Wang, Yifan; Wu, Lingdan; Zhou, Hongli; Lin, Xiao; Zhang, Yifen; Du, Xiaoxia; Dong, Guangheng

    2017-04-01

    This study utilized independent component analysis to explore the abnormal functional connectivity (FC) in male participants with Internet gaming disorder (IGD). Functional magnetic resonance imaging and behavioral data were collected from 21 healthy controls (HC) and 18 IGD patients when they were performing a delay discounting task. Behavioral results revealed that the IGD patients showed higher delay discounting rates than HC. Two networks were found to be associated with IGD: (1) the executive control network containing the anterior cingulate cortex and the medial and superior frontal gyrus, and (2) the basal ganglia network containing the lentiform nucleus. Comparing to HC, IGD exhibited stronger FC when selecting small and now options. In addition, the delay discounting rates were positively correlated with the modulation of the two networks and the reaction time. The results suggested that the IGD patients have enhanced sensitivity to reward and decreased ability to control their impulsivity effectively, which leads to myopic decision making.

  10. Statistical equivalence and test-retest reliability of delay and probability discounting using real and hypothetical rewards.

    Science.gov (United States)

    Matusiewicz, Alexis K; Carter, Anne E; Landes, Reid D; Yi, Richard

    2013-11-01

    Delay discounting (DD) and probability discounting (PD) refer to the reduction in the subjective value of outcomes as a function of delay and uncertainty, respectively. Elevated measures of discounting are associated with a variety of maladaptive behaviors, and confidence in the validity of these measures is imperative. The present research examined (1) the statistical equivalence of discounting measures when rewards were hypothetical or real, and (2) their 1-week reliability. While previous research has partially explored these issues using the low threshold of nonsignificant difference, the present study fully addressed this issue using the more-compelling threshold of statistical equivalence. DD and PD measures were collected from 28 healthy adults using real and hypothetical $50 rewards during each of two experimental sessions, one week apart. Analyses using area-under-the-curve measures revealed a general pattern of statistical equivalence, indicating equivalence of real/hypothetical conditions as well as 1-week reliability. Exceptions are identified and discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

  11. Impulsive Delayed Reward Discounting as a Genetically-Influenced Target for Drug Abuse Prevention: A Critical Evaluation

    Directory of Open Access Journals (Sweden)

    Joshua C. Gray

    2015-09-01

    Full Text Available This review evaluates the viability of delayed reward discounting (DRD, an index of how much an individual devalues a future reward based on its delay in time, for genetically-informed drug abuse prevention. A review of the literature suggests that impulsive DRD is robustly associated with drug addiction and meets most of the criteria for being an endophenotype, albeit with mixed findings for specific molecular genetic influences. Several modes of experimental manipulation have been demonstrated to reduce DRD acutely. These include behavioral strategies, such as mindfulness, reward bundling, and episodic future thinking; pharmacological interventions, including noradrengic agonists, adrenergic agonists, and multiple monoamine agonists; and neuromodulatory interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation. However, the generalization of these interventions to positive clinical outcomes remains unclear and no studies to date have examined interventions on DRD in the context of prevention. Collectively, these findings suggest it would be premature to target DRD for genetically-informed prevention. Indeed, given the evidence of environmental contributions such as early life adversity to impulsive DRD, whether genetically-informed secondary prevention would ever be warranted is debatable. However, progress in identifying polymorphisms associated with DRD preference could further clarify the underlying biological systems implicated in impulsive DRD for further progress in pharmacological and neuromodulatory interventions. Furthermore, independent of genetically-informed prevention, impulsive DRD is a qualitatively different risk factor from existing prevention programs and is generally worthy of investigation as a novel and promising drug abuse prevention target.

  12. Time discounting for primary rewards.

    Science.gov (United States)

    McClure, Samuel M; Ericson, Keith M; Laibson, David I; Loewenstein, George; Cohen, Jonathan D

    2007-05-23

    Previous research, involving monetary rewards, found that limbic reward-related areas show greater activity when an intertemporal choice includes an immediate reward than when the options include only delayed rewards. In contrast, the lateral prefrontal and parietal cortex (areas commonly associated with deliberative cognitive processes, including future planning) respond to intertemporal choices in general but do not exhibit sensitivity to immediacy (McClure et al., 2004). The current experiments extend these findings to primary rewards (fruit juice or water) and time delays of minutes instead of weeks. Thirsty subjects choose between small volumes of drinks delivered at precise times during the experiment (e.g., 2 ml now vs 3 ml in 5 min). Consistent with previous findings, limbic activation was greater for choices between an immediate reward and a delayed reward than for choices between two delayed rewards, whereas the lateral prefrontal cortex and posterior parietal cortex responded similarly whether choices were between an immediate and a delayed reward or between two delayed rewards. Moreover, relative activation of the two sets of brain regions predicts actual choice behavior. A second experiment finds that when the delivery of all rewards is offset by 10 min (so that the earliest available juice reward in any choice is 10 min), no differential activity is observed in limbic reward-related areas for choices involving the earliest versus only more delayed rewards. We discuss implications of this finding for differences between primary and secondary rewards.

  13. Relative reinforcing value of food and delayed reward discounting in obesity and disordered eating: A systematic review.

    Science.gov (United States)

    Stojek, Monika M K; MacKillop, James

    2017-07-01

    Understanding the food choice decision-making may help identify those at higher risk for excess weight gain and dysregulated eating patterns. This paper systematically reviews the literature related to eating behavior and behavioral economic constructs of relative reinforcing value of food (RRVfood) and delayed reward discounting (DRD). RRVfood characterizes how valuable energy-dense food is to the individual, and DRD characterizes preferences for smaller immediate rewards over larger future rewards, an index of impulsivity. Literature search on PubMed was conducted using combination of terms that involve behavioral economics and dysregulated eating in youth and adults. Forty-seven articles were reviewed. There is consistent evidence that obese youth and adults exhibit higher RRVfood. There is a need for more research on the role of RRVfood in eating disorders, as an insufficient number of studies exist to draw meaningful conclusions. There is accumulating evidence that obese individuals have higher DRD but the study of moderators of this relationship is crucial. Only a small number of studies have been conducted on DRD and binge eating, and no clear conclusions can be made currently. Approximately half of existing studies suggest lower DRD in individuals with anorexia nervosa. Research implications and treatment application are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

  14. Delay, Probability, and Social Discounting in a Public Goods Game

    Science.gov (United States)

    Jones, Bryan A.; Rachlin, Howard

    2009-01-01

    A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual…

  15. The role of impulsivity traits and delayed reward discounting in dysregulated eating and drinking among heavy drinkers.

    Science.gov (United States)

    Stojek, Monika M; Fischer, Sarah; Murphy, Cara M; MacKillop, James

    2014-09-01

    Impulsivity is a multifaceted construct that has been linked to dysregulated eating and problematic alcohol use. The UPPS model identifies five personality-based impulsivity traits that have unique predictive utility: Negative Urgency, Perseverance, Premeditation, Sensation Seeking, and Positive Urgency. Delayed reward discounting (DRD) is an index of impulsive decision making characterized by preference for smaller immediate gains at the cost of larger delayed gains. In the current study, we sought to refine the influence of impulsive personality traits and DRD on disordered eating patterns and problematic drinking. One hundred and eight treatment-seeking heavy drinkers were assessed for UPPS impulsivity traits, DRD, disordered eating, alcohol use, and demographic information. With regard to disordered eating patterns, DRD predicted higher levels of Dietary Restraint and Weight and Shape Concerns. Negative Urgency predicted binge eating and Weight and Shape Concerns. Positive Urgency predicted Eating Concerns. Female sex predicted Eating, Weight, and Shape Concerns. When considering problematic alcohol use, only Negative Urgency and Sensation Seeking were predictive. This is the first study to examine both personality-based impulsivity and DRD in relation to pathological eating and drinking behavior. The results suggest the importance of disentangling the contributions of various impulsivity constructs on dysregulated eating.

  16. Parabolic discounting of monetary rewards by physical effort.

    Science.gov (United States)

    Hartmann, Matthias N; Hager, Oliver M; Tobler, Philippe N; Kaiser, Stefan

    2013-11-01

    When humans and other animals make decisions in their natural environments prospective rewards have to be weighed against costs. It is well established that increasing costs lead to devaluation or discounting of reward. While our knowledge about discount functions for time and probability costs is quite advanced, little is known about how physical effort discounts reward. In the present study we compared three different models in a binary choice task in which human participants had to squeeze a handgrip to earn monetary rewards: a linear, a hyperbolic, and a parabolic model. On the group as well as the individual level, the concave parabolic model explained most variance of the choice data, thus contrasting with the typical hyperbolic discounting of reward value by delay. Research on effort discounting is not only important to basic science but also holds the potential to quantify aberrant motivational states in neuropsychiatric disorders.

  17. Delay discounting and utility for money or weight loss.

    Science.gov (United States)

    Sze, Y Y; Slaven, E M; Bickel, W K; Epstein, L H

    2017-03-01

    Obesity is related to a bias towards smaller immediate over larger delayed rewards. This bias is typically examined by studying single commodity discounting. However, weight loss often involves choices among multiple commodities. To our knowledge, no research has examined delay discounting of delayed weight loss compared with other commodities. We examined single commodity discounting of money and cross commodity discounting of money and weight loss in a sample of 84 adults with obesity or overweight statuses interested in weight loss. The exchange rate between money and weight loss was calculated, and participants completed two delay discounting tasks: money now versus money later and money now versus weight loss later. Participants discounted weight loss more than money (p commodity discounting, and greater discounting of weight loss across all participants provide insight on important challenges for weight control.

  18. Personal relative deprivation, delay discounting, and gambling.

    Science.gov (United States)

    Callan, Mitchell J; Shead, N Will; Olson, James M

    2011-11-01

    Several lines of research have provided evidence for a relation between personal relative deprivation and gambling. Despite this knowledge, little is known about possible psychological mechanisms through which personal relative deprivation exerts its influence on gambling. The authors of this research sought to examine one such mechanism: the desire for immediate rewards. Using complementary approaches to studying psychological mechanisms, they tested in four studies the general hypothesis that personal relative deprivation translates into gambling urges and behavior in part via increased desires for immediate, even if smaller, rewards. Study 1 showed that an experimental manipulation of personal relative deprivation increased participants' preferences for smaller-sooner over larger-later rewards during a delay-discounting task. Studies 2 and 3 showed that a decreased willingness to delay gratification led to increased gambling behavior. Study 4 showed that preferences for smaller-sooner over larger-later rewards statistically mediated the relation between self-reported personal relative deprivation and gambling urges among a community sample of gamblers. The implications and potential applications of these findings are discussed.

  19. Delay discounting and future-directed thinking in anhedonic individuals.

    Science.gov (United States)

    Lempert, Karolina M; Pizzagalli, Diego A

    2010-09-01

    Anhedonia (lack of reactivity to pleasurable stimuli) and a negatively skewed view of the future are important components of depression that could affect economic decisions in depressed individuals. Delay discounting paradigms might be useful for probing putative affective and cognitive underpinnings of such decisions. As a first step to evaluate whether difficulties experiencing pleasure might affect delay discounting, 36 undergraduate students with varying levels of anhedonia performed a delay discounting task in which they made choices between a small immediate and larger future monetary reward. Increasing levels of anhedonia (Snaith-Hamilton Pleasure Scale) were negatively associated with delay discounting rate, indicating that anhedonic individuals tended to choose the larger, albeit delayed reward. These correlations remained after controlling for variables previously linked to delay discounting (working memory capacity and impulsivity) and pessimistic future-directed thinking. The current findings provide preliminary evidence indicating that anhedonic individuals make less myopic decisions about their future, possibly due to their decreased responsiveness to immediate rewards. (c) 2010 Elsevier Ltd. All rights reserved.

  20. Delay Discounting and Social Policy Issues

    Science.gov (United States)

    Weatherly, Jeffrey N.; Plumm, Karyn M.; Derenne, Adam

    2011-01-01

    The present study used a delay discounting framework to study decisions about six social policy issues and one monetary outcome. For outcomes that nearly all participants discounted, social policies were discounted significantly more than money. A similar result was observed when analyzing all outcomes using data only from participants who…

  1. Delay Discounting and Social Policy Issues

    Science.gov (United States)

    Weatherly, Jeffrey N.; Plumm, Karyn M.; Derenne, Adam

    2011-01-01

    The present study used a delay discounting framework to study decisions about six social policy issues and one monetary outcome. For outcomes that nearly all participants discounted, social policies were discounted significantly more than money. A similar result was observed when analyzing all outcomes using data only from participants who…

  2. Temporal Discounting Predicts Student Responsiveness to Exchange Delays in a Classroom Token System

    Science.gov (United States)

    Reed, Derek D.; Martens, Brian K.

    2011-01-01

    Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual…

  3. Role of delay-based reward in the spatial cooperation

    Science.gov (United States)

    Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

    2017-01-01

    Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

  4. Pigeons' Discounting of Probabilistic and Delayed Reinforcers

    Science.gov (United States)

    Green, Leonard; Myerson, Joel; Calvert, Amanda L.

    2010-01-01

    Pigeons' discounting of probabilistic and delayed food reinforcers was studied using adjusting-amount procedures. In the probability discounting conditions, pigeons chose between an adjusting number of food pellets contingent on a single key peck and a larger, fixed number of pellets contingent on completion of a variable-ratio schedule. In the…

  5. Individual differences in delay discounting under acute stress: the role of trait perceived stress

    Directory of Open Access Journals (Sweden)

    Karolina M. Lempert

    2012-07-01

    Full Text Available Delay discounting refers to the reduction of the value of a future reward as the delay to that reward increases. The rate at which individuals discount future rewards varies as a function of both individual and contextual differences, and high delay discounting rates have been linked with problematic behaviors, including drug abuse and gambling. The current study investigated the effects of acute anticipatory stress on delay discounting, while considering two important factors: individual perceptions of stress and whether the stressful situation is future-focused or present-focused. Half of the participants experienced acute stress by anticipating giving a videotaped speech. This stress was either future-oriented (speech about future job or present-oriented (speech about physical appearance. They then performed a delay discounting task, in which they chose between smaller, immediate rewards and larger, delayed rewards. Their scores on the Perceived Stress Scale were also collected. The way in which one appraises a stressful situation interacts with acute stress to influence choices; under stressful conditions, delay discounting rate was highest in individuals with low perceived stress and lowest for individuals with high perceived stress. This result might be related to individual variation in reward responsiveness under stress. Furthermore, the time orientation of the task interacted with its stressfulness to affect the individual’s propensity to choose immediate rewards. These findings add to our understanding of the intermediary factors between stress and decision making.

  6. The absence of numbers to express the amount may affect delay discounting with humans.

    Science.gov (United States)

    Reyes-Huerta, Hugo E; Dos Santos, Cristiano V

    2016-09-01

    Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay-discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.

  7. Discounting of Reward Sequences: a Test of Competing Formal Models of Hyperbolic Discounting

    Directory of Open Access Journals (Sweden)

    Noah eZarr

    2014-03-01

    Full Text Available Humans are known to discount future rewards hyperbolically in time. Nevertheless, a formal recursive model of hyperbolic discounting has been elusive until recently, with the introduction of the hyperbolically discounted temporal difference (HDTD model. Prior to that, models of learning (especially reinforcement learning have relied on exponential discounting, which generally provides poorer fits to behavioral data. Recently, it has been shown that hyperbolic discounting can also be approximated by a summed distribution of exponentially discounted values, instantiated in the µAgents model. The HDTD model and the µAgents model differ in one key respect, namely how they treat sequences of rewards. The µAgents model is a particular implementation of a parallel discounting model, which values sequences based on the summed value of the individual rewards whereas the HDTD model contains a nonlinear interaction. To discriminate among these models, we ascertained how subjects discounted a sequence of three rewards, and then we tested how well each candidate model fit the subject data. The results show that the parallel model generally provides a better fit to the human data.

  8. High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

    Science.gov (United States)

    Cherniawsky, Avital S; Holroyd, Clay B

    2013-03-01

    Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

  9. Temporal discounting of rewards in patients with bipolar disorder and schizophrenia.

    Science.gov (United States)

    Ahn, Woo-Young; Rass, Olga; Fridberg, Daniel J; Bishara, Anthony J; Forsyth, Jennifer K; Breier, Alan; Busemeyer, Jerome R; Hetrick, William P; Bolbecker, Amanda R; O'Donnell, Brian F

    2011-11-01

    Patients with bipolar disorder (BD) and schizophrenia (SZ) often show decision-making deficits in everyday circumstances. A failure to appropriately weigh immediate versus future consequences of choices may contribute to these deficits. We used the delay discounting task in individuals with BD or SZ to investigate their temporal decision making. Twenty-two individuals with BD, 21 individuals with SZ, and 30 healthy individuals completed the delay discounting task along with neuropsychological measures of working memory and cognitive function. Both BD and SZ groups discounted delayed rewards more steeply than did the healthy group even after controlling for current substance use, age, gender, and employment. Hierarchical multiple regression analyses showed that discounting rate was associated with both diagnostic group and working memory or intelligence scores. In each group, working memory or intelligence scores negatively correlated with discounting rate. The results suggest that (a) both BD and SZ groups value smaller, immediate rewards more than larger, delayed rewards compared with the healthy group and (b) working memory or intelligence is related to temporal decision making in individuals with BD or SZ as well as in healthy individuals.

  10. Willingness to wait and altered encoding of time-discounted reward in the orbitofrontal cortex with normal aging.

    Science.gov (United States)

    Roesch, Matthew R; Bryden, Daniel W; Cerri, Domenic H; Haney, Zachary R; Schoenbaum, Geoffrey

    2012-04-18

    Normal aging has been associated with cognitive changes, including shifts in responding for time-discounted rewards. The orbitofrontal cortex, an area previously associated with aging-related cognitive changes, is critical for normal discounting. Previously we have shown in a choice task that rats prefer immediate over delayed reward and that neural representations of delayed reward in orbitofrontal cortex were attenuated, whereas immediate reward elicited strong responses. Changes in choice performance were correlated with changes in firing rate in orbitofrontal neurons, suggesting that these reward representations were critical to the rats' ability to wait for reward. Here we asked whether age-dependent changes in discounting behavior were related to changes in the representation of delayed reward in the orbitofrontal cortex. Young (3-6 months) and aged (22-26 months) rats were trained on the same discounting paradigm used previously. We found that aged rats showed less sensitivity to increasing delay preceding reward delivery, shifting behavior away from the delayed reward more slowly than younger rats. This sensitivity was specific to delay, since choice performance did not differ between the two groups when delay was held constant and reward size varied. Aged rats exhibited a corresponding increase in the prevalence of neurons that fired more strongly for delayed reward. Again this change was specific to delay; there was no change in encoding of different-sized rewards. These results suggest that natural aging results in altered representations of reward in orbitofrontal cortex. These changes may relate to the increased ability to delay gratification and reduced impulsivity associated with aging.

  11. Survey of time preference, delay discounting models

    Directory of Open Access Journals (Sweden)

    John R. Doyle

    2013-03-01

    Full Text Available The paper surveys over twenty models of delay discounting (also known as temporal discounting, time preference, time discounting, that psychologists and economists have put forward to explain the way people actually trade off time and money. Using little more than the basic algebra of powers and logarithms, I show how the models are derived, what assumptions they are based upon, and how different models relate to each other. Rather than concentrate only on discount functions themselves, I show how discount functions may be manipulated to isolate rate parameters for each model. This approach, consistently applied, helps focus attention on the three main components in any discounting model: subjectively perceived money; subjectively perceived time; and how these elements are combined. We group models by the number of parameters that have to be estimated, which means our exposition follows a trajectory of increasing complexity to the models. However, as the story unfolds it becomes clear that most models fall into a smaller number of families. We also show how new models may be constructed by combining elements of different models. The surveyed models are: Exponential; Hyperbolic; Arithmetic; Hyperboloid (Green and Myerson, Rachlin; Loewenstein and Prelec Generalized Hyperboloid; quasi-Hyperbolic (also known as beta-delta discounting; Benhabib et al's fixed cost; Benhabib et al's Exponential / Hyperbolic / quasi-Hyperbolic; Read's discounting fractions; Roelofsma's exponential time; Scholten and Read's discounting-by-intervals (DBI; Ebert and Prelec's constant sensitivity (CS; Bleichrodt et al.'s constant absolute decreasing impatience (CADI; Bleichrodt et al.'s constant relative decreasing impatience (CRDI; Green, Myerson, and Macaux's hyperboloid over intervals models; Killeen's additive utility; size-sensitive additive utility; Yi, Landes, and Bickel's memory trace models; McClure et al.'s two exponentials; and Scholten and Read's trade

  12. Episodic future thinking reduces delay discounting and energy intake in children.

    Science.gov (United States)

    Daniel, Tinuke Oluyomi; Said, Michele; Stanton, Christina M; Epstein, Leonard H

    2015-08-01

    Discounting of larger future rewards in favor of smaller immediate rewards is known as delay discounting. High delay discounting or a bias towards immediate gratification impedes self-regulation and is associated with maladaptive eating behaviors. Children in general show greater delay discounting than adults. Obese children in particular, have greater difficulty delaying gratification for edible rewards. Episodic future thinking (EFT) which is mental self-projection to pre-experience future events reduces delay discounting and reduces energy intake in overweight/obese adults. However, these EFT effects have not been examined in children. We evaluated the effects of EFT versus control episodic recent thinking (ERT) on delay discounting and ad libitum energy intake while thinking about episodic cues in 42 overweight/obese 9 to 14year olds. Results showed that EFT led to less delay discounting and lowered energy intake, and EFT had the greatest effect on reducing energy intake in children with a higher desire to restrict food intake. This suggests that EFT may be useful in pediatric obesity treatment programs to help children regulate energy intake. Copyright © 2015 Elsevier Ltd. All rights reserved.

  13. The intertemporal choice behaviour: Classical and alternative delay discounting models and control techniques

    Directory of Open Access Journals (Sweden)

    Aldo G. S. Ventre

    2012-11-01

    Full Text Available Hyperbolic discounting refers to the tendency for people to increasingly choose a smaller-sooner reward over a larger-later reward as the delay occurs sooner rather than later in time. When offered a larger reward in exchange for waiting a set amount of time, people act less impulsively (i.e., choose to wait as the rewards happen further in the future. Put another way, people avoid waiting more as the wait nears the present time.

  14. Spatial discounting of food and social rewards in guppies (Poecilia reticulata

    Directory of Open Access Journals (Sweden)

    Nelly eMühlhoff

    2011-04-01

    Full Text Available In temporal discounting, animals trade off the time to obtain a reward against the quality of a reward, choosing between a smaller reward available sooner versus a larger reward available later. Similar discounting can apply over space, when animals choose between smaller and closer versus larger and more distant rewards. Most studies of temporal and spatial discounting in nonhuman animals use food as the reward, and it is not established whether animals trade off other preferred stimuli in similar ways. Here, we offered female guppies (Poecilia reticulata a spatial discounting task in which we measured preferences for a larger reward as the distance to it increased relative to a closer but smaller reward. We tested whether the fish discounted reward types differently by offering subjects either food items or same-sex conspecifics as rewards. Before beginning the discounting tasks, we conducted validation tests to ensure that subjects equally valued the food and social stimuli in the quantities provided. In the discounting task, subjects switched their preferences from the larger to the smaller reward as the distance to the larger reward increased (spatial discounting, but the pattern and magnitude of discounting did not differ across the two reward types. These findings indicate that guppies show similar patterns of discounting food and social rewards in a spatial task. In an analysis of travel times, however, the fish swam faster to food rewards than to shoaling partners. This difference in travel times implies that fish temporally discounted social rewards less steeply than food rewards. Thus, reward type influences temporal discounting, suggesting a dissociation between temporal and spatial discounting. Our results illustrate how animals adjust choices and travel times depending on both the type of cost (time, distance and benefits (food, social partners.

  15. The Effects of Inflation and Interest Rates on Delay Discounting in Human Behavior

    Science.gov (United States)

    Kawashima, Kentaro

    2006-01-01

    Interest and inflation rates may be major determinants of delay discounting, but these variables have not been controlled in past experiments because they depend on macroeconomic conditions. This study uses a computer game-like task to investigate the effects of inflation rates on people's subjective valuation of delayed rewards. During the task,…

  16. Rats value time differently on equivalent foraging and delay-discounting tasks.

    Science.gov (United States)

    Carter, Evan C; Redish, A David

    2016-09-01

    All organisms have to consider consequences that vary through time. Theories explaining how animals handle intertemporal choice include delay-discounting models, in which the value of future rewards is discounted by the delay until receipt, and foraging models, which predict that decision-makers maximize rate of reward. We measured the behavior of rats on a 2-option delay-discounting task and a stay/go foraging task that were equivalent for rate of reward and physical demand. Despite the highly shared features of the tasks, rats were willing to wait much longer on the foraging task than on the delay-discounting task. Moreover, choice performance by rats was less optimal in terms of total reward received on the foraging task compared to the delay-discounting task. We applied a suite of intertemporal choice models to the data but found that we needed a novel model incorporating interactions of decision-making systems to successfully explain behavior. Our findings (a) highlight the importance of factors that historically have been seen as irrelevant and (b) indicate the inadequacy of current general theories of intertemporal choice. (PsycINFO Database Record

  17. Delay discounting task in pigs reveals response strategies related to dopamine metabolite.

    Science.gov (United States)

    Melotti, Luca; Thomsen, Liat Romme; Toscano, Michael J; Mendl, Michael; Held, Suzanne

    2013-08-15

    We developed a novel delay discounting task to investigate outcome impulsivity in pigs. As impulsivity can affect aggression, and might also relate to proactive and reactive coping styles, eight proactive (HR) and eight reactive (LR) pigs identified in a manual restraint test ("Backtest", after Bolhuis et al., 2003) were weaned and mixed in four pens of four unfamiliar pigs, so that each pen had two HR and two LR pigs, and aggression was scored in the 9h after mixing. In the delay discounting task, each pig chose between two levers, one always delivering a small immediate reward, the other a large delayed reward with daily increasing delays, impulsive individuals being the ones discounting the value of the large reward quicker. Two novel strategies emerged: some pigs gradually switched their preference towards the small reward ('Switchers') as predicted, but others persistently preferred the large reward until they stopped making choices ('Omitters'). Outcome impulsivity itself was unrelated to these strategies, to urinary serotonin metabolite (5-HIAA) or dopamine metabolite (HVA) levels, aggression at weaning, or coping style. However, HVA was relatively higher in Omitters than Switchers, and positively correlated with behavioural measures of indecisiveness and frustration during choosing. The delay discounting task thus revealed two response strategies that seemed to be related to the activity of the dopamine system and might indicate a difference in execution, rather than outcome, impulsivity.

  18. Delay and Probability Discounting as Candidate Markers for Dementia: An Initial Investigation

    Science.gov (United States)

    Lindbergh, Cutter A.; Puente, Antonio N.; Gray, Joshua C.; Mackillop, James; Miller, L. Stephen

    2014-01-01

    The present study investigated delay discounting and probability discounting—behavioral economic indices of impulsivity and risk proneness, respectively—in 39 healthy older adults and 25 older adults with mild cognitive impairment (MCI). Relative to the healthy group, it was hypothesized that older adults with MCI would display greater levels of impulsivity, risk proneness, and response inconsistency. The MCI group was found to display a unique delay discounting profile characterized by increasing impulsivity with decreasing reward magnitude, such that cognitively impaired older adults were significantly more impulsive than healthy controls at the small reward magnitude. The two groups exhibited similar levels of probability discounting, though older adults with MCI were significantly less consistent in their risk preferences. The present findings shed light onto decision-making in pre-dementia disease stages and suggest that discounting performance holds potential to complement early diagnostic instruments, likely due to pathophysiological processes in relevant brain regions. PMID:25236720

  19. The effects of the framing of time on delay discounting.

    Science.gov (United States)

    DeHart, William Brady; Odum, Amy L

    2015-01-01

    We examined the effects of the framing of time on delay discounting. Delay discounting is the process by which delayed outcomes are devalued as a function of time. Time in a titrating delay discounting task is often framed in calendar units (e.g., as 1 week, 1 month, etc.). When time is framed as a specific date, delayed outcomes are discounted less compared to the calendar format. Other forms of framing time; however, have not been explored. All participants completed a titrating calendar unit delay-discounting task for money. Participants were also assigned to one of two delay discounting tasks: time as dates (e.g., June 1st, 2015) or time in units of days (e.g., 5000 days), using the same delay distribution as the calendar delay-discounting task. Time framed as dates resulted in less discounting compared to the calendar method, whereas time framed as days resulted in greater discounting compared to the calendar method. The hyperboloid model fit best compared to the hyperbola and exponential models. How time is framed may alter how participants attend to the delays as well as how the delayed outcome is valued. Altering how time is framed may serve to improve adherence to goals with delayed outcomes.

  20. A comparison of delay discounting among substance users with and without suicide attempt history.

    Science.gov (United States)

    Liu, Richard T; Vassileva, Jasmin; Gonzalez, Raul; Martin, Eileen M

    2012-12-01

    Although substance use disorders are associated with overall increased suicide risk, there is considerable variability in suicide risk among substance-dependent individuals (SDIs). Impairment in impulse control is common among SDIs, and it may contribute to vulnerability to suicidal behavior. The present study examined the relation between one specific aspect of impulsivity-delay discounting-and suicide attempt history in a sample of SDIs. An interaction was observed between suicide attempt history and discounting rates across delayed reward size. Specifically, SDIs with no history of attempted suicide, devalued small relative to large delayed rewards. In contrast, SDIs with a history of suicide attempts appeared comparatively indifferent to delayed reward size, discounting both small and large delayed rewards at essentially identical rates. These findings provide evidence that, despite the view that SDIs are characterized by marked difficulties in impulsivity, significant variability exists within this group in delay-discounting tendencies. Furthermore, these differences provide preliminary evidence that specific aspects of impulsivity may help to identify those most at risk for suicidal behavior in this population. The potential implications of our findings for suicide prevention efforts are discussed.

  1. Increased Delay Discounting on a Novel Real-Time Task among Girls, but not Boys, with ADHD

    Science.gov (United States)

    Rosch, Keri S.; Mostofsky, Stewart H.

    2016-01-01

    The aim of this study was to examine delay discounting in girls and boys with ADHD-Combined type (ADHD-C) relative to typically developing (TD) children on two tasks that differ in the extent to which the rewards and delays were experienced by participants. Children ages 8–12 years with ADHD-C (n = 65; 19 girls) and TD controls (n = 55; 15 girls) completed two delay discounting tasks involving a series of choices between smaller, immediate and larger, delayed rewards. The classic delay discounting task involved choices about money at delays of 1–90 days and only some of the outcomes were actually experienced by the participants. The novel real-time discounting task involved choices about an immediately consumable reward (playing a preferred game) at delays of 25–100 s, all of which were actually experienced by participants. Participants also provided subjective ratings of how much they liked playing the game and waiting to play. Girls with ADHD-C displayed greater delay discounting compared to boys with ADHD-C and TD girls and boys on the real-time discounting task. Diagnostic group differences were not evident on the classic discounting task. In addition, children with ADHD-C reported wanting to play the game more and liking waiting to play the game less than TD children. This novel demonstration of greater delay discounting among girls with ADHD-C on a discounting task in which the rewards are immediately consumable and the delays are experienced in real-time informs our understanding of sex differences and motivational processes in children with ADHD. PMID:26549118

  2. Internet Addiction and Delay Discounting in College Students

    Science.gov (United States)

    Saville, Bryan K.; Gisbert, Amanda; Kopp, Jason; Telesco, Carolyn

    2010-01-01

    To examine the relation between Internet addiction and delay discounting, we gave 276 college students a survey designed to measure Internet addiction and a paper-based delay-discounting task. In our larger sample, we identified 14 students who met the criteria for Internet addiction; we also identified 14 matched controls who were similar to the…

  3. Internet Addiction and Delay Discounting in College Students

    Science.gov (United States)

    Saville, Bryan K.; Gisbert, Amanda; Kopp, Jason; Telesco, Carolyn

    2010-01-01

    To examine the relation between Internet addiction and delay discounting, we gave 276 college students a survey designed to measure Internet addiction and a paper-based delay-discounting task. In our larger sample, we identified 14 students who met the criteria for Internet addiction; we also identified 14 matched controls who were similar to the…

  4. Decreased frontal, striatal and cerebellar activation in adults with ADHD during an adaptive delay discounting task.

    Science.gov (United States)

    Ortiz, Nick; Parsons, Aisling; Whelan, Robert; Brennan, Katie; Agan, Maria L F; O'Connell, Redmond; Bramham, Jessica; Garavan, Hugh

    2015-01-01

    An important characteristic of childhood attention-deficit/hyperactivity disorder (ADHD) is a bias towards small immediate versus larger delayed rewards, but it is not known if this symptom is also a feature of adult ADHD. A delay-discounting task was administered to participants with adult ADHD and a comparison group in conjunction with functional magnetic resonance imaging. Participants responded to a series of questions that required judgments between small sums of money available immediately and larger sums obtained after a temporal delay. Question parameters were adjusted by an adaptive algorithm designed to converge on each participant's discounting indifference point, an individual set point at which there is equal valuation of both choices. In all participants, robust task activation was observed in regions previously identified in functional imaging studies of delay discounting. However, adults with ADHD showed less task activation in a number of regions including the dorsolateral prefrontal cortex, superior frontal gyrus, anterior cingulate, caudate nucleus and declive of the cerebellum. Additionally, the degree to which a participant discounted delayed rewards was inversely related to task activation in the cerebellum. The results suggest that the bias towards immediate rewards in childhood ADHD may not persist behaviorally, but instead present in adulthood as alterations in frontostriatal and frontocerebellar networks.

  5. Tobacco demand, delay discounting, and smoking topography among smokers with and without psychopathology.

    Science.gov (United States)

    Farris, Samantha G; Aston, Elizabeth R; Abrantes, Ana M; Zvolensky, Michael J

    2017-10-01

    Tobacco demand (i.e., relative value attributed to a given reinforcer) and delay discounting (i.e., relative preference for smaller immediate rewards over larger delayed rewards) are two behavioral economic processes that are linked to the progression of problematic substance use. These processes have not been studied among those with psychopathology, a vulnerable group of smokers. The current study examined differences in tobacco demand and delay discounting, and their association with smoking topography among smokers with (n=43) and without (n=64) past-year psychopathology. Adult daily smokers (n=107,Mage=43.5; SD=9.7) participated in a study on "smoking behavior." Past-year psychological disorders were assessed via a clinician-administered diagnostic assessment. All subjects participated in an ad libitum smoking trial and then completed an assessment of delay discounting (Monetary Choice Questionnaire) and tobacco demand (Cigarette Purchase Task) approximately 45-60min post-smoking. Smokers with psychopathology, compared to those without, had significantly higher demand intensity and maximum expenditure on tobacco (Omax), but did not differ on other demand indices or delay discounting. Smokers with psychopathology had shorter average inter-puff intervals and shorter time to cigarette completion than smokers without psychopathology. Tobacco demand and delay discounting measures were significantly intercorrelated among smokers with psychopathology, but not those without. Both behavioral economic measures were associated with specific aspects of smoking topography in smokers with psychopathology. The association between tobacco demand and delay discounting is evident among smokers with psychopathology and both measures were most consistently related to smoking behavior. Copyright © 2017 Elsevier B.V. All rights reserved.

  6. Delay discounting and impulsivity traits in young and older gambling disorder patients.

    Science.gov (United States)

    Steward, Trevor; Mestre-Bach, Gemma; Fernández-Aranda, Fernando; Granero, Roser; Perales, José C; Navas, Juan Francisco; Soriano-Mas, Carles; Baño, Marta; Fernández-Formoso, Jose A; Martín-Romera, Virginia; Menchón, José M; Jiménez-Murcia, Susana

    2017-08-01

    Impulsivity is understood to be a multidimensional construct involving aspects such as impulsive choice and impulsive traits. Delay discounting, the tendency to place greater value in immediate rewards over larger, long-term rewards, has been associated with maladaptive choices in gambling disorder (GD). Delay discounting is known to evolve with age; though no study to date has evaluated the interactions between impulsivity, GD severity and age in treatment-seeking patients. We aimed to examine whether associations between delay discounting and impulsivity traits differed between younger and older-aged GD patients. Secondly, we sought to untangle the mediating role of impulsivity in determining gambling behavior in these two age groups. GD patients (N=335) were evaluated using the UPPS-P Impulsive Behavior Scale and a delay discounting task. Structural Equation Modeling (SEM) was used to explore associations between impulsivity measures and gambling severity in young (18-30years) and old (31-70) GD patients. No differences in delay discounting were found between young and old GD patients. Significant correlations between delay discounting and urgency levels (the tendency to act rashly under emotional states) were identified only in the young GD group. Path analyses also revealed both positive and negative urgency to be a mediator of GD severity levels in young GD patients. Significant associations between impulsive choice and positive urgency are only present in young gamblers, suggesting that positive urgency influence choice behavior to a greater degree at younger ages. Implications for targeted interventions are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

  7. A behavioral economic analysis of texting while driving: Delay discounting processes.

    Science.gov (United States)

    Hayashi, Yusuke; Miller, Kimberly; Foreman, Anne M; Wirth, Oliver

    2016-12-01

    The purpose of the present study was to examine an impulsive decision-making process underlying texting while driving from a behavioral economic perspective. A sample of 108 college students completed a novel discounting task that presented participants with a hypothetical scenario in which, after receiving a text message while driving, they rated the likelihood of replying to a text message immediately versus waiting to reply for a specific period of time. Participants also completed a delay discounting task in which they made repeated hypothetical choices between obtaining a larger amount of money available after a delay and an equal or lesser amount of money available immediately. The results show that the duration of the delay is a critical variable that strongly determines whether participants choose to wait to reply to a text message, and that the decrease in the likelihood of waiting as a function of delay is best described by a hyperbolic delay discounting function. The results also show that participants who self-reported higher frequency of texting while driving discounted the opportunity to reply to a text message at greater rates, whereas there was no relation between the rates of discounting of hypothetical monetary rewards and the frequency of texting while driving. The results support the conclusion that texting while driving is fundamentally an impulsive choice.

  8. Anxious Individuals Are Impulsive Decision-Makers in the Delay Discounting Task: An ERP Study.

    Science.gov (United States)

    Xia, Lisheng; Gu, Ruolei; Zhang, Dandan; Luo, Yuejia

    2017-01-01

    Impulsivity, which is linked to a wide range of psychiatric disorders, is often characterized by a preference for immediate but smaller rewards over delayed but larger rewards. However, debate exists on the relationship between anxiety and impulsivity. Here we use event-related potential (ERP) components as biomarkers in the temporal discounting task to examine the effect of anxiety on inter-temporal decision-making. Our behavioral results indicated that the high trait anxiety (HTA) group made significantly more immediate choices than the low trait anxiety (LTA) group. Compared with the LTA group, shorter response time was associated with immediate rewards in the HTA group. Furthermore, previous studies have demonstrated three ERP components that are associated with impulsivity and/or delay discounting. First, the N1 is an early sensory component involved in selective attention and attention processing for goal-directed actions. Second, the reward positivity (RewP) reflects reward-related dopaminergic activity and encodes reward values. Third, the P3 is regarded as a measure of motivational significance in the decision-making literature. Accordingly, this study found in the immediate-option-evoked ERPs that the HTA group had a larger N1 than the LTA group did. For the delayed-option-evoked ERPs, the HTA group had larger N1 and RewP for the immediate choice than the LTA group did, while the LTA group had a larger P3 for the delayed choice than the HTA group did. These results support the notion that anxiety individuals are impulsive decision-makers in the Delay Discounting Task.

  9. Anxious Individuals Are Impulsive Decision-Makers in the Delay Discounting Task: An ERP Study

    Science.gov (United States)

    Xia, Lisheng; Gu, Ruolei; Zhang, Dandan; Luo, Yuejia

    2017-01-01

    Impulsivity, which is linked to a wide range of psychiatric disorders, is often characterized by a preference for immediate but smaller rewards over delayed but larger rewards. However, debate exists on the relationship between anxiety and impulsivity. Here we use event-related potential (ERP) components as biomarkers in the temporal discounting task to examine the effect of anxiety on inter-temporal decision-making. Our behavioral results indicated that the high trait anxiety (HTA) group made significantly more immediate choices than the low trait anxiety (LTA) group. Compared with the LTA group, shorter response time was associated with immediate rewards in the HTA group. Furthermore, previous studies have demonstrated three ERP components that are associated with impulsivity and/or delay discounting. First, the N1 is an early sensory component involved in selective attention and attention processing for goal-directed actions. Second, the reward positivity (RewP) reflects reward-related dopaminergic activity and encodes reward values. Third, the P3 is regarded as a measure of motivational significance in the decision-making literature. Accordingly, this study found in the immediate-option-evoked ERPs that the HTA group had a larger N1 than the LTA group did. For the delayed-option-evoked ERPs, the HTA group had larger N1 and RewP for the immediate choice than the LTA group did, while the LTA group had a larger P3 for the delayed choice than the HTA group did. These results support the notion that anxiety individuals are impulsive decision-makers in the Delay Discounting Task. PMID:28174528

  10. Delay discounting without decision-making: Medial prefrontal cortex and amygdala activations reflect immediacy processing and correlate with impulsivity and anxious-depressive traits

    Directory of Open Access Journals (Sweden)

    Vera eLudwig

    2015-10-01

    Full Text Available Humans value rewards less when these are delivered in the future as opposed to immediately, a phenomenon referred to as delay discounting. While delay discounting has been studied during the anticipation of rewards and in the context of intertemporal decision-making, little is known about its neural correlates in the outcome phase (during reward delivery and their relation to personality. Personality traits that have been associated with increased delay discounting include impulsivity and, potentially, anxious-depressive traits. Here we performed functional magnetic resonance imaging (fMRI in 72 healthy participants while they carried out a monetary incentive delay task with a delay manipulation. In sixty percent of the experimental trials, participants won rewards that differed in magnitude (0.05€, 0.50€ or 1€ and delay until delivery (immediately, 10 days, or 100 days. A factor analysis on questionnaires yielded two factors reflecting Impulsivity and Anxiety/Depression, which we used to examine potential relationships between personality and delay discounting. When winning a reward, medial prefrontal cortex (mPFC activation was higher for immediate compared to delayed rewards. Moreover, amygdala activation correlated with reward magnitude for immediate but not for delayed rewards. Amygdala activation to winning immediate rewards was higher in more impulsive participants, while mPFC activation to winning immediate rewards was higher in more anxious-depressed participants. Our results uncover neural correlates of delay discounting during reward delivery, and suggest that impulsivity and subclinical anxious-depressive traits are related to stronger neural responses for winning immediate relative to delayed rewards.

  11. Temporal Dynamics of the Interaction between Reward and Time Delay during Intertemporal Choice

    Science.gov (United States)

    Gui, Dan-Yang; Li, Jin-Zhen; Li, Xiaoli; Luo, Yue-jia

    2016-01-01

    Intertemporal choice involves the processes of valuation and choice. Choice is often the result of subjective valuation, in which reward is integrated with time delay. Here, using event-related potential (ERP) signals as temporal hallmarks, we aim to investigate temporal dynamics of how reward interacts with time delay during a delayed discounting task. We found that participants preferred immediate rewards when delayed rewards were small or over long-term delays. Our ERP results suggested that the P200 component reflected an initial valuation of reward and time delay, while the frontal N2 component correlated with individual choices of immediate option of rewards. The LPP component was modulated by the N2 component. These findings demonstrate that the N2 component is the key component in temporal dynamics of the interaction between reward and time valuation.

  12. Effects of delay and probability combinations on discounting in humans.

    Science.gov (United States)

    Cox, David J; Dallery, Jesse

    2016-10-01

    To determine discount rates, researchers typically adjust the amount of an immediate or certain option relative to a delayed or uncertain option. Because this adjusting amount method can be relatively time consuming, researchers have developed more efficient procedures. One such procedure is a 5-trial adjusting delay procedure, which measures the delay at which an amount of money loses half of its value (e.g., $1000 is valued at $500 with a 10-year delay to its receipt). Experiment 1 (n=212) used 5-trial adjusting delay or probability tasks to measure delay discounting of losses, probabilistic gains, and probabilistic losses. Experiment 2 (n=98) assessed combined probabilistic and delayed alternatives. In both experiments, we compared results from 5-trial adjusting delay or probability tasks to traditional adjusting amount procedures. Results suggest both procedures produced similar rates of probability and delay discounting in six out of seven comparisons. A magnitude effect consistent with previous research was observed for probabilistic gains and losses, but not for delayed losses. Results also suggest that delay and probability interact to determine the value of money. Five-trial methods may allow researchers to assess discounting more efficiently as well as study more complex choice scenarios. Copyright © 2016 Elsevier B.V. All rights reserved.

  13. Steep delay discounting and addictive behavior: a meta-analysis of continuous associations.

    Science.gov (United States)

    Amlung, Michael; Vedelago, Lana; Acker, John; Balodis, Iris; MacKillop, James

    2017-01-01

    To synthesize continuous associations between delayed reward discounting (DRD) and both addiction severity and quantity-frequency (QF); to examine moderators of these relationships; and to investigate publication bias. Meta-analysis of published studies examining continuous associations between DRD and addictive behaviors. Published, peer-reviewed studies on addictive behaviors (alcohol, tobacco, cannabis, stimulants, opiates and gambling) were identified via PubMed, MEDLINE and PsycInfo. Studies were restricted to DRD measures of monetary gains. Random-effects meta-analysis was conducted using Pearson's r as the effect size. Publication bias was evaluated using fail-safe N, Begg-Mazumdar and Egger's tests, meta-regression of publication year and effect size and imputation of missing studies. The primary meta-analysis revealed a small magnitude effect size that was highly significant (r = 0.14, P addictive behavior (P = 0.30) or DRD assessment (P = 0.90). Indices of publication bias suggested a modest impact of unpublished findings. Delayed reward discounting is associated robustly with continuous measures of addiction severity and quantity-frequency. This relation is generally robust across type of addictive behavior and delayed reward discounting assessment modality. © 2016 Society for the Study of Addiction.

  14. Texting Dependence, iPod Dependence, and Delay Discounting.

    Science.gov (United States)

    Ferraro, F Richard; Weatherly, Jeffrey N

    2016-01-01

    We gave 127 undergraduates questionnaires about their iPod and texting dependence and 2 hypothetical delay discounting scenarios related to free downloaded songs and free texting for life. Using regression analyses we found that when iPod dependence was the dependent variable, Text2-excessive use, Text4-psychological and behavioral symptoms, iPod2-excessive use, and iPod3-relationship disruption were significant predictors of discounting. When texting dependence was the dependent variable, Text4-psychological and behavioral symptoms and iPod3-relationship disruption were significant predictors of discounting. These are the first data to show that delay discounting relates to certain aspects of social media, namely iPod and texting dependence. These data also show that across these 2 dependencies, both psychological and behavioral symptoms and relationship disruptions are affected.

  15. The role of prospection in steep temporal reward discounting in gambling addiction

    Directory of Open Access Journals (Sweden)

    Antonius eWiehler

    2015-08-01

    Full Text Available Addiction and pathological gambling (PG have been consistently associated with high impulsivity and a steep devaluation of delayed rewards, a process that is known as temporal discounting (TD. Recent studies indicated that enhanced episodic future thinking (EFT results in less impulsive TD in healthy controls (HC. In a separate line of research, it has been suggested that non-linearities in time perception might contribute to reward devaluation during inter-temporal choice. Therefore, in addition to deficits in valuation processes and executive control, impairments in EFT and non-linearities in time perception have been hypothesized to contribute to steep TD in addiction. In this study, we explore such a potential association of impairments in EFT and time perception with steep TD in PG.We investigated 20 PGs and 20 matched HCs. TD was assessed via a standard computerized binary choice task. We measured EFT using a variation of the Autobiographical Memory Interview by Levine et al. (1. Time perception was assessed with a novel task, utilizing a non-linear rating procedure via circle-size adjustments.Groups did not differ in baseline EFT. In both groups, a power law accounted time perception best, and the degree of non-linearity in time perception correlated with discounting across groups. A multiple regression analysis across all predictors and covariates revealed that only group status (PG/HC and depression were significantly associated with discounting behavior such that PG increased TD and depression attenuated TD.Our findings speak against the idea that steep TD in PG is due to a skewed perception of time or impairments in EFT, at least under the present task conditions. The lack of overall group differences in EFT does not rule out the possibility of more complex interactions of EFT and decision-making. These interactions might be diminished in pathological gambling or addiction more generally, when other task configurations are used.

  16. Delay discounting, risk-taking, and rejection sensitivity among individuals with Internet and Video Gaming Disorders

    Science.gov (United States)

    Weinstein, Aviv; Abu, Hodaya Ben; Timor, Ayelet; Mama, Yaniv

    2016-01-01

    Background and aims There is a previous evidence for impulsivity in individuals with Internet and Video Gaming Disorders. The aim of this study was to examine whether Internet and video game addictions are associated with experiential delay discounting, risk-taking, and sensitivity to social rejection using computerized tasks and questionnaires. Methods Twenty participants (mean age 24, SD = 1.55) with high score on the Problematic Online Gaming Questionnaire (POGQ) were compared with 20 participants (mean age 24.8, SD = 1.34) with low score on the POGQ. They performed on computerized Balloon Analog Risk Task and Experiential Delay discounting Task (EDT), and filled in the sensitivity to social rejection questionnaire. Results Participants with high POGQ scores had lower measures of delay discounting, higher measures of risk-taking, and higher measures of sensitivity to social rejection compared with participants with low POGQ scores. Discussion The results of this study support the previous evidence of risk-taking and provide new evidence for difficulties in delay discounting and sensitivity to social rejection among those who score high on Internet and video games. Conclusions The results suggest that Internet- and video game-addicted individuals seek immediate gratification and cannot wait for later reward. Furthermore, these individuals spend time in the virtual world, where they feel safe, and avoid social interactions presumably due to fears of social rejection. PMID:27958761

  17. White matter integrity predicts delay discounting behavior in 9- to 23-year-olds: a diffusion tensor imaging study.

    Science.gov (United States)

    Olson, Elizabeth A; Collins, Paul F; Hooper, Catalina J; Muetzel, Ryan; Lim, Kelvin O; Luciana, Monica

    2009-07-01

    Healthy participants (n = 79), ages 9-23, completed a delay discounting task assessing the extent to which the value of a monetary reward declines as the delay to its receipt increases. Diffusion tensor imaging (DTI) was used to evaluate how individual differences in delay discounting relate to variation in fractional anisotropy (FA) and mean diffusivity (MD) within whole-brain white matter using voxel-based regressions. Given that rapid prefrontal lobe development is occurring during this age range and that functional imaging studies have implicated the prefrontal cortex in discounting behavior, we hypothesized that differences in FA and MD would be associated with alterations in the discounting rate. The analyses revealed a number of clusters where less impulsive performance on the delay discounting task was associated with higher FA and lower MD. The clusters were located primarily in bilateral frontal and temporal lobes and were localized within white matter tracts, including portions of the inferior and superior longitudinal fasciculi, anterior thalamic radiation, uncinate fasciculus, inferior fronto-occipital fasciculus, corticospinal tract, and splenium of the corpus callosum. FA increased and MD decreased with age in the majority of these regions. Some, but not all, of the discounting/DTI associations remained significant after controlling for age. Findings are discussed in terms of both developmental and age-independent effects of white matter organization on discounting behavior.

  18. Delay discounting and the use of mindful attention versus distraction in the treatment of drug addiction: a conceptual review.

    Science.gov (United States)

    Ashe, Melinda L; Newman, Michelle G; Wilson, Stephen J

    2015-01-01

    In recent decades, researchers have integrated measurements of delay discounting, how the subjective valuation of a reward changes as a function of time, into their study of addiction. Research has begun to explore the idea that delay discounting may serve as both a marker for the effectiveness of existing treatments for addiction and a potential target for novel intervention strategies. As this work is in its infancy, many potentially significant connections between the construct of delay discounting and the treatment of addiction have yet to be explored. Here, we present a conceptual review highlighting novel points of intersection between delay discounting and two approaches to treating addiction that have become increasingly popular in recent years: those that focus on the development of mindfulness skills and those that emphasize the use of distraction techniques. Viewing these two techniques through the lens of delay discounting is particularly intriguing because of the very different way that they address the experience of drug cravings in the present moment (nonjudgmentally attending to vs. shifting attention away from subjective cravings, respectively). We propose that these opposing strategies for dealing with cravings may interact with delay discounting in ways that have important implications for treatment effectiveness. © Society for the Experimental Analysis of Behavior.

  19. Gender differences in delay-discounting under mild food restriction

    NARCIS (Netherlands)

    Koot, S.; van den Bos, R.; Adriani, W.; Laviola, G.

    2009-01-01

    Abstract: Impulsivity, a core symptomof attention-deficit hyperactivity disorder (ADHD), is tested in animal models by delay-discounting tasks. So far, mainly male subjects have been used in this paradigm at severe levels of food restriction. Here we studied the impulsive behaviour of CD-1 adult mal

  20. Discounting of Various Types of Rewards by Women with and without Binge Eating Disorder: Evidence for General Rather than Specific Differences

    Science.gov (United States)

    Manwaring, Jamie L.; Green, Leonard; Myerson, Joel; Strube, Michael J.; Wilfley, Denise E.

    2011-01-01

    The present study compared the extent to which obese women with binge eating disorder (BED), obese women without BED, and controls discounted delayed and probabilistic money and directly consumable rewards: food, massage time, and preferred sedentary activity. Of special interest was whether the BED group differed from the other groups in terms of…

  1. Discounting of Various Types of Rewards by Women with and without Binge Eating Disorder: Evidence for General Rather than Specific Differences

    Science.gov (United States)

    Manwaring, Jamie L.; Green, Leonard; Myerson, Joel; Strube, Michael J.; Wilfley, Denise E.

    2011-01-01

    The present study compared the extent to which obese women with binge eating disorder (BED), obese women without BED, and controls discounted delayed and probabilistic money and directly consumable rewards: food, massage time, and preferred sedentary activity. Of special interest was whether the BED group differed from the other groups in terms of…

  2. Me, Myself, and Money II: Relative Deprivation Predicts Disordered Gambling Severity via Delay Discounting, Especially Among Gamblers Who Have a Financially Focused Self-Concept.

    Science.gov (United States)

    Tabri, Nassim; Will Shead, N; Wohl, Michael J A

    2017-02-02

    In the current research, we examined whether the known link between relative deprivation and disordered gambling (via delay discounting; i.e., preferences for immediate smaller rewards relative to delayed larger rewards) is moderated by the extent to which gamblers have a financially focused self-concept. Specifically, we hypothesized that delay discounting would be a strong predictor of disordered gambling among those who base their self-worth on their financial success. To test this moderated-mediation model, a community sample of gamblers (N = 239) completed measures that assessed relative deprivation, delay discounting, financially focused self-concept, and disordered gambling severity. As predicted, people who felt more relative deprivation reported more severe symptoms of disordered gambling and this association was mediated by delay discounting. Importantly, this mediated relationship was moderated by the extent to which participants' self-concept was focused on financial success. Among participants whose self-concept was high in financial focus, greater delay discounting (stemming from relative deprivation) was a strong predictor of disordered gambling. Among people whose self-concept was low in financial focus, delay discounting (stemming from relative deprivation) was a weak predictor of disordered gambling. Thus, the magnitude of the indirect effect of relative deprivation on disordered gambling severity was larger among people with a more financially focused self-concept-an effect mediated by delay discounting. These findings suggest that targeting gamblers' financial focus in prevention and treatment interventions may be instrumental in curtailing the development and maintenance of disordered gambling.

  3. Previous Cocaine Exposure Makes Rats Hypersensitive to Both Delay and Reward Magnitude

    Science.gov (United States)

    Roesch, Matthew R.; Takahashi, Yuji; Gugsa, Nishan; Bissonette, Gregory B.; Schoenbaum, Geoffrey

    2008-01-01

    Animals prefer an immediate over a delayed reward, just as they prefer a large over a small reward. Exposure to psychostimulants causes long-lasting changes in structures critical for this behavior and might disrupt normal time-discounting performance. To test this hypothesis, we exposed rats to cocaine daily for 2 weeks (30 mg/kg, i.p.). Approximately 6 weeks later, we tested them on a variant of a time-discounting task, in which the rats responded to one of two locations to obtain reward while we independently manipulated the delay to reward and reward magnitude. Performance did not differ between cocaine-treated and saline-treated (control) rats when delay lengths and reward magnitudes were equal at the two locations. However, cocaine-treated rats were significantly more likely to shift their responding when we increased the delay or reward size asymmetrically. Furthermore, they were slower to respond and made more errors when forced to the side associated with the lower value. We conclude that previous exposure to cocaine makes choice behavior hypersensitive to differences in the time to and size of available rewards, consistent with a general effect of cocaine exposure on reward valuation mechanisms. PMID:17202492

  4. Self-Administered Cocaine Causes Long-Lasting Increases in Impulsive Choice in a Delay Discounting Task

    OpenAIRE

    Mendez, Ian A.; Nicholas W Simon; Hart, Nigel; Mitchell, Marci R.; Nation, Jack R.; Wellman, Paul J.; Setlow, Barry

    2010-01-01

    Cocaine use is associated with high levels of impulsive choice (preference for immediate over delayed rewards), but it is not clear whether cocaine use causes elevated impulsive choice, or whether elevated impulsive choice is solely a predisposing factor for cocaine use. This study examined the effects of prior cocaine self-administration on rats performing a delay discounting task commonly used to measure impulsive choice. Male Long-Evans rats were implanted with intravenous catheters, and f...

  5. Rates of delay and probability discounting of northern plains American Indians discounting Indian and majority culture-specific outcomes.

    Science.gov (United States)

    Weatherly, Jeffrey N; McDonald, J Douglas; Derenne, Adam

    2013-01-01

    Discounting occurs when the value of an outcome changes because its delivery is delayed or uncertain. Discounting provides insight into how individuals make decisions, with rates of discounting being related to a number of behavioral disorders. In this study, 39 American Indians (AIs), 29 female, were recruited from the psychology department participant pool at a university in the Northern Plains to complete an acculturation inventory and delay- and probability-discounting tasks related to money, health care, and education reform. Results from ANOVAs showed that participants did not differentially discount the delayed outcomes, but discounted the probabilistic monetary outcomes to a greater extent than probabilistic outcomes involving education reform, suggesting that participants were more risk averse with the monetary, than the education, outcomes. Differences in discounting were not observed as a function of whether the outcome would occur on or off a tribal reservation. Results from regression analyses showed that participants' affiliation with the majority culture was also related to how they discounted probabilistic monetary outcomes. The present study represents the first attempt to measure probability discounting in AI participants and is the first to show differences in this type of decision making. The results, therefore, represent a step forward in understanding when risk-averse versus risk-prone decisions (i.e., a small but certain outcome vs. a better but uncertain outcome) may be made, and how those decisions are related to acculturation in AIs.

  6. Delay discounting as a function of intrinsic/extrinsic religiousness, religious fundamentalism, and regular church attendance.

    Science.gov (United States)

    Weatherly, Jeffrey N; Plumm, Karyn M

    2012-01-01

    Delay discounting occurs when the subjective value of an outcome decreases because its delivery is delayed. Previous research has suggested that the rate at which some, but not all, outcomes are discounted varies as a function of regular church attendance. In the present study, 509 participants completed measures of intrinsic religiousness, extrinsic religiousness, religious fundamentalism, and whether they regularly attended church services. They then completed a delay-discounting task involving five outcomes. Although religiousness was not a significant predictor of discounting for all outcomes, participants scoring high in intrinsic religiousness tended to display less delay discounting than participants scoring low. Likewise, participants scoring high in religious fundamentalism tended to display more delay discounting than participants scoring low. These results partially replicate previous ones in showing that the process of discounting may vary as a function of religiousness. The results also provide some direction for those interested in altering how individuals discount.

  7. Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation.

    Science.gov (United States)

    Klein-Flügge, Miriam C; Kennerley, Steven W; Saraiva, Ana C; Penny, Will D; Bestmann, Sven

    2015-03-01

    There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort

  8. Unique prediction of cannabis use severity and behaviors by delay discounting and behavioral economic demand.

    Science.gov (United States)

    Strickland, Justin C; Lile, Joshua A; Stoops, William W

    2017-07-01

    Few studies have simultaneously evaluated delay discounting and behavioral economic demand to determine their unique contribution to drug use. A recent study in cannabis users found that monetary delay discounting uniquely predicted cannabis dependence symptoms, whereas cannabis demand uniquely predicted use frequency. This study sought to replicate and extend this research by evaluating delay discounting and behavioral economic demand measures for multiple commodities and including a use quantity measure. Amazon.com's Mechanical Turk was used to sample individuals reporting recent cannabis use (n=64) and controls (n=72). Participants completed measures of monetary delay discounting as well as alcohol and cannabis delay discounting and demand. Cannabis users and controls did not differ on monetary delay discounting or alcohol delay discounting and demand. Among cannabis users, regression analyses indicated that cannabis delay discounting uniquely predicted use severity, whereas cannabis demand uniquely predicted use frequency and quantity. These effects remained significant after controlling for other delay discounting and demand measures. This research replicates previous outcomes relating delay discounting and demand with cannabis use and extends them by accounting for the contribution of multiple commodities. This research also demonstrates the ability of online crowdsourcing methods to complement traditional human laboratory techniques. Copyright © 2017 Elsevier B.V. All rights reserved.

  9. Delay discounting of food by rhesus monkeys: Cocaine and food choice in isomorphic and allomorphic situations.

    Science.gov (United States)

    Huskinson, Sally L; Woolverton, William L; Green, Leonard; Myerson, Joel; Freeman, Kevin B

    2015-06-01

    Research on delay discounting has focused largely on nondrug reinforcers in an isomorphic context in which choice is between alternatives that involve the same type of reinforcer. Less often, delay discounting has been studied with drug reinforcers in a more ecologically valid allomorphic context where choice is between alternatives involving different types of reinforcers. The present experiment is the first to examine discounting of drug and nondrug reinforcers in both isomorphic and allomorphic situations using a theoretical model (i.e., the hyperbolic discounting function) that allows for comparisons of discounting rates between reinforcer types and amounts. The goal of the current experiment was to examine discounting of a delayed, nondrug reinforcer (food) by male rhesus monkeys when the immediate alternative was either food (isomorphic situation) or cocaine (allomorphic situation). In addition, we sought to determine whether there was a magnitude effect with delayed food in the allomorphic situation. Choice of immediate food and immediate cocaine increased with amount and dose, respectively. Choice functions for immediate food and cocaine generally shifted leftward as delay increased. Compared to isomorphic situations in which food was the immediate alternative, delayed food was discounted more steeply in allomorphic situations where cocaine was the immediate alternative. Notably, discounting was not affected by the magnitude of the delayed reinforcer. These data indicate that how steeply a delayed nondrug reinforcer is discounted may depend more on the qualitative characteristics of the immediate reinforcer and less on the magnitude of the delayed one. (c) 2015 APA, all rights reserved).

  10. Individual Determinants in Delay Discounting%延迟折扣的个体影响因素

    Institute of Scientific and Technical Information of China (English)

    佟月华; 韩颖; 逄宇

    2012-01-01

    Delay discounting refers to the tendency to discount the subjective value of future rewards as a function of the delay receiving them. Researchers explored individual determinants which affect delay discounting, including demographic variables such as age, gender, education and income, and personality trait, emotion, and cognitive factors. Future research should focus on characteristics of delay discounting in childhood, interaction between personality and emotion, and interaction between individual and environmental factors.%延迟折扣是指未来奖赏当前的主观价值随着时间的延长而减少的心理现象.研究者从年龄、性别、受教育程度与收入等人口学变量以及人格特质、情绪和认知方面人手,对延迟折扣的个体影响因素进行了探讨.未来的研究应关注学前和学龄儿童延迟折扣特点、人格与情绪等的交互作用以及个体因素与环境因素的交互作用等问题.

  11. Capacity to delay reward differentiates obsessive-compulsive disorder and obsessive-compulsive personality disorder.

    Science.gov (United States)

    Pinto, Anthony; Steinglass, Joanna E; Greene, Ashley L; Weber, Elke U; Simpson, H Blair

    2014-04-15

    Although the relationship between obsessive-compulsive disorder (OCD) and obsessive-compulsive personality disorder (OCPD) has long been debated, clinical samples of OCD (without OCPD) and OCPD (without OCD) have never been systematically compared. We studied whether individuals with OCD, OCPD, or both conditions differ on symptomatology, functioning, and a measure of self-control: the capacity to delay reward. Twenty-five OCD, 25 OCPD, 25 comorbid OCD + OCPD, and 25 healthy control subjects completed clinical assessments and a validated intertemporal choice task that measures capacity to forego small immediate rewards for larger delayed rewards. OCD and OCPD subjects both showed impairment in psychosocial functioning and quality of life, as well as compulsive behavior, but only subjects with OCD reported obsessions. Individuals with OCPD, with or without comorbid OCD, discounted the value of delayed monetary rewards significantly less than OCD and healthy control subjects. This excessive capacity to delay reward discriminates OCPD from OCD and is associated with perfectionism and rigidity. OCD and OCPD are both impairing disorders marked by compulsive behaviors, but they can be differentiated by the presence of obsessions in OCD and by excessive capacity to delay reward in OCPD. That individuals with OCPD show less temporal discounting (suggestive of excessive self-control), whereas prior studies have shown that individuals with substance use disorders show greater discounting (suggestive of impulsivity), supports the premise that this component of self-control lies on a continuum in which both extremes (impulsivity and overcontrol) contribute to psychopathology. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

  12. Delay discounting and intake of ready-to-eat and away-from-home foods in overweight and obese women.

    Science.gov (United States)

    Appelhans, Bradley M; Waring, Molly E; Schneider, Kristin L; Pagoto, Sherry L; DeBiasse, Michelle A; Debiasse, Michelle A; Whited, Matthew C; Lynch, Elizabeth B

    2012-10-01

    A shift from home-prepared to away-from-home and ready-to-eat foods has occurred in recent decades, which has implications for obesity and health. This study tested whether delay discounting, a facet of impulsivity reflecting sensitivity to immediate reward, is associated with the frequency of consumption and typical amount consumed of home-prepared, away-from-home, and ready-to-eat foods among overweight and obese women. Seventy-eight participants completed a binary choice task assessing discounting of delayed monetary rewards. Nutrient analysis of weighed food records characterized dietary intake over seven consecutive days. Foods were categorized as home-prepared, away-from-home, or ready-to-eat by a registered dietitian from information provided by participants. Delay discounting was not associated with the frequency of consuming home-prepared, away-from-home, and ready-to-eat foods as reflected in the percentages of recorded foods or total energy intake from each category. However, once consuming away-from-home and ready-to-eat foods (but not home-prepared foods), impulsive women consumed more energy than less impulsive women. Exploratory analyses indicated that more impulsive women chose away-from-home foods with a higher energy density (kcal/g). Impulsivity was associated with the quantity of away-from-home and ready-to-eat foods consumed, but not the frequency of their consumption. Home food preparation may be critical to weight control for impulsive individuals.

  13. The Effects of Reduced Cigarette Smoking on Discounting Future Rewards: An Initial Evaluation

    Science.gov (United States)

    Yi, Richard; Johnson, Matthew W.; Giordano, Louis A.; Landes, Reid D.; Badger, Gary J.; Bickel, Warren K.

    2008-01-01

    To determine whether reduction of smoking via contingency management in dependent smokers would decrease the discounting of delayed reinforcers compared with smokers who did not reduce their smoking, moderate to heavy cigarette smokers were randomly assigned to one of two conditions: a contingency management condition and a control condition. In…

  14. Changing Delay Discounting in the Light of the Competing Neurobehavioral Decision Systems Theory: A Review

    Science.gov (United States)

    Koffarnus, Mikhail N.; Jarmolowicz, David P.; Mueller, E. Terry; Bickel, Warren K.

    2013-01-01

    Excessively devaluing delayed reinforcers co-occurs with a wide variety of clinical conditions such as drug dependence, obesity, and excessive gambling. If excessive delay discounting is a trans-disease process that underlies the choice behavior leading to these and other negative health conditions, efforts to change an individual's discount rate…

  15. Steeper delay and probability discounting of potentially real versus hypothetical cigarettes (but not money) among smokers.

    Science.gov (United States)

    Green, Ryan M; Lawyer, Steven R

    2014-10-01

    There is a strong relationship between drug use and the tendency to discount the value of outcomes as a function of their delay and probability. Most discounting researchers use hypothetical monetary outcomes to establish discounting patterns among human subjects, who tend to discount the value of hypothetical money and real money similarily. However, no research to date has examined whether hypothetical non-monetary outcomes are discounted similarly to real non-monetary outcomes. In this study, smokers were assigned randomly to complete delay and probability discounting tasks for money and cigarettes that were either potentially real (n=33) or hypothetical (n=31). Consistent with previous research, smokers discounted the value of hypothetical and potentially real money similarly. However, smokers evidenced steeper rates of discounting for potentially real cigarettes in both delay and probability discounting. These findings suggest domain-specific discounting patterns in which potentially real and hypothetical outcomes may be synonymous in the context of monetary outcomes, but not in the context of non-monetary outcomes. Copyright © 2014 Elsevier B.V. All rights reserved.

  16. Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance

    Science.gov (United States)

    2014-09-29

    value function approximation is an active area of research ( Parr et al., 2008; Mahadevan, 2009; Taylor and Parr , 2009; Boots and Gordon, 2010), but it is...Publishers Inc. Ng, A., Harada, D., Russell , S., 1999. Policy invariance under reward transfor- mations: Theory and application to reward shaping. ICML...strategy. In: Proceedings of the IEEE/ACM International Conference on Human-Robot Interaction. 43 Parr , R., Li, L., Taylor, G., Painter-Wakefield, C

  17. Undervaluing delayed rewards explains adolescents’ impulsivity in inter-temporal choice: an ERP study

    Science.gov (United States)

    Huang, Yunyun; Hu, Ping; Li, Xueting

    2017-01-01

    Adolescence has frequently been characterized as a period of choice impulsivity relative to adulthood. According to the control-integrated valuation model of inter-temporal choice, this choice impulsivity may be driven partly by an age-related difference in reward processing. We hypothesized that, compared to adults, adolescents would undervalue delayed rewards during reward processing and would thus be more impulsive in inter-temporal choice. To test this hypothesis at the behavioural and neural levels, we first measured the choice impulsivity of 18 adolescents and 19 adults using a delay discounting task (DDT). Then, we recorded event-related potentials (ERPs) from the participants while they were performing the valuation task, in which monetary gains and losses were either immediate or delayed. The behavioural results showed that adolescents were more impulsive than adults in the DDT. The ERP results showed that, whilst both groups valued immediate rewards, implied by a similarly strong feedback-related negativity (FRN) effect associated with immediate outcomes, adolescents devalued delayed rewards more than adults did, as they produced a significantly smaller FRN effect associated with delayed outcomes. As predicted, the mediation analysis revealed that the adolescents’ lower FRN effect of delayed outcomes underpinned their stronger impulsive decision making in the DDT. PMID:28198452

  18. Undervaluing delayed rewards explains adolescents' impulsivity in inter-temporal choice: an ERP study.

    Science.gov (United States)

    Huang, Yunyun; Hu, Ping; Li, Xueting

    2017-02-15

    Adolescence has frequently been characterized as a period of choice impulsivity relative to adulthood. According to the control-integrated valuation model of inter-temporal choice, this choice impulsivity may be driven partly by an age-related difference in reward processing. We hypothesized that, compared to adults, adolescents would undervalue delayed rewards during reward processing and would thus be more impulsive in inter-temporal choice. To test this hypothesis at the behavioural and neural levels, we first measured the choice impulsivity of 18 adolescents and 19 adults using a delay discounting task (DDT). Then, we recorded event-related potentials (ERPs) from the participants while they were performing the valuation task, in which monetary gains and losses were either immediate or delayed. The behavioural results showed that adolescents were more impulsive than adults in the DDT. The ERP results showed that, whilst both groups valued immediate rewards, implied by a similarly strong feedback-related negativity (FRN) effect associated with immediate outcomes, adolescents devalued delayed rewards more than adults did, as they produced a significantly smaller FRN effect associated with delayed outcomes. As predicted, the mediation analysis revealed that the adolescents' lower FRN effect of delayed outcomes underpinned their stronger impulsive decision making in the DDT.

  19. Delay and probability discounting of sexual and monetary outcomes in individuals with cocaine use disorders and matched controls.

    Science.gov (United States)

    Johnson, Matthew W; Johnson, Patrick S; Herrmann, Evan S; Sweeney, Mary M

    2015-01-01

    Individuals with cocaine use disorders are disproportionately affected by HIV/AIDS, partly due to higher rates of unprotected sex. Recent research suggests delay discounting of condom use is a factor in sexual HIV risk. Delay discounting is a behavioral economic concept describing how delaying an event reduces that event's value or impact on behavior. Probability discounting is a related concept describing how the uncertainty of an event decreases its impact on behavior. Individuals with cocaine use disorders (n = 23) and matched non-cocaine-using controls (n = 24) were compared in decision-making tasks involving hypothetical outcomes: delay discounting of condom-protected sex (Sexual Delay Discounting Task), delay discounting of money, the effect of sexually transmitted infection (STI) risk on likelihood of condom use (Sexual Probability Discounting Task), and probability discounting of money. The Cocaine group discounted delayed condom-protected sex (i.e., were more likely to have unprotected sex vs. wait for a condom) significantly more than controls in two of four Sexual Delay Discounting Task partner conditions. The Cocaine group also discounted delayed money (i.e., preferred smaller immediate amounts over larger delayed amounts) significantly more than controls. In the Sexual Probability Discounting Task, both groups showed sensitivity to STI risk, however the groups did not differ. The Cocaine group did not consistently discount probabilistic money more or less than controls. Steeper discounting of delayed, but not probabilistic, sexual outcomes may contribute to greater rates of sexual HIV risk among individuals with cocaine use disorders. Probability discounting of sexual outcomes may contribute to risk of unprotected sex in both groups. Correlations showed sexual and monetary results were unrelated, for both delay and probability discounting. The results highlight the importance of studying specific behavioral processes (e.g., delay and probability

  20. An alternative approach to calculating Area-Under-the-Curve (AUC) in delay discounting research.

    Science.gov (United States)

    Borges, Allison M; Kuang, Jinyi; Milhorn, Hannah; Yi, Richard

    2016-09-01

    Applied to delay discounting data, Area-Under-the-Curve (AUC) provides an atheoretical index of the rate of delay discounting. The conventional method of calculating AUC, by summing the areas of the trapezoids formed by successive delay-indifference point pairings, does not account for the fact that most delay discounting tasks scale delay pseudoexponentially, that is, time intervals between delays typically get larger as delays get longer. This results in a disproportionate contribution of indifference points at long delays to the total AUC, with minimal contribution from indifference points at short delays. We propose two modifications that correct for this imbalance via a base-10 logarithmic transformation and an ordinal scaling transformation of delays. These newly proposed indices of discounting, AUClog d and AUCor d, address the limitation of AUC while preserving a primary strength (remaining atheoretical). Re-examination of previously published data provides empirical support for both AUClog d and AUCor d . Thus, we believe theoretical and empirical arguments favor these methods as the preferred atheoretical indices of delay discounting.

  1. When is it adaptive to be patient? A general framework for evaluating delayed rewards.

    Science.gov (United States)

    Fawcett, Tim W; McNamara, John M; Houston, Alasdair I

    2012-02-01

    The tendency of animals to seek instant gratification instead of waiting for greater long-term benefits has been described as impatient, impulsive or lacking in self-control. How can we explain the evolution of such seemingly irrational behaviour? Here we analyse optimal behaviour in a variety of simple choice situations involving delayed rewards. We show that preferences for more immediate rewards should depend on a variety of factors, including whether the choice is a one-off or is likely to be repeated, the information the animal has about the continuing availability of the rewards and the opportunity to gain rewards through alternative activities. In contrast to the common assertion that rational animals should devalue delayed rewards exponentially, we find that this pattern of discounting is optimal only under restricted circumstances. We predict preference reversal whenever waiting for delayed rewards entails loss of opportunities elsewhere, but the direction of this reversal depends on whether the animal will face the same choice repeatedly. Finally, we question the ecological relevance of standard laboratory tests for impulsive behaviour, arguing that animals rarely face situations analogous to the self-control paradigm in their natural environment. To understand the evolution of impulsiveness, a more promising strategy would be to identify decision rules that are adaptive in a realistic ecological setting, and examine how these rules determine patterns of behaviour in simultaneous choice tests.

  2. Hot executive function following moderate-to-late preterm birth: altered delay discounting at 4 years of age.

    Science.gov (United States)

    Hodel, Amanda S; Brumbaugh, Jane E; Morris, Alyssa R; Thomas, Kathleen M

    2016-03-01

    Interest in monitoring long-term neurodevelopmental outcomes of children born moderate-to-late preterm (32-36 weeks gestation) is increasing. Moderate-to-late preterm birth has a negative impact on academic achievement, which may relate to differential development of executive function (EF). Prior studies reporting deficits in EF in preterm children have almost exclusively assessed EF in affectively neutral contexts in high-risk preterm children (birth remains uninvestigated, despite evidence that preterm children show differential development of neural circuitry subserving hot EF, including reduced orbitofrontal cortex volume. The present study is the first to examine whether low-risk, healthy children born moderate-to-late preterm exhibit impairments in the development of hot EF. Preterm children at age 4.5 years were less likely to choose larger, delayed rewards across all levels of reward magnitude on a delay discounting task using tangible rewards, but performed more similarly to their full-term peers on a delay aversion task involving abstract rewards and on measures of cool EF. The relationship between gestational age at birth and selection of delayed rewards extended across the entire gestational age range of the sample (32-42 weeks), and remained significant after controlling for intelligence and processing speed. Results imply that there is not a finite cut-off point at which children are spared from potential long-term neurodevelopmental effects of PT birth. Further investigation of reward processing and hot EF in individuals with a history of PT birth is warranted given the susceptibility of prefrontal cortex development to early environmental variations.

  3. A Job with a Future? Delay Discounting, Magnitude Effects, and Domain Independence of Utility for Career Decisions.

    Science.gov (United States)

    Schoenfelder, Thomas E.; Hantula, Donald A.

    2003-01-01

    Seniors (n=20) assessed two job offers with differences in domain (salary/tasks), delay (career-long earnings), and magnitude (initial salary offer). Contrary to discounted utility theory, choices reflected nonconstant discount rates for future salary/tasks (delay effect), lower discount rates for salary/preferred tasks (magnitude effect), and a…

  4. Testing the Reliability of Delay Discounting of Ten Commodities Using the Fill-in-the-Blank Method

    Science.gov (United States)

    Weatherly, Jeffrey N.; Derenne, Adam; Terrell, Heather K.

    2011-01-01

    Several measures of delay discounting have been shown to be reliable over periods of up to 3 months. In the present study, 115 participants completed a fill-in-the-blank (FITB) delay-discounting task on sets of 5 different commodities, 12 weeks apart. Results showed that discounting rates were not well described by a hyperbolic function but were…

  5. Adolescents' performance on delay and probability discounting tasks: contributions of age, intelligence, executive functioning, and self-reported externalizing behavior.

    Science.gov (United States)

    Olson, Elizabeth A; Hooper, Catalina J; Collins, Paul; Luciana, Monica

    2007-11-01

    Healthy adolescents, ages 9-23, completed delay and probability discounting tasks and measures of verbal and nonverbal intelligence, executive functioning, and self-reported internalizing and externalizing behavior. Delay but not probability discounting decreased with age. Delay discounting was also associated with verbal intelligence and Go-NoGo and Iowa Gambling Task performance. Probability discounting was associated only with externalizing behavior. Findings conform to an accumulation of evidence that while delay and probability discounting may have some overlapping components, they also reflect some fundamentally different processes in this age group.

  6. Reward-based decision making in pathological gambling: the roles of risk and delay.

    Science.gov (United States)

    Wiehler, Antonius; Peters, Jan

    2015-01-01

    Pathological gambling (PG) is a non-substance based addiction that shares many behavioral and neural features with substance based addictions. However, in PG behavioral and neural changes are unlikely to be confounded by effects of acute or chronic drug exposure. Changes in reward based decision-making in particular increases in impulsivity are hallmark features of addictions. Here we review studies in PG that applied three reward-related decision tasks: the Iowa Gambling Task, probability discounting and delay discounting. We discuss the findings and focus on the impact of addiction severity and the relation of effects to impulsivity measures. While there is evidence that PGs differ from healthy controls on all three tasks, there is only little support for a further modulation of impairments by addiction severity. Conceptually, delay discounting is related to impulsivity measures and findings in this task show a considerable correlation with e.g. questionnaire-based measures of impulsivity. Taken together, impairments in PG on these three tasks are relatively well replicated, although impairments appear to be largely uncorrelated between tasks. An important next step will be to conceptualize a process-based account of behavioral impairments in PG.

  7. Shallow discounting of delayed cocaine by male rhesus monkeys when immediate food is the choice alternative.

    Science.gov (United States)

    Huskinson, Sally L; Myerson, Joel; Green, Leonard; Rowlett, James K; Woolverton, William L; Freeman, Kevin B

    2016-12-01

    Huskinson et al. (2015) recently examined delay discounting in monkeys choosing between an immediate drug (cocaine) reinforcer and a delayed nondrug (food) reinforcer. The present experiment examined the reverse situation: choice between immediate nondrug (food) and delayed drug (cocaine) reinforcers. Whereas the former choice situation exemplifies drug abuse from a delay-discounting perspective, our interest in the latter choice situation is derived from the observation that drug abusers, who characteristically are associated with impulsive choice, typically must devote considerable time to procuring drugs, often at the expense of immediate nondrug alternatives. Accordingly, we analyzed 3 male rhesus monkeys' choices between immediate food and delayed cocaine (0.1 and 0.2 mg/kg/injection) using a hyperbolic model that allowed us to compare discounting rates between qualitatively different reinforcers. Choice of immediate food increased with food amount, and choice functions generally shifted leftward as delay to cocaine increased, indicating a decrease in the subjective value of cocaine. Compared with our previous delay-discounting experiment with immediate cocaine versus delayed food, both doses of delayed cocaine were discounted at a shallow rate. The present results demonstrate that rhesus monkeys will tolerate relatively long delays in an immediate-food versus delayed-drug situation, suggesting that in intertemporal choices between cocaine and food, the subjective value of cocaine is less affected by the delay until reinforcement than is the subjective value of delayed food. More generally, the present findings suggest that although drug abusers may choose impulsively when immediate drug reinforcement is available, they exercise self-control in the acquisition of a highly preferred, delayed drug reinforcer. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

  8. Humans can adopt optimal discounting strategy under real-time constraints.

    Directory of Open Access Journals (Sweden)

    N Schweighofer

    2006-11-01

    Full Text Available Critical to our many daily choices between larger delayed rewards, and smaller more immediate rewards, are the shape and the steepness of the function that discounts rewards with time. Although research in artificial intelligence favors exponential discounting in uncertain environments, studies with humans and animals have consistently shown hyperbolic discounting. We investigated how humans perform in a reward decision task with temporal constraints, in which each choice affects the time remaining for later trials, and in which the delays vary at each trial. We demonstrated that most of our subjects adopted exponential discounting in this experiment. Further, we confirmed analytically that exponential discounting, with a decay rate comparable to that used by our subjects, maximized the total reward gain in our task. Our results suggest that the particular shape and steepness of temporal discounting is determined by the task that the subject is facing, and question the notion of hyperbolic reward discounting as a universal principle.

  9. Wait for It: Delay-Discounting and Academic Performance among an Irish Adolescent Sample

    Science.gov (United States)

    Freeney, Yseult; O'Connell, Michael

    2010-01-01

    Beyond cognitive ability and family background, are there other significant determinants of educational attainment? From research in psychology, economics, education and criminology, one powerful influence is the ability to delay gratification, operationalised in this paper as "delay-discounting". It is intuitively plausible that the ability to…

  10. Food reinforcement and delay discounting in zBMI-discordant siblings

    Science.gov (United States)

    The interaction of food reinforcement and the inability to delay gratification are related to adult energy intake and obesity. This study was designed to test the association of sibling pair differences in relative reinforcing efficacy of food and delay discounting on sibling pair differences in zBM...

  11. The Surprisingly Low Motivational Power of Future Rewards: Comparing Conventional Money-Based Measures of Discounting with Motivation-Based Measures

    Science.gov (United States)

    Ebert, Jane E. J.

    2010-01-01

    Temporal discount rates are often poor predictors of behaviors that we expect will be motivated by the future. The current research suggests this may be because conventional discounting measures are poor measures of the motivational value of future rewards. In six studies, I develop motivation-based measures of the present value (PV) of future…

  12. Letting go of the present: mind-wandering is associated with reduced delay discounting.

    Science.gov (United States)

    Smallwood, Jonathan; Ruby, Florence J M; Singer, Tania

    2013-03-01

    The capacity to self-generate mental content that is unrelated to the current environment is a fundamental characteristic of the mind, and the current experiment explored how this experience is related to the decisions that people make in daily life. We examined how task-unrelated thought (TUT) varies with the length of time participants are willing to wait for an economic reward, as measured using an inter-temporal discounting task. When participants performed a task requiring minimal attention, the greater the amount of time spent engaged in TUT the longer the individual was prepared to wait for an economic reward. These data indicate that self-generated thought engages processes associated with the successful management of long-term goals. Although immersion in the here and now is undeniably advantageous, under appropriate conditions the capacity to let go of the present and consider more pertinent personal goals may have its own rewards. Copyright © 2012 Elsevier Inc. All rights reserved.

  13. Gambling, Delay, and Probability Discounting in Adults With and Without ADHD.

    Science.gov (United States)

    Dai, Zhijie; Harrow, Sarah-Eve; Song, Xianwen; Rucklidge, Julia J; Grace, Randolph C

    2016-11-01

    We investigated the relationship between impulsivity, as measured by delay and probability discounting, and gambling-related cognitions and behavior in adults with and without ADHD. Adults who met Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV) diagnostic criteria for ADHD (n = 31) and controls (n = 29) were recruited from the community. All completed an interview that included an assessment of psychiatric disorders, gambling questionnaires, and simulated gambling, delay, and probability discounting tasks. The ADHD group was more likely to meet the criteria for problem gambling and was more impulsive than controls based on a composite discounting measure. ADHD symptoms were correlated with gambling-related cognitions and behavior. Probability, but not delay discounting, explained significant variance in gambling-related measures after controlling for ADHD symptoms. Results confirm an association between adult ADHD and gambling, and suggest that the facets of impulsivity related to risk proneness may be an independent risk factor for problem gambling in this population. © The Author(s) 2013.

  14. Explicit information reduces discounting behavior in monkeys

    Directory of Open Access Journals (Sweden)

    John ePearson

    2010-12-01

    Full Text Available Animals are notoriously impulsive in common laboratory experiments, preferring smaller, sooner rewards to larger, delayed rewards even when this reduces average reward rates. By contrast, the same animals often engage in natural behaviors that require extreme patience, such as food caching, stalking prey, and traveling long distances to high quality food sites. One possible explanation for this discrepancy is that standard laboratory delay discounting tasks artificially inflate impulsivity by subverting animals’ common learning strategies. To test this idea, we examined choices made by rhesus macaques in two variants of a standard delay discounting task. In the conventional variant, post-reward delays were uncued and adjusted to render total trial length constant; in the second, all delays were cued explicitly. We found that measured discounting was significantly reduced in the cued task, with discount rates well below those reported in studies using the standard uncued design. When monkeys had complete information, their decisions were more consistent with a strategy of reward rate maximization. These results indicate that monkeys, and perhaps other animals, are more patient than is normally assumed, and that laboratory measures of delay discounting may overstate impulsivity.

  15. Delay Discounting as an Index of Sustainable Behavior: Devaluation of Future Air Quality and Implications for Public Health.

    Science.gov (United States)

    Berry, Meredith S; Nickerson, Norma P; Odum, Amy L

    2017-09-01

    Poor air quality and resulting annual deaths represent significant public health concerns. Recently, rapid delay discounting (the devaluation of future outcomes) of air quality has been considered a potential barrier for engaging in long term, sustainable behaviors that might help to reduce emissions (e.g., reducing private car use, societal support for clean air initiatives). Delay discounting has been shown to be predictive of real world behavior outside of laboratory settings, and therefore may offer an important framework beyond traditional variables thought to measure sustainable behavior such as importance of an environmental issue, or environmental attitudes/values, although more research is needed in this area. We examined relations between discounting of air quality, respiratory health, and monetary gains and losses. We also examined, relations between discounting and self-reported importance of air quality and respiratory health, and nature relatedness. Results showed rapid delay discounting of all outcomes across the time frames assessed, and significant positive correlations between delay discounting of air quality, respiratory health, and monetary outcomes. Steeper discounting of monetary outcomes relative to air quality and respiratory health outcomes was observed in the context of gains; however, no differences in discounting were observed across losses of monetary, air quality, and respiratory health. Replicating the sign effect, monetary outcomes were discounted more steeply than monetary losses. Importance of air quality, respiratory health and nature relatedness were significantly and positively correlated with one another, but not with degree of delay discounting of any outcome, demonstrating the need for more comprehensive measures that predict pro-environmental behaviors that might benefit individuals and public health over time. These results add to our understanding of decision-making, and demonstrate alarming rates of delay discounting of

  16. Delay Discounting of Video Game Players: Comparison of Time Duration Among Gamers.

    Science.gov (United States)

    Buono, Frank D; Sprong, Matthew E; Lloyd, Daniel P; Cutter, Christopher J; Printz, Destiny M B; Sullivan, Ryan M; Moore, Brent A

    2017-02-01

    Video game addiction or Internet game disorder, as proposed by the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition), has similar criterion characteristics to other impulse control disorders. There is limited research examining video game addiction within a behavioral economic framework using delay discounting. The current study evaluated delay-discounting patterns of money and video game play by usual weekly hours of video game play. A total of 104 participants were split into 1 of 3 groups of video game players (low, medium, and high) and were asked to complete a monetary and video game discounting procedure through an online survey. Results showed significant differences between groups within both the monetary (p = 0.003) and video game discounting procedures (p = 0.004). Additionally, a positive linear relationship was noted between the groups across both procedures. The results of the current article reinforce previous findings that more hours of video game use are associated with greater impulsivity and provide implications for future research.

  17. Intolerance of uncertainty and decisions about delayed, probabilistic rewards.

    Science.gov (United States)

    Luhmann, Christian C; Ishida, Kanako; Hajcak, Greg

    2011-09-01

    Worry is the inflated concern about potential future threats and is a hallmark feature of generalized anxiety disorder. Previous theoretical work has suggested that worry may be a consequence of intolerance of uncertainty (IU). The current study seeks to explore the behavioral consequences of IU. Specifically, we examine how IU might be associated with aspects of reward-based decision making. We utilized a simple laboratory gambling task in which participants chose between small, low-probability rewards available immediately at the beginning of each trial and large, high-probability rewards only available after some variable delay. Results demonstrate that higher levels of intolerance of uncertainty were associated with a tendency to select the immediately available, but less valuable and less probable rewards. IU also predicted decision-makers' sensitivity to outcomes. We discuss the cognitive and affective mechanisms that are likely to underlie the observed decision-making behavior and the implications for anxiety disorders.

  18. A Tutorial on the Use of Excel 2010 and Excel for Mac 2011 for Conducting Delay-Discounting Analyses

    Science.gov (United States)

    Reed, Derek D.; Kaplan, Brent A.; Brewer, Adam T.

    2012-01-01

    In recent years, researchers and practitioners in the behavioral sciences have profited from a growing literature on delay discounting. The purpose of this article is to provide readers with a brief tutorial on how to use Microsoft Office Excel 2010 and Excel for Mac 2011 to analyze discounting data to yield parameters for both the hyperbolic…

  19. A comparison of delay discounting among substance users with and without suicide attempt history

    OpenAIRE

    Liu, Richard T.; Vassileva, Jasmin; Gonzalez, Raul; Martin, Eileen M.

    2012-01-01

    Although substance use disorders are associated with overall increased suicide risk, there is considerable variability in suicide risk among substance dependent individuals (SDIs). Impairment in impulse control is common among SDIs and may contribute to vulnerability to suicidal behavior. The present study examined the relation between one specific aspect of impulsivity, delay discounting, and suicide attempt history in a sample of SDIs. An interaction was observed between suicide attempt his...

  20. Relationship between cooperation in an iterated prisoner's dilemma game and the discounting of hypothetical outcomes.

    Science.gov (United States)

    Yi, Richard; Johnson, Matthew W; Bickel, Warren K

    2005-08-01

    A number of authors have proposed that preference for a larger, delayed reward in delay discounting is similar to cooperation in a repeated prisoner's dilemma game versus tit-for-tat. This proposal was examined by correlating delay-discounting (Experiment 1) and probability-discounting (Experiment 2) rates for hypothetical monetary gains and losses with performance in a repeated prisoner's dilemma game. Correlations between rate of delay discounting (discounting parameters and area under the curve) and proportion of cooperation in the repeated prisoner's dilemma game versus tit-for-tat were significant across three magnitudes, and correlations were generally higher with discounting for losses than with that for gains. As was expected, correlations between rate of delay discounting and performance versus a random strategy in the prisoner's dilemma game were not significant. Correlations between rate of probability-discounting and cooperation rate in a repeated prisoner's dilemma game versus neither a tit-for-tat nor a random strategy were significant.

  1. Impulse control and restrained eating among young women: Evidence for compensatory cortical activation during a chocolate-specific delayed discounting task.

    Science.gov (United States)

    Dong, Debo; Wang, Yulin; Jackson, Todd; Chen, Shuaiyu; Wang, Yu; Zhou, Feng; Chen, Hong

    2016-10-01

    Theory and associated research indicate that people with elevated restrained eating (RE) scores have higher risk for binge eating, future bulimic symptom onset and weight gain. Previous imaging studies have suggested hyper-responsive reward brain area activation in response to food cues contributes to this risk but little is known about associated neural impulse control mechanisms, especially when considering links between depleted cognitive resources related to unsuccessful RE. Towards illuminating this issue, we used a chocolate-specific delayed discounting (DD) task to investigate relations between RE scores, behavior impulsivity, and corresponding neural impulse control correlates in a functional magnetic resonance imaging (fMRI) study of 27 young women. Specifically, participants were required to choose between more immediate, smaller versus delayed, larger hypothetical chocolate rewards following initial consumption of a chocolate. As predicted, RE scores were correlated positively with behavior impulse control levels. More critically, higher RE scores were associated with stronger activation in impulse control region, the dorsal-lateral prefrontal cortex (DLPFC) during the completion of difficult decision trials reflecting higher cognitive demands and resource depletion relative to easy decision trials. Exploratory analyses revealed a positive correlation between RE scores and activity in a reward system hub, the right striatum. Moreover, a positive correlation between left DLPFC and striatum activation was posited to reflect, in part, impulse control region compensation in response to stronger reward signal among women with RE elevations. Findings suggested impulse control lapses may contribute to difficulties in maintaining RE, particularly when cognitive demands are high.

  2. Delay aversion but preference for large and rare rewards in two choice tasks: implications for the measurement of self-control parameters

    Directory of Open Access Journals (Sweden)

    Laviola Giovanni

    2006-06-01

    Full Text Available Abstract Background Impulsivity is defined as intolerance/aversion to waiting for reward. In intolerance-to-delay (ID protocols, animals must choose between small/soon (SS versus large/late (LL rewards. In the probabilistic discount (PD protocols, animals are faced with choice between small/sure (SS versus large/luck-linked (LLL rewards. It has been suggested that PD protocols also measure impulsivity, however, a clear dissociation has been reported between delay and probability discounting. Results Wistar adolescent rats (30- to 46-day-old were tested using either protocol in drug-free state. In the ID protocol, animals showed a marked shift from LL to SS reward when delay increased, and this despite adverse consequences on the total amount of food obtained. In the PD protocol, animals developed a stable preference for LLL reward, and maintained it even when SS and LLL options were predicted and demonstrated to become indifferent. We demonstrate a clear dissociation between these two protocols. In the ID task, the aversion to delay was anti-economical and reflected impulsivity. In the PD task, preference for large reward was maintained despite its uncertain delivery, suggesting a strong attraction for unitary rewards of great magnitude. Conclusion Uncertain delivery generated no aversion, when compared to delays producing an equivalent level of large-reward rarefaction. The PD task is suggested not to reflect impulsive behavior, and to generate patterns of choice that rather resemble the features of gambling. In summary, present data do indicate the need to interpret choice behavior in ID and PD protocols differently.

  3. The effect of probability discounting on reward seeking: a three-dimensional perspective

    Directory of Open Access Journals (Sweden)

    Yannick-Andre eBreton

    2014-08-01

    Full Text Available Rats will work for electrical stimulation pulses of the medial forebrain bundle. The rewarding effect arises from the volleys of action potentials fired by the stimulation and subsequent spatio-temporal integration of their post-synpatic impact. The proportion of time allocated to self-stimulation depends on the intensity of the rewarding effect as well as on other key determinants of decision-making, such as subjective opportunity costs and reward probability. We have proposed that a 3D model relating time allocation to the intensity and cost of reward can distinguish manipulations acting prior to the output of the spatio-temporal integrator from those acting at or beyond it. Here, we test this proposition by varying reward probability, a variable that influences the computation of payoff in the 3D model downstream from the output of the integrator. On riskless trials, reward was delivered on every occasion that the rat held down the lever for a cumulative duration called the ``price,'' whereas on risky trials, reward was delivered with probability 0.75 or 0.50. According to the model, the 3D structure relating time allocation to reward intensity and price is shifted leftward along the price axis by reductions in reward probability; the magnitude of the shift estimates the change in subjective probability. The predictions were borne out: reducing reward probability shifted the 3D structure systematically along the price axis while producing only small, inconsistent displacements along the pulse-frequency axis. The results confirm that the model can accurately distinguish manipulations acting at or beyond the spatio-temporal integrator and strengthen the conclusions of previous studies showing similar shifts following dopaminergic manipulations. Subjective and objective reward probabilities appeared indistinguishable over the range of 0.5 <= p <= 1.0.

  4. On the Expected Discounted Penalty Function in a Delayed-claims Risk Model

    Institute of Scientific and Technical Information of China (English)

    Hui MENG; Guo-jing WANG

    2012-01-01

    In this paper,we consider a risk model in which each main claim may induce a delayed claim,called a by-claim.We assume that the time for the occurrence of a by-claim is random.We investigate the expected discounted penalty function,and derive the defective renewal equation satisfied by it.We obtain some explicit results when the main claim and the by-claim are both exponentially distributed,respectively.We also present some numerical illustrations.

  5. The nature of impulsivity: visual exposure to natural environments decreases impulsive decision-making in a delay discounting task.

    Science.gov (United States)

    Berry, Meredith S; Sweeney, Mary M; Morath, Justice; Odum, Amy L; Jordan, Kerry E

    2014-01-01

    The benefits of visual exposure to natural environments for human well-being in areas of stress reduction, mood improvement, and attention restoration are well documented, but the effects of natural environments on impulsive decision-making remain unknown. Impulsive decision-making in delay discounting offers generality, predictive validity, and insight into decision-making related to unhealthy behaviors. The present experiment evaluated differences in such decision-making in humans experiencing visual exposure to one of the following conditions: natural (e.g., mountains), built (e.g., buildings), or control (e.g., triangles) using a delay discounting task that required participants to choose between immediate and delayed hypothetical monetary outcomes. Participants viewed the images before and during the delay discounting task. Participants were less impulsive in the condition providing visual exposure to natural scenes compared to built and geometric scenes. Results suggest that exposure to natural environments results in decreased impulsive decision-making relative to built environments.

  6. Cognitive Control Modulates Effects of Episodic Simulation on Delay Discounting in Aging

    Science.gov (United States)

    Sasse, Laura K.; Peters, Jan; Brassen, Stefanie

    2017-01-01

    Enhancing prospective thinking by tagging the future with specific episodic events has been shown to reduce delay discounting in young age (“tag-effect”). So far, it is unclear whether such beneficial effect extends to old adulthood. Since the general ability of future thinking and cognitive control are crucial modulators of temporal discounting in young age, potential age-related decline in these functions might impact on the effect. We focused on this issue by combining functional magnetic resonance imaging (fMRI) with an established intertemporal choice task including episodic “tags” in healthy older participants. Future thinking ability was assessed using autobiographical interviews for future event simulations and a visual search task was applied to assess participants’ cognitive control ability. In contrast to previous data in young adults, the group of older participants did not benefit from tagging the future with episodic events. Older participants’ cognitive control function was directly associated with discounting rates in the episodic conditions: the less the older adults were able to focus their attention the less they benefited from the inclusion of episodic events. Consistent with this, imaging results revealed that: (a) subjective value (SV) signals in the hippocampus and the anterior cingulate cortex (ACC) as well as; (b) hippocampal-striatal coupling during the episodic condition were positively related to participants’ control capacity. Our findings highlight the critical role of executive functioning for the simultaneous integration of episodic information with future value computation in aging. Boosting delay gratification by including episodic tags might hence be limited in older individuals with pronounced decline in distraction control. PMID:28352226

  7. Delayed discounting and hedonic hunger in the prediction of lab-based eating behavior.

    Science.gov (United States)

    Ely, Alice V; Howard, Janna; Lowe, Michael R

    2015-12-01

    Research suggests that characteristics identified in obese individuals, such as impulsive decision-making and hedonic hunger, may exist in nonobese populations. This study examined the independent and interactive effects of impulsive decision-making (measured via delay discounting, DD) and hedonic hunger (assessed with the Power of Food Scale, PFS) on food intake. Female participants (N=78) ate a self-determined amount of plain oatmeal, completed self-report measures and the delay discounting task, and participated in a sham taste test of palatable sweet and salty foods. Unexpectedly, PFS and DD scores interacted to predict consumption of the total amount of food consumed, and of oatmeal alone, but not of snack food alone. High-PFS participants consumed more when also high in DD, while low-PFS participants showed the opposite pattern of consumption. The findings identify variables that may increase propensity toward overconsumption and potential weight gain; future research is necessary to evaluate the utility of these constructs to predict increases in BMI over time.

  8. Can't wait to lose weight? Characterizing temporal discounting parameters for weight-loss.

    Science.gov (United States)

    Lim, Seung-Lark; Bruce, Amanda S

    2015-02-01

    Obesity is often related to steeper temporal discounting, that is, higher decision impulsivity for immediate rewards over delayed rewards. However, previous studies have measured temporal discounting parameters through monetary rewards. The aim of this study was to develop a temporal discounting measure based on weight-loss rewards, which may help to understand decision-making mechanisms more closely related to body weight regulation. After having their heights and weights measured, healthy young adults completed the Monetary Choice Questionnaire (MCQ), and an adapted version of the MCQ, with weight-loss as a reward. Participants also completed self-reports that measure obesity-related cognitive variables. For 42 participants who expressed a desire to lose weight, weight-loss rewards were discounted over time and had a positive correlation with temporal discounting for monetary rewards. Higher temporal discounting for weight loss rewards (i.e., preference for immediate weight loss) showed correlations with beliefs that obesity is under obese persons' control and largely due to lack of willpower, while temporal discounting parameters for monetary rewards did not. Taken together, our weight loss temporal discounting measure demonstrated both convergent and divergent validity, which can be utilized for future obesity research and interventions.

  9. Delay Discounting Mediates Parent-Adolescent Relationship Quality and Risky Sexual Behavior for Low Self-Control Adolescents

    Science.gov (United States)

    Kahn, Rachel E.; Holmes, Christopher; Farley, Julee P.; Kim-Spoon, Jungmeen

    2015-01-01

    Parent-adolescent relationship quality and delay discounting may play important roles in adolescents’ sexual decision making processes, and levels of self-control during adolescence could act as a buffer within these factors. This longitudinal study included 219 adolescent (55% male; mean age = 12.66 years at Wave 1; mean age = 15.10 years at Wave 2) and primary caregiver dyads. Structural equation modeling was utilized to determine whether delay discounting mediated the association between parent-adolescent relationship quality and adolescents’ risky sexual behavior and how this mediated association may differ between those with high versus low self-control. The results revealed parent-adolescent relationship quality plays a role in the development of risky sexual behavior indirectly through levels of delay discounting, but only for adolescents with low self-control. These findings could inform sex education policies and health prevention programs that address adolescent risky sexual behavior. PMID:26202153

  10. Temporal Discounting of Monetary Rewards in Children and Adolescents with ADHD and Autism Spectrum Disorders

    Science.gov (United States)

    Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

    2012-01-01

    It has been difficult to differentiate attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer…

  11. Syntax for calculation of discounting indices from the monetary choice questionnaire and probability discounting questionnaire.

    Science.gov (United States)

    Gray, Joshua C; Amlung, Michael T; Palmer, Abraham A; MacKillop, James

    2016-09-01

    The 27-item Monetary Choice Questionnaire (MCQ; Kirby, Petry, & Bickel, 1999) and 30-item Probability Discounting Questionnaire (PDQ; Madden, Petry, & Johnson, 2009) are widely used, validated measures of preferences for immediate versus delayed rewards and guaranteed versus risky rewards, respectively. The MCQ measures delayed discounting by asking individuals to choose between rewards available immediately and larger rewards available after a delay. The PDQ measures probability discounting by asking individuals to choose between guaranteed rewards and a chance at winning larger rewards. Numerous studies have implicated these measures in addiction and other health behaviors. Unlike typical self-report measures, the MCQ and PDQ generate inferred hyperbolic temporal and probability discounting functions by comparing choice preferences to arrays of functions to which the individual items are preconfigured. This article provides R and SPSS syntax for processing the MCQ and PDQ. Specifically, for the MCQ, the syntax generates k values, consistency of the inferred k, and immediate choice ratios; for the PDQ, the syntax generates h indices, consistency of the inferred h, and risky choice ratios. The syntax is intended to increase the accessibility of these measures, expedite the data processing, and reduce risk for error.

  12. Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards.

    Science.gov (United States)

    Miyazaki, Kayoko W; Miyazaki, Katsuhiko; Doya, Kenji

    2012-08-01

    The forebrain serotonergic system is a crucial component in the control of impulsive behaviors. We previously reported that the activity of serotonin neurons in the midbrain dorsal raphe nucleus increased when rats performed a task that required them to wait for delayed rewards. However, the causal relationship between serotonin neural activity and the tolerance for the delayed reward remained unclear. Here, we test whether the inhibition of serotonin neural activity by the local application of the 5-HT(1A) receptor agonist 8-hydroxy-2-(di-n-propylamino) tetralin in the dorsal raphe nucleus impairs rats' tolerance for delayed rewards. Rats performed a sequential food-water navigation task that required them to visit food and water sites alternately via a tone site to get rewards at both sites after delays. During the short (2 s) delayed reward condition, the inhibition of serotonin neural activity did not significantly influence the numbers of reward choice errors (nosepoke at an incorrect reward site following a conditioned reinforcer tone), reward wait errors (failure to wait for the delayed rewards), or total trials (sum of reward choice errors, reward wait errors, and acquired rewards). By contrast, during the long (7-11 s) delayed reward condition, the number of wait errors significantly increased while the numbers of total trials and choice errors did not significantly change. These results indicate that the activation of dorsal raphe serotonin neurons is necessary for waiting for long delayed rewards and suggest that elevated serotonin activity facilitates waiting behavior when there is the prospect of forthcoming rewards.

  13. Effect of orbitofrontal cortex lesions on temporal discounting in rats

    OpenAIRE

    Jo, Suhyun; Kim, Ko-Un; Lee, Daeyeol; Jung, Min Whan

    2013-01-01

    Although choices of both humans and animals are more strongly influenced by immediate than delayed rewards, methodological limitations have made it difficult to estimate the precise form of temporal discounting in animals. In the present study, we sought to characterize temporal discounting in rats and to test the role of the orbitofrontal cortex (OFC) in this process. Rats were trained in a novel intertemporal choice task in which the sequence of delay durations was randomized across trials....

  14. An EPQ model under cash discount and permissible delay in payments derived without derivatives

    Directory of Open Access Journals (Sweden)

    Huang Yung-Fu

    2007-01-01

    Full Text Available The main purpose of this paper is to investigate the case where the retailer’s unit selling price and the purchasing price per unit are not necessarily equal within the economic production quantity (EPQ framework under cash discount and permissible delay in payments. We establish the retailer’s inventory system as a cost minimization problem to determine the retailer’s optimal inventory cycle time, optimal order quantity and optimal payment time. This paper provides an algebraic approach to determine the optimal cycle time, optimal order quantity and optimal payment time. This approach provides one theorem to efficiently determine the optimal solution. Some previously published results of other researchers are deduced as special cases. Finally, numerical examples are given to illustrate the result and the managerial insights are also obtained.

  15. Delay discounting and frontostriatal fiber tracts: a combined DTI and MTR study on impulsive choices in healthy young adults.

    Science.gov (United States)

    Peper, Jiska S; Mandl, René C W; Braams, Barbara R; de Water, Erik; Heijboer, Annemieke C; Koolschijn, P Cédric M P; Crone, Eveline A

    2013-07-01

    Delay discounting, a measure of impulsive choice, has been associated with decreased control of the prefrontal cortex over striatum responses. The anatomical connectivity between both brain regions in delaying gratification remains unknown. Here, we investigate whether the quality of frontostriatal (FS) white matter tracts can predict individual differences in delay-discounting behavior. We use tract-based diffusion tensor imaging and magnetization transfer imaging to measure the microstructural properties of FS fiber tracts in 40 healthy young adults (from 18 to 25 years). We additionally explored whether internal sex hormone levels affect the integrity of FS tracts, based on the hypothesis that sex hormones modulate axonal density within prefrontal dopaminergic circuits. We calculated fractional anisotropy (FA), mean diffusivity (MD), longitudinal diffusivity, radial diffusivity (RD), and magnetization transfer ratio (MTR), a putative measure of myelination, for the FS tract. Results showed that lower integrity within the FS tract (higher MD and RD and lower FA), predicts faster discounting in both sexes. MTR was unrelated to delay-discounting performance. In addition, testosterone levels in males were associated with a lower integrity (higher RD) within the FS tract. Our study provides support for the hypothesis that enhanced structural integrity of white matter fiber bundles between prefrontal and striatal brain areas is associated with better impulse control.

  16. Domain-General and Domain-Specific Aspects of Temporal Discounting in Children with ADHD and Autism Spectrum Disorders (ASD): A Proof of Concept Study

    Science.gov (United States)

    Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

    2013-01-01

    It has been shown that delayed consumable rewards are discounted to a higher degree than money, which has been referred to as the "domain effect". Until now the effects of reward type on temporal discounting (TD) have mainly been studied in adults. Although there is evidence that children with attention-deficit/hyperactivity disorder (ADHD) tend…

  17. Domain-General and Domain-Specific Aspects of Temporal Discounting in Children with ADHD and Autism Spectrum Disorders (ASD): A Proof of Concept Study

    Science.gov (United States)

    Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

    2013-01-01

    It has been shown that delayed consumable rewards are discounted to a higher degree than money, which has been referred to as the "domain effect". Until now the effects of reward type on temporal discounting (TD) have mainly been studied in adults. Although there is evidence that children with attention-deficit/hyperactivity disorder (ADHD) tend…

  18. A delay discounting task produces a greater likelihood of waiting than a deferred gratification task.

    Science.gov (United States)

    Young, Michael E; McCoy, Anthony W

    2015-01-01

    A first-person-shooter video game was adapted for the study of choice between smaller sooner and larger later outcomes to compare the behavioral patterns produced by deferred gratification (DG) and delay discounting (DD) tasks. Participants played a game in which they could either fire their weapon sooner and do a small amount of damage or wait a few seconds to fire their weapon and do a larger amount of damage. For the DD task, a failure to fire within one second committed the player to waiting for the larger later outcome thus removing the opportunity to defect during the delay that is present in the DG task. The incentive structure changed multiple times during game play so that at times the optimal decision was to choose the smaller sooner outcome whereas at other times the optimal decision was to wait for the larger later outcome. Players assigned to the DD task showed a greater tendency to wait and lower sensitivity to the changing incentives.

  19. The relationship between temporal discounting and the prisoner's dilemma game in intranasal abusers of prescription opioids.

    Science.gov (United States)

    Yi, Richard; Buchhalter, August R; Gatchalian, Kirstin M; Bickel, Warren K

    2007-02-23

    Previous research on college students has found that cooperation in iterated prisoner's dilemma game is correlated with preference for delayed rewards in studies of temporal discounting. The present study attempted to replicate this finding in a drug-dependent population. Thirty-one individuals who intranasally abuse prescription opioids participated in temporal discounting and iterated prisoner's dilemma game procedures during intake for a treatment study. Rate of temporal discounting was determined for each participant at two hypothetical reward magnitudes, as well as proportion of cooperation in a 60-trial iterated prisoner's dilemma game versus a tit-for-tat strategy. Cooperation in the prisoner's dilemma game and temporal discounting rates were significantly correlated in the predicted direction: individuals who preferred delayed rewards in the temporal discounting task were more likely to cooperate in the prisoner's dilemma game.

  20. The nature of impulsivity: visual exposure to natural environments decreases impulsive decision-making in a delay discounting task.

    Directory of Open Access Journals (Sweden)

    Meredith S Berry

    Full Text Available The benefits of visual exposure to natural environments for human well-being in areas of stress reduction, mood improvement, and attention restoration are well documented, but the effects of natural environments on impulsive decision-making remain unknown. Impulsive decision-making in delay discounting offers generality, predictive validity, and insight into decision-making related to unhealthy behaviors. The present experiment evaluated differences in such decision-making in humans experiencing visual exposure to one of the following conditions: natural (e.g., mountains, built (e.g., buildings, or control (e.g., triangles using a delay discounting task that required participants to choose between immediate and delayed hypothetical monetary outcomes. Participants viewed the images before and during the delay discounting task. Participants were less impulsive in the condition providing visual exposure to natural scenes compared to built and geometric scenes. Results suggest that exposure to natural environments results in decreased impulsive decision-making relative to built environments.

  1. Reinforcer magnitude affects delay discounting and influences effects of d-amphetamine in rats.

    Science.gov (United States)

    Krebs, Christopher A; Reilly, William J; Anderson, Karen G

    2016-09-01

    Impulsive choice in humans can be altered by changing reinforcer magnitude; however, this effect has not been found in rats. Current levels of impulsive choice can also influence effects of d-amphetamine. This study used a within-subject assessment to determine if impulsive choice is sensitive to changes in reinforcer magnitude, and whether effects of d-amphetamine are related to current levels of impulsive choice. A discounting procedure in which choice was for a smaller reinforcer available immediately or a larger reinforcer available after a delay that increased within session was used. Reinforcer magnitude was manipulated between conditions and impulsive choice was quantified using area under the curve (AUC). In the Smaller-Magnitude (SM) Condition, choice was between one food pellet and three food pellets. In the Larger-Magnitude (LM) Condition, choice was between two food pellets and six food pellets. Impulsive choice was greater in the SM Condition compared to the LM Condition. Further, effects of d-amphetamine (0.1-1.8mg/kg) were related to differences in impulsive choice. d-Amphetamine increased impulsive choice in the LM Condition, but had no effect on impulsive choice in the SM Condition. Overall, these results show that impulsive choice in rats is sensitive to changes in reinforcer magnitude, and that effects of d-amphetamine are influenced by current levels of impulsive choice.

  2. Delay Discounting Mediates Parent-Adolescent Relationship Quality and Risky Sexual Behavior for Low Self-Control Adolescents.

    Science.gov (United States)

    Kahn, Rachel E; Holmes, Christopher; Farley, Julee P; Kim-Spoon, Jungmeen

    2015-09-01

    Parent-adolescent relationship quality and delay discounting may play important roles in adolescents' sexual decision making processes, and levels of self-control during adolescence could act as a buffer within these factors. This longitudinal study included 219 adolescent (55 % male; mean age = 12.66 years at Wave 1; mean age = 15.10 years at Wave 2) and primary caregiver dyads. Structural equation modeling (SEM) was utilized to determine whether delay discounting mediated the association between parent-adolescent relationship quality and adolescents' risky sexual behavior and how this mediated association may differ between those with high versus low self-control. The results revealed parent-adolescent relationship quality plays a role in the development of risky sexual behavior indirectly through levels of delay discounting, but only for adolescents with low self-control. These findings could inform sex education policies and health prevention programs that address adolescent risky sexual behavior.

  3. Delay discounting, but not disinhibition or inattention, partially mediates the effects of neuroticism on disordered eating in adolescents.

    Science.gov (United States)

    Thamotharan, Sneha; Hubbard, Meagan; Fields, Sherecce

    2015-08-01

    Adolescence represents an integral developmental period for the prevention and intervention of disordered eating. Individuals with high levels of neuroticism have been shown to respond with greater impulsivity and use of disordered eating as a coping mechanism. However, the exact mechanism through which neuroticism and impulsivity affect disordered eating remains unknown. To understand the effects of personality and impulsivity on disordered eating in adolescence, the present study aimed to investigate whether impulsivity mediated the relationship between neuroticism and disordered eating. Adolescents (N=40) between the ages of 13 and 19 (Mage=18.25years; S.D.=1.30) were queried on eating attitudes and personality, as well as completed behavioral tasks assessing impulsivity (delay discounting, disinhibition and inattention). Mediation analyses revealed that neuroticism was significantly associated with patterns of disordered eating, but delay discounting, and not disinhibition and inattention, appeared to mediate the relationship between neuroticism and disordered eating. These results should guide prospective research exploring the relations between neurotic and impulsive behavior, particularly delay discounting on disordered eating, which will assist in future treatment efforts targeting the development of maladaptive eating behaviors.

  4. The Q-Exponential Decay of Subjective Probability for Future Reward: A Psychophysical Time Approach

    Directory of Open Access Journals (Sweden)

    Taiki Takahashi

    2014-10-01

    Full Text Available This study experimentally examined why subjective probability for delayed reward decays non-exponentially (“hyperbolically”, i.e., q ˂ 1 in the q-exponential discount function in humans. Our results indicate that nonlinear psychophysical time causes hyperbolic time-decay of subjective probability for delayed reward. Implications for econophysics and neuroeconomics are discussed.

  5. Neural hyporesponsiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/hyperactivity disorder.

    Science.gov (United States)

    Plichta, Michael M; Vasic, Nenad; Wolf, Robert Christian; Lesch, Klaus-Peter; Brummer, Dagmar; Jacob, Christian; Fallgatter, Andreas J; Grön, Georg

    2009-01-01

    Dysfunctional reward processing, accompanied by a limited ability to tolerate reward delays, has been proposed as an important feature in attention-deficit/hyperactivity disorder (ADHD). Using functional magnetic resonance imaging (fMRI), brain activation in adult patients with ADHD (n=14) and healthy control subjects (n=12) was examined during a series of choices between two monetary reward options that varied by delay to delivery. Compared with healthy control subjects, hyporesponsiveness of the ventral-striatal reward system was replicated in patients with ADHD and was evident for both immediate and delayed rewards. In contrast, delayed rewards evoked hyperactivation in dorsal caudate nucleus and amygdala of ADHD patients. In both structures, neural activity toward delayed rewards was significantly correlated with self-rated ADHD symptom severity. The finding of ventral-striatal hyporesponsiveness during immediate and delayed reward processing in patients with ADHD further strengthens the concept of a diminished neural processing of rewards in ADHD. Hyperactivation during delayed reward processing, gradually increasing along the ventral-to-dorsal extension of the caudate nucleus, and especially the concomitant hyperactivation of the amygdala are in accordance with predictions of the delay aversion hypothesis.

  6. Associations between depression, distress tolerance, delay discounting, and alcohol-related problems in European American and African American college students.

    Science.gov (United States)

    Dennhardt, Ashley A; Murphy, James G

    2011-12-01

    Although levels of heavy drinking and alcohol-related problems are high in college students, there is significant variability in the number and type of problems experienced, even among students who drink heavily. African American students drink less and experience fewer alcohol-related problems than European American students, but are still at risk, and little research has investigated the potentially unique patterns and predictors of problems among these students. Depression, distress tolerance, and delay discounting have been implicated in adult substance abuse and may be important predictors of alcohol problem severity among college students. We examined the relationship between these variables and alcohol-related problems among African American and European American students (N = 206; 53% female; 68% European American; 28% African American) who reported recent heavy drinking. In regression models that controlled for drinking level, depression, distress tolerance, and delay discounting were associated with alcohol problems among African American students, but only depression was associated with alcohol problems among European American students. These results suggest that negative affect is a key risk factor for alcohol problems among college student drinkers. For African American students, the inability to tolerate negative emotions and to organize their behavior around future outcomes may also be especially relevant risk factors.

  7. Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective

    Science.gov (United States)

    Story, Giles W.; Vlaev, Ivo; Seymour, Ben; Darzi, Ara; Dolan, Raymond J.

    2014-01-01

    The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a “model-based” (or goal-directed) system and a “model-free” (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes. PMID:24659960

  8. Time discounting and time preference in animals: A critical review.

    Science.gov (United States)

    Hayden, Benjamin Y

    2016-02-01

    Animals are an important model for studies of impulsivity and self-control. Many studies have made use of the intertemporal choice task, which pits small rewards available sooner against larger rewards available later (typically several seconds), repeated over many trials. Preference for the sooner reward is often taken to indicate impulsivity and/or a failure of self-control. This review shows that very little evidence supports this assumption; on the contrary, ostensible discounting behavior may reflect a boundedly rational but not necessarily impulsive reward-maximizing strategy. Specifically, animals may discount weakly, or even adopt a long-term rate-maximizing strategy, but fail to fully incorporate postreward delays into their choices. This failure may reflect learning biases. Consequently, tasks that measure animal discounting may greatly overestimate the true discounting and may be confounded by processes unrelated to time preferences. If so, animals may be much more patient than is widely believed; human and animal intertemporal choices may reflect unrelated mental operations; and the shared hyperbolic shape of the human and animal discount curves, which is used to justify cross-species comparisons, may be coincidental. The discussion concludes with a consideration of alternative ways to measure self-control in animals.

  9. Delay-Amount Tradeoffs in Choices by Pigeons and Rats: Hyperbolic versus Exponential Discounting

    Science.gov (United States)

    Mazur, James E.; Biondi, Dawn R.

    2009-01-01

    An adjusting-delay procedure was used to study the choices of pigeons and rats when both delay and amount of reinforcement were varied. In different conditions, the choice alternatives included one versus two reinforcers, one versus three reinforcers, and three versus two reinforcers. The delay to one alternative (the standard alternative) was…

  10. No food for thought: moderating effects of delay discounting and future time perspective on the relation between income and food insecurity1234

    Science.gov (United States)

    Epstein, Leonard H; Jankowiak, Noelle; Lin, Henry; Paluch, Rocco; Koffarnus, Mikhail N; Bickel, Warren K

    2014-01-01

    Background: Low income is related to food insecurity, and research has suggested that a scarcity of resources associated with low income can shift attention to the present, thereby discounting the future. Objective: We tested whether attending to the present and discounting the future may moderate the influence of income on food insecurity. Design: Delay discounting and measures of future time perspective (Zimbardo Time Perspective Inventory, Consideration of Future Consequences Scale, time period of financial planning, and subjective probability of living to age 75 y) were studied as moderators of the relation between income and food insecurity in a diverse sample of 975 adults, 31.8% of whom experienced some degree of food insecurity. Results: Income, financial planning, subjective probability of living to age 75 y, and delay discounting predicted food insecurity as well as individuals who were high in food insecurity. Three-way interactions showed that delay discounting interacted with financial planning and income to predict food insecurity (P = 0.003). At lower levels of income, food insecurity was lowest for subjects who had good financial planning skills and did not discount the future, whereas having good financial skills and discounting the future had minimal influence on food insecurity. The same 3-way interaction was observed when high food insecurity was predicted (P = 0.008). Conclusion: Because of the role of scarce resources on narrowing attention and reducing prospective thinking, research should address whether modifying future orientation may reduce food insecurity even in the face of diminishing financial resources. This trial was registered at clinicaltrials.gov as NCT02099812. PMID:25008855

  11. The arithmetic of discounting.

    Science.gov (United States)

    Killeen, Peter R

    2015-01-01

    Most current models of delay discounting multiply the nominal value of a good whose receipt is delayed, by a discount factor that is some function of that delay. This article reviews the logic of a theory that discounts the utility of delayed goods by adding the utility of the good to the disutility of the delay. In limiting cases it approaches other familiar models, such as hyperbolic discounting. In nonlimit cases it makes different predictions, generally requiring, inter alia, a magnitude effect when the value of goods is varied. A different theory is proposed for conditioning experiments. In it utility is computed as the average reinforcing strength of the stimuli that signal the delay. Both theories are extended to experiments in which degree of preference is measured, rather than adjustment to iso-utility values. © Society for the Experimental Analysis of Behavior.

  12. The influence of mortality and socioeconomic status on risk and delayed rewards: a life history theory approach.

    Science.gov (United States)

    Griskevicius, Vladas; Tybur, Joshua M; Delton, Andrew W; Robertson, Theresa E

    2011-06-01

    Why do some people take risks and live for the present, whereas others avoid risks and save for the future? The evolutionary framework of life history theory predicts that preferences for risk and delay in gratification should be influenced by mortality and resource scarcity. A series of experiments examined how mortality cues influenced decisions involving risk preference (e.g., $10 for sure vs. 50% chance of $20) and temporal discounting (e.g., $5 now vs. $10 later). The effect of mortality depended critically on whether people grew up in a relatively resource-scarce or resource-plentiful environment. For individuals who grew up relatively poor, mortality cues led them to value the present and gamble for big immediate rewards. Conversely, for individuals who grew up relatively wealthy, mortality cues led them to value the future and avoid risky gambles. Overall, mortality cues appear to propel individuals toward diverging life history strategies as a function of childhood socioeconomic status, suggesting important implications for how environmental factors influence economic decisions and risky behaviors.

  13. How Many Impulsivities? A Discounting Perspective

    Science.gov (United States)

    Green, Leonard; Myerson, Joel

    2013-01-01

    People discount the value of delayed and uncertain outcomes, and how steeply individuals discount is thought to reflect how impulsive they are. From this perspective, steep discounting of delayed outcomes (which fails to maximize long-term welfare) and shallow discounting of probabilistic outcomes (which fails to adequately take risk into account)…

  14. Rewards.

    Science.gov (United States)

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today.

  15. A Reduction in Delay Discounting by Using Episodic Future Imagination and the Association with Episodic Memory Capacity

    Science.gov (United States)

    Hu, Xiaochen; Kleinschmidt, Helena; Martin, Jason A.; Han, Ying; Thelen, Manuela; Meiberth, Dix; Jessen, Frank; Weber, Bernd

    2017-01-01

    Delay discounting (DD) refers to the phenomenon that individuals discount future consequences. Previous studies showed that future imagination reduces DD, which was mediated by functional connectivity between medial prefrontal valuation areas and a key region for episodic memory (hippocampus). Future imagination involves an initial period of construction and a later period of elaboration, with the more elaborative latter period recruiting more cortical regions. This study examined whether elaborative future imagination modulated DD, and if so, what are the underlying neural substrates. It was assumed that cortical areas contribute to the modulation effect during the later period of imagination. Since future imagination is supported by episodic memory capacity, we additionally hypothesize that the neural network underlying the modulation effect is related to individual episodic memory capacity. Twenty-two subjects received an extensive interview on personal future events, followed by an fMRI DD experiment with and without the need to perform elaborative future imagination simultaneously. Subjects' episodic memory capacity was also assessed. Behavioral results replicate previous findings of a reduced discount rate in the DD plus imagination condition compared to the DD only condition. The behavioral effect positively correlated with: (i) subjective value signal changes in midline brain structures during the initial imagination period; and (ii) signal changes in left prefrontoparietal areas during the later imagination period. Generalized psychophysiological interaction (gPPI) analyses reveal positive correlations between the behavioral effect and functional connectivity among the following areas: right anterior cingulate cortex (ACC) and left hippocampus; left inferior parietal cortex (IPC) and left hippocampus; and left IPC and bilateral occipital cortices. These changes in functional connectivity are also associated with episodic memory capacity. A hierarchical

  16. Personality influences temporal discounting preferences: behavioral and brain evidence.

    Science.gov (United States)

    Manning, Joshua; Hedden, Trey; Wickens, Nina; Whitfield-Gabrieli, Susan; Prelec, Drazen; Gabrieli, John D E

    2014-09-01

    Personality traits are stable predictors of many life outcomes that are associated with important decisions that involve tradeoffs over time. Therefore, a fundamental question is how tradeoffs over time vary from person to person in relation to stable personality traits. We investigated the influence of personality, as measured by the Five-Factor Model, on time preferences and on neural activity engaged by intertemporal choice. During functional magnetic resonance imaging (fMRI), participants made choices between smaller-sooner and larger-later monetary rewards. For each participant, we estimated a constant-sensitivity discount function that dissociates impatience (devaluation of future consequences) from time sensitivity (consistency with rational, exponential discounting). Overall, higher neuroticism was associated with a relatively greater preference for immediate rewards and higher conscientiousness with a relatively greater preference for delayed rewards. Specifically, higher conscientiousness correlated positively with lower short-term impatience and more exponential time preferences, whereas higher neuroticism (lower emotional stability) correlated positively with higher short-term impatience and less exponential time preferences. Cognitive-control and reward brain regions were more activated when higher conscientiousness participants selected a smaller-sooner reward and, conversely, when higher neuroticism participants selected a larger-later reward. The greater activations that occurred when choosing rewards that contradicted personality predispositions may reflect the greater recruitment of mental resources needed to override those predispositions. These findings reveal that stable personality traits fundamentally influence how rewards are chosen over time. Copyright © 2014 Elsevier Inc. All rights reserved.

  17. Effects of mindful eating training on delay and probability discounting for food and money in obese and healthy-weight individuals.

    Science.gov (United States)

    Hendrickson, Kelsie L; Rasmussen, Erin B

    2013-07-01

    Obese individuals tend to behave more impulsively than healthy weight individuals across a variety of measures, but it is unclear whether this pattern can be altered. The present study examined the effects of a mindful eating behavioral strategy on impulsive and risky choice patterns for hypothetical food and money. In Experiment 1, 304 participants completed computerized delay and probability discounting tasks for food-related and monetary outcomes. High percent body fat (PBF) predicted more impulsive choice for food, but not small-value money, replicating previous work. In Experiment 2, 102 randomly selected participants from Experiment 1 were assigned to participate in a 50-min workshop on mindful eating or to watch an educational video. They then completed the discounting tasks again. Participants who completed the mindful eating session showed more self-controlled and less risk-averse discounting patterns for food compared to baseline; those in the control condition discounted similarly to baseline rates. There were no changes in discounting for money for either group, suggesting stimulus specificity for food for the mindful eating condition.

  18. Anodal Stimulation of the Left DLPFC Increases IGT Scores and Decreases Delay Discounting Rate in Healthy Males

    Directory of Open Access Journals (Sweden)

    Qinghua He

    2016-09-01

    Full Text Available Previous correlational imaging studies have implicated the dorsolateral prefrontal cortex (DLPFC in decision making. Using High-Definition Transcranial Direct Current Stimulation (HD-tDCS, the present study directly investigated the causal role of the DLPFC in performing the Iowa Gambling Task (IGT and the Inter-Temporal Choice (ITC task. Three experiments were conducted: Exp. 1 (N = 41 to study the left DLPFC, Exp. 2 (N = 49 to study the right DLPFC, and Exp. 3 (N = 20, a subset of those in Exp. 1 to switch the experimental and control conditions. All participants were healthy male college students. For Exps. 1 and 2, participants were randomly assigned to either the HD- tDCS or the sham stimulation condition. For Exp. 3, participants were assigned to the condition they were not in during Exp. 1. Results showed that HD-tDCS over the left DLPFC increased IGT score, decreased the recency parameter in IGT, and lowered delay discounting rate (k in the ITC task. We discussed the potential roles of impulse control and time perception in mediating the effect of tDCS stimulation of left DLPFC on decision making. Our results have clinical implications for the treatment of disorders involving poor decision-making, such as addictions.

  19. Examining educational attainment, prepregnancy smoking rate, and delay discounting as predictors of spontaneous quitting among pregnant smokers.

    Science.gov (United States)

    White, Thomas J; Redner, Ryan; Skelly, Joan M; Higgins, Stephen T

    2014-10-01

    We investigated three potential predictors (educational attainment, prepregnancy smoking rate, and delay discounting [DD]) of spontaneous quitting among pregnant smokers. These predictors were examined alone and in combination with other potential predictors using study-intake assessments from controlled clinical trials examining the efficacy of financial incentives for smoking cessation and relapse prevention. Data from 349 pregnant women (231 continuing smokers and 118 spontaneous quitters) recruited from the greater Burlington, VT, area contributed to this secondary analysis, including psychiatric/sociodemographic characteristics, smoking characteristics, and performance on a computerized DD task. Educational attainment, smoking rate, and DD values were each significant predictors of spontaneous quitting in univariate analyses. A model examining those three predictors together retained educational attainment as a main effect and revealed a significant interaction of DD and smoking rate (i.e., DD was a significant predictor at lower but not higher smoking rates). A final model considering all potential predictors, included education, the interaction of DD and smoking rate, and five additional predictors (i.e., stress ratings, the belief that smoking during pregnancy will "greatly harm my baby," age of smoking initiation, marital status, and prior quit attempts during pregnancy). The study presented here contributes new knowledge on predictors of spontaneous quitting among pregnant smokers with substantive practical implications for reducing smoking during pregnancy.

  20. Future Discounting in Congo Basin Hunter-Gatherers Declines with Socio-Economic Transitions.

    Directory of Open Access Journals (Sweden)

    Gul Deniz Salali

    Full Text Available Humans have a tendency to discount the future; that is we value small, short-term rewards over larger, long-term rewards. The degree of future discounting, however, changes in response to socio-ecological factors. Here, we study Mbendjele BaYaka hunter-gatherers of northern Congo and their farmer neighbours to investigate adaptations in inter-temporal preferences in humans. We argue that in immediate-return systems, where food storage is absent and egalitarianism is enforced through levelling mechanisms, future discounting is an adaptive strategy to prevent wealth accumulation and the emergence of hierarchies. This ensures food sharing and allows for survival in unpredictable environments where there is risk of an energy shortfall. On the other hand, when food storage is made possible by the emergence of agriculture or as seen in some delayed-return hunter-gatherer populations, wealth accumulation, hierarchies and lower discount rates become the adaptive strategy. Therefore, individuals in immediate-return, egalitarian societies will discount the future more than those in non-egalitarian, delayed-return societies. Consistent with the predictions we found that market integration and socio-economic transitions decrease the future discounting in Mbendjele hunter-gatherers. Our measures of socio-economic differences marked this transition in hunter-gatherers living in a logging town. The degree of future-discounting was the same between more market-integrated hunter-gatherers and their farmer neighbours.

  1. Delay Discounting Rates Are Temporally Stable in an Equivalent Present Value Procedure Using Theoretical and Area under the Curve Analyses

    Science.gov (United States)

    Harrison, Justin; McKay, Ryan

    2012-01-01

    Temporal discounting rates have become a popular dependent variable in social science research. While choice procedures are commonly employed to measure discounting rates, equivalent present value (EPV) procedures may be more sensitive to experimental manipulation. However, their use has been impeded by the absence of test-retest reliability data.…

  2. What can the monetary incentive delay task tell us about the neural processing of reward and punishment?

    Directory of Open Access Journals (Sweden)

    Lutz K

    2014-04-01

    Full Text Available Kai Lutz,1–3 Mario Widmer1,2,41Department of Neurology, University Hospital Zürich, Zürich, 2Cereneo, Center for Neurology and Rehabilitation, Vitznau, 3Division of Neuropsychology, Institute of Psychology, University of Zürich, Zürich, 4Neural Control of Movement Lab, ETH Zürich, Zürich, SwitzerlandAbstract: Since its introduction in 2000, the monetary incentive delay (MID task has been used extensively to investigate changes in neural activity in response to the processing of reward and punishment in healthy, but also in clinical populations. Typically, the MID task requires an individual to react to a target stimulus presented after an incentive cue to win or to avoid losing the indicated reward. In doing so, this paradigm allows the detailed examination of different stages of reward processing like reward prediction, anticipation, outcome processing, and consumption as well as the processing of tasks under different reward conditions. This review gives an overview of different utilizations of the MID task by outlining the neuronal processes involved in distinct aspects of human reward processing, such as anticipation versus consumption, reward versus punishment, and, with a special focus, reward-based learning processes. Furthermore, literature on specific influences on reward processing like behavioral, clinical and developmental influences, is reviewed, describing current findings and possible future directions.Keywords: reward, punishment, dopamine, reward system

  3. Reward type and behavioural patterns predict dogs’ success in a delay of gratification paradigm

    Science.gov (United States)

    Brucks, Désirée; Soliani, Matteo; Range, Friederike; Marshall-Pescini, Sarah

    2017-01-01

    Inhibiting an immediate behaviour in favour of an alternative but more advantageous behaviour has been linked to individual success in life, especially in humans. Dogs, which have been living in the human environment for thousands of years, are exposed to daily situations that require inhibition different in context from other non-domesticated species. One task regularly used to study inhibitory control is the delay of gratification task, which requires individuals to choose between an immediate option of lower value and a delayed option of higher value. We tested sixteen dogs in a non-social delay of gratification task, conducting two different conditions: a quality and a quantity condition. While the majority of dogs failed to wait for more than 10 s, some dogs tolerated delays of up to 140 s, while one dog waited for 15 minutes. Moreover, dogs had more difficulties to wait if the reward increased in terms of quantity than quality. Interestingly, dogs were able to anticipate the delay duration and some dogs developed behavioural patterns that predicted waiting, which seems similar in some respects to ‘coping-strategies’ found in children, chimpanzees and parrots. Our results indicate that strategies to cope with impulsivity seem to be consistent and present across animal taxa. PMID:28272409

  4. Waiting for what comes later: capuchin monkeys show self-control even for nonvisible delayed rewards.

    Science.gov (United States)

    Perdue, Bonnie M; Bramlett, Jessica L; Evans, Theodore A; Beran, Michael J

    2015-09-01

    Self-control tasks used with nonhuman animals typically involve the choice between an immediate option and a delayed, but more preferred option. However, in many self-control scenarios, not only does the more impulsive option come sooner in time, it is often more concrete than the delayed option. For example, studies have presented children with the option of eating a visible marshmallow immediately, or foregoing it for a better reward that can only be seen later. Thus, the immediately available option is visible and concrete, whereas the delayed option is not visible and more abstract. We tested eight capuchin monkeys to better understand this potential effect by manipulating the visibility of the response options and the visibility of the baiting itself. Monkeys observed two food items (20 or 5 g pieces of banana) each being placed either on top of or inside of one of the two opaque containers attached to a revolving tray apparatus, either in full view of monkeys or occluded by a barrier. Trials ended when monkeys removed a reward from the rotating tray. To demonstrate self-control, monkeys should have allowed the smaller piece of food to pass if the larger piece was forthcoming. Overall, monkeys were successful on the task, allowing a smaller, visible piece of banana to pass from reach in order to access the larger, nonvisible banana piece. This was true even when the entire baiting process took place out of sight of the monkeys. This finding suggests that capuchin monkeys succeed on self-control tasks even when the delayed option is also more abstract than the immediate one-a situation likely faced by primates in everyday life.

  5. Association of cognition with temporal discounting in community based older persons

    Directory of Open Access Journals (Sweden)

    Boyle Patricia A

    2012-08-01

    Full Text Available Abstract Background The objective of this study was to test the hypothesis that cognitive function is negatively associated with temporal discounting in old age. Methods Participants were 388 community-dwelling older persons without dementia from the Rush Memory and Aging Project, an ongoing longitudinal epidemiologic study of aging in the Chicago metropolitan area. Temporal discounting was measured using standard questions in which participants were asked to choose between an immediate, smaller payment and a delayed, larger one. Cognition was measured using a detailed battery including 19 tests. The association between cognition and temporal discounting was examined via mixed models adjusted for age, sex, education, income, and the number of chronic medical conditions. Results Descriptive data revealed a consistent pattern whereby older persons with lower cognitive function were more likely to discount greater but delayed rewards compared to those with higher cognitive function. Further, in a mixed effect model adjusted for age, sex, education, income, and chronic medical conditions, global cognitive function was negatively associated with temporal discounting (estimate = −0.45, SE = 0.18, p = 0.015, such that a person with lower cognition exhibited greater discounting. Finally, in subsequent models examining domain specific associations, perceptual speed and visuospatial abilities were associated with temporal discounting, but episodic memory, semantic memory and working memory were not. Conclusion Among older persons without dementia, a lower level of cognitive function is associated with greater temporal discounting. These findings have implications regarding the ability of older persons to make decisions that involve delayed rewards but maximize well-being.

  6. Introducing Upfront Money Can Decrease Discounting in Intertemporal Choices with Losses.

    Science.gov (United States)

    Jiang, Cheng-Ming; Sun, Hong-Yue; Zheng, Sheng-Hua; Wang, Liang-Jun; Qin, Yu

    2016-01-01

    People generally tend to advance gains and postpone losses in intertemporal choice. Jiang et al. (2014) recently showed that adding upfront losses or gains to both smaller and sooner (SS) and larger and later (LL) rewards can decrease people's discounting. To account for this decrease, they proposed the salience hypothesis, which states that introducing upfront losses or gains makes the money dimension more salient than not, thus increasing people's preference for LL rewards. Considering that decreasing the discounting of delayed losses is imperative and that most previous studies have focused on intertemporal choices with gains, in the current paper we conducted two experiments and used hypothetical money outcomes to examine whether the effect of upfront money could be extended to intertemporal choices with losses. The results showed that when both SS and LL intertemporal losses were combined with an upfront loss or gain, people's discounting rate decreased and the preference for the SS option increased. This finding further supports the salience account.

  7. Discounting Behavior

    DEFF Research Database (Denmark)

    Andersen, Steffen; Harrison, Glenn W.; Lau, Morten

    2014-01-01

    We re-evaluate the theory, experimental design and econometrics behind claims that individuals exhibit non-constant discounting behavior. Theory points to the importance of controlling for the non-linearity of the utility function of individuals, since the discount rate is defined over time......-dated utility flows and not flows of money. It also points to a menagerie of functional forms to characterize different types of non-constant discounting behavior. The implied experimental design calls for individuals to undertake several tasks to allow us to identify these models, and to several treatments...

  8. Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2015-08-01

    Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward.

  9. Starlings uphold principles of economic rationality for delay and probability of reward.

    Science.gov (United States)

    Monteiro, Tiago; Vasconcelos, Marco; Kacelnik, Alex

    2013-04-07

    Rationality principles are the bedrock of normative theories of decision-making in biology and microeconomics, but whereas in microeconomics, consistent choice underlies the notion of utility; in biology, the assumption of consistent selective pressures justifies modelling decision mechanisms as if they were designed to maximize fitness. In either case, violations of consistency contradict expectations and attract theoretical interest. Reported violations of rationality in non-humans include intransitivity (i.e. circular preferences) and lack of independence of irrelevant alternatives (changes in relative preference between options when embedded in different choice sets), but the extent to which these observations truly represent breaches of rationality is debatable. We tested both principles with starlings (Sturnus vulgaris), training subjects either with five options differing in food delay (exp. 1) or with six options differing in reward probability (exp. 2), before letting them choose repeatedly one option out of several binary and trinary sets of options. The starlings conformed to economic rationality on both tests, showing strong stochastic transitivity and no violation of the independence principle. These results endorse the rational choice and optimality approaches used in behavioural ecology, and highlight the need for functional and mechanistic enquiring when apparent violations of such principles are observed.

  10. Positive temporal dependence of the biological clock implies hyperbolic discounting

    Directory of Open Access Journals (Sweden)

    Debajyoti eRay

    2011-01-01

    Full Text Available Temporal preferences of animals and humans often exhibit inconsistencies, whereby an earlier, smaller reward may be preferred when it occurs immediately but not when it is delayed. Such choices reflect hyperbolic discounting of future rewards, rather than the exponential discounting required for temporal consistency. Simultaneously, however, evidence has emerged that suggests that animals and humans have an internal representation of time that often differs from the calendar time used in detection of temporal inconsistencies. Here, we prove that temporal inconsistencies emerge if fixed durations in calendar time are experienced as positively related (positive quadrant dependent. Hence, what are time-consistent choices within the time framework of the decision maker appear as time-inconsistent to an outsider who analyzes choices in calendar time. As the biological clock becomes more variable, the fit of the hyperbolic discounting model improves. A recent alternative explanation for temporal choice inconsistencies builds on persistent under-estimation of the length of distant time intervals. By increasing the expected speed of our stochastic biological clock for time farther into the future, we can emulate this explanation. Ours is therefore an encompassing theoretical framework that predicts context-dependent degrees of intertemporal choice inconsistencies, to the extent that context can generate changes in autocorrelation, variability, and expected speed of the biological clock. Our finding should lead to novel experiments that will clarify the role of time perception in impulsivity, with critical implications for, among others, our understanding of aging, drug abuse and pathological gambling.

  11. Modulation of impulsivity and reward sensitivity in intertemporal choice by striatal and midbrain dopamine synthesis in healthy adults.

    Science.gov (United States)

    Smith, Christopher T; Wallace, Deanna L; Dang, Linh C; Aarts, Esther; Jagust, William J; D'Esposito, Mark; Boettiger, Charlotte A

    2016-03-01

    Converging evidence links individual differences in mesolimbic and mesocortical dopamine (DA) to variation in the tendency to choose immediate rewards ("Now") over larger, delayed rewards ("Later"), or "Now bias." However, to date, no study of healthy young adults has evaluated the relationship between Now bias and DA with positron emission tomography (PET). Sixteen healthy adults (ages 24-34 yr; 50% women) completed a delay-discounting task that quantified aspects of intertemporal reward choice, including Now bias and reward magnitude sensitivity. Participants also underwent PET scanning with 6-[(18)F]fluoro-l-m-tyrosine (FMT), a radiotracer that measures DA synthesis capacity. Lower putamen FMT signal predicted elevated Now bias, a more rapidly declining discount rate with increasing delay time, and reduced willingness to accept low-interest-rate delayed rewards. In contrast, lower FMT signal in the midbrain predicted greater sensitivity to increasing magnitude of the Later reward. These data demonstrate that intertemporal reward choice in healthy humans varies with region-specific measures of DA processing, with regionally distinct associations with sensitivity to delay and to reward magnitude.

  12. Cueing the personal future to reduce discounting in intertemporal choice: Is episodic prospection necessary?

    Science.gov (United States)

    Kwan, Donna; Craver, Carl F; Green, Leonard; Myerson, Joel; Gao, Fuqiang; Black, Sandra E; Rosenbaum, R Shayna

    2015-04-01

    How does the ability to imagine detailed future experiences (i.e., episodic prospection) contribute to choices between immediate and delayed rewards? Individuals with amnesia do not show abnormally steep discounting in intertemporal choice, suggesting that neither medial temporal lobe (MTL) integrity nor episodic prospection is required for the valuation of future rewards (Kwan et al. (), Hippocampus, 22:1215-1219; Kwan et al. (2013), J Exp Psychol, 142:1355-1369 2013). However, hippocampally mediated episodic prospection in healthy adults reduces the discounting of future rewards (Peters and Büchel (2010), Neuron, 66:138-148; Benoit et al. (2011), J Neurosci, 31:6771-6779), raising the possibility that MTL damage causes more subtle impairments to this form of decision-making than noted in previous patient studies. Intertemporal choice appears normal in amnesic populations, yet they may be unable to use episodic prospection to adaptively modulate the value assigned to future rewards. To investigate how the extended hippocampal system, including the hippocampus and related MTL structures, contributes to the valuation of future rewards, we compared the performance of six amnesic cases with impaired episodic prospection to that of 20 control participants on two versions of an intertemporal choice task: a standard discounting task, and a cued version in which cues prompted them to imagine specific personal future events temporally contiguous with the receipt of delayed rewards. Amnesic individuals' intertemporal choices in the standard condition were indistinguishable from those of controls, replicating previous findings. Surprisingly, performance of the amnesic cases in the cued condition indicates that amnesia does not preclude flexible modulation of choices in response to future event cues, even in the absence of episodic prospection. Cueing the personal future to modulate decisions appears to constitute a less demanding or a qualitatively different (e.g., personal

  13. Risk, reward, and decision-making in a rodent model of cognitive aging.

    Science.gov (United States)

    Gilbert, Ryan J; Mitchell, Marci R; Simon, Nicholas W; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L

    2011-01-01

    Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 months) and aged (23-25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost-benefit decision-making.

  14. Temporal Discounting Is Associated with an Increased Risk of Mortality among Community-Based Older Persons without Dementia.

    Directory of Open Access Journals (Sweden)

    Patricia A Boyle

    Full Text Available Temporal discounting is an important determinant of many health and financial outcomes, but we are not aware of studies that have examined the association of temporal discounting with mortality.Participants were 406 older persons without dementia from the Rush Memory and Aging Project, a longitudinal cohort study of aging. Temporal discounting was measured using standard preference elicitation questions. Individual discount rates were estimated using a well-established hyperbolic function and used to predict the risk of mortality during up to 5 years of follow-up.The mean estimate of discounting was 0.45 (SD = 0.33, range: 0.08-0.90, with higher scores indicating a greater propensity to prefer smaller immediate rewards over larger but delayed ones. During up to 5 years of follow-up (mean = 3.6 years, 62 (15% of 406 persons died. In a proportional hazards model adjusted for age, sex, and education, temporal discounting was associated with an increased risk of mortality (HR = 1.103, 95% CI 1.024, 1.190, p = 0.010. Thus, a person with the highest discount rate (score = 0.90 was about twice more likely to die over the study period compared to a person with the lowest discount rate (score = 0.08. Further, the association of discounting with mortality persisted after adjustment for the level of global cognitive function, the burden of vascular risk factors and diseases, and an indicator of psychological well being (i.e., purpose in life.Temporal discounting is associated with an increased risk of mortality in old age after accounting for global cognitive function and indicators of physical and mental health.

  15. Reward type and behavioural patterns predict dogs' success in a delay of gratification paradigm

    National Research Council Canada - National Science Library

    Désirée Brucks; Matteo Soliani; Friederike Range; Sarah Marshall-pescini

    2017-01-01

    .... One task regularly used to study inhibitory control is the delay of gratification task, which requires individuals to choose between an immediate option of lower value and a delayed option of higher value...

  16. Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder.

    Science.gov (United States)

    Wilbertz, Gregor; van Elst, Ludger Tebartz; Delgado, Mauricio R; Maier, Simon; Feige, Bernd; Philipsen, Alexandra; Blechert, Jens

    2012-03-01

    Impulsivity symptoms of adult attention deficit hyperactivity disorder (ADHD) such as increased risk taking have been linked with impaired reward processing. Previous studies have focused on reward anticipation or on rewarded executive functioning tasks and have described a striatal hyporesponsiveness and orbitofrontal alterations in adult and adolescent ADHD. Passive reward delivery and its link to behavioral impulsivity are less well understood. To study this crucial aspect of reward processing we used functional magnetic resonance imaging (fMRI) combined with electrodermal assessment in male and female adult ADHD patients (N=28) and matched healthy control participants (N=28) during delivery of monetary and non-monetary rewards. Further, two behavioral tasks assessed risky decision making (game of dice task) and delay discounting. Results indicated that both groups activated ventral and dorsal striatum and the medial orbitofrontal cortex (mOFC) in response to high-incentive (i.e. monetary) rewards. A similar, albeit less strong activation pattern was found for low-incentive (i.e. non-monetary) rewards. Group differences emerged when comparing high and low incentive rewards directly: activation in the mOFC coded for the motivational change in reward delivery in healthy controls, but not ADHD patients. Additionally, this dysfunctional mOFC activity in patients correlated with risky decision making and delay discounting and was paralleled by physiological arousal. Together, these results suggest that the mOFC codes reward value and type in healthy individuals whereas this function is deficient in ADHD. The brain-behavior correlations suggest that this deficit might be related to behavioral impulsivity. Reward value processing difficulties in ADHD should be considered when assessing reward anticipation and emotional learning in research and applied settings.

  17. Risk, reward, and decision-making in a rodent model of cognitive aging

    Directory of Open Access Journals (Sweden)

    Ryan J Gilbert

    2012-01-01

    Full Text Available Impaired decision-making in aging can directly impact factors (financial security, quality of healthcare that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 mo. and aged (23-25 mo. male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (1 food pellet and a large but uncertain reward (2 food pellets with varying probabilities of delivery ranging from 100% to 0%. Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the smaller but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for costs (i.e., delay, probability. These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct neural mechanisms that can impact cost

  18. Immediate or delayed feedback on rewards in Pay-As-You-Drive Systems

    NARCIS (Netherlands)

    Dijksterhuis, Chris; Lewis Evans, Ben; de Waard, Dick; Tucha, Oliver; Brookhuis, Karel

    2014-01-01

    In normal, everyday driving, behaving safely in traffic usually remains unrewarded whereas consequences for unsafe behaviours are rarely negative and can actually often be positive. The strength of Pay-As-You-Drive insurance is its potential to correct this major issue with driving by rewarding safe

  19. Victims' time discounting 2.5 years after the Wenchuan earthquake: an ERP study.

    Directory of Open Access Journals (Sweden)

    Jin-Zhen Li

    Full Text Available BACKGROUND: Time discounting refers to the fact that the subjective value of a reward decreases as the delay until its occurrence increases. The present study investigated how time discounting has been affected in survivors of the magnitude-8.0 Wenchuan earthquake that occurred in China in 2008. METHODOLOGY: Nineteen earthquake survivors and 22 controls, all school teachers, participated in the study. Event-related brain potentials (ERPs for time discounting tasks involving gains and losses were acquired in both the victims and controls. FINDINGS: The behavioral data replicated our previous findings that delayed gains were discounted more steeply after a disaster. ERP results revealed that the P200 and P300 amplitudes were increased in earthquake survivors. There was a significant group (earthquake vs. non-earthquake × task (gain vs. loss interaction for the N300 amplitude, with a marginally significantly reduced N300 for gain tasks in the experimental group, which may suggest a deficiency in inhibitory control for gains among victims. CONCLUSIONS: The results suggest that post-disaster decisions might involve more emotional (System 1 and less rational thinking (System 2 in terms of a dual-process model of decision making. The implications for post-disaster intervention and management are also discussed.

  20. Queuing theory under competitive social foraging may explain a mathematical equivalence of delay and probability in impulsive decision-making.

    Science.gov (United States)

    Takahashi, Taiki

    2006-01-01

    Intertemporal and probabilistic decision-making has been studied in psychiatry, ecology, and neuroeconomics. Because drug addicts and psycopaths often make risky decisions (e.g., drug misuse and aggression), investigation into types of impulsivity in intertemporal and probabilistic choices (delay and probability discounting) are important for psychiatric treatments. Studies in behavioral ecology proposed that delay and probability discounting are mediated by the same psychological process, because a decrease in probability of winning corresponds to an increase in delay until winning. According to this view, odds-against winning (=1/p-1) in probabilistic choice corresponds to delay in intertemporal choice. This hypothesis predicts that preference of gambling (low degree of probability discounting) may be associated with patience, rather than impulsivity or impatience, in intertemporal choice (low degree of delay discounting). However, recent empirical evidence in psychiatric research employing pathological gamblers indicates that pathological gamblers are impulsive in intertemporal choice (high degrees of delay discounting). However, a hyperbolic discounting function (usually adopted to explain intertemporal choice) with odds-against (instead of delay) explain experimental data in probabilistic choice dramatically well. Therefore, an alternative explanation is required for the hypothetical equivalence of odds-against to delay. We propose that queuing theory (often adopted for analyzing computer network traffic) under a competitive social foraging condition may explain the equivalence. Our hypothesis may help understand impulsivity of psychiatrics in social behavior (e.g., aggression and antisocial behavior) in addition to non-social impulsivity in reward-seeking (e.g., substance misuse).

  1. Incidental rewarding cues influence economic decision-making in obesity

    Directory of Open Access Journals (Sweden)

    Jakob eSimmank

    2015-10-01

    Full Text Available Recent research suggests that obesity is linked to prominent alterations in learning and decision-making. This general difference may also underlie the preference for immediately consumable, highly palatable but unhealthy and high-calorie foods. Such poor food-related inter-temporal decision-making can explain weight gain; however, it is not yet clear whether this deficit can be generalized to other domains of inter-temporal decision-making, for example financial decisions. Further, little is known about the stability of decision-making behavior in obesity, especially in the presence of rewarding cues. To answer these questions, obese and lean participants (n=52 completed two sessions of a novel priming paradigm including a computerized monetary delay discounting task. In the first session, general differences between groups in financial delay discounting were measured. In the second session, we tested the general stability of discounting rates. Additionally, participants were primed by affective visual cues of different contextual categories before the financial decision. We found that the obese group showed stronger discounting of future monetary rewards than the lean group, but groups did not differ in their general stability between sessions nor in their sensitivity towards changes in reward magnitude. In the obese group, a fast decrease of subjective value over time was directly related to a higher tendency for opportunistic eating. Obese in contrast to lean people were primed by the affective cues, showing a sex-specific pattern of priming direction. Our findings demonstrate that environments rich of cues, aiming at inducing unhealthy consumer decisions, can be highly detrimental for obese people. It also underscores that obesity is not merely a medical condition but has a strong cognitive component, meaning that current dietary and medical treatment strategies may fall too short.

  2. The delay effect on outcome evaluation: results from an Event-related Potential study

    Directory of Open Access Journals (Sweden)

    Chen eQu

    2013-11-01

    Full Text Available Behavioral studies demonstrate that the timing of receiving gains or losses affects decision-making, a phenomenon known as temporal discounting, as participants are inclined to prefer immediate rewards over delayed ones and vice versa for losses. The present study used the event-related potential (ERP technique with a simple gambling task to investigate how delayed rewards and losses affected the brain activity in outcome evaluations made by 20 young adults. Statistical analysis revealed a larger feedback related negativity (FRN effect between loss and gain following immediate outcomes than following future outcomes. In addition, delay impacted FRN only in gain conditions, with delayed winning eliciting a more negative FRN than immediatewinning. These results suggest that temporal discounting and sign effect could be encoded in the FRN in the early stage of outcome evaluation.

  3. Impact of size and delay on neural activity in the rat limbic corticostriatal system

    Directory of Open Access Journals (Sweden)

    Matthew R Roesch

    2011-12-01

    Full Text Available A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short-delay and big-reward conditions than under long-delay and small-reward conditions as measured by percent choice, accuracy and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.

  4. Impact of Size and Delay on Neural Activity in the Rat Limbic Corticostriatal System

    Science.gov (United States)

    Roesch, Matthew R.; Bryden, Daniel W.

    2011-01-01

    A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level. PMID:22363252

  5. Impact of size and delay on neural activity in the rat limbic corticostriatal system.

    Science.gov (United States)

    Roesch, Matthew R; Bryden, Daniel W

    2011-01-01

    A number of factors influence an animal's economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.

  6. Effects of anonymous peer observation on adolescents' preference for immediate rewards.

    Science.gov (United States)

    Weigard, Alexander; Chein, Jason; Albert, Dustin; Smith, Ashley; Steinberg, Laurence

    2014-01-01

    Research suggests that the presence of peers influences adolescent risk-taking by increasing the perceived reward value of risky decisions. While prior work has involved observation of participants by their friends, the current study examined whether observation by an anonymous peer could elicit similarly increased reward sensitivity. Late adolescent participants completed a delay discounting task either alone or under the belief that performance was being observed from a neighboring room by an unknown viewer of the same gender and age. Even in this limited social context, participants demonstrated a significantly increased preference for smaller, immediate rewards when they believed that they were being watched. This outcome challenges several intuitive accounts of the peer effect on adolescent risk-taking, and indicates that the peer influence on reward sensitivity during late adolescence is not dependent on familiarity with the observer. The findings have both theoretical and practical implications for our understanding of social influences on adolescents' risky behavior.

  7. Discounting in Time

    DEFF Research Database (Denmark)

    Fahrenberg, Uli; Larsen, Kim Guldstrand

    2009-01-01

    This paper deals with the issue of discounting in weighted timed transition systems. Discounting provides a way to model optimal-cost problems for infinite runs and has applications in optimal scheduling and other areas. We show that when postulating a certain natural additivity property for the ......This paper deals with the issue of discounting in weighted timed transition systems. Discounting provides a way to model optimal-cost problems for infinite runs and has applications in optimal scheduling and other areas. We show that when postulating a certain natural additivity property...... for the discounted weights of runs, there is essentially only one possible way to introduce a discounting semantics. Our proof relies on the fact that a certain functional equation essentially only has one solution, for which we provide an elementary proof....

  8. Discounted Duration Calculus

    DEFF Research Database (Denmark)

    Ody, Heinrich; Fränzle, Martin; Hansen, Michael Reichhardt

    2016-01-01

    To formally reason about the temporal quality of systems discounting was introduced to CTL and LTL. However, these logic are discrete and they cannot express duration properties. In this work we introduce discounting for a variant of Duration Calculus. We prove decidability of model checking...... for a useful fragment of discounted Duration Calculus formulas on timed automata under mild assumptions. Further, we provide an extensive example to show the usefulness of the fragment....

  9. Mobile technology habits: patterns of association among device usage, intertemporal preference, impulse control, and reward sensitivity.

    Science.gov (United States)

    Wilmer, Henry H; Chein, Jason M

    2016-10-01

    Mobile electronic devices are playing an increasingly pervasive role in our daily activities. Yet, there has been very little empirical research investigating how mobile technology habits might relate to individual differences in cognition and affect. The research presented in this paper provides evidence that heavier investment in mobile devices is correlated with a relatively weaker tendency to delay gratification (as measured by a delay discounting task) and a greater inclination toward impulsive behavior (i.e., weaker impulse control, assessed behaviorally and through self-report) but is not related to individual differences in sensitivity to reward. Analyses further demonstrated that individual variation in impulse control mediates the relationship between mobile technology usage and delay of gratification. Although based on correlational results, these findings lend some backing to concerns that increased use of portable electronic devices could have negative impacts on impulse control and the ability to appropriately valuate delayed rewards.

  10. Discounting in the evaluation of the cost-effectiveness of a vaccination programme: A critical review.

    Science.gov (United States)

    Jit, Mark; Mibei, Walter

    2015-07-31

    Discounting future costs and health benefits usually has a large effect on results of cost-effectiveness evaluations of vaccination because of delays between the initial expenditure in the programme and the health benefits from averting disease. Most guidelines currently recommend discounting both costs and health effects at a positive, constant, common rate back to a common point in time. A review of 84 published economic evaluations of vaccines found that most of them apply these recommendations. However, both technical and normative arguments have been presented for discounting health at a different rate to consumption (differential discounting), discounting at a rate that changes over time (non-constant discounting), discounting intra-generational and inter-generational effects at a different rate (two-stage discounting), and discounting the health gains from an intervention to a different discount year from the time of intervention (delayed discounting). These considerations are particularly acute for vaccines, because their effects can occur in a different generation from the one paying for them, and because the time of vaccination, of infection aversion, and of disease aversion usually differ. Using differential, two-stage or delayed discounting in model-based cost-effectiveness evaluations of vaccination raises technical challenges, but mechanisms have been proposed to overcome them.

  11. Hyperbolically Discounted Temporal Difference Learning

    OpenAIRE

    Alexander, William H.; Brown, Joshua W.

    2010-01-01

    Hyperbolic discounting of future outcomes is widely observed to underlie choice behavior in animals. Additionally, recent studies (Kobayashi & Schultz, 2008) have reported that hyperbolic discounting is observed even in neural systems underlying choice. However, the most prevalent models of temporal discounting, such as temporal difference learning, assume that future outcomes are discounted exponentially. Exponential discounting has been preferred largely because it is able to be expressed r...

  12. Reduced sensitivity to sooner reward during intertemporal decision-making following insula damage in humans

    Directory of Open Access Journals (Sweden)

    Manuela eSellitto

    2016-01-01

    Full Text Available During intertemporal choice, humans tend to prefer small-sooner rewards over larger-delayed rewards, reflecting temporal discounting (TD of delayed outcomes. Functional neuroimaging evidence has implicated the insular cortex in time-sensitive decisions, yet it is not clear whether activity in this brain region is crucial for, or merely associated with, TD behaviour. Here, patients with damage to the insula (Insular patients, control patients with lesions outside the insula, and healthy individuals chose between smaller-sooner and larger-later monetary rewards. Insular patients were less sensitive to sooner rewards than were the control groups, exhibiting reduced TD. A Voxel-based Lesion-Symptom Mapping (VLSM analysis confirmed a statistically significant association between insular damage and reduced TD. These results indicate that the insular cortex is crucial for intertemporal choice. We suggest that he insula may be necessary to anticipate the bodily/emotional effects of receiving rewards at different delays, influencing the computation of their incentive value. Devoid of such input, insular patients’ choices would be governed by a heuristic of quantity, allowing patients to wait for larger options.

  13. Hunger does not motivate reward in women remitted from anorexia nervosa.

    Science.gov (United States)

    Wierenga, Christina E; Bischoff-Grethe, Amanda; Melrose, A James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F; Simmons, Alan; Fudge, Julie L; McClure, Samuel M; Ely, Alice; Kaye, Walter H

    2015-04-01

    Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study investigated brain response to rewards during hunger and satiated states to examine whether diminished response to reward could underlie food restriction in AN. Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 women remitted from AN (RAN group; to reduce the confounding effects of starvation) with 17 healthy comparison women (CW group). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Interactions of Group (RAN, CW) × Visit (hunger, satiety) revealed that, for the CW group, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in the RAN group. A main effect of group revealed elevated response in the middle frontal gyrus for the RAN group compared with the CW group. Women remitted from AN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to the motivational drive of hunger may explain the ability of individuals with AN to restrict food when emaciated. Difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this disorder. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  14. Is there time discounting for risk premium?

    Science.gov (United States)

    Shavit, Tal; Rosenboim, Mosi

    2015-03-01

    Individuals with a higher subjective discount rate concentrate more on the present and delay is more significant for them. However, when a risky asset is delayed, not only is the outcome delayed but also the risk. In this paper, we suggest a new, two-stage experimental method with real monetary incentives that allows us to distinguish between the effect of the risk and the effect of the time when pricing a risky asset. We show that when individuals have greater preference for the present, their risk aversion for a risky asset realized in the future decreases. We argue that the effect of the risk for future asset is lower for individuals with higher time preference because they discount not only the outcome but also the risks. © Society for the Experimental Analysis of Behavior.

  15. Employee reward

    OpenAIRE

    2014-01-01

    Objectives: • To present the main historical and theoretical foundations underpinning contemporary employee reward practice. • To define employee reward and identify the key components of reward. • To explore the concept of reward management and the benefits and difficulties associated with introducing a strategic approach to reward. • To consider key employee reward choices facing organisations in the contemporary era. • To explore the economic and legal context for reward and the implicatio...

  16. Excitotoxic lesions of the medial striatum delay extinction of a reinforcement color discrimination operant task in domestic chicks; a functional role of reward anticipation.

    Science.gov (United States)

    Ichikawa, Yoko; Izawa, Ei-Ichi; Matsushima, Toshiya

    2004-12-01

    To reveal the functional roles of the striatum, we examined the effects of excitotoxic lesions to the bilateral medial striatum (mSt) and nucleus accumbens (Ac) in a food reinforcement color discrimination operant task. With a food reward as reinforcement, 1-week-old domestic chicks were trained to peck selectively at red and yellow beads (S+) and not to peck at a blue bead (S-). Those chicks then received either lesions or sham operations and were tested in extinction training sessions, during which yellow turned out to be nonrewarding (S-), whereas red and blue remained unchanged. To further examine the effects on postoperant noninstrumental aspects of behavior, we also measured the "waiting time", during which chicks stayed at the empty feeder after pecking at yellow. Although the lesioned chicks showed significantly higher error rates in the nonrewarding yellow trials, their postoperant waiting time gradually decreased similarly to the sham controls. Furthermore, the lesioned chicks waited significantly longer than the controls, even from the first extinction block. In the blue trials, both lesioned and sham chicks consistently refrained from pecking, indicating that the delayed extinction was not due to a general disinhibition of pecking. Similarly, no effects were found in the novel training sessions, suggesting that the lesions had selective effects on the extinction of a learned operant. These results suggest that a neural representation of memory-based reward anticipation in the mSt/Ac could contribute to the anticipation error required for extinction.

  17. Disorder-specific functional abnormalities during temporal discounting in youth with Attention Deficit Hyperactivity Disorder (ADHD), Autism and comorbid ADHD and Autism.

    Science.gov (United States)

    Chantiluke, Kaylita; Christakou, Anastasia; Murphy, Clodagh M; Giampietro, Vincent; Daly, Eileen M; Ecker, Christina; Brammer, Michael; Murphy, Declan G; Rubia, Katya

    2014-08-30

    Attention Deficit Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) are often comorbid and share cognitive abnormalities in temporal foresight. A key question is whether shared cognitive phenotypes are based on common or different underlying pathophysiologies and whether comorbid patients have additive neurofunctional deficits, resemble one of the disorders or have a different pathophysiology. We compared age- and IQ-matched boys with non-comorbid ADHD (18), non-comorbid ASD (15), comorbid ADHD and ASD (13) and healthy controls (18) using functional magnetic resonance imaging (fMRI) during a temporal discounting task. Only the ASD and the comorbid groups discounted delayed rewards more steeply. The fMRI data showed both shared and disorder-specific abnormalities in the three groups relative to controls in their brain-behaviour associations. The comorbid group showed both unique and more severe brain-discounting associations than controls and the non-comorbid patient groups in temporal discounting areas of ventromedial and lateral prefrontal cortex, ventral striatum and anterior cingulate, suggesting that comorbidity is neither an endophenocopy of the two pure disorders nor an additive pathology.

  18. Discounting, beyond Utilitarianism

    National Research Council Canada - National Science Library

    Fleurbaey, Marc; Zuber, Stéphane

    2015-01-01

    .... The class is more flexible than discounted utilitarianism in terms of population ethics and it disentangles risk aversion and inequality aversion. The authors show that these social objectives imply interesting modifications of the Ramsey formula, and shed new light on Weitzman's "dismal theorem".

  19. Discounting of money and sex: effects of commodity and temporal position in stimulant-dependent men and women.

    Science.gov (United States)

    Jarmolowicz, David P; Landes, Reid D; Christensen, Darren R; Jones, Bryan A; Jackson, Lisa; Yi, Richard; Bickel, Warren K

    2014-11-01

    Research on delay discounting has contributed to the understanding of numerous addiction-related phenomena. For example, studies have shown that substance dependent individuals discount their addictive substances (e.g., cocaine) more rapidly than they do other commodities (e.g., money). Recent research has shown that substance dependent individuals discount delayed sex more rapidly than delayed money, and their discounting rates for delayed sex were higher than those of non-addicted individuals. The particular reason that delay discounting rates for sex are higher than those for money, however, are unclear. Do individuals discount delayed sex rapidly because immediate sex is particularly appealing or because delayed sex does not retain its value? Moreover, do the same factors influence men and women's choices? The current study examined delay discounting in four conditions (money now versus money later; sex now versus sex later; money now, versus sex later; sex now versus money later) in cocaine dependent men and women. The procedures used isolated the role of the immediate versus delayed commodity. For men, the higher rates of delay discounting for sex were because delayed sex did not retain its value, whereas both the immediate and delayed commodity influenced the female participants' decisions. Copyright © 2014 Elsevier Ltd. All rights reserved.

  20. The Rewards of Patience: An 822 Day Time Delay in the Gravitational Lens SDSS J1004+4112

    CERN Document Server

    Fohlmeister, J; Falco, E E; Morgan, C W; Wambsganss, J

    2007-01-01

    We present 107 new epochs of optical monitoring data for the four brightest images of the gravitational lens SDSS J1004+4112 observed between October 2006 and June 2007. Combining this data with the previously obtained light curves, we determine the time delays between images A, B and C. We confirm our previous measurement finding that A leads B by dt_BA=40.6+-1.8 days, and find that image C leads image A by dt_CA=821.6+-2.1 days. The lower limit on the remaining delay is that image D lags image A by dt_AD>1250 days. Based on the microlensing of images A and B we estimate that the accretion disk size at a rest wavelength of 2300 angstrom is 10^{14.8+-0.3} cm for a disk inclination of cos{i}=1/2, which is consistent with the microlensing disk size-black hole mass correlation function given our estimate of the black hole mass from the MgII line width of logM_BH/M_sun=8.44+-0.14. The long delays allow us to fill in the seasonal gaps and assemble a continuous, densely sampled light curve spanning 5.7 years whose ...

  1. Interaction between DRD2 C957T polymorphism and an acute psychosocial stressor on reward-related behavioral impulsivity.

    Science.gov (United States)

    White, Melanie J; Lawford, Bruce R; Morris, C Phillip; Young, Ross McD

    2009-05-01

    The dopamine D2 receptor (DRD2) C957T polymorphism CC genotype is associated with decreased striatal binding of DRD2 and executive function and working memory impairments in healthy adults. We investigated the relationships between C957T and acute stress with behavioral phenotypes of impulsivity in 72 young adults randomly allocated to either an acute psychosocial stress or relaxation induction condition. Homozygotes for 957C showed increased reward responsiveness after stress induction. They were also quicker when making immediate choices on the delay discounting task when stressed, compared with homozygotes who were not stressed. No effects were found for response inhibition, a dimension of impulsivity not related to extrinsic rewards. These data suggest that C957T is associated with a reward-related impulsivity endophenotype in response to acute psychosocial stress. Future studies should examine whether the greater sensitivity of 957C homozygotes to the effects of stress is mediated through dopamine release.

  2. Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans

    Science.gov (United States)

    Weber, S C; Beck-Schimmer, B; Kajdi, M-E; Müller, D; Tobler, P N; Quednow, B B

    2016-01-01

    Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity. PMID:27378550

  3. Network Effects Versus Strategic Discounting

    DEFF Research Database (Denmark)

    Zucchini, Leon; Claussen, Jörg; Trüg, Moritiz

    . Alternatively, research on strategic discounting suggests small operators use on-net discounts to advertise with low on-net prices. We test the relative strength of these effects using data on tariff setting in German mobile telecommunications between 2001 and 2009. We find that large operators are more likely......Mobile telecommunication operators routinely charge subscribers lower prices for calls on their own network than for calls to other networks (on-net discounts). Studies on tariff-mediated network effects suggest this is due to large operators using on-net discounts to damage smaller rivals...... to offer tariffs with on-net discounts but there is no consistently significant difference in the magnitude of discounts. Our results suggest that tariff-mediated network effects are the main cause of on-net discounts....

  4. Shopping in discount stores

    DEFF Research Database (Denmark)

    Zielke, Stephan

    2014-01-01

    This paper analyzes the impact of price-related attributions, emotions and value perception on the intention to shop at grocery discounters in an integrated framework. Moderating effects of price consciousness are also analyzed. The results show that the proposed model explains almost three quart...... effect, followed by the efficiency of the business model attribution. The unfairness to stakeholders and the tricks in price communication attribution mostly influence the shopping intention for less price-conscious customers.......This paper analyzes the impact of price-related attributions, emotions and value perception on the intention to shop at grocery discounters in an integrated framework. Moderating effects of price consciousness are also analyzed. The results show that the proposed model explains almost three...

  5. Valuing rewards to others in a prisoner's dilemma game.

    Science.gov (United States)

    Safin, Vasiliy; Locey, Matthew L; Rachlin, Howard

    2013-10-01

    People value rewards to others but discount those rewards based on social distance; rewards to a socially closer person are valued more than identical rewards to a socially more distant person (Jones and Rachlin, 2006). The concept of social discounting can explain cooperation and defection in two-player prisoner's dilemma (PD) games (Axelrod, 1980). The contingencies of a PD game are such that in any single game cooperation is costly to each player herself but beneficial to the other player. From the viewpoint of each player, the costs of cooperation are fully realized, but the benefits of cooperation are discounted by the social distance to the other player. The present experiment measured cooperation and defection in two PD-game conditions with differing reward magnitudes. In one (the 1-2-3-4 condition), the cost of cooperation exceeded its socially discounted benefit, and players were predicted to defect; in the other (the 1-2-9-10 condition), the discounted benefit of cooperation exceeded its cost, and players were predicted to cooperate. Over the course of repeated trials defection increased with the 1-2-3-4 condition but not with the 1-2-9-10 condition. Moreover, participants who rated their partners as closer, relative to random classmates, cooperated at higher rates--consistent with social discounting.

  6. Dissociations in future thinking following hippocampal damage: evidence from discounting and time perspective in episodic amnesia.

    Science.gov (United States)

    Kwan, Donna; Craver, Carl F; Green, Leonard; Myerson, Joel; Rosenbaum, R Shayna

    2013-11-01

    Recollecting past experiences and imagining future experiences activate a common set of brain regions that includes the hippocampus (Schacter, Addis, & Buckner, 2007), and both functions are impaired in people with compromised hippocampal function (Klein, Loftus, & Kihlstrom, 2002; Tulving, 1985). These findings indicate a role for the hippocampus that extends beyond declarative memory. However, a case study revealed that a person with extensive medial temporal lobe (MTL) damage and episodic amnesia was able to forgo smaller, immediate rewards for a larger future payoff to a degree similar to control participants (Kwan et al., 2012). This finding suggests that typical regard for the future does not depend on hippocampal integrity. To test this hypothesis, the current study examined the nature and limits of the role of the hippocampus in future thinking and decision making in amnesic individuals with hippocampal damage and associated impairments in episodic memory and future imagining. The amnesic individuals were administered a delay discounting task to assess valuation of future rewards, a probability discounting task to assess risk taking, and the Zimbardo Time Perspective Inventory to assess personal orientation toward the past, present, and future. Comparisons with demographically matched controls indicated that aspects of temporal thought and future-oriented decision making are preserved in individuals with hippocampal amnesia despite their inability to imagine themselves in detailed future events. Thus, even extensive MTL damage and the resulting episodic amnesia do not preclude prudent decision making, including consideration of future financial outcomes and personal identification with the past and future. PsycINFO Database Record (c) 2013 APA, all rights reserved.

  7. MODELLING OF ONLINE GROUP DISCOUNTS

    Directory of Open Access Journals (Sweden)

    Karlo Kotarac

    2013-02-01

    Full Text Available Web pages for group discounts have become very popular in the past few years. In this paper we concentrate on the group discounts for the service industry in which a quality of the service plays an important role in retaining customers which in return affects business profitability. We present a model of the group discount offer from a merchant’s point view. A merchant decides about the size of the discount offered, having in mind quality of the service offered which is affected by the number of customers who use the service. Finally, we derive the first order optimality conditions.

  8. High monetary reward rates and caloric rewards decrease temporal persistence

    Science.gov (United States)

    Bode, Stefan; Murawski, Carsten

    2017-01-01

    Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. PMID:28228517

  9. Discounted continuous-time constrained Markov decision processes in Polish spaces

    CERN Document Server

    Guo, Xianping; 10.1214/10-AAP749

    2012-01-01

    This paper is devoted to studying constrained continuous-time Markov decision processes (MDPs) in the class of randomized policies depending on state histories. The transition rates may be unbounded, the reward and costs are admitted to be unbounded from above and from below, and the state and action spaces are Polish spaces. The optimality criterion to be maximized is the expected discounted rewards, and the constraints can be imposed on the expected discounted costs. First, we give conditions for the nonexplosion of underlying processes and the finiteness of the expected discounted rewards/costs. Second, using a technique of occupation measures, we prove that the constrained optimality of continuous-time MDPs can be transformed to an equivalent (optimality) problem over a class of probability measures. Based on the equivalent problem and a so-called $\\bar{w}$-weak convergence of probability measures developed in this paper, we show the existence of a constrained optimal policy. Third, by providing a linear ...

  10. The medial temporal lobes are critical for reward-based decision making under conditions that promote episodic future thinking.

    Science.gov (United States)

    Palombo, Daniela J; Keane, Margaret M; Verfaellie, Mieke

    2015-03-01

    In the present study, we investigated the effect of medial temporal lobe (MTL) damage on human decision making in the context of reward-based intertemporal choice. During intertemporal choice, humans typically devalue (or discount) a future reward to account for its delayed arrival (e.g., preferring $30 now over $42 in 2 months), but this effect is attenuated when participants engage in episodic future thinking, i.e., project themselves into the future to imagine a specific event. We hypothesized that this attenuation would be selectively impaired in amnesic patients, who have deficits in episodic future thinking. Replicating previous work, in a standard intertemporal choice task, amnesic patients showed temporal discounting indices similar to healthy controls. Consistent with our hypothesis, while healthy controls demonstrated attenuated temporal discounting in a condition that required participants first to engage in episodic future thinking (e.g., to imagine spending $42 at a theatre in 2 months), amnesic patients failed to demonstrate this effect. Moreover, as expected, amnesic patients' narratives were less episodically rich than those of controls. These findings extend the range of tasks that are shown to be MTL dependent to include not only memory-based decision-making tasks but also future-oriented ones.

  11. Time discounting and time consistency

    NARCIS (Netherlands)

    Dimitri, N.; Eijck, D.J.N. van

    2012-01-01

    Time discounting is the phenomenon that a desired result in the future is perceived as less valuable than the same result now. Economic theories can take this psychological fact into account in several ways. In the economic literature the most widely used type of additive time discounting is

  12. Power and reduced temporal discounting.

    Science.gov (United States)

    Joshi, Priyanka D; Fast, Nathanael J

    2013-04-01

    Decision makers generally feel disconnected from their future selves, an experience that leads them to prefer smaller immediate gains to larger future gains. This pervasive tendency is known as temporal discounting, and researchers across disciplines are interested in understanding how to overcome it. Following recent advances in the power literature, we suggest that the experience of power enhances one's connection with the future self, which in turn results in reduced temporal discounting. In Study 1, we found that participants assigned to high-power roles were less likely than participants assigned to low-power roles to display temporal discounting. In Studies 2 and 3, priming power reduced temporal discounting in monetary and nonmonetary tasks, and, further, connection with the future self mediated the relation between power and reduced discounting. In Study 4, experiencing a general sense of power in the workplace predicted actual lifetime savings. These results have important implications for future research.

  13. College Students Discount Money "Won" More than Money "Owed"

    Science.gov (United States)

    Weatherly, Jeffrey N.; Derenne, Adam; Terrell, Heather K.

    2010-01-01

    Evidence in the research literature indicates people may treat "won" money differently than they would their own money. The present study had a sample of 648 college students complete a delay-discounting task that involved the hypothetical monetary amounts of $1,000 or $100,000. Participants were asked repeatedly what amount they would…

  14. College Students Discount Money "Won" More than Money "Owed"

    Science.gov (United States)

    Weatherly, Jeffrey N.; Derenne, Adam; Terrell, Heather K.

    2010-01-01

    Evidence in the research literature indicates people may treat "won" money differently than they would their own money. The present study had a sample of 648 college students complete a delay-discounting task that involved the hypothetical monetary amounts of $1,000 or $100,000. Participants were asked repeatedly what amount they would accept…

  15. Variable delay-to-signal: a fast paradigm for assessment of aspects of impulsivity in rats

    Directory of Open Access Journals (Sweden)

    Hugo eLeite-Almeida

    2013-10-01

    Full Text Available Testing impulsive behavior in rodents is challenging and labor-intensive. We developed a new behavioral paradigm – the Variable Delay-to-Signal (VDS test – that provides rapid and simultaneous assessment of response and decision impulsivity in rodents. Presentation of a light at variable delays signals the permission for action (nose poke contingent with a reward. Two blocks of 25 trials at 3s delay flank a block of 70 trials in which light is presented with randomly selected 6s or 12s delays. Exposure to such large delays boosts the rate of premature responses when the delay drops to 3s in the final block, an effect that is blunted by an acute methamphetamine challenge and that correlates with the delay-discounting paradigm (choice impulsivity. Finally, as expected, treatment with the NMDA antagonist MK-801 caused a generalized response increase in all VDS blocks. The pharmacological validation, particularly with methamphetamine which has a well established dual effect on response and decision impulsivity, and the correlations between the impulsive behavior in the delay-discounting and VDS paradigms, suggests that the later is able to provide, in a single session, a multi-dimensional assessment of impulsive behavior.

  16. The Attraction Effect Modulates Reward Prediction Errors and Intertemporal Choices.

    Science.gov (United States)

    Gluth, Sebastian; Hotaling, Jared M; Rieskamp, Jörg

    2017-01-11

    Classical economic theory contends that the utility of a choice option should be independent of other options. This view is challenged by the attraction effect, in which the relative preference between two options is altered by the addition of a third, asymmetrically dominated option. Here, we leveraged the attraction effect in the context of intertemporal choices to test whether both decisions and reward prediction errors (RPE) in the absence of choice violate the independence of irrelevant alternatives principle. We first demonstrate that intertemporal decision making is prone to the attraction effect in humans. In an independent group of participants, we then investigated how this affects the neural and behavioral valuation of outcomes using a novel intertemporal lottery task and fMRI. Participants' behavioral responses (i.e., satisfaction ratings) were modulated systematically by the attraction effect and this modulation was correlated across participants with the respective change of the RPE signal in the nucleus accumbens. Furthermore, we show that, because exponential and hyperbolic discounting models are unable to account for the attraction effect, recently proposed sequential sampling models might be more appropriate to describe intertemporal choices. Our findings demonstrate for the first time that the attraction effect modulates subjective valuation even in the absence of choice. The findings also challenge the prospect of using neuroscientific methods to measure utility in a context-free manner and have important implications for theories of reinforcement learning and delay discounting.

  17. Rewards and Performance Incentives.

    Science.gov (United States)

    Zigon, Jack

    1994-01-01

    Discusses rewards and performance incentives for employees, including types of rewards; how rewards help in managing; dysfunctional awards; selecting the right reward; how to find rewards that fit; and delivering rewards effectively. Examples are included. (three references) (LRW)

  18. The Impact of Delays on Parents' Perceptions of Treatments for Problem Behavior

    Science.gov (United States)

    Call, Nathan A.; Reavis, Andrea R.; McCracken, Courtney E.; Gillespie, Scott E.; Scheithauer, Mindy C.

    2015-01-01

    Parent engagement in behavioral interventions is critical for treatments to succeed. Parental decision-making regarding treatments can be impacted by systematic biases, such as the tendency to discount the value of delayed benefits, or "delay discounting". This study examined the impact of delay discounting on parents' perceptions of…

  19. Effects of episodic future thinking on discounting: Personalized age-progressed pictures improve risky long-term health decisions.

    Science.gov (United States)

    Kaplan, Brent A; Reed, Derek D; Jarmolowicz, David P

    2016-03-01

    Many everyday choices are associated with both delayed and probabilistic outcomes. The temporal attention hypothesis suggests that individuals' decision making can be improved by focusing attention on temporally distal events and implies that environmental manipulations that bring temporally distal outcomes into focus may alter an individual's degree of discounting. One such manipulation, episodic future thinking, has shown to lower discount rates; however, several questions remain about the applicability of episodic future thinking to domains other than delay discounting. The present experiments examine the effects of a modified episodic-future-thinking procedure in which participants viewed age-progressed computer-generated images of themselves and answered questions related to their future, on probability discounting in the context of both a delayed health gain and loss. Results indicate that modified episodic future thinking effectively altered individuals' degree of discounting in the predicted directions and demonstrate the applicability of episodic future thinking to decision making of socially significant outcomes.

  20. Strategy iteration is strongly polynomial for 2-player turn-based stochastic games with a constant discount factor

    DEFF Research Database (Denmark)

    Hansen, Thomas Dueholm; Miltersen, Peter Bro; Zwick, Uri

    2011-01-01

    Ye showed recently that the simplex method with Dantzig pivoting rule, as well as Howard's policy iteration algorithm, solve discounted Markov decision processes (MDPs), with a constant discount factor, in strongly polynomial time. More precisely, Ye showed that both algorithms terminate after at......-sum rewards. This provides the first strongly polynomial algorithm for solving these games, resolving a long standing open problem....... iterations. Second, and more importantly, we show that the same bound applies to the number of iterations performed by the strategy iteration (or strategy improvement) algorithm, a generalization of Howard's policy iteration algorithm used for solving 2-player turn-based stochastic games with discounted zero......Ye showed recently that the simplex method with Dantzig pivoting rule, as well as Howard's policy iteration algorithm, solve discounted Markov decision processes (MDPs), with a constant discount factor, in strongly polynomial time. More precisely, Ye showed that both algorithms terminate after...

  1. Homeostatic reinforcement learning for integrating reward collection and physiological stability.

    Science.gov (United States)

    Keramati, Mehdi; Gutkin, Boris

    2014-12-02

    Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

  2. The effect of natural scenes on temporal and probability discounting

    Directory of Open Access Journals (Sweden)

    2015-09-01

    Results: There was no significant difference in delay discounting between groups F(1,172 = .613, p = .607. Males discounted significantly less than females on temporal and probability discounting tasks F(1,300 = 6.795, p = .010; F(1,300 = 9.941, p = .002, respectively. Older individuals delay discount significantly less than younger individuals F(3,300 = 11.826, p < .001. Older individuals had significantly higher positive affect than younger individuals F(3,300 = 7.956, p < .001. Conclusions: The discounting functions obtained were consistent with previous studies. The results for age and gender on discounting contributes to discussion of these matters: While lower levels of impulsivity in older adults is perhaps to be expected, the gender effect obtained here is less easily explained. Contrary to Berry et al. (2014 we found no evidence for any effect of viewing natural scenes on discounting, regardless of their aesthetic properties. While this discrepancy could relate to the differences in methodology employed, it would suggest that the claims for an effect of natural scenes on impulsivity should be treated with caution.

  3. Tuition Discounting for Revenue Management

    Science.gov (United States)

    Hillman, Nicholas W.

    2012-01-01

    Over the past decade, institutionally-funded financial aid (or "tuition discounts") have been the fastest-growing item within most public four-year college and university operating budgets. One explanation for this trend is due to the changing structure of public colleges' revenue streams, as tuition and fees have replaced state appropriations as…

  4. Optimal supplier choice with discounting

    NARCIS (Netherlands)

    Goldengorin, B.; Keane, J.; Kuzmenko, V.; Tso, M. K-S

    2011-01-01

    This paper investigates a model for pricing the demand for a set of goods when suppliers operate discount schedules based on total business value. We formulate the buyers's decision problem as a mixed binary integer program, which is a generalization of the capacitated facility location problem (CFL

  5. Time Discounting and Time Consistency

    NARCIS (Netherlands)

    N. Dimitri; D.J.N. van Eijck (Jan)

    2011-01-01

    htmlabstractTime discounting is the phenomenon that a desired result in the future is perceived as less valuable than the same result now. Economic theories can take this psychological fact into account in several ways. In the economic literature the most widely used type of additive time discountin

  6. Tuition Discounting for Revenue Management

    Science.gov (United States)

    Hillman, Nicholas W.

    2012-01-01

    Over the past decade, institutionally-funded financial aid (or "tuition discounts") have been the fastest-growing item within most public four-year college and university operating budgets. One explanation for this trend is due to the changing structure of public colleges' revenue streams, as tuition and fees have replaced state appropriations as…

  7. Reinforcement learning for discounted values often loses the goal in the application to animal learning.

    Science.gov (United States)

    Yamaguchi, Yoshiya; Sakai, Yutaka

    2012-11-01

    The impulsive preference of an animal for an immediate reward implies that it might subjectively discount the value of potential future outcomes. A theoretical framework to maximize the discounted subjective value has been established in the reinforcement learning theory. The framework has been successfully applied in engineering. However, this study identified a limitation when applied to animal behavior, where in some cases, there is no learning goal. Here a possible learning framework was proposed that is well-posed in any cases and that is consistent with the impulsive preference.

  8. Hoarders Only Discount Consumables and Are More Patient for Money.

    Science.gov (United States)

    Vickers, Brian D; Preston, Stephanie D; Gonzalez, Richard; Angott, Andrea M

    2016-01-01

    Individuals with hoarding disorder (HD) excessively acquire and retain goods while also exhibiting characteristics of impulsivity and addiction. However, HD individuals do not always perform impulsively in experiments, they do not appear interested in money, and they exhibit many features of risk-aversion and future-planning. To examine impulsivity in HD, we compared validated community participants high and low in hoarding tendencies on questionnaire measures of hoarding and impulsivity as well as a standard experimental measure of impulsivity (intertemporal discounting) that was modified to compare decisions about money, pens, and snacks. Common discounting effects were replicated. Compared to the low hoarding group, the high hoarding group was more impatient for consumables (pens and snacks) but they were more patient for money. This increased patience for money in high hoarding individuals is in contrast to all other studies on discounting in disordered populations, but consistent with the phenomenology of HD. HD does not appear to be driven by a fundamental inability to wait, but rather a specific, potent desire for consumable rewards.

  9. I want to media multitask and I want to do it now: Individual differences in media multitasking predict delay of gratification and system-1 thinking.

    Science.gov (United States)

    Schutten, Dan; Stokes, Kirk A; Arnell, Karen M

    2017-01-01

    Media multitasking, the concurrent use of multiple media forms, has been shown to be related to greater self-reported impulsivity and less self-control. These measures are both hallmarks of the need for immediate gratification which has been associated with fast, intuitive 'system-1' decision making, as opposed to more deliberate and effortful 'system-2' decision making. In Study 1, we used the Cognitive Reflection Task (CRT) to examine whether individuals who engage heavily in media multitasking differ from those who are light media multitaskers in their degree of system-1 versus system-2 thinking. In Study 2 we examined whether heavy and light media multitaskers differ in delay of gratification, using the delay discounting measure which estimates the preference for smaller immediate rewards, relative to larger delayed rewards in a hypothetical monetary choice task. We found that heavy media multitaskers were more likely than light media multitaskers to endorse intuitive, but wrong, decisions on the CRT indicating a greater reliance on 'system-1' thinking. Heavy media multitaskers were also willing to settle for less money immediately relative to light media multitaskers who were more willing to wait for the larger delayed reward. These results suggest that heavy media multitaskers have a reactive decision-making style that promotes current desires (money, ease of processing) at the expense of accuracy and future rewards. These findings highlight the potential for heavy media multitaskers to be at risk for problematic behaviors associated with delay discounting - behaviors such as substance abuse, overeating, problematic gambling, and poor financial management.

  10. Reward circuitry function in autism spectrum disorders

    OpenAIRE

    Dichter, Gabriel S.; Felder, Jennifer N.; Green, Steven R.; Rittenberg, Alison M.; Sasson, Noah J.; Bodfish, James W.

    2010-01-01

    Social interaction deficits and restricted repetitive behaviors and interests that characterize autism spectrum disorders (ASDs) may both reflect aberrant functioning of brain reward circuits. However, no neuroimaging study to date has investigated the integrity of reward circuits using an incentive delay paradigm in individuals with ASDs. In the present study, we used functional magnetic resonance imaging to assess blood-oxygen level-dependent activation during reward anticipation and outcom...

  11. Discounting in intergenerational investment appraisal - Survey results

    Directory of Open Access Journals (Sweden)

    Monika Foltyn-Zarychta

    2014-04-01

    Full Text Available Appraising projects with intergenerational effects is a complex task, incorporating the issue of bringing future impacts to present value. This is usually achieved by applying the discount factor. However, the choice of discount rate to intergenerational context faces multiple technical and moral problems. The paper analyses a theoretical rationale behind the concept of intergenerational discount rate and preliminary assessment of intergenerational discount rate level in Poland based on survey done in 2012 among Finance & Insurance Faculty students at University of Economics in Katowice showing the decline in the value of discount rates with time.

  12. The Power of the Virtual Ideal Self in Weight Control: Weight-Reduced Avatars Can Enhance the Tendency to Delay Gratification and Regulate Dietary Practices.

    Science.gov (United States)

    Kuo, Hsu-Chan; Lee, Chun-Chia; Chiou, Wen-Bin

    2016-02-01

    The tendency to discount larger future benefits in favor of smaller immediate gains (i.e., temporal discounting) is relevant to the issue of obesity. Successful weight loss requires individuals to sacrifice immediate culinary pleasures in favor of future health gains. Based on the notion that increasing the vividness of one's future self may mitigate temporal discounting and promote the ability to delay gratification, we examined whether viewing one's weight-reduced self (i.e., the ideal self) in a virtual environment can decrease temporal discounting and lead to better regulation of dietary practices. Seventy-six undergraduates who had reported an intention to lose weight were recruited to participate in a laboratory experiment and were randomly assigned to interact with either the weight-reduced self (experimental condition) or the present self (control condition) by looking into a dressing mirror in a virtual fitting room. A temporal-discounting task and a taste test were subsequently administered. Results showed that, compared with control participants, participants who viewed their weight-reduced avatars ate less ice cream in a taste test and were more likely to choose a sugar-free drink as a reward. The discounting rate mediated the association between the avatar manipulation and the amount of ice cream eaten in the subsequent taste test. Overall, our findings suggest that a computer-generated image of one's weight-reduced self may assist in resisting impulses that promote immediate gratification over delayed benefits. This research provides a new approach for controlling impulsive behavior such as dietary regulation and weight control.

  13. Choice between delayed food and immediate opioids in rats: treatment effects and individual differences.

    Science.gov (United States)

    Panlilio, Leigh V; Secci, Maria E; Schindler, Charles W; Bradberry, Charles W

    2017-09-04

    Addiction involves maladaptive choice behavior in which immediate drug effects are valued more than delayed nondrug rewards. To model this behavior and extend our earlier work with the prescription opioid oxycodone, we allowed rats to choose between immediate intravenous delivery of the short-acting opioid remifentanil and delayed delivery of highly palatable food pellets. Treatment drugs were tested on a baseline where remifentanil was preferred over food. Treatment with a high dose of the opioid antagonist naltrexone decreased but did not reverse the preference for remifentanil. Treatment with the serotonin 5-HT2C agonist lorcaserin decreased remifentanil and food self-administration nonselectively. Across conditions in which the alternative to delayed food was either a moderate dose of oxycodone, a moderate or high dose of remifentanil, a smaller more immediate delivery of food, or timeout with no primary reinforcement, choice was determined by both the length of the delay and the nature of the alternative option. Delayed food was discounted most steeply when the alternative was a high dose of remifentanil, which was preferred over food when food was delayed by 30 s or more. Within-subject comparisons showed no evidence for trait-like impulsivity or sensitivity to delay across these conditions. Choice was determined more by the current contingencies of reinforcement than by innate individual differences. This finding suggests that people might develop steep delay-discounting functions because of the contingencies in their environment, and it supports the use of contingency management to enhance the relative value of delayed nondrug reinforcers.

  14. Escaping the impulse to immediate gratification: the prospect concept promotes a future-oriented mindset, prompting an inclination towards delayed gratification.

    Science.gov (United States)

    Cheng, Ying-Yao; Shein, Paichi Pat; Chiou, Wen-Bin

    2012-02-01

    People's willingness to postpone receiving an immediate reward in order to gain additional benefits in the future, that is, a tendency to shallow delay discounting, is closely related to one's health, wealth, and happiness. We conducted two experiments investigating how the prospect concept can induce a future-oriented mindset and induce people to behave accordingly. We found that engaging in prospective imagery led the participants to focus on delayed utility over immediate utility in financial decisions (Experiment 1). Participants who received the prospect prime via a scrambled-sentence task decreased their desire to pursue hedonic activities for instant gratification (Experiment 2). Moreover, a state of future orientation mediated the effect of the prospect prime on measures of delayed gratification (Experiments 1 and 2). Thus, reminders of prospect may activate a mindset for future orientation by which delayed gratification is strengthened.

  15. The discount window : time for reform?

    OpenAIRE

    Craig S. Hakkio; Gordon H. Sellon

    2000-01-01

    For many years, the Federal Reserve's discount window has played an important role in monetary policy. Discount window borrowing helps individual depository institutions manage their reserve accounts in the presence of unexpected deposit and payments flows. Improved reserve management, in turn, helps stabilize the overnight federal funds market by reducing the volatility of short-term interest rates. Moreover, announced changes in the Federal Reserve's discount rate have often signaled import...

  16. Social discounting involves modulation of neural value signals by temporoparietal junction.

    Science.gov (United States)

    Strombach, Tina; Weber, Bernd; Hangebrauk, Zsofia; Kenning, Peter; Karipidis, Iliana I; Tobler, Philippe N; Kalenscher, Tobias

    2015-02-03

    Most people are generous, but not toward everyone alike: generosity usually declines with social distance between individuals, a phenomenon called social discounting. Despite the pervasiveness of social discounting, social distance between actors has been surprisingly neglected in economic theory and neuroscientific research. We used functional magnetic resonance imaging (fMRI) to study the neural basis of this process to understand the neural underpinnings of social decision making. Participants chose between selfish and generous alternatives, yielding either a large reward for the participant alone, or smaller rewards for the participant and another individual at a particular social distance. We found that generous choices engaged the temporoparietal junction (TPJ). In particular, the TPJ activity was scaled to the social-distance-dependent conflict between selfish and generous motives during prosocial choice, consistent with ideas that the TPJ promotes generosity by facilitating overcoming egoism bias. Based on functional coupling data, we propose and provide evidence for a biologically plausible neural model according to which the TPJ supports social discounting by modulating basic neural value signals in the ventromedial prefrontal cortex to incorporate social-distance-dependent other-regarding preferences into an otherwise exclusively own-reward value representation.

  17. Social discounting involves modulation of neural value signals by temporoparietal junction

    Science.gov (United States)

    Strombach, Tina; Weber, Bernd; Hangebrauk, Zsofia; Kenning, Peter; Karipidis, Iliana I.; Tobler, Philippe N.; Kalenscher, Tobias

    2015-01-01

    Most people are generous, but not toward everyone alike: generosity usually declines with social distance between individuals, a phenomenon called social discounting. Despite the pervasiveness of social discounting, social distance between actors has been surprisingly neglected in economic theory and neuroscientific research. We used functional magnetic resonance imaging (fMRI) to study the neural basis of this process to understand the neural underpinnings of social decision making. Participants chose between selfish and generous alternatives, yielding either a large reward for the participant alone, or smaller rewards for the participant and another individual at a particular social distance. We found that generous choices engaged the temporoparietal junction (TPJ). In particular, the TPJ activity was scaled to the social-distance–dependent conflict between selfish and generous motives during prosocial choice, consistent with ideas that the TPJ promotes generosity by facilitating overcoming egoism bias. Based on functional coupling data, we propose and provide evidence for a biologically plausible neural model according to which the TPJ supports social discounting by modulating basic neural value signals in the ventromedial prefrontal cortex to incorporate social-distance–dependent other-regarding preferences into an otherwise exclusively own-reward value representation. PMID:25605887

  18. Rewarding prayers.

    Science.gov (United States)

    Schjødt, Uffe; Stødkilde-Jørgensen, Hans; Geertz, Armin W; Roepstorff, Andreas

    2008-10-10

    We report a highly significant regional increase of the BOLD response in the caudate nucleus in a group of Danish Christians while performing silent religious prayer. The effect was found in a main-effect analysis of high-structured and low-structured religious recitals relative to comparable secular recitals and to a non-narrative baseline. This supports the hypothesis that religious prayer as a form of frequently recurring behavior is capable of stimulating the dopaminergic reward system in practicing individuals. It extends recent research which demonstrates a relation between interpersonal trust and activation in the dopaminergic system to also encompass relations to abstract entities.

  19. Reward circuitry function in autism spectrum disorders

    Science.gov (United States)

    Felder, Jennifer N.; Green, Steven R.; Rittenberg, Alison M.; Sasson, Noah J.; Bodfish, James W.

    2012-01-01

    Social interaction deficits and restricted repetitive behaviors and interests that characterize autism spectrum disorders (ASDs) may both reflect aberrant functioning of brain reward circuits. However, no neuroimaging study to date has investigated the integrity of reward circuits using an incentive delay paradigm in individuals with ASDs. In the present study, we used functional magnetic resonance imaging to assess blood-oxygen level-dependent activation during reward anticipation and outcomes in 15 participants with an ASD and 16 matched control participants. Brain activation was assessed during anticipation of and in response to monetary incentives and object image incentives previously shown to be visually salient for individuals with ASDs (e.g. trains, electronics). Participants with ASDs showed decreased nucleus accumbens activation during monetary anticipation and outcomes, but not during object anticipation or outcomes. Group × reward-type-interaction tests revealed robust interaction effects in bilateral nucleus accumbens during reward anticipation and in ventromedial prefrontal cortex during reward outcomes, indicating differential responses contingent on reward type in these regions. Results suggest that ASDs are characterized by reward-circuitry hypoactivation in response to monetary incentives but not in response to autism-relevant object images. The clinical implications of the double dissociation of reward type and temporal phase in reward circuitry function in ASD are discussed. PMID:21148176

  20. New Approaches to Defense Inflation and Discounting

    Science.gov (United States)

    2013-01-01

    the artisan loaf to the store brand, buying less bread and more rice, or even switching from the local grocery chain to a discount store. Notably, the...Guzman, “Theory and Practice in the Choice of Social Discount Rate for Cost-Benefit Analysis: A Survey,” Manila, Philippines: Asian Development Bank

  1. Essays on Discounting Behavior and Gambling Behavior

    DEFF Research Database (Denmark)

    Jessen, Lasse J.

    This thesis consists of three independent chapters on the elicitation of individual discount rates and on the estimation of gambling prevalence in Denmark. The first chapter, “Discount Rate Sensitivity to Background Consumption and Consumption Smoothing,” studies the sensitivity of individual dis...

  2. Tuition Discounting to Optimize Enrollment and Revenue

    Science.gov (United States)

    Parrott, Sarah A.

    2008-01-01

    As the borders between higher education systems continue to erode and competition for qualified students increases, many institutions are exploring variable pricing options, known in the USA as "tuition discounting." The goal of tuition discounting is to use institutional funds to attract and retain desired students while maximizing net…

  3. Essays on Discounting Behavior and Gambling Behavior

    DEFF Research Database (Denmark)

    Jessen, Lasse J.

    This thesis consists of three independent chapters on the elicitation of individual discount rates and on the estimation of gambling prevalence in Denmark. The first chapter, “Discount Rate Sensitivity to Background Consumption and Consumption Smoothing,” studies the sensitivity of individual dis...

  4. Effects of Attention to Symbolically Presented Rewards on Self-Control

    Science.gov (United States)

    Mischel, Walter; Moore, Bert

    1973-01-01

    The effects of attention to symbolic presentation of contingent rewards, in the form of slide-presented images, on children's ability to wait for the delayed reward were investigated. Attention to the symbolic contingent rewards greatly increased the duration of the children's delay of gratification. (Author/KM)

  5. Characterizing heterogeneity in children with and without ADHD based on reward system connectivity

    Directory of Open Access Journals (Sweden)

    Taciana G. Costa Dias

    2015-02-01

    Full Text Available One potential obstacle limiting our ability to clarify ADHD etiology is the heterogeneity within the disorder, as well as in typical samples. In this study, we utilized a community detection approach on 106 children with and without ADHD (aged 7–12 years, in order to identify potential subgroups of participants based on the connectivity of the reward system. Children with ADHD were compared to typically developing children within each identified community, aiming to find the community-specific ADHD characteristics. Furthermore, to assess how the organization in subgroups relates to behavior, we evaluated delay-discounting gradient and impulsivity-related temperament traits within each community. We found that discrete subgroups were identified that characterized distinct connectivity profiles in the reward system. Importantly, which connections were atypical in ADHD relative to the control children were specific to the community membership. Our findings showed that children with ADHD and typically developing children could be classified into distinct subgroups according to brain functional connectivity. Results also suggested that the differentiation in “functional” subgroups is related to specific behavioral characteristics, in this case impulsivity. Thus, combining neuroimaging data and community detection might be a valuable approach to elucidate heterogeneity in ADHD etiology and examine ADHD neurobiology.

  6. Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

    Science.gov (United States)

    Vaidya, Jatin G.; Knutson, Brian; O'Leary, Daniel S.; Block, Robert I.; Magnotta, Vincent

    2013-01-01

    Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

  7. Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

    Science.gov (United States)

    Murayama, Kou; Kitagami, Shinji

    2014-02-01

    Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

  8. Discounting Behaviour and the Magnitude Effect

    DEFF Research Database (Denmark)

    Andersen, Steffen; Harrison, Glenn W.; Lau, Morten Igel

    2013-01-01

    We evaluate the claim that individuals exhibit a magnitude effect in their discounting behaviour, where higher discount rates are inferred from choices made with lower principals, all else being equal. If the magnitude effect is quantitatively significant, it is not appropriate to use one discount...... rate that is independent of the scale of the project for cost–benefit analysis and capital budgeting. Using data from a field experiment in Denmark, we find statistically significant evidence of a magnitude effect that is much smaller than is claimed. This evidence surfaces only if one controls...

  9. The Rewards of Learning.

    Science.gov (United States)

    Chance, Paul

    1992-01-01

    Although intrinsic rewards are important, they (along with punishment and encouragement) are insufficient for efficient learning. Teachers must supplement intrinsic rewards with extrinsic rewards, such as praising, complimenting, applauding, and providing other forms of recognition for good work. Teachers should use the weakest reward required to…

  10. The Rewards of Learning.

    Science.gov (United States)

    Chance, Paul

    1992-01-01

    Although intrinsic rewards are important, they (along with punishment and encouragement) are insufficient for efficient learning. Teachers must supplement intrinsic rewards with extrinsic rewards, such as praising, complimenting, applauding, and providing other forms of recognition for good work. Teachers should use the weakest reward required to…

  11. Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

    Science.gov (United States)

    Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

    2015-05-01

    Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  12. Sexual discounting among high-risk youth ages 18-24: implications for sexual and substance use risk behaviors.

    Science.gov (United States)

    Dariotis, Jacinda K; Johnson, Matthew W

    2015-02-01

    Youth under 25 show substantial sexual and substance use risk behaviors. One factor associated with risk behaviors is delay discounting, the devaluation of delayed outcomes. This study determined if delay discounting for sexual outcomes is related to sexual risk and substance use among 18-24 year olds. Females (70) and males (56) completed the Sexual Discounting Task, which assessed their likelihood of having unprotected immediate sex versus waiting for sex with a condom, at various delays, with 4 hypothetical sexual partners selected from photographs: the person they most wanted to have sex with, least wanted to have sex with, judged most likely to have a sexually transmitted infection (STI), and judged least likely to have an STI. They also completed instruments assessing HIV knowledge, sexual behaviors, substance use, risk attitudes, inhibition, impulsivity, and sensation-seeking. Condom use likelihood generally decreased with increasing delay. Preference for immediate, unprotected sex was greater for partners whom participants most (vs. least) wanted to have sex with and judged least (vs. most) likely to have an STI. Preference for immediate, unprotected sex in the "most want to have sex with" and "least likely to have an STI" conditions was related to greater lifetime risky sexual partners, lifetime number of unique substances used, disregard of social approval/danger, disinhibition, and sensation/excitement-seeking. Males showed greater likelihood of unprotected sex than females when condom use was undelayed, but delay similarly affected condom use between sexes. Delay discounting should be considered in strategies to minimize youth risk behavior.

  13. Do Declining Discount Rates lead to Time Inconsistent Economic Advice?

    DEFF Research Database (Denmark)

    Hansen, Anders Chr.

    2006-01-01

    This paper addresses the risk of time inconsistency in economic appraisals related to the use of hyperbolic discounting (declining discount rates) instead of exponential discounting (constant discount rate). Many economists are uneasy about the prospects of potential time inconsistency. The paper...

  14. 7 CFR 1786.153 - Discounted present value.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 12 2010-01-01 2010-01-01 false Discounted present value. 1786.153 Section 1786.153... Discounted Prepayments on RUS Electric Loans § 1786.153 Discounted present value. (a) The discounted present value shall be calculated by summing the present values of all remaining payments on all Qualified...

  15. 7 CFR 1786.53 - Discounted present value.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 12 2010-01-01 2010-01-01 false Discounted present value. 1786.53 Section 1786.53... Special Discounted Prepayments on RUS Direct/Insured Loans § 1786.53 Discounted present value. The Discounted Present Value shall be calculated five business days before prepayment is made by summing...

  16. Time management problems and discounted utility.

    Science.gov (United States)

    König, Cornelius J; Kleinmann, Martin

    2007-05-01

    The lens of behavioral decision theory offers a new perspective for research on time management. The basic idea of this approach is that people discount future consequences of their time management decisions, meaning that they work on tasks with smaller but sooner outcomes rather than on tasks with larger but later outcomes. The authors performed 2 experimental studies to test whether people are sensitive to differences in the discounted utility of time management decisions. In Experiment 1, they used vignettes of typical time management situations; Experiment 2 was a laboratory simulation (an in-basket task that was part of a training assessment). Participants in both studies were German students. As expected, manipulating the discounted utility of options resulted in different time management decisions. In Experiment 1, reactions to time management situations were judged as less likely if the reactions had lower discounted utilities. In Experiment 2, people spent less time on an interruption.

  17. WHEN ONE MIGHT EXPECT NEGATIVE DISCOUNT RATE?

    Directory of Open Access Journals (Sweden)

    Marcin Palenik

    2012-12-01

    Full Text Available Both in economics and psychology, positive discount rate is usually assumed as an axiom. However, there are circumstances which may lead to negative discount rate. This article presents such a phenomenon. Moreover, author presents particular cases of theories and models which imply preference of receiving lower income in later period of time, rather than higher income in earlier period of time (“less later than more earlier”. The described models are as follows: Life Cycle Hypothesis together with Self Control Theory, Construal Level Theory, Model of Patience Formation and Loewenstein’s Anticipation Model. Authors conclude that there is a need of empirical research verifying implications of these models concerning negative discount rate. Authors believe that the problem of negative discount rate deserves more attention, taking into account that in developed countries interest rates are close to zero and it still does not discourage customers from putting money aside.

  18. ACCOUNTING TREATMENT FOR COMMERCIAL DISCOUNTS ON GOODS PURCHASED FOR RESALE

    Directory of Open Access Journals (Sweden)

    HOLT GHEORGHE

    2016-04-01

    Full Text Available In the specialized literature there are two major categories of discounts applied between business partners: trade discounts and financial discounts. In terms of accounting, the method of calculation of interest is commercial and financial cuts, especially the tax treatment of them. Trade discounts are applied prior to financial services, and both types of discounts are calculated on the net earlier. Discounts are calculated after applying discounts and special an issue is to know the level of rebates, which are determined periodically based on the turnover.

  19. TD Waterhouse discount brokerage: a competitive strategy

    OpenAIRE

    Dangerfield, Catherine

    2007-01-01

    This paper provides a strategic analysis of TD Waterhouse (TDW), the discount brokerage provider within TD Bank Financial Group (TDBFG). Discount brokerage in Canada is an increasingly lucrative industry and contributes significantly to the bottom lines of every major financial institution in the country. It is also a rapidly changing and intensely price-competitive industry in which an explicit, educated business strategy is of the utmost importance. TDW currently employs a somewhat ambiguou...

  20. An Inventory Model with Finite Replenishment Rate, Trade Credit Policy and Price-Discount Offer

    Directory of Open Access Journals (Sweden)

    Biswajit Sarkar

    2013-01-01

    Full Text Available When some suppliers offer trade credit periods and price discounts to retailers in order to increase the demand of their products, retailers have to face different types of discount offers and credits within which they have to take a decision which is the best offer for them to make more profit. The retailers try to buy perfect-quality items at a reasonable price, and also they try to invest returns obtained by selling those items in such a manner that their business is not hampered. In this point of view, we consider an economic order quantity (EOQ model for various types of time-dependent demand when delay in payment and price discount are permitted by suppliers to retailers. The models of various demand patterns are discussed analytically. Some numerical examples and graphical representations are considered to illustrate the model.

  1. Strategy Iteration Is Strongly Polynomial for 2-Player Turn-Based Stochastic Games with a Constant Discount Factor

    DEFF Research Database (Denmark)

    Hansen, Thomas Dueholm; Miltersen, Peter Bro; Zwick, Uri

    2013-01-01

    -based stochastic games with discounted zero-sum rewards. This provides the first strongly polynomial algorithm for solving these games, solving a long standing open problem. Combined with other recent results, this provides a complete characterization of the complexity the standard strategy iteration algorithm......Ye [2011] showed recently that the simplex method with Dantzig’s pivoting rule, as well as Howard’s policy iteration algorithm, solve discounted Markov decision processes (MDPs), with a constant discount factor, in strongly polynomial time. More precisely, Ye showed that both algorithms terminate...... terminates after at most O(m1−γ log n1−γ) iterations. Second, and more importantly, we show that the same bound applies to the number of iterations performed by the strategy iteration (or strategy improvement) algorithm, a generalization of Howard’s policy iteration algorithm used for solving 2-player turn...

  2. [The model of the reward choice basing on the theory of reinforcement learning].

    Science.gov (United States)

    Smirnitskaia, I A; Frolov, A A; Merzhanova, G Kh

    2007-01-01

    We developed the model of alimentary instrumental conditioned bar-pressing reflex for cats making a choice between either immediate small reinforcement ("impulsive behavior") or delayed more valuable reinforcement ("self-control behavior"). Our model is based on the reinforcement learning theory. We emulated dopamine contribution by discount coefficient of this theory (a subjective decrease in the value of a delayed reinforcement). The results of computer simulation showed that "cats" with large discount coefficient demonstrated "self-control behavior"; small discount coefficient was associated with "impulsive behavior". This data are in agreement with the experimental data indicating that the impulsive behavior is due to a decreased amount of dopamine in striatum.

  3. Can adolescents learn self-control? Delay of gratification in the development of control over risk taking.

    Science.gov (United States)

    Romer, Daniel; Duckworth, Angela L; Sznitman, Sharon; Park, Sunhee

    2010-09-01

    Recent findings from developmental neuroscience suggest that the adolescent brain is too immature to exert control over impulsive drives, such as sensation seeking, that increase during adolescence. Using a discounting of delayed reward paradigm, this research examines the ability to delay gratification as a potential source of control over risk-taking tendencies that increase during adolescence. In addition, it explores the role of experience resulting from risk taking as well as future time perspective as contributors to the development of this ability. In a nationally representative sample (n = 900) of young people aged 14-22, a structural equation analysis shows that risk taking as assessed by use of three popular drugs (tobacco, marijuana, and alcohol) is inversely related to the ability to delay gratification. The relation is robust across gender, age, and different levels of sensation seeking. In addition, high sensation seekers exhibit dramatic age-related increase in delay of gratification, lending support to the hypothesis that engaging in risky behavior provides experience that leads to greater patience for long-term rewards. The findings support the conclusion that a complete understanding of the development of self-control must consider individual differences not easily explained by universal trends in brain maturation.

  4. Reliability of the Discounting Inventory: An extension into substance-use population

    Directory of Open Access Journals (Sweden)

    Malesza Marta

    2017-06-01

    Full Text Available Recent research introduced the Discounting Inventory that allows the measurement of individual differences in the delay, probabilistic, effort, and social discounting rates. The goal of this investigation was to determine several aspects of the reliability of the Discounting Inventory using the responses of 385 participants (200 non-smokers and 185 current-smokers. Two types of reliability are of interest. Internal consistency and test-retest stability. A secondary aim was to extend such reliability measures beyond the non-clinical participant. The current study aimed to measure the reliability of the DI in a nicotine-dependent individuals and non-nicotine-dependent individuals. It is concluded that the internal consistency of the DI is excellent, and that the test-retest reliability results suggest that items intended to measure three types of discounting were likely testing trait, rather than state, factors, regardless of whether “non-smokers” were included in, or excluded from, the analyses (probabilistic discounting scale scores being the exception. With these cautions in mind, however, the psychometric properties of the DI appear to be very good.

  5. Neural response to reward anticipation is modulated by Gray's impulsivity.

    Science.gov (United States)

    Hahn, Tim; Dresler, Thomas; Ehlis, Ann-Christine; Plichta, Michael M; Heinzel, Sebastian; Polak, Thomas; Lesch, Klaus-Peter; Breuer, Felix; Jakob, Peter M; Fallgatter, Andreas J

    2009-07-15

    According to the Reinforcement Sensitivity Theory (RST), Gray's dimension of impulsivity, reflecting human trait reward sensitivity, determines the extent to which stimuli activate the Behavioural Approach System (BAS). The potential neural underpinnings of the BAS, however, remain poorly understood. In the present study, we examined the association between Gray's impulsivity as defined by the RST and event-related fMRI BOLD-response to anticipation of reward in twenty healthy human subjects in brain regions previously associated with reward processing. Anticipation of reward during a Monetary Incentive Delay Task elicited activation in key components of the human reward circuitry such as the ventral striatum, the amygdala and the orbitofrontal cortex. Interindividual differences in Gray's impulsivity accounted for a significant amount of variance of the reward-related BOLD-response in the ventral striatum and the orbitofrontal cortex. Specifically, higher trait reward sensitivity was associated with increased activation in response to cues indicating potential reward. Extending previous evidence, here we show that variance in functional brain activation during anticipation of reward is attributed to interindividual differences regarding Gray's dimension of impulsivity. Thus, trait reward sensitivity contributes to the modulation of responsiveness in major components of the human reward system which thereby display a core property of the BAS. Generally, fostering our understanding of the neural underpinnings of the association of reward-related interindividual differences in affective traits might aid researchers in quest for custom-tailored treatments of psychiatric disorders, further disentangling the complex relationship between personality traits, emotion, and health.

  6. The Timing Effects of Reward, Business Longevity, and Involvement on Consumers’ Responses to a Reward Program

    Directory of Open Access Journals (Sweden)

    Badri Munir Sukoco

    2015-06-01

    Full Text Available Managers could elicit customers’ repeat purchase behavior through a well-designed reward program. This study examines two extrinsic cues - business longevity and timing effects of reward – to determine the consumers’ perceived risk and intention to participate in this kind of program. Moreover, this study discusses how different levels of involvement might interact with these two cues. An experiment with a 2 (business longevity: long vs. short x 2 (timing of reward: delayed vs. immediate x 2 (involvement: high vs. low between-subject factorial design is conducted to validate the proposed research hypotheses. The results show that an immediate reward offered by an older, more established, firm for a highly-involved product, make loyalty programs less risky and consequently attract consumers to participate. Interestingly, immediate rewards that are offered by older firms for a product that customers are less involved in has the opposite effects. Managerial and academic implications are further presented in this study.

  7. The Discounting Confusion: An Ecological Economics Perspective

    Directory of Open Access Journals (Sweden)

    Frank G. Müller

    2013-06-01

    Full Text Available Factors impacting on the discounting process are mirrored in every aspect of human activities, be it the philosophical, the aesthetic, the religious through to the environmental and scientific experiences. In short, discounting is a controversial concept, and yet, the economic profession seems to ignore that issues related to “long-term” discounting are complex, multifaceted, and far from settled. The environmental community in particular has expressed reservations about discounting, because this process —an inherently myopic one— embodies a built-in bias against the future generations.It will be argued here that the danger to ecological sustainability is of a specific nature, namely,it relates to the lack of substitutability between human-made capital and natural capital. If this assumption is accepted, then it follows that using a discount rate is an inadequate instrumentfor achieving sustainability. Thus, it will be argued that the implementation of the precautionary principle, e.g., in form of “safe minimum standards” of ecosystem protection, provides a successful approach for achieving sustainability.

  8. Cost of delay and endogenous price leadership

    OpenAIRE

    Pastine, Tuvana

    2004-01-01

    We study the effects of discounting in a standard endogenous price leadership model. We show that there will be occasional changes in the identity of the leader with any cost of delay or discounting, however small. By analyzing the incentives that induce a firm to take up the leader position, we derive positive predictions about which firm will lead most price changes. Firms with shorter reaction times will be more likely to become the price leader, as will firms with lower cost o...

  9. Motivation and reward systems

    NARCIS (Netherlands)

    van Eerde, W.; Vodosek, M.; den Hartog, D.N.; McNett, J.M.

    2014-01-01

    Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are discus

  10. Punished by Rewards?

    Science.gov (United States)

    Brandt, Ron

    1995-01-01

    The author of "Punished by Rewards" (1993), claims that rewards and punishments serve to manipulate behavior and destroy the potential for real learning. Praise is especially tricky, since intangible rewards can also foster compliance, not motivation. An engaging curriculum and a caring atmosphere encourage kids to exercise their natural…

  11. Discounting in Games across Time Scales

    Directory of Open Access Journals (Sweden)

    Krishnendu Chatterjee

    2010-06-01

    Full Text Available We introduce two-level discounted games played by two players on a perfect-information stochastic game graph. The upper level game is a discounted game and the lower level game is an undiscounted reachability game. Two-level games model hierarchical and sequential decision making under uncertainty across different time scales. We show the existence of pure memoryless optimal strategies for both players and an ordered field property for such games. We show that if there is only one player (Markov decision processes, then the values can be computed in polynomial time. It follows that whether the value of a player is equal to a given rational constant in two-level discounted games can be decided in NP intersected coNP. We also give an alternate strategy improvement algorithm to compute the value.

  12. Discounting in Games across Time Scales

    CERN Document Server

    Chatterjee, Krishnendu; 10.4204/EPTCS.25.6

    2010-01-01

    We introduce two-level discounted games played by two players on a perfect-information stochastic game graph. The upper level game is a discounted game and the lower level game is an undiscounted reachability game. Two-level games model hierarchical and sequential decision making under uncertainty across different time scales. We show the existence of pure memoryless optimal strategies for both players and an ordered field property for such games. We show that if there is only one player (Markov decision processes), then the values can be computed in polynomial time. It follows that whether the value of a player is equal to a given rational constant in two-level discounted games can be decided in NP intersected coNP. We also give an alternate strategy improvement algorithm to compute the value.

  13. Social and monetary reward processing in autism spectrum disorders

    Directory of Open Access Journals (Sweden)

    Delmonte Sonja

    2012-09-01

    Full Text Available Abstract Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD. However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS. The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in

  14. 10% discount at Novae restaurants for students

    CERN Multimedia

    2016-01-01

    A 10% discount will be granted for students dining in restaurants 1 and 2 (on the Meyrin site) during the summer from 15 June 2016 to 15 September 2016.   A special badge will be issued by the respective secretariats if the student fulfils the following criteria:  Is under 25 years old; Is in possession of a student card issued by a University or college; Has a CERN contract > 1 month (Users, Summer Students, Trainees, etc). This badge and the CERN access card will have to be shown at the Novae restaurants in order to benefit from this discount.

  15. Discount method for programming language evaluation

    DEFF Research Database (Denmark)

    Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

    2016-01-01

    internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming......This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...

  16. Delay Choice vs. Delay Maintenance: Different Measures of Delayed Gratification in Capuchin Monkeys (Cebus apella)

    Science.gov (United States)

    Addessi, Elsa; Paglieri, Fabio; Beran, Michael J.; Evans, Theodore A.; Macchitella, Luigi; De Petrillo, Francesca; Focaroli, Valentina

    2013-01-01

    Delaying gratification involves two components: (i) delay choice (selecting a delayed reward over an immediate one), and (ii) delay maintenance (sustaining the decision to delay gratification even if the immediate reward is available during the delay). In primates, two tasks most commonly have explored these components, the Intertemporal choice task and the Accumulation task. It is unclear whether these tasks provide equivalent measures of delay of gratification. Here, we compared the performance of the same capuchin monkeys, belonging to two study populations, between these tasks. We found only limited evidence of a significant correlation in performance. Consequently, in contrast to what is often assumed, our data provide only partial support to the hypothesis that these tasks provide equivalent measures of delay of gratification. PMID:23544770

  17. Climate policy under sustainable discounted utilitarianism

    Energy Technology Data Exchange (ETDEWEB)

    Dietz, Simon [London School of Economics and Political Science (LSE) (United Kingdom); Asheim, Geir B. [Oslo Univ. (Norway). Dept. of Economics

    2011-08-15

    Empirical evaluation of policies to mitigate climate change has been largely confined to the application of discounted utilitarianism (DU). DU is controversial, both due to the conditions through which it is justified and due to its consequences for climate policies, where the discounting of future utility gains from present abatement efforts makes it harder for such measures to justify their present costs. In this paper, we propose sustainable discounted utilitarianism (SDU) as an alternative principle for evaluation of climate policy. Unlike undiscounted utilitarianism, which always assigns zero relative weight to present utility, SDU is an axiomatically based criterion, which departs from DU by assigning zero weight to present utility if and only if the present is better off than the future. Using the DICE integrated assessment model to run risk analysis, we show that it is possible for the future to be worse off than the present along a 'business as usual' development path. Consequently SDU and DU differ, and willingness to pay for emissions reductions is (sometimes significantly) higher under SDU than under DU. Under SDU, stringent schedules of emissions reductions increase social welfare, even for a relatively high utility discount rate. (orig.)

  18. A New Outlet for Discount Shopping

    Institute of Scientific and Technical Information of China (English)

    S.E.CONGDON-MARTIN

    2004-01-01

    Shanghai Outlet Mall's flaming yellow and orange signage, featuring the word ‘outlet' in two-meter tall capital letters, shrieks, “I'm here!” A sprawling warehouse of discount clothes sold from regular stores and makeshift cubicles, Shanghai Outlet is the pioneer for outlet malls in the city, and one of the first in the country.

  19. Discounting Models for Outcomes over Continuous Time

    DEFF Research Database (Denmark)

    Harvey, Charles M.; Østerdal, Lars Peter

    Events that occur over a period of time can be described either as sequences of outcomes at discrete times or as functions of outcomes in an interval of time. This paper presents discounting models for events of the latter type. Conditions on preferences are shown to be satisfied if and only if t...

  20. Win-Win Strategies at Discount Stores

    NARCIS (Netherlands)

    B. Deleersnyder (Barbara); M.G. Dekimpe (Marnik); J-B.E.M. Steenkamp (Jan-Benedict); O. Koll

    2005-01-01

    textabstractAn important development that contributes to store brands’ growing success in the grocery market is the increasing number of discount stores that sell predominantly own, private-label, brands. To fight private labels, manufacturers of national brands feel increasingly compelled to develo

  1. Book Discounts and Cost-Plus Pricing

    Science.gov (United States)

    Andresen, David C.

    1974-01-01

    The adoption of cost-plus pricing by a major book jobber may have profound effects on the discounts that libraries receive. The article explains the pricing system and presents a set of graphs for libraries to use to determine its effects. (Author)

  2. Discount Functions for Fitting Individual Data

    NARCIS (Netherlands)

    H. Bleichrodt (Han); K.I.M. Rohde (Kirsten); P.P. Wakker (Peter)

    2007-01-01

    textabstractThe commonly used hyperbolic and quasi-hyperbolic discount functions imply decreasing impatience, which is the prevailing empirical phenomenon in intertemporal choice, in particular for aggregate behavior. At the individual level there is much variation, however, and there will always be

  3. Skiba points for small discount rates

    NARCIS (Netherlands)

    F.O.O. Wagener

    2006-01-01

    The present article uses perturbation techniques to approximate the value function of an economic minimization problem for small values of the discount rate. This can be used to obtain the approximate location of the Skiba states in the problem; these are states for which there are two distinct opti

  4. Discounts at the Carlson Wagonlit travel agency

    CERN Multimedia

    2008-01-01

    The Carlson Wagonlit travel agency is offering exceptional discounts of up to 40% for bookings with M-Travel before 29 February 2008 and Helvetic Tours before 30 March 2008. For terms and conditions and further information please contact the CERN Carlson Wagonlit Travel office, Main Building (500), Tel. 72763.

  5. Discounting medical malpractice claim reserves for self-insured hospitals.

    Science.gov (United States)

    Frese, Richard; Kitchen, Patrick

    2011-01-01

    The hospital CFO often works with the hospital's actuary and external auditor to calculate the reserves recorded in financial statements. Hospital management, usually the CFO, needs to decide the discount rate that is most appropriate. A formal policy addressing the rationale for discounting and the rationale for selecting the discount rate can be helpful to the CFO, actuary, and external auditor.

  6. Discounting health effects in pharmacoeconomic evaluations : Current controversies

    NARCIS (Netherlands)

    Bos, JM; Postma, MJ; Annemans, L

    2005-01-01

    Currently, much debate still surrounds the discounting of health effects: Most general consensus statements have argued for the same discount rate for health and money; however, this practice has been questioned by several authors. The choice of discount rate can have varying effects on intervention

  7. 7 CFR 1786.98 - Discounted present value.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 12 2010-01-01 2010-01-01 false Discounted present value. 1786.98 Section 1786.98... Discounted present value. (a) The Discounted Present Value shall be calculated by RUS before prepayment is made by summing the present values of all remaining payments on all outstanding notes according to...

  8. Markov reward processes

    Science.gov (United States)

    Smith, R. M.

    1991-01-01

    Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

  9. Single pulse TMS differentially modulates reward behavior.

    Science.gov (United States)

    Stanford, Arielle D; Luber, Bruce; Unger, Layla; Cycowicz, Yael M; Malaspina, Dolores; Lisanby, Sarah H

    2013-12-01

    Greater knowledge of cortical brain regions in reward processing may set the stage for using transcranial magnetic stimulation (TMS) as a treatment in patients with avolition, apathy or other drive-related symptoms. This study examined the effects of single pulse (sp) TMS to two reward circuit targets on drive in healthy subjects. Fifteen healthy subjects performed the monetary incentive delay task (MID) while receiving fMRI-guided spTMS to either inferior parietal lobe (IPL) or supplemental motor area (SMA). The study demonstrated decreasing reaction times (RT) for increasing reward. It also showed significant differences in RT modulation for TMS pulses to the IPL versus the SMA. TMS pulses during the delay period produced significantly more RT slowing when targeting the IPL than those to the SMA. This RT slowing carried over into subsequent trials without TMS stimulation, with significantly slower RTs in sessions that had targeted the IPL compared to those targeting SMA. The results of this study suggest that both SMA and IPL are involved in reward processing, with opposite effects on RT in response to TMS stimulation. TMS to these target cortical regions may be useful in modulating reward circuit deficits in psychiatric populations.

  10. Blunted ventral striatal responses to anticipated rewards foreshadow problematic drug use in novelty-seeking adolescents

    Science.gov (United States)

    Büchel, Christian; Peters, Jan; Banaschewski, Tobias; Bokde, Arun L. W.; Bromberg, Uli; Conrod, Patricia J.; Flor, Herta; Papadopoulos, Dimitri; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Walter, Henrik; Ittermann, Bernd; Mann, Karl; Martinot, Jean-Luc; Paillère-Martinot, Marie-Laure; Nees, Frauke; Paus, Tomas; Pausova, Zdenka; Poustka, Luise; Rietschel, Marcella; Robbins, Trevor W.; Smolka, Michael N.; Gallinat, Juergen; Schumann, Gunter; Knutson, Brian; Arroyo, Mercedes; Artiges, Eric; Aydin, Semiha; Bach, Christine; Barbot, Alexis; Barker, Gareth; Bruehl, Ruediger; Cattrell, Anna; Constant, Patrick; Crombag, Hans; Czech, Katharina; Dalley, Jeffrey; Decideur, Benjamin; Desrivieres, Sylvane; Fadai, Tahmine; Fauth-Buhler, Mira; Feng, Jianfeng; Filippi, Irinia; Frouin, Vincent; Fuchs, Birgit; Gemmeke, Isabel; Genauck, Alexander; Hanratty, Eanna; Heinrichs, Bert; Heym, Nadja; Hubner, Thomas; Ihlenfeld, Albrecht; Ing, Alex; Ireland, James; Jia, Tianye; Jones, Jennifer; Jurk, Sarah; Kaviani, Mehri; Klaassen, Arno; Kruschwitz, Johann; Lalanne, Christophe; Lanzerath, Dirk; Lathrop, Mark; Lawrence, Claire; Lemaitre, Hervé; Macare, Christine; Mallik, Catherine; Mar, Adam; Martinez-Medina, Lourdes; Mennigen, Eva; de Carvahlo, Fabiana Mesquita; Mignon, Xavier; Millenet, Sabina; Miranda, Ruben; Müller, Kathrin; Nymberg, Charlotte; Parchetka, Caroline; Pena-Oliver, Yolanda; Pentilla, Jani; Poline, Jean-Baptiste; Quinlan, Erin Burke; Rapp, Michael; Ripke, Stephan; Ripley, Tamzin; Robert, Gabriel; Rogers, John; Romanowski, Alexander; Ruggeri, Barbara; Schmäl, Christine; Schmidt, Dirk; Schneider, Sophia; Schubert, Florian; Schwartz, Yannick; Sommer, Wolfgang; Spanagel, Rainer; Speiser, Claudia; Spranger, Tade; Stedman, Alicia; Stephens, Dai; Strache, Nicole; Ströhle, Andreas; Struve, Maren; Subramaniam, Naresh; Theobald, David; Vetter, Nora; Vulser, Helene; Weiss, Katharina; Whelan, Robert; Williams, Steve; Xu, Bing; Yacubian, Juliana; Yu, Tao; Ziesch, Veronika

    2017-01-01

    Novelty-seeking tendencies in adolescents may promote innovation as well as problematic impulsive behaviour, including drug abuse. Previous research has not clarified whether neural hyper- or hypo-responsiveness to anticipated rewards promotes vulnerability in these individuals. Here we use a longitudinal design to track 144 novelty-seeking adolescents at age 14 and 16 to determine whether neural activity in response to anticipated rewards predicts problematic drug use. We find that diminished BOLD activity in mesolimbic (ventral striatal and midbrain) and prefrontal cortical (dorsolateral prefrontal cortex) regions during reward anticipation at age 14 predicts problematic drug use at age 16. Lower psychometric conscientiousness and steeper discounting of future rewards at age 14 also predicts problematic drug use at age 16, but the neural responses independently predict more variance than psychometric measures. Together, these findings suggest that diminished neural responses to anticipated rewards in novelty-seeking adolescents may increase vulnerability to future problematic drug use. PMID:28221370

  11. Probabilistic Discounting of Hypothetical Monetary Gains: University Students Differ in How They Discount "Won" and "Owed" Money

    Science.gov (United States)

    Weatherly, Jeffrey N.; Derenne, Adam

    2013-01-01

    The present study tested whether participants would discount "won" money differently than they would "owed" money in a probability-discounting task. Participants discounted $1000 or $100,000 that they had won in a sweepstakes or that was owed to them using the multiple-choice (Experiment 1) or fill-in-the-blank (Experiment 2) method of collecting…

  12. Probabilistic Discounting of Hypothetical Monetary Gains: University Students Differ in How They Discount "Won" and "Owed" Money

    Science.gov (United States)

    Weatherly, Jeffrey N.; Derenne, Adam

    2013-01-01

    The present study tested whether participants would discount "won" money differently than they would "owed" money in a probability-discounting task. Participants discounted $1000 or $100,000 that they had won in a sweepstakes or that was owed to them using the multiple-choice (Experiment 1) or fill-in-the-blank (Experiment 2) method of collecting…

  13. Approximating a Behavioural Pseudometric without Discount for Probabilistic Systems

    CERN Document Server

    van Breugel, Franck; Worrell, James

    2008-01-01

    Desharnais, Gupta, Jagadeesan and Panangaden introduced a family of behavioural pseudometrics for probabilistic transition systems. These pseudometrics are a quantitative analogue of probabilistic bisimilarity. Distance zero captures probabilistic bisimilarity. Each pseudometric has a discount factor, a real number in the interval (0, 1]. The smaller the discount factor, the more the future is discounted. If the discount factor is one, then the future is not discounted at all. Desharnais et al. showed that the behavioural distances can be calculated up to any desired degree of accuracy if the discount factor is smaller than one. In this paper, we show that the distances can also be approximated if the future is not discounted. A key ingredient of our algorithm is Tarski's decision procedure for the first order theory over real closed fields. By exploiting the Kantorovich-Rubinstein duality theorem we can restrict to the existential fragment for which more efficient decision procedures exist.

  14. When is it worth waiting for? Food quantity, but not food quality, affects delay tolerance in tufted capuchin monkeys.

    Science.gov (United States)

    De Petrillo, Francesca; Gori, Emanuele; Micucci, Antonia; Ponsi, Giorgia; Paglieri, Fabio; Addessi, Elsa

    2015-09-01

    When faced with choices between smaller sooner options and larger later options (i.e. intertemporal choices), both humans and non-human animals discount future rewards. Apparently, only humans consistently show the magnitude effect, according to which larger options are discounted over time at a lower rate than smaller options. Most of the studies carried out in non-human animals led instead to negative results. Here, we tested ten tufted capuchin monkeys (Sapajus spp.) in a delay choice task to evaluate whether they show a magnitude effect when choosing between different quantities of the same food or when the options are represented by high- and low-preferred foods in different conditions. Whereas food quality did not play a role, we provided the first evidence of an effect of the reward amount on temporal preferences in a non-human primate species, a result with potential implications for the validity of comparative studies on the evolution of delay tolerance. In contrast with human results, but as shown in other animal species, capuchins' choice of the larger later option decreased as the amount of the smaller sooner option increased. Capuchins based their temporal preferences on the quantity of the smaller sooner option, rather than on that of the larger later option, probably because in the wild they virtually never have to choose between the above two options at the same time, but they more often encounter them consecutively. Thus, paying attention to the sooner option and deciding on the basis of its features may be an adaptive strategy rather than an irrational response.

  15. Reward Merit with Praise.

    Science.gov (United States)

    Andrews, Hans A.

    1987-01-01

    Describes the efforts of two educational institutions to reward teaching excellence using positive feedback rather than merit pay incentives. An Arizona district, drawing on Herzberg's motivation theories, offers highly individualized rewards ranging from computers to conference money, while an Illinois community college bestows engraved plaques…

  16. Synchronisation of customers’ orders using discounts

    DEFF Research Database (Denmark)

    Buhayenko, Viktoryia; van Eikenhorst, Erik

    2016-01-01

    is able to give his customers the incentive to change their order patterns in a way that minimizes his total cost. With the new order schemes, all parties are at least as well off as before. A mono-objective reformulation for this conflicting bi-objective problem is proposed and a mixed-integer based...... the supplier's profit a modification of the heuristic which differs in the discount approximation used is developed....

  17. Accounting and Tax Issues Concerning Commercial Discounts

    Directory of Open Access Journals (Sweden)

    Sava Raluca

    2015-12-01

    Full Text Available Commercial discounts accounting presents a particular importance because, on the one hand, of their widely spread on a large scale in the commercial activity and on the second hand, due to the influence of the accounting and reporting method over the value added tax. The paper theoretically addresses commercial reductions and also their reflection in the accounting according with the latest regulations in force.

  18. Dopaminergic Enhancement of Striatal Response to Reward in Major Depression.

    Science.gov (United States)

    Admon, Roee; Kaiser, Roselinde H; Dillon, Daniel G; Beltzer, Miranda; Goer, Franziska; Olson, David P; Vitaliano, Gordana; Pizzagalli, Diego A

    2017-04-01

    Major depressive disorder is characterized by reduced reward-related striatal activation and dysfunctional reward learning, putatively reflecting decreased dopaminergic signaling. The goal of this study was to test whether a pharmacological challenge designed to facilitate dopaminergic transmission can enhance striatal responses to reward and improve reward learning in depressed individuals. In a double-blind placebo-controlled design, 46 unmedicated depressed participants and 43 healthy control participants were randomly assigned to receive either placebo or a single low dose (50 mg) of the D2/D3 receptor antagonist amisulpride, which is believed to increase dopamine signaling through presynaptic autoreceptor blockade. To investigate the effects of increased dopaminergic transmission on reward-related striatal function and behavior, a monetary incentive delay task (in conjunction with functional MRI) and a probabilistic reward learning task were administered at absorption peaks of amisulpride. Depressed participants selected previously rewarded stimuli less frequently than did control participants, indicating reduced reward learning, but this effect was not modulated by amisulpride. Relative to depressed participants receiving placebo (and control participants receiving amisulpride), depressed participants receiving amisulpride exhibited increased striatal activation and potentiated corticostriatal functional connectivity between the nucleus accumbens and the midcingulate cortex in response to monetary rewards. Stronger corticostriatal connectivity in response to rewards predicted better reward learning among depressed individuals receiving amisulpride as well as among control participants receiving placebo. Acute enhancement of dopaminergic transmission potentiated reward-related striatal activation and corticostriatal functional connectivity in depressed individuals but had no behavioral effects. Taken together, the results suggest that targeted pharmacological

  19. Analysis of Time of Day Fare Discounts on Urban Mass Transit Travel Behavior, Crowding, and Waiting Time

    Directory of Open Access Journals (Sweden)

    Xiao Guo

    2014-01-01

    Full Text Available Every morning, commuters select the regularly dispatched urban mass transit for traveling from a residential area to a workplace. This paper aims to find an optimal discount fare and time intervals on morning peak hour. As a direct and flexible traffic economic instrument, fares can influence commuters’ behavior. Therefore, fare discount has been proposed to regulate traffic flow in different time. Two models have been analyzed to describe it with schedule delay because of the travel demand size. The first objective function is constructed on pressure equalization when the travel demand is small. The other objective function is to minimize total waiting time when the travel demand is large. In the end, numerical examples based on an artificial network are performed to characterize fare discount models.

  20. Cognitive decline is associated with risk aversion and temporal discounting in older adults without dementia.

    Directory of Open Access Journals (Sweden)

    Bryan D James

    Full Text Available Risk aversion and temporal discounting are preferences that are strongly linked to sub-optimal financial and health decision making ability. Prior studies have shown they differ by age and cognitive ability, but it remains unclear whether differences are due to age-related cognitive decline or lower cognitive abilities over the life span. We tested the hypothesis that cognitive decline is associated with higher risk aversion and temporal discounting in 455 older persons without dementia from the Memory and Aging Project, a longitudinal cohort study of aging in Chicago. All underwent repeated annual cognitive evaluations using a detailed battery including 19 tests. Risk aversion was measured using standard behavioral economics questions: participants were asked to choose between a certain monetary payment versus a gamble in which they could gain more or nothing; potential gamble gains varied across questions. Temporal discounting: participants were asked to choose between an immediate, smaller payment and a delayed, larger one; two sets of questions addressed small and large stakes based on payment amount. Regression analyses were used to examine whether prior rate of cognitive decline predicted level of risk aversion and temporal discounting, controlling for age, sex, and education. Over an average of 5.5 (SD=2.9 years, cognition declined at an average of 0.016 units per year (SD=0.03. More rapid cognitive decline predicted higher levels of risk aversion (p=0.002 and temporal discounting (small stakes: p=0.01, high stakes: p=0.006. Further, associations between cognitive decline and risk aversion (p=0.015 and large stakes temporal discounting (p=0.026 persisted in analyses restricted to persons without any cognitive impairment (i.e., no dementia or mild cognitive impairment; the association of cognitive decline and small stakes temporal discounting was no longer statistically significant (p=0.078. These findings are consistent with the

  1. Desvalorização de ganhos e perdas monetárias em fumantes, fumantes em tratamento e não fumantes Discounting of monetary gains and losses by smokers, smokers seeking treatment and non-smokers

    Directory of Open Access Journals (Sweden)

    Arianne de Sá Barbosa

    2012-12-01

    Full Text Available Fumantes tendem a escolher recompensas imediatas de menor valor e desvalorizar as atrasadas de maior valor em modelos de desvalorização pelo atraso (DA. Entretanto, pouco se sabe sobre a escolha temporal de consequências apetitivas e aversivas de fumantes que decidem parar de fumar. Por isso, investigou-se a DA em uma tarefa com perdas e ganhos de valores monetários hipotéticos em fumantes (n = 20, fumantes em tratamento (n = 20 e não fumantes (n = 20, que também responderam o questionário de tolerância de Fagerström e o ASSIST. A DA foi maior para fumantes do que para não fumantes para ganhos (mas não perdas. Fumantes em tratamento não diferiram dos outros grupos, apresentando uma DA intermediária. Estes podem ser um subgrupo de fumantes menos impulsivos ou a decisão de parar de fumar reduziu a DA. A DA pode ser uma preditora do sucesso da cessação do tabagismo.Smokers tend to choose immediate reward of small magnitude and discount delayed reward of larger magnitude in Delay Discounting Models (DD. However, little is known about temporal choice of appetitive and aversive consequences among smokers who seek to quit smoking. DD was examined in a task of hypothetical monetary gains and losses in smokers (n = 20, smokers seeking treatment (n = 20 and non-smokers, who also answered the Fagerström Tolerance Questionnaire, and ASSIST. Smokers showed a greater DD than non-smokers in the appetitive condition (but not aversive. DD in smokers on treatment to quit was not different from remaining groups, and showed an intermediate DD. These smokers seeking treatment might either be a less impulsive subgroup of smokers or the decision to quit smoking reduced DD. DD might be an outcome predictor in smoking cessation treatment.

  2. The discount phenomenon at the beginning of the new millennium

    OpenAIRE

    Ducháčová, Lenka

    2010-01-01

    This bachelor's thesis aims to research into the consumer behaviour with respect to sales and discounts. The theoretical part provides the definition of consumer behaviour and forms of sales and discounts, focusing on the phrase "for FREE". The next part takes a look "under the bonnet" of low prices in retail chains and introduces Czech retail chains and their recent development along with the continuously increasing offer of special sales and discounts on the Czech market. One chapter deals ...

  3. Quantity Discount Scheme in Supply Chain under Asymmetric Information

    Institute of Scientific and Technical Information of China (English)

    LI Ji-bin; PENG Zuo-he

    2007-01-01

    Quantity discount scheme plays an important role in supply chain management. The different quantity discount schemes under symmetric (full) information and asymmetric information, are analyzed by using principal-agent and optimal control theory. As a result, the research reveals that the optimal quantity discount solution under symmetric information is a special case of that under asymmetric information. At the same price, the critical value of quantity discount under asymmetric information is much lower than that under asymmetric information. Therefore, this leads to less cost for retailers and smaller profit for their supplier.

  4. Agency Costs and the Size Discount: Evidence from Acquisitions

    Directory of Open Access Journals (Sweden)

    David Ofenberg

    2010-12-01

    Full Text Available Many scholars have found a negative relationship between a firm’s size and its value, as measured by Tobin’s q. This result is called the size discount. There are hypotheses about why the size discount exists, but none have been rigorously empirically tested. This paper argues that the size discount is created by the inability of shareholders to minimize agency costs in larger companies. Statistical tests suggest that the size discount only appears in large firms with managers that impose excessive agency costs upon their shareholders. Empiricists who use Tobin’s q to proxy for growth opportunities may need a different proxy.

  5. Academic staff reward

    African Journals Online (AJOL)

    User

    improvement of performance evaluation and the reward system, and improving the skill and ability of ... motivation and morale of the employees .... express their opinion using a scale, 1 to 3. (agree = 1, undecided ..... Organizational Behavior.

  6. Rationalizing spatial exploration patterns of wild animals and humans through a temporal discounting framework.

    Science.gov (United States)

    Namboodiri, Vijay Mohan K; Levy, Joshua M; Mihalas, Stefan; Sims, David W; Hussain Shuler, Marshall G

    2016-08-02

    Understanding the exploration patterns of foragers in the wild provides fundamental insight into animal behavior. Recent experimental evidence has demonstrated that path lengths (distances between consecutive turns) taken by foragers are well fitted by a power law distribution. Numerous theoretical contributions have posited that "Lévy random walks"-which can produce power law path length distributions-are optimal for memoryless agents searching a sparse reward landscape. It is unclear, however, whether such a strategy is efficient for cognitively complex agents, from wild animals to humans. Here, we developed a model to explain the emergence of apparent power law path length distributions in animals that can learn about their environments. In our model, the agent's goal during search is to build an internal model of the distribution of rewards in space that takes into account the cost of time to reach distant locations (i.e., temporally discounting rewards). For an agent with such a goal, we find that an optimal model of exploration in fact produces hyperbolic path lengths, which are well approximated by power laws. We then provide support for our model by showing that humans in a laboratory spatial exploration task search space systematically and modify their search patterns under a cost of time. In addition, we find that path length distributions in a large dataset obtained from free-ranging marine vertebrates are well described by our hyperbolic model. Thus, we provide a general theoretical framework for understanding spatial exploration patterns of cognitively complex foragers.

  7. Contracting with Private Rewards

    OpenAIRE

    Rene Kirkegaard

    2015-01-01

    I extend the canonical moral hazard model to allow the agent to face endogenous and non-contractible uncertainty. The agent works for the principal and simultaneously pursues private rewards. I establish conditions under which the first-order approach remains valid. The model adds to the literature on intrinsic versus extrinsic motivation. Specifically, to induce higher effort at work the contract may offer higher rewards but flatter incentives. The contract change makes the agent reevaluate ...

  8. Congruence of BOLD Response across Intertemporal Choice Conditions: Fictive and Real Money Gains and Losses: Behavioral and Neural Differences in Discounting

    Science.gov (United States)

    Bickel, Warren K.; Pitcock, Jeffery A.; Yi, Richard; Edgardo, J.C. Angtuaco

    2009-01-01

    Intertemporal choice is predicated on the valuation of commodities with respect to delay until their receipt. Subjective value of a future outcome decreases, or is discounted, as a function of that delay (Bickel and Johnson, 2003). While behavioral studies suggest no difference between the devaluation of real and fictive outcomes, no neuroimaging studies have investigated potential differences in the underlying deliberative process. Here we compare behavioral and neural correlates of intertemporal valuation of real and hypothetical monetary gains as well as hypothetical losses, which have been posited to involve different mechanisms. Behavioral and neuroimaging sessions were conducted in which participants made intertemporal choice decisions in a gains condition using both real and hypothetical $100 money, and in a loss condition using a fictive $100 money. Within-subject comparison of behavioral data revealed no significant difference between levels of discounting across the three conditions. Random-effects analysis of fMRI data of each of the three discounting conditions independently revealed significant signal change in limbic (anterior cingulate, striatum, posterior cingulate) and executive functioning areas (lateral pre-frontal cortex), while a repeated measures ANOVA failed to detect differences in signal change across the three discounting conditions after correcting for multiple comparisons. These data support a concordance between real and hypothetical conditions from delay discounting studies and further suggest a congruence of the fMRI BOLD signal across brain regions associated with the deliberative process of different forms of intertemporal choice. PMID:19587291

  9. Discount factors for public sector investment projects using the sum of discounted consumption flows -- estimates for the United Kingdom

    OpenAIRE

    E Kula

    1984-01-01

    In this article a model to estimate a discount factor matrix is derived for discount rates between 1% and 15% for the United Kingdom on the basis of a public-sector project evaluation method known as the sum of discounted consumption flows. These factors can readily be used by project analysts working on United Kingdom projects, especially those in which costs and benefits extend over many years.

  10. Cost of delay, deadlines and endogenous price leadership

    OpenAIRE

    Pastine, Tuvana; Pastine, Ivan

    2001-01-01

    This Paper analyses endogenous price leadership in a duopolistic market with differentiated products and symmetrically informed firms. We study the effects of deadlines and discounting in a standard endogenous leadership model. We show that there will be occasional changes in the identity of the price leader with any cost of delay or discounting, however small. By analyzing the incentives that induce a firm to take up the leader position we derive positive predictions about which firm will le...

  11. Intergenerational transfers and the social discount rate

    Energy Technology Data Exchange (ETDEWEB)

    Howarth, R.B.; Norgaard, R.B.

    1992-08-01

    This paper investigates the relationship between intergenerational asset transfers and the choice of the discount rate for use in cost-benefit analysis in a model of a competitive overlapping generations economy constrained by a socially managed exhaustible resource. Provided that there are no distortions in capital markets and that all agents hold perfect foresight, cost-benefit techniques will result in a Pareto efficient resource allocation if the discount rate is set equal to the market rate of interest. But since the path of the interest rate depends on the level of intergenerational transfers, cost-benefit techniques do not ensure a socially desirable distribution of welfare between generations; a social optimum will result only if intergenerational transfers are properly chosen and enforced. Decentralized private altruism may result in intergenerational transfers that both present and future individuals would agree are too small if members of the present generation attach positive weight to the general welfare of future generations, not simply their personal descendants. In a world where intergenerational transfers are non-optimal, second-best policy-making may imply a constrained optimum that is inefficient. Together, these findings suggest that cost-benefit analysis is at best a partial criterion to policy formulation that should be used only in conjunction with ethical principles that define the proper distribution of welfare between present and future generations.

  12. Impulsivity toward food reward is related to BMI: Evidence from intertemporal choice in obese and normal-weight individuals.

    Science.gov (United States)

    Schiff, Sami; Amodio, Piero; Testa, Giulia; Nardi, Mariateresa; Montagnese, Sara; Caregaro, Lorenza; di Pellegrino, Giuseppe; Sellitto, Manuela

    2016-12-01

    Obesity is a medical condition frequently associated with psychopathological symptoms and neurocognitive and/or personality traits related to impulsivity. Impulsivity during intertemporal choices seems to be typical of obese individuals. However, so far, the specific relationship between different types of reward and neuropsychological and psychopathological profile are yet to be unravelled. Here, we investigated impulsive choice for primary and secondary reward in obese individuals and normal-weight controls with comparable neuropsychological and psychopathological status. Participants performed three intertemporal choice tasks involving food, money, and discount voucher, respectively. Moreover, they completed a battery of neuropsychological tests and psychometric questionnaires assessing psychopathological state, impulsivity, and personality traits. Obese individuals showed increased preference for immediate food reward compared with controls, whereas no group difference emerged concerning money and discount voucher. Moreover, the higher the body mass index (BMI), the steeper the food discounting. These findings emerged in light of comparable neuropsychological and psychopathological profile between groups. Steeper food discounting in obese individuals appears to be related to BMI but not to psychopathological and neuropsychological profile. We suggest using intertemporal choice in the clinical practice as measure of the effectiveness of different types of intervention (e.g., educational, psychological, pharmacological or surgical) aimed at reducing impulsivity toward food and increasing cognitive control during food intake in obese individuals. Copyright © 2015 Elsevier Inc. All rights reserved.

  13. 26 CFR 1.846-1 - Application of discount factors.

    Science.gov (United States)

    2010-04-01

    ...) International business. For any accident year, unpaid losses which are attributable to international business... unpaid losses attributable to each accident year of each line of business shown on the annual statement... of a line of business, that series of discount factors must be applied to discount the unpaid...

  14. Zero discounting can compensate future generations for climate damage

    NARCIS (Netherlands)

    M.D. Davidson

    2014-01-01

    In cost-benefit analysis of climate policy there are two main approaches to discounting, each with implications conflicting with our moral intuitions. Thus, discounted utilitarianism implies that we hardly need to protect future generations against climate change, while classical utilitarianism impl

  15. Zero discounting can compensate future generations for climate damage

    NARCIS (Netherlands)

    Davidson, M.D.

    2014-01-01

    In cost-benefit analysis of climate policy there are two main approaches to discounting, each with implications conflicting with our moral intuitions. Thus, discounted utilitarianism implies that we hardly need to protect future generations against climate change, while classical utilitarianism

  16. Discounts and their Effects - Economic and Legal Approach

    Directory of Open Access Journals (Sweden)

    Funta Rastislav

    2015-02-01

    Full Text Available The present article discusses the economic and legal effects of single-product loyalty discounts. It is clear that arguments concerning the “pro-competitive” effects of such discounts must be judged with skepticism. This applies in particular to the assumed effects of loyalty discounts resulting from double profit surcharges or falling average costs, as well as in the context of price discrimination. I argue that many of the alleged effects could also be achieved with discount forms where the risk of restrictive effects on competition should be lower. Also, the assumed anti-competitive effects of loyalty discounts must be better justified economically. This article suggests using a form-based approach for the assessment of discount schemes. However, this should not amount to a restrictive assessment of certain discount schemes. For the development of such a form-based approach, it is necessary to review the theories about pro-competitive and anti-competitive effects. Therefore, this article attempts to identify which positive effects are more likely to be achieved by means of which discount forms and under which circumstances.

  17. Valuing the Future: Should Educational Benefits Be Discounted?

    Science.gov (United States)

    Gilead, Tal

    2015-01-01

    The practice of assigning a lesser value to benefits the further they are into the future, or, in economic terms, discounting, has long played a significant role in shaping public policy. Recently, due to the growing influence of economic modes of thinking on the educational realm, the concept of discounting is also starting to have an influence…

  18. The Students Decision Making in Solving Discount Problem

    Science.gov (United States)

    Abdillah; Nusantara, Toto; Subanji; Susanto, Hery; Abadyo

    2016-01-01

    This research is reviewing students' process of decision making intuitively, analytically, and interactively. The research done by using discount problem which specially created to explore student's intuition, analytically, and interactively. In solving discount problems, researcher exploring student's decision in determining their attitude which…

  19. Where do we stand on discounts? - A Danish perspective

    DEFF Research Database (Denmark)

    Bergqvist, Christian

    The dominant undertaking’s ability to award discounts and other loyalty inducing considerations are subject to much ambiguity and many unsettled issues. Despite discounts being a commercial requirement, even for the dominant undertaking, it’s difficult to draw up clear principles, and while the a...

  20. 47 CFR 54.509 - Adjustments to the discount matrix.

    Science.gov (United States)

    2010-10-01

    ... 47 Telecommunication 3 2010-10-01 2010-10-01 false Adjustments to the discount matrix. 54.509... discount matrix. (a) Estimating future spending requests. When submitting their requests for specific... matrices, the Administrator shall consult with the Commission to establish the best way to distribute...

  1. Discounting in economic evaluations : Stepping forward towards optimal decision rules

    NARCIS (Netherlands)

    Gravelle, Hugh; Brouwer, Werner; Niessen, Louis; Postma, Maarten; Rutten, Frans

    2007-01-01

    The National Institute for Clinical Excellence has recently changed its guidelines on discounting costs and effects in economic evaluations. In common with most other regulatory bodies it now requires that health effects should be discounted at the same rate as costs. We show that the guideline lead

  2. Discounting and environmental quality: When should dual rates be used?

    NARCIS (Netherlands)

    Weikard, H.P.; Zhu, X.

    2005-01-01

    Triggered by concerns about impacts of long-run climatic change the use of dual-rate discounting to evaluate projects and policies has been suggested. Environmental goods should be discounted at a lower rate than conventional consumption goods. We consider the appropriate use of dual-rate discountin

  3. Episodic Future Thinking about the Ideal Self Induces Lower Discounting, Leading to a Decreased Tendency toward Cheating

    Science.gov (United States)

    Wu, Wen-Hsiung; Cheng, Wen; Chiou, Wen-Bin

    2017-01-01

    Delay discounting refers to a pervasive tendency toward preferring smaller immediate gains over larger future gains. Recent empirical research has shown that episodic future thinking (EFT; i.e., projecting oneself into the future to pre-experience forthcoming events) can reduce the tendency toward discounting. A common tenet of psychological theories of crime is that delinquency results from focusing on short-term gains while failing to consider adequately the longer-term consequences of delinquent behavior. We investigated whether an EFT intervention involving the ideal self could induce lower discounting rates and, as a consequence, reduced delinquency. The results showed that, compared with control participants, participants engaging in EFT, that is, envisaging life events that would be experienced by their ideal selves, exhibited a lower discounting rate in a monetary choice task (Experiments 1 and 2), as well as a decreased tendency to make delinquent choices in imaginary scenarios (Experiment 1) and cheat in a matrix task (Experiment 2). The discounting tendency mediated the relationship between engaging in EFT pertaining to the ideal self and the tendency toward morally questionable behavior (Experiments 1 and 2). The findings of the two experiments indicate that engagement in EFT with a focus on the ideal self is sufficient to induce lower discounting rates, by promoting consideration of distant costs and thus increasing resistance to delinquent involvement and cheating (given the temptation of the immediate benefits that may accrue from such behavior). The current research constitutes an innovative approach to delinquency prevention and the promotion of morality. PMID:28303111

  4. Value of the future: Discounting in random environments

    Science.gov (United States)

    Farmer, J. Doyne; Geanakoplos, John; Masoliver, Jaume; Montero, Miquel; Perelló, Josep

    2015-05-01

    We analyze how to value future costs and benefits when they must be discounted relative to the present. We introduce the subject for the nonspecialist and take into account the randomness of the economic evolution by studying the discount function of three widely used processes for the dynamics of interest rates: Ornstein-Uhlenbeck, Feller, and log-normal. Besides obtaining exact expressions for the discount function and simple asymptotic approximations, we show that historical average interest rates overestimate long-run discount rates and that this effect can be large. In other words, long-run discount rates should be substantially less than the average rate observed in the past, otherwise any cost-benefit calculation would be biased in favor of the present and against interventions that may protect the future.

  5. Supermarket Analysis Based On Product Discount and Statistics

    Directory of Open Access Journals (Sweden)

    Komal Kumawat

    2014-03-01

    Full Text Available E-commerce has been growing rapidly. Its domain can provide all the right ingredients for successful data mining and it is a significant domain of data mining. E commerce refers to buying and selling of products or services over electronic systems such as internet. Various e commerce systems give discount on product and allow user to buy product online. The basic idea used here is to predict the product sale based on discount applied to the product. Our analysis concentrates on how customer behaves when discount is allotted to him. We have developed a model which finds the customer behaviour when discount is applied to the product. This paper elaborates upon how a different technique like session, click stream is used to collect user data online based on discount applied to the product and how statistics is applied to data set to see the variation in the data.

  6. WORK COMPETENCES AT WESTERN BANK DISCOUNT

    Directory of Open Access Journals (Sweden)

    Haidee Coste

    2017-03-01

    Full Text Available The research aimed to identify the generic work competences in the staff of the Vice Presidency of Compensation and Development of the Western Bank Discount. Authors were consulted such as Alles (2008, Tobon (2006 and Hay Group (2004, among others. The research is descriptive, non-experimental, transactional and field design. The population consisted of twelve (12 subjects belonging to the vice presidency. It was applied a questionnaire of thirty (30 items, validated by the trial of three (3 experts, with 0.92 reliability by Cronbach alpha coefficient.  It is concluded the employees of the vice presidency have a high level of the generic work competences customer focus, teamwork, effective communication, innovation, emotional intelligence and making decisions. It is strength for the institution, because staff with those competences contributes doing the best for the development of the institution.

  7. Reward deficiency and anti-reward in pain chronification

    OpenAIRE

    Borsook, D.; Linnman, C.; Faria, Vanda; Strassman, A.M.; Becerra, L; Elman, I

    2016-01-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between...

  8. The rewarding value of good motor performance in the context of monetary incentives.

    Science.gov (United States)

    Lutz, Kai; Pedroni, Andreas; Nadig, Karin; Luechinger, Roger; Jäncke, Lutz

    2012-07-01

    Whether an agent receives positive task feedback or a monetary reward, neural activity in their striatum increases. In the latter case striatal activity reflects extrinsic reward processing, while in the former, striatal activity reflects the intrinsically rewarding effects of performing well. There can be a "hidden cost of reward", which is a detrimental effect of extrinsic on intrinsic reward value. This raises the question how these two types of reward interact. To address this, we applied a monetary incentive delay task: in all trials participants received feedback depending on their performance. In half of the trials they could additionally receive monetary reward if they performed well. This resulted in high performance trials, which were monetarily rewarded and high performance trials that were not. This made it possible to dissociate the neural correlates of performance feedback from the neural correlates of monetary reward that comes with high performance. Performance feedback alone elicits activation increases in the ventral striatum. This activation increases due to additional monetary reward. Neural response in the dorsal striatum on the other hand is only significantly increased by feedback when a monetary incentive is present. The quality of performance does not significantly influence dorsal striatum activity. In conclusion, our results indicate that the dorsal striatum is primarily sensitive to optional or actually received external rewards, whereas the ventral striatum may be coding intrinsic reward due to positive performance feedback. Thus the ventral striatum is suggested to be involved in the processing of intrinsically motivated behavior.

  9. Deriving time discounting correction factors for TTO tariffs.

    Science.gov (United States)

    Attema, Arthur E; Brouwer, Werner B F

    2014-04-01

    The Time Trade-off (TTO) method is a popular method for valuing health state utilities and is frequently used in economic evaluations. However, this method produces utilities that are distorted by several biases. One important bias entails the failure to incorporate time discounting. This paper aims to measure time discounting for health outcomes in a sample representative for the general population. In particular, we estimate TTO scores alongside time discounting in order to derive a set of correction factors that can be employed to correct raw TTO scores for the downward bias caused by time discounting. We find substantial positive correction factors, which are increasing with the severity of the health state. Furthermore, higher discounting is found when using more severe health states in the discounting elicitation task. More research is needed to further develop discount rate elicitation procedures and test their validity, especially in general public samples. Moreover, future research should investigate the correction of TTO values for other biases as well, such as loss aversion, and to develop a criterion to test the external validity of TTO scores.

  10. Do Economic Rewards Work?

    Science.gov (United States)

    Wallace, Brian D.

    2009-01-01

    The love of learning--that intrinsic desire to gain knowledge and insight into new subjects--was once its own reward. That was altered decades ago when parents started using the proverbial "stick and carrot" to motivate their children to do well in school, or even just show up. Today, educators across the country have taken hold of this approach…

  11. Stress and reward

    DEFF Research Database (Denmark)

    Chumbley, J R; Hulme, O; Köchli, H

    2014-01-01

    Healthy individuals tend to consume available rewards like food and sex. This tendency is attenuated or amplified in most stress-related psychiatric conditions, so we asked if it depends on endogenous levels of the 'canonical stress hormone' cortisol. We unobtrusively quantified how hard healthy...

  12. Commitment to self-rewards

    DEFF Research Database (Denmark)

    Koch, Alexander; Nafziger, Julia

    People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...

  13. Commitment to self-rewards

    DEFF Research Database (Denmark)

    Koch, Alexander; Nafziger, Julia

    People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...

  14. Neuronal Reward and Decision Signals: From Theories to Data.

    Science.gov (United States)

    Schultz, Wolfram

    2015-07-01

    Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

  15. Neuronal Reward and Decision Signals: From Theories to Data

    Science.gov (United States)

    Schultz, Wolfram

    2015-01-01

    Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

  16. Impaired reward learning and intact motivation after serotonin depletion in rats.

    Science.gov (United States)

    Izquierdo, Alicia; Carlos, Kathleen; Ostrander, Serena; Rodriguez, Danilo; McCall-Craddolph, Aaron; Yagnik, Gargey; Zhou, Feimeng

    2012-08-01

    Aside from the well-known influence of serotonin (5-hydroxytryptamine, 5-HT) on emotional regulation, more recent investigations have revealed the importance of this monoamine in modulating cognition. Parachlorophenylalanine (PCPA) depletes 5-HT by inhibiting tryptophan hydroxylase, the enzyme required for 5-HT synthesis and, if administered at sufficiently high doses, can result in a depletion of at least 90% of the brain's 5-HT levels. The present study assessed the long-lasting effects of widespread 5-HT depletions on two tasks of cognitive flexibility in Long Evans rats: effort discounting and reversal learning. We assessed performance on these tasks after administration of either 250 or 500 mg/kg PCPA or saline (SAL) on two consecutive days. Consistent with a previous report investigating the role of 5-HT on effort discounting, pretreatment with either dose of PCPA resulted in normal effortful choice: All rats continued to climb tall barriers to obtain large rewards and were not work-averse. Additionally, rats receiving the lower dose of PCPA displayed normal reversal learning. However, despite intact motivation to work for food rewards, rats receiving the largest dose of PCPA were unexpectedly impaired relative to SAL rats on the pretraining stages leading up to reversal learning, ultimately failing to approach and respond to the stimuli associated with reward. High performance liquid chromatography (HPLC) with electrochemical detection confirmed 5-HT, and not dopamine, levels in the ventromedial frontal cortex were correlated with this measure of associative reward learning.

  17. The role of cognitive effort in subjective reward devaluation and risky decision-making.

    Science.gov (United States)

    Apps, Matthew A J; Grima, Laura L; Manohar, Sanjay; Husain, Masud

    2015-11-20

    Motivation is underpinned by cost-benefit valuations where costs-such as physical effort or outcome risk-are subjectively weighed against available rewards. However, in many environments risks pertain not to the variance of outcomes, but to variance in the possible levels of effort required to obtain rewards (effort risks). Moreover, motivation is often guided by the extent to which cognitive-not physical-effort devalues rewards (effort discounting). Yet, very little is known about the mechanisms that underpin the influence of cognitive effort risks or discounting on motivation. We used two cost-benefit decision-making tasks to probe subjective sensitivity to cognitive effort (number of shifts of spatial attention) and to effort risks. Our results show that shifts of spatial attention when monitoring rapidly presented visual stimuli are perceived as effortful and devalue rewards. Additionally, most people are risk-averse, preferring safe, known amounts of effort over risky offers. However, there was no correlation between their effort and risk sensitivity. We show for the first time that people are averse to variance in the possible amount of cognitive effort to be exerted. These results suggest that cognitive effort sensitivity and risk sensitivity are underpinned by distinct psychological and neurobiological mechanisms.

  18. Agent Reward Shaping for Alleviating Traffic Congestion

    Science.gov (United States)

    Tumer, Kagan; Agogino, Adrian

    2006-01-01

    Traffic congestion problems provide a unique environment to study how multi-agent systems promote desired system level behavior. What is particularly interesting in this class of problems is that no individual action is intrinsically "bad" for the system but that combinations of actions among agents lead to undesirable outcomes, As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of "good" actions. This problem is ubiquitous in various traffic problems, including selecting departure times for commuters, routes for airlines, and paths for data routers. In this paper we present a multi-agent approach to two traffic problems, where far each driver, an agent selects the most suitable action using reinforcement learning. The agent rewards are based on concepts from collectives and aim to provide the agents with rewards that are both easy to learn and that if learned, lead to good system level behavior. In the first problem, we study how agents learn the best departure times of drivers in a daily commuting environment and how following those departure times alleviates congestion. In the second problem, we study how agents learn to select desirable routes to improve traffic flow and minimize delays for. all drivers.. In both sets of experiments,. agents using collective-based rewards produced near optimal performance (93-96% of optimal) whereas agents using system rewards (63-68%) barely outperformed random action selection (62-64%) and agents using local rewards (48-72%) performed worse than random in some instances.

  19. Impulsive social influence increases impulsive choices on a temporal discounting task in young adults.

    Directory of Open Access Journals (Sweden)

    Jodi M Gilman

    Full Text Available Adolescents and young adults who affiliate with friends who engage in impulsive behavior are more likely to engage in impulsive behaviors themselves, and those who associate with prosocial (i.e. more prudent, future oriented peers are more likely to engage in prosocial behavior. However, it is difficult to disentangle the contribution of peer influence vs. peer selection (i.e., whether individuals choose friends with similar traits when interpreting social behaviors. In this study, we combined a novel social manipulation with a well-validated delay discounting task assessing impulsive behavior to create a social influence delay discounting task, in which participants were exposed to both impulsive (smaller, sooner or SS payment and non-impulsive (larger, later or LL payment choices from their peers. Young adults in this sample, n = 51, aged 18-25 had a higher rate of SS choices after exposure to impulsive peer influence than after exposure to non-impulsive peer influence. Interestingly, in highly susceptible individuals, the rate of non-impulsive choices did not increase after exposure to non-impulsive influence. There was a positive correlation between self-reported suggestibility and degree of peer influence on SS choices. These results suggest that, in young adults, SS choices appear to be influenced by the choices of same-aged peers, especially for individuals who are highly susceptible to influence.

  20. Commitment to self-rewards

    OpenAIRE

    Koch, Alexander K.; Nafziger, Julia

    2009-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplish¬ments and are widely recommended as tools for overcoming self-control problems. However, it seems puzzling why self-rewards can work: the prospect of a reward has a motivating force only if the threat of self-denial of the reward after low performance is credible. We explain how a rational forward-looking individual may achieve commitment to self-rewards, by applying Köszegi and Rabin's (2006) model of ...

  1. Reduced reward processing in the brains of Parkinsonian patients

    NARCIS (Netherlands)

    Kunig, G; Leenders, KL; Martin-Solch, C; Missimer, J; Magyar, S; Schultz, W

    2000-01-01

    Regional cerebral blood flow (rCBF) in healthy controls and non-demented, non-depressed Parkinsonian patients was measured using H(2)(15)0 PET while subjects performed a prelearned pattern recognition task with delayed response. To investigate differences between the two groups in response to reward

  2. 48 CFR 952.251-70 - Contractor employee travel discounts.

    Science.gov (United States)

    2010-10-01

    ... Federal Contractor employee travelers by AMTRAK, hotels, motels, or car rental companies, when use of such... employees. (d) Hotels/motels. Many lodging providers extend their discount rates for Federal employees...

  3. INFLUENCE OF DISCOUNT PRICE ANNOUNCEMENTS ON CONSUMER’S BEHAVIOR

    Directory of Open Access Journals (Sweden)

    Giuliana Isabella

    2012-10-01

    Full Text Available The theoretical framework that underpins this research study is based on the Prospect Theory formulated by Kahneman and Tversky, and Thaler´s Mental Accounting Theory. The research aims to evaluate the consumers’ behavior when different patterns of discount are offered (in percentage and absolute value and for larger and smaller discounts. Two experiments were conducted to explore these patterns of behavior and the results that were obtained supported the view that the framing effect was a common occurrence. The patterns of choice of individuals in a sample were found to be different due to changes in the ways discounts were offered. This can be explained by the various ways of presenting discount rates that had an impact on the influence of purchase intentions, recommendations and quality perception.

  4. Review of assessment methods discount rate in investment analysis

    Directory of Open Access Journals (Sweden)

    Yamaletdinova Guzel Hamidullovna

    2011-08-01

    Full Text Available The article examines the current methods of calculating discount rate in investment analysis and business valuation, as well as analyzes the key problems using various techniques in terms of the Russian economy.

  5. Cooperation under Incomplete Information on the Discount Factors

    CERN Document Server

    Maor, C

    2010-01-01

    In the repeated Prisoner's Dilemma, when every player has a different discount factor, the grim-trigger strategy is an equilibrium if and only if the discount factor of each player is higher than some threshold. What happens if the players have incomplete information regarding the discount factors? In this work we look at repeated games in which each player has incomplete information regarding the other player's discount factor, and ask when a pair of grim-trigger strategies is an equilibrium. We provide necessary and sufficient conditions for such strategies to be an equilibrium. We characterize the states of the world in which the strategies are not triggered, i.e., the players cooperate, in such equilibria (or $\\epsilon$-equilibria), and ask whether these "cooperation events" are close to those in the complete information case, when the information is "almost" complete, in several senses.

  6. Do natural landscapes reduce future discounting in humans?

    Science.gov (United States)

    van der Wal, Arianne J; Schade, Hannah M; Krabbendam, Lydia; van Vugt, Mark

    2013-12-22

    An important barrier to enduring behavioural change is the human tendency to discount the future. Drawing on evolutionary theories of life history and biophilia, this study investigates whether exposure to natural versus urban landscapes affects people's temporal discount rates. The results of three studies, two laboratory experiments and a field study reveal that individual discount rates are systematically lower after people have been exposed to scenes of natural environments as opposed to urban environments. Further, this effect is owing to people placing more value on the future after nature exposure. The finding that nature exposure reduces future discounting-as opposed to exposure to urban environments-conveys important implications for a range of personal and collective outcomes including healthy lifestyles, sustainable resource use and population growth.

  7. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Science.gov (United States)

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  8. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Directory of Open Access Journals (Sweden)

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  9. Bundling Revisited: Substitute Products and Inter-Firm Discounts

    OpenAIRE

    Armstrong, Mark

    2011-01-01

    This paper extends the standard model of bundling to allow products to be substitutes and for products to be supplied by separate sellers. Whether integrated or separate, firms have an incentive to introduce bundling discounts when demand for the bundle is elastic relative to demand for stand-alone products. When products are partial substitutes, this typically gives an integrated firm a greater incentive to offer a bundle discount (relative to the standard model with additive preferences), w...

  10. THC reduces the anticipatory nucleus accumbens response to reward in subjects with a nicotine addiction.

    Science.gov (United States)

    Jansma, J M; van Hell, H H; Vanderschuren, L J M J; Bossong, M G; Jager, G; Kahn, R S; Ramsey, N F

    2013-02-26

    Recent evidence has implicated the endocannabinoid (eCB) system in nicotine addiction. The eCB system also has an important role in reward mechanisms, and nicotine addiction has been associated with aberrant reward processing. Motivated by this evidence, we tested the hypothesis that eCB modulation of reward processing is altered in subjects with a nicotine addiction (NAD). For this purpose, we compared reward-related activity in NAD with healthy controls (HC) in a pharmacological magnetic resonance imaging (MRI) study using Δ(9)-tetrahydrocannabinol (THC) administration to challenge the eCB system. Eleven HC and 10 NAD participated in a 3-T functional MRI (fMRI) study with a double-blind, cross-over, placebo-controlled design, using a Monetary Incentive Delay (MID) paradigm with three reward levels. Reward activity in the nucleus accumbens (NAcc) and caudate putamen during anticipation and feedback of reward was compared after THC and placebo. fMRI results indicated a significant reduction of reward anticipation activity in the NAcc in NAD after THC administration, which was not present in HC. This is indicated by a significant group by drug by reward interaction. Our data show that THC significantly reduces the NAcc response to monetary reward anticipation in NAD. These results suggest that nicotine addiction is associated with altered eCB modulation of reward processing in the NAcc. This study adds important human data to existing evidence implicating the eCB system in nicotine addiction.

  11. Involvement of the endocannabinoid system in reward processing in the human brain.

    Science.gov (United States)

    van Hell, Hendrika H; Jager, Gerry; Bossong, Matthijs G; Brouwer, Annelies; Jansma, J Martijn; Zuurman, Lineke; van Gerven, Joop; Kahn, René S; Ramsey, Nick F

    2012-02-01

    Disturbed reward processing in humans has been associated with a number of disorders, such as depression, addiction, and attention-deficit hyperactivity disorder. The endocannabinoid (eCB) system has been implicated in reward processing in animals, but in humans, the relation between eCB functioning and reward is less clear. The current study uses functional magnetic resonance imaging (fMRI) to investigate the role of the eCB system in reward processing in humans by examining the effect of the eCB agonist Δ(9)-tetrahydrocannabinol (THC) on reward-related brain activity. Eleven healthy males participated in a randomized placebo-controlled pharmacological fMRI study with administration of THC to challenge the eCB system. We compared anticipatory and feedback-related brain activity after placebo and THC, using a monetary incentive delay task. In this task, subjects are notified before each trial whether a correct response is rewarded ("reward trial") or not ("neutral trial"). Subjects showed faster reaction times during reward trials compared to neutral trials, and this effect was not altered by THC. THC induced a widespread attenuation of the brain response to feedback in reward trials but not in neutral trials. Anticipatory brain activity was not affected. These results suggest a role for the eCB system in the appreciation of rewards. The involvement of the eCB system in feedback processing may be relevant for disorders in which appreciation of natural rewards may be affected such as addiction.

  12. Heterogeneity in the Effects of Reward- and Deposit-based Financial Incentives on Smoking Cessation.

    Science.gov (United States)

    Halpern, Scott D; French, Benjamin; Small, Dylan S; Saulsgiver, Kathryn; Harhay, Michael O; Audrain-McGovern, Janet; Loewenstein, George; Asch, David A; Volpp, Kevin G

    2016-10-15

    Targeting different smoking cessation programs to smokers most likely to quit when using them could reduce the burden of lung disease. To identify smokers most likely to quit using pure reward-based financial incentives or incentive programs requiring refundable deposits to become eligible for rewards. We conducted prespecified secondary analyses of a randomized trial in which 2,538 smokers were assigned to an $800 reward contingent on sustained abstinence from smoking, a refundable $150 deposit plus a $650 reward, or usual care. Using logistic regression, we identified characteristics of smokers that were most strongly associated with accepting their assigned intervention and ceasing smoking for 6 months. We assessed modification of the acceptance, efficacy, and effectiveness of reward and deposit programs by 11 prospectively selected demographic, smoking-related, and psychological factors. Predictors of sustained smoking abstinence differed among participants assigned to reward- versus deposit-based incentives. However, greater readiness to quit and less steep discounting of future rewards were consistently among the most important predictors. Deposit-based programs were uniquely effective relative to usual care among men, higher-income participants, and participants who more commonly failed to pay their bills (all interaction P values rewards, deposits were more effective among black persons (P = 0.022) and those who more commonly failed to pay their bills (P = 0.082). Relative to rewards, deposits were more commonly accepted by higher-income participants, men, white persons, and those who less commonly failed to pay their bills (all P incentives suggests potential benefits of targeting behavior-change interventions based on patient characteristics. Clinical trial registered with www.clinicaltrials.gov (NCT 01526265).

  13. A model of food reward learning with dynamic reward exposure

    Directory of Open Access Journals (Sweden)

    Ross A Hammond

    2012-10-01

    Full Text Available The process of conditioning via reward learning is highly relevant to the study of food choice and obesity. Learning is itself shaped by environmental exposure, with the potential for such exposures to vary substantially across individuals and across place and time. In this paper, we use computational techniques to extend a well-validated standard model of reward learning, introducing both substantial heterogeneity and dynamic reward exposures. We then apply the extended model to a food choice context. The model produces a variety of individual behaviors and population-level patterns which are not evident from the traditional formulation, but which offer potential insights for understanding food reward learning and obesity. These include a lock-in effect, through which early exposure can strongly shape later reward valuation. We discuss potential implications of our results for the study and prevention of obesity, for the reward learning field, and for future experimental and computational work.

  14. The effects of non-contingent extrinsic and intrinsic rewards on memory consolidation.

    Science.gov (United States)

    Nielson, Kristy A; Bryant, Ted

    2005-07-01

    Emotional and arousing treatments given shortly after learning enhance delayed memory retrieval in animal and human studies. Positive affect and reward induced prior to a variety of cognitive tasks enhance performance, but their ability to affect memory consolidation has not been investigated before. Therefore, we investigated the effects of a small, non-contingent, intrinsic or extrinsic reward on delayed memory retrieval. Participants (n=108) studied and recalled a list of 30 affectively neutral, imageable nouns. Experimental groups were then given either an intrinsic reward (e.g., praise) or an extrinsic reward (e.g., US 1 dollar). After a one-week delay, participants' retrieval performance for the word list was significantly better in the extrinsic reward groups, whether the reward was expected or not, than in controls. Those who received the intrinsic reward performed somewhat better than controls, but the difference was not significant. Thus, at least some forms of arousal and reward, even when semantically unrelated to the learned material, can effectively modulate memory consolidation. These types of treatments might be useful for the development of new memory intervention strategies.

  15. Differential effects of reward and punishment on conscious and unconscious eye movements.

    Science.gov (United States)

    Blaukopf, Clare L; DiGirolamo, Gregory J

    2006-10-01

    Very little is known about how human movements are influenced by abstract rewards and punishments relevant for human behaviour. The purpose of this study was to expand our knowledge of the behavioural effects of monetary reward and punishment. We introduced a high and low reward and punishment scheme into an antisaccade task where trials were either rewarded for a correct response (+1 or +25p) or punished for an incorrect response (-1 or -25p). The monetary value of the trial was indicated by the go signal, so subjects had to both program the location of the movement and determine the valence in the short interval before the eye movement was executed. We analysed both correct antisaccade responses and prosaccade errors. Importantly, the errors in this task can be either conscious (recognised) or unconscious (unrecognised). Saccades in both high-reward and high-punishment trials were slowed compared to saccades in low-reward and low-punishment trials, respectively. Therefore, unlike moderate rewards only (Blaukopf and DiGirolamo in Exp Brain Res 167:654-659, 2005), combining rewards and punishments and increasing motivation levels leads to a delay in movement execution during high valence trials where all actions are slowed, even errors. However, unconscious errors were differentially affected as they were speeded when punishment was high. We conclude that reward and punishment similarly influence the programming of conscious movements, but the strong saliency for punishment affords unconscious errors immunity from this delay.

  16. Time discounting and pain anticipation. Experimental evidence

    Directory of Open Access Journals (Sweden)

    Brañas Garza, Pablo

    2012-03-01

    Full Text Available This paper deals with pain anticipation experienced before medical procedures. our experimental results show that individuals with lower time discount factors are more prone to suffer pain in advance. We provide a framework to rationalize the connection between pain anticipation and impatience. in this set up, more impatient subjects, who only value very near events, mainly take into account the present negative effects of medical procedures (the costs, whereas more patient individuals have a net positive valuation of medical events, given that they are able to value both the cost incurred now and all the benefits to be accrued in the future.

    Este artículo trata de la anticipación del dolor experimentada antes de los procedimientos médicos. nuestros resultados experimentales muestran que los individuos con factor de descuento temporal más bajo son más proclives a sufrir dolor por adelantado. el artículo proporciona un marco en el que racionalizar la relación existente entre impaciencia y anticipación del dolor. en este marco, los sujetos más impacientes, que evalúan sólo los eventos muy próximos en el tiempo, focalizan su atención principalmente en los efectos negativos de los procedimientos médicos (sólo los costes, mientras que los individuos más pacientes tienen una valoración neta positiva de los actos médicos puesto que valoran tanto el coste en el que se incurre en el presente como los beneficios que se obtendrán en el futuro.

  17. Estimation of social discount rate for Lithuania

    Directory of Open Access Journals (Sweden)

    Vilma Kazlauskiene

    2016-09-01

    Full Text Available Purpose of the article: The paper seeks to analyse the problematics of estimation of the social discount rate (SDR. The SDR is the critical parameter of cost-benefit analysis, which allows calculating the present value of cost and the benefit of public sector investment projects. Incorrect choice of the SDR can lead to the realisation of ineffective public project or conversely, cost-effective project will be rejected. The relevance of this problem analysis is determined by discussions and different viewpoints of scientists on the choice of the most appropriate approach to determine the SDR and absence of methodically based the SDR on the national level of Lithuania. Methodology/methods: The research is performed by the scientific and methodical literature analysis, systematization, time series and regression analysis. Scientific aim: The aim of the article is to calculate the SDR based on the statistical data of Lithuania. Findings: The analysis of methods of SDR determination, as well as the researches performed by foreign researchers, allows stating that the social rate of time preference (SRTP approach is the most appropriate. The SDR, calculated by the SRTP approach, reflects the main purpose of public investment projects, i.e. to enhance social benefit for society, the best. The analyses of SDR determination practice of the foreign countries shows that the SDR level should not be universal for all states. Each country should calculate the SDR based on its own data and apply it for the assessment of public projects. Conclusions: The calculated SDR for Lithuania using the SRTP approach varies between 3.5 % and 4.3 %. Although it is lower than 5 % that is offered by European Commission, this rate is based on the statistical data of Lithuania and should be used for the assessment of the national public projects. Application of the reasonable SDR let get the more accurate and reliable cost-benefit analysis of the public projects.

  18. Rewarding the Multiplayer : How rewards and objectives influence Multiplayer games

    OpenAIRE

    Helin, Henry

    2014-01-01

    In this thesis I analyse the reward systems of cooperative and competitive Multiplayer games – the games I have chosen were built for a Single-player campaign with Multiplayer as additional content. My main focus is on the Multiplayer and the reward systems of that game mode. The reward systems are important to consider when designing a game for fans of Multiplayer games, as a faulty reward system might hinder the aspect which makes Multiplayer games special – to be playing together and go fo...

  19. Social reward shapes attentional biases.

    Science.gov (United States)

    Anderson, Brian A

    2016-01-01

    Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

  20. Monetary rewards modulate inhibitory control

    Directory of Open Access Journals (Sweden)

    Paula Marcela Herrera

    2014-05-01

    Full Text Available The ability to override a dominant response, often referred to as behavioural inhibiton, is considered a key element of executive cognition. Poor behavioural inhibition is a defining characteristic of several neurological and psychiatric populations. Recently, there has been increasing interest in the motivational dimension of behavioural inhibition, with some experiments incorporating emotional contingencies in classical inhibitory paradigms such as the Go/Nogo and Stop Signal Tasks. Several studies have reported a positive modulatory effect of reward on the performance of such tasks in pathological conditions such as substance abuse, pathological gambling, and ADHD. However, experiments that directly investigate the modulatory effects of reward magnitudes on the performance of inhibitory paradigms are rare and consequently, little is known about the finer grained relationship between motivation and self-control. Here, we probed the effect of reward and reward magnitude on behavioural inhibition using two modified version of the widely used Stop Signal Task. The first task compared no reward with reward, whilst the other compared two different reward magnitudes. The reward magnitude effect was confirmed by the second study, whereas it was less compelling in the first study, possibly due to the effect of having no reward in some conditions. In addition, our results showed a kick start effect over global performance measures. More specifically, there was a long lasting improvement in performance throughout the task, when participants received the highest reward magnitudes at the beginning of the protocol. These results demonstrate that individuals’ behavioural inhibition capacities are dynamic not static because they are modulated by the reward magnitude and initial reward history of the task at hand.

  1. Affective personality predictors of disrupted reward learning and pursuit in major depressive disorder.

    Science.gov (United States)

    DelDonno, Sophie R; Weldon, Anne L; Crane, Natania A; Passarotti, Alessandra M; Pruitt, Patrick J; Gabriel, Laura B; Yau, Wendy; Meyers, Kortni K; Hsu, David T; Taylor, Stephen F; Heitzeg, Mary M; Herbener, Ellen; Shankman, Stewart A; Mickey, Brian J; Zubieta, Jon-Kar; Langenecker, Scott A

    2015-11-30

    Anhedonia, the diminished anticipation and pursuit of reward, is a core symptom of major depressive disorder (MDD). Trait behavioral activation (BA), as a proxy for anhedonia, and behavioral inhibition (BI) may moderate the relationship between MDD and reward-seeking. The present studies probed for reward learning deficits, potentially due to aberrant BA and/or BI, in active or remitted MDD individuals compared to healthy controls (HC). Active MDD (Study 1) and remitted MDD (Study 2) participants completed the modified monetary incentive delay task (mMIDT), a behavioral reward-seeking task whose response window parameters were individually titrated to theoretically elicit equivalent accuracy between groups. Participants completed the BI Scale and BA Reward-Responsiveness and Drive Scales. Despite individual titration, active MDD participants won significantly less money than HCs. Higher Reward-Responsiveness scores predicted more won; Drive and BI were not predictive. Remitted MDD participants' performance did not differ from controls', and trait BA and BI measures did not predict r-MDD performance. These results suggest that diminished reward-responsiveness may contribute to decreased motivation and reward pursuit during active MDD, but that reward learning is intact in remission. Understanding individual reward processing deficits in MDD may inform personalized intervention addressing anhedonia and motivation deficits in select MDD patients.

  2. Neuron-type-specific signals for reward and punishment in the ventral tegmental area.

    Science.gov (United States)

    Cohen, Jeremiah Y; Haesler, Sebastian; Vong, Linh; Lowell, Bradford B; Uchida, Naoshige

    2012-01-18

    Dopamine has a central role in motivation and reward. Dopaminergic neurons in the ventral tegmental area (VTA) signal the discrepancy between expected and actual rewards (that is, reward prediction error), but how they compute such signals is unknown. We recorded the activity of VTA neurons while mice associated different odour cues with appetitive and aversive outcomes. We found three types of neuron based on responses to odours and outcomes: approximately half of the neurons (type I, 52%) showed phasic excitation after reward-predicting odours and rewards in a manner consistent with reward prediction error coding; the other half of neurons showed persistent activity during the delay between odour and outcome that was modulated positively (type II, 31%) or negatively (type III, 18%) by the value of outcomes. Whereas the activity of type I neurons was sensitive to actual outcomes (that is, when the reward was delivered as expected compared to when it was unexpectedly omitted), the activity of type II and type III neurons was determined predominantly by reward-predicting odours. We 'tagged' dopaminergic and GABAergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to optical stimulation while recording. All identified dopaminergic neurons were of type I and all GABAergic neurons were of type II. These results show that VTA GABAergic neurons signal expected reward, a key variable for dopaminergic neurons to calculate reward prediction error.

  3. Description, prescription and the choice of discount rates

    Energy Technology Data Exchange (ETDEWEB)

    Baum, Seth D. [Rock Ethics Institute, Pennsylvania State University, 201 Willard Building, University Park, PA 16802 (United States); Department of Geography, Pennsylvania State University, 302 Walker Building, University Park, PA 16802 (United States)

    2009-11-15

    The choice of discount rates is a key issue in the analysis of long-term societal issues, in particular environmental issues such as climate change. Approaches to choosing discount rates are generally placed into two categories: the descriptive approach and the prescriptive approach. The descriptive approach is often justified on grounds that it uses a description of how society discounts instead of having analysts impose their own discounting views on society. This paper analyzes the common forms of the descriptive and prescriptive approaches and finds that, in contrast with customary thinking, both forms are equally descriptive and prescriptive. The prescriptions concern who has standing (i.e. who is included) in society, how the views of these individuals are measured, and how the measurements are aggregated. Such prescriptions are necessary to choose from among the many possible descriptions of how society discounts. The descriptions are the measurements made given a choice of measurement technique. Thus, the labels 'descriptive approach' and 'prescriptive approach' are deeply misleading, as analysts cannot avoid imposing their own views on society. (author)

  4. Rewards teach visual selective attention.

    Science.gov (United States)

    Chelazzi, Leonardo; Perlato, Andrea; Santandrea, Elisa; Della Libera, Chiara

    2013-06-07

    Visual selective attention is the brain function that modulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior. Enhanced analysis of currently relevant or otherwise salient information is often accompanied by suppressed processing of the less relevant or salient input. Recent findings indicate that rewards exert a powerful influence on the deployment of visual selective attention. Such influence takes different forms depending on the specific protocol adopted in the given study. In some cases, the prospect of earning a larger reward in relation to a specific stimulus or location biases attention accordingly in order to maximize overall gain. This is mediated by an effect of reward acting as a type of incentive motivation for the strategic control of attention. In contrast, reward delivery can directly alter the processing of specific stimuli by increasing their attentional priority, and this can be measured even when rewards are no longer involved, reflecting a form of reward-mediated attentional learning. As a further development, recent work demonstrates that rewards can affect attentional learning in dissociable ways depending on whether rewards are perceived as feedback on performance or instead are registered as random-like events occurring during task performance. Specifically, it appears that visual selective attention is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them. Overall this emerging literature demonstrates unequivocally that rewards "teach" visual selective attention so that processing resources will be allocated to objects, features and locations which are likely to optimize the organism's interaction with the

  5. Interindividual variability in functional connectivity as long-term correlate of temporal discounting.

    Directory of Open Access Journals (Sweden)

    Cinzia Calluso

    Full Text Available During intertemporal choice (IT future outcomes are usually devaluated as a function of the delay, a phenomenon known as temporal discounting (TD. Based on task-evoked activity, previous neuroimaging studies have described several networks associated with TD. However, given its relevance for several disorders, a critical challenge is to define a specific neural marker able to predict TD independently of task execution. To this aim, we used resting-state functional connectivity MRI (fcMRI and measured TD during economic choices several months apart in 25 human subjects. We further explored the relationship between TD, impulsivity and decision uncertainty by collecting standard questionnaires on individual trait/state differences. Our findings indicate that fcMRI within and between critical nodes of task-evoked neural networks associated with TD correlates with discounting behavior measured a long time afterwards, independently of impulsivity. Importantly, the nodes form an intrinsic circuit that might support all the mechanisms underlying TD, from the representation of subjective value to choice selection through modulatory effects of cognitive control and episodic prospection.

  6. Where do we stand on discounts? - A Danish perspective

    DEFF Research Database (Denmark)

    Bergqvist, Christian

    The dominant undertaking’s ability to award discounts and other loyalty inducing considerations are subject to much ambiguity and many unsettled issues. Despite discounts being a commercial requirement, even for the dominant undertaking, it’s difficult to draw up clear principles, and while...... the approach to non-dominant undertaking’s restriction of competition has been fundamentally recast over the last 20 years, the appraisal of single company behaviour remains more formal and rigid. However, there have recently been indications that some of the same leniency might have been extended to discounts...... and single company behaviour. Consequently, an attempt shall be made to provide some guidelines under EU and Danish practice’red. Danish companies would normally be governed by both and the later has been aligned to the former, thus providing general guidance on EU practice....

  7. Increased Firing to Cues That Predict Low-Value Reward in the Medial Orbitofrontal Cortex

    Science.gov (United States)

    Burton, Amanda C.; Kashtelyan, Vadim; Bryden, Daniel W.; Roesch, Matthew R.

    2014-01-01

    Anatomical, imaging, and lesion work have suggested that medial and lateral aspects of orbitofrontal cortex (OFC) play different roles in reward-guided decision-making, yet few single-neuron recording studies have examined activity in more medial parts of the OFC (mOFC) making it difficult to fully assess its involvement in motivated behavior. Previously, we have shown that neurons in lateral parts of the OFC (lOFC) selectively fire for rewards of different values. In that study, we trained rats to respond to different fluid wells for rewards of different sizes or delivered at different delays. Rats preferred large over small reward, and rewards delivered after short compared with long delays. Here, we recorded from single neurons in rat rostral mOFC as they performed the same task. Similar to the lOFC, activity was attenuated for rewards that were delivered after long delays and was enhanced for delivery of larger rewards. However, unlike lOFC, odor-responsive neurons in the mOFC were more active when cues predicted low-value outcomes. These data suggest that odor-responsive mOFC neurons signal the association between environmental cues and unfavorable outcomes during decision making. PMID:23901075

  8. Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex.

    Science.gov (United States)

    Burton, Amanda C; Kashtelyan, Vadim; Bryden, Daniel W; Roesch, Matthew R

    2014-12-01

    Anatomical, imaging, and lesion work have suggested that medial and lateral aspects of orbitofrontal cortex (OFC) play different roles in reward-guided decision-making, yet few single-neuron recording studies have examined activity in more medial parts of the OFC (mOFC) making it difficult to fully assess its involvement in motivated behavior. Previously, we have shown that neurons in lateral parts of the OFC (lOFC) selectively fire for rewards of different values. In that study, we trained rats to respond to different fluid wells for rewards of different sizes or delivered at different delays. Rats preferred large over small reward, and rewards delivered after short compared with long delays. Here, we recorded from single neurons in rat rostral mOFC as they performed the same task. Similar to the lOFC, activity was attenuated for rewards that were delivered after long delays and was enhanced for delivery of larger rewards. However, unlike lOFC, odor-responsive neurons in the mOFC were more active when cues predicted low-value outcomes. These data suggest that odor-responsive mOFC neurons signal the association between environmental cues and unfavorable outcomes during decision making. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  9. 26 CFR 1.466-1 - Method of accounting for the redemption cost of qualified discount coupons.

    Science.gov (United States)

    2010-04-01

    ... the coupon. (2) Definitions—(i) Discount coupon. A discount coupon is a sales promotion device used to... than a reduction in the sales price of one of the issuer's products. The discount may be stated...

  10. ATLAS rewards industry

    CERN Multimedia

    2006-01-01

    Showing excellence in mechanics, electronics and cryogenics, three industries are honoured for their contributions to the ATLAS experiment. Representatives of the three award-wining companies after the ceremony. For contributing vital pieces to the ATLAS puzzle, three industries were recognized on Friday 5 May during a supplier awards ceremony. After a welcome and overview of the ATLAS experiment by spokesperson Peter Jenni, CERN Secretary-General Maximilian Metzger stressed the importance of industry to CERN's scientific goals. Close interaction with CERN was a key factor in the selection of each rewarded company, in addition to the high-quality products they delivered to the experiment. Alu Menziken Industrie AG, of Switzerland, was honoured for the production of 380,000 aluminium tubes for the Monitored Drift Tube Chambers (MDT). As Giora Mikenberg, the Muon System Project Leader stressed, the aluminium tubes were delivered on time with an extraordinary quality and precision. Between October 2000 and Jan...

  11. Reward deficiency and anti-reward in pain chronification.

    Science.gov (United States)

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  12. Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward?

    Science.gov (United States)

    Bechara, Antoine; Dolan, Sara; Hindes, Andrea

    2002-01-01

    On a decision-making instrument known as the "gambling task" (GT), a subgroup of substance dependent individuals (SDI) opted for choices that yield high immediate gains in spite of higher future losses. This resembles the behavior of patients with ventromedial (VM) prefrontal cortex lesions. In this study, we addressed the possibility that hypersensitivity to reward may account for the "myopia" for the future in this subgroup of SDI. We used a variant version of the GT, in which the good decks yielded high immediate punishment but higher delayed reward. The bad decks yielded low immediate punishment and lower delayed reward. We measured the skin conductance response (SCR) of subjects after receiving reward (reward SCR) and during their pondering from which deck to choose (anticipatory SCR). A subgroup of SDI who was not impaired on the original GT performed normally on the variant GT. The subgroup of SDI who was impaired on the original GT showed two levels of performance on the variant GT. One subgroup (36% of the sample) performed poorly on the variant GT, and showed similar behavioral and physiological impairments to VM patients. The other subgroup of SDI (64% of the sample) performed normally on the variant task, but had abnormally large physiological responses to reward, i.e. large SCR after receiving reward (reward SCR) and large SCR in anticipation of outcomes that yield large reward. Thus, the combined cognitive and physiological approach of assessing decision-making characterizes three sub-populations of SDI. One sub-population is without impairments that can be detected by any measure of the GT paradigm. Another sub-population is similar to VM patients in that they are insensitive to the future, both positive and negative. A third sub-population is hypersensitive to reward, so that the presence or the prospect of receiving, reward dominates their behavior.

  13. Modulation of impulsivity and reward sensitivity in intertemporal choice by striatal and midbrain dopamine synthesis in healthy adults

    NARCIS (Netherlands)

    Smith, C.T.; Wallace, D.L.; Dang, L.C.; Aarts, E.; Jagust, W.J.; D'Esposito, M.; Boettiger, C.A.

    2016-01-01

    Converging evidence links individual differences in mesolimbic and mesocortical dopamine (DA) to variation in the tendency to choose immediate rewards (“Now”) over larger, delayed rewards (“Later”), or “Now bias.” However, to date, no study of healthy young

  14. Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

    NARCIS (Netherlands)

    Bijleveld, E.H.; Custers, R.; Aarts, H.A.G.

    2012-01-01

    When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms operating without c

  15. Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

    Science.gov (United States)

    Bijleveld, Erik; Custers, Ruud; Aarts, Henk

    2012-01-01

    When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

  16. On the Joint Analysis of the Total Discounted Payments to Policyholders and Shareholders: Dividend Barrier Strategy

    National Research Council Canada - National Science Library

    Eric C K Cheung; Haibo Liu; Jae-Kyung Woo

    2015-01-01

      In the compound Poisson insurance risk model under a dividend barrier strategy, this paper aims to analyze jointly the aggregate discounted claim amounts until ruin and the total discounted dividends...

  17. On Optimality of Greedy Policy for a Class of Standard Reward Function of Restless Multi-armed Bandit Problem

    CERN Document Server

    Liu, Quan; Chen, Lin

    2011-01-01

    In this paper,we consider the restless bandit problem, which is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. However, it is known be PSPACE-Hard to approximate to any non-trivial factor. Thus the optimality is very difficult to obtain due to its high complexity. A natural method is to obtain the greedy policy considering its stability and simplicity. However, the greedy policy will result in the optimality loss for its intrinsic myopic behavior generally. In this paper, by analyzing one class of so-called standard reward function, we establish the closed-form condition about the discounted factor \\beta such that the optimality of the greedy policy is guaranteed under the discounted expected reward criterion, especially, the condition \\beta = 1 indicating the optimality of the greedy policy under the average accumulative reward criterion. Thus, the standard form of reward function can easily be used to judge the optimality of the greed...

  18. Medial prefrontal and anterior cingulate cortical thickness predicts shared individual differences in self-generated thought and temporal discounting.

    Science.gov (United States)

    Bernhardt, Boris C; Smallwood, Jonathan; Tusche, Anita; Ruby, Florence J M; Engen, Haakon G; Steinbeis, Nikolaus; Singer, Tania

    2014-04-15

    When deprived of compelling perceptual input, the mind is often occupied with thoughts unrelated to the immediate environment. Previous behavioral research has shown that this self-generated task-unrelated thought (TUT), especially under non-demanding conditions, relates to cognitive capacities such as creativity, planning, and reduced temporal discounting. Despite the frequency and importance of this type of cognition, little is known about its structural brain basis. Using MRI-based cortical thickness measures in 37 participants, we were able to show that individuals with a higher tendency to engage in TUT under low-demanding conditions (but not under high-demanding conditions) show an increased thickness of medial prefrontal cortex (mPFC) and anterior/midcingulate cortex. Thickness of these regions also related to less temporal discounting (TD) of monetary rewards in an economic task, indicative of more patient decision-making. The findings of a shared structural substrate in mPFC and anterior/midcingulate cortex underlying both TUT and TD suggest an important role of these brain regions in supporting the self-generation of information that is unrelated to the immediate environment and which may be adaptive in nature. Copyright © 2013 Elsevier Inc. All rights reserved.

  19. Optimal harvesting of fish stocks under a time-varying discount rate

    OpenAIRE

    Duncan, Stephen; Hepburn, Cameron; Papachristodoulou, Antonis

    2010-01-01

    Abstract Optimal control theory has been extensively used to determine the optimal harvesting policy for renewable resources such as fish stocks. In such optimizations, it is common to maximise the discounted utility of harvesting over time, employing a constant time discount rate. However, evidence from human and animal behaviour suggests that we have evolved to employ discount rates which fall over time, often referred to as ?hyperbolic discounting?. This increases the weight on ...

  20. Quantity discount contracts for supply chain coordination under asymmetric information and disruptions

    Institute of Scientific and Technical Information of China (English)

    2008-01-01

    The quantity discount contracts are investigated for a one-supplier-one-retailer supply chain with asymmetric information when the retailer's cost is disrupted. While the retailer's cost structure is asymmetric information, two all-unit quantity discount contract models, fixed expected-profit percentage discount(FEPD) and fixed wholesale-pricing percentage discount(FWPD) under asymmetric information are proposed in a regular scenario. When the retailer's cost distribution fluctuates due to disruptions, the ...

  1. Dimensional psychiatry: reward dysfunction and depressive mood across psychiatric disorders.

    Science.gov (United States)

    Hägele, Claudia; Schlagenhauf, Florian; Rapp, Michael; Sterzer, Philipp; Beck, Anne; Bermpohl, Felix; Stoy, Meline; Ströhle, Andreas; Wittchen, Hans-Ulrich; Dolan, Raymond J; Heinz, Andreas

    2015-01-01

    A dimensional approach in psychiatry aims to identify core mechanisms of mental disorders across nosological boundaries. We compared anticipation of reward between major psychiatric disorders, and investigated whether reward anticipation is impaired in several mental disorders and whether there is a common psychopathological correlate (negative mood) of such an impairment. We used functional magnetic resonance imaging (fMRI) and a monetary incentive delay (MID) task to study the functional correlates of reward anticipation across major psychiatric disorders in 184 subjects, with the diagnoses of alcohol dependence (n = 26), schizophrenia (n = 44), major depressive disorder (MDD, n = 24), bipolar disorder (acute manic episode, n = 13), attention deficit/hyperactivity disorder (ADHD, n = 23), and healthy controls (n = 54). Subjects' individual Beck Depression Inventory-and State-Trait Anxiety Inventory-scores were correlated with clusters showing significant activation during reward anticipation. During reward anticipation, we observed significant group differences in ventral striatal (VS) activation: patients with schizophrenia, alcohol dependence, and major depression showed significantly less ventral striatal activation compared to healthy controls. Depressive symptoms correlated with dysfunction in reward anticipation regardless of diagnostic entity. There was no significant correlation between anxiety symptoms and VS functional activation. Our findings demonstrate a neurobiological dysfunction related to reward prediction that transcended disorder categories and was related to measures of depressed mood. The findings underline the potential of a dimensional approach in psychiatry and strengthen the hypothesis that neurobiological research in psychiatric disorders can be targeted at core mechanisms that are likely to be implicated in a range of clinical entities.

  2. Random reward priming is task-contingent

    DEFF Research Database (Denmark)

    Ásgeirsson, Árni Gunnar; Kristjánsson, Árni

    2014-01-01

    Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings...... for a Gabor patch of odd spatial frequency we found no evidence of reward priming, while we only partially replicate the reward priming in the exact original paradigm tested by Hickey and colleagues. The results cast doubt on the proposal that random reward enhances salience, suggested in the original papers......, and highlight the need for a more nuanced account. In many other paradigms reward effects have been found to progress gradually, becoming stronger as they build up, and we argue that for robust reward priming, reward schedules need to be more consistent than in the original 1-trial reward priming paradigm....

  3. Random reward priming is task-contingent

    DEFF Research Database (Denmark)

    Ásgeirsson, Árni Gunnar; Kristjánsson, Árni

    2014-01-01

    Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings...... for a Gabor patch of odd spatial frequency we found no evidence of reward priming, while we only partially replicate the reward priming in the exact original paradigm tested by Hickey and colleagues. The results cast doubt on the proposal that random reward enhances salience, suggested in the original papers......, and highlight the need for a more nuanced account. In many other paradigms reward effects have been found to progress gradually, becoming stronger as they build up, and we argue that for robust reward priming, reward schedules need to be more consistent than in the original 1-trial reward priming paradigm....

  4. Special discount to the members of the Staff Association

    CERN Document Server

    Association du personnel

    2012-01-01

    FNAC 5% discount on gifts card available in four Swiss shops without any restriction. Gifts card on sale to the Staff Association Secretariat. TPG 50 CHF discount on annual subscriptions. Subscription « tout Genève » for adult: 650 CHF; for junior: 400 CHF. On sale to the Staff Association Secretariat. Théâtre de Carouge Discount of 5.-CHF for all shows (30.– CHF instead of 35.-CHF) and on season tickets « first performance » ( 132.– CHF instead 162.– CHF) and also on « classical » ( 150.– CHF instead of 180.– CHF) upon presentation of your Staff Association membership card before payment. Aquaparc Discounted prices on admission of whole day. Children from 5 to 15 years: 30.-CHF instead of 39.-CHF; Adults from 16 years: 36.-CHF instead of 49.-CHF. Tickets on sale to the Staff Association Secretariat. Go Sport 15% off on all purchases in the whole shop upon present...

  5. MODERN INDICATORS DERIVED FROM VALUE CREATION AND DISCOUNTED

    Directory of Open Access Journals (Sweden)

    Cican Simona

    2013-07-01

    In this article, we will present the connection between discounted cash flow methods and the indicators derived from value creation, based on the business finance theory, which says that firm value will increase if projects with positive net present value are accepted, while it will be destroyed if projects with negative net present value are accepted.

  6. Deriving the Dividend Discount Model in the Intermediate Microeconomics Class

    Science.gov (United States)

    Norman, Stephen; Schlaudraff, Jonathan; White, Karianne; Wills, Douglas

    2013-01-01

    In this article, the authors show that the dividend discount model can be derived using the basic intertemporal consumption model that is introduced in a typical intermediate microeconomics course. This result will be of use to instructors who teach microeconomics to finance students in that it demonstrates the value of utility maximization in…

  7. Tuition Discounting: The Impact of Institutionally Funded Financial Aid.

    Science.gov (United States)

    Hubbell, Loren Loomis

    This report presents a model and an approach that institutions of higher education can use to analyze and project the impact of endogenous and exogenous factors on both net and gross tuition in the context of the increasing practice of tuition discounting. It is noted that two key questions drive this effort: (1) what influence does gross tuition…

  8. Children's Use of the Discounting Principle: A Perceptual Approach.

    Science.gov (United States)

    Kassin, Saul M.; And Others

    1980-01-01

    Subjects watched animated films depicting the simultaneous movements of two triangles toward a goal. One triangle was pushed by an external object while the other triangle was not. Initially, only college students understood the discounting principle. Kindergarten children, second graders, and fourth graders did not. Revision of the film produced…

  9. 7 CFR 17.6 - Discounts, fees, commissions and payments.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 1 2010-01-01 2010-01-01 false Discounts, fees, commissions and payments. 17.6 Section 17.6 Agriculture Office of the Secretary of Agriculture SALES OF AGRICULTURAL COMMODITIES MADE... commissions earned on U.S. and non-U.S.-flag bookings by all parties arranging vessel fixtures shall...

  10. Employee Reward Systems in Organizations

    Directory of Open Access Journals (Sweden)

    Došenović Dragana

    2016-06-01

    Full Text Available Employee rewarding is one of the activities of human resource management concerning the management of money, goods and services that employees receive from their employer in exchange for their work. Given that a properly designed reward system is one of the conditions for a stable business, successful performance of work activities and the achievement of set objectives in each organization, the basic theme of this paper is the employee reward system, with a special focus on different elements of it. The purpose of this paper is to describe the role and significance of the observed system and to draw attention to its role in employee’s motivation.

  11. Reviewing and piloting methods for decreasing discount rates; someone, somewhere in time.

    NARCIS (Netherlands)

    Parouty, Mehraj B Y; Krooshof, Daan G M; Westra, Tjalke A; Pechlivanoglou, Petros; Postma, Maarten J

    2013-01-01

    There has been substantial debate on the need for decreasing discounting for monetary and health gains in economic evaluations. Next to the discussion on differential discounting, a way to identify the need for such discounting strategies is through eliciting the time preferences for monetary and he

  12. Parameters of rewards on choice behavior in Siamese fighting fish (Betta splendens).

    Science.gov (United States)

    Shapiro, Martin S; Jensen, Ashley L

    2009-09-01

    Five experiments were conducted with Siamese fighting fish (Betta splendens) to investigate how choices in a T-maze were affected by parameters of a social reward (aggression display to another male): presence or absence, amount, delay and distance traveled. Bettas showed a preference for the side associated with the presence of another male rather than the side associated with nothing (Exp 1), a greater length of time of the reward (Exp 2) and shorter delay (Exp 3). The animals were indifferent when one side offered a longer delay to a longer reward time compared with a shorter delay to a shorter reward time (Exp 4). What was most surprising, however, was that fish preferred to choose the side that was associated with swimming a greater distance to reach an opponent male (Exp 5). These experiments demonstrate that, while some parameters of a visual reward affect behavior in predictable ways (greater amount, shorter delay), the complex motivations underlying inter-male aggression can produce what appear to be paradoxical results.

  13. Working memory load strengthens reward prediction errors.

    Science.gov (United States)

    Collins, Anne G E; Ciullo, Brittany; Frank, Michael J; Badre, David

    2017-03-20

    Reinforcement learning in simple instrumental tasks is usually modeled as a monolithic process in which reward prediction errors are used to update expected values of choice options. This modeling ignores the different contributions of different memory and decision-making systems thought to contribute even to simple learning. In an fMRI experiment, we asked how working memory and incremental reinforcement learning processes interact to guide human learning. Working memory load was manipulated by varying the number of stimuli to be learned across blocks. Behavioral results and computational modeling confirmed that learning was best explained as a mixture of two mechanisms: a fast, capacity-limited, and delay-sensitive working memory process together with slower reinforcement learning. Model-based analysis of fMRI data showed that striatum and lateral prefrontal cortex were sensitive to reward prediction error, as shown previously, but critically, these signals were reduced when the learning problem was within capacity of working memory. The degree of this neural interaction related to individual differences in the use of working memory to guide behavioral learning. These results indicate that the two systems do not process information independently, but rather interact during learning.SIGNIFICANCE STATEMENTReinforcement learning theory has been remarkably productive at improving our understanding of instrumental learning as well as dopaminergic and striatal network function across many mammalian species. However, this neural network is only one contributor to human learning, and other mechanisms such as prefrontal cortex working memory, also play a key role. Our results show in addition that these other players interact with the dopaminergic RL system, interfering with its key computation of reward predictions errors.

  14. Does 'better' discounting lead to 'worse' outcomes in long-run decisions? The dilemma of hyperbolic discounting

    Energy Technology Data Exchange (ETDEWEB)

    Winkler, Ralph [School of Politics, International Relations and the Environment, Keele University, Keele, Staffordshire, ST5 5BG (United Kingdom)

    2006-06-01

    The shortcomings of conventional discounting, especially in the context of long-run environmental problems, have been extensively discussed in the literature. Recently, hyperbolic discounting, i. e. discounting at declining instead of constant discount rates, has attracted a lot of interest among both scientists and politicians. Although there are compelling arguments for employing hyperbolic discounting, there are also pitfalls, which have to be pointed out. In this paper I show that the problem of time-inconsistency, an inherent characteristics of hyperbolic discounting, leads to a potential clash between economic efficiency and intergenerational equity. As an example, I refer to the weak progress in the controlling of greenhouse gas emissions under the Kyoto protocol. As the problem of time-inconsistency cannot be solved on economic grounds alone, there is a need for an intergenerational moral commitment. (author)

  15. Delay Aversion in Attention Deficit/Hyperactivity Disorder: An Empirical Investigation of the Broader Phenotype

    Science.gov (United States)

    Bitsakou, Paraskevi; Psychogiou, Lamprini; Thompson, Margaret; Sonuga-Barke, Edmund J. S.

    2009-01-01

    Background: Delay-related motivational processes are impaired in children with Attention Deficit/Hyperactivity Disorder (ADHD). Here we explore the impact of ADHD on the performance of three putative indices of Delay Aversion (DAv): (i) the choice for immediate over delayed reward; (ii) slower reaction times following delay; and (iii) increased…

  16. Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials.

    Science.gov (United States)

    Cox, Anthony; Kohls, Gregor; Naples, Adam J; Mukerji, Cora E; Coffman, Marika C; Rutherford, Helena J V; Mayes, Linda C; McPartland, James C

    2015-10-01

    Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD.

  17. Model Checking Multivariate State Rewards

    DEFF Research Database (Denmark)

    Nielsen, Bo Friis; Nielson, Flemming; Nielson, Hanne Riis

    2010-01-01

    We consider continuous stochastic logics with state rewards that are interpreted over continuous time Markov chains. We show how results from multivariate phase type distributions can be used to obtain higher-order moments for multivariate state rewards (including covariance). We also generalise ...... the treatment of eventuality to unbounded path formulae. For all extensions we show how to obtain closed form definitions that are straightforward to implement and we illustrate our development on a small example.......We consider continuous stochastic logics with state rewards that are interpreted over continuous time Markov chains. We show how results from multivariate phase type distributions can be used to obtain higher-order moments for multivariate state rewards (including covariance). We also generalise...

  18. Dysfunctional Reward Processing in Depression

    Science.gov (United States)

    Admon, Roee; Pizzagalli, Diego A.

    2015-01-01

    Anhedonia - diminished pleasure and/or decreased reactivity to pleasurable stimuli - is a core feature of depression that frequently persists after treatment. As a result, extensive effort has been directed towards characterizing the psychological and biological processes that mediate dysfunctional reward processing in depression. Reward processing can be parsed into sub-components that include motivation, reinforcement learning, and hedonic capacity, which, according to preclinical and neuroimaging evidence, involve partially dissociable brain systems. In line with this, recent findings indicate that behavioral impairments and neural abnormalities in depression vary across distinct reward-related constructs. Ultimately, improved understanding of precise reward-related dysfunctions in depression promises to improve diagnostic and therapeutic efforts in depression. PMID:26258159

  19. Evolutionary advantages of adaptive rewarding

    CERN Document Server

    Szolnoki, Attila

    2012-01-01

    Our wellbeing depends as much on our personal success, as it does on the success of our society. The realization of this fact makes cooperation a very much needed trait. Experiments have shown that rewards can elevate our readiness to cooperate, but since giving a reward inevitably entails paying a cost for it, the emergence and stability of such behavior remain elusive. Here we show that allowing for the act of rewarding to self-organize in dependence on the success of cooperation creates several evolutionary advantages that instill new ways through which collaborative efforts are promoted. Ranging from indirect territorial battle to the spontaneous emergence and destruction of coexistence, phase diagrams and the underlying spatial patterns reveal fascinatingly reach social dynamics that explains why this costly behavior has evolved and persevered. Comparisons with adaptive punishment, however, uncover an Achilles heel of adaptive rewarding that is due to over-aggression, which in turn hinders optimal utiliz...

  20. Developing a Comprehensive Reward System.

    Science.gov (United States)

    Votruba, James C.

    1979-01-01

    Providing incentives for teachers of adults is an important means of attracting, retaining, and stimulating staff. Developing a variety of extrinsic and intrinsic rewards and incentives and instituting them effectively are important administrative functions. (SK)

  1. Developing a Comprehensive Reward System.

    Science.gov (United States)

    Votruba, James C.

    1979-01-01

    Providing incentives for teachers of adults is an important means of attracting, retaining, and stimulating staff. Developing a variety of extrinsic and intrinsic rewards and incentives and instituting them effectively are important administrative functions. (SK)

  2. The Role of Reward Expectations for Prospective Memory : An investigation with functional magnetic resonance imaging

    OpenAIRE

    Gäbel, Andrea

    2010-01-01

    Prospective memory is the ability to remember to carry out an intended action after a delay. However, it remains unclear how motivational aspects of the intended action,such as reward expectations, are integrated into the processes subserving intact prospective memory. The goal of this dissertation is to investigate the effects of motivational incentives on prospective memory on the behavioral and on the neural level, while taking into account individual differences in reward sensitivity and ...

  3. The role of the striatum in effort-based decision-making in the absence of reward.

    Science.gov (United States)

    Schouppe, Nathalie; Demanet, Jelle; Boehler, Carsten N; Ridderinkhof, K Richard; Notebaert, Wim

    2014-02-05

    Decision-making involves weighing costs against benefits, for instance, in terms of the effort it takes to obtain a reward of a given magnitude. This evaluation process has been linked to the dorsal anterior cingulate cortex (dACC) and the striatum, with activation in these brain structures reflecting the discounting effect of effort on reward. Here, we investigate how cognitive effort influences neural choice processes in the absence of an extrinsic reward. Using functional magnetic resonance imaging in humans, we used an effort-based decision-making task in which participants were required to choose between two options for a subsequent flanker task that differed in the amount of cognitive effort. Cognitive effort was manipulated by varying the proportion of incongruent trials associated with each choice option. Choice-locked activation in the striatum was higher when participants chose voluntarily for the more effortful alternative but displayed the opposite trend on forced-choice trials. The dACC revealed a similar, yet only trend-level significant, activation pattern. Our results imply that activation levels in the striatum reflect a cost-benefit analysis, in which a balance is made between effort discounting and the intrinsic motivation to choose a cognitively challenging task. Moreover, our findings indicate that it matters whether this challenge is voluntarily chosen or externally imposed. As such, the present findings contrast with classical findings on effort discounting that found reductions in striatum activation for higher effort by finding enhancements of the same neural circuits when a cognitively challenging task is voluntarily selected and does not entail the danger of losing reward.

  4. Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

    Science.gov (United States)

    Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

    2013-01-01

    Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

  5. Should I Stay or Should I Go?

    Science.gov (United States)

    ROESCH, MATTHEW R.; CALU, DONNA J.; BURKE, KATHRYN A.; SCHOENBAUM, GEOFFREY

    2008-01-01

    Animals prefer a small, immediate reward over a larger delayed reward (time discounting). Lesions of the orbitofrontal cortex (OFC) can either increase or decrease the breakpoint at which animals abandon the large delayed reward for the more immediate reward as the delay becomes longer. Here we argue that the varied effects of OFC lesions on delayed discounting reflect two different patterns of activity in OFC; one that bridges the gap between a response and an outcome and another that discounts delayed reward. These signals appear to reflect the spatial location of the reward and/or the action taken to obtain it, and are encoded independently from representations of absolute value. We suggest a dual role for output from OFC in both discounting delayed reward, while at the same time supporting new learning for them. PMID:17344533

  6. Retailer's inventory system in a two-level trade credit financing with selling price discount and partial order cancellations

    Science.gov (United States)

    Thangam, A.

    2014-02-01

    In today's fast marketing over the Internet or online, many retailers want to trade at the same time and change their marketing strategy to attract more customers. Some of the customers may decide to cancel their orders partially with a retailer due to various reasons such as increase in customer's waiting time, loss of customer's goodwill on retailer's business, and attractive promotional schemes offered by other retailers. Even though there is a lag in trading and order cancellation, this paper attempts to develop the retailer's inventory model with the effect of order cancellations during advance sales period. The retailer announces a price discount program during advance sales period to promote his sales and also offers trade credit financing during the sales periods. The retailer availing trade credit period from his supplier offers a permissible delay period to his customers. The customer who gets an item is allowed to pay on or before the permissible delay period which is accounted from the buying time rather than from the start period of inventory sales. This accounts for significant changes in the calculations of interest payable and interest earned by the retailer. The retailer's total cost is minimized so as to find out the optimal replenishment cycle time and price discount policies through a solution procedure. The results derived in mathematical theorems are implemented in numerical examples, and sensitivity analyses on several inventory parameters are obtained.

  7. Retailer's inventory system in a two-level trade credit financing with selling price discount and partial order cancelations

    Science.gov (United States)

    Thangam, A.

    2015-03-01

    In today's fast marketing over the Internet or online, many retailers want to trade at the same time and change their marketing strategy to attract more customers. Some of the customers may decide to cancel their orders partially with a retailer due to various reasons such as increase in customer's waiting time, loss of customer's goodwill on retailer's business, attractive promotional schemes offered by other retailers etc. Even though there is a lag in trading and order cancelation, this paper attempts to develop the retailer's inventory model with the effect of order cancelations during advance sales period. The retailer announces a price discount program during advance sales period to promote his sales and also he offers trade credit financing during the sales periods. The retailer availing trade credit period from his supplier offers a permissible delay period to his customers. The customer who gets an item has allowed paying on or before the permissible delay period which is accounted from the buying time rather than the start period of inventory sales. This accounts for significant changes in the calculations of interest payable and interest earned by the retailer. The retailer's total cost is minimized so as to find out the optimal replenishment cycle time and price discount policies through a solution procedure. The results derived in mathematical theorems are implemented in numerical examples and sensitivity analyses on several inventory parameters are obtained.

  8. Fronto-striatal dysfunction during reward processing in unaffected siblings of schizophrenia patients.

    Science.gov (United States)

    de Leeuw, Max; Kahn, René S; Vink, Matthijs

    2015-01-01

    Schizophrenia is a psychiatric disorder that is associated with impaired functioning of the fronto-striatal network, in particular during reward processing. However, it is unclear whether this dysfunction is related to the illness itself or whether it reflects a genetic vulnerability to develop schizophrenia. Here, we examined reward processing in unaffected siblings of schizophrenia patients using functional magnetic resonance imaging. Brain activity was measured during reward anticipation and reward outcome in 27 unaffected siblings of schizophrenia patients and 29 healthy volunteers using a modified monetary incentive delay task. Task performance was manipulated online so that all subjects won the same amount of money. Despite equal performance, siblings showed reduced activation in the ventral striatum, insula, and supplementary motor area (SMA) during reward anticipation compared to controls. Decreased ventral striatal activation in siblings was correlated with sub-clinical negative symptoms. During the outcome of reward, siblings showed increased activation in the ventral striatum and orbitofrontal cortex compared to controls. Our finding of decreased activity in the ventral striatum during reward anticipation and increased activity in this region during receiving reward may indicate impaired cue processing in siblings. This is consistent with the notion of dopamine dysfunction typically associated with schizophrenia. Since unaffected siblings share on average 50% of their genes with their ill relatives, these deficits may be related to the genetic vulnerability for schizophrenia.

  9. Neural signature of food reward processing in bulimic-type eating disorders.

    Science.gov (United States)

    Simon, Joe J; Skunde, Mandy; Walther, Stephan; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2016-09-01

    Clinical observations and similarities to addiction suggest heightened reward sensitivity to food in patients with bulimic-type eating (BTE) disorders. Therefore, we investigated the expectation and receipt of food reward compared with monetary reward in patients with BTE. Fifty-six patients with BTE (27 patients with binge eating disorder and 29 with bulimia nervosa) and 55 matched healthy control participants underwent event-related functional magnetic resonance imaging while performing both food and monetary incentive delay tasks. BTE patients exhibited reduced brain activation in the posterior cingulate cortex during the expectation of food and increased activity in the medial orbitofrontal cortex, anterior medial prefrontal cortex and posterior cingulate cortex during the receipt of food reward. These findings were relevant to food because we found no significant group differences related to monetary reward. In the patients, higher brain activity in the medial orbitofrontal cortex during the receipt of food reward was related to higher levels of trait food craving and external eating. BTE patients exhibited increased hedonic processing during the receipt of food reward. These findings corroborate the notion that an altered responsiveness of the reward network to food stimuli is associated with BTE.

  10. Genetic algorithm for network cost minimization using threshold based discounting

    Directory of Open Access Journals (Sweden)

    Hrvoje Podnar

    2003-01-01

    Full Text Available We present a genetic algorithm for heuristically solving a cost minimization problem applied to communication networks with threshold based discounting. The network model assumes that every two nodes can communicate and offers incentives to combine flow from different sources. Namely, there is a prescribed threshold on every link, and if the total flow on a link is greater than the threshold, the cost of this flow is discounted by a factor α. A heuristic algorithm based on genetic strategy is developed and applied to a benchmark set of problems. The results are compared with former branch and bound results using the CPLEX® solver. For larger data instances we were able to obtain improved solutions using less CPU time, confirming the effectiveness of our heuristic approach.

  11. Production inventory policy under a discounted cash flow

    Directory of Open Access Journals (Sweden)

    Su Chao-Ton

    2005-01-01

    Full Text Available This paper presents an extended production inventory model in which the production rate at any instant depends on the demand and the inventory level. The effects of the time value of money are incorporated into the model. The demand rate is a linear function of time for the scheduling period. The proposed model can assist managers in economically controlling production systems under the condition of considering a discounted cash flow. A simple algorithm computing the optimal production-scheduling period is developed. Several particular cases of the model are briefly discussed. Through numerical example, sensitive analyses are carried out to examine the effect of the parameters. Results show that the discount rate parameter and the inventory holding cost have a significant impact on the proposed model.

  12. The Discount Rate for Defense Decisionmaking: Some New Considerations,

    Science.gov (United States)

    1978-11-01

    Bradford, "Constraints on Government Investment Opportunities and the Choice of the Discount Rate," American Economic Review , Vol. 65, December 1975...Lind, "Uncertainty and the Evaluation of Public Investment Decisions," American Economic Review , Vol. 60, June 1970, pp. 364-378. Arrow, K. .., and...Robert C. Lind, "Uncertainty and the Evaluation of Public Investment Decisions: Reply," American Economic Review , Vol. 62, March 1972, pp. 171-172

  13. Credibility Discounting in the Theory of Approximate Reasoning

    OpenAIRE

    Yager, Ronald R.

    2013-01-01

    We are concerned with the problem of introducing credibility type information into reasoning systems. The concept of credibility allows us to discount information provided by agents. An important characteristic of this kind of procedure is that a complete lack of credibility rather than resulting in the negation of the information provided results in the nullification of the information provided. We suggest a representational scheme for credibility qualification in the theory of approximate r...

  14. some notes on discount factor restrictions for dynamic optimization problems

    OpenAIRE

    Gerhard Sorger

    2008-01-01

    We consider dynamic optimization problems on one-dimensional state spaces. Un- der standard smoothness and convexity assumptions, the optimal solutions are characterized by an optimal policy function h mapping the state space into itself. There exists an extensive literature on the relation between the size of the discount factor of the dynamic optimization problem on the one hand and the properties of the dynamical system xt+1 = h(xt) on the other hand. The purpose of this paper is to survey...

  15. Three residual income valuation methods and discounted cash flow valuation

    OpenAIRE

    Fernandez, Pablo

    2003-01-01

    In this paper we show that the three residual Income models for equity valuation always yield the same value as the Discounted Cash Flow Valuation models. We use three residual income measures: Economic Profit, Economic Value Added (EVA) and Cash Value Added. We also show that economic profit and EVA are different, although Copeland, Koller and Murrin (2000, page 55) say that economic profit is a synonym of EVA. Specifically, we first show that the present value of the Economic Profit discoun...

  16. Delayed Puberty

    DEFF Research Database (Denmark)

    Kolby, Nanna; Busch, Alexander Siegfried; Juul, Anders

    2017-01-01

    Delayed puberty can be a source of great concern and anxiety, although it usually is caused by a self-limiting variant of the normal physiological timing named constitutional delay of growth and puberty (CDGP). Delayed puberty can, however, also be the first presentation of a permanent condition ...... mineral density) and psychological (e.g., low self-esteem) and underline the importance of careful clinical assessment of the patients.......Delayed puberty can be a source of great concern and anxiety, although it usually is caused by a self-limiting variant of the normal physiological timing named constitutional delay of growth and puberty (CDGP). Delayed puberty can, however, also be the first presentation of a permanent condition...

  17. Delayed fission

    Energy Technology Data Exchange (ETDEWEB)

    Hatsukawa, Yuichi [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

    1997-07-01

    Delayed fission is a nuclear decay process that couples {beta} decay and fission. In the delayed fission process, a parent nucleus undergoes {beta} decay and thereby populates excited states in the daughter. If these states are of energies comparable to or greater than the fission barrier of the daughter, then fission may compete with other decay modes of the excited states in the daughter. In this paper, mechanism and some experiments of the delayed fission will be discussed. (author)

  18. Reward and learning in the goldfish.

    Science.gov (United States)

    Lowes, G; Bitterman, M E

    1967-07-28

    An experiment with goldfish showed the effects of change in amount of reward that are predicted from reinforcement theory. The performance of animals shifted from small to large reward improved gradually to the level of unshifted large-reward controls, while the performance of animals shifted from large to small reward remained at the large-reward level. The difference between these results and those obtained in analogous experiments with the rat suggests that reward functions differently in the instrumental learning of the two animals.

  19. Introduction: Addiction and Brain Reward and Anti-Reward Pathways

    Science.gov (United States)

    Gardner, Eliot L.

    2013-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the

  20. Linking reward processing to behavioral output: motor and motivational integration in the primate subthalamic nucleus

    Directory of Open Access Journals (Sweden)

    Juan-Francisco eEspinosa-Parrilla

    2013-12-01

    Full Text Available The expectation and detection of motivationally relevant events is a major determinant of goal-directed behavior and there is a strong interest in the contribution of basal ganglia in the integration of motivational processes into behavioral output. Recent research has focused on the role of the subthalamic nucleus (STN in the motivational control of action, but it remains to be determined how information about reward is encoded in this nucleus. We recorded the activity of single neurons in the STN of two behaving monkeys to examine whether activity was influenced by the delivery of reward in an instrumental task, a Pavlovian stimulus-reward association, or outside of a task context. We confirmed preliminary findings indicating that STN neurons were sensitive not only to rewards obtained during task performance, but also to the expectation of reward when its delivery was delayed in time. Most of the modulations at the onset of reaching movement were combined with modulations following reward delivery, suggesting the convergence of signals related to the animal’s movement and its outcome in the same neurons. Some neurons were also influenced by the visuomotor contingencies of the task, i.e., target location and/or movement direction. In addition, modulations were observed under conditions where reward delivery was not contingent on an instrumental response, even in the absence of a reward predictive cue. Taken as a whole, these results demonstrate a potential contribution of the STN to motivational control of behavior in the non-human primate, although problems in distinguishing neuronal signals related to reward from those related to motor behavior should be considered. Characterizing the specificity of reward processing in the STN remains challenging and could have important implications for understanding the influence of this key component of basal ganglia circuitry on emotional and motivated behaviors under normal and pathological

  1. Reduced Caudate and Nucleus Accumbens Response to Rewards in Unmedicated Subjects with Major Depressive Disorder

    Science.gov (United States)

    Pizzagalli, Diego A.; Holmes, Avram J.; Dillon, Daniel G.; Goetz, Elena L.; Birk, Jeffrey L.; Bogdan, Ryan; Dougherty, Darin D.; Iosifescu, Dan V.; Rauch, Scott L.; Fava, Maurizio

    2009-01-01

    Objective Major depressive disorder (MDD) is characterized by impaired reward processing, possibly due to dysfunction in the basal ganglia. However, few neuroimaging studies of depression have distinguished between anticipatory and consummatory phases of reward processing. Using functional magnetic resonance imaging (fMRI) and a task that dissociates anticipatory and consummatory phases of reward processing, the authors tested the hypothesis that MDD participants would show reduced reward-related responses in basal ganglia structures. Method A monetary incentive delay task was presented to 30 unmedicated MDD subjects and 31 healthy comparison subjects during fMRI scanning. Whole-brain analyses focused on neural responses to reward-predicting cues and rewarding outcomes (i.e., monetary gains). Secondary analyses focused on the relationship between anhedonic symptoms and basal ganglia volumes. Results Relative to comparison subjects, MDD participants showed significantly weaker responses to gains in the left nucleus accumbens and bilateral caudate. Group differences in these regions were specific to rewarding outcomes and did not generalize to neutral or negative outcomes, although relatively reduced responses to monetary penalties in MDD emerged in other caudate regions. By contrast, evidence for group differences during reward anticipation was weaker, although MDD subjects showed reduced activation to reward cues in a small sector of the left posterior putamen. Among MDD subjects, anhedonic symptoms and depression severity were associated with reduced bilateral caudate volume. Conclusions These results indicate that basal ganglia dysfunction in MDD may affect the consummatory phase of reward processing. Additionally, morphometric results suggest that anhedonia in MDD is related to caudate volume. PMID:19411368

  2. THE LEVELS OF VALUE IN BUSINESS VALUATION. THE DISCOUNT FOR LACK OF MARKETABILITY

    Directory of Open Access Journals (Sweden)

    Szatmary Miclea Camelia

    2012-12-01

    Full Text Available This paper approaches the subject of levels of value used in business valuation and adjustments (discounts and prime that enable professional business valuers to relate these in order to determine the value of a business or ownerships interests in a business. Marketability and control over business decision have a profound impact on the value of an ownership interest. Valuators, regularly, reduce the value of an investment interest if it lacks a ready market. In this paper, I highlight the difference between the marketability and liquidity and, the differences between the the discount for lack of marketability and discount for lack of control. A discount for lack of marketability is closely associated with, but, conceptually, distinct from, the discount for lack of control. I present the characteristics of discount for lack of marketability and the rational of applying it in valuation of minority and majority interest.

  3. Addiction: Beyond dopamine reward circuitry

    Energy Technology Data Exchange (ETDEWEB)

    Volkow, N.D.; Wang, G.; Volkow, N.D.; Wang, G.-J.; Fowler, J.S.; Tomasi, D.; Telang, F.

    2011-09-13

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  4. What Rewards Do Students Want?

    Science.gov (United States)

    Ware, Barbara Ann

    1978-01-01

    In general, students ranked personal kinds of recognition high and teachers ranked tangible sources of recognition high in surveys of the kinds of rewards that motivate students. The students' top two kinds of recognition were ranked as the bottom two by teachers. (Author/IRT)

  5. Should Virtuous Behavior Be Rewarded?

    Institute of Scientific and Technical Information of China (English)

    Shu Shengxiang; Wu Ruowei; Fang Hua; Jin Zhen; Wan Xiaoyang; Wang Jie

    2012-01-01

    Traditionally Chinese people place much value in virtue, with a long-held belief that one should never appropriate valuable items lost by others. However, a recent regulation by the government of south China's Guangdong Province has provaked heated debate on whether such virtuaus behavior should be rewarded with money.

  6. The Hidden Costs of Rewards.

    Science.gov (United States)

    Deci, Edward L.

    1976-01-01

    This paper discusses ways managers can motivate their employees to work and at the same time to increase their performance. Two theories of motivation--Vroom's theory and Atkinson's theory--focus on the use of extrinsic and intrinsic rewards respectively. A managerial strategy that combines the best of both intrinsic and extrinsic approaches to…

  7. To Groupon or Not to Groupon: The Profitability of Deep Discounts

    OpenAIRE

    Benjamin Edelman; Sonia Jaffe; Scott Duke Kominers

    2010-01-01

    We examine the profitability and implications of online discount vouchers, a relatively new marketing tool that offers consumers large discounts when they prepay for participating firms' goods and services. Within a model of repeat experience good purchase, we examine two mechanisms by which a discount voucher service can benefit affiliated firms: price discrimination and advertising. For vouchers to provide successful price discrimination, the valuations of consumers who have access to vouch...

  8. Effects of Varying Contingency and Directness of Rewards upon Children's Performance under Implicit Reward Conditions.

    Science.gov (United States)

    Sharpley, Christopher F.

    1988-01-01

    Investigated the application of verbal praise as a reward with 84 third and fourth grade children who completed a digit-symbol coding task under contingent versus noncontingent and direct versus implicit reward conditions. Noncontingent rewards possessed no significant reinforcer effect under either reward condition. (SKC)

  9. Neural correlates of reward processing in healthy siblings of patients with schizophrenia.

    Science.gov (United States)

    Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M; Shergill, Sukhi S; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could

  10. Defining rewardable innovation in drug therapy.

    Science.gov (United States)

    Aronson, Jeffrey K; Ferner, Robin E; Hughes, Dyfrig A

    2012-03-30

    Implementing mechanisms for rewarding those who introduce innovative medicinal products requires a definition of 'rewardable innovation'. Here, we propose a definition of innovation with respect to medicinal products, accompanied by a ranking of the importance of different types of innovativeness, with the aim of providing a basis for rewarding such innovation.

  11. Alterations of the Brain Reward System in Antipsychotic Naïve Schizophrenia Patients

    DEFF Research Database (Denmark)

    Nielsen, Mette Ødegaard; Rostrup, Egill; Wulff, Sanne

    2012-01-01

    BACKGROUND: Various schizophrenic symptoms are suggested to be linked to a dysfunction of the brain reward system. Several studies have found alterations in the reward processing in patients with schizophrenia; however, most previous findings might be confounded by medication effects. METHODS......: Thirty-one antipsychotic-naïve schizophrenia patients and 31 age- and gender-matched healthy control subjects were examined with functional magnetic resonance imaging while playing a variant of the monetary incentive delay task. The task variant made it possible to separate overall salience (defined...... as arousing events) into behavioral salience (events where a predicted reward requires performance) and valence anticipation (the anticipation of a monetarily significant outcome). Furthermore, the evaluation of monetary gain and loss was assessed. RESULTS: During reward anticipation, patients had...

  12. Independent functional connectivity networks underpin food and monetary reward sensitivity in excess weight.

    Science.gov (United States)

    Verdejo-Román, Juan; Fornito, Alex; Soriano-Mas, Carles; Vilar-López, Raquel; Verdejo-García, Antonio

    2017-02-01

    Overvaluation of palatable food is a primary driver of obesity, and is associated with brain regions of the reward system. However, it remains unclear if this network is specialized in food reward, or generally involved in reward processing. We used functional magnetic resonance imaging (fMRI) to characterize functional connectivity during processing of food and monetary rewards. Thirty-nine adults with excess weight and 37 adults with normal weight performed the Willingness to Pay for Food task and the Monetary Incentive Delay task in the fMRI scanner. A data-driven graph approach was applied to compare whole-brain, task-related functional connectivity between groups. Excess weight was associated with decreased functional connectivity during the processing of food rewards in a network involving primarily frontal and striatal areas, and increased functional connectivity during the processing of monetary rewards in a network involving principally frontal and parietal areas. These two networks were topologically and anatomically distinct, and were independently associated with BMI. The processing of food and monetary rewards involve segregated neural networks, and both are altered in individuals with excess weight.

  13. Adolescent development of the reward system

    Directory of Open Access Journals (Sweden)

    Adriana Galván

    2010-02-01

    Full Text Available Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question.

  14. Incremental effects of reward on creativity.

    Science.gov (United States)

    Eisenberger, R; Rhoades, L

    2001-10-01

    The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization.

  15. Brain Circuits Encoding Reward from Pain Relief

    Science.gov (United States)

    Navratilova, Edita; Atcherley, Christopher; Porreca, Frank

    2015-01-01

    Relief from pain in humans is rewarding and pleasurable. Primary rewards, or reward predictive cues, are encoded in brain reward/motivational circuits. While considerable advances have been made in our understanding of reward circuits underlying positive reinforcement, less is known about the circuits underlying the hedonic and reinforcing actions of pain relief. We review findings from electrophysiological, neuroimaging and behavioral studies supporting the concept that the rewarding effect of pain relief requires opioid signaling in the anterior cingulate cortex, activation of midbrain dopamine neurons and release of dopamine in the nucleus accumbens. Understanding of circuits that govern the reward of pain relief may allow the discovery of more effective and satisfying therapies for patients with acute and chronic pain. PMID:26603560

  16. Commercial Discount Rate Estimation for Efficiency Standards Analysis

    Energy Technology Data Exchange (ETDEWEB)

    Fujita, K. Sydny [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

    2016-04-13

    Underlying each of the Department of Energy's (DOE's) federal appliance and equipment standards are a set of complex analyses of the projected costs and benefits of regulation. Any new or amended standard must be designed to achieve significant additional energy conservation, provided that it is technologically feasible and economically justified (42 U.S.C. 6295(o)(2)(A)). A proposed standard is considered economically justified when its benefits exceed its burdens, as represented by the projected net present value of costs and benefits. DOE performs multiple analyses to evaluate the balance of costs and benefits of commercial appliance and equipment e efficiency standards, at the national and individual building or business level, each framed to capture different nuances of the complex impact of standards on the commercial end user population. The Life-Cycle Cost (LCC) analysis models the combined impact of appliance first cost and operating cost changes on a representative commercial building sample in order to identify the fraction of customers achieving LCC savings or incurring net cost at the considered efficiency levels.1 Thus, the choice of commercial discount rate value(s) used to calculate the present value of energy cost savings within the Life-Cycle Cost model implicitly plays a key role in estimating the economic impact of potential standard levels.2 This report is intended to provide a more in-depth discussion of the commercial discount rate estimation process than can be readily included in standard rulemaking Technical Support Documents (TSDs).

  17. Providing Extrinsic Reward for Test Performance Undermines Long-Term Memory Acquisition

    Directory of Open Access Journals (Sweden)

    Christof eKuhbandner

    2016-02-01

    Full Text Available Based on numerous studies showing that testing studied material can improve long-term retention more than restudying the same material, it is often suggested that the number of tests in education should be increased to enhance knowledge acquisition. However, testing in real-life educational settings often entails a high degree of extrinsic motivation of learners due to the common practice of placing important consequences on the outcome of a test. Such an effect on the motivation of learners may undermine the beneficial effects of testing on long-term memory because it has been shown that extrinsic motivation can reduce the quality of learning. To examine this issue, participants learned foreign language vocabulary words, followed by an immediate test in which one third of the words were tested and one third restudied. To manipulate extrinsic motivation during immediate testing, participants received either monetary reward contingent on test performance or no reward. After one week, memory for all words was tested. In the immediate test, reward reduced correct recall and increased commission errors, indicating that reward reduced the number of items that can benefit from successful retrieval. The results in the delayed test revealed that reward additionally reduced the gain received from successful retrieval because memory for initially successfully retrieved words was lower in the reward condition. However, testing was still more effective than restudying under reward conditions because reward undermined long-term memory for concurrently restudied material as well. These findings indicate that providing performance-contingent reward in a test can undermine long-term knowledge acquisition.

  18. Providing Extrinsic Reward for Test Performance Undermines Long-Term Memory Acquisition.

    Science.gov (United States)

    Kuhbandner, Christof; Aslan, Alp; Emmerdinger, Kathrin; Murayama, Kou

    2016-01-01

    Based on numerous studies showing that testing studied material can improve long-term retention more than restudying the same material, it is often suggested that the number of tests in education should be increased to enhance knowledge acquisition. However, testing in real-life educational settings often entails a high degree of extrinsic motivation of learners due to the common practice of placing important consequences on the outcome of a test. Such an effect on the motivation of learners may undermine the beneficial effects of testing on long-term memory because it has been shown that extrinsic motivation can reduce the quality of learning. To examine this issue, participants learned foreign language vocabulary words, followed by an immediate test in which one-third of the words were tested and one-third restudied. To manipulate extrinsic motivation during immediate testing, participants received either monetary reward contingent on test performance or no reward. After 1 week, memory for all words was tested. In the immediate test, reward reduced correct recall and increased commission errors, indicating that reward reduced the number of items that can benefit from successful retrieval. The results in the delayed test revealed that reward additionally reduced the gain received from successful retrieval because memory for initially successfully retrieved words was lower in the reward condition. However, testing was still more effective than restudying under reward conditions because reward undermined long-term memory for concurrently restudied material as well. These findings indicate that providing performance-contingent reward in a test can undermine long-term knowledge acquisition.

  19. Interaction between COMT Val(158)Met polymorphism and childhood adversity affects reward processing in adulthood.

    Science.gov (United States)

    Boecker-Schlier, Regina; Holz, Nathalie E; Buchmann, Arlette F; Blomeyer, Dorothea; Plichta, Michael M; Jennen-Steinmetz, Christine; Wolf, Isabella; Baumeister, Sarah; Treutlein, Jens; Rietschel, Marcella; Meyer-Lindenberg, Andreas; Banaschewski, Tobias; Brandeis, Daniel; Laucht, Manfred

    2016-05-15

    Accumulating evidence suggests that altered dopamine transmission may increase the risk of mental disorders such as ADHD, schizophrenia or depression, possibly mediated by reward system dysfunction. This study aimed to clarify the impact of the COMT Val(158)Met polymorphism in interaction with environmental variation (G×E) on neuronal activity during reward processing. 168 healthy young adults from a prospective study conducted over 25years participated in a monetary incentive delay task measured with simultaneous EEG-fMRI. DNA was genotyped for COMT, and childhood family adversity (CFA) up to age 11 was assessed by a standardized parent interview. At reward delivery, a G×E revealed that fMRI activation for win vs. no-win trials in reward-related regions increased with the level of CFA in Met homozygotes as compared to Val/Met heterozygotes and Val homozygotes, who showed no significant effect. During the anticipation of monetary vs. verbal rewards, activation decreased with the level of CFA, which was also observed for EEG, in which the CNV declined with the level of CFA. These results identify convergent genetic and environmental effects on reward processing in a prospective study. Moreover, G×E effects during reward delivery suggest that stress during childhood is associated with higher reward sensitivity and reduced efficiency in processing rewarding stimuli in genetically at-risk individuals. Together with previous evidence, these results begin to define a specific system mediating interacting effects of early environmental and genetic risk factors, which may be targeted by early intervention and prevention. Copyright © 2016 Elsevier Inc. All rights reserved.

  20. Providing Extrinsic Reward for Test Performance Undermines Long-Term Memory Acquisition

    Science.gov (United States)

    Kuhbandner, Christof; Aslan, Alp; Emmerdinger, Kathrin; Murayama, Kou

    2016-01-01

    Based on numerous studies showing that testing studied material can improve long-term retention more than restudying the same material, it is often suggested that the number of tests in education should be increased to enhance knowledge acquisition. However, testing in real-life educational settings often entails a high degree of extrinsic motivation of learners due to the common practice of placing important consequences on the outcome of a test. Such an effect on the motivation of learners may undermine the beneficial effects of testing on long-term memory because it has been shown that extrinsic motivation can reduce the quality of learning. To examine this issue, participants learned foreign language vocabulary words, followed by an immediate test in which one-third of the words were tested and one-third restudied. To manipulate extrinsic motivation during immediate testing, participants received either monetary reward contingent on test performance or no reward. After 1 week, memory for all words was tested. In the immediate test, reward reduced correct recall and increased commission errors, indicating that reward reduced the number of items that can benefit from successful retrieval. The results in the delayed test revealed that reward additionally reduced the gain received from successful retrieval because memory for initially successfully retrieved words was lower in the reward condition. However, testing was still more effective than restudying under reward conditions because reward undermined long-term memory for concurrently restudied material as well. These findings indicate that providing performance–contingent reward in a test can undermine long-term knowledge acquisition. PMID:26869978

  1. 76 FR 73674 - Change in Discount Rate for Water Resources Planning

    Science.gov (United States)

    2011-11-29

    ... Bureau of Reclamation Change in Discount Rate for Water Resources Planning AGENCY: Bureau of Reclamation, Interior. ACTION: Notice of change. SUMMARY: The Water Resources Planning Act of 1965 and the Water... resources planning. The discount rate for Federal water resources planning for fiscal year 2012 is 4 percent...

  2. 78 FR 16706 - Change in Discount Rate for Water Resources Planning

    Science.gov (United States)

    2013-03-18

    ... Bureau of Reclamation Change in Discount Rate for Water Resources Planning AGENCY: Bureau of Reclamation, Interior. ACTION: Notice of change. SUMMARY: The Water Resources Planning Act of 1965 and the Water... resources planning. The discount rate for Federal water resources planning for fiscal year 2013 is 3.75...

  3. 75 FR 8106 - Change in Discount Rate for Water Resources Planning

    Science.gov (United States)

    2010-02-23

    ... Bureau of Reclamation Change in Discount Rate for Water Resources Planning AGENCY: Bureau of Reclamation, Interior. ACTION: Notice of change. SUMMARY: The Water Resources Planning Act of 1965 and the Water... resources planning. The discount rate for Federal water resources planning for fiscal year 2010 is 4.375...

  4. 75 FR 82066 - Change in Discount Rate for Water Resources Planning

    Science.gov (United States)

    2010-12-29

    ... Resources Planning AGENCY: Bureau of Reclamation, Interior. ACTION: Notice of change. SUMMARY: The Water Resources Planning Act of 1965 and the Water Resources Development Act of 1974 require an annual determination of a discount rate for Federal water resources planning. The discount rate for Federal water...

  5. 78 FR 67393 - Change in Discount Rate for Water Resources Planning

    Science.gov (United States)

    2013-11-12

    ... Bureau of Reclamation Change in Discount Rate for Water Resources Planning AGENCY: Bureau of Reclamation, Interior. ACTION: Notice of change. SUMMARY: The Water Resources Planning Act of 1965 and the Water... resources planning. The discount rate for Federal water resources planning for fiscal year 2014 is 3.50...

  6. Determining a Relationship between Higher Education Financial Position and Tuition Discount Rates

    Science.gov (United States)

    Browning, Julianna

    2013-01-01

    Institutions have increased the practice of tuition discounting, that is, the strategic use of price discrimination. During the past 30 years, both the average percent discount given to students and the proportion of students receiving tuition breaks have increased. As this practice has increased, there are financial determinants and implications…

  7. Long-term impacts of mega-projects: the discount rate

    NARCIS (Netherlands)

    Koopmans, C.; Rietveld, P.; Priemus, H.; van Wee, B.

    2013-01-01

    In social cost-benefit analysis (SCBA), discount rates are used to convert costs and benefits that occur at different points in time, to present values that can be added and subtracted. Especially if important costs and benefits occur in the long term (more than say 30 years), the discount rate may

  8. Future Rice Is Discounted Less Steeply than Future Money in Thailand

    Science.gov (United States)

    Takahashi, Masaharu; Masataka, Nobuo; Malaivijitnond, Suchinda; Wongsiri, Siriwat

    2008-01-01

    There is evidence that people discount food more steeply than money, suggesting that primary or consumable reinforcers lose value quickly, whereas conditioned or nonconsumable reinforcers lose value slowly. In the present study, discounting rates of baht (unstable currency) and rice (preservable food) were compared during a period of unstable…

  9. 78 FR 6140 - Discount Rates for Cost-Effectiveness Analysis of Federal Programs

    Science.gov (United States)

    2013-01-29

    ... updated annually when the interest rate and inflation assumptions used to prepare the Budget of the United... Real Discount Rates. A forecast of real interest rates from which the inflation premium has been... are to be used for discounting constant-dollar flows, as is often required in...

  10. Stochastic Discount Factor Approach to International Risk-Sharing:A Robustness Check of the Bilateral Setting

    NARCIS (Netherlands)

    Hadzi-Vaskov, M.; Kool, C.J.M.

    2007-01-01

    This paper presents a robustness check of the stochastic discount factor approach to international (bilateral) risk-sharing given in Brandt, Cochrane, and Santa-Clara (2006). We demonstrate two main inherent limitations of the bilateral SDF approach to international risk-sharing. First, the discount

  11. Deciding under doubt: a theory of risk aversion, time discounting preferences, and educational decision-making

    NARCIS (Netherlands)

    R. Breen; H.G. van de Werfhorst; M.M. Jaeger

    2014-01-01

    We develop a rational choice model of educational decision-making in which the utility of educational choices depends on students’ risk aversion and their time discounting preferences. We argue for the role of risk aversion and time discounting preferences in the choice of different tracks in second

  12. The meanings of discounts in contemporary art markets: the case of India

    NARCIS (Netherlands)

    Komarova, N.

    2015-01-01

    Although discounts in art markets are commonplace, the phenomenon remains largely unresearched. This paper looks at how art market actors understand the functions of discounts, focusing on ‘suppliers’ of the market and drawing on qualitative interviews with artists and art dealers from New Delhi and

  13. 77 FR 68886 - Rate for Use in Federal Debt Collection and Discount and Rebate Evaluation

    Science.gov (United States)

    2012-11-16

    ... this rate by agencies as a comparison point in evaluating the cost-effectiveness of a cash discount. In... with Federal Cash Management systems and is based on investment rates set for purposes of Public Law 95... Fiscal Service Rate for Use in Federal Debt Collection and Discount and Rebate Evaluation...

  14. Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings.

    Science.gov (United States)

    von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J; Hoekstra, Pieter J; Hartman, Catharina A; Faraone, Stephen V; van Rooij, Daan; van Dongen, Eelco V; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

    2015-05-01

    Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD. We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age. Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt. ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

  15. Memory Consolidation and Neural Substrate of Reward

    Directory of Open Access Journals (Sweden)

    Redolar-Ripoll, Diego

    2012-08-01

    Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

  16. Reward system dysfunction in autism spectrum disorders

    Science.gov (United States)

    Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2013-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

  17. Impulsivity as a behavioral measure of withdrawal of orally delivered PCP and nondrug rewards in male and female monkeys.

    Science.gov (United States)

    Carroll, Marilyn E; Mach, Jami L; La Nasa, Rachel M; Newman, Jennifer L

    2009-11-01

    Withdrawal of phencyclidine (PCP), ethanol (ETOH), and other drugs reduces operant responding maintained by food. Experiment 1 examined the effects of withdrawing daily short access (2 h) to drug on impulsivity for saccharin (SACC) using a delay discounting task and comparing male and female rhesus monkeys. Experiment 2 examined the effects of withdrawing a nondrug substance (e.g., food or SACC) on impulsivity for PCP. In experiment 1, either PCP or ETOH was available daily with water for 2 h under a fixed ratio 16 (FR 16) or FR 8 schedule, respectively. In a second component, SACC was available for 45 min under a delay discounting schedule. Next, water was substituted, and drug access was then restored. In experiment 2, PCP was available under a delay discounting schedule during food satiation or restriction or during concurrent SACC vs water access. In experiment 1, withdrawal of 0.5 mg/ml PCP increased impulsivity for SACC, but not SACC intake, in males and females. During 16% ETOH access, impulsivity for SACC was elevated compared to baseline water access, and it returned to baseline levels during ETOH withdrawal. In experiment 2, food restriction resulted in increased PCP intake in males and females and increases in impulsivity for PCP that were greater in males than in females. SACC withdrawal had no effect on impulsivity for PCP or PCP intake. Withdrawal of PCP and reduced food access increased impulsivity for SACC or PCP, respectively. Impulsivity is a sensitive indicator of drug dependence.

  18. Increased effort requirements and risk sensitivity: a comparison of delay and magnitude manipulations.

    Science.gov (United States)

    Kirshenbaum, Ari P.; Szalda-Petree, Allen D.; Haddad, Nabil F.

    2003-03-31

    Reward magnitude and delay to reward were independently manipulated in two separate experiments examining risk-sensitive choice in rats. A dual-running wheel apparatus was used and the tangential force resistance required to displace both wheels was low (50g) for half of the subjects, and high (120g) for the remaining subjects. Concurrent FI30-s and FI60-s schedules delivered equivalent amounts of food reward per unit time (i.e. 5 and 10 pellets of food, respectively), and these conditions served as the baseline treatment for all subjects. Variability, either in reward magnitude or delay, was introduced on the long-delay (60s) schedule during the second phase. All subjects were returned to the baseline condition in the third phase, and variability was introduced on the short-delay (30s) interval schedule during phase four. The subjects were again returned to the baseline condition in the fifth and final phase, ultimately yielding a five-phase ABACA design. Original baseline performance was characterized by a slight short-delay interval preference, and this pattern of performance was recovered with each subsequent presentation of the baseline condition. Overall, the data obtained from the reward magnitude and delay-to-reward manipulations were indistinguishable; subjects experiencing low-response effort requirement behaved in a risk-indifferent manner and subjects experiencing high-response effort requirement preferred the variable schedule. Implications for the daily energy budget rule on risk-sensitive foraging are discussed in light of these findings.

  19. Social Discounting of Large Dams with Climate Change Uncertainty

    Directory of Open Access Journals (Sweden)

    Marc Jeuland

    2010-06-01

    This paper reviews the recent discounting controversy and examines its implications for the appraisal of an illustrative hydropower project in Ethiopia. The analysis uses an integrated hydro-economic model that accounts for how the dam’s transboundary impacts vary with climate change. The real value of the dam is found to be highly sensitive to assumptions about future economic growth. The argument for investment is weakest under conditions of robust global economic growth, particularly if these coincide with unfavourable hydrological or development factors related to the project. If however long-term growth is reduced, the value of the dam tends to increase. There may also be distributional or local arguments favouring investment, if growth in the investment region lags behind that of the rest of the globe. In such circumstances, a large dam can be seen as a form of insurance that protects future vulnerable generations against the possibility of macroeconomic instability or climate shocks.

  20. Learning Reward Uncertainty in the Basal Ganglia.

    Directory of Open Access Journals (Sweden)

    John G Mikhael

    2016-09-01

    Full Text Available Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid options with variable reward can be controlled by increasing (or decreasing the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions.

  1. Corticotropin-releasing hormone receptor type 1 (CRHR1) genetic variation and stress interact to influence reward learning.

    Science.gov (United States)

    Bogdan, Ryan; Santesso, Diane L; Fagerness, Jesen; Perlis, Roy H; Pizzagalli, Diego A

    2011-09-14

    Stress is a general risk factor for psychopathology, but the mechanisms underlying this relationship remain largely unknown. Animal studies and limited human research suggest that stress can induce anhedonic behavior. Moreover, emerging data indicate that genetic variation within the corticotropin-releasing hormone type 1 receptor gene (CRHR1) at rs12938031 may promote psychopathology, particularly in the context of stress. Using an intermediate phenotypic neurogenetics approach, we assessed how stress and CRHR1 genetic variation (rs12938031) influence reward learning, an important component of anhedonia. Psychiatrically healthy female participants (n = 75) completed a probabilistic reward learning task during stress and no-stress conditions while 128-channel event-related potentials were recorded. Fifty-six participants were also genotyped across CRHR1. Response bias, an individual's ability to modulate behavior as a function of reward, was the primary behavioral variable of interest. The feedback-related positivity (FRP) in response to reward feedback was used as a neural index of reward learning. Relative to the no-stress condition, acute stress was associated with blunted response bias as well as a smaller and delayed FRP (indicative of disrupted reward learning) and reduced anterior cingulate and orbitofrontal cortex activation to reward. Critically, rs12938031 interacted with stress to influence reward learning: both behaviorally and neurally, A homozygotes showed stress-induced reward learning abnormalities. These findings indicate that acute, uncontrollable stressors reduce participants' ability to modulate behavior as a function of reward, and that such effects are modulated by CRHR1 genotype. Homozygosity for the A allele at rs12938031 may increase risk for psychopathology via stress-induced reward learning deficits.

  2. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  3. Adolescent behavioral and neural reward sensitivity: a test of the differential susceptibility theory

    Science.gov (United States)

    Richards, J S; Arias Vásquez, A; von Rhein, D; van der Meer, D; Franke, B; Hoekstra, P J; Heslenfeld, D J; Oosterlaan, J; Faraone, S V; Buitelaar, J K; Hartman, C A

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene–environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments. Reward responses were assessed during a monetary incentive delay task in 178 participants with and 265 without attention-deficit/hyperactivity disorder (ADHD), from N=261 families. We examined interactions between variants in candidate plasticity genes (DAT1, 5-HTT and DRD4) and social environments (maternal expressed emotion and peer affiliation). HTTLPR short allele carriers showed the least reward speeding when exposed to high positive peer affiliation, but the most when faced with low positive peer affiliation or low maternal warmth. DAT1 10-repeat homozygotes displayed similar GxE patterns toward maternal warmth on general task performance. At the neural level, DRD4 7-repeat carriers showed the least striatal activation during reward anticipation when exposed to high maternal warmth, but the most when exposed to low warmth. Findings were independent of ADHD severity. Our results partially confirm the differential susceptibility theory and indicate the importance of positive social environments in reward sensitivity and general task performance for persons with specific genotypes. PMID:27045841

  4. Anticipation of novelty recruits reward system and hippocampus while promoting recollection.

    Science.gov (United States)

    Wittmann, Bianca C; Bunzeck, Nico; Dolan, Raymond J; Düzel, Emrah

    2007-10-15

    The dopaminergic midbrain, which comprises the substantia nigra and ventral tegmental area (SN/VTA), plays a central role in reward processing. This region is also activated by novel stimuli, raising the possibility that novelty and reward have shared functional properties. It is currently unclear whether functional aspects of reward processing in the SN/VTA, namely, activation by unexpected rewards and cues that predict reward, also characterize novelty processing. To address this question, we conducted an fMRI experiment during which subjects viewed symbolic cues that predicted either novel or familiar images of scenes with 75% validity. We show that SN/VTA was activated by cues predicting novel images as well as by unexpected novel images that followed familiarity-predictive cues, an 'unexpected novelty' response. The hippocampus, a region implicated in detecting and encoding novel stimuli, showed an anticipatory novelty response but differed from the response profile of SN/VTA in responding at outcome to expected and 'unexpected' novelty. In a behavioral extension of the experiment, recollection increased relative to familiarity when comparing delayed recognition memory for anticipated novel stimuli with unexpected novel stimuli. These data reveal commonalities in SN/VTA responses to anticipating reward and anticipating novel stimuli. We suggest that this anticipatory response codes a motivational exploratory novelty signal that, together with anticipatory activation of the hippocampus, leads to enhanced encoding of novel events. In more general terms, the data suggest that dopaminergic processing of novelty might be important in driving exploration of new environments.

  5. Alterations of Monetary Reward and Punishment Processing in Chronic Cannabis Users: An fMRI Study

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were – in contrast to healthy controls – not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects. PMID:25799565

  6. Neural sensitivity to social reward and punishment anticipation in Social Anxiety Disorder.

    Directory of Open Access Journals (Sweden)

    Henk eCremers

    2015-01-01

    Full Text Available An imbalance in the neural motivational system may underlie Social Anxiety Disorder (SAD. This study examines social reward and punishment anticipation in SAD, predicting a valence-specific effect: increased striatal activity for punishment avoidance compared to obtaining a reward. Individuals with SAD (n=20 and age, gender, and education case-matched controls (n=20 participated in a functional magnetic resonance imaging (fMRI study. During fMRI scanning, participants performed a Social Incentive Delay task to measure the anticipation of social reward and punishment. The left putamen (part of the striatum showed a valence-specific interaction with group after correcting for medication use and comorbidity. The control group showed a relatively stronger activation for reward vs. punishment trials, compared to the social anxiety group. However, post-hoc pairwise comparisons were not significant, indicating that the effect is driven by a relative difference. A connectivity analysis (Psychophysiological interaction further revealed a general salience effect: SAD patients showed decreased putamen-ACC connectivity compared to controls for both reward and punishment trials. Together these results suggest that the usual motivational preference for social reward is absent in SAD. In addition, cortical control processes during social incentive anticipation may be disrupted in SAD. These results provide initial evidence for altered striatal involvement in both valence-specific and valence nonspecific processing of social incentives, and stress the relevance of taking motivational processes into account when studying social anxiety.

  7. Attention Diversion Improves Response Inhibition of Immediate Reward, But Only When it is Beneficial: An FMRI Study

    Directory of Open Access Journals (Sweden)

    Franco Scalzo

    2016-08-01

    Full Text Available Deficits of self-control are associated with a number of mental state disorders. The ability to direct attention away from an alluring stimulus appears to aid inhibition of an impulsive response. However, further functional imaging research is required to assess the impact of shifts in attention on self-regulating processes. We varied the level of attentional disengagement in an fMRI-based Go/No-go task to probe whether diversion of attention away from alluring stimuli facilitates response inhibition. We used the attention-grabbing characteristic of faces to exogenously direct attention away from stimuli and investigated the relative importance of attention and response inhibition mechanisms under different delayed reward scenarios (i.e., where forgoing an immediate reward ($1 led to a higher ($10 or no payoff in the future. We found that diverting attention improved response inhibition performance, but only when resistance to an alluring stimulus led to delayed reward. Region of interest analyses indicated significant increased activity in posterior right inferior frontal gyrus during successful No-go trials for delayed reward trials compared to no delayed reward trials, and significant reduction in activity in the superior temporal gyri and left caudate in contexts of high attentional diversion. Our findings imply that strategies that increase the perceived benefits of response inhibition might assist individuals to abstain from problematic impulsive behaviors.

  8. Individual Differences in Music Reward Experiences

    OpenAIRE

    Mas-Herrero, E.; Marco Pallarés, Josep; Lorenzo-Seva, U.; Zatorre, R.; Rodriguez-Fornells, A.

    2013-01-01

    Music is one of the most pleasant human experiences, even though it has no direct biological advantage. However little is known about individual differences in how people experience reward in music-related activities. The goal of the present study was to describe the main facets of music experience that could explain the variance observed in how people experience reward associated with music. To this end we developed the Barcelona Music Reward Questionnaire (BMRQ), which was administrated to ...

  9. Endocannabinoid signaling in reward and addiction

    OpenAIRE

    Parsons, Loren H.; Hurd, Yasmin L.

    2015-01-01

    Brain endocannabinoid signaling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated endocannabinoid signaling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired endocannabinoid signaling contributes to dysregulated synaptic plasticity, increased stress r...

  10. The Social Rewards of Engagement

    DEFF Research Database (Denmark)

    Robison, Joshua

    2017-01-01

    Political interest is a crucial precursor to political engagement, but little is known about how to stimulate greater interest. The article explores the role social motives have in generating interest. A laboratory experiment is used in which it is possible to manipulate beliefs about the social...... particularly strong among individuals with low levels of external efficacy. Ultimately, the data provide clear evidence that political interest can be positively stimulated with social rewards mobilisation techniques and that it is rooted in beliefs about the potential motives pursuable through politics...

  11. Impaired risk evaluation in people with Internet gaming disorder: fMRI evidence from a probability discounting task.

    Science.gov (United States)

    Lin, Xiao; Zhou, Hongli; Dong, Guangheng; Du, Xiaoxia

    2015-01-02

    This study examined how Internet gaming disorder (IGD) subjects modulating reward and risk at a neural level under a probability-discounting task with functional magnetic resonance imaging (fMRI). Behavioral and imaging data were collected from 19 IGD subjects (22.2 ± 3.08 years) and 21 healthy controls (HC, 22.8 ± 3.5 years). Behavior results showed that IGD subjects prefer the probabilistic options to fixed ones and were associated with shorter reaction time, when comparing to HC. The fMRI results revealed that IGD subjects show decreased activation in the inferior frontal gyrus and the precentral gyrus when choosing the probabilistic options than HC. Correlations were also calculated between behavioral performances and brain activities in relevant brain regions. Both of the behavioral performance and fMRI results indicate that people with IGD show impaired risk evaluation, which might be the reason why IGD subjects continue playing online games despite the risks of widely known negative consequence.

  12. Neural processing of reward in adolescent rodents

    Directory of Open Access Journals (Sweden)

    Nicholas W. Simon

    2015-02-01

    Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

  13. Maximize Producer Rewards in Distributed Windmill Environments: A Q-Learning Approach

    Directory of Open Access Journals (Sweden)

    Bei Li

    2015-03-01

    Full Text Available In Smart Grid environments, homes equipped with windmills are encouraged to generate energy and sell it back to utilities. Time of Use pricing and the introduction of storage devices would greatly influence a user in deciding when to sell back energy and how much to sell. Therefore, a study of sequential decision making algorithms that can optimize the total pay off for the user is necessary. In this paper, reinforcement learning is used to tackle this optimization problem. The problem of determining when to sell back energy is formulated as a Markov decision process and the model is learned adaptively using Q-learning. Experiments are done with varying sizes of storage capacities and under periodic energy generation rates of different levels of fluctuations. The results show a notable increase in discounted total rewards from selling back energy with the proposed approach.

  14. Perturbations in reward-related decision-making induced by reduced prefrontal cortical GABA transmission: Relevance for psychiatric disorders.

    Science.gov (United States)

    Piantadosi, Patrick T; Khayambashi, Shahin; Schluter, Magdalen G; Kutarna, Agnes; Floresco, Stan B

    2016-02-01

    The prefrontal cortex (PFC) is critical for higher-order cognitive functions, including decision-making. In psychiatric conditions such as schizophrenia, prefrontal dysfunction co-occurs with pronounced alterations in decision-making ability. These alterations include a diminished ability to utilize probabilistic reinforcement in guiding future choice, and a reduced willingness to expend effort to receive reward. Among the neurochemical abnormalities observed in the PFC of individuals with schizophrenia are alterations in the production and function of the inhibitory neurotransmitter gamma-aminobutyric acid (GABA). To probe how PFC GABA hypofunction may contribute to alterations in cost/benefit decision-making, we assessed the effects GABAA-receptor antagonist bicuculline (BIC; 50 ng in 0.5 μl saline/hemisphere) infusion in the medial PFC of rats during performance on a series of well-validated cost/benefit decision-making tasks. Intra-PFC BIC reduced risky choice and reward sensitivity during probabilistic discounting and decreased the preference for larger rewards associated with a greater effort cost, similar to the behavioral sequelae observed in schizophrenia. Additional experiments revealed that these treatments did not alter instrumental responding on a progressive ratio schedule, nor did they impair the ability to discriminate between reward and no reward. However, BIC induced a subtle but consistent impairment in preference for larger vs. smaller rewards of equal cost. BIC infusion also increased decision latencies and impaired the ability to "stay on task" as indexed by reduced rates of instrumental responding. Collectively, these results implicate prefrontal GABAergic dysfunction as a key contributing factor to abnormal decision-making observed in schizophrenia and other neuropsychiatric conditions with similar neurobiological and behavioral alterations.

  15. A model of reward choice based on the theory of reinforcement learning.

    Science.gov (United States)

    Smirnitskaya, I A; Frolov, A A; Merzhanova, G Kh

    2008-03-01

    A model explaining behavioral "impulsivity" and "self-control" is proposed on the basis of the theory of reinforcement learning. The discount coefficient gamma, which in this theory accounts for the subjective reduction in the value of a delayed reinforcement, is identified with the overall level of dopaminergic neuron activity which, according to published data, also determines the behavioral variant. Computer modeling showed that high values of gamma are characteristic of predominantly "self-controlled" subjects, while smaller values of gamma are characteristic of "impulsive" subjects.

  16. Social Influences on Creativity: Interactive Effects of Reward and Choice.

    Science.gov (United States)

    Amabile, Teresa M.

    In a test of intrinsic motivation hypothesis of creativity, 60 undergraduate women did an artistic creativity task with either the expectation of receiving a reward or no expectation of reward. Reward was crossed with choice in task engagement, such that half of the reward Ss contracted to do the task in order to receive reward, and half simply…

  17. Harnessing the uncertainty monster: Putting quantitative constraints on the intergenerational social discount rate

    Science.gov (United States)

    Lewandowsky, Stephan; Freeman, Mark C.; Mann, Michael E.

    2017-09-01

    There is broad consensus among economists that unmitigated climate change will ultimately have adverse global economic consequences, that the costs of inaction will likely outweigh the cost of taking action, and that social planners should therefore put a price on carbon. However, there is considerable debate and uncertainty about the appropriate value of the social discount rate, that is the extent to which future damages should be discounted relative to mitigation costs incurred now. We briefly review the ethical issues surrounding the social discount rate and then report a simulation experiment that constrains the value of the discount rate by considering 4 sources of uncertainty and ambiguity: Scientific uncertainty about the extent of future warming, social uncertainty about future population and future economic development, political uncertainty about future mitigation trajectories, and ethical ambiguity about how much the welfare of future generations should be valued today. We compute a certainty-equivalent declining discount rate that accommodates all those sources of uncertainty and ambiguity. The forward (instantaneous) discount rate converges to a value near 0% by century's end and the spot (horizon) discount rate drops below 2% by 2100 and drops below previous estimates by 2070.

  18. Reward and non-reward learning of flower colours in the butterfly Byasa alcinous (Lepidoptera: Papilionidae)

    Science.gov (United States)

    Kandori, Ikuo; Yamaki, Takafumi

    2012-09-01

    Learning plays an important role in food acquisition for a wide range of insects. To increase their foraging efficiency, flower-visiting insects may learn to associate floral cues with the presence (so-called reward learning) or the absence (so-called non-reward learning) of a reward. Reward learning whilst foraging for flowers has been demonstrated in many insect taxa, whilst non-reward learning in flower-visiting insects has been demonstrated only in honeybees, bumblebees and hawkmoths. This study examined both reward and non-reward learning abilities in the butterfly Byasa alcinous whilst foraging among artificial flowers of different colours. This butterfly showed both types of learning, although butterflies of both sexes learned faster via reward learning. In addition, females learned via reward learning faster than males. To the best of our knowledge, these are the first empirical data on the learning speed of both reward and non-reward learning in insects. We discuss the adaptive significance of a lower learning speed for non-reward learning when foraging on flowers.

  19. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats

    Directory of Open Access Journals (Sweden)

    Howes Nathan J

    2005-05-01

    Full Text Available Abstract Background Animals must frequently make choices between alternative courses of action, seeking to maximize the benefit obtained. They must therefore evaluate the magnitude and the likelihood of the available outcomes. Little is known of the neural basis of this process, or what might predispose individuals to be overly conservative or to take risks excessively (avoiding or preferring uncertainty, respectively. The nucleus accumbens core (AcbC is known to contribute to rats' ability to choose large, delayed rewards over small, immediate rewards; AcbC lesions cause impulsive choice and an impairment in learning with delayed reinforcement. However, it is not known how the AcbC contributes to choice involving probabilistic reinforcement, such as between a large, uncertain reward and a small, certain reward. We examined the effects of excitotoxic lesions of the AcbC on probabilistic choice in rats. Results Rats chose between a single food pellet delivered with certainty (p = 1 and four food pellets delivered with varying degrees of uncertainty (p = 1, 0.5, 0.25, 0.125, and 0.0625 in a discrete-trial task, with the large-reinforcer probability decreasing or increasing across the session. Subjects were trained on this task and then received excitotoxic or sham lesions of the AcbC before being retested. After a transient period during which AcbC-lesioned rats exhibited relative indifference between the two alternatives compared to controls, AcbC-lesioned rats came to exhibit risk-averse choice, choosing the large reinforcer less often than controls when it was uncertain, to the extent that they obtained less food as a result. Rats behaved as if indifferent between a single certain pellet and four pellets at p = 0.32 (sham-operated or at p = 0.70 (AcbC-lesioned by the end of testing. When the probabilities did not vary across the session, AcbC-lesioned rats and controls strongly preferred the large reinforcer when it was certain, and strongly

  20. Cognitive processing of food rewards.

    Science.gov (United States)

    Higgs, Suzanne

    2016-09-01

    Cues associated with tasty foods, such as their smell or taste, are strong motivators of eating, but the power of food cues on behaviour varies from moment to moment and from person to person. Variation in the rewarding value of a food with metabolic state explains why food cues are more attractive when hungry. However, cognitive processes are also important determinants of our responses to food cues. An urge to consume a tempting food may be resisted if, for example, a person has a longer term goal of weight loss. There is also evidence that responses to food cues can be facilitated or inhibited by memory processes. The aim of this review is to add to the literature on cognitive control of eating by reviewing recent evidence on the influence of working memory and episodic memory processes on responses to food cues. It is argued that processing of food information in working memory affects how much attention is paid to food cues in the environment and promotes the motivation to seek out food in the absence of direct contact with food cues. It is further argued that memories of specific recent eating episodes play an important role in directing food choices and influencing when and how much we eat. However, these memory processes are prone to disruption. When this happens, eating behaviour may become more cue-driven and less flexible. In the modern food environment, disruption of cognitive processing of food reward cues may lead to overconsumption and obesity.

  1. Reward guides vision when it's your thing: trait reward-seeking in reward-mediated visual priming.

    Directory of Open Access Journals (Sweden)

    Clayton Hickey

    Full Text Available Reward-related mesolimbic dopamine is thought to play an important role in guiding animal behaviour, biasing approach towards potentially beneficial environmental stimuli and away from objects unlikely to garner positive outcome. This is considered to result in part from an impact on perceptual and attentional processes: dopamine initiates a series of cognitive events that result in the priming of reward-associated perceptual features. We have provided behavioural and electrophysiological evidence that this mechanism guides human vision in search, an effect we refer to as reward priming. We have also demonstrated that there is substantial individual variability in this effect. Here we show that behavioural differences in reward priming are predicted remarkably well by a personality index that captures the degree to which a person's behaviour is driven by reward outcome. Participants with reward-seeking personalities are found to be those who allocate visual resources to objects characterized by reward-associated visual features. These results add to a rapidly developing literature demonstrating the crucial role reward plays in attentional control. They additionally illustrate the striking impact personality traits can have on low-level cognitive processes like perception and selective attention.

  2. Coordinated Lot-sizing and Dynamic Prizing under a Supplier All-units Quantity Discount

    Directory of Open Access Journals (Sweden)

    Sandra Transchel

    2008-05-01

    Full Text Available We consider an economic order quantity model where the supplier offers an all-units quantity discount and a price sensitive customer demand. We compare a decentralized decision framework where selling price and replenishment policy are determined independently to simultaneous decision making. Constant and dynamic pricing are distinguished. We derive structural properties and develop algorithms that determine the optimal pricing and replenishment policy and show how quantity discounts not only influence the purchasing strategy but also the pricing policy. A sensitivity analysis indicates the impact of the fixed-holding cost ratio, the discount policy, and the customers' price sensitivity on the optimal decisions.

  3. An analysis of the influence of discount sales promotion in consumer buying intent and the moderating effects of attractiveness

    Directory of Open Access Journals (Sweden)

    Fernando de Oliveira Santini

    2015-12-01

    Full Text Available ABSTRACT The purpose of this paper is to analyze the influence of discount sales promotion in the purchase intention and the moderating effects of attractiveness in the relationship between intention to purchase a discounted product and the impulsiveness, hedonic perception and financial risk. Thus, an experiment involving 613 students was conducted. The hypotheses predicted that a product with discount promotion would relate positively with impulsivity, as well as with a hedonic perception about the good offered, and negatively with the perception of financial risk associated with the product offered with discount. A positive moderation was expected of the perceived attractiveness of the announced discount promotion on the intentions of behaviors. The results confirmed the hypothesis, indicating positive effects of impulsivity and hedonic perception by purchasing the discounted products, in addition to the negative link between the intention of purchasing discounted products and the perception of a financial risk. The moderating effects were not confirmed. Final considerations conclude the work.

  4. Modelling and analysis of Markov reward automata

    NARCIS (Netherlands)

    Guck, Dennis; Timmer, Mark; Hatefi, Hassan; Ruijters, Enno; Stoelinga, Mariëlle

    2014-01-01

    Costs and rewards are important ingredients for many types of systems, modelling critical aspects like energy consumption, task completion, repair costs, and memory usage. This paper introduces Markov reward automata, an extension of Markov automata that allows the modelling of systems incorporating

  5. Self-rewards and personal motivation

    NARCIS (Netherlands)

    Koch, A.K.; Nafziger, J.; Suvorov, A.; van de Ven, J.

    2014-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool to

  6. Resource Allocation Problems with Concave Reward Functions

    NARCIS (Netherlands)

    Grundel, S.; Borm, P.E.M.; Hamers, H.J.M.

    2013-01-01

    Abstract: In a resource allocation problem there is a common-pool resource, which has to be divided among agents. Each agent is characterized by a claim on this pool and an individual concave reward function on assigned resources. An assignment of resources is optimal if the total joint reward is ma

  7. Video game training and the reward system.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  8. The Risks and Rewards of Sexual Debut

    Science.gov (United States)

    Golden, Rachel Lynn; Furman, Wyndol; Collibee, Charlene

    2016-01-01

    The sex-positive framework of sexual development hypothesizes that healthy sexual experiences can be developmentally appropriate and rewarding for adolescents despite the risks involved. Research has not examined whether risky behaviors and rewarding cognitions actually change with sexual debut at a normative or late age. This study measured the…

  9. Status Characteristics, Reward Allocation, and Equity

    Science.gov (United States)

    Parcel, Toby L.; Cook, Karen S.

    1977-01-01

    The relationship between a group's power and prestige or status hierarchy and group members' patterns of reward allocation was investigated. The addition of evidence concerning actual task performance results in the alignment of reward and status rankings and encourages the use of distribution rules stressing equity as opposed to equality.…

  10. Performance-Based Rewards and Work Stress

    Science.gov (United States)

    Ganster, Daniel C.; Kiersch, Christa E.; Marsh, Rachel E.; Bowen, Angela

    2011-01-01

    Even though reward systems play a central role in the management of organizations, their impact on stress and the well-being of workers is not well understood. We review the literature linking performance-based reward systems to various indicators of employee stress and well-being. Well-controlled experiments in field settings suggest that certain…

  11. Video Game Training and the Reward System

    Directory of Open Access Journals (Sweden)

    Robert C. Lorenz

    2015-02-01

    Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  12. Reward Magnitude Effects on Temporal Discrimination

    Science.gov (United States)

    Galtress, Tiffany; Kirkpatrick, Kimberly

    2010-01-01

    Changes in reward magnitude or value have been reported to produce effects on timing behavior, which have been attributed to changes in the speed of an internal pacemaker in some instances and to attentional factors in other cases. The present experiments therefore aimed to clarify the effects of reward magnitude on timing processes. In Experiment…

  13. Self-rewards and personal motivation

    DEFF Research Database (Denmark)

    Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

    2014-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool to over...

  14. Self-Rewards and Personal Motivation

    DEFF Research Database (Denmark)

    Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool to over...

  15. Performance-Based Rewards and Work Stress

    Science.gov (United States)

    Ganster, Daniel C.; Kiersch, Christa E.; Marsh, Rachel E.; Bowen, Angela

    2011-01-01

    Even though reward systems play a central role in the management of organizations, their impact on stress and the well-being of workers is not well understood. We review the literature linking performance-based reward systems to various indicators of employee stress and well-being. Well-controlled experiments in field settings suggest that certain…

  16. Effects of Extrinsic Rewards on Intrinsic Motivation in the Classroom.

    Science.gov (United States)

    Workman, Edward A.; Williams, Robert L.

    1980-01-01

    Reviews classroom behavior management studies to see if extrinsic rewards affect intrinsic reinforcement value of appropriate classroom behaviors. Conclusion indicates extrinsic rewards are useful. Teachers need not avoid the use of rewards in fear of undermining intrinsic interest. (LAB)

  17. Effects of Extrinsic Rewards on Intrinsic Motivation in the Classroom.

    Science.gov (United States)

    Workman, Edward A.; Williams, Robert L.

    1980-01-01

    Reviews classroom behavior management studies to see if extrinsic rewards affect intrinsic reinforcement value of appropriate classroom behaviors. Conclusion indicates extrinsic rewards are useful. Teachers need not avoid the use of rewards in fear of undermining intrinsic interest. (LAB)

  18. Serotonergic modulation of reward and punishment

    DEFF Research Database (Denmark)

    Macoveanu, Julian

    2014-01-01

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line...... of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions......-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor...

  19. Feast your eyes: hunger and trait reward drive predict attentional bias for food cues.

    Science.gov (United States)

    Tapper, Katy; Pothos, Emmanuel M; Lawrence, Andrew D

    2010-12-01

    Appraisal theories of emotion predict that the relevance of a stimulus to a person's needs and goals influences attentional allocation. We used a modified visual probe task to examine the influence of hunger and trait reward drive on food-related attentional bias. Both hunger and trait reward drive predicted degree of attentional "disengagement" from food images at short (100 ms), but not long (500, 2,000 ms) stimulus durations. Effects of hunger were found for both bland and appetizing foods, while effects of reward drive were restricted to appetizing foods. Our findings extend previous research showing delayed "disengagement" from threat-related stimuli, suggesting that both organismic- and goal-relevance are key biasing factors in attentional competition.

  20. Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder.

    Science.gov (United States)

    Ströhle, Andreas; Stoy, Meline; Wrase, Jana; Schwarzer, Steffi; Schlagenhauf, Florian; Huss, Michael; Hein, Jakob; Nedderhut, Anke; Neumann, Britta; Gregor, Andreas; Juckel, Georg; Knutson, Brian; Lehmkuhl, Ulrike; Bauer, Michael; Heinz, Andreas

    2008-02-01

    Attention-deficit/hyperactivity disorder (ADHD) has been suggested to involve deficits in reward processing. We used functional magnetic resonance imaging (fMRI) to compare the neural responses to reward anticipation and outcomes in 10 adults with ADHD and 10 controls as they played a monetary incentive delay task. Adults with ADHD were unmedicated, and groups were matched for age, verbal IQ and smoking habits. Adults with ADHD showed decreased activation in the ventral striatum during the anticipation of gain, but increased activation of the orbitofrontal cortex in response to gain outcomes. Ventral striatal activation in adults with ADHD during gain anticipation was negatively correlated with self-rated symptoms of hyperactivity and impulsivity. These findings suggest that male adults with ADHD show neural signs of abnormal reward processing. Future studies will have to investigate whether these dysfunctional patterns might be normalized by treatment.

  1. Reward sensitivity and food addiction in women.

    Science.gov (United States)

    Loxton, Natalie J; Tipman, Renée J

    2016-10-15

    Sensitivity to the rewarding properties of appetitive substances has long been implicated in excessive consumption of palatable foods and drugs of abuse. Previous research focusing on individual differences in reward responsiveness has found heightened trait reward sensitivity to be associated with binge-eating, hazardous drinking, and illicit substance use. Food addiction has been proposed as an extreme form of compulsive-overeating and has been associated with genetic markers of heightened reward responsiveness. However, little research has explicitly examined the association between reward sensitivity and food addiction. Further, the processes by which individual differences in this trait are associated with excessive over-consumption has not been determined. A total of 374 women from the community completed an online questionnaire assessing reward sensitivity, food addiction, emotional, externally-driven, and hedonic eating. High reward sensitivity was significantly associated with greater food addiction symptoms (r = 0.31). Bootstrapped tests of indirect effects found the relationship between reward sensitivity and food addiction symptom count to be uniquely mediated by binge-eating, emotional eating, and hedonic eating (notably, food availability). These indirect effects held even when controlling for BMI, anxiety, depression, and trait impulsivity. This study further supports the argument that high levels of reward sensitivity may offer a trait marker of vulnerability to excessive over-eating, beyond negative affect and impulse-control deficits. That the hedonic properties of food (especially food availability), emotional, and binge-eating behavior act as unique mediators suggest that interventions for reward-sensitive women presenting with food addiction may benefit from targeting food availability in addition to management of negative affect.

  2. Touch massage, a rewarding experience.

    Science.gov (United States)

    Lindgren, Lenita; Jacobsson, Maritha; Lämås, Kristina

    2014-12-01

    This study aims to describe and analyze healthy individuals' expressed experiences of touch massage (TM). Fifteen healthy participants received whole body touch massage during 60 minutes for two separate occasions. Interviews were analyzed by narrative analysis. Four identifiable storyline was found, Touch massage as an essential need, in this storyline the participants talked about a desire and need for human touch and TM. Another storyline was about, Touch massage as a pleasurable experience and the participants talked about the pleasure of having had TM. In the third storyline Touch massage as a dynamic experience, the informants talked about things that could modulate the experience of receiving TM. In the last storyline, Touch massage influences self-awareness, the participants described how TM affected some of their psychological and physical experiences. Experiences of touch massage was in general described as pleasant sensations and the different storylines could be seen in the light of rewarding experiences. © The Author(s) 2014.

  3. Study Discounts Myth of 'Patient Zero' in U.S. AIDS Crisis

    Science.gov (United States)

    ... Study Discounts Myth of 'Patient Zero' in U.S. AIDS Crisis Genetic analysis of 40-year-old blood ... in North America of the virus that causes AIDS. One myth already debunked by the research: That ...

  4. Intense sweetness surpasses cocaine reward.

    Directory of Open Access Journals (Sweden)

    Magalie Lenoir

    Full Text Available BACKGROUND: Refined sugars (e.g., sucrose, fructose were absent in the diet of most people until very recently in human history. Today overconsumption of diets rich in sugars contributes together with other factors to drive the current obesity epidemic. Overconsumption of sugar-dense foods or beverages is initially motivated by the pleasure of sweet taste and is often compared to drug addiction. Though there are many biological commonalities between sweetened diets and drugs of abuse, the addictive potential of the former relative to the latter is currently unknown. METHODOLOGY/PRINCIPAL FINDINGS: Here we report that when rats were allowed to choose mutually-exclusively between water sweetened with saccharin-an intense calorie-free sweetener-and intravenous cocaine-a highly addictive and harmful substance-the large majority of animals (94% preferred the sweet taste of saccharin. The preference for saccharin was not attributable to its unnatural ability to induce sweetness without calories because the same preference was also observed with sucrose, a natural sugar. Finally, the preference for saccharin was not surmountable by increasing doses of cocaine and was observed despite either cocaine intoxication, sensitization or intake escalation-the latter being a hallmark of drug addiction. CONCLUSIONS: Our findings clearly demonstrate that intense sweetness can surpass cocaine reward, even in drug-sensitized and -addicted individuals. We speculate that the addictive potential of intense sweetness results from an inborn hypersensitivity to sweet tastants. In most mammals, including rats and humans, sweet receptors evolved in ancestral environments poor in sugars and are thus not adapted to high concentrations of sweet tastants. The supranormal stimulation of these receptors by sugar-rich diets, such as those now widely available in modern societies, would generate a supranormal reward signal in the brain, with the potential to override self

  5. Regret Expression and Social Learning Increases Delay to Sexual Gratification.

    Directory of Open Access Journals (Sweden)

    Amanda J Quisenberry

    Full Text Available Modification and prevention of risky sexual behavior is important to individuals' health and public health policy. This study employed a novel sexual discounting task to elucidate the effects of social learning and regret expression on delay to sexual gratification in a behavioral task.Amazon Mechanical Turk Workers were assigned to hear one of three scenarios about a friend who engages in similar sexual behavior. The scenarios included a positive health consequence, a negative health consequence or a negative health consequence with the expression of regret. After reading one scenario, participants were asked to select from 60 images, those with whom they would have casual sex. Of the selected images, participants chose one image each for the person they most and least want to have sex with and person most and least likely to have a sexually transmitted infection. They then answered questions about engaging in unprotected sex now or waiting some delay for condom-protected sex in each partner condition.Results indicate that the negative health outcome scenario with regret expression resulted in delayed sexual gratification in the most attractive and least STI partner conditions, whereas in the least attractive and most STI partner conditions the negative health outcome with and without regret resulted in delayed sexual gratification.Results suggest that the sexual discounting task is a relevant laboratory measure and the framing of information to include regret expression may be relevant for prevention of risky sexual behavior.

  6. Intergenerational Justice: How Reasonable Man Discounts Climate Damage

    Directory of Open Access Journals (Sweden)

    Marc D. Davidson

    2012-01-01

    Full Text Available Moral philosophers and economists have evaluated the intergenerational problem of climate change by applying the whole gamut of theories on distributive justice. In this article, however, it is argued that intergenerational justice cannot imply the application of moral ideal theories to future generations. The formal principle of equality simply requires us to treat like cases as like. If intergenerational justice is to have any meaning, it would require future generations to receive the same treatment under the law and the same treatment from the authorities, as far as cases are like. In the context of climate change, the reasonable man standard from tort law is of particular relevance. There is no justification to handle pollution across generational boundaries according to norms which differ from the (international laws for handling pollution across national borders. It is argued that this implies, for example, that a zero social rate of time preference should be used in cost-benefit analysis of climate policy: climate damage experienced by future generations should be discounted neither for their higher expected wealth, nor purely for their being remote.

  7. Escaping the repugnant conclusion: rank-discounted utilitarianism with variable population

    OpenAIRE

    Asheim, Geir Bjarne; Zuber, Stéphane

    2014-01-01

    We contribute to population ethics by proposing and axiomatizing rank-discounted critical-level generalized utilitarianism (RDCLU). Population ethics is needed for evaluation of policies, e.g., concerning climate change, where population size depends on the chosen policy. We show that critical-level generalized utilitarianism and (a version of) critical-level leximin are the limits of RDCLU for extreme values of the rank utility discount factor. Moreover, we establish how RDCLU avoids serious...

  8. Optimal harvesting of fish stocks under a time-varying discount rate.

    Science.gov (United States)

    Duncan, Stephen; Hepburn, Cameron; Papachristodoulou, Antonis

    2011-01-21

    Optimal control theory has been extensively used to determine the optimal harvesting policy for renewable resources such as fish stocks. In such optimisations, it is common to maximise the discounted utility of harvesting over time, employing a constant time discount rate. However, evidence from human and animal behaviour suggests that we have evolved to employ discount rates which fall over time, often referred to as "hyperbolic discounting". This increases the weight on benefits in the distant future, which may appear to provide greater protection of resources for future generations, but also creates challenges of time-inconsistent plans. This paper examines harvesting plans when the discount rate declines over time. With a declining discount rate, the planner reduces stock levels in the early stages (when the discount rate is high) and intends to compensate by allowing the stock level to recover later (when the discount rate will be lower). Such a plan may be feasible and optimal, provided that the planner remains committed throughout. However, in practice there is a danger that such plans will be re-optimized and adjusted in the future. It is shown that repeatedly restarting the optimization can drive the stock level down to the point where the optimal policy is to harvest the stock to extinction. In short, a key contribution of this paper is to identify the surprising severity of the consequences flowing from incorporating a rather trivial, and widely prevalent, "non-rational" aspect of human behaviour into renewable resource management models. These ideas are related to the collapse of the Peruvian anchovy fishery in the 1970's. Copyright © 2010 Elsevier Ltd. All rights reserved.

  9. Understanding the Impact of Online Reviews on Customer Choice: A Probability Discounting Approach

    OpenAIRE

    Fagerstrøm, A; Ghinea, G; Sydnes, L

    2016-01-01

    This study uses the concept of probability discounting to understand the impact of online customer reviews on consumer choice. Probability discounting describes how the subjective value of an outcome alters when its delivery shifts from certain to uncertain. An experimental study with 29 participants was conducted. Participants were run through an online shopping scenario where they had to choose whether to buy a product from a Web shop with customer reviews on reliability or from a Web shop ...

  10. Discounted cash flow valuation methods: Examples of perpetuities, constant growth and general case

    OpenAIRE

    Fernandez, Pablo

    2005-01-01

    This paper explores the discounted cash flow valuation methods. We start the paper with the simplest case: no-growth, perpetual-life companies. Then we will study the continuous growth case and, finally, the general case. The different concepts of cash flow used in company valuation are defined: equity cash flow (ECF), free cash flow (FCF), and capital cash flow (CCF). Then the appropriate discount rate is determined for each cash flow, depending on the valuation method used. Our starting poi...

  11. Discounted cash flow valuation methods: Examples of perpetuities, constant growth and general case

    OpenAIRE

    Fernandez, Pablo

    2005-01-01

    This paper explores the discounted cash flow valuation methods. We start the paper with the simplest case: no-growth, perpetual-life companies. Then we will study the continuous growth case and, finally, the general case. The different concepts of cash flow used in company valuation are defined: equity cash flow (ECF), free cash flow (FCF), and capital cash flow (CCF). Then the appropriate discount rate is determined for each cash flow, depending on the valuation method used. Our starting poi...

  12. What makes a reach movement effortful? Physical effort discounting supports common minimization principles in decision making and motor control.

    Science.gov (United States)

    Morel, Pierre; Ulbrich, Philipp; Gail, Alexander

    2017-06-01

    When deciding between alternative options, a rational agent chooses on the basis of the desirability of each outcome, including associated costs. As different options typically result in different actions, the effort associated with each action is an essential cost parameter. How do humans discount physical effort when deciding between movements? We used an action-selection task to characterize how subjective effort depends on the parameters of arm transport movements and controlled for potential confounding factors such as delay discounting and performance. First, by repeatedly asking subjects to choose between 2 arm movements of different amplitudes or durations, performed against different levels of force, we identified parameter combinations that subjects experienced as identical in effort (isoeffort curves). Movements with a long duration were judged more effortful than short-duration movements against the same force, while movement amplitudes did not influence effort. Biomechanics of the movements also affected effort, as movements towards the body midline were preferred to movements away from it. Second, by introducing movement repetitions, we further determined that the cost function for choosing between effortful movements had a quadratic relationship with force, while choices were made on the basis of the logarithm of these costs. Our results show that effort-based action selection during reaching cannot easily be explained by metabolic costs. Instead, force-loaded reaches, a widely occurring natural behavior, imposed an effort cost for decision making similar to cost functions in motor control. Our results thereby support the idea that motor control and economic choice are governed by partly overlapping optimization principles.

  13. Reward-based learning under hardware constraints - Using a RISC processor embedded in a neuromorphic substrate

    Directory of Open Access Journals (Sweden)

    Simon eFriedmann

    2013-09-01

    Full Text Available In this study, we propose and analyze in simulations a new, highly flexible method of imple-menting synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. Thestudy focuses on globally modulated STDP, as a special use-case of this method. Flexibility isachieved by embedding a general-purpose processor dedicated to plasticity into the wafer. Toevaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spiketrain learning task. A single layer of neurons is trained to fire at specific points in time withonly the reward as feedback. This model is simulated to measure its performance, i.e. the in-crease in received reward after learning. Using this performance as baseline, we then simulatethe model with various constraints imposed by the proposed implementation and compare theperformance. The simulated constraints include discretized synaptic weights, a restricted inter-face between analog synapses and embedded processor, and mismatch of analog circuits. Wefind that probabilistic updates can increase the performance of low-resolution weights, a simpleinterface between analog synapses and processor is sufficient for learning, and performance isinsensitive to mismatch. Further, we consider communication latency between wafer and theconventional control computer system that is simulating the environment. This latency increasesthe delay, with which the reward is sent to the embedded processor. Because of the time continu-ous operation of the analog synapses, delay can cause a deviation of the updates as compared tothe not delayed situation. We find that for highly accelerated systems latency has to be kept to aminimum. This study demonstrates the suitability of the proposed implementation to emulatethe selected reward modulated STDP learning rule. It is therefore an ideal candidate for imple-mentation in an upgraded version of the wafer-scale system developed within the BrainScaleSproject.

  14. Acute stress selectively reduces reward sensitivity

    Directory of Open Access Journals (Sweden)

    Lisa H Berghorst

    2013-04-01

    Full Text Available Stress may promote the onset of psychopathology by disrupting reward processing. However, the extent to which stress impairs reward processing, rather than incentive processing more generally, is unclear. To evaluate the specificity of stress-induced reward processing disruption, 100 psychiatrically healthy females were administered a probabilistic stimulus selection task enabling comparison of sensitivity to reward-driven (Go and punishment-driven (NoGo learning under either ‘no stress’ or ‘stress’ (threat-of-shock conditions. Cortisol samples and self-report measures were collected. Contrary to hypotheses, the groups did not differ significantly in task performance or cortisol reactivity. However, further analyses focusing only on individuals under ‘stress’ who were high responders with regard to both cortisol reactivity and self-reported negative affect revealed reduced reward sensitivity relative to individuals tested in the ‘no stress’ condition; importantly, these deficits were reward-specific. Overall, findings provide preliminary evidence that stress-reactive individuals show diminished sensitivity to reward but not punishment under stress. While such results highlight the possibility that stress-induced anhedonia might be an important mechanism linking stress to affective disorders, future studies are necessary to confirm this conjecture.

  15. Reinforcement Learning by Comparing Immediate Reward

    CERN Document Server

    Pandey, Punit; Kumar, Shishir

    2010-01-01

    This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate rewards using a variation of Q-Learning algorithm. Unlike the conventional Q-Learning, the proposed algorithm compares current reward with immediate reward of past move and work accordingly. Relative reward based Q-learning is an approach towards interactive learning. Q-Learning is a model free reinforcement learning method that used to learn the agents. It is observed that under normal circumstances algorithm take more episodes to reach optimal Q-value due to its normal reward or sometime negative reward. In this new form of algorithm agents select only those actions which have a higher immediate reward signal in comparison to previous one. The contribution of this article is the presentation of new Q-Learning Algorithm in order to maximize the performance of algorithm and reduce the number of episode required to reach optimal Q-value. Effectiveness of proposed algorithm is simulated in a 20 x20 Grid world dete...

  16. Prosocial reward learning in children and adolescents

    Directory of Open Access Journals (Sweden)

    Youngbin Kwak

    2016-10-01

    Full Text Available Adolescence is a period of increased sensitivity to social contexts. To evaluate how social context sensitivity changes over development – and influences reward learning – we investigated how children and adolescents perceive and integrate rewards for oneself and others during a dynamic risky-decision-making task. Children and adolescents (N=75, 8-16 yrs performed the Social Gambling Task (SGT, (Kwak et al., 2014 and completed a set of questionnaires measuring other-regarding behavior. In the SGT, participants choose amongst four card decks that have different payout structures for oneself and for a charity. We examined patterns of choices, overall decision strategies, and how reward outcomes led to trial-by-trial adjustments in behavior, as estimated using a reinforcement-learning model. Performance of children and adolescents was compared to data from a previously collected sample of adults (N=102 performing the identical task. We found that that children/adolescents were not only more sensitive to rewards directed to the charity than self but also showed greater prosocial tendencies on independent measures of other-regarding behavior. Children and adolescents also showed less use of a strategy that prioritizes rewards for self at the expense of rewards for others. These results support the conclusion that, compared to adults, children and adolescents show greater sensitivity to outcomes for others when making decisions and learning about potential rewards.

  17. Reward expectation influences audiovisual spatial integration.

    Science.gov (United States)

    Bruns, Patrick; Maiworm, Mario; Röder, Brigitte

    2014-08-01

    In order to determine the spatial location of an object that is simultaneously seen and heard, the brain assigns higher weights to the sensory inputs that provide the most reliable information. For example, in the well-known ventriloquism effect, the perceived location of a sound is shifted toward the location of a concurrent but spatially misaligned visual stimulus. This perceptual illusion can be explained by the usually much higher spatial resolution of the visual system as compared to the auditory system. Recently, it has been demonstrated that this cross-modal binding process is not fully automatic, but can be modulated by emotional learning. Here we tested whether cross-modal binding is similarly affected by motivational factors, as exemplified by reward expectancy. Participants received a monetary reward for precise and accurate localization of brief auditory stimuli. Auditory stimuli were accompanied by task-irrelevant, spatially misaligned visual stimuli. Thus, the participants' motivational goal of maximizing their reward was put in conflict with the spatial bias of auditory localization induced by the ventriloquist situation. Crucially, the amounts of expected reward differed between the two hemifields. As compared to the hemifield associated with a low reward, the ventriloquism effect was reduced in the high-reward hemifield. This finding suggests that reward expectations modulate cross-modal binding processes, possibly mediated via cognitive control mechanisms. The motivational significance of the stimulus material, thus, constitutes an important factor that needs to be considered in the study of top-down influences on multisensory integration.

  18. Using food as a reward: An examination of parental reward practices.

    Science.gov (United States)

    Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

    2017-09-23

    Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

  19. Abnormal striatal BOLD responses to reward anticipation and reward delivery in ADHD.

    Science.gov (United States)

    Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R; Bramati, Ivanei E; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A; Moll, Jorge

    2014-01-01

    Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD.

  20. Adolescents, adults and rewards: comparing motivational neurocircuitry recruitment using fMRI.

    Directory of Open Access Journals (Sweden)

    James M Bjork

    Full Text Available BACKGROUND: Adolescent risk-taking, including behaviors resulting in injury or death, has been attributed in part to maturational differences in mesolimbic incentive-motivational neurocircuitry, including ostensible oversensitivity of the nucleus accumbens (NAcc to rewards. METHODOLOGY/PRINCIPAL FINDINGS: To test whether adolescents showed increased NAcc activation by cues for rewards, or by delivery of rewards, we scanned 24 adolescents (age 12-17 and 24 adults age (22-42 with functional magnetic resonance imaging while they performed a monetary incentive delay (MID task. The MID task was configured to temporally disentangle potential reward or potential loss anticipation-related brain signal from reward or loss notification-related signal. Subjects saw cues signaling opportunities to win or avoid losing $0, $.50, or $5 for responding quickly to a subsequent target. Subjects then viewed feedback of their trial success after a variable interval from cue presentation of between 6 to 17 s. Adolescents showed reduced NAcc recruitment by reward-predictive cues compared to adult controls in a linear contrast with non-incentive cues, and in a volume-of-interest analysis of signal change in the NAcc. In contrast, adolescents showed little difference in striatal and frontocortical responsiveness to reward deliveries compared to adults. CONCLUSIONS/SIGNIFICANCE: In light of divergent developmental difference findings between neuroimaging incentive paradigms (as well as at different stages within the same task, these data suggest that maturational differences in incentive-motivational neurocircuitry: 1 may be sensitive to nuances of incentive tasks or stimuli, such as behavioral or learning contingencies, and 2 may be specific to the component of the instrumental behavior (such as anticipation versus notification.