WorldWideScience

Sample records for rewards differentially modulate

  1. Accelerated iTBS treatment in depressed patients differentially modulates reward system activity based on anhedonia.

    Science.gov (United States)

    Duprat, Romain; Wu, Guo-Rong; De Raedt, Rudi; Baeken, Chris

    2017-08-09

    Accelerated intermittent theta-burst stimulation (aiTBS) anti-depressive working mechanisms are still unclear. Because aiTBS may work through modulating the reward system and the level of anhedonia may influence this modulation, we investigated the effect of aiTBS on reward responsiveness in high and low anhedonic MDD patients. In this registered RCT (NCT01832805), 50 MDD patients were randomised to a sham-controlled cross-over aiTBS treatment protocol over the left dorsolateral prefrontal cortex (DLPFC). Patients performed a probabilistic learning task in fMRI before and after each week of stimulation. Task performance analyses did not show any significant effects of aiTBS on reward responsiveness, nor differences between both groups of MDD patients. However, at baseline, low anhedonic patients displayed higher neural activity in the caudate and putamen. After the first week of aiTBS treatment, in low anhedonic patients we found a decreased neural activity within the reward system, in contrast to an increased activity observed in high anhedonic patients. No changes were observed in reward related neural regions after the first week of sham stimulation. Although both MDD groups showed no differences in task performance, our brain imaging findings suggest that left DLPFC aiTBS treatment modulates the reward system differently according to anhedonia severity.

  2. Reward modulates perception in binocular rivalry.

    Science.gov (United States)

    Marx, Svenja; Einhäuser, Wolfgang

    2015-01-14

    Our perception does not provide us with an exact imprint of the outside world, but is continuously adapted to our internal expectations, task sets, and behavioral goals. Although effects of reward-or value in general-on perception therefore seem likely, how valuation modulates perception and how such modulation relates to attention is largely unknown. We probed effects of reward on perception by using a binocular-rivalry paradigm. Distinct gratings drifting in opposite directions were presented to each observer's eyes. To objectify their subjective perceptual experience, the optokinetic nystagmus was used as measure of current perceptual dominance. In a first experiment, one of the percepts was either rewarded or attended. We found that reward and attention similarly biased perception. In a second experiment, observers performed an attentionally demanding task either on the rewarded stimulus, the other stimulus, or both. We found that-on top of an attentional effect on perception-at each level of attentional load, reward still modulated perception by increasing the dominance of the rewarded percept. Similarly, penalizing one percept increased dominance of the other at each level of attentional load. In turn, rewarding-and similarly nonpunishing-a percept yielded performance benefits that are typically associated with selective attention. In conclusion, our data show that value modulates perception in a similar way as the volitional deployment of attention, even though the relative effect of value is largely unaffected by an attention task. © 2015 ARVO.

  3. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    Science.gov (United States)

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

  4. Reward-dependent modulation of movement variability.

    Science.gov (United States)

    Pekny, Sarah E; Izawa, Jun; Shadmehr, Reza

    2015-03-04

    Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. Copyright © 2015 the authors 0270-6474/15/354015-10$15.00/0.

  5. Reward-modulated motor information in identified striatum neurons.

    Science.gov (United States)

    Isomura, Yoshikazu; Takekawa, Takashi; Harukuni, Rie; Handa, Takashi; Aizawa, Hidenori; Takada, Masahiko; Fukai, Tomoki

    2013-06-19

    It is widely accepted that dorsal striatum neurons participate in either the direct pathway (expressing dopamine D1 receptors) or the indirect pathway (expressing D2 receptors), controlling voluntary movements in an antagonistically balancing manner. The D1- and D2-expressing neurons are activated and inactivated, respectively, by dopamine released from substantia nigra neurons encoding reward expectation. However, little is known about the functional representation of motor information and its reward modulation in individual striatal neurons constituting the two pathways. In this study, we juxtacellularly recorded the spike activity of single neurons in the dorsolateral striatum of rats performing voluntary forelimb movement in a reward-predictable condition. Some of these neurons were identified morphologically by a combination of juxtacellular visualization and in situ hybridization for D1 mRNA. We found that the striatal neurons exhibited distinct functional activations before and during the forelimb movement, regardless of the expression of D1 mRNA. They were often positively, but rarely negatively, modulated by expecting a reward for the correct motor response. The positive reward modulation was independent of behavioral differences in motor performance. In contrast, regular-spiking and fast-spiking neurons in any layers of the motor cortex displayed only minor and unbiased reward modulation of their functional activation in relation to the execution of forelimb movement. Our results suggest that the direct and indirect pathway neurons cooperatively rather than antagonistically contribute to spatiotemporal control of voluntary movements, and that motor information is subcortically integrated with reward information through dopaminergic and other signals in the skeletomotor loop of the basal ganglia.

  6. Monetary rewards modulate inhibitory control

    Directory of Open Access Journals (Sweden)

    Paula Marcela Herrera

    2014-05-01

    Full Text Available The ability to override a dominant response, often referred to as behavioural inhibiton, is considered a key element of executive cognition. Poor behavioural inhibition is a defining characteristic of several neurological and psychiatric populations. Recently, there has been increasing interest in the motivational dimension of behavioural inhibition, with some experiments incorporating emotional contingencies in classical inhibitory paradigms such as the Go/Nogo and Stop Signal Tasks. Several studies have reported a positive modulatory effect of reward on the performance of such tasks in pathological conditions such as substance abuse, pathological gambling, and ADHD. However, experiments that directly investigate the modulatory effects of reward magnitudes on the performance of inhibitory paradigms are rare and consequently, little is known about the finer grained relationship between motivation and self-control. Here, we probed the effect of reward and reward magnitude on behavioural inhibition using two modified version of the widely used Stop Signal Task. The first task compared no reward with reward, whilst the other compared two different reward magnitudes. The reward magnitude effect was confirmed by the second study, whereas it was less compelling in the first study, possibly due to the effect of having no reward in some conditions. In addition, our results showed a kick start effect over global performance measures. More specifically, there was a long lasting improvement in performance throughout the task, when participants received the highest reward magnitudes at the beginning of the protocol. These results demonstrate that individuals’ behavioural inhibition capacities are dynamic not static because they are modulated by the reward magnitude and initial reward history of the task at hand.

  7. Motivational orientation modulates the neural response to reward.

    Science.gov (United States)

    Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

    2010-02-01

    Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

  8. Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity

    Directory of Open Access Journals (Sweden)

    Ioan eOpris

    2011-05-01

    Full Text Available Although reward probability is an important factor that shapes animal behavior, it is not well understood however, how the primate brain translates reward expectation into the vigor of movement (reaction time and speed. To address this question, we trained two monkeys in a reaction time task that required wrist movements in response to vibrotactile and visual stimuli, with a variable reward schedule. Correct performance was rewarded in 75 % of the trials. Monkeys were certain that they would be rewarded only in the trials immediately following withheld rewards. In these trials, the animals responded sooner and moved faster. Single-unit recordings from the dorsal striatum revealed that modulations in striatal neurons reflected such modulations of movement vigor. First, in the trials with certain rewards, striatal neurons modulated their firing rates earlier. Second, magnitudes of changes in neuronal firing rates depended on whether or not monkeys were certain about the reward. Third, these modulations depended on the sensory modality of the cue (visual vs. vibratory and/or movement direction (flexions vs. extensions. We conclude that dorsal striatum may be a part of the mechanism responsible for the modulation of movement vigor in response to changes of reward predictability.

  9. Reward-dependent modulation of working memory in lateral prefrontal cortex.

    Science.gov (United States)

    Kennerley, Steven W; Wallis, Jonathan D

    2009-03-11

    Although research implicates lateral prefrontal cortex (PFC) in executive control and goal-directed behavior, it remains unclear how goals influence executive processes. One possibility is that goal-relevant information, such as expected rewards, could modulate the representation of information relating to executive control, thereby ensuring the efficient allocation of cognitive resources. To investigate this, we examined how reward modulated spatial working memory. Past studies investigating spatial working memory have focused on dorsolateral PFC, but this area only weakly connects with areas processing reward. Ventrolateral PFC has better connections in this regard. Thus, we contrasted the functional properties of single neurons in ventrolateral and dorsolateral PFC as two subjects performed a task that required them to hold spatial information in working memory under different expectancies of reward for correct performance. We balanced the order of presentation of spatial and reward information so we could assess the neuronal encoding of the two pieces of information independently and conjointly. Neurons in ventrolateral PFC encoded both spatial and reward information earlier, stronger and in a more sustained manner than neurons in dorsolateral PFC. Within ventrolateral PFC, spatial selectivity was more prevalent on the inferior convexity than within the principal sulcus. Finally, when reward increased spatial selectivity, behavioral performance improved, whereas when reward decreased spatial selectivity, behavioral performance deteriorated. These results suggest that ventrolateral PFC may be a locus whereby information about expected rewards can modulate information in working memory. The pattern of results is consistent with a role for ventrolateral PFC in attentional control.

  10. Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

    Science.gov (United States)

    Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

    2014-01-01

    To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

  11. Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

    Science.gov (United States)

    Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

    2014-10-01

    To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

  12. Differential reward coding in the subdivisions of the primate caudate during an oculomotor task.

    Science.gov (United States)

    Nakamura, Kae; Santos, Gustavo S; Matsuzaki, Ryuichi; Nakahara, Hiroyuki

    2012-11-07

    The basal ganglia play a pivotal role in reward-oriented behavior. The striatum, an input channel of the basal ganglia, is composed of subdivisions that are topographically connected with different cortical and subcortical areas. To test whether reward information is differentially processed in the different parts of the striatum, we compared reward-related neuronal activity along the dorsolateral-ventromedial axis in the caudate nucleus of monkeys performing an asymmetrically rewarded oculomotor task. In a given block, a target in one position was associated with a large reward, whereas the other target was associated with a small reward. The target position-reward value contingency was switched between blocks. We found the following: (1) activity that reflected the block-wise reward contingency emerged before the appearance of a visual target, and it was more prevalent in the dorsal, rather than central and ventral, caudate; (2) activity that was positively related to the reward size of the current trial was evident, especially after reward delivery, and it was more prevalent in the ventral and central, rather than dorsal, caudate; and (3) activity that was modulated by the memory of the outcomes of the previous trials was evident in the dorsal and central caudate. This multiple reward information, together with the target-direction information, was represented primarily by individual caudate neurons, and the different reward information was represented in caudate subpopulations with distinct electrophysiological properties, e.g., baseline firing and spike width. These results suggest parallel processing of different reward information by the basal ganglia subdivisions defined by extrinsic connections and intrinsic properties.

  13. Cigarette smoking modulates medication-associated deficits in a monetary reward task in patients with schizophrenia.

    Science.gov (United States)

    Lernbass, Birgit; Grön, Georg; Wolf, Nadine D; Abler, Birgit

    2013-09-01

    Imaging studies of reward processing have demonstrated a mesolimbic-mesocortical dopaminergic dysfunction in schizophrenia. Such studies on reward processing in patients and also in healthy controls showed that differential activations of dopaminergic brain areas are associated with adaptive changes in response speed related to different reward values. Given this relationship, we investigated reward processing on the behavioural level in a larger sample of 49 medicated patients with a diagnosis of schizophrenia (ICD-10 F20) and 49 healthy controls. Subjects were instructed to react by button press upon two different stimuli in order to retain a 60 % chance winning a previously announced high (1$) or low (20¢) amount of money paid to participants after the experiment. Concordant with previous reports on deficits in reward processing, acceleration of reaction times in patients upon low rewards differed significantly (p non-smoking subgroup of patients (n = 24). In this subgroup, we also observed a significant (p monetary reward task might constitute a feasible behavioural proxy for dopaminergic dysfunction and its different dimensions regarding psychopathology but also medication in patients with schizophrenia. In line with clinical observations, our findings support the notion that smoking modulates medication-associated side effects on reward processing in patients with schizophrenia.

  14. Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning.

    Science.gov (United States)

    Marsh, Brandi T; Tarigoppula, Venkata S Aditya; Chen, Chen; Francis, Joseph T

    2015-05-13

    For decades, neurophysiologists have worked on elucidating the function of the cortical sensorimotor control system from the standpoint of kinematics or dynamics. Recently, computational neuroscientists have developed models that can emulate changes seen in the primary motor cortex during learning. However, these simulations rely on the existence of a reward-like signal in the primary sensorimotor cortex. Reward modulation of the primary sensorimotor cortex has yet to be characterized at the level of neural units. Here we demonstrate that single units/multiunits and local field potentials in the primary motor (M1) cortex of nonhuman primates (Macaca radiata) are modulated by reward expectation during reaching movements and that this modulation is present even while subjects passively view cursor motions that are predictive of either reward or nonreward. After establishing this reward modulation, we set out to determine whether we could correctly classify rewarding versus nonrewarding trials, on a moment-to-moment basis. This reward information could then be used in collaboration with reinforcement learning principles toward an autonomous brain-machine interface. The autonomous brain-machine interface would use M1 for both decoding movement intention and extraction of reward expectation information as evaluative feedback, which would then update the decoding algorithm as necessary. In the work presented here, we show that this, in theory, is possible. Copyright © 2015 the authors 0270-6474/15/357374-14$15.00/0.

  15. Galanin-Expressing GABA Neurons in the Lateral Hypothalamus Modulate Food Reward and Noncompulsive Locomotion.

    Science.gov (United States)

    Qualls-Creekmore, Emily; Yu, Sangho; Francois, Marie; Hoang, John; Huesing, Clara; Bruce-Keller, Annadora; Burk, David; Berthoud, Hans-Rudolf; Morrison, Christopher D; Münzberg, Heike

    2017-06-21

    The lateral hypothalamus (LHA) integrates reward and appetitive behavior and is composed of many overlapping neuronal populations. Recent studies associated LHA GABAergic neurons (LHA GABA ), which densely innervate the ventral tegmental area (VTA), with modulation of food reward and consumption; yet, LHA GABA projections to the VTA exclusively modulated food consumption, not reward. We identified a subpopulation of LHA GABA neurons that coexpress the neuropeptide galanin (LHA Gal ). These LHA Gal neurons also modulate food reward, but lack direct VTA innervation. We hypothesized that LHA Gal neurons may represent a subpopulation of LHA GABA neurons that mediates food reward independent of direct VTA innervation. We used chemogenetic activation of LHA Gal or LHA GABA neurons in mice to compare their role in feeding behavior. We further analyzed locomotor behavior to understand how differential VTA connectivity and transmitter release in these LHA neurons influences this behavior. LHA Gal or LHA GABA neuronal activation both increased operant food-seeking behavior, but only activation of LHA GABA neurons increased overall chow consumption. Additionally, LHA Gal or LHA GABA neuronal activation similarly induced locomotor activity, but with striking differences in modality. Activation of LHA GABA neurons induced compulsive-like locomotor behavior; while LHA Gal neurons induced locomotor activity without compulsivity. Thus, LHA Gal neurons define a subpopulation of LHA GABA neurons without direct VTA innervation that mediate noncompulsive food-seeking behavior. We speculate that the striking difference in compulsive-like locomotor behavior is also based on differential VTA innervation. The downstream neural network responsible for this behavior and a potential role for galanin as neuromodulator remains to be identified. SIGNIFICANCE STATEMENT The lateral hypothalamus (LHA) regulates motivated feeding behavior via GABAergic LHA neurons. The molecular identity of LHA

  16. Differentiating neural reward responsiveness in autism versus ADHD

    Directory of Open Access Journals (Sweden)

    Gregor Kohls

    2014-10-01

    Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.

  17. Functional requirements for reward-modulated spike-timing-dependent plasticity.

    Science.gov (United States)

    Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

    2010-10-06

    Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

  18. Modulation of risk/reward decision making by dopaminergic transmission within the basolateral amygdala.

    Science.gov (United States)

    Larkin, Joshua D; Jenni, Nicole L; Floresco, Stan B

    2016-01-01

    Dopamine (DA) transmission within cortico-limbic-striatal circuitry is integral in modulating decisions involving reward uncertainty. The basolateral amygdala (BLA) also plays a role in these processes, yet how DA transmission within this nucleus regulates cost/benefit decision making is unknown. We investigated the contribution of DA transmission within the BLA to risk/reward decision making assessed with a probabilistic discounting task. Rats were well-trained to choose between a small/certain reward and a large/risky reward, with the probability of obtaining the larger reward decreasing (100-12.5 %) or increasing (12.5-100 %) over a session. We examined the effects of antagonizing BLA D1 (SCH 23390, 0.1-1 μg) or D2 (eticlopride, 0.1-1 μg) receptors, as well as intra-BLA infusions of agonists for D1 (SKF 81297, 0.1-1 μg) and D2 (quinpirole, 1-10 μg) receptors. We also assessed how DA receptor stimulation may induce differential effects related to baseline levels of risky choice. BLA D1 receptor antagonism reduced risky choice by decreasing reward sensitivity, whereas D2 antagonism did not affect overall choice patterns. Stimulation of BLA D1 receptors optimized decision making in a baseline-dependent manner: in risk-averse rats, infusions of a lower dose of SKF81297 increased risky choice when reward probabilities were high (50 %), whereas in risk-prone rats, this drug reduced risky choice when probabilities were low (12.5 %). Quinpirole reduced risky choice in risk-prone rats, enhancing lose-shift behavior. These data highlight previously uncharacterized roles for BLA DA D1 and D2 receptors in biasing choice during risk/reward decision making through mediation of reward/negative feedback sensitivity.

  19. Reward-based spatial crowdsourcing with differential privacy preservation

    Science.gov (United States)

    Xiong, Ping; Zhang, Lefeng; Zhu, Tianqing

    2017-11-01

    In recent years, the popularity of mobile devices has transformed spatial crowdsourcing (SC) into a novel mode for performing complicated projects. Workers can perform tasks at specified locations in return for rewards offered by employers. Existing methods ensure the efficiency of their systems by submitting the workers' exact locations to a centralised server for task assignment, which can lead to privacy violations. Thus, implementing crowsourcing applications while preserving the privacy of workers' location is a key issue that needs to be tackled. We propose a reward-based SC method that achieves acceptable utility as measured by task assignment success rates, while efficiently preserving privacy. A differential privacy model ensures rigorous privacy guarantee, and Laplace noise is introduced to protect workers' exact locations. We then present a reward allocation mechanism that adjusts each piece of the reward for a task using the distribution of the workers' locations. Through experimental results, we demonstrate that this optimised-reward method is efficient for SC applications.

  20. Galanin-Expressing GABA Neurons in the Lateral Hypothalamus Modulate Food Reward and Noncompulsive Locomotion

    OpenAIRE

    Qualls-Creekmore, Emily; Yu, Sangho; Francois, Marie; Hoang, John; Huesing, Clara; Bruce-Keller, Annadora; Burk, David; Berthoud, Hans-Rudolf; Morrison, Christopher D.; Münzberg, Heike

    2017-01-01

    The lateral hypothalamus (LHA) integrates reward and appetitive behavior and is composed of many overlapping neuronal populations. Recent studies associated LHA GABAergic neurons (LHAGABA), which densely innervate the ventral tegmental area (VTA), with modulation of food reward and consumption; yet, LHAGABA projections to the VTA exclusively modulated food consumption, not reward. We identified a subpopulation of LHAGABA neurons that coexpress the neuropeptide galanin (LHAGal). These LHAGal n...

  1. Probability differently modulating the effects of reward and punishment on visuomotor adaptation.

    Science.gov (United States)

    Song, Yanlong; Smiley-Oyen, Ann L

    2017-12-01

    Recent human motor learning studies revealed that punishment seemingly accelerated motor learning but reward enhanced consolidation of motor memory. It is not evident how intrinsic properties of reward and punishment modulate the potentially dissociable effects of reward and punishment on motor learning and motor memory. It is also not clear what causes the dissociation of the effects of reward and punishment. By manipulating probability of distribution, a critical property of reward and punishment, the present study demonstrated that probability had distinct modulation on the effects of reward and punishment in adapting to a sudden visual rotation and consolidation of the adaptation memory. Specifically, two probabilities of monetary reward and punishment distribution, 50 and 100%, were applied during young adult participants adapting to a sudden visual rotation. Punishment and reward showed distinct effects on motor adaptation and motor memory. The group that received punishments in 100% of the adaptation trials adapted significantly faster than the other three groups, but the group that received rewards in 100% of the adaptation trials showed marked savings in re-adapting to the same rotation. In addition, the group that received punishments in 50% of the adaptation trials that were randomly selected also had savings in re-adapting to the same rotation. Sensitivity to sensory prediction error or difference in explicit process induced by reward and punishment may likely contribute to the distinct effects of reward and punishment.

  2. Neural reward processing is modulated by approach- and avoidance-related personality traits

    NARCIS (Netherlands)

    Simon, J.J.; Walther, S.; Fiebach, C.J.; Friederich, H.C.; Stippich, C.; Weisbrod, M.; Kaiser, S.

    2009-01-01

    The neural processing of reward can be differentiated into two sub-components with different functions, "wanting" (i.e., the expectation of a reward which includes appetitive and motivational components) and "liking" (i.e., the hedonic impact experienced during the receipt of a reward), involving

  3. Reward-timing-dependent bidirectional modulation of cortical microcircuits during optical single-neuron operant conditioning.

    Science.gov (United States)

    Hira, Riichiro; Ohkubo, Fuki; Masamizu, Yoshito; Ohkura, Masamichi; Nakai, Junichi; Okada, Takashi; Matsuzaki, Masanori

    2014-11-24

    Animals rapidly adapt to environmental change. To reveal how cortical microcircuits are rapidly reorganized when an animal recognizes novel reward contingency, we conduct two-photon calcium imaging of layer 2/3 motor cortex neurons in mice and simultaneously reinforce the activity of a single cortical neuron with water delivery. Here we show that when the target neuron is not relevant to a pre-trained forelimb movement, the mouse increases the target neuron activity and the number of rewards delivered during 15-min operant conditioning without changing forelimb movement behaviour. The reinforcement bidirectionally modulates the activity of subsets of non-target neurons, independent of distance from the target neuron. The bidirectional modulation depends on the relative timing between the reward delivery and the neuronal activity, and is recreated by pairing reward delivery and photoactivation of a subset of neurons. Reward-timing-dependent bidirectional modulation may be one of the fundamental processes in microcircuit reorganization for rapid adaptation.

  4. Endogenous nociceptin modulates diet preference independent of motivation and reward.

    Science.gov (United States)

    Koizumi, Miwako; Cagniard, Barbara; Murphy, Niall P

    2009-04-20

    Previous studies show that the opioid peptide nociceptin stimulates food intake. Here, we studied nociceptin receptor knockout (NOP KO) mice in various behavioral paradigms designed to differentiate psychological and physiological loci at which endogenous nociceptin might control feeding. When presented a choice under food restriction, NOP KO mice displayed reduced preference for high sucrose diet, but lower intake of high fat diet under no-choice conditions. These responses were absent under ad libitum feeding conditions. Conditioned place preference to high fat diet under food-deprived conditions was unaltered in NOP KO mice, suggesting no difference in reward responses. Furthermore, operant food self-administration under a variety of conditions showed no genotype-dependent differences, suggesting no differences in the motivational properties of food. Taste reactivity to sucrose was unchanged in NOP KO mice, though NOP KO mice had altered aversive reactions to quinine solutions under ad libitum feeding, suggesting minor differences in the affective impact of palatable and unpalatable tastants. Although NOP KO mice re-fed following food-deprivation showed normal increases in plasma glucose and insulin, multidimensional scaling analysis showed that the relationship between these measures, body weight and plasma leptin was substantially disrupted in NOP KO, particularly in fasted mice. Additionally, the typical positive relationship between body weight and plasma leptin was considerably weaker in NOP KO mice. Together, these findings suggest that endogenous nociceptin differentially modulates diet preference depending on macronutrient content and homeostatic state, independently of the motivating, rewarding or orosensory properties of food, but may involve metabolic or postingestive processes.

  5. Pramipexole modulates the neural network of reward anticipation.

    Science.gov (United States)

    Ye, Zheng; Hammer, Anke; Camara, Estela; Münte, Thomas F

    2011-05-01

    Pramipexole is widely prescribed to treat Parkinson's disease. It has been found to cause impulse control disorders such as pathological gambling. To examine how pramipexole modulates the network of reward anticipation, we carried out a pharmacological functional magnetic resonance imaging study with a double-blind, within-subject design. During the anticipation of monetary rewards, pramipexole increased the activity of the nucleus accumbens (NAcc), enhanced the interaction between the NAcc and the anterior insula, but weakened the interaction between the NAcc and the prefrontal cortex. These results suggest that pramipexole may exaggerate incentive and affective responses to possible rewards, but reduce the top-down control of impulses, leading to an increase in impulsive behaviors. This imbalance between the prefrontal-striatum connectivity and the insula-striatum connectivity may represent the neural mechanism of pathological gambling caused by pramipexole. Copyright © 2010 Wiley-Liss, Inc.

  6. Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex.

    Science.gov (United States)

    Toda, Koji; Sugase-Miyamoto, Yasuko; Mizuhiki, Takashi; Inaba, Kiyonori; Richmond, Barry J; Shidara, Munetaka

    2012-01-01

    The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1-4 sequential color discrimination trials to obtain a reward of 1-3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount. Our results suggest that the rACC neurons encode information about reward proximity and amount in a manner that is dependent on utility of reward information. The manner in which the information is represented could be used in the moment-to-moment calculation of the effect of time and amount on predicted outcome value.

  7. Expected reward modulates encoding-related theta activity before an event.

    Science.gov (United States)

    Gruber, Matthias J; Watrous, Andrew J; Ekstrom, Arne D; Ranganath, Charan; Otten, Leun J

    2013-01-01

    Oscillatory brain activity in the theta frequency range (4-8 Hz) before the onset of an event has been shown to affect the likelihood of successfully encoding the event into memory. Recent work has also indicated that frontal theta activity might be modulated by reward, but it is not clear how reward expectancy, anticipatory theta activity, and memory formation might be related. Here, we used scalp electroencephalography (EEG) to assess the relationship between these factors. EEG was recorded from healthy adults while they memorized a series of words. Each word was preceded by a cue that indicated whether a high or low monetary reward would be earned if the word was successfully remembered in a later recognition test. Frontal theta power between the presentation of the reward cue and the onset of a word was predictive of later memory for the word, but only in the high reward condition. No theta differences were observed before word onset following low reward cues. The magnitude of prestimulus encoding-related theta activity in the high reward condition was correlated with the number of high reward words that were later confidently recognized. These findings provide strong evidence for a link between reward expectancy, theta activity, and memory encoding. Theta activity before event onset seems to be especially important for the encoding of motivationally significant stimuli. One possibility is that dopaminergic activity during reward anticipation mediates frontal theta activity related to memory. Copyright © 2012 Elsevier Inc. All rights reserved.

  8. Neural processing of calories in brain reward areas can be modulated by reward sensitivity

    Directory of Open Access Journals (Sweden)

    Inge eVan Rijn

    2016-01-01

    Full Text Available A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity, however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015, in which participants (n=30 tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n=18 (Griffioen-Roose et al., 2013. First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS questionnaire.When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate, right amygdala and anterior cingulate cortex (bilaterally correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per

  9. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity.

    Science.gov (United States)

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A M

    2015-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be

  10. Reward modulation of hippocampal subfield activation during successful associative encoding and retrieval

    Science.gov (United States)

    Wolosin, Sasha M.; Zeithamova, Dagmar; Preston, Alison R.

    2012-01-01

    Emerging evidence suggests that motivation enhances episodic memory formation through interactions between medial temporal lobe (MTL) structures and dopaminergic midbrain. In addition, recent theories propose that motivation specifically facilitates hippocampal associative binding processes, resulting in more detailed memories that are readily reinstated from partial input. Here, we used high-resolution functional magnetic resonance imaging to determine how motivation influences associative encoding and retrieval processes within human MTL subregions and dopaminergic midbrain. Participants intentionally encoded object associations under varying conditions of reward and performed a retrieval task during which studied associations were cued from partial input. Behaviorally, cued recall performance was superior for high-value relative to low-value associations; however, participants differed in the degree to which rewards influenced memory. The magnitude of behavioral reward modulation was associated with reward-related activation changes in dentate gyrus/CA2,3 during encoding and enhanced functional connectivity between dentate gyrus/CA2,3 and dopaminergic midbrain during both the encoding and retrieval phases of the task. These findings suggests that within the hippocampus, reward-based motivation specifically enhances dentate gyrus/CA2,3 associative encoding mechanisms through interactions with dopaminergic midbrain. Furthermore, within parahippocampal cortex and dopaminergic midbrain regions, activation associated with successful memory formation was modulated by reward across the group. During the retrieval phase, we also observed enhanced activation in hippocampus and dopaminergic midbrain for high-value associations that occurred in the absence of any explicit cues to reward. Collectively, these findings shed light on fundamental mechanisms through which reward impacts associative memory formation and retrieval through facilitation of MTL and VTA/SN processing

  11. Modulating Reward Induces Differential Neurocognitive Approaches to Sustained Attention.

    Science.gov (United States)

    Esterman, Michael; Poole, Victoria; Liu, Guanyu; DeGutis, Joseph

    2017-08-01

    Reward and motivation have powerful effects on cognition and brain activity, yet it remains unclear how they affect sustained cognitive performance. We have recently shown that a variety of motivators improve accuracy and reduce variability during sustained attention. In the current study, we investigate how neural activity in task-positive networks supports these sustained attention improvements. Participants performed the gradual-onset continuous performance task with alternating motivated (rewarded) and unmotivated (unrewarded) blocks. During motivated blocks, we observed increased sustained neural recruitment of task-positive regions, which interacted with fluctuations in task performance. Specifically, during motivated blocks, participants recruited these regions in preparation for upcoming targets, and this activation predicted accuracy. In contrast, during unmotivated blocks, no such advanced preparation was observed. Furthermore, during motivated blocks, participants had similar activation levels during both optimal (in-the-zone) and suboptimal (out-of-the-zone) epochs of performance. In contrast, during unmotivated blocks, task-positive regions were only engaged to a similar degree as motivated blocks during suboptimal (out-of-the-zone) periods. These data support a framework in which motivated individuals act as "cognitive investors," engaging task-positive resources proactively and consistently during sustaining attention. When unmotivated, however, the same individuals act as "cognitive misers," engaging maximal task-positive resources only during periods of struggle. Published by Oxford University Press 2016.

  12. Dopamine modulates reward system activity during subconscious processing of sexual stimuli.

    Science.gov (United States)

    Oei, Nicole Y L; Rombouts, Serge Arb; Soeter, Roelof P; van Gerven, Joop M; Both, Stephanie

    2012-06-01

    Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive-compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the 'reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. Young healthy males (n=53) were randomly assigned to two experimental groups or a control group, and were administered a dopamine antagonist (haloperidol), a dopamine agonist (levodopa), or placebo. Brain activation was assessed during a backward-masking task with subliminally presented sexual stimuli. Results showed that levodopa significantly enhanced the activation in the nucleus accumbens and dorsal anterior cingulate when subliminal sexual stimuli were shown, whereas haloperidol decreased activations in those areas. Dopamine thus enhances activations in regions thought to regulate 'wanting' in response to potentially rewarding sexual stimuli that are not consciously perceived. This running start of the reward system might explain the pull of rewards in individuals with compulsive reward-seeking behaviors such as hypersexuality and patients who receive dopaminergic medication.

  13. BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

    Science.gov (United States)

    Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

    2016-09-01

    According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

  14. The sleep and circadian modulation of neural reward pathways: a protocol for a pair of systematic reviews.

    Science.gov (United States)

    Byrne, Jamie E M; Murray, Greg

    2017-12-02

    Animal research suggests that neural reward activation may be systematically modulated by sleep and circadian function. Whether humans also exhibit sleep and circadian modulation of neural reward pathways is unclear. This area is in need of further research, as it has implications for the involvement of sleep and circadian function in reward-related disorders. The aim of this paper is to describe the protocol for a pair of systematic literature reviews to synthesise existing literature related to (1) sleep and (2) circadian modulation of neural reward pathways in healthy human populations. A systematic review of relevant online databases (Scopus, PubMed, Web of Science, ProQuest, PsycINFO and EBSCOhost) will be conducted. Reference lists, relevant reviews and supplementary data will be searched for additional articles. Articles will be included if (a) they contain a sleep- or circadian-related predictor variable with a neural reward outcome variable, (b) use a functional magnetic resonance imaging protocol and (c) use human samples. Articles will be excluded if study participants had disorders known to affect the reward system. The articles will be screened by two independent authors. Two authors will complete the data extraction form, with two authors independently completing the quality assessment tool for the selected articles, with a consensus reached with a third author if needed. Narrative synthesis methods will be used to analyse the data. The findings from this pair of systematic literature reviews will assist in the identification of the pathways involved in the sleep and circadian function modulation of neural reward in healthy individuals, with implications for disorders characterised by dysregulation in sleep, circadian rhythms and reward function. PROSPERO CRD42017064994.

  15. Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

    Science.gov (United States)

    Macoveanu, Julian

    2014-03-27

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

  16. How Sequential Changes in Reward Magnitude Modulate Cognitive Flexibility: Evidence from Voluntary Task Switching

    Science.gov (United States)

    Fröber, Kerstin; Dreisbach, Gesine

    2016-01-01

    There is much evidence that the prospect of reward modulates cognitive control in terms of more stable behavior. Increases in expected reward magnitude, however, have been suggested to increase flexible behavior as evidenced by reduced switch costs. In a series of experiments, the authors provide evidence that this increased cognitive flexibility…

  17. Distinct Reward Properties are Encoded via Corticostriatal Interactions.

    Science.gov (United States)

    Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

    2016-02-02

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

  18. BMI not WHR modulates BOLD fMRI responses in a sub-cortical reward network when participants judge the attractiveness of human female bodies.

    Directory of Open Access Journals (Sweden)

    Ian E Holliday

    Full Text Available In perceptual terms, the human body is a complex 3d shape which has to be interpreted by the observer to judge its attractiveness. Both body mass and shape have been suggested as strong predictors of female attractiveness. Normally body mass and shape co-vary, and it is difficult to differentiate their separate effects. A recent study suggested that altering body mass does not modulate activity in the reward mechanisms of the brain, but shape does. However, using computer generated female body-shaped greyscale images, based on a Principal Component Analysis of female bodies, we were able to construct images which covary with real female body mass (indexed with BMI and not with body shape (indexed with WHR, and vice versa. Twelve observers (6 male and 6 female rated these images for attractiveness during an fMRI study. The attractiveness ratings were correlated with changes in BMI and not WHR. Our primary fMRI results demonstrated that in addition to activation in higher visual areas (such as the extrastriate body area, changing BMI also modulated activity in the caudate nucleus, and other parts of the brain reward system. This shows that BMI, not WHR, modulates reward mechanisms in the brain and we infer that this may have important implications for judgements of ideal body size in eating disordered individuals.

  19. Prediction-error in the context of real social relationships modulates reward system activity.

    Science.gov (United States)

    Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

    2012-01-01

    The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  20. Acute Stress Influences Neural Circuits of Reward Processing

    Directory of Open Access Journals (Sweden)

    Anthony John Porcelli

    2012-11-01

    Full Text Available People often make decisions under aversive conditions such as acute stress. Yet, less is known about the process in which acute stress can influence decision-making. A growing body of research has established that reward-related information associated with the outcomes of decisions exerts a powerful influence over the choices people make and that an extensive network of brain regions, prominently featuring the striatum, is involved in the processing of this reward-related information. Thus, an important step in research on the nature of acute stress’ influence over decision-making is to examine how it may modulate responses to rewards and punishments within reward-processing neural circuitry. In the current experiment, we employed a simple reward processing paradigm – where participants received monetary rewards and punishments – known to evoke robust striatal responses. Immediately prior to performing each of two task runs, participants were exposed to acute stress (i.e., cold pressor or a no stress control procedure in a between-subjects fashion. No stress group participants exhibited a pattern of activity within the dorsal striatum and orbitofrontal cortex consistent with past research on outcome processing – specifically, differential responses for monetary rewards over punishments. In contrast, acute stress group participants’ dorsal striatum and orbitofrontal cortex demonstrated decreased sensitivity to monetary outcomes and a lack of differential activity. These findings provide insight into how neural circuits may process rewards and punishments associated with simple decisions under acutely stressful conditions.

  1. Prediction-error in the context of real social relationships modulates reward system activity

    Directory of Open Access Journals (Sweden)

    Joshua ePoore

    2012-08-01

    Full Text Available The human reward system is sensitive to both social (e.g., validation and non-social rewards (e.g., money and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward—social validation—and this activity’s relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants’ expectations for their romantic partners’ positive regard of them were confirmed (validated or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  2. Monetary reward speeds up voluntary saccades.

    Science.gov (United States)

    Chen, Lewis L; Chen, Y Mark; Zhou, Wu; Mustain, William D

    2014-01-01

    Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation.

  3. Modulation of Food Reward by Endocrine and Environmental Factors: Update and Perspective.

    Science.gov (United States)

    Figlewicz, Dianne P

    2015-01-01

    Palatable foods are frequently high in energy density. Chronic consumption of high-energy density foods can contribute to the development of cardiometabolic pathology including obesity, diabetes, and cardiovascular disease. This article reviews the contributions of extrinsic and intrinsic factors that influence the reward components of food intake. A narrative review was conducted to determine the behavioral and central nervous system (CNS) related processes involved in the reward components of high-energy density food intake. The rewarding aspects of food, particularly palatable and preferred foods, are regulated by CNS circuitry. Overlaying this regulation is modulation by intrinsic endocrine systems and metabolic hormones relating to energy homeostasis, developmental stage, or gender. It is now recognized that extrinsic or environmental factors, including ambient diet composition and the provocation of stress or anxiety, also contribute substantially to the expression of food reward behaviors such as motivation for, and seeking of, preferred foods. High-energy density food intake is influenced by both physiological and pathophysiological processes. Contextual, behavioral, and psychological factors and CNS-related processes represent potential targets for multiple types of therapeutic intervention.

  4. The Attraction Effect Modulates Reward Prediction Errors and Intertemporal Choices.

    Science.gov (United States)

    Gluth, Sebastian; Hotaling, Jared M; Rieskamp, Jörg

    2017-01-11

    Classical economic theory contends that the utility of a choice option should be independent of other options. This view is challenged by the attraction effect, in which the relative preference between two options is altered by the addition of a third, asymmetrically dominated option. Here, we leveraged the attraction effect in the context of intertemporal choices to test whether both decisions and reward prediction errors (RPE) in the absence of choice violate the independence of irrelevant alternatives principle. We first demonstrate that intertemporal decision making is prone to the attraction effect in humans. In an independent group of participants, we then investigated how this affects the neural and behavioral valuation of outcomes using a novel intertemporal lottery task and fMRI. Participants' behavioral responses (i.e., satisfaction ratings) were modulated systematically by the attraction effect and this modulation was correlated across participants with the respective change of the RPE signal in the nucleus accumbens. Furthermore, we show that, because exponential and hyperbolic discounting models are unable to account for the attraction effect, recently proposed sequential sampling models might be more appropriate to describe intertemporal choices. Our findings demonstrate for the first time that the attraction effect modulates subjective valuation even in the absence of choice. The findings also challenge the prospect of using neuroscientific methods to measure utility in a context-free manner and have important implications for theories of reinforcement learning and delay discounting. Many theories of value-based decision making assume that people first assess the attractiveness of each option independently of each other and then pick the option with the highest subjective value. The attraction effect, however, shows that adding a new option to a choice set can change the relative value of the existing options, which is a violation of the independence

  5. Reward modulates oculomotor competition between differently valued stimuli.

    Science.gov (United States)

    Bucker, Berno; Silvis, Jeroen D; Donk, Mieke; Theeuwes, Jan

    2015-03-01

    The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection. Copyright © 2015 Elsevier Ltd. All rights reserved.

  6. Differential modulation of thresholds for intracranial self-stimulation by mGlu5 positive and negative allosteric modulators: implications for effects on drug self-administration

    Directory of Open Access Journals (Sweden)

    M. Foster eOlive

    2012-01-01

    Full Text Available Pharmacological manipulation of the type 5 metabotropic glutamate (mGlu5 receptor alters various addiction related behaviors such as drug self-administration and the extinction and reinstatement of drug-seeking behavior. However, the effects of pharmacological modulation of mGlu5 receptors on brain reward function have not been widely investigated. We examined the effects of acute administration of positive and negative allosteric modulators (PAMs and NAMs, respectively on brain reward function by assessing thresholds for intracranial self-stimulation (ICSS. In addition, when acute effects were observed, we examined potential changes in altered ICSS thresholds following repeated administration. Male Sprague-Dawley rats were implanted with bipolar electrodes into the medial forebrain bundle and trained to respond for ICSS, followed by assessment of effects of mGlu5 ligands on ICSS thresholds using a discrete trials current intensity threshold determination procedure. Acute administration of the selective mGlu5 NAMs MTEP (0, 0.3, 1 or 3 mg/kg and fenobam (0, 3, 10, or 30 mg/kg dose-dependently increased ICSS thresholds (~70% at the highest dose tested, suggesting a deficit in brain reward function. Acute administration of the mGlu5 PAMs CDPPB (0, 10, 30 and 60 mg/kg or ADX47273 (0, 10, 30 and 60 mg/kg was without effect at any dose tested. When administered once daily for 5 consecutive days, the development of tolerance to the ability of threshold-elevating doses of MTEP and fenobam to increase ICSS thresholds was observed. We conclude that mGlu5 PAMs and NAMs differentially affect brain reward function, and that tolerance to the ability of mGlu5 NAMs to reduce brain reward function develops with repeated administration. These brain reward deficits should be taken into consideration when interpreting acute effects of mGlu5 NAMs on drug self-administration, and repeated administration may be an effective method to reduce these deficits.

  7. Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

    Science.gov (United States)

    Via, Esther; Soriano-Mas, Carles; Sánchez, Isabel; Forcano, Laura; Harrison, Ben J; Davey, Christopher G; Pujol, Jesús; Martínez-Zalacaín, Ignacio; Menchón, José M; Fernández-Aranda, Fernando; Cardoner, Narcís

    2015-01-01

    Patients with anorexia nervosa (AN) display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI) study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2) and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire). Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC) during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

  8. Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

    Directory of Open Access Journals (Sweden)

    Esther Via

    Full Text Available Patients with anorexia nervosa (AN display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2 and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire. Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

  9. Threat/reward-sensitivity and hypomanic-personality modulate cognitive-control and attentional neural processes to emotional stimuli.

    Science.gov (United States)

    Pornpattananangkul, Narun; Hu, Xiaoqing; Nusslock, Robin

    2015-11-01

    Temperamental-traits (e.g. threat/reward-sensitivity) are found to modulate cognitive-control and attentional-processes. Yet, it is unclear exactly how these traits interact with emotional-stimuli in the modulation of cognitive-control, as reflected by the N2 event-related potential (ERP), and attentional-processes, as reflected by the P2 and P3 ERPs. Here in an ERP emotional-Go/NoGo task, 36 participants were instructed to inhibit their response to Fearful- and Happy-faces. Individual-differences in threat-sensitivity, reward-sensitivity and hypomanic-personality were assessed through self-report. Hypomanic-personality was assessed, given its relationship with reward-sensitivity and relevance to mood-disorder symptoms. Concerning cognitive-control, individuals with elevated threat-sensitivity displayed more-negative N2s to Happy-NoGo (relative to Fearful-NoGo) faces, whereas both individuals with elevated reward-sensitivity and hypomanic-personality displayed more-negative N2s to Fearful-NoGo (relative to Happy-NoGo) faces. Accordingly, when cognitive-control is required (during Go/NoGo), a mismatch between one's temperament and the valence of the NoGo-stimulus elevates detection of the need for cognitive-control. Conversely, the modulation of attentional-processing was specific to threat-sensitivity, as there was no relationship between either reward-sensitivity or hypomanic-personality and attentional-processing. Elevated threat-sensitivity was associated with enhanced early (P2s) and later (P3s) attentional-processing to Fearful-NoGo (relative to Happy-NoGo) faces. These latter findings support the negative attentional-bias model relating elevated threat-sensitivity with attentional-biases toward negative-stimuli and away from positive-stimuli. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  10. Cholinergic modulation of mesolimbic dopamine function and reward.

    Science.gov (United States)

    Mark, Gregory P; Shabani, Shkelzen; Dobbs, Lauren K; Hansen, Stephen T

    2011-07-25

    The substantial health risk posed by obesity and compulsive drug use has compelled a serious research effort to identify the neurobiological substrates that underlie the development these pathological conditions. Despite substantial progress, an understanding of the neurochemical systems that mediate the motivational aspects of drug-seeking and craving remains incomplete. Important work from the laboratory of Bart Hoebel has provided key information on neurochemical systems that interact with dopamine (DA) as potentially important components in both the development of addiction and the expression of compulsive behaviors such as binge eating. One such modulatory system appears to be cholinergic pathways that interact with DA systems at all levels of the reward circuit. Cholinergic cells in the pons project to DA-rich cell body regions in the ventral tegmental area (VTA) and substantial nigra (SN) where they modulate the activity of dopaminergic neurons and reward processing. The DA terminal region of the nucleus accumbens (NAc) contains a small but particularly important group of cholinergic interneurons, which have extensive dendritic arbors that make synapses with a vast majority of NAc neurons and afferents. Together with acetylcholine (ACh) input onto DA cell bodies, cholinergic systems could serve a vital role in gating information flow concerning the motivational value of stimuli through the mesolimbic system. In this report we highlight evidence that CNS cholinergic systems play a pivotal role in behaviors that are motivated by both natural and drug rewards. We argue that the search for underlying neurochemical substrates of compulsive behaviors, as well as attempts to identify potential pharmacotherapeutic targets to combat them, must include a consideration of central cholinergic systems. Copyright © 2011 Elsevier Inc. All rights reserved.

  11. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    NARCIS (Netherlands)

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A M

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth

  12. Overt and covert attention to location-based reward.

    Science.gov (United States)

    McCoy, Brónagh; Theeuwes, Jan

    2018-01-01

    Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  13. Reward acts on the pFC to enhance distractor resistance of working memory representations.

    Science.gov (United States)

    Fallon, Sean James; Cools, Roshan

    2014-12-01

    Working memory and reward processing are often thought to be separate, unrelated processes. However, most daily activities involve integrating these two types of information, and the two processes rarely, if ever, occur in isolation. Here, we show that working memory and reward interact in a task-dependent manner and that this task-dependent interaction involves modulation of the pFC by the ventral striatum. Specifically, BOLD signal during gains relative to losses in the ventral striatum and pFC was associated not only with enhanced distractor resistance but also with impairment in the ability to update working memory representations. Furthermore, the effect of reward on working memory was accompanied by differential coupling between the ventral striatum and ignore-related regions in the pFC. Together, these data demonstrate that reward-related signals modulate the balance between cognitive stability and cognitive flexibility by altering functional coupling between the ventral striatum and the pFC.

  14. Opposite modulation of brain stimulation reward by NMDA and AMPA receptors in the ventral tegmental area.

    Science.gov (United States)

    Ducrot, Charles; Fortier, Emmanuel; Bouchard, Claude; Rompré, Pierre-Paul

    2013-01-01

    Previous studies have shown that blockade of ventral tegmental area (VTA) glutamate N-Methyl-D-Aspartate (NMDA) receptors induces reward, stimulates forward locomotion and enhances brain stimulation reward. Glutamate induces two types of excitatory response on VTA neurons, a fast and short lasting depolarization mediated by α-amino-3-hydroxy-5-methyl-4-isoxazole propionate (AMPA) receptors and a longer lasting depolarization mediated by NMDA receptors. A role for the two glutamate receptors in modulation of VTA neuronal activity is evidenced by the functional change in AMPA and NMDA synaptic responses that result from repeated exposure to reward. Since both receptors contribute to the action of glutamate on VTA neuronal activity, we studied the effects of VTA AMPA and NMDA receptor blockade on reward induced by electrical brain stimulation. Experiments were performed on rats trained to self-administer electrical pulses in the medial posterior mesencephalon. Reward thresholds were measured with the curve-shift paradigm before and for 2 h after bilateral VTA microinjections of the AMPA antagonist, NBQX (2,3,-Dioxo-6-nitro-1,2,3,4-tetrahydrobenzo(f)quinoxaline-7-sulfonamide, 0, 80, and 800 pmol/0.5 μl/side) and of a single dose (0.825 nmol/0.5 μl/side) of the NMDA antagonist, PPPA (2R,4S)-4-(3-Phosphonopropyl)-2-piperidinecarboxylic acid). NBQX produced a dose-dependent increase in reward threshold with no significant change in maximum rate of responding. Whereas PPPA injected at the same VTA sites produced a significant time dependent decrease in reward threshold and increase in maximum rate of responding. We found a negative correlation between the magnitude of the attenuation effect of NBQX and the enhancement effect of PPPA; moreover, NBQX and PPPA were most effective when injected, respectively, into the anterior and posterior VTA. These results suggest that glutamate acts on different receptor sub-types, most likely located on different VTA neurons, to

  15. Opposite modulation of brain stimulation reward by NMDA and AMPA receptors in the ventral tegmental area.

    Directory of Open Access Journals (Sweden)

    Charles eDucrot

    2013-10-01

    Full Text Available Previous studies have shown that blockade of ventral midbrain (VM glutamate N-Methyl-D-Aspartate (NMDA receptors induces reward, stimulates forward locomotion and enhances brain stimulation reward. Glutamate induces two types of excitatory response on VM neurons, a fast and short lasting depolarisation mediated by a-amino-3-hydroxy-5-methyl-4-isoxazole propionate (AMPA receptors and a longer lasting depolarization mediated by NMDA receptors. A role for the two glutamate receptors in modulation of VM neuronal activity is evidenced by the functional change in AMPA and NMDA synaptic responses that result from repeated exposure to reward. Since both receptors contribute to the action of glutamate on VM neuronal activity, we studied the effects of VM AMPA and NMDA receptor blockade on reward induced by electrical brain stimulation. Experiments were performed on rats trained to self-administer electrical pulses in the medial posterior mesencephalon. Reward thresholds were measured with the curve-shift paradigm before and for two hours after bilateral VM microinjections of the AMPA antagonist, NBQX (2,3,-Dioxo-6-nitro-1,2,3,4-tetrahydrobenzo(fquinoxaline-7-sulfonamide, 0, 80, and 800 pmol/0.5ul/side and of a single dose (0.825 nmol/0.5ul/side of the NMDA antagonist, PPPA (2R,4S-4-(3-Phosphonopropyl-2-piperidinecarboxylic acid. NBQX produced a dose-dependent increase in reward threshold with no significant change in maximum rate of responding. Whereas PPPA injected at the same VM sites produced a significant time dependent decrease in reward threshold and increase in maximum rate of responding. We found a negative correlation between the magnitude of the attenuation effect of NBQX and the enhancement effect of PPPA; moreover, NBQX and PPPA were most effective when injected respectively into the anterior and posterior VM. These results suggest that glutamate acts on different receptor sub-types, most likely located on different VM neurons, to modulate

  16. Capacity to Delay Reward Differentiates Obsessive Compulsive Disorder and Obsessive Compulsive Personality Disorder

    Science.gov (United States)

    Pinto, Anthony; Steinglass, Joanna E.; Greene, Ashley L.; Weber, Elke U.; Simpson, H. Blair

    2013-01-01

    Background Although the relationship between obsessive compulsive disorder (OCD) and obsessive compulsive personality disorder (OCPD) has long been debated, clinical samples of OCD (without OCPD) and OCPD (without OCD) have never been systematically compared. We studied whether individuals with OCD, OCPD, or both conditions differ on symptomatology, functioning, and a measure of self-control: the capacity to delay reward. Methods 25 OCD, 25 OCPD, 25 comorbid OCD+OCPD, and 25 healthy controls (HC) completed clinical assessments and a validated intertemporal choice task that measures capacity to forego small immediate rewards for larger delayed rewards. Results OCD and OCPD subjects both showed impairment in psychosocial functioning and quality of life, as well as compulsive behavior, but only subjects with OCD reported obsessions. Individuals with OCPD, with or without comorbid OCD, discounted the value of delayed monetary rewards significantly less than OCD and HC. This excessive capacity to delay reward discriminates OCPD from OCD, and is associated with perfectionism and rigidity. Conclusions OCD and OCPD are both impairing disorders marked by compulsive behaviors, but they can be differentiated by the presence of obsessions in OCD and by excessive capacity to delay reward in OCPD. That individuals with OCPD show less temporal discounting (suggestive of excessive self-control) whereas prior studies have shown that individuals with substance use disorders show greater discounting (suggestive of impulsivity) supports the premise that this component of self-control lies on a continuum in which both extremes (impulsivity and overcontrol) contribute to psychopathology. PMID:24199665

  17. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    Science.gov (United States)

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-02

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. Copyright © 2014 Elsevier B.V. All rights reserved.

  18. Distributed hippocampal patterns that discriminate reward context are associated with enhanced associative binding.

    Science.gov (United States)

    Wolosin, Sasha M; Zeithamova, Dagmar; Preston, Alison R

    2013-11-01

    Recent research indicates that reward-based motivation impacts medial temporal lobe (MTL) encoding processes, leading to enhanced memory for rewarded events. In particular, previous functional magnetic resonance imaging (fMRI) studies of motivated learning have shown that MTL activation is greater for highly rewarded events, with the degree of reward-related activation enhancement tracking the corresponding behavioral memory advantage. These studies, however, do not directly address leading theoretical perspectives that propose such reward-based enhancements in MTL encoding activation reflect enhanced discrimination of the motivational context of specific events. In this study, a high-value or low-value monetary cue preceded a pair of objects, indicating the future reward for successfully remembering the pair. Using representational similarity analysis and high-resolution fMRI, we show that MTL activation patterns are more similar for encoding trials preceded by the same versus different reward cues, indicating a distributed code in this region that distinguishes between motivational contexts. Moreover, we show that activation patterns in hippocampus and parahippocampal cortex (PHc) that differentiate reward conditions during anticipatory cues and object pairs relate to successful associative memory. Additionally, the degree to which patterns differentiate reward contexts in dentate gyrus/CA2,3 and PHc is related to individual differences in reward modulation of memory. Collectively, these findings suggest that distributed activation patterns in the human hippocampus and PHc reflect the rewards associated with individual events. Furthermore, we show that these activation patterns-which discriminate between reward conditions--may influence memory through the incorporation of information about motivational contexts into stored memory representations. PsycINFO Database Record (c) 2013 APA, all rights reserved.

  19. Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain.

    Science.gov (United States)

    Tosoni, Annalisa; Shulman, Gordon L; Pope, Anna L W; McAvoy, Mark P; Corbetta, Maurizio

    2013-06-01

    Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 sec, the reward magnitude indicated by the cue changed roughly every 30 sec, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and frontal eye field (FEF) also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. Copyright © 2012 Elsevier Ltd. All rights reserved.

  20. Capacity to delay reward differentiates obsessive-compulsive disorder and obsessive-compulsive personality disorder.

    Science.gov (United States)

    Pinto, Anthony; Steinglass, Joanna E; Greene, Ashley L; Weber, Elke U; Simpson, H Blair

    2014-04-15

    Although the relationship between obsessive-compulsive disorder (OCD) and obsessive-compulsive personality disorder (OCPD) has long been debated, clinical samples of OCD (without OCPD) and OCPD (without OCD) have never been systematically compared. We studied whether individuals with OCD, OCPD, or both conditions differ on symptomatology, functioning, and a measure of self-control: the capacity to delay reward. Twenty-five OCD, 25 OCPD, 25 comorbid OCD + OCPD, and 25 healthy control subjects completed clinical assessments and a validated intertemporal choice task that measures capacity to forego small immediate rewards for larger delayed rewards. OCD and OCPD subjects both showed impairment in psychosocial functioning and quality of life, as well as compulsive behavior, but only subjects with OCD reported obsessions. Individuals with OCPD, with or without comorbid OCD, discounted the value of delayed monetary rewards significantly less than OCD and healthy control subjects. This excessive capacity to delay reward discriminates OCPD from OCD and is associated with perfectionism and rigidity. OCD and OCPD are both impairing disorders marked by compulsive behaviors, but they can be differentiated by the presence of obsessions in OCD and by excessive capacity to delay reward in OCPD. That individuals with OCPD show less temporal discounting (suggestive of excessive self-control), whereas prior studies have shown that individuals with substance use disorders show greater discounting (suggestive of impulsivity), supports the premise that this component of self-control lies on a continuum in which both extremes (impulsivity and overcontrol) contribute to psychopathology. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

  1. Dopaminergic modulation of reward-guided decision making in alcohol-preferring AA rats.

    Science.gov (United States)

    Oinio, Ville; Bäckström, Pia; Uhari-Väänänen, Johanna; Raasmaja, Atso; Piepponen, Petteri; Kiianmaa, Kalervo

    2017-05-30

    R**esults from animal gambling models have highlighted the importance of dopaminergic neurotransmission in modulating decision making when large sucrose rewards are combined with uncertainty. The majority of these models use food restriction as a tool to motivate animals to accomplish operant behavioral tasks, in which sucrose is used as a reward. As enhanced motivation to obtain sucrose due to hunger may impact its reward-seeking effect, we wanted to examine the decision-making behavior of rats in a situation where rats were fed ad libitum. For this purpose, we chose alcohol-preferring AA (alko alcohol) rats, as these rats have been shown to have high preference for sweet agents. In the present study, AA rats were trained to self-administer sucrose pellet rewards in a two-lever choice task (one pellet vs. three pellets). Once rational choice behavior had been established, the probability of gaining three pellets was decreased over time (50%, 33%, 25% then 20%). The effect of d-amphetamine on decision making was studied at every probability level, as well as the effect of the dopamine D 1 receptor agonist SKF-81297 and D 2 agonist quinpirole at probability levels of 100% and 25%. d-Amphetamine increased unprofitable choices in a dose-dependent manner at the two lowest probability levels. Quinpirole increased the frequency of unprofitable decisions at the 25% probability level, and SKF-82197 did not affect choice behavior. These results mirror the findings of probabilistic discounting studies using food-restricted rats. Based on this, the use of AA rats provides a new approach for studies on reward-guided decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

  2. Basal forebrain projections to the lateral habenula modulate aggression reward.

    Science.gov (United States)

    Golden, Sam A; Heshmati, Mitra; Flanigan, Meghan; Christoffel, Daniel J; Guise, Kevin; Pfau, Madeline L; Aleyasin, Hossein; Menard, Caroline; Zhang, Hongxing; Hodes, Georgia E; Bregman, Dana; Khibnik, Lena; Tai, Jonathan; Rebusi, Nicole; Krawitz, Brian; Chaudhury, Dipesh; Walsh, Jessica J; Han, Ming-Hu; Shapiro, Matt L; Russo, Scott J

    2016-06-30

    Maladaptive aggressive behaviour is associated with a number of neuropsychiatric disorders and is thought to result partly from the inappropriate activation of brain reward systems in response to aggressive or violent social stimuli. Nuclei within the ventromedial hypothalamus, extended amygdala and limbic circuits are known to encode initiation of aggression; however, little is known about the neural mechanisms that directly modulate the motivational component of aggressive behaviour. Here we established a mouse model to measure the valence of aggressive inter-male social interaction with a smaller subordinate intruder as reinforcement for the development of conditioned place preference (CPP). Aggressors develop a CPP, whereas non-aggressors develop a conditioned place aversion to the intruder-paired context. Furthermore, we identify a functional GABAergic projection from the basal forebrain (BF) to the lateral habenula (lHb) that bi-directionally controls the valence of aggressive interactions. Circuit-specific silencing of GABAergic BF-lHb terminals of aggressors with halorhodopsin (NpHR3.0) increases lHb neuronal firing and abolishes CPP to the intruder-paired context. Activation of GABAergic BF-lHb terminals of non-aggressors with channelrhodopsin (ChR2) decreases lHb neuronal firing and promotes CPP to the intruder-paired context. Finally, we show that altering inhibitory transmission at BF-lHb terminals does not control the initiation of aggressive behaviour. These results demonstrate that the BF-lHb circuit has a critical role in regulating the valence of inter-male aggressive behaviour and provide novel mechanistic insight into the neural circuits modulating aggression reward processing.

  3. Processing of Continuously Provided Punishment and Reward in Children with ADHD and the Modulating Effects of Stimulant Medication : An ERP Study

    NARCIS (Netherlands)

    Groen, Yvonne; Tucha, Oliver; Wijers, Albertus A.; Althaus, Monika

    2013-01-01

    Objectives: Current models of ADHD suggest abnormal reward and punishment sensitivity, but the exact mechanisms are unclear. This study aims to investigate effects of continuous reward and punishment on the processing of performance feedback in children with ADHD and the modulating effects of

  4. Reward deficiency and anti-reward in pain chronification.

    Science.gov (United States)

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  5. A Genetic Polymorphism of the Endogenous Opioid Dynorphin Modulates Monetary Reward Anticipation in the Corticostriatal Loop

    Science.gov (United States)

    Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald

    2014-01-01

    The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse. PMID:24587148

  6. A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

    Directory of Open Access Journals (Sweden)

    Mikhail Votinov

    Full Text Available The dynorphin/κ-opioid receptor (KOP-R system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype of the variable nucleotide tandem repeat (68-bp VNTR functional polymorphism of the prodynorphin (PDYN gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype. We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

  7. A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

    Science.gov (United States)

    Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald; Lamm, Claus; Sailer, Uta

    2014-01-01

    The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

  8. "Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

    Science.gov (United States)

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2012-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

  9. Abstinence duration modulates striatal functioning during monetary reward processing in cocaine patients.

    Science.gov (United States)

    Bustamante, Juan-Carlos; Barrós-Loscertales, Alfonso; Costumero, Víctor; Fuentes-Claramonte, Paola; Rosell-Negre, Patricia; Ventura-Campos, Noelia; Llopis, Juan-José; Ávila, César

    2014-09-01

    Pre-clinical and clinical studies in cocaine addiction highlight alterations in the striatal dopaminergic reward system that subserve maintenance of cocaine use. Using an instrumental conditioning paradigm with monetary reinforcement, we studied striatal functional alterations in long-term abstinent cocaine-dependent patients and striatal functioning as a function of abstinence and treatment duration. Eighteen patients and 20 controls underwent functional magnetic resonance imaging during a Monetary Incentive Delay task. Region of interest analyses based on masks of the dorsal and ventral striatum were conducted to test between-group differences and the functional effects in the cocaine group of time (in months) with no more than two lapses from the first time patients visited the clinical service to seek treatment at the scanning time (duration of treatment), and the functional effects of the number of months with no lapses or relapses at the scanning session time (length of abstinence). We applied a voxel-wise and a cluster-wise FWE-corrected level (pFWE) at a threshold of P reward anticipation than the control group. The regression analyses in the patients group revealed a positive correlation between duration of treatment and brain activity in the left caudate during reward anticipation. Likewise, length of abstinence negatively correlated with brain activity in the bilateral nucleus accumbens during monetary outcome processing. In conclusion, caudate and nucleus accumbens show a different brain response pattern to non-drug rewards during cocaine addiction, which can be modulated by treatment success. © 2013 The Authors, Addiction Biology © 2013 Society for the Study of Addiction.

  10. Autistic Traits Moderate the Impact of Reward Learning on Social Behaviour.

    Science.gov (United States)

    Panasiti, Maria Serena; Puzzo, Ignazio; Chakrabarti, Bhismadev

    2016-04-01

    A deficit in empathy has been suggested to underlie social behavioural atypicalities in autism. A parallel theoretical account proposes that reduced social motivation (i.e., low responsivity to social rewards) can account for the said atypicalities. Recent evidence suggests that autistic traits modulate the link between reward and proxy metrics related to empathy. Using an evaluative conditioning paradigm to associate high and low rewards with faces, a previous study has shown that individuals high in autistic traits show reduced spontaneous facial mimicry of faces associated with high vs. low reward. This observation raises the possibility that autistic traits modulate the magnitude of evaluative conditioning. To test this, we investigated (a) if autistic traits could modulate the ability to implicitly associate a reward value to a social stimulus (reward learning/conditioning, using the Implicit Association Task, IAT); (b) if the learned association could modulate participants' prosocial behaviour (i.e., social reciprocity, measured using the cyberball task); (c) if the strength of this modulation was influenced by autistic traits. In 43 neurotypical participants, we found that autistic traits moderated the relationship of social reward learning on prosocial behaviour but not reward learning itself. This evidence suggests that while autistic traits do not directly influence social reward learning, they modulate the relationship of social rewards with prosocial behaviour. © 2015 The Authors Autism Research published by Wiley Periodicals, Inc. on behalf of International Society for Autism Research.

  11. Serotonergic modulation of reward and punishment

    DEFF Research Database (Denmark)

    Macoveanu, Julian

    2014-01-01

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line......-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor...

  12. Monetary rewards influence retrieval orientations.

    Science.gov (United States)

    Halsband, Teresa M; Ferdinand, Nicola K; Bridger, Emma K; Mecklinger, Axel

    2012-09-01

    Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24 h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.

  13. Monetary reward magnitude effects on behavior and brain function during goal-directed behavior.

    Science.gov (United States)

    Rosell-Negre, P; Bustamante, J C; Fuentes-Claramonte, P; Costumero, V; Benabarre, S; Barrós-Loscertales, A

    2017-08-01

    Reward may modulate the cognitive processes required for goal achievement, while individual differences in personality may affect reward modulation. Our aim was to test how different monetary reward magnitudes modulate brain activation and performance during goal-directed behavior, and whether individual differences in reward sensitivity affect this modulation. For this purpose, we scanned 37 subjects with a parametric design in which we varied the magnitude of monetary rewards (€0, €0.01, €0.5, €1 or €1.5) in a blocked fashion while participants performed an interference counting-Stroop condition. The results showed that the brain activity of left dorsolateral prefrontal cortex (DLPFC) and the striatum were modulated by increasing and decreasing reward magnitudes, respectively. Behavioral performance improved as the magnitude of monetary reward increased while comparing the non reward (€0) condition to any other reward condition, or the lower €0.01 to any other reward condition, and this improvement was related with individual differences in reward sensitivity. In conclusion, the locus of influence of monetary incentives overlaps the activity of the regions commonly involved in cognitive control.

  14. Rewards modulate saccade latency but not exogenous spatial attention.

    Science.gov (United States)

    Dunne, Stephen; Ellison, Amanda; Smith, Daniel T

    2015-01-01

    The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

  15. Rewards modulate saccade latency but not exogenous spatial attention.

    Directory of Open Access Journals (Sweden)

    Stephen eDunne

    2015-07-01

    Full Text Available The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behaviour induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor IOR. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for 3 blocks of extinction trials. However this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

  16. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

    Science.gov (United States)

    Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-09-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  17. Differential Effects of Social and Non-Social Reward on Response Inhibition in Children and Adolescents

    Science.gov (United States)

    Kohls, Gregor; Peltzer, Judith; Herpertz-Dahlmann, Beate; Konrad, Kerstin

    2009-01-01

    An important issue in the field of clinical and developmental psychopathology is whether cognitive control processes, such as response inhibition, can be specifically enhanced by motivation. To determine whether non-social (i.e. monetary) and social (i.e. positive facial expressions) rewards are able to differentially improve response inhibition…

  18. Neural correlates of sample-coding and reward-coding in the delay activity of neurons in the entopallium and nidopallium caudolaterale of pigeons (Columba livia).

    Science.gov (United States)

    Johnston, Melissa; Anderson, Catrona; Colombo, Michael

    2017-01-15

    We recorded neuronal activity from the nidopallium caudolaterale, the avian equivalent of mammalian prefrontal cortex, and the entopallium, the avian equivalent of the mammalian visual cortex, in four birds trained on a differential outcomes delayed matching-to-sample procedure in which one sample stimulus was followed by reward and the other was not. Despite similar incidence of reward-specific and reward-unspecific delay cell types across the two areas, overall entopallium delay activity occurred following both rewarded and non-rewarded stimuli, whereas nidopallium caudolaterale delay activity tended to occur following the rewarded stimulus but not the non-rewarded stimulus. These findings are consistent with the view that delay activity in entopallium represents a code of the sample stimulus whereas delay activity in nidopallium caudolaterale represents a code of the possibility of an upcoming reward. However, based on the types of delay cells encountered, cells in NCL also code the sample stimulus and cells in ENTO are influenced by reward. We conclude that both areas support the retention of information, but that the activity in each area is differentially modulated by factors such as reward and attentional mechanisms. Copyright © 2016 Elsevier B.V. All rights reserved.

  19. Motivational state, reward value, and Pavlovian cues differentially affect skilled forelimb grasping in rats

    Science.gov (United States)

    de Clauser, Larissa; Kasper, Hansjörg; Schwab, Martin E.

    2016-01-01

    Motor skills represent high-precision movements performed at optimal speed and accuracy. Such motor skills are learned with practice over time. Besides practice, effects of motivation have also been shown to influence speed and accuracy of movements, suggesting that fast movements are performed to maximize gained reward over time as noted in previous studies. In rodents, skilled motor performance has been successfully modeled with the skilled grasping task, in which animals use their forepaw to grasp for sugar pellet rewards through a narrow window. Using sugar pellets, the skilled grasping task is inherently tied to motivation processes. In the present study, we performed three experiments modulating animals’ motivation during skilled grasping by changing the motivational state, presenting different reward value ratios, and displaying Pavlovian stimuli. We found in all three studies that motivation affected the speed of skilled grasping movements, with the strongest effects seen due to motivational state and reward value. Furthermore, accuracy of the movement, measured in success rate, showed a strong dependence on motivational state as well. Pavlovian cues had only minor effects on skilled grasping, but results indicate an inverse Pavlovian-instrumental transfer effect on movement speed. These findings have broad implications considering the increasing use of skilled grasping in studies of motor system structure, function, and recovery after injuries. PMID:27194796

  20. Cognitive regulation of saccadic velocity by reward prospect.

    Science.gov (United States)

    Chen, Lewis L; Hung, Leroy Y; Quinet, Julie; Kosek, Kevin

    2013-08-01

    It is known that expectation of reward speeds up saccades. Past studies have also shown the presence of a saccadic velocity bias in the orbit, resulting from a biomechanical regulation over varying eccentricities. Nevertheless, whether and how reward expectation interacts with the biomechanical regulation of saccadic velocities over varying eccentricities remains unknown. We addressed this question by conducting a visually guided double-step saccade task. The role of reward expectation was tested in monkeys performing two consecutive horizontal saccades, one associated with reward prospect and the other not. To adequately assess saccadic velocity and avoid adaptation, we systematically varied initial eye positions, saccadic directions and amplitudes. Our results confirmed the existence of a velocity bias in the orbit, i.e., saccadic peak velocity decreased linearly as the initial eye position deviated in the direction of the saccade. The slope of this bias increased as saccadic amplitudes increased. Nevertheless, reward prospect facilitated velocity to a greater extent for saccades away from than for saccades toward the orbital centre, rendering an overall reduction in the velocity bias. The rate (slope) and magnitude (intercept) of reward modulation over this velocity bias were linearly correlated with amplitudes, similar to the amplitude-modulated velocity bias without reward prospect, which presumably resulted from a biomechanical regulation. Small-amplitude (≤ 5°) saccades received little modulation. These findings together suggest that reward expectation modulated saccadic velocity not as an additive signal but as a facilitating mechanism that interacted with the biomechanical regulation. © 2013 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

  1. Distinct Reward Properties are Encoded via Corticostriatal Interactions

    OpenAIRE

    David V. Smith; Anastasia E. Rigney; Mauricio R. Delgado

    2016-01-01

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nu...

  2. Health interest modulates brain reward responses to a perceived low-caloric beverage in females.

    Science.gov (United States)

    van Rijn, Inge; Wegman, Joost; Aarts, Esther; de Graaf, Cees; Smeets, Paul A M

    2017-01-01

    Health labels are omnipresent in the supermarket. Such labels give rise to expectations about the product experience and may change flavor perception and perceived reward value. Consumers vary in their degree of health interest and may be differentially affected by such labels. However, how health interest influences neural reward responses to anticipation and receipt of heath-labeled foods is not known. This study assessed to what extent brain responses induced by anticipation and receipt of a beverage with different levels of perceived caloric content are associated with health interest. Twenty-five females completed an fMRI motivational taste-task in which they were presented with a low-caloric cue or a high-caloric cue and subsequently worked for sips of lemonade by moving a joystick. If they responded correctly and in time, they received the lemonade as a reward. Because of the 2 cue types, participants believed they were receiving 2 different lemonades, a high-caloric (HC-receipt) and a low-caloric (LC-receipt) one. Health interest was assessed with the General health interest subscale of the Health and Taste Attitude Scales. Health interest scores correlated significantly (r = .65) with LC-versus HC-receipt activation in the dorsal striatum (putamen), a region involved in encoding food reward. These findings suggest that the reward value of a healthy product compared to its unhealthy counterpart increases with health interest. This provides more insight into the working mechanism of government campaigns that focus on increasing health interest to encourage the formation of healthy eating habits. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  3. Reward and Attentional Control in Visual Search

    Science.gov (United States)

    Anderson, Brian A.; Wampler, Emma K.; Laurent, Patryk A.

    2015-01-01

    It has long been known that the control of attention in visual search depends both on voluntary, top-down deployment according to context-specific goals, and on involuntary, stimulus-driven capture based on the physical conspicuity of perceptual objects. Recent evidence suggests that pairing target stimuli with reward can modulate the voluntary deployment of attention, but there is little evidence that reward modulates the involuntary deployment of attention to task-irrelevant distractors. We report several experiments that investigate the role of reward learning on attentional control. Each experiment involved a training phase and a test phase. In the training phase, different colors were associated with different amounts of monetary reward. In the test phase, color was not task-relevant and participants searched for a shape singleton; in most experiments no reward was delivered in the test phase. We first show that attentional capture by physically salient distractors is magnified by a previous association with reward. In subsequent experiments we demonstrate that physically inconspicuous stimuli previously associated with reward capture attention persistently during extinction—even several days after training. Furthermore, vulnerability to attentional capture by high-value stimuli is negatively correlated across individuals with working memory capacity and positively correlated with trait impulsivity. An analysis of intertrial effects reveals that value-driven attentional capture is spatially specific. Finally, when reward is delivered at test contingent on the task-relevant shape feature, recent reward history modulates value-driven attentional capture by the irrelevant color feature. The influence of learned value on attention may provide a useful model of clinical syndromes characterized by similar failures of cognitive control, including addiction, attention-deficit/hyperactivity disorder, and obesity. PMID:23437631

  4. Deep brain stimulation of the subthalamic nucleus modulates reward processing and action selection in Parkinson patients.

    Science.gov (United States)

    Wagenbreth, Caroline; Zaehle, Tino; Galazky, Imke; Voges, Jürgen; Guitart-Masip, Marc; Heinze, Hans-Jochen; Düzel, Emrah

    2015-06-01

    Deep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for motor impairments in Parkinson's disease (PD) but its effect on the motivational regulation of action control is still not fully understood. We investigated whether DBS of the STN influences the ability of PD patients to act for anticipated reward or loss, or whether DBS improves action execution independent of motivational valence. 16 PD patients (12 male, mean age = 58.5 ± 10.17 years) treated with bilateral STN-DBS and an age- and gender-matched group of healthy controls (HC) performed a go/no-go task whose contingencies explicitly decouple valence and action. Patients were tested with (ON) and without (OFF) active STN stimulation. For HC, there was a benefit in performing rewarded actions when compared to actions that avoided punishment. PD patients showed such a benefit reliably only when STN stimulation was ON. In fact, the relative behavioral benefit for go for reward over go to avoid losing was stronger in the PD patients under DBS ON than in HC. In PD patients, rather than generally improving motor functions independent of motivational valence, modulation of the STN by DBS improves action execution specifically when rewards are anticipated. Thus, STN-DBS establishes a reliable congruency between action and reward ("Pavlovian congruency") and remarkably enhances it over the level observed in HC.

  5. The differential effects of tangible rewards and praise on intrinsic motivation: A comparison of cognitive evaluation theory and operant theory.

    Science.gov (United States)

    Carton, J S

    1996-01-01

    Substantial research indicates that tangible rewards, such as money, prizes, and tokens, decrease response rates by undermining intrinsic motivation. In contrast, praise appears to increase response rates by enhancing intrinsic motivation. Based on their interpretation of available evidence, many social-cognitive researchers warn not to use tangible rewards in applied settings and to use praise instead. Furthermore, they suggest that the differential effects of the two types of rewards on intrinsic motivation cannot be explained using principles of operant psychology. Cognitive evaluation theory provides one of the most recent and widely cited social-cognitive explanations for the different effects of the two types of rewards on intrinsic motivation (Deci & Ryan, 1985). However, a review of existing research found little support for the explanations based on this theory and revealed three potential confounding effects: (a) temporal contiguity, (b) the number of reward administrations, and (c) discriminative stimuli associated with reward availability. These three confounding factors provide explanations for the effects of tangible rewards and praise on intrinsic motivation that are consistent with principles of operant psychology.

  6. Reward modulates oculomotor competition between differently valued stimuli

    NARCIS (Netherlands)

    Bucker, B.; Silvis, J.D.; Donk, M.; Theeuwes, J.

    2015-01-01

    The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate

  7. “Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

    OpenAIRE

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2012-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they...

  8. Emotional modulation of control dilemmas: the role of positive affect, reward, and dopamine in cognitive stability and flexibility.

    Science.gov (United States)

    Goschke, Thomas; Bolte, Annette

    2014-09-01

    Goal-directed action in changing environments requires a dynamic balance between complementary control modes, which serve antagonistic adaptive functions (e.g., to shield goals from competing responses and distracting information vs. to flexibly switch between goals and behavioral dispositions in response to significant changes). Too rigid goal shielding promotes stability but incurs a cost in terms of perseveration and reduced flexibility, whereas too weak goal shielding promotes flexibility but incurs a cost in terms of increased distractibility. While research on cognitive control has long been conducted relatively independently from the study of emotion and motivation, it is becoming increasingly clear that positive affect and reward play a central role in modulating cognitive control. In particular, evidence from the past decade suggests that positive affect not only influences the contents of cognitive processes, but also modulates the balance between complementary modes of cognitive control. In this article we review studies from the past decade that examined effects of induced positive affect on the balance between cognitive stability and flexibility with a focus on set switching and working memory maintenance and updating. Moreover, we review recent evidence indicating that task-irrelevant positive affect and performance-contingent rewards exert different and sometimes opposite effects on cognitive control modes, suggesting dissociations between emotional and motivational effects of positive affect. Finally, we critically review evidence for the popular hypothesis that effects of positive affect may be mediated by dopaminergic modulations of neural processing in prefrontal and striatal brain circuits, and we refine this "dopamine hypothesis of positive affect" by specifying distinct mechanisms by which dopamine may mediate effects of positive affect and reward on cognitive control. We conclude with a discussion of limitations of current research, point to

  9. Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity

    Science.gov (United States)

    Warlaumont, Anne S.; Finnegan, Megan K.

    2016-01-01

    At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant’s nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model’s frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one’s own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic vocalizations develop

  10. Multilinear intertwining differential operators from new generalized Verma modules

    International Nuclear Information System (INIS)

    Dobrev, V.K.

    1998-01-01

    The present contribution contains two interrelated developments. First are proposed new generalized Verma modules. They are called k-Verma modules (k is a natural number) and coincide with the usual Verma modules for k=1. As a vector space, a k-Verma module is isomorphic to the symmetric tensor product of k copies of the universal enveloping algebra U(G -1 ) of the lowering generators of any simple Lie algebra G. The second development is the proposal of a procedure for constructing multilinear intertwining differential operators for semisimple Lie groups G. This procedure uses the k-Verma modules and, for k=1, coincides with our procedure for constructing linear intertwining differential operators. For all k, a central role is played by the singular vectors of the k-Verma modules. Explicit formulas for series of such singular vectors are given. With the aid of these, many new examples of multilinear intertwining differential operators are given explicitly. In particular, all bilinear intertwining differential operators are given explicitly for G=SL(2R). With the aid of the latter, (n/2)-differentials for all even natural n are constructed as an application, the ordinary Schwarzian corresponding to the case of n=4. As another application, a new hierarchy of nonlinear equations is proposed, the lowest member being the KdV equation

  11. Processing of Continuously Provided Punishment and Reward in Children with ADHD and the Modulating Effects of Stimulant Medication: An ERP Study

    OpenAIRE

    Groen, Yvonne; Tucha, Oliver; Wijers, Albertus A.; Althaus, Monika

    2013-01-01

    OBJECTIVES: Current models of ADHD suggest abnormal reward and punishment sensitivity, but the exact mechanisms are unclear. This study aims to investigate effects of continuous reward and punishment on the processing of performance feedback in children with ADHD and the modulating effects of stimulant medication. METHODS: 15 Methylphenidate (Mph)-treated and 15 Mph-free children of the ADHD-combined type and 17 control children performed a selective attention task with three feedback conditi...

  12. Favorite brands as cultural objects modulate reward circuit.

    Science.gov (United States)

    Schaefer, Michael; Rotte, Michael

    2007-01-22

    On the basis of the hypothesis that brands may function as reward stimuli, we investigated brain responses to favorite brands. Participants viewed brand logos while we measured cortical activity with functional magnetic resonance imaging. Results revealed activity in the striatum for favorite brands that positively correlated with sports and luxury characteristics, but negatively with attributions to a brand of rational choice. Reduced activation of a single region in the dorsolateral prefrontal cortex was demonstrated when viewing the most beloved brand, possibly suggesting reduced strategic reasoning on the basis of affect. The results propose that brands that have been associated with appetitive stimuli owing to marketing efforts engage brain networks similar to those engaged by artificially associated reward stimuli. Moreover, social stimuli may function as secondary inducers of reward mechanisms.

  13. Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

    Science.gov (United States)

    Murayama, Kou; Kitagami, Shinji

    2014-02-01

    Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

  14. Reward, Context, and Human Behaviour

    Directory of Open Access Journals (Sweden)

    Clare L. Blaukopf

    2007-01-01

    Full Text Available Animal models of reward processing have revealed an extensive network of brain areas that process different aspects of reward, from expectation and prediction to calculation of relative value. These results have been confirmed and extended in human neuroimaging to encompass secondary rewards more unique to humans, such as money. The majority of the extant literature covers the brain areas associated with rewards whilst neglecting analysis of the actual behaviours that these rewards generate. This review strives to redress this imbalance by illustrating the importance of looking at the behavioural outcome of rewards and the context in which they are produced. Following a brief review of the literature of reward-related activity in the brain, we examine the effect of reward context on actions. These studies reveal how the presence of reward vs. reward and punishment, or being conscious vs. unconscious of reward-related actions, differentially influence behaviour. The latter finding is of particular importance given the extent to which animal models are used in understanding the reward systems of the human mind. It is clear that further studies are needed to learn about the human reaction to reward in its entirety, including any distinctions between conscious and unconscious behaviours. We propose that studies of reward entail a measure of the animal's (human or nonhuman knowledge of the reward and knowledge of its own behavioural outcome to achieve that reward.

  15. The role of the dorsal raphé nucleus in reward-seeking behavior

    Directory of Open Access Journals (Sweden)

    Kae eNakamura

    2013-08-01

    Full Text Available Pharmacological experiments have shown that the modulation of brain serotonin levels has a strong impact on value-based decision making. Anatomical and physiological evidence also revealed that the dorsal raphé nucleus (DRN, a major source of serotonin, and the dopamine system receive common inputs from brain regions associated with appetitive and aversive information processing. The serotonin and dopamine systems also have reciprocal functional influences on each other. However, the specific mechanism by which serotonin affects value-based decision making is not clear.To understand the information carried by the DRN for reward-seeking behavior, we measured single neuron activity in the primate DRN during the performance of saccade tasks to obtain different amounts of a reward. We found that DRN neuronal activity was characterized by tonic modulation that was altered by the expected and received reward value. Consistent reward-dependent modulation across different task periods suggested that DRN activity kept track of the reward value throughout a trial. The DRN was also characterized by modulation of its activity in the opposite direction by different neuronal subgroups, one firing strongly for the prediction and receipt of large rewards, with the other firing strongly for small rewards. Conversely, putative dopamine neurons showed positive phasic responses to reward-indicating cues and the receipt of an unexpected reward amount, which supports the reward prediction error signal hypothesis of dopamine.I suggest that the tonic reward monitoring signal of the DRN, possibly together with its interaction with the dopamine system, reports a continuous level of motivation throughout the performance of a task. Such a signal may provide reward context information to the targets of DRN projections, where it may be integrated further with incoming motivationally salient information.

  16. The endocannabinoid system and nondrug rewarding behaviours.

    Science.gov (United States)

    Fattore, Liana; Melis, Miriam; Fadda, Paola; Pistis, Marco; Fratta, Walter

    2010-07-01

    Rewarding behaviours such as sexual activity, eating, nursing, parenting, social interactions, and play activity are conserved strongly in evolution, and they are essential for development and survival. All of these behaviours are enjoyable and represent pleasant experiences with a high reward value. Remarkably, rewarding behaviours activate the same brain circuits that mediate the positive reinforcing effects of drugs of abuse and of other forms of addiction, such as gambling and food addiction. Given the involvement of the endocannabinoid system in a variety of physiological functions of the nervous system, it is not surprising that it takes part in the complex machinery that regulates gratification and perception of pleasure. In this review, we focus first on the role of the endocannabinoid system in the modulation of neural activity and synaptic functions in brain regions that are involved in natural and nonnatural rewards (namely, the ventral tegmental area, striatum, amygdala, and prefrontal cortex). Then, we examine the role of the endocannabinoid system in modulating behaviours that directly or indirectly activate these brain reward pathways. More specifically, current knowledge of the effects of the pharmacological manipulation of the endocannabinoid system on natural (eating, sexual behaviour, parenting, and social play) and pathological (gambling) rewarding behaviours is summarised and discussed. Copyright 2010 Elsevier Inc. All rights reserved.

  17. Perceived life stress exposure modulates reward-related medial prefrontal cortex responses to acute stress in depression.

    Science.gov (United States)

    Kumar, Poornima; Slavich, George M; Berghorst, Lisa H; Treadway, Michael T; Brooks, Nancy H; Dutra, Sunny J; Greve, Douglas N; O'Donovan, Aoife; Bleil, Maria E; Maninger, Nicole; Pizzagalli, Diego A

    2015-07-15

    Major depressive disorder (MDD) is often precipitated by life stress and growing evidence suggests that stress-induced alterations in reward processing may contribute to such risk. However, no human imaging studies have examined how recent life stress exposure modulates the neural systems that underlie reward processing in depressed and healthy individuals. In this proof-of-concept study, 12 MDD and 10 psychiatrically healthy individuals were interviewed using the Life Events and Difficulties Schedule (LEDS) to assess their perceived levels of recent acute and chronic life stress exposure. Additionally, each participant performed a monetary incentive delay task under baseline (no-stress) and stress (social-evaluative) conditions during functional MRI. Across groups, medial prefrontal cortex (mPFC) activation to reward feedback was greater during acute stress versus no-stress conditions in individuals with greater perceived stressor severity. Under acute stress, depressed individuals showed a positive correlation between perceived stressor severity levels and reward-related mPFC activation (r=0.79, p=0.004), whereas no effect was found in healthy controls. Moreover, for depressed (but not healthy) individuals, the correlations between the stress (r=0.79) and no-stress (r=-0.48) conditions were significantly different. Finally, relative to controls, depressed participants showed significantly reduced mPFC gray matter, but functional findings remained robust while accounting for structural differences. Small sample size, which warrants replication. Depressed individuals experiencing greater recent life stress recruited the mPFC more under stress when processing rewards. Our results represent an initial step toward elucidating mechanisms underlying stress sensitization and recurrence in depression. Copyright © 2015 Elsevier B.V. All rights reserved.

  18. Monetary Reward and Punishment to Response Inhibition Modulate Activation and Synchronization Within the Inhibitory Brain Network

    Directory of Open Access Journals (Sweden)

    Rupesh K. Chikara

    2018-03-01

    Full Text Available A reward or punishment can modulate motivation and emotions, which in turn affect cognitive processing. The present simultaneous functional magnetic resonance imaging-electroencephalography study examines neural mechanisms of response inhibition under the influence of a monetary reward or punishment by implementing a modified stop-signal task in a virtual battlefield scenario. The participants were instructed to play as snipers who open fire at a terrorist target but withhold shooting in the presence of a hostage. The participants performed the task under three different feedback conditions in counterbalanced order: a reward condition where each successfully withheld response added a bonus (i.e., positive feedback to the startup credit, a punishment condition where each failure in stopping deduced a penalty (i.e., negative feedback, and a no-feedback condition where response outcome had no consequences and served as a control setting. Behaviorally both reward and punishment conditions led to significantly down-regulated inhibitory function in terms of the critical stop-signal delay. As for the neuroimaging results, increased activities were found for the no-feedback condition in regions previously reported to be associated with response inhibition, including the right inferior frontal gyrus and the pre-supplementary motor area. Moreover, higher activation of the lingual gyrus, posterior cingulate gyrus (PCG and inferior parietal lobule were found in the reward condition, while stronger activation of the precuneus gyrus was found in the punishment condition. The positive feedback was also associated with stronger changes of delta, theta, and alpha synchronization in the PCG than were the negative or no-feedback conditions. These findings depicted the intertwining relationship between response inhibition and motivation networks.

  19. Reward and relief dimensions of temptation to drink: construct validity and role in predicting differential benefit from acamprosate and naltrexone.

    Science.gov (United States)

    Roos, Corey R; Mann, Karl; Witkiewitz, Katie

    2017-11-01

    Researchers have sought to distinguish between individuals whose alcohol use disorder (AUD) is maintained by drinking to relieve negative affect ('relief drinkers') and those whose AUD is maintained by the rewarding effects of alcohol ('reward drinkers'). As an opioid receptor antagonist, naltrexone may be particularly effective for reward drinkers. Acamprosate, which has been shown to down-regulate the glutamatergic system, may be particularly effective for relief drinkers. This study sought to replicate and extend prior work (PREDICT study; Glöckner-Rist et al. ) by examining dimensions of reward and relief temptation to drink and subtypes of individuals with distinct patterns of reward/relief temptation. We utilized data from two randomized clinical trials for AUD (Project MATCH, n = 1726 and COMBINE study, n = 1383). We also tested whether classes of reward/relief temptation would predict differential response to naltrexone and acamprosate in COMBINE. Results replicated prior work by identifying reward and relief temptation factors, which had excellent reliability and construct validity. Using factor mixture modeling, we identified five distinct classes of reward/relief temptation that replicated across studies. In COMBINE, we found a significant class-by-acamprosate interaction effect. Among those most likely classified in the high relief/moderate reward temptation class, individuals had better drinking outcomes if assigned to acamprosate versus placebo. We did not find a significant class-by-naltrexone interaction effect. Our study questions the orthogonal classification of drinkers into only two types (reward or relief drinkers) and adds to the body of research on moderators of acamprosate, which may inform clinical decision making in the treatment of AUD. © 2016 Society for the Study of Addiction.

  20. Endocannabinoid signaling in reward and addiction

    Science.gov (United States)

    Parsons, Loren H.; Hurd, Yasmin L.

    2015-01-01

    Brain endocannabinoid signaling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated endocannabinoid signaling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired endocannabinoid signaling contributes to dysregulated synaptic plasticity, increased stress responsivity, negative emotional states, and craving that propel addiction. Understanding the contributions of endocannabinoid disruptions to behavioral and physiological traits provides insight into the endocannabinoid influence on addiction vulnerability. PMID:26373473

  1. Lighting up the brain's reward circuitry.

    Science.gov (United States)

    Lobo, Mary Kay

    2012-07-01

    The brain's reward circuit is critical for mediating natural reward behaviors including food, sex, and social interaction. Drugs of abuse take over this circuit and produce persistent molecular and cellular alterations in the brain regions and their neural circuitry that make up the reward pathway. Recent use of optogenetic technologies has provided novel insights into the functional and molecular role of the circuitry and cell subtypes within these circuits that constitute this pathway. This perspective will address the current and future use of light-activated proteins, including those involved in modulating neuronal activity, cellular signaling, and molecular properties in the neural circuitry mediating rewarding stimuli and maladaptive responses to drugs of abuse. © 2012 New York Academy of Sciences.

  2. Differential Space-Time Block Code Modulation for DS-CDMA Systems

    Directory of Open Access Journals (Sweden)

    Liu Jianhua

    2002-01-01

    Full Text Available A differential space-time block code (DSTBC modulation scheme is used to improve the performance of DS-CDMA systems in fast time-dispersive fading channels. The resulting scheme is referred to as the differential space-time block code modulation for DS-CDMA (DSTBC-CDMA systems. The new modulation and demodulation schemes are especially studied for the down-link transmission of DS-CDMA systems. We present three demodulation schemes, referred to as the differential space-time block code Rake (D-Rake receiver, differential space-time block code deterministic (D-Det receiver, and differential space-time block code deterministic de-prefix (D-Det-DP receiver, respectively. The D-Det receiver exploits the known information of the spreading sequences and their delayed paths deterministically besides the Rake type combination; consequently, it can outperform the D-Rake receiver, which employs the Rake type combination only. The D-Det-DP receiver avoids the effect of intersymbol interference and hence can offer better performance than the D-Det receiver.

  3. Differential Contributions of Nucleus Accumbens Subregions to Cue-Guided Risk/Reward Decision Making and Implementation of Conditional Rules.

    Science.gov (United States)

    Floresco, Stan B; Montes, David R; Tse, Maric M T; van Holstein, Mieke

    2018-02-21

    associated with neuropsychiatric disorders, such as attention deficit hyperactivity disorder and schizophrenia, which in turn has been linked to aberrant processing in the nucleus accumbens. However, many preclinical studies have often assessed risk/reward decision making in the absence of explicit cues. The current study fills that gap by using a novel task that allows for the assessment of cue-guided risk/reward decision making in rodents. Our findings identified distinct yet complementary roles for the medial versus lateral portions of this nucleus that provide a broader understanding of the differential contributions it makes to decision making and reward seeking guided by discriminative stimuli. Copyright © 2018 the authors 0270-6474/18/381901-14$15.00/0.

  4. Reward speeds up and increases consistency of visual selective attention: a lifespan comparison.

    Science.gov (United States)

    Störmer, Viola; Eppinger, Ben; Li, Shu-Chen

    2014-06-01

    Children and older adults often show less favorable reward-based learning and decision making, relative to younger adults. It is unknown, however, whether reward-based processes that influence relatively early perceptual and attentional processes show similar lifespan differences. In this study, we investigated whether stimulus-reward associations affect selective visual attention differently across the human lifespan. Children, adolescents, younger adults, and older adults performed a visual search task in which the target colors were associated with either high or low monetary rewards. We discovered that high reward value speeded up response times across all four age groups, indicating that reward modulates attentional selection across the lifespan. This speed-up in response time was largest in younger adults, relative to the other three age groups. Furthermore, only younger adults benefited from high reward value in increasing response consistency (i.e., reduction of trial-by-trial reaction time variability). Our findings suggest that reward-based modulations of relatively early and implicit perceptual and attentional processes are operative across the lifespan, and the effects appear to be greater in adulthood. The age-specific effect of reward on reducing intraindividual response variability in younger adults likely reflects mechanisms underlying the development and aging of reward processing, such as lifespan age differences in the efficacy of dopaminergic modulation. Overall, the present results indicate that reward shapes visual perception across different age groups by biasing attention to motivationally salient events.

  5. Ethanol Exposure History and Alcoholic Reward Differentially Alter Dopamine Release in the Nucleus Accumbens to a Reward-Predictive Cue.

    Science.gov (United States)

    Fiorenza, Amanda M; Shnitko, Tatiana A; Sullivan, Kaitlin M; Vemuru, Sudheer R; Gomez-A, Alexander; Esaki, Julie Y; Boettiger, Charlotte A; Da Cunha, Claudio; Robinson, Donita L

    2018-06-01

    Conditioned stimuli (CS) that predict reward delivery acquire the ability to induce phasic dopamine release in the nucleus accumbens (NAc). This dopamine release may facilitate conditioned approach behavior, which often manifests as approach to the site of reward delivery (called "goal-tracking") or to the CS itself (called "sign-tracking"). Previous research has linked sign-tracking in particular to impulsivity and drug self-administration, and addictive drugs may promote the expression of sign-tracking. Ethanol (EtOH) acutely promotes phasic release of dopamine in the accumbens, but it is unknown whether an alcoholic reward alters dopamine release to a CS. We hypothesized that Pavlovian conditioning with an alcoholic reward would increase dopamine release triggered by the CS and subsequent sign-tracking behavior. Moreover, we predicted that chronic intermittent EtOH (CIE) exposure would promote sign-tracking while acute administration of naltrexone (NTX) would reduce it. Rats received 14 doses of EtOH (3 to 5 g/kg, intragastric) or water followed by 6 days of Pavlovian conditioning training. Rewards were a chocolate solution with or without 10% (w/v) alcohol. We used fast-scan cyclic voltammetry to measure phasic dopamine release in the NAc core in response to the CS and the rewards. We also determined the effect of NTX (1 mg/kg, subcutaneous) on conditioned approach. Both CIE and alcoholic reward, individually but not together, associated with greater dopamine to the CS than control conditions. However, this increase in dopamine release was not linked to greater sign-tracking, as both CIE and alcoholic reward shifted conditioned approach from sign-tracking behavior to goal-tracking behavior. However, they both also increased sensitivity to NTX, which reduced goal-tracking behavior. While a history of EtOH exposure or alcoholic reward enhanced dopamine release to a CS, they did not promote sign-tracking under the current conditions. These findings are

  6. Reward-Enhanced Memory in Younger and Older Adults

    OpenAIRE

    Julia Spaniol; Cécile Schain; Holly J. Bowen

    2014-01-01

    Objectives. We investigated how the anticipation of remote monetary reward modulates intentional episodic memory formation in younger and older adults. On the basis of prior findings of preserved reward–cognition interactions in aging, we predicted that reward anticipation would be associated with enhanced memory in both younger and older adults. On the basis of previous demonstrations of a time-dependent effect of reward anticipation on memory, we expected the memory enhancement to increase ...

  7. Reward retroactively enhances memory consolidation for related items

    OpenAIRE

    Patil, Anuya; Murty, Vishnu P.; Dunsmoor, Joseph E.; Phelps, Elizabeth A.; Davachi, Lila

    2017-01-01

    Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated the influence of reward motivation on retroactive memory enhancement selectively for conceptually related information. We found behavioral evidence...

  8. Reward salience and risk aversion underlie differential ACC activity in substance dependence.

    Science.gov (United States)

    Alexander, William H; Fukunaga, Rena; Finn, Peter; Brown, Joshua W

    2015-01-01

    The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC), has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs), while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.

  9. The globus pallidus sends reward-related signals to the lateral habenula.

    Science.gov (United States)

    Hong, Simon; Hikosaka, Okihide

    2008-11-26

    As a major output station of the basal ganglia, the globus pallidus internal segment (GPi) projects to the thalamus and brainstem nuclei thereby controlling motor behavior. A less well known fact is that the GPi also projects to the lateral habenula (LHb) which is often associated with the limbic system. Using the monkey performing a saccade task with positionally biased reward outcomes, we found that antidromically identified LHb-projecting neurons were distributed mainly in the dorsal and ventral borders of the GPi and that their activity was strongly modulated by expected reward outcomes. A majority of them were excited by the no-reward-predicting target and inhibited by the reward-predicting target. These reward-dependent modulations were similar to those in LHb neurons but started earlier than those in LHb neurons. These results suggest that GPi may initiate reward-related signals through its effects on the LHb, which then influences the dopaminergic and serotonergic systems.

  10. Do Substantia Nigra Dopaminergic Neurons Differentiate Between Reward and Punishment?

    Institute of Scientific and Technical Information of China (English)

    Michael J. Frank; D. James Surmeier

    2009-01-01

    The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either rewarding or aversive outcomes increase the activity of dopaminergic neurons in the substantia nigra pars compacta.

  11. Imbalance in the sensitivity to different types of rewards in pathological gambling.

    Science.gov (United States)

    Sescousse, Guillaume; Barbalat, Guillaume; Domenech, Philippe; Dreher, Jean-Claude

    2013-08-01

    Pathological gambling is an addictive disorder characterized by a persistent and compulsive desire to engage in gambling activities. This maladaptive behaviour has been suggested to result from a decreased sensitivity to experienced rewards, regardless of reward type. Alternatively, pathological gambling might reflect an imbalance in the sensitivity to monetary versus non-monetary incentives. To directly test these two hypotheses, we examined how the brain reward circuit of pathological gamblers responds to different types of rewards. Using functional magnetic resonance imaging, we compared the brain responses of 18 pathological gamblers and 20 healthy control subjects while they engaged in a simple incentive task manipulating both monetary and visual erotic rewards. During reward anticipation, the ventral striatum of pathological gamblers showed a differential response to monetary versus erotic cues, essentially driven by a blunted reactivity to cues predicting erotic stimuli. This differential response correlated with the severity of gambling symptoms and was paralleled by a reduced behavioural motivation for erotic rewards. During reward outcome, a posterior orbitofrontal cortex region, responding to erotic rewards in both groups, was further recruited by monetary gains in pathological gamblers but not in control subjects. Moreover, while ventral striatal activity correlated with subjective ratings assigned to monetary and erotic rewards in control subjects, it only correlated with erotic ratings in gamblers. Our results point to a differential sensitivity to monetary versus non-monetary rewards in pathological gambling, both at the motivational and hedonic levels. Such an imbalance might create a bias towards monetary rewards, potentially promoting addictive gambling behaviour.

  12. Trial-by-Trial Modulation of Associative Memory Formation by Reward Prediction Error and Reward Anticipation as Revealed by a Biologically Plausible Computational Model.

    Science.gov (United States)

    Aberg, Kristoffer C; Müller, Julia; Schwartz, Sophie

    2017-01-01

    Anticipation and delivery of rewards improves memory formation, but little effort has been made to disentangle their respective contributions to memory enhancement. Moreover, it has been suggested that the effects of reward on memory are mediated by dopaminergic influences on hippocampal plasticity. Yet, evidence linking memory improvements to actual reward computations reflected in the activity of the dopaminergic system, i.e., prediction errors and expected values, is scarce and inconclusive. For example, different previous studies reported that the magnitude of prediction errors during a reinforcement learning task was a positive, negative, or non-significant predictor of successfully encoding simultaneously presented images. Individual sensitivities to reward and punishment have been found to influence the activation of the dopaminergic reward system and could therefore help explain these seemingly discrepant results. Here, we used a novel associative memory task combined with computational modeling and showed independent effects of reward-delivery and reward-anticipation on memory. Strikingly, the computational approach revealed positive influences from both reward delivery, as mediated by prediction error magnitude, and reward anticipation, as mediated by magnitude of expected value, even in the absence of behavioral effects when analyzed using standard methods, i.e., by collapsing memory performance across trials within conditions. We additionally measured trait estimates of reward and punishment sensitivity and found that individuals with increased reward (vs. punishment) sensitivity had better memory for associations encoded during positive (vs. negative) prediction errors when tested after 20 min, but a negative trend when tested after 24 h. In conclusion, modeling trial-by-trial fluctuations in the magnitude of reward, as we did here for prediction errors and expected value computations, provides a comprehensive and biologically plausible description of

  13. Modulation of spatial attention by goals, statistical learning, and monetary reward.

    Science.gov (United States)

    Jiang, Yuhong V; Sha, Li Z; Remington, Roger W

    2015-10-01

    This study documented the relative strength of task goals, visual statistical learning, and monetary reward in guiding spatial attention. Using a difficult T-among-L search task, we cued spatial attention to one visual quadrant by (i) instructing people to prioritize it (goal-driven attention), (ii) placing the target frequently there (location probability learning), or (iii) associating that quadrant with greater monetary gain (reward-based attention). Results showed that successful goal-driven attention exerted the strongest influence on search RT. Incidental location probability learning yielded a smaller though still robust effect. Incidental reward learning produced negligible guidance for spatial attention. The 95 % confidence intervals of the three effects were largely nonoverlapping. To understand these results, we simulated the role of location repetition priming in probability cuing and reward learning. Repetition priming underestimated the strength of location probability cuing, suggesting that probability cuing involved long-term statistical learning of how to shift attention. Repetition priming provided a reasonable account for the negligible effect of reward on spatial attention. We propose a multiple-systems view of spatial attention that includes task goals, search habit, and priming as primary drivers of top-down attention.

  14. Music-related reward responses predict episodic memory performance.

    Science.gov (United States)

    Ferreri, Laura; Rodriguez-Fornells, Antoni

    2017-12-01

    Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

  15. Reward Systems in the Brain and Nutrition.

    Science.gov (United States)

    Rolls, Edmund T

    2016-07-17

    The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

  16. Event-related EEG responses to anticipation and delivery of monetary and social reward.

    Science.gov (United States)

    Flores, Amanda; Münte, Thomas F; Doñamayor, Nuria

    2015-07-01

    Monetary and a social incentive delay tasks were used to characterize reward anticipation and delivery with electroencephalography. During reward anticipation, N1, P2 and P3 components were modulated by both prospective reward value and incentive type (monetary or social), suggesting distinctive allocation of attentional and motivational resources depending not only on whether rewards or non-rewards were cued, but also on the monetary and social nature of the prospective outcomes. In the delivery phase, P2, FRN and P3 components were also modulated by levels of reward value and incentive type, illustrating how distinctive affective and cognitive processes were attached to the different outcomes. Our findings imply that neural processing of both reward anticipation and delivery can be specific to incentive type, which might have implications for basic as well as translational research. These results are discussed in the light of previous electrophysiological and neuroimaging work using similar tasks. Copyright © 2015 Elsevier B.V. All rights reserved.

  17. Reward Retroactively Enhances Memory Consolidation for Related Items

    Science.gov (United States)

    Patil, Anuya; Murty, Vishnu P.; Dunsmoor, Joseph E.; Phelps, Elizabeth A.; Davachi, Lila

    2017-01-01

    Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated…

  18. Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

    Science.gov (United States)

    van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

    2014-06-01

    The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

  19. Social anxiety, acute social stress, and reward parameters interact to predict risky decision-making among adolescents.

    Science.gov (United States)

    Richards, Jessica M; Patel, Nilam; Daniele-Zegarelli, Teresa; MacPherson, Laura; Lejuez, C W; Ernst, Monique

    2015-01-01

    Risk-taking behavior increases during adolescence, leading to potentially disastrous consequences. Social anxiety emerges in adolescence and may compound risk-taking propensity, particularly during stress and when reward potential is high. However, the manner in which social anxiety, stress, and reward parameters interact to impact adolescent risk-taking is unclear. To clarify this question, a community sample of 35 adolescents (15-18yo), characterized as having high or low social anxiety, participated in a study over two separate days, during each of which they were exposed to either a social stress or a control condition, while performing a risky decision-making task. The task manipulated, orthogonally, reward magnitude and probability across trials. Three findings emerged. First, reward magnitude had a greater impact on the rate of risky decisions in high social anxiety (HSA) than low social anxiety (LSA) adolescents. Second, reaction times (RTs) were similar during the social stress and the control conditions for the HSA group, whereas the LSA group's RTs differed between conditions. Third, HSA adolescents showed the longest RTs on the most negative trials. These findings suggest that risk-taking in adolescents is modulated by context and reward parameters differentially as a function of social anxiety. Published by Elsevier Ltd.

  20. Social Anxiety, Acute Social Stress, and Reward Parameters Interact to Predict Risky Decision-Making among Adolescents

    Science.gov (United States)

    Richards, Jessica M.; Patel, Nilam; Daniele, Teresa; MacPherson, Laura; Lejuez, C.W.; Ernst, Monique

    2014-01-01

    Risk-taking behavior increases during adolescence, leading to potentially disastrous consequences. Social anxiety emerges in adolescence and may compound risk-taking propensity, particularly during stress and when reward potential is high. However, the manner in which social anxiety, stress, and reward parameters interact to impact adolescent risk-taking is unclear. To clarify this question, a community sample of 35 adolescents (15 to 18 yo), characterized as having high or low social anxiety, participated in a 2-day study, during each of which they were exposed to either a social stress or a control condition, while performing a risky decision-making task. The task manipulated, orthogonally, reward magnitude and probability across trials. Three findings emerged. First, reward magnitude had a greater impact on the rate of risky decisions in high social anxiety (HSA) than low social anxiety (LSA) adolescents. Second, reaction times (RTs) were similar during the social stress and the control conditions for the HSA group, whereas the LSA group’s RTs differed between conditions. Third, HSA adolescents showed the longest RTs on the most negative trials. These findings suggest that risk-taking in adolescents is modulated by context and reward parameters differentially as a function of social anxiety. PMID:25465884

  1. Differentiating Motivational from Affective Influence of Performance-contingent Reward on Cognitive Control: The Wanting Component Enhances Both Proactive and Reactive Control.

    Science.gov (United States)

    Chaillou, Anne-Clémence; Giersch, Anne; Hoonakker, Marc; Capa, Rémi L; Bonnefond, Anne

    2017-04-01

    Positive affect strongly modulates goal-directed behaviors and cognitive control mechanisms. It often results from the presence of a pleasant stimulus in the environment, whether that stimulus appears unpredictably or as a consequence of a particular behavior. The influence of positive affect linked to a random pleasant stimulus differs from the influence of positive affect resulting from performance-contingent pleasant stimuli. However, the mechanisms by which the performance contingency of pleasant stimuli modulates the influence of positive affect on cognitive control mechanisms have not been elucidated. Here, we tested the hypothesis that these differentiated effects are the consequence of the activation of the motivational "wanting" component specifically under performance contingency conditions. To that end, we directly compared the effects on cognitive control of pleasant stimuli (a monetary reward) attributed in a performance contingent manner, and of random pleasant stimuli (positive picture) not related to performance, during an AX-CPT task. Both proactive and reactive modes of control were increased specifically by performance contingency, as reflected by faster reaction times and larger amplitude of the CNV and P3a components. Our findings advance our understanding of the respective effects of affect and motivation, which is of special interest regarding alterations of emotion-motivation interaction found in several psychopathological disorders. Copyright © 2017 Elsevier B.V. All rights reserved.

  2. Learned reward association improves visual working memory.

    Science.gov (United States)

    Gong, Mengyuan; Li, Sheng

    2014-04-01

    Statistical regularities in the natural environment play a central role in adaptive behavior. Among other regularities, reward association is potentially the most prominent factor that influences our daily life. Recent studies have suggested that pre-established reward association yields strong influence on the spatial allocation of attention. Here we show that reward association can also improve visual working memory (VWM) performance when the reward-associated feature is task-irrelevant. We established the reward association during a visual search training session, and investigated the representation of reward-associated features in VWM by the application of a change detection task before and after the training. The results showed that the improvement in VWM was significantly greater for items in the color associated with high reward than for those in low reward-associated or nonrewarded colors. In particular, the results from control experiments demonstrate that the observed reward effect in VWM could not be sufficiently accounted for by attentional capture toward the high reward-associated item. This was further confirmed when the effect of attentional capture was minimized by presenting the items in the sample and test displays of the change detection task with the same color. The results showed significantly larger improvement in VWM performance when the items in a display were in the high reward-associated color than those in the low reward-associated or nonrewarded colors. Our findings suggest that, apart from inducing space-based attentional capture, the learned reward association could also facilitate the perceptual representation of high reward-associated items through feature-based attentional modulation.

  3. Robust fractional order differentiators using generalized modulating functions method

    KAUST Repository

    Liu, Dayan

    2015-02-01

    This paper aims at designing a fractional order differentiator for a class of signals satisfying a linear differential equation with unknown parameters. A generalized modulating functions method is proposed first to estimate the unknown parameters, then to derive accurate integral formulae for the left-sided Riemann-Liouville fractional derivatives of the studied signal. Unlike the improper integral in the definition of the left-sided Riemann-Liouville fractional derivative, the integrals in the proposed formulae can be proper and be considered as a low-pass filter by choosing appropriate modulating functions. Hence, digital fractional order differentiators applicable for on-line applications are deduced using a numerical integration method in discrete noisy case. Moreover, some error analysis are given for noise error contributions due to a class of stochastic processes. Finally, numerical examples are given to show the accuracy and robustness of the proposed fractional order differentiators.

  4. Robust fractional order differentiators using generalized modulating functions method

    KAUST Repository

    Liu, Dayan; Laleg-Kirati, Taous-Meriem

    2015-01-01

    This paper aims at designing a fractional order differentiator for a class of signals satisfying a linear differential equation with unknown parameters. A generalized modulating functions method is proposed first to estimate the unknown parameters, then to derive accurate integral formulae for the left-sided Riemann-Liouville fractional derivatives of the studied signal. Unlike the improper integral in the definition of the left-sided Riemann-Liouville fractional derivative, the integrals in the proposed formulae can be proper and be considered as a low-pass filter by choosing appropriate modulating functions. Hence, digital fractional order differentiators applicable for on-line applications are deduced using a numerical integration method in discrete noisy case. Moreover, some error analysis are given for noise error contributions due to a class of stochastic processes. Finally, numerical examples are given to show the accuracy and robustness of the proposed fractional order differentiators.

  5. Reward prediction error signal enhanced by striatum-amygdala interaction explains the acceleration of probabilistic reward learning by emotion.

    Science.gov (United States)

    Watanabe, Noriya; Sakagami, Masamichi; Haruno, Masahiko

    2013-03-06

    Learning does not only depend on rationality, because real-life learning cannot be isolated from emotion or social factors. Therefore, it is intriguing to determine how emotion changes learning, and to identify which neural substrates underlie this interaction. Here, we show that the task-independent presentation of an emotional face before a reward-predicting cue increases the speed of cue-reward association learning in human subjects compared with trials in which a neutral face is presented. This phenomenon was attributable to an increase in the learning rate, which regulates reward prediction errors. Parallel to these behavioral findings, functional magnetic resonance imaging demonstrated that presentation of an emotional face enhanced reward prediction error (RPE) signal in the ventral striatum. In addition, we also found a functional link between this enhanced RPE signal and increased activity in the amygdala following presentation of an emotional face. Thus, this study revealed an acceleration of cue-reward association learning by emotion, and underscored a role of striatum-amygdala interactions in the modulation of the reward prediction errors by emotion.

  6. The influence of emotion down-regulation on the expectation of sexual reward.

    Science.gov (United States)

    Brom, Mirte; Laan, Ellen; Everaerd, Walter; Spinhoven, Philip; Cousijn, Janna; Both, Stephanie

    2015-05-01

    Emotion regulation research has shown successful altering of unwanted aversive emotional reactions. Cognitive strategies can also regulate expectations of reward arising from conditioned stimuli. However, less is known about the efficacy of such strategies with expectations elicited by conditioned appetitive sexual stimuli, and possible sex differences therein. In the present study it was examined whether a cognitive strategy (attentional deployment) could successfully down-regulate sexual arousal elicited by sexual reward-conditioned cues in men and women. A differential conditioning paradigm was applied, with genital vibrostimulation as unconditioned stimulus (US) and sexually relevant pictures as conditional stimuli (CSs). Evidence was found for emotion down-regulation to effect extinction of conditioned sexual responding in men. In women, the emotion down-regulatory strategy resulted in attenuated conditioned approach tendencies towards the CSs. The findings support that top-down modulation may indeed influence conditioned sexual responses. This knowledge may have implications for treating disturbances in sexual appetitive responses. Copyright © 2015. Published by Elsevier Ltd.

  7. Multi-layer network utilizing rewarded spike time dependent plasticity to learn a foraging task.

    Directory of Open Access Journals (Sweden)

    Pavel Sanda

    2017-09-01

    Full Text Available Neural networks with a single plastic layer employing reward modulated spike time dependent plasticity (STDP are capable of learning simple foraging tasks. Here we demonstrate advanced pattern discrimination and continuous learning in a network of spiking neurons with multiple plastic layers. The network utilized both reward modulated and non-reward modulated STDP and implemented multiple mechanisms for homeostatic regulation of synaptic efficacy, including heterosynaptic plasticity, gain control, output balancing, activity normalization of rewarded STDP and hard limits on synaptic strength. We found that addition of a hidden layer of neurons employing non-rewarded STDP created neurons that responded to the specific combinations of inputs and thus performed basic classification of the input patterns. When combined with a following layer of neurons implementing rewarded STDP, the network was able to learn, despite the absence of labeled training data, discrimination between rewarding patterns and the patterns designated as punishing. Synaptic noise allowed for trial-and-error learning that helped to identify the goal-oriented strategies which were effective in task solving. The study predicts a critical set of properties of the spiking neuronal network with STDP that was sufficient to solve a complex foraging task involving pattern classification and decision making.

  8. Mindfulness meditation modulates reward prediction errors in the striatum in a passive conditioning task

    Directory of Open Access Journals (Sweden)

    Ulrich eKirk

    2015-02-01

    Full Text Available Reinforcement learning models have demonstrated that phasic activity of dopamine neurons during reward expectation encodes information about the predictability of rewards and cues that predict reward. Evidence indicates that mindfulness-based approaches reduce reward anticipation signal in the striatum to negative and positive incentives suggesting the hypothesis that such training influence basic reward processing. Using a passive conditioning task and fMRI in a group of experienced mindfulness meditators and age-matched controls, we tested the hypothesis that mindfulness meditation influence reward and reward prediction error signals. We found diminished positive and negative prediction error-related blood-oxygen level-dependent (BOLD responses in the putamen in meditators compared with controls. In the meditators, this decrease in striatal BOLD responses to reward prediction was paralleled by increased activity in posterior insula, a primary interoceptive region. Critically, responses in the putamen during early trials of the conditioning procedure (run 1 were elevated in both meditators and controls. These results provide evidence that experienced mindfulness meditators show attenuated reward prediction signals to valenced stimuli, which may be related to interoceptive processes encoded in the posterior insula.

  9. Dose Dependent Dopaminergic Modulation of Reward-Based Learning in Parkinson's Disease

    Science.gov (United States)

    van Wouwe, N. C.; Ridderinkhof, K. R.; Band, G. P. H.; van den Wildenberg, W. P. M.; Wylie, S. A.

    2012-01-01

    Learning to select optimal behavior in new and uncertain situations is a crucial aspect of living and requires the ability to quickly associate stimuli with actions that lead to rewarding outcomes. Mathematical models of reinforcement-based learning to select rewarding actions distinguish between (1) the formation of stimulus-action-reward…

  10. Monetary reward modulates task-irrelevant perceptual learning for invisible stimuli.

    Science.gov (United States)

    Pascucci, David; Mastropasqua, Tommaso; Turatto, Massimo

    2015-01-01

    Task Irrelevant Perceptual Learning (TIPL) shows that the brain's discriminative capacity can improve also for invisible and unattended visual stimuli. It has been hypothesized that this form of "unconscious" neural plasticity is mediated by an endogenous reward mechanism triggered by the correct task performance. Although this result has challenged the mandatory role of attention in perceptual learning, no direct evidence exists of the hypothesized link between target recognition, reward and TIPL. Here, we manipulated the reward value associated with a target to demonstrate the involvement of reinforcement mechanisms in sensory plasticity for invisible inputs. Participants were trained in a central task associated with either high or low monetary incentives, provided only at the end of the experiment, while subliminal stimuli were presented peripherally. Our results showed that high incentive-value targets induced a greater degree of perceptual improvement for the subliminal stimuli, supporting the role of reinforcement mechanisms in TIPL.

  11. The endocannabinoid system in brain reward processes.

    Science.gov (United States)

    Solinas, M; Goldberg, S R; Piomelli, D

    2008-05-01

    Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

  12. Power Generator with Thermo-Differential Modules

    Science.gov (United States)

    Saiz, John R.; Nguyen, James

    2010-01-01

    A thermoelectric power generator consists of an oven box and a solar cooker/solar reflector unit. The solar reflector concentrates sunlight into heat and transfers the heat into the oven box via a heat pipe. The oven box unit is surrounded by five thermoelectric modules and is located at the bottom end of the solar reflector. When the heat is pumped into one side of the thermoelectric module and ejected from the opposite side at ambient temperatures, an electrical current is produced. Typical temperature accumulation in the solar reflector is approximately 200 C (392 F). The heat pipe then transfers heat into the oven box with a loss of about 40 percent. At the ambient temperature of about 20 C (68 F), the temperature differential is about 100 C (180 F) apart. Each thermoelectric module, generates about 6 watts of power. One oven box with five thermoelectric modules produces about 30 watts. The system provides power for unattended instruments in remote areas, such as space colonies and space vehicles, and in polar and other remote regions on Earth.

  13. Dopamine and reward: comment on Hernandez et al. (2006).

    Science.gov (United States)

    Gallistel, C R

    2006-08-01

    Many lines of evidence suggest that the dopaminergic projection from the midbrain tegmentum to the forebrain must play a critical role in mediating the behavioral effects of natural and artificial rewards, with brain stimulation reward and addictive drugs included in the latter category. However, a closer look reveals many incongruities. The work of G. Hernandez et al. (2006) resolves several puzzles. It implies that the dopaminergic projection does not carry the signal that encodes the magnitude of a brain stimulation reward. It suggests that the elevation in the tonic levels of dopamine consequent on brain stimulation reward modulates the registration of the magnitude of the reward. This reconciles the psychophysical evidence with the pharmacological, electrophysiological, and anatomical evidence. However, some serious puzzles do remain.

  14. Reward anticipation modulates the effect of stress-related increases in cortisol on episodic memory.

    Science.gov (United States)

    Quent, Jörn A; McCullough, Andrew M; Sazma, Matt; Wolf, Oliver T; Yonelinas, Andrew P

    2018-01-01

    When acute stress is experienced shortly after an event is encoded into memory, this can slow the forgetting of the study event, which is thought to reflect the effect of cortisol on consolidation. In addition, when events are encoded under conditions of high reward they tend to be remembered better than those encoded under non-rewarding conditions, and these effects are thought to reflect the operation of the dopaminergic reward system. Although both modulatory systems are believed to impact the medial temporal lobe regions critical for episodic memory, the manner, and even the extent, to which these two systems interact is currently unknown. To address this question in the current study, participants encoded words under reward or non-reward conditions, then one half of the participants were stressed using the social evaluation cold pressor task and the other half completed a non-stress control task. After a two-hour delay, all participants received a free recall and recognition memory test. There were no significant effects of stress or reward on overall memory performance. However, for the non-reward items, increases in stress-related cortisol in stressed participants were related to increases in recall and increases in recollection-based recognition responses. In contrast, for the reward items, increases in stress-related cortisol were not related to increases in memory performance. The results indicate that the stress and the reward systems interact in the way they impact episodic memory. The results are consistent with tag and capture models in the sense that cortisol reactivity can only affect non-reward items because plasticity-related products are already provided by reward anticipation. Copyright © 2017 Elsevier Inc. All rights reserved.

  15. How motivation and reward learning modulate selective attention.

    Science.gov (United States)

    Bourgeois, A; Chelazzi, L; Vuilleumier, P

    2016-01-01

    Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior. © 2016 Elsevier B.V. All rights reserved.

  16. Monetary reward modulates task-irrelevant perceptual learning for invisible stimuli.

    Directory of Open Access Journals (Sweden)

    David Pascucci

    Full Text Available Task Irrelevant Perceptual Learning (TIPL shows that the brain's discriminative capacity can improve also for invisible and unattended visual stimuli. It has been hypothesized that this form of "unconscious" neural plasticity is mediated by an endogenous reward mechanism triggered by the correct task performance. Although this result has challenged the mandatory role of attention in perceptual learning, no direct evidence exists of the hypothesized link between target recognition, reward and TIPL. Here, we manipulated the reward value associated with a target to demonstrate the involvement of reinforcement mechanisms in sensory plasticity for invisible inputs. Participants were trained in a central task associated with either high or low monetary incentives, provided only at the end of the experiment, while subliminal stimuli were presented peripherally. Our results showed that high incentive-value targets induced a greater degree of perceptual improvement for the subliminal stimuli, supporting the role of reinforcement mechanisms in TIPL.

  17. Modulation of neuronal differentiation by CD40 isoforms

    International Nuclear Information System (INIS)

    Hou Huayu; Obregon, Demian; Lou, Deyan; Ehrhart, Jared; Fernandez, Frank; Silver, Archie; Tan Jun

    2008-01-01

    Neuron differentiation is a complex process involving various cell-cell interactions, and multiple signaling pathways. We showed previously that CD40 is expressed and functional on mouse and human neurons. In neurons, ligation of CD40 protects against serum withdrawal-induced injury and plays a role in survival and differentiation. CD40 deficient mice display neuron dysfunction, aberrant neuron morphologic changes, and associated gross brain abnormalities. Previous studies by Tone and colleagues suggested that five isoforms of CD40 exist with two predominant isoforms expressed in humans: signal-transducible CD40 type I and a C-terminal truncated, non-signal-transducible CD40 type II. We hypothesized that differential expression of CD40 isoform type I and type II in neurons may modulate neuron differentiation. Results show that adult wild-type, and CD40 -/- deficient mice predominantly express CD40 type I and II isoforms. Whereas adult wild-type mice express mostly CD40 type I in cerebral tissues at relatively high levels, in age and gender-matched CD40 -/- mice CD40 type I expression was almost completely absent; suggesting a predominance of the non-signal-transducible CD40 type II isoform. Younger, 1 day old wild-type mice displayed less CD40 type I, and more CD40 type II, as well as, greater expression of soluble CD40 (CD40L/CD40 signal inhibitor), compared with 1 month old mice. Neuron-like N2a cells express CD40 type I and type II isoforms while in an undifferentiated state, however once induced to differentiate, CD40 type I predominates. Further, differentiated N2a cells treated with CD40 ligand express high levels of neuron specific nuclear protein (NeuN); an effect reduced by anti-CD40 type I siRNA, but not by control (non-targeting) siRNA. Altogether these data suggest that CD40 isoforms may act in a temporal fashion to modulate neuron differentiation during brain development. Thus, modulation of neuronal CD40 isoforms and CD40 signaling may represent

  18. Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

    Science.gov (United States)

    Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

    2017-07-01

    Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

  19. Differential Effects of Acute Stress on Anticipatory and Consummatory Phases of Reward Processing

    Science.gov (United States)

    Kumar, Poornima; Berghorst, Lisa H.; Nickerson, Lisa D.; Dutra, Sunny J.; Goer, Franziska; Greve, Douglas; Pizzagalli, Diego A.

    2014-01-01

    Anhedonia is one of the core symptoms of depression and has been linked to blunted responses to rewarding stimuli in striatal regions. Stress, a key vulnerability factor for depression, has been shown to induce anhedonic behavior, including reduced reward responsiveness in both animals and humans, but the brain processes associated with these effects remain largely unknown in humans. Emerging evidence suggests that stress has dissociable effects on distinct components of reward processing, as it has been found to potentiate motivation/‘wanting’ during the anticipatory phase but reduce reward responsiveness/‘liking’ during the consummatory phase. To examine the impact of stress on reward processing, we used a monetary incentive delay (MID) task and an acute stress manipulation (negative performance feedback) in conjunction with functional magnetic resonance imaging (fMRI). Fifteen healthy participants performed the MID task under no-stress and stress conditions. We hypothesized that stress would have dissociable effects on the anticipatory and consummatory phases in reward-related brain regions. Specifically, we expected reduced striatal responsiveness during reward consumption (mirroring patterns previously observed in clinical depression) and increased striatal activation during reward anticipation consistent with non-human findings. Supporting our hypotheses, significant Phase (Anticipation/Consumption) x Stress (Stress/No-stress) interactions emerged in the putamen, nucleus accumbens, caudate and amygdala. Post-hoc tests revealed that stress increased striatal and amygdalar activation during anticipation but decreased striatal activation during consumption. Importantly, stress-induced striatal blunting was similar to the profile observed in clinical depression under baseline (no-stress) conditions in prior studies. Given that stress is a pivotal vulnerability factor for depression, these results offer insight to better understand the etiology of this

  20. Reward associations magnify memory-based biases on perception.

    Science.gov (United States)

    Doallo, Sonia; Patai, Eva Zita; Nobre, Anna Christina

    2013-02-01

    Long-term spatial contextual memories are a rich source of predictions about the likely locations of relevant objects in the environment and should enable tuning of neural processing of unfolding events to optimize perception and action. Of particular importance is whether and how the reward outcome of past events can impact perception. We combined behavioral measures with recordings of brain activity with high temporal resolution to test whether the previous reward outcome associated with a memory could modulate the impact of memory-based biases on perception, and if so, the level(s) at which visual neural processing is biased by reward-associated memory-guided attention. Data showed that past rewards potentiate the effects of spatial memories upon the discrimination of target objects embedded within complex scenes starting from early perceptual stages. We show that a single reward outcome of learning impacts on how we perceive events in our complex environments.

  1. Intranasal insulin modulates intrinsic reward and prefrontal circuitry of the human brain in lean women.

    Science.gov (United States)

    Kullmann, Stephanie; Frank, Sabine; Heni, Martin; Ketterer, Caroline; Veit, Ralf; Häring, Hans-Ulrich; Fritsche, Andreas; Preissl, Hubert

    2013-01-01

    There is accumulating evidence that food consumption is controlled by a wide range of brain circuits outside of the homeostatic system. Activation in these brain circuits may override the homeostatic system and also contribute to the enormous increase of obesity. However, little is known about the influence of hormonal signals on the brain's non-homeostatic system. Thus, selective insulin action in the brain was investigated by using intranasal application. We performed 'resting-state' functional magnetic resonance imaging in 17 healthy lean female subjects to assess intrinsic brain activity by fractional amplitude of low-frequency fluctuations (fALFF) before, 30 and 90 min after application of intranasal insulin. Here, we showed that insulin modulates intrinsic brain activity in the hypothalamus and orbitofrontal cortex. Furthermore, we could show that the prefrontal and anterior cingulate cortex response to insulin is associated with body mass index. This demonstrates that hormonal signals as insulin may reduce food intake by modifying the reward and prefrontal circuitry of the human brain, thereby potentially decreasing the rewarding properties of food. Due to the alarming increase in obesity worldwide, it is of great importance to identify neural mechanisms of interaction between the homeostatic and non-homeostatic system to generate new targets for obesity therapy. Copyright © 2012 S. Karger AG, Basel.

  2. Reward Draws the Eye, Uncertainty Holds the Eye: Associative Learning Modulates Distractor Interference in Visual Search

    Directory of Open Access Journals (Sweden)

    Stephan Koenig

    2017-07-01

    Full Text Available Stimuli in our sensory environment differ with respect to their physical salience but moreover may acquire motivational salience by association with reward. If we repeatedly observed that reward is available in the context of a particular cue but absent in the context of another cue the former typically attracts more attention than the latter. However, we also may encounter cues uncorrelated with reward. A cue with 50% reward contingency may induce an average reward expectancy but at the same time induces high reward uncertainty. In the current experiment we examined how both values, reward expectancy and uncertainty, affected overt attention. Two different colors were established as predictive cues for low reward and high reward respectively. A third color was followed by high reward on 50% of the trials and thus induced uncertainty. Colors then were introduced as distractors during search for a shape target, and we examined the relative potential of the color distractors to capture and hold the first fixation. We observed that capture frequency corresponded to reward expectancy while capture duration corresponded to uncertainty. The results may suggest that within trial reward expectancy is represented at an earlier time window than uncertainty.

  3. Crossed Module Bundle Gerbes; Classification, String Group and Differential Geometry

    OpenAIRE

    Jurco, Branislav

    2005-01-01

    We discuss nonabelian bundle gerbes and their differential geometry using simplicial methods. Associated to any crossed module there is a simplicial group NC, the nerve of the 1-category defined by the crossed module and its geometric realization |NC|. Equivalence classes of principal bundles with structure group |NC| are shown to be one-to-one with stable equivalence classes of what we call crossed module gerbes bundle gerbes. We can also associate to a crossed module a 2-category C'. Then t...

  4. The Influence of Emotion Upregulation on the Expectation of Sexual Reward.

    Science.gov (United States)

    Brom, Mirte; Laan, Ellen; Everaerd, Walter; Spinhoven, Philip; Trimbos, Baptist; Both, Stephanie

    2016-01-01

    Emotion regulation research has shown successful altering of unwanted aversive emotional reactions. Cognitive strategies can also downregulate expectations of reward arising from conditioned stimuli, including sexual stimuli. However, little is known about whether such strategies can also efficiently upregulate expectations of sexual reward arising from conditioned stimuli, and possible gender differences therein. The present study examined whether a cognitive upregulatory strategy could successfully upregulate sexual arousal elicited by sexual reward-conditioned cues in men and women. Men (n = 40) and women (n = 53) participated in a study using a differential conditioning paradigm, with genital vibrostimulation as unconditioned stimulus (US) and sexually relevant pictures as conditional stimuli. Penile circumference and vaginal pulse amplitude were assessed and ratings of US expectancy, affective value, and sexual arousal value were obtained. Also a stimulus response compatibility task was included to assess automatic approach and avoidance tendencies. Evidence was found for emotion upregulation to increase genital arousal response in the acquisition phase in both sexes, and to enhance resistance to extinction of conditioned genital responding in women. In men, the emotion upregulatory strategy resulted in increased conditioned positive affect. The findings support that top-down modulation may indeed influence conditioned sexual responses. This knowledge may have implications for treating disturbances in sexual appetitive responses, such as low sexual arousal and desire. Copyright © 2016 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

  5. Reward-seeking behavior and addiction: cause or cog?

    Science.gov (United States)

    Arias-Carrión, Oscar; Salama, Mohamed

    2012-09-01

    Although dopaminergic system represents the cornerstone in rewarding, other neurotransmitters can modulate both the reward system and the psychomotor effects of addictive drugs. Many hypotheses have been proposed for a better understanding of the reward system and its role in drug addiction. However, after many years of investigation, no single theory can completely explain the neural basis of drug addiction. Recent reports introduce novel neurotransmitters into the game e.g. dynorphins, orexins, histamine, gheralin and galanin. The interacting functions of these neurotransmitters have shown that the reward system and its role in drug dependence, is far more complicated than was thought before. Individual variations exist regarding response to drug exposure, vulnerability for addiction and the effects of different cues on reward systems. Consequently, genetic variations of neurotransmission are thought to influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. However, the individual variations can not be based mainly on genetics; environmental factors seem to play a role too. Here we discuss the current knowledge about the orquestic regulation of different neurotransmitters on reward-seeking behavior and their potential effect on drug addiction.

  6. NMDA receptor blockade in the prelimbic cortex activates the mesolimbic system and dopamine-dependent opiate reward signaling.

    Science.gov (United States)

    Tan, Huibing; Rosen, Laura G; Ng, Garye A; Rushlow, Walter J; Laviolette, Steven R

    2014-12-01

    N-Methyl-D-aspartate (NMDA) receptors in the medial prefrontal cortex (mPFC) are involved in opiate reward processing and modulate sub-cortical dopamine (DA) activity. NMDA receptor blockade in the prelimbic (PLC) division of the mPFC strongly potentiates the rewarding behavioural properties of normally sub-reward threshold doses of opiates. However, the possible functional interactions between cortical NMDA and sub-cortical DAergic motivational neural pathways underlying these effects are not understood. This study examines how NMDA receptor modulation in the PLC influences opiate reward processing via interactions with sub-cortical DAergic transmission. We further examined whether direct intra-PLC NMDA receptor modulation may activate DA-dependent opiate reward signaling via interactions with the ventral tegmental area (VTA). Using an unbiased place conditioning procedure (CPP) in rats, we performed bilateral intra-PLC microinfusions of the competitive NMDA receptor antagonist, (2R)-amino-5-phosphonovaleric acid (AP-5), prior to behavioural morphine place conditioning and challenged the rewarding effects of morphine with DA receptor blockade. We next examined the effects of intra-PLC NMDA receptor blockade on the spontaneous activity patterns of presumptive VTA DA or GABAergic neurons, using single-unit, extracellular in vivo neuronal recordings. We show that intra-PLC NMDA receptor blockade strongly activates sub-cortical DA neurons within the VTA while inhibiting presumptive non-DA GABAergic neurons. Behaviourally, NMDA receptor blockade activates a DA-dependent opiate reward system, as pharmacological blockade of DA transmission blocked morphine reward only in the presence of intra-PLC NMDA receptor antagonism. These findings demonstrate a cortical NMDA-mediated mechanism controlling mesolimbic DAergic modulation of opiate reward processing.

  7. Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task.

    Science.gov (United States)

    Martig, Adria K; Mizumori, Sheri J Y

    2011-02-01

    Hippocampus (HPC) receives dopaminergic (DA) projections from the ventral tegmental area (VTA) and substantia nigra. These inputs appear to provide a modulatory signal that influences HPC dependent behaviors and place fields. We examined how efferent projections from VTA to HPC influence spatial working memory and place fields when the reward context changes. CA1 and CA3 process environmental context changes differently and VTA preferentially innervates CA1. Given these anatomical data and electrophysiological evidence that implicate DA in reward processing, we predicted that CA1 place fields would respond more strongly to both VTA disruption and changes in the reward context than CA3 place fields. Rats (N = 9) were implanted with infusion cannula targeting VTA and recording tetrodes aimed at HPC. Then they were tested on a differential reward, win-shift working memory task. One recording session consisted of 5 baseline and 5 manipulation trials during which place cells in CA1/CA2 (N = 167) and CA3 (N = 94) were recorded. Prior to manipulation trials rats were infused with either baclofen or saline and then subjected to control or reward conditions during which the learned locations of large and small reward quantities were reversed. VTA disruption resulted in an increase in errors, and in CA1/CA2 place field reorganization. There were no changes in any measures of CA3 place field stability during VTA disruption. Reward manipulations did not affect performance or place field stability in CA1/CA2 or CA3; however, changes in the reward locations "rescued" performance and place field stability in CA1/CA2 when VTA activity was compromised, perhaps by trigging compensatory mechanisms. These data support the hypothesis that VTA contributes to spatial working memory performance perhaps by maintaining place field stability selectively in CA1/CA2. Copyright © 2009 Wiley-Liss, Inc.

  8. Reward-enhanced memory in younger and older adults.

    Science.gov (United States)

    Spaniol, Julia; Schain, Cécile; Bowen, Holly J

    2014-09-01

    We investigated how the anticipation of remote monetary reward modulates intentional episodic memory formation in younger and older adults. On the basis of prior findings of preserved reward-cognition interactions in aging, we predicted that reward anticipation would be associated with enhanced memory in both younger and older adults. On the basis of previous demonstrations of a time-dependent effect of reward anticipation on memory, we expected the memory enhancement to increase with study-test delay. In Experiment 1, younger and older participants encoded a series of picture stimuli associated with high- or low-reward values. At test (24-hr postencoding), recognition hits resulted in either high or low monetary rewards, whereas false alarms were penalized to discourage guessing. Experiment 2 was similar to Experiment 1, but the study-test delay was manipulated within subjects (immediate vs 24hr). In Experiment 1, younger and older adults showed enhanced recognition for high-reward pictures compared with low-reward pictures. Experiment 2 replicated this finding and additionally showed that the effect did not extend to immediate recognition. The current findings provide support for a time-dependent mechanism of reward-based memory enhancement. They also suggest that aging leaves intact the positive influence of reward anticipation on intentional long-term memory formation. © The Author 2013. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  9. Putting Desire on a Budget: Dopamine and Energy Expenditure, Reconciling Reward and Resources

    Directory of Open Access Journals (Sweden)

    Jeff A Beeler

    2012-07-01

    Full Text Available Accumulating evidence indicates integration of dopamine function with metabolic signals, highlighting a potential role for dopamine in energy balance, frequently construed as modulating reward in response to homeostatic state. Though its precise role remains controversial, the reward perspective of dopamine has dominated investigation of motivational disorders, including obesity. In the hypothesis outlined here, we suggest instead that the primary role of dopamine in behavior is to modulate activity to adapt behavioral energy expenditure to the prevailing environmental energy conditions, with the role of dopamine in reward and motivated behaviors derived from its primary role in energy balance. Dopamine has long been known to modulate activity, exemplified by psychostimulants that act via dopamine. More recently, there has been nascent investigation into the role of dopamine in modulating voluntary activity, with some investigators suggesting that dopamine may serve as a final common pathway that couples energy sensing to regulated voluntary energy expenditure. We suggest that interposed between input from both the internal and external world, dopamine modulates behavioral energy expenditure along two axes: a conserve-expend axis that regulates generalized activity and an explore-exploit axes that regulates the degree to which reward value biases the distribution of activity. In this view, increased dopamine does not promote consumption of tasty food. Instead increased dopamine promotes energy expenditure and exploration while decreased dopamine favors energy conservation and exploitation. This hypothesis provides a mechanistic interpretation to an apparent paradox: the well-established role of dopamine in food seeking and the findings that low dopaminergic functions are associated with obesity. Our hypothesis provides an alternative perspective on the role of dopamine in obesity and reinterprets the ‘reward deficiency hypothesis’ as a

  10. Motivated Memories: Effects of Reward and Recollection in the Core Recollection Network and Beyond

    Science.gov (United States)

    Elward, Rachael L.; Vilberg, Kaia L.; Rugg, Michael D.

    2015-01-01

    fMRI was employed to assess whether the neural correlates of accurate source memory are modulated by the reward value of recollected information. Study items comprised pictures of objects, each paired with a depiction of 1 of 2 coins. The reward value of the coins ($2.00 vs. $0.02) was disclosed after study. At test, a source memory procedure was employed in which subjects discriminated between studied and unstudied objects and, for objects judged studied, indicated the identity of the coin paired with the object at study. Correct judgments earned a reward corresponding to the value of the coin, whereas incorrect judgments were penalized. No regions were identified where the magnitude of recollection effects was modulated by reward. Exclusive effects of source accuracy were evident in the hippocampus. Different striatal sub-regions demonstrated exclusive recollection effects, exclusive reward effects, and overlap between the 2 effects. The left angular gyrus and medial prefrontal cortex were additively responsive to source accuracy and the reward. The findings suggest that reward value and recollection success are conjointly but independently represented in at least 2 cortical regions and that striatal retrieval success effects cannot be accounted for in terms of a single construct, such as goal satisfaction. PMID:24872520

  11. I endeavor to make it: effort increases valuation of subsequent monetary reward.

    Science.gov (United States)

    Ma, Qingguo; Meng, Liang; Wang, Lei; Shen, Qiang

    2014-03-15

    Although it is commonly accepted that the amount of effort we put into accomplishing a task would exert an influence on subsequent reward processing and outcome evaluation, whether effort is incorporated as a cost or it would increase the valuation of concomitant reward is still under debate. In this study, EEGs were recorded while subjects performed calculation tasks that required different amount of effort, correct responses of which were followed by either no reward or fixed compensation. Results showed that high effort induced larger differentiated FRN responses to the reward and non-reward discrepancy across two experimental conditions. Furthermore, P300 manifested valence effect during reward feedback, with more positive amplitudes for reward than for non-reward only in the high effort condition. These results suggest that effort might increase subjective evaluation toward subsequent reward. Copyright © 2013 Elsevier B.V. All rights reserved.

  12. Post-learning hippocampal dynamics promote preferential retention of rewarding events

    Science.gov (United States)

    Gruber, Matthias J.; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K.; Ranganath, Charan

    2016-01-01

    Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here, we used functional magnetic resonance imaging (fMRI) to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- or low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation. PMID:26875624

  13. Changes in reward contingency modulate the trial-to-trial variability of hippocampal place cells.

    Science.gov (United States)

    Wikenheiser, Andrew M; Redish, A David

    2011-08-01

    Pyramidal cells in the rodent hippocampus often exhibit clear spatial tuning. Theories of hippocampal function suggest that these "place cells" implement multiple, independent neural representations of position (maps), based on different reference frames or environmental features. Consistent with the "multiple maps" theory, previous studies have shown that manipulating spatial factors related to task performance modulates the within-session variability (overdispersion) of cells in the hippocampus. However, the influence of changes in reward contingency on overdispersion has not been examined. To test this, we first trained rats to collect food from three feeders positioned around a circular track (task(1)). When subjects were proficient, the reward contingency was altered such that every other feeder delivered food (task(2)). We recorded ensembles of hippocampal neurons as rats performed both tasks. Place cell overdispersion was high during task(1) but decreased significantly during task(2), and this increased reliability could not be accounted for by changes in running speed or familiarity with the task. Intuitively, decreased variability might be expected to improve neural representations of position. To test this, we used Bayesian decoding of hippocampal spike trains to estimate subjects' location. Neither the amount of probability decoded to subjects' position (local probability) nor the difference between estimated position and true location (decoding accuracy) differed between tasks. However, we found that hippocampal ensembles were significantly more self-consistent during task(2) performance. These results suggest that changes in task demands can affect the firing statistics of hippocampal neurons, leading to changes in the properties of decoded neural representations.

  14. Reward networks in the brain as captured by connectivity measures

    Directory of Open Access Journals (Sweden)

    Estela Camara

    2009-12-01

    Full Text Available An assortment of human behaviors is thought to be driven by rewards including reinforcement learning, novelty processing, learning, decision making, economic choice, incentive motivation, and addiction. In each case the ventral tegmental area / ventral striatum (Nucleus accumbens system (VTA-VS has been implicated as a key structure by functional imaging studies, mostly on the basis of standard, univariate analyses. Here we propose that standard fMRI analysis needs to be complemented by methods that take into account the differential connectivity of the VTA-VS system in the different behavioral contexts in order to describe reward based processes more appropriately. We first consider the wider network for reward processing as it emerged from animal experimentation. Subsequently, an example for a method to assess functional connectivity is given. Finally, we illustrate the usefulness of such analyses by examples regarding reward valuation, reward expectation and the role of reward in addiction.

  15. Adaptive Modulation for a Downlink Multicast Channel in OFDMA Systems

    DEFF Research Database (Denmark)

    Wang, Haibo; Schwefel, Hans-Peter; Toftegaard, Thomas Skjødeberg

    2007-01-01

    In this paper we focus on adaptive modulation strategies for multicast service in orthogonal frequency division multiple access systems. A reward function has been defined as the optimization target, which includes both the average user throughput and bit error rate. We also developed an adaptive...... modulation strategy, namely local best reward strategy, to maximize this reward function. The performance of different modulation strategies are compared in different SNR distribution scenarios, and the optimum strategy in each scenario is suggested....

  16. Reward mechanisms in the brain and their role in dependence : evidence from neurophysiological and neuroimaging studies

    NARCIS (Netherlands)

    Martin-Soelch, C; Leenders, KL; Chevalley, AF; Missimer, J; Kunig, G; Magyar, S; Mino, A; Schultz, W

    2001-01-01

    This article reviews neuronal activity related to reward processing in primate and human brains. In the primate brain, neurophysiological methods provide a differentiated view of reward processing in a limited number of brain structures. Dopamine neurons respond to unpredictable rewards and produce

  17. Reward association facilitates distractor suppression in human visual search.

    Science.gov (United States)

    Gong, Mengyuan; Yang, Feitong; Li, Sheng

    2016-04-01

    Although valuable objects are attractive in nature, people often encounter situations where they would prefer to avoid such distraction while focusing on the task goal. Contrary to the typical effect of attentional capture by a reward-associated item, we provide evidence for a facilitation effect derived from the active suppression of a high reward-associated stimulus when cuing its identity as distractor before the display of search arrays. Selection of the target is shown to be significantly faster when the distractors were in high reward-associated colour than those in low reward-associated or non-rewarded colours. This behavioural reward effect was associated with two neural signatures before the onset of the search display: the increased frontal theta oscillation and the strengthened top-down modulation from frontal to anterior temporal regions. The former suggests an enhanced working memory representation for the reward-associated stimulus and the increased need for cognitive control to override Pavlovian bias, whereas the latter indicates that the boost of inhibitory control is realized through a frontal top-down mechanism. These results suggest a mechanism in which the enhanced working memory representation of a reward-associated feature is integrated with task demands to modify attentional priority during active distractor suppression and benefit behavioural performance. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

  18. Influence of promised rewards on conflict resolution in healthy participants and patients with Parkinson's disease.

    Science.gov (United States)

    Houvenaghel, Jean-François; Duprez, Joan; Naudet, Florian; Argaud, Soizic; Dondaine, Thibaut; Drapier, Sophie; Robert, Gabriel Hadrien; Drapier, Dominique; Vérin, Marc; Sauleau, Paul

    2016-08-15

    The influence of promised rewards on conflict resolution processes is not clearly defined in the literature, and the underlying mechanisms are poorly understood. Some studies have shown no effect of reward, while others have demonstrated a beneficial influence. In addition, although the basal ganglia are known to play a critical role in the association between motivation and cognition, the influence of promised rewards on conflict resolution processes in Parkinson's disease (PD) has received little attention. In this context, we assessed the influence of promised rewards on both impulse activation and suppression in 36 healthy participants and 36 patients with PD, using a rewarded Simon task. Analysis of performances revealed that promised rewards worsened the overall congruence effect, but only in healthy participants. Although the incentive context did not modulate the congruence effect in patients, by using the activation-suppression model, we were able to show that promised rewards did influence impulse suppression in patients-but not in healthy participants. Suppressing inappropriate response activation in an incentive context appears to be harder in medically treated Parkinson's disease. This indicates that incentive motivation can modulate at least one cognitive process involved in cognitive action control in patients with medically treated PD. The activation-suppression model provides essential additional information concerning the influence of promised rewards on conflict resolution processes in a pathological population. Copyright © 2016 Elsevier B.V. All rights reserved.

  19. A Positive Affective Neuroendocrinology (PANE Approach to Reward and Behavioral Dysregulation

    Directory of Open Access Journals (Sweden)

    Keith eWelker

    2015-07-01

    Full Text Available Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE perspective. This approach holds that testosterone increases reward processing, which increases the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology.

  20. Spread of status value: Rewards and the creation of status characteristics.

    Science.gov (United States)

    Harkness, Sarah K

    2017-01-01

    Rewards have social significance and are highly esteemed objects, but what does their ownership signify to others? Prior work has demonstrated it may be possible for these rewards to spread their status to those who possess them, such that individuals gain or lose status and influence by virtue of the rewards they display. Yet, is this spread enough to produce entirely new status characteristics by virtue of their association with rewards? I propose a theoretical extension of the spread of status value theory and offer an experimental test considering whether the status value conveyed by rewards spreads to a new, nominal characteristic of those who come to possess these objects. The results indicate that states of a nominal characteristic do gain or lose status value and behavioral influence through their association with differentially valued rewards. Thus, rewards can create new status characteristics with resulting behavioral expectations. Copyright © 2016 Elsevier Inc. All rights reserved.

  1. Could Reward-disturbances caused by antipsychotic medication lead to weight gain?

    DEFF Research Database (Denmark)

    Nielsen, Mette Ødegaard; Rostrup, Egill; Nørbak-Emig, Henrik

    2014-01-01

    BACKGROUND The reward system is known to be central to the regulation of appetite. Further, disturbances of the brain reward system are suggested to play an important role in the development of central psychopathological symptoms in schizophrenia. Antipsychotic medication partly acts by modulating...... the reward system and most antipsychotics cause some degree of weight gain. Recently, a relation between weight gain caused by one week of olanzapine treatment and change in reward signalling was found in healthy volunteers1. To our knowledge there are no previous studies examining how the effect...... of antipsychotic treatment on the reward system relate to weight gain in patients. METHODS 50 antipsychotic-naïve first-episode patients with schizophrenia and 40 healthy controls were included in the study at baseline. 38 patients and 31 healthy controls were re-examined after six weeks where patients were...

  2. Simulated Microgravity Modulates Differentiation Processes of Embryonic Stem Cells

    Directory of Open Access Journals (Sweden)

    Vaibhav Shinde

    2016-04-01

    Full Text Available Background/Aims: Embryonic developmental studies under microgravity conditions in space are very limited. To study the effects of altered gravity on the embryonic development processes we established an in vitro methodology allowing differentiation of mouse embryonic stem cells (mESCs under simulated microgravity within a fast-rotating clinostat (clinorotation and capture of microarray-based gene signatures. Methods: The differentiating mESCs were cultured in a 2D pipette clinostat. The microarray and bioinformatics tools were used to capture genes that are deregulated by simulated microgravity and their impact on developmental biological processes. Results: The data analysis demonstrated that differentiation of mESCs in pipettes for 3 days resultet to early germ layer differentiation and then to the different somatic cell types after further 7 days of differentiation in the Petri dishes. Clinorotation influences differentiation as well as non-differentiation related biological processes like cytoskeleton related 19 genes were modulated. Notably, simulated microgravity deregulated genes Cyr61, Thbs1, Parva, Dhrs3, Jun, Tpm1, Fzd2 and Dll1 are involved in heart morphogenesis as an acute response on day 3. If the stem cells were further cultivated under normal gravity conditions (1 g after clinorotation, the expression of cardiomyocytes specific genes such as Tnnt2, Rbp4, Tnni1, Csrp3, Nppb and Mybpc3 on day 10 was inhibited. This correlated well with a decreasing beating activity of the 10-days old embryoid bodies (EBs. Finally, we captured Gadd45g, Jun, Thbs1, Cyr61and Dll1 genes whose expressions were modulated by simulated microgravity and by real microgravity in various reported studies. Simulated microgravity also deregulated genes belonging to the MAP kinase and focal dhesion signal transduction pathways. Conclusion: One of the most prominent biological processes affected by simulated microgravity was the process of cardiomyogenesis. The

  3. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    Science.gov (United States)

    Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

    2013-01-01

    The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

  4. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    Directory of Open Access Journals (Sweden)

    Victor Costumero

    Full Text Available The behavioral approach system (BAS from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

  5. Differentiable absorption of Hilbert C*-modules, connections and lifts of unbounded operators

    DEFF Research Database (Denmark)

    Kaad, Jens

    2017-01-01

    . The differentiable absorption theorem is then applied to construct densely defined connections (or correpondences) on Hilbert C∗C∗-modules. These connections can in turn be used to define selfadjoint and regular "lifts" of unbounded operators which act on an auxiliary Hilbert C∗C∗-module....

  6. Effect of social influence on effort-allocation for monetary rewards.

    Science.gov (United States)

    Gilman, Jodi M; Treadway, Michael T; Curran, Max T; Calderon, Vanessa; Evins, A Eden

    2015-01-01

    Though decades of research have shown that people are highly influenced by peers, few studies have directly assessed how the value of social conformity is weighed against other types of costs and benefits. Using an effort-based decision-making paradigm with a novel social influence manipulation, we measured how social influence affected individuals' decisions to allocate effort for monetary rewards during trials with either high or low probability of receiving a reward. We found that information about the effort-allocation of peers modulated participant choices, specifically during conditions of low probability of obtaining a reward. This suggests that peer influence affects effort-based choices to obtain rewards especially under conditions of risk. This study provides evidence that people value social conformity in addition to other costs and benefits when allocating effort, and suggests that neuroeconomic studies that assess trade-offs between effort and reward should consider social environment as a factor that can influence decision-making.

  7. Effect of social influence on effort-allocation for monetary rewards.

    Directory of Open Access Journals (Sweden)

    Jodi M Gilman

    Full Text Available Though decades of research have shown that people are highly influenced by peers, few studies have directly assessed how the value of social conformity is weighed against other types of costs and benefits. Using an effort-based decision-making paradigm with a novel social influence manipulation, we measured how social influence affected individuals' decisions to allocate effort for monetary rewards during trials with either high or low probability of receiving a reward. We found that information about the effort-allocation of peers modulated participant choices, specifically during conditions of low probability of obtaining a reward. This suggests that peer influence affects effort-based choices to obtain rewards especially under conditions of risk. This study provides evidence that people value social conformity in addition to other costs and benefits when allocating effort, and suggests that neuroeconomic studies that assess trade-offs between effort and reward should consider social environment as a factor that can influence decision-making.

  8. Serotonergic versus Nonserotonergic Dorsal Raphe Projection Neurons: Differential Participation in Reward Circuitry

    Directory of Open Access Journals (Sweden)

    Ross A. McDevitt

    2014-09-01

    Full Text Available The dorsal raphe nucleus (DRN contains the largest group of serotonin-producing neurons in the brain and projects to regions controlling reward. Although pharmacological studies suggest that serotonin inhibits reward seeking, electrical stimulation of the DRN strongly reinforces instrumental behavior. Here, we provide a targeted assessment of the behavioral, anatomical, and electrophysiological contributions of serotonergic and nonserotonergic DRN neurons to reward processes. To explore DRN heterogeneity, we used a simultaneous two-vector knockout/optogenetic stimulation strategy, as well as cre-induced and cre-silenced vectors in several cre-expressing transgenic mouse lines. We found that the DRN is capable of reinforcing behavior primarily via nonserotonergic neurons, for which the main projection target is the ventral tegmental area (VTA. Furthermore, these nonserotonergic projections provide glutamatergic excitation of VTA dopamine neurons and account for a large majority of the DRN-VTA pathway. These findings help to resolve apparent discrepancies between the roles of serotonin versus the DRN in behavioral reinforcement.

  9. The effects of non-contingent extrinsic and intrinsic rewards on memory consolidation.

    Science.gov (United States)

    Nielson, Kristy A; Bryant, Ted

    2005-07-01

    Emotional and arousing treatments given shortly after learning enhance delayed memory retrieval in animal and human studies. Positive affect and reward induced prior to a variety of cognitive tasks enhance performance, but their ability to affect memory consolidation has not been investigated before. Therefore, we investigated the effects of a small, non-contingent, intrinsic or extrinsic reward on delayed memory retrieval. Participants (n=108) studied and recalled a list of 30 affectively neutral, imageable nouns. Experimental groups were then given either an intrinsic reward (e.g., praise) or an extrinsic reward (e.g., US 1 dollar). After a one-week delay, participants' retrieval performance for the word list was significantly better in the extrinsic reward groups, whether the reward was expected or not, than in controls. Those who received the intrinsic reward performed somewhat better than controls, but the difference was not significant. Thus, at least some forms of arousal and reward, even when semantically unrelated to the learned material, can effectively modulate memory consolidation. These types of treatments might be useful for the development of new memory intervention strategies.

  10. Effect of familiarity on reward anticipation in children with and without autism spectrum disorders.

    Directory of Open Access Journals (Sweden)

    Katherine K M Stavropoulos

    Full Text Available Previous research on the reward system in autism spectrum disorders (ASD suggests that children with ASD anticipate and process social rewards differently than typically developing (TD children--but has focused on the reward value of unfamiliar face stimuli. Children with ASD process faces differently than their TD peers. Previous research has focused on face processing of unfamiliar faces, but less is known about how children with ASD process familiar faces. The current study investigated how children with ASD anticipate rewards accompanied by familiar versus unfamiliar faces.The stimulus preceding negativity (SPN of the event-related potential (ERP was utilized to measure reward anticipation. Participants were 6- to 10-year-olds with (N = 14 and without (N = 14 ASD. Children were presented with rewards accompanied by incidental face or non-face stimuli that were either familiar (caregivers or unfamiliar. All non-face stimuli were composed of scrambled face elements in the shape of arrows, controlling for visual properties.No significant differences between familiar versus unfamiliar faces were found for either group. When collapsing across familiarity, TD children showed larger reward anticipation to face versus non-face stimuli, whereas children with ASD did not show differential responses to these stimulus types. Magnitude of reward anticipation to faces was significantly correlated with behavioral measures of social impairment in the ASD group.The findings do not provide evidence for differential reward anticipation for familiar versus unfamiliar face stimuli in children with or without ASD. These findings replicate previous work suggesting that TD children anticipate rewards accompanied by social stimuli more than rewards accompanied by non-social stimuli. The results do not support the idea that familiarity normalizes reward anticipation in children with ASD. Our findings also suggest that magnitude of reward anticipation to faces is

  11. Reward can modulate attentional capture, independent of top-down set

    NARCIS (Netherlands)

    Munneke, J.; Hoppenbrouwers, S.S.; Theeuwes, J.

    2015-01-01

    The traditional distinction between exogenous and endogenous attentional control has recently been enriched with an additional mode of control, termed “selection history.” Recent findings have indicated, for instance, that previously rewarded or punished stimuli capture more attention than their

  12. Two pore channel 2 differentially modulates neural differentiation of mouse embryonic stem cells.

    Directory of Open Access Journals (Sweden)

    Zhe-Hao Zhang

    Full Text Available Nicotinic acid adenine dinucleotide phosphate (NAADP is an endogenous Ca(2+ mobilizing nucleotide presented in various species. NAADP mobilizes Ca(2+ from acidic organelles through two pore channel 2 (TPC2 in many cell types and it has been previously shown that NAADP can potently induce neuronal differentiation in PC12 cells. Here we examined the role of TPC2 signaling in the neural differentiation of mouse embryonic stem (ES cells. We found that the expression of TPC2 was markedly decreased during the initial ES cell entry into neural progenitors, and the levels of TPC2 gradually rebounded during the late stages of neurogenesis. Correspondingly, TPC2 knockdown accelerated mouse ES cell differentiation into neural progenitors but inhibited these neural progenitors from committing to neurons. Overexpression of TPC2, on the other hand, inhibited mouse ES cell from entering the early neural lineage. Interestingly, TPC2 knockdown had no effect on the differentiation of astrocytes and oligodendrocytes of mouse ES cells. Taken together, our data indicate that TPC2 signaling plays a temporal and differential role in modulating the neural lineage entry of mouse ES cells, in that TPC2 signaling inhibits ES cell entry to early neural progenitors, but is required for late neuronal differentiation.

  13. Model Checking Markov Reward Models with Impulse Rewards

    NARCIS (Netherlands)

    Cloth, Lucia; Katoen, Joost-Pieter; Khattri, Maneesh; Pulungan, Reza; Bondavalli, Andrea; Haverkort, Boudewijn; Tang, Dong

    This paper considers model checking of Markov reward models (MRMs), continuous-time Markov chains with state rewards as well as impulse rewards. The reward extension of the logic CSL (Continuous Stochastic Logic) is interpreted over such MRMs, and two numerical algorithms are provided to check the

  14. The Effects of Reward, Punishment, and Knowledge of Results on Children's Discrimination Learning

    Science.gov (United States)

    Donohue, Barbara; Ratliff, Richard G.

    1976-01-01

    The differential effects of contingent reward (candy), punishment (loss of candy), and knowledge of results (KOR) were investigated in eighty 9- to 10-year-old males. Level of performance of groups receiving KOR was significantly higher than performance on groups rewarded or punished with candy. (MS)

  15. Aberrant reward center response to partner reputation during a social exchange game in generalized social phobia.

    Science.gov (United States)

    Sripada, Chandra; Angstadt, Michael; Liberzon, Israel; McCabe, Kevin; Phan, K Luan

    2013-04-01

    Generalized social anxiety disorder (GSAD) is characterized by excessive fear of public scrutiny and reticence in social engagement. Previous studies have probed the neural basis of GSAD often using static, noninteractive stimuli (e.g., face photographs) and have identified dysfunction in fear circuitry. We sought to investigate brain-based dysfunction in GSAD during more real-world, dynamic social interactions, focusing on the role of reward-related regions that are implicated in social decision-making. Thirty-six healthy individuals (healthy control [HC]) and 36 individuals with GSAD underwent functional magnetic resonance imaging (fMRI) scanning while participating in a behavioral economic game ("Trust Game") involving iterative exchanges with fictive partners who acquire differential reputations for reciprocity. We investigated brain responses to reciprocation of trust in one's social partner, and how these brain responses are modulated by partner reputation for repayment. In both HC and GSAD, receipt of reciprocity robustly engaged ventral striatum, a region implicated in reward. In HC, striatal responses to reciprocity were specific to partners who have consistently returned the investment ("cooperative partners"), and were absent for partners who lack a cooperative reputation. In GSAD, modulation of striatal responses by partner reputation was absent. Social anxiety severity predicted diminished responses to cooperative partners. These results suggest abnormalities in GSAD in reward-related striatal mechanisms that may be important for the initiation, valuation, and maintenance of cooperative social relationships. Moreover, this study demonstrates that dynamic, interactive task paradigms derived from economics can help illuminate novel mechanisms of pathology in psychiatric illnesses in which social dysfunction is a cardinal feature. © 2013 Wiley Periodicals, Inc.

  16. On the influence of reward on action-effect binding

    Directory of Open Access Journals (Sweden)

    Paul Simon Muhle-Karbe

    2012-11-01

    Full Text Available Ideomotor theory states that the formation of anticipatory representations about the perceptual consequences of an action (i.e. action-effect (A-E binding provides the functional basis of voluntary action control. A host of studies has demonstrated that A-E binding occurs fast and effortlessly, yet only little is known about cognitive and affective factors that influence this learning process. In the present study, we sought to test whether the motivational value of an action modulates the acquisition of A-E associations. To this end, we associated specific actions with monetary incentives during the acquisition of novel A-E mappings. In a subsequent test phase, the degree of binding was assessed by presenting the former effect stimuli as task-irrelevant response primes in a forced-choice response task in the absence of any reward. Binding, as indexed by response priming through the former action effects, was only found for reward-related A-E mappings. Moreover, the degree to which reward associations modulated the binding strength was predicted by individuals’ trait sensitivity to reward. These observations indicate that the association of actions and their immediate outcomes depends on the motivational value of the action during learning, as well as on the motivational disposition of the individual. On a larger scale, these findings also highlight the link between ideomotor theories and reinforcement-learning theories, providing an interesting perspective for future research on anticipatory regulation of behavior.

  17. Processing of continuously provided punishment and reward in children with ADHD and the modulating effects of stimulant medication: an ERP study.

    Science.gov (United States)

    Groen, Yvonne; Tucha, Oliver; Wijers, Albertus A; Althaus, Monika

    2013-01-01

    Current models of ADHD suggest abnormal reward and punishment sensitivity, but the exact mechanisms are unclear. This study aims to investigate effects of continuous reward and punishment on the processing of performance feedback in children with ADHD and the modulating effects of stimulant medication. 15 Methylphenidate (Mph)-treated and 15 Mph-free children of the ADHD-combined type and 17 control children performed a selective attention task with three feedback conditions: no-feedback, gain and loss. Event Related Potentials (ERPs) time-locked to feedback and errors were computed. All groups performed more accurately with gain and loss than without feedback. Feedback-related ERPs demonstrated no group differences in the feedback P2, but an enhanced late positive potential (LPP) to feedback stimuli (both gains and losses) for Mph-free children with ADHD compared to controls. Feedback-related ERPs in Mph-treated children with ADHD were similar to controls. Correlational analyses in the ADHD groups revealed that the severity of inattention problems correlated negatively with the feedback P2 amplitude and positively with the LPP to losses and omitted gains. The early selective attention for rewarding and punishing feedback was relatively intact in children with ADHD, but the late feedback processing was deviant (increased feedback LPP). This may explain the often observed positive effects of continuous reinforcement on performance and behaviour in children with ADHD. However, these group findings cannot be generalised to all individuals with the ADHD, because the feedback-related ERPs were associated with the severity of the inattention problems. Children with ADHD-combined type with more inattention problems showed both deviant early attentional selection of feedback stimuli, and deviant late processing of non-reward and punishment.

  18. Serotonergic neurons signal reward and punishment on multiple timescales

    Science.gov (United States)

    Cohen, Jeremiah Y; Amoroso, Mackenzie W; Uchida, Naoshige

    2015-01-01

    Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales. DOI: http://dx.doi.org/10.7554/eLife.06346.001 PMID:25714923

  19. Neural evidence reveals the rapid effects of reward history on selective attention.

    Science.gov (United States)

    MacLean, Mary H; Giesbrecht, Barry

    2015-05-05

    Selective attention is often framed as being primarily driven by two factors: task-relevance and physical salience. However, factors like selection and reward history, which are neither currently task-relevant nor physically salient, can reliably and persistently influence visual selective attention. The current study investigated the nature of the persistent effects of irrelevant, physically non-salient, reward-associated features. These features affected one of the earliest reliable neural indicators of visual selective attention in humans, the P1 event-related potential, measured one week after the reward associations were learned. However, the effects of reward history were moderated by current task demands. The modulation of visually evoked activity supports the hypothesis that reward history influences the innate salience of reward associated features, such that even when no longer relevant, nor physically salient, these features have a rapid, persistent, and robust effect on early visual selective attention. Copyright © 2015 Elsevier B.V. All rights reserved.

  20. Reward, dopamine and the control of food intake: implications for obesity

    Energy Technology Data Exchange (ETDEWEB)

    Volkow N. D.; Wang G.; Volkow, N.D.; Wang, G.-J.; Baler, R.D.

    2011-10-01

    The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated that this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.

  1. Reward, dopamine and the control of food intake: implications for obesity

    International Nuclear Information System (INIS)

    Volkow, N.D.; Wang, G.J.; Baler, R.D.

    2011-01-01

    The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated that this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.

  2. Subthalamic nucleus high-frequency stimulation modulates neuronal reactivity to cocaine within the reward circuit.

    Science.gov (United States)

    Hachem-Delaunay, Sabira; Fournier, Marie-Line; Cohen, Candie; Bonneau, Nicolas; Cador, Martine; Baunez, Christelle; Le Moine, Catherine

    2015-08-01

    The subthalamic nucleus (STN) is a critical component of a complex network controlling motor, associative and limbic functions. High-frequency stimulation (HFS) of the STN is an effective therapy for motor symptoms in Parkinsonian patients and can also reduce their treatment-induced addictive behaviors. Preclinical studies have shown that STN HFS decreases motivation for cocaine while increasing that for food, highlighting its influence on rewarding and motivational circuits. However, the cellular substrates of these effects remain unknown. Our objectives were to characterize the cellular consequences of STN HFS with a special focus on limbic structures and to elucidate how STN HFS may interfere with acute cocaine effects in these brain areas. Male Long-Evans rats were subjected to STN HFS (130 Hz, 60 μs, 50-150 μA) for 30 min before an acute cocaine injection (15 mg/kg) and sacrificed 10 min following the injection. Neuronal reactivity was analyzed through the expression of two immediate early genes (Arc and c-Fos) to decipher cellular responses to STN HFS and cocaine. STN HFS only activated c-Fos in the globus pallidus and the basolateral amygdala, highlighting a possible role on emotional processes via the amygdala, with a limited effect by itself in other structures. Interestingly, and despite some differential effects on Arc and c-Fos expression, STN HFS diminished the c-Fos response induced by acute cocaine in the striatum. By preventing the cellular effect of cocaine in the striatum, STN HFS might thus decrease the reinforcing properties of the drug, which is in line with the inhibitory effect of STN HFS on the rewarding and reinforcing properties of cocaine. Copyright © 2015 Elsevier Inc. All rights reserved.

  3. Activation of dopamine D3 receptors inhibits reward-related learning induced by cocaine.

    Science.gov (United States)

    Kong, H; Kuang, W; Li, S; Xu, M

    2011-03-10

    Memories of learned associations between the rewarding properties of drugs and environmental cues contribute to craving and relapse in humans. The mesocorticolimbic dopamine (DA) system is involved in reward-related learning induced by drugs of abuse. DA D3 receptors are preferentially expressed in mesocorticolimbic DA projection areas. Genetic and pharmacological studies have shown that DA D3 receptors suppress locomotor-stimulant effects of cocaine and reinstatement of cocaine-seeking behaviors. Activation of the extracellular signal-regulated kinase (ERK) induced by acute cocaine administration is also inhibited by D3 receptors. How D3 receptors modulate cocaine-induced reward-related learning and associated changes in cell signaling in reward circuits in the brain, however, have not been fully investigated. In the present study, we show that D3 receptor mutant mice exhibit potentiated acquisition of conditioned place preference (CPP) at low doses of cocaine compared to wild-type mice. Activation of ERK and CaMKIIα, but not the c-Jun N-terminal kinase and p38, in the nucleus accumbens, amygdala and prefrontal cortex is also potentiated in D3 receptor mutant mice compared to that in wild-type mice following CPP expression. These results support a model in which D3 receptors modulate reward-related learning induced by low doses of cocaine by inhibiting activation of ERK and CaMKIIα in reward circuits in the brain. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

  4. Cerebral interactions of pain and reward and their relevance for chronic pain.

    Science.gov (United States)

    Becker, Susanne; Gandhi, Wiebke; Schweinhardt, Petra

    2012-06-29

    Pain and reward are opponent, interacting processes. Such interactions are enabled by neuroanatomical and neurochemical overlaps of brain systems that process pain and reward. Cerebral processing of hedonic ('liking') and motivational ('wanting') aspects of reward can be separated: the orbitofrontal cortex and opioids play an important role for the hedonic experience, and the ventral striatum and dopamine predominantly process motivation for reward. Supported by neuroimaging studies, we present here the hypothesis that the orbitofrontal cortex and opioids are responsible for pain modulation by hedonic experience, while the ventral striatum and dopamine mediate motivational effects on pain. A rewarding stimulus that appears to be particularly important in the context of pain is pain relief. Further, reward, including pain relief, leads to operant learning, which can affect pain sensitivity. Indirect evidence points at brain mechanisms that might underlie pain relief as a reward and related operant learning but studies are scarce. Investigating the cerebral systems underlying pain-reward interactions as well as related operant learning holds the potential of better understanding mechanisms that contribute to the development and maintenance of chronic pain, as detailed in the last section of this review. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

  5. The influence of motherhood on neural systems for reward processing in low income, minority, young women.

    Science.gov (United States)

    Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

    2016-04-01

    Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold preward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an

  6. Nanomaterials modulate stem cell differentiation: biological interaction and underlying mechanisms.

    Science.gov (United States)

    Wei, Min; Li, Song; Le, Weidong

    2017-10-25

    Stem cells are unspecialized cells that have the potential for self-renewal and differentiation into more specialized cell types. The chemical and physical properties of surrounding microenvironment contribute to the growth and differentiation of stem cells and consequently play crucial roles in the regulation of stem cells' fate. Nanomaterials hold great promise in biological and biomedical fields owing to their unique properties, such as controllable particle size, facile synthesis, large surface-to-volume ratio, tunable surface chemistry, and biocompatibility. Over the recent years, accumulating evidence has shown that nanomaterials can facilitate stem cell proliferation and differentiation, and great effort is undertaken to explore their possible modulating manners and mechanisms on stem cell differentiation. In present review, we summarize recent progress in the regulating potential of various nanomaterials on stem cell differentiation and discuss the possible cell uptake, biological interaction and underlying mechanisms.

  7. The attention habit: how reward learning shapes attentional selection.

    Science.gov (United States)

    Anderson, Brian A

    2016-04-01

    There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications. © 2015 New York Academy of Sciences.

  8. The role of rewarding and novel events in facilitating memory persistence in a separate spatial memory task

    Science.gov (United States)

    Salvetti, Beatrice; Morris, Richard G.M.; Wang, Szu-Han

    2014-01-01

    Many insignificant events in our daily life are forgotten quickly but can be remembered for longer when other memory-modulating events occur before or after them. This phenomenon has been investigated in animal models in a protocol in which weak memories persist longer if exploration in a novel context is introduced around the time of memory encoding. This study aims to understand whether other types of rewarding or novel tasks, such as rewarded learning in a T-maze and novel object recognition, can also be effective memory-modulating events. Rats were trained in a delayed matching-to-place task to encode and retrieve food locations in an event arena. Weak encoding with only one food pellet at the sample location induced memory encoding but forgetting over 24 h. When this same weak encoding was followed by a rewarded task in a T-maze, the memory persisted for 24 h. Moreover, the same persistence of memory over 24 h could be achieved by exploration in a novel box or by a rewarded T-maze task after a “non-rewarded” weak encoding. When the one-pellet weak encoding was followed by novel object exploration, the memory did not persist at 24 h. Together, the results confirm that place encoding is possible without explicit reward, and that rewarded learning in a separate task lacking novelty can be an effective memory-modulating event. The behavioral and neurobiological implications are discussed. PMID:24429424

  9. BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

    Science.gov (United States)

    Miyapuram, Krishna P; Tobler, Philippe N; Gregorios-Pippas, Lucy; Schultz, Wolfram

    2012-01-16

    Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. Copyright © 2011 Elsevier Inc. All rights reserved.

  10. Reward deficiency and anti-reward in pain chronification

    OpenAIRE

    Borsook, D.; Linnman, C.; Faria, Vanda; Strassman, A. M.; Becerra, L.; Elman, I.

    2016-01-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between...

  11. Ghrelin at the interface of obesity and reward.

    Science.gov (United States)

    Schellekens, Harriët; Dinan, Timothy G; Cryan, John F

    2013-01-01

    The prevalence of obesity continues to increase and has reached epidemic proportions. Accumulating data over the past few decades have given us key insights and broadened our understanding of the peripheral and central regulation of energy homeostasis. Despite this, the currently available pharmacological treatments, reducing body weight, remain limited due to poor efficacy and side effects. The gastric peptide ghrelin has been identified as the only orexigenic hormone from the periphery to act in the hypothalamus to stimulate food intake. Recently, a role for ghrelin and its receptor at the interface between homeostatic control of appetite and reward circuitries modulating the hedonic aspects of food has also emerged. Nonhomeostatic factors such as the rewarding and motivational value of food, which increase with food palatability and caloric content, can override homeostatic control of food intake. This nonhomeostatic decision to eat leads to overconsumption beyond nutritional needs and is being recognized as a key component in the underlying causes for the increase in obesity incidence worldwide. In addition, the hedonic feeding behavior has been linked to food addiction and an important role for ghrelin in the development of addiction has been suggested. Moreover, plasma ghrelin levels are responsive to conditions of stress, and recent evidence has implicated ghrelin in stress-induced food-reward behavior. The prominent role of the ghrelinergic system in the regulation of feeding gives rise to it as an effective target for the development of successful antiobesity pharmacotherapies that not only affect satiety but also selectively modulate the rewarding properties of food and reduce the desire to eat. Copyright © 2013 Elsevier Inc. All rights reserved.

  12. New hybrid reverse differential pulse position width modulation scheme for wireless optical communication

    Science.gov (United States)

    Liao, Renbo; Liu, Hongzhan; Qiao, Yaojun

    2014-05-01

    In order to improve the power efficiency and reduce the packet error rate of reverse differential pulse position modulation (RDPPM) for wireless optical communication (WOC), a hybrid reverse differential pulse position width modulation (RDPPWM) scheme is proposed, based on RDPPM and reverse pulse width modulation. Subsequently, the symbol structure of RDPPWM is briefly analyzed, and its performance is compared with that of other modulation schemes in terms of average transmitted power, bandwidth requirement, and packet error rate over ideal additive white Gaussian noise (AWGN) channels. Based on the given model, the simulation results show that the proposed modulation scheme has the advantages of improving the power efficiency and reducing the bandwidth requirement. Moreover, in terms of error probability performance, RDPPWM can achieve a much lower packet error rate than that of RDPPM. For example, at the same received signal power of -28 dBm, the packet error rate of RDPPWM can decrease to 2.6×10-12, while that of RDPPM is 2.2×10. Furthermore, RDPPWM does not need symbol synchronization at the receiving end. These considerations make RDPPWM a favorable candidate to select as the modulation scheme in the WOC systems.

  13. The habenula governs the attribution of incentive salience to reward predictive cues

    OpenAIRE

    Danna, Carey L.; Shepard, Paul D.; Elmer, Greg I.

    2013-01-01

    The attribution of incentive salience to reward associated cues is critical for motivation and the pursuit of rewards. Disruptions in the integrity of the neural systems controlling these processes can lead to avolition and anhedonia, symptoms that cross the diagnostic boundaries of many neuropsychiatric illnesses. Here, we consider whether the habenula (Hb), a region recently demonstrated to encode negatively valenced events, also modulates the attribution of incentive salience to a neutral...

  14. Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study

    NARCIS (Netherlands)

    da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

    2011-01-01

    Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity

  15. Reward positivity: Reward prediction error or salience prediction error?

    Science.gov (United States)

    Heydari, Sepideh; Holroyd, Clay B

    2016-08-01

    The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis. © 2016 Society for Psychophysiological Research.

  16. Regulation of brain reward by the endocannabinoid system: a critical review of behavioral studies in animals.

    Science.gov (United States)

    Vlachou, S; Panagis, G

    2014-01-01

    The endocannabinoid system has been implicated in the regulation of a variety of physiological processes, including a crucial involvement in brain reward systems and the regulation of motivational processes. Behavioral studies have shown that cannabinoid reward may involve the same brain circuits and similar brain mechanisms with other drugs of abuse, such as nicotine, cocaine, alcohol and heroin, as well as natural rewards, such as food, water and sucrose, although the conditions under which cannabinoids exert their rewarding effects may be more limited. The purpose of the present review is to briefly describe and evaluate the behavioral and pharmacological research concerning the major components of the endocannabinoid system and reward processes. Special emphasis is placed on data received from four procedures used to test the effects of the endocannabinoid system on brain reward in animals; namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the drug-discrimination procedure. The effects of cannabinoid 1 (CB1) and cannabinoid 2 (CB2) receptor agonists, antagonists and endocannabinoid modulators in these procedures are examined. Further, the involvement of CB1 and CB2 receptors, as well the fatty acid amid hydrolase (FAAH) enzyme in reward processes is investigated through presentation of respective genetic ablation studies in mice. We suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. Further research will provide us with a better understanding of these processes and, thus, could lead to the development of potential therapeutic compounds for the treatment of reward-related disorders.

  17. Rewards.

    Science.gov (United States)

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. Copyright © 2011. Published by Elsevier Inc.

  18. The role of reward and reward uncertainty in episodic memory

    OpenAIRE

    Mason, Alice; Farrell, Simon; Howard-Jones, Paul; Ludwig, Casimir

    2017-01-01

    Declarative memory has been found to be sensitive to reward-related changes in the environment. The reward signal can be broken down into information regarding the expected value of the reward, reward uncertainty and the prediction error. Research has established that high as opposed to low reward values enhance declarative memory. Research in neuroscience suggests that high uncertainty activates the reward system, which could lead to enhanced learning and memory. Here we present the results ...

  19. Distinct Roles for the Amygdala and Orbitofrontal Cortex in Representing the Relative Amount of Expected Reward.

    Science.gov (United States)

    Saez, Rebecca A; Saez, Alexandre; Paton, Joseph J; Lau, Brian; Salzman, C Daniel

    2017-07-05

    The same reward can possess different motivational meaning depending upon its magnitude relative to other rewards. To study the neurophysiological mechanisms mediating assignment of motivational meaning, we recorded the activity of neurons in the amygdala and orbitofrontal cortex (OFC) of monkeys during a Pavlovian task in which the relative amount of liquid reward associated with one conditioned stimulus (CS) was manipulated by changing the reward amount associated with a second CS. Anticipatory licking tracked relative reward magnitude, implying that monkeys integrated information about recent rewards to adjust the motivational meaning of a CS. Upon changes in relative reward magnitude, neural responses to reward-predictive cues updated more rapidly in OFC than amygdala, and activity in OFC but not the amygdala was modulated by recent reward history. These results highlight a distinction between the amygdala and OFC in assessing reward history to support the flexible assignment of motivational meaning to sensory cues. Copyright © 2017 Elsevier Inc. All rights reserved.

  20. Reward-dependent modulation of working memory is associated with negative symptoms in schizophrenia.

    Science.gov (United States)

    Hager, Oliver M; Kirschner, Matthias; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N; Kaiser, Stefan

    2015-10-01

    The negative symptoms of schizophrenia have been associated with altered neural activity during both reward processing and cognitive processing. Even though increasing evidence suggests a strong interaction between these two domains, it has not been studied in relation to negative symptoms. To elucidate neural mechanisms of the reward-cognition interaction, we applied a letter variant of the n-back working memory task and varied the financial incentives for performance. In the interaction contrast, we found a significantly activated cluster in the rostral anterior cingulate cortex (ACC), the middle frontal gyrus, and the bilateral superior frontal gyrus. The interaction did not differ significantly between the patient group and a healthy control group, suggesting that patients with schizophrenia are on average able to integrate reward information and utilize this information to maximize cognitive performance. However within the patient group, we found a significant inverse correlation of ACC activity with the factor diminished expression. This finding is consistent with the model that a lack of available cognitive resources leads to diminished expression. We therefore argue that patients with diminished expression have difficulties in recruiting additional cognitive resources (as implemented in the ACC) in response to an anticipated reward. Due to this lack of cognitive resources, less processing capacity is available for effective expression, resulting in diminished expressive behavior. Copyright © 2015 Elsevier B.V. All rights reserved.

  1. Processing of continuously provided punishment and reward in children with ADHD and the modulating effects of stimulant medication: an ERP study.

    Directory of Open Access Journals (Sweden)

    Yvonne Groen

    Full Text Available OBJECTIVES: Current models of ADHD suggest abnormal reward and punishment sensitivity, but the exact mechanisms are unclear. This study aims to investigate effects of continuous reward and punishment on the processing of performance feedback in children with ADHD and the modulating effects of stimulant medication. METHODS: 15 Methylphenidate (Mph-treated and 15 Mph-free children of the ADHD-combined type and 17 control children performed a selective attention task with three feedback conditions: no-feedback, gain and loss. Event Related Potentials (ERPs time-locked to feedback and errors were computed. RESULTS: All groups performed more accurately with gain and loss than without feedback. Feedback-related ERPs demonstrated no group differences in the feedback P2, but an enhanced late positive potential (LPP to feedback stimuli (both gains and losses for Mph-free children with ADHD compared to controls. Feedback-related ERPs in Mph-treated children with ADHD were similar to controls. Correlational analyses in the ADHD groups revealed that the severity of inattention problems correlated negatively with the feedback P2 amplitude and positively with the LPP to losses and omitted gains. CONCLUSIONS: The early selective attention for rewarding and punishing feedback was relatively intact in children with ADHD, but the late feedback processing was deviant (increased feedback LPP. This may explain the often observed positive effects of continuous reinforcement on performance and behaviour in children with ADHD. However, these group findings cannot be generalised to all individuals with the ADHD, because the feedback-related ERPs were associated with the severity of the inattention problems. Children with ADHD-combined type with more inattention problems showed both deviant early attentional selection of feedback stimuli, and deviant late processing of non-reward and punishment.

  2. Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards.

    Science.gov (United States)

    Pornpattananangkul, Narun; Nadig, Ajay; Heidinger, Storm; Walden, Keegan; Nusslock, Robin

    2017-06-01

    Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).

  3. Reward guides vision when it's your thing: trait reward-seeking in reward-mediated visual priming.

    Directory of Open Access Journals (Sweden)

    Clayton Hickey

    Full Text Available Reward-related mesolimbic dopamine is thought to play an important role in guiding animal behaviour, biasing approach towards potentially beneficial environmental stimuli and away from objects unlikely to garner positive outcome. This is considered to result in part from an impact on perceptual and attentional processes: dopamine initiates a series of cognitive events that result in the priming of reward-associated perceptual features. We have provided behavioural and electrophysiological evidence that this mechanism guides human vision in search, an effect we refer to as reward priming. We have also demonstrated that there is substantial individual variability in this effect. Here we show that behavioural differences in reward priming are predicted remarkably well by a personality index that captures the degree to which a person's behaviour is driven by reward outcome. Participants with reward-seeking personalities are found to be those who allocate visual resources to objects characterized by reward-associated visual features. These results add to a rapidly developing literature demonstrating the crucial role reward plays in attentional control. They additionally illustrate the striking impact personality traits can have on low-level cognitive processes like perception and selective attention.

  4. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder.

    Science.gov (United States)

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-07-28

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing.

  5. History-based Adaptive Modulation for a Downlink Multicast Channel in OFDMA systems

    DEFF Research Database (Denmark)

    Wang, Haibo; Schwefel, Hans-Peter; Toftegaard, Thomas Skjødeberg

    2008-01-01

    In this paper we investigated the adaptive modulation strategies for Multicast service in orthogonal frequency division multiple access systems. We defined a Reward function as the performance optimization target and developed adaptive modulation strategies to maximize this Reward function....... The proposed optimization algorithm varied the instantaneous BER constraint of each mobile Multicast receiver according to its individual cumulated BER, which resulted in a significant Reward gain....

  6. The dark side of monetary incentive: how does extrinsic reward crowd out intrinsic motivation.

    Science.gov (United States)

    Ma, Qingguo; Jin, Jia; Meng, Liang; Shen, Qiang

    2014-02-12

    It was widely believed that incentives could effectively enhance the motivation of both students and employees. However, psychologists reported that extrinsic reward actually could undermine individuals' intrinsic motivation to a given interesting task, which challenged viewpoints from traditional incentive theories. Numerous studies have been carried out to test and explain the undermining effect; however, the neural basis of this effect is still elusive. Here, we carried out an electrophysiological study with a simple but interesting stopwatch task to explore to what extent the performance-based monetary reward undermines individuals' intrinsic motivation toward the task. The electrophysiological data showed that the differentiated feedback-related negativity amplitude toward intrinsic success failure divergence was prominently reduced once the extrinsic reward was imposed beforehand. However, such a difference was not observed in the control group, in which no extrinsic reward was provided throughout the experiment. Furthermore, such a pattern was not observed for P300 amplitude. Therefore, the current results indicate that extrinsic reward demotivates the intrinsic response of individuals toward success-failure outcome, which was reflected in the corresponding reduced motivational-related differentiated feedback-related negativity, but not in amplitude of P300.

  7. Cognitive capacity limitations and Need for Cognition differentially predict reward-induced cognitive effort expenditure.

    Science.gov (United States)

    Sandra, Dasha A; Otto, A Ross

    2018-03-01

    While psychological, economic, and neuroscientific accounts of behavior broadly maintain that people minimize expenditure of cognitive effort, empirical work reveals how reward incentives can mobilize increased cognitive effort expenditure. Recent theories posit that the decision to expend effort is governed, in part, by a cost-benefit tradeoff whereby the potential benefits of mental effort can offset the perceived costs of effort exertion. Taking an individual differences approach, the present study examined whether one's executive function capacity, as measured by Stroop interference, predicts the extent to which reward incentives reduce switch costs in a task-switching paradigm, which indexes additional expenditure of cognitive effort. In accordance with the predictions of a cost-benefit account of effort, we found that a low executive function capacity-and, relatedly, a low intrinsic motivation to expend effort (measured by Need for Cognition)-predicted larger increase in cognitive effort expenditure in response to monetary reward incentives, while individuals with greater executive function capacity-and greater intrinsic motivation to expend effort-were less responsive to reward incentives. These findings suggest that an individual's cost-benefit tradeoff is constrained by the perceived costs of exerting cognitive effort. Copyright © 2017 Elsevier B.V. All rights reserved.

  8. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    Science.gov (United States)

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

  9. How Performance-Contingent Reward Prospect Modulates Cognitive Control: Increased Cue Maintenance at the Cost of Decreased Flexibility

    Science.gov (United States)

    Hefer, Carmen; Dreisbach, Gesine

    2017-01-01

    Growing evidence suggests that reward prospect promotes cognitive stability in terms of increased context or cue maintenance. In 3 Experiments, using different versions of the AX-continuous performance task, we investigated whether this reward effect comes at the cost of decreased cognitive flexibility. Experiment 1 shows that the reward induced…

  10. Effects of reward on the accuracy and dynamics of smooth pursuit eye movements.

    Science.gov (United States)

    Brielmann, Aenne A; Spering, Miriam

    2015-08-01

    Reward modulates behavioral choices and biases goal-oriented behavior, such as eye or hand movements, toward locations or stimuli associated with higher rewards. We investigated reward effects on the accuracy and timing of smooth pursuit eye movements in 4 experiments. Eye movements were recorded in participants tracking a moving visual target on a computer monitor. Before target motion onset, a monetary reward cue indicated whether participants could earn money by tracking accurately, or whether the trial was unrewarded (Experiments 1 and 2, n = 11 each). Reward significantly improved eye-movement accuracy across different levels of task difficulty. Improvements were seen even in the earliest phase of the eye movement, within 70 ms of tracking onset, indicating that reward impacts visual-motor processing at an early level. We obtained similar findings when reward was not precued but explicitly associated with the pursuit target (Experiment 3, n = 16); critically, these results were not driven by stimulus prevalence or other factors such as preparation or motivation. Numerical cues (Experiment 4, n = 9) were not effective. (c) 2015 APA, all rights reserved).

  11. On the Frequency Correction in Temperature-Modulated Differential Scanning Calorimetry of Glass Transition

    DEFF Research Database (Denmark)

    Guo, Xiaoju; Mauro, J.C.; Allan, D.C.

    2012-01-01

    Temperature-modulated differential scanning calorimetry (TMDSC) is based on conventional DSC but with a sinusoidally modulated temperature path. Simulations of TMDSC signals were performed for Corning EAGLE XG® glass over a wide range of modulation frequencies. Our results reveal that the frequency...... correction commonly used in the interpretation of TMDSC signals leads to a master nonreversing heat flow curve independent of modulation frequency, provided that sufficiently high frequencies are employed in the TMDSC measurement. A master reversing heat flow curve can also be generated through the frequency...

  12. Wafer defect detection by a polarization-insensitive external differential interference contrast module.

    Science.gov (United States)

    Nativ, Amit; Feldman, Haim; Shaked, Natan T

    2018-05-01

    We present a system that is based on a new external, polarization-insensitive differential interference contrast (DIC) module specifically adapted for detecting defects in semiconductor wafers. We obtained defect signal enhancement relative to the surrounding wafer pattern when compared with bright-field imaging. The new DIC module proposed is based on a shearing interferometer that connects externally at the output port of an optical microscope and enables imaging thin samples, such as wafer defects. This module does not require polarization optics (such as Wollaston or Nomarski prisms) and is insensitive to polarization, unlike traditional DIC techniques. In addition, it provides full control of the DIC shear and orientation, which allows obtaining a differential phase image directly on the camera (with no further digital processing) while enhancing defect detection capabilities, even if the size of the defect is smaller than the resolution limit. Our technique has the potential of future integration into semiconductor production lines.

  13. The opioid receptor pharmacology of GSK1521498 compared to other ligands with differential effects on compulsive reward-related behaviours.

    Science.gov (United States)

    Kelly, Eamonn; Mundell, Stuart J; Sava, Anna; Roth, Adelheid L; Felici, Antonio; Maltby, Kay; Nathan, Pradeep J; Bullmore, Edward T; Henderson, Graeme

    2015-01-01

    The novel opioid receptor antagonist, GSK1421498, has been shown to attenuate reward-driven compulsive behaviours, such as stimulant drug seeking or binge eating, in animals and humans. Here, we report new data on the receptor pharmacology of GSK121498, in comparison to naltrexone, naloxone, 6-β-naltrexol and nalmefene. To determine whether the novel opioid antagonist, GSK1521498, is an orthosteric or allosteric antagonist at the μ opioid receptor (MOPr) and whether it has neutral antagonist or inverse agonist properties. A combination of radioligand binding assays and [(35)S]GTPγS binding assays was employed. GSK1521498 completely displaced [(3)H]naloxone binding to MOPr and did not alter the rate of [(3)H]naloxone dissociation from MOPr observations compatible with it binding to the orthosteric site on MOPr. GSK1521498 exhibited inverse agonism when MOPr was overexpressed but not when the level of MOPr expression was low. In parallel studies under conditions of high receptor expression density, naloxone, naltrexone, 6-β-naltrexol and nalmefene exhibited partial agonism, not inverse agonism as has been reported previously for naloxone and naltrexone. In brain tissue from mice receiving a prolonged morphine pre-treatment, GSK1521498 exhibited slight inverse agonism. Differences between GSK1521498 and naltrexone in their effects on compulsive reward seeking are arguably linked to the more selective and complete MOPr antagonism of GSK1521498 versus the partial MOPr agonism of naltrexone. GSK1521498 is also pharmacologically differentiated by its inverse agonist efficacy at high levels of MOPr expression, but this may be less likely to contribute to behavioural differentiation at patho-physiological levels of expression.

  14. Polymeric membranes modulate human keratinocyte differentiation in specific epidermal layers.

    Science.gov (United States)

    Salerno, Simona; Morelli, Sabrina; Giordano, Francesca; Gordano, Amalia; Bartolo, Loredana De

    2016-10-01

    In vitro models of human bioengineered skin substitutes are an alternative to animal experimentation for testing the effects and toxicity of drugs, cosmetics and pollutants. For the first time specific and distinct human epidermal strata were engineered by using membranes and keratinocytes. To this purpose, biodegradable membranes of chitosan (CHT), polycaprolactone (PCL) and a polymeric blend of CHT-PCL were prepared by phase-inversion technique and characterized in order to evaluate their morphological, physico-chemical and mechanical properties. The capability of membranes to modulate keratinocyte differentiation inducing specific interactions in epidermal membrane systems was investigated. The overall results demonstrated that the membrane properties strongly influence the cell morpho-functional behaviour of human keratinocytes, modulating their terminal differentiation, with the creation of specific epidermal strata or a fully proliferative epidermal multilayer system. In particular, human keratinocytes adhered on CHT and CHT-PCL membranes, forming the structure of the epidermal top layers, such as the corneum and granulosum strata, characterized by withdrawal or reduction from the cell cycle and cell proliferation. On the PCL membrane, keratinocytes developed an epidermal basal lamina, with high proliferating cells that stratified and migrated over time to form a complete differentiating epidermal multilayer system. Copyright © 2016 Elsevier B.V. All rights reserved.

  15. Modulation of neonatal microbial recognition: TLR-mediated innate immune responses are specifically and differentially modulated by human milk.

    Science.gov (United States)

    LeBouder, Emmanuel; Rey-Nores, Julia E; Raby, Anne-Catherine; Affolter, Michael; Vidal, Karine; Thornton, Catherine A; Labéta, Mario O

    2006-03-15

    The mechanisms controlling innate microbial recognition in the neonatal gut are still to be fully understood. We have sought specific regulatory mechanisms operating in human breast milk relating to TLR-mediated microbial recognition. In this study, we report a specific and differential modulatory effect of early samples (days 1-5) of breast milk on ligand-induced cell stimulation via TLRs. Although a negative modulation was exerted on TLR2 and TLR3-mediated responses, those via TLR4 and TLR5 were enhanced. This effect was observed in human adult and fetal intestinal epithelial cell lines, monocytes, dendritic cells, and PBMC as well as neonatal blood. In the latter case, milk compensated for the low capacity of neonatal plasma to support responses to LPS. Cell stimulation via the IL-1R or TNFR was not modulated by milk. This, together with the differential effect on TLR activation, suggested that the primary effect of milk is exerted upstream of signaling proximal to TLR ligand recognition. The analysis of TLR4-mediated gene expression, used as a model system, showed that milk modulated TLR-related genes differently, including those coding for signal intermediates and regulators. A proteinaceous milk component of > or =80 kDa was found to be responsible for the effect on TLR4. Notably, infant milk formulations did not reproduce the modulatory activity of breast milk. Together, these findings reveal an unrecognized function of human milk, namely, its capacity to influence neonatal microbial recognition by modulating TLR-mediated responses specifically and differentially. This in turn suggests the existence of novel mechanisms regulating TLR activation.

  16. Sense of Accomplishment Is Modulated by a Proper Level of Instruction and Represented in the Brain Reward System.

    Science.gov (United States)

    Nakai, Tomoya; Nakatani, Hironori; Hosoda, Chihiro; Nonaka, Yulri; Okanoya, Kazuo

    2017-01-01

    Problem-solving can be facilitated with instructions or hints, which provide information about given problems. The proper amount of instruction that should be provided for learners is controversial. Research shows that tasks with intermediate difficulty induce the largest sense of accomplishment (SA), leading to an intrinsic motivation for learning. To investigate the effect of instructions, we prepared three instruction levels (No hint, Indirect hint, and Direct hint) for the same insight-problem types. We hypothesized that indirect instructions impose intermediate difficulty for each individual, thereby inducing the greatest SA per person. Based on previous neuroimaging studies that showed involvement of the bilateral caudate in learning and motivation, we expected SA to be processed in this reward system. We recruited twenty-one participants, and investigated neural activations during problem solving by functional magnetic resonance imaging (fMRI). We confirmed that the Indirect hint, which imposed intermediate difficulty, induced the largest SA among the three instruction types. Using fMRI, we showed that activations in the bilateral caudate and anterior cingulate cortex (ACC) were significantly modulated by SA. In the bilateral caudate, the indirect hint induced the largest activation, while the ACC seemed to reflect the difference between correct and incorrect trials. Importantly, such activation pattern was independent of notations (number or letter). Our results indicate that SA is represented in the reward system, and that the Indirect instruction effectively induces such sensation.

  17. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Science.gov (United States)

    Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

    2015-01-01

    Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  18. Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

    Directory of Open Access Journals (Sweden)

    Björn Enzi

    Full Text Available Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15 and in healthy control subjects (n = 15 with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

  19. Cannabinoid transmission in the prelimbic cortex bidirectionally controls opiate reward and aversion signaling through dissociable kappa versus μ-opiate receptor dependent mechanisms.

    Science.gov (United States)

    Ahmad, Tasha; Lauzon, Nicole M; de Jaeger, Xavier; Laviolette, Steven R

    2013-09-25

    Cannabinoid, dopamine (DA), and opiate receptor pathways play integrative roles in emotional learning, associative memory, and sensory perception. Modulation of cannabinoid CB1 receptor transmission within the medial prefrontal cortex (mPFC) regulates the emotional valence of both rewarding and aversive experiences. Furthermore, CB1 receptor substrates functionally interact with opiate-related motivational processing circuits, particularly in the context of reward-related learning and memory. Considerable evidence demonstrates functional interactions between CB1 and DA signaling pathways during the processing of motivationally salient information. However, the role of mPFC CB1 receptor transmission in the modulation of behavioral opiate-reward processing is not currently known. Using an unbiased conditioned place preference paradigm with rats, we examined the role of intra-mPFC CB1 transmission during opiate reward learning. We report that activation or inhibition of CB1 transmission within the prelimbic cortical (PLC) division of the mPFC bidirectionally regulates the motivational valence of opiates; whereas CB1 activation switched morphine reward signaling into an aversive stimulus, blockade of CB1 transmission potentiated the rewarding properties of normally sub-reward threshold conditioning doses of morphine. Both of these effects were dependent upon DA transmission as systemic blockade of DAergic transmission prevented CB1-dependent modulation of morphine reward and aversion behaviors. We further report that CB1-mediated intra-PLC opiate motivational signaling is mediated through a μ-opiate receptor-dependent reward pathway, or a κ-opiate receptor-dependent aversion pathway, directly within the ventral tegmental area. Our results provide evidence for a novel CB1-mediated motivational valence switching mechanism within the PLC, controlling dissociable subcortical reward and aversion pathways.

  20. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping.

    Science.gov (United States)

    Takikawa, Yoriko; Kawagoe, Reiko; Hikosaka, Okihide

    2004-10-01

    Dopamine (DA) neurons respond to sensory stimuli that predict reward. To understand how DA neurons acquire such ability, we trained monkeys on a one-direction-rewarded version of memory-guided saccade task (1DR) only when we recorded from single DA neurons. In 1DR, position-reward mapping was changed across blocks of trials. In the early stage of training of 1DR, DA neurons responded to reward delivery; in the later stages, they responded predominantly to the visual cue that predicted reward or no reward (reward predictor) differentially. We found that such a shift of activity from reward to reward predictor also occurred within a block of trials after position-reward mapping was altered. A main effect of long-term training was to accelerate the within-block reward-to-predictor shift of DA neuronal responses. The within-block shift appeared first in the intermediate stage, but was slow, and DA neurons often responded to the cue that indicated reward in the preceding block. In the advanced stage, the reward-to-predictor shift occurred quickly such that the DA neurons' responses to visual cues faithfully matched the current position-reward mapping. Changes in the DA neuronal responses co-varied with the reward-predictive differentiation of saccade latency both in short-term (within-block) and long-term adaptation. DA neurons' response to the fixation point also underwent long-term changes until it occurred predominantly in the first trial within a block. This might trigger a switch between the learned sets. These results suggest that midbrain DA neurons play an essential role in adapting oculomotor behavior to frequent switches in position-reward mapping.

  1. Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation.

    Science.gov (United States)

    Collins, Anne L; Aitken, Tara J; Greenfield, Venuz Y; Ostlund, Sean B; Wassum, Kate M

    2016-11-01

    Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.

  2. Molecular role of dopamine in anhedonia linked to reward deficiency syndrome (RDS) and anti- reward systems.

    Science.gov (United States)

    Gold, Mark S; Blum, Kenneth; Febo, Marcelo; Baron, David; Modestino, Edward Justin; Elman, Igor; Badgaiyan, Rajendra D

    2018-03-01

    Anhedonia is a condition that leads to the loss of feelings pleasure in response to natural reinforcers like food, sex, exercise, and social activities. This disorder occurs in addiction, and an array of related neuropsychiatric syndromes, including schizophrenia, depression, and Post Traumatic Stress Disorder (PTSD). Anhedonia may by due to derangements in mesolimbic dopaminergic pathways and their terminal fields (e.g., striatum, amygdala, and prefrontal cortex) that persist long after the traces of the causative drugs are eliminated (pharmacokinetically). Here we postulate that anhedonia is not a distinct entity but is rather an epiphenomenon of hypodopaminergic states and traits arising from the interaction of genetic traits and epigenetic neurobiological alterations in response to environmental influences. Moreover, dopaminergic activity is rather complex, and so it may give rise to differential pathophysiological processes such as incentive sensitization, aberrant learning and stress-like "anti-reward" phenomena. These processes may have additive, synergistic or antagonistic interactions with the concurrent reward deficiency states leading in some instances to more severe and long-lasting symptoms. Operant understanding of the neurogenetic antecedents to reward deficiency syndrome (RDS) and the elucidation of reward gene polymorphisms may provide a map for accessing an individual's genetic risk for developing Anhedonia. Prevention techniques that can restore homeostatic balance via physiological activation of dopaminergic receptors (D2/D3) may be instrumental for targeting not only anhedonia per se but also drug craving and relapse.

  3. Rewards and Performance Incentives.

    Science.gov (United States)

    Zigon, Jack

    1994-01-01

    Discusses rewards and performance incentives for employees, including types of rewards; how rewards help in managing; dysfunctional awards; selecting the right reward; how to find rewards that fit; and delivering rewards effectively. Examples are included. (three references) (LRW)

  4. Reward loss and the basolateral amygdala: A function in reward comparisons.

    Science.gov (United States)

    Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

    2017-07-28

    The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

  5. The neurobiology of social play and its rewarding value in rats

    Science.gov (United States)

    Vanderschuren, Louk J.M.J.; Achterberg, E.J. Marijke; Trezza, Viviana

    2016-01-01

    In the young of many mammalian species, including humans, a vigorous and highly rewarding social activity is abundantly expressed, known as social play behaviour. Social play is thought to be important for the development of social, cognitive and emotional processes and their neural underpinnings, and it is disrupted in pediatric psychiatric disorders. Here, we summarize recent progress in our understanding of the brain mechanisms of social play behaviour, with a focus on its rewarding properties. Opioid, endocannabinoid, dopamine and noradrenaline systems play a prominent role in the modulation of social play. Of these, dopamine is particularly important for the motivational properties of social play. The nucleus accumbens has been identified as a key site for opioid and dopamine modulation of social play. Endocannabinoid influences on social play rely on the basolateral amygdala, whereas noradrenaline modulates social play through the basolateral amygdala, habenula and prefrontal cortex. In sum, social play behaviour is the result of coordinated activity in a network of corticolimbic structures, and its monoamine, opioid and endocannabinoid innervation. PMID:27587003

  6. Neural activation to monetary reward is associated with amphetamine reward sensitivity.

    Science.gov (United States)

    Crane, Natania A; Gorka, Stephanie M; Weafer, Jessica; Langenecker, Scott A; de Wit, Harriet; Phan, K Luan

    2018-03-14

    One known risk factor for drug use and abuse is sensitivity to rewarding effects of drugs. It is not known whether this risk factor extends to sensitivity to non-drug rewards. In this study with healthy young adults, we examined the association between sensitivity to the subjective rewarding effects of amphetamine and a neural indicator of anticipation of monetary reward. We hypothesized that greater euphorigenic response to amphetamine would be associated with greater neural activation to anticipation of monetary reward (Win > Loss). Healthy participants (N = 61) completed four laboratory sessions in which they received d-amphetamine (20 mg) and placebo in alternating order, providing self-report measures of euphoria and stimulation at regular intervals. At a separate visit 1-3 weeks later, participants completed the guessing reward task (GRT) during fMRI in a drug-free state. Participants reporting greater euphoria after amphetamine also exhibited greater neural activation during monetary reward anticipation in mesolimbic reward regions, including the bilateral caudate and putamen. This is the first study to show a relationship between neural correlates of monetary reward and sensitivity to the subjective rewarding effects of amphetamine in humans. These findings support growing evidence that sensitivity to reward in general is a risk factor for drug use and abuse, and suggest that sensitivity of drug-induced euphoria may reflect a general sensitivity to rewards. This may be an index of vulnerability for drug use or abuse.

  7. A role for the endocannabinoid 2-arachidonoyl-sn-glycerol for social and high-fat food reward in male mice.

    Science.gov (United States)

    Wei, Don; Lee, DaYeon; Li, Dandan; Daglian, Jennifer; Jung, Kwang-Mook; Piomelli, Daniele

    2016-05-01

    The endocannabinoid system is an important modulator of brain reward signaling. Investigations have focused on cannabinoid (CB1) receptors, because dissection of specific contributions of individual endocannabinoids has been limited by the available toolset. While we recently described an important role for the endocannabinoid anandamide in the regulation of social reward, it remains to be determined whether the other major endocannabinoid, 2-arachidonoyl-sn-glycerol (2-AG), serves a similar or different function. To study the role of 2-AG in natural reward, we used a transgenic mouse model (MGL-Tg mice) in which forebrain 2-AG levels are selectively reduced. We complemented behavioral analysis with measurements of brain 2-AG levels. We tested male MGL-Tg mice in conditioned place preference (CPP) tasks for high-fat food, social contact, and cocaine. We measured 2-AG content in the brain regions of interest by liquid chromatography/mass spectrometry. Male MGL-Tg mice are impaired in developing CPP for high-fat food and social interaction, but do develop CPP for cocaine. Furthermore, compared to isolated mice, levels of 2-AG in socially stimulated wild-type mice are higher in the nucleus accumbens and ventral hippocampus (183 and 140 % of controls, respectively), but unchanged in the medial prefrontal cortex. The results suggest that reducing 2-AG-mediated endocannabinoid signaling impairs social and high-fat food reward in male mice, and that social stimulation mobilizes 2-AG in key brain regions implicated in the control of motivated behavior. The time course of this response differentiates 2-AG from anandamide, whose role in mediating social reward was previously documented.

  8. Reward-Modulated Hebbian Plasticity as Leverage for Partially Embodied Control in Compliant Robotics

    Science.gov (United States)

    Burms, Jeroen; Caluwaerts, Ken; Dambre, Joni

    2015-01-01

    In embodied computation (or morphological computation), part of the complexity of motor control is offloaded to the body dynamics. We demonstrate that a simple Hebbian-like learning rule can be used to train systems with (partial) embodiment, and can be extended outside of the scope of traditional neural networks. To this end, we apply the learning rule to optimize the connection weights of recurrent neural networks with different topologies and for various tasks. We then apply this learning rule to a simulated compliant tensegrity robot by optimizing static feedback controllers that directly exploit the dynamics of the robot body. This leads to partially embodied controllers, i.e., hybrid controllers that naturally integrate the computations that are performed by the robot body into a neural network architecture. Our results demonstrate the universal applicability of reward-modulated Hebbian learning. Furthermore, they demonstrate the robustness of systems trained with the learning rule. This study strengthens our belief that compliant robots should or can be seen as computational units, instead of dumb hardware that needs a complex controller. This link between compliant robotics and neural networks is also the main reason for our search for simple universal learning rules for both neural networks and robotics. PMID:26347645

  9. Neural Mechanisms of Circadian Regulation of Natural and Drug Reward

    Directory of Open Access Journals (Sweden)

    Lauren M. DePoy

    2017-01-01

    Full Text Available Circadian rhythms are endogenously generated near 24-hour variations of physiological and behavioral functions. In humans, disruptions to the circadian system are associated with negative health outcomes, including metabolic, immune, and psychiatric diseases, such as addiction. Animal models suggest bidirectional relationships between the circadian system and drugs of abuse, whereby desynchrony, misalignment, or disruption may promote vulnerability to drug use and the transition to addiction, while exposure to drugs of abuse may entrain, disrupt, or perturb the circadian timing system. Recent evidence suggests natural (i.e., food and drug rewards may influence overlapping neural circuitry, and the circadian system may modulate the physiological and behavioral responses to these stimuli. Environmental disruptions, such as shifting schedules or shorter/longer days, influence food and drug intake, and certain mutations of circadian genes that control cellular rhythms are associated with altered behavioral reward. We highlight the more recent findings associating circadian rhythms to reward function, linking environmental and genetic evidence to natural and drug reward and related neural circuitry.

  10. Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

    Science.gov (United States)

    Murty, Vishnu P; Adcock, R Alison

    2014-08-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  11. Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

    Science.gov (United States)

    Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

    2016-03-01

    We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

  12. An endocannabinoid hypothesis of drug reward and drug addiction.

    Science.gov (United States)

    Onaivi, Emmanuel S

    2008-10-01

    Pharmacologic treatment of drug and alcohol dependency has largely been disappointing, and new therapeutic targets and hypotheses are needed. There is accumulating evidence indicating a central role for the previously unknown but ubiquitous endocannabinoid physiological control system (EPCS) in the regulation of the rewarding effects of abused substances. Thus an endocannabinoid hypothesis of drug reward is postulated. Endocannabinoids mediate retrograde signaling in neuronal tissues and are involved in the regulation of synaptic transmission to suppress neurotransmitter release by the presynaptic cannabinoid receptors (CB-Rs). This powerful modulatory action on synaptic transmission has significant functional implications and interactions with the effects of abused substances. Our data, along with those from other investigators, provide strong new evidence for a role for EPCS modulation in the effects of drugs of abuse, and specifically for involvement of cannabinoid receptors in the neural basis of addiction. Cannabinoids and endocannabinoids appear to be involved in adding to the rewarding effects of addictive substances, including, nicotine, opiates, alcohol, cocaine, and BDZs. The results suggest that the EPCS may be an important natural regulatory mechanism for drug reward and a target for the treatment of addictive disorders.

  13. Beyond Rewards

    Science.gov (United States)

    Hall, Philip S.

    2009-01-01

    Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

  14. Moving beyond energy homeostasis: new roles for glucagon-like peptide-1 in food and drug reward.

    Science.gov (United States)

    Reddy, India A; Stanwood, Gregg D; Galli, Aurelio

    2014-07-01

    Glucagon-like peptide-1 (GLP-1), a hormone and neuropeptide, is known to regulate energy homeostasis in part through an established central role in controlling food intake. Historically this central role has largely been attributed to GLP-1 receptor signaling in the brainstem and hypothalamus. However, emerging data indicate that GLP-1 also contributes to non-homeostatic regulation of food reward and motivated behaviors in brain reward centers, including the ventral tegmental area and nucleus accumbens. The hypothesis that GLP-1 signaling modulates reward circuitry has provided the impetus for studies demonstrating that GLP-1 attenuates reward for psychostimulants and alcohol. Here, we examine current evidence for GLP-1-mediated regulation of food and drug reward and use these findings to hypothesize mechanisms of action within brain reward centers. Copyright © 2013 Elsevier Ltd. All rights reserved.

  15. Genetic moderation of the association between regulatory focus and reward responsiveness: a proof-of-concept study.

    Science.gov (United States)

    Goetz, Elena L; Hariri, Ahmad R; Pizzagalli, Diego A; Strauman, Timothy J

    2013-02-01

    Recent studies implicate individual differences in regulatory focus as contributing to self-regulatory dysfunction, particularly not responding to positive outcomes. How such individual differences emerge, however, is unclear. We conducted a proof-of-concept study to examine the moderating effects of genetically driven variation in dopamine signaling, a key modulator of neural reward circuits, on the association between regulatory focus and reward cue responsiveness. Healthy Caucasians (N=59) completed a measure of chronic regulatory focus and a probabilistic reward task. A common functional genetic polymorphism impacting prefrontal dopamine signaling (COMT rs4680) was evaluated. Response bias, the participants' propensity to modulate behavior as a function of reward, was predicted by an interaction of regulatory focus and COMT genotype. Specifically, self-perceived success at achieving promotion goals predicted total response bias, but only for individuals with the COMT genotype (Val/Val) associated with relatively increased phasic dopamine signaling and cognitive flexibility. The combination of success in promotion goal pursuit and Val/Val genotype appears to facilitate responding to reward opportunities in the environment. This study is among the first to integrate an assessment of self-regulatory style with an examination of genetic variability that underlies responsiveness to positive outcomes in goal pursuit.

  16. Concurrent progressive-ratio schedules: built-in controls in the study of delayed reward efficacy.

    Science.gov (United States)

    Jarmolowicz, David P; Hudnall, Jennifer L

    2014-08-15

    Delayed rewards maintain lower rates of operant responding than immediate rewards, and when given a choice between immediate and delayed rewards, individuals typically choose the immediate reward, even when it is smaller (a phenomenon called delay discounting). The behavioral and neural mechanisms underlying these behavioral patterns, however, are not conclusively understood. The present study developed a method to examine the efficacy of delayed rewards in a way that is suitable for pharmacological manipulation of delayed reward efficacy (while controlling for general changes in reward efficacy). The progressive ratio (PR) paradigm often used to examine reward efficacy was modified such that two PR schedules for lever pressing concurrently yet independently were presented. Across a series of conditions, a range of delays (3-81s) were arranged on one of the levers while the reward on the other lever remained immediate. PR breakpoints (the highest ratio completed on each lever, our measure of reward efficacy) systematically decreased on the delayed, but not on the immediate reward lever, suggesting that delays decreased reward efficacy. This decrease in breakpoint resulted in bias in within-session responding that was accounted for by models that adjusted reward value by the delay to that reward. Unlike the standard PR paradigm, the present arrangement provided the controls needed to differentiate delay specific from general changes in reward efficacy. The present method should be helpful in the study of the behavioral and neural mechanisms of delayed reward efficacy. Modifications of the present paradigm should be useful for pharmacological studies. Copyright © 2014 Elsevier B.V. All rights reserved.

  17. Novelty enhances visual salience independently of reward in the parietal lobe.

    Science.gov (United States)

    Foley, Nicholas C; Jangraw, David C; Peck, Christopher; Gottlieb, Jacqueline

    2014-06-04

    Novelty modulates sensory and reward processes, but it remains unknown how these effects interact, i.e., how the visual effects of novelty are related to its motivational effects. A widespread hypothesis, based on findings that novelty activates reward-related structures, is that all the effects of novelty are explained in terms of reward. According to this idea, a novel stimulus is by default assigned high reward value and hence high salience, but this salience rapidly decreases if the stimulus signals a negative outcome. Here we show that, contrary to this idea, novelty affects visual salience in the monkey lateral intraparietal area (LIP) in ways that are independent of expected reward. Monkeys viewed peripheral visual cues that were novel or familiar (received few or many exposures) and predicted whether the trial will have a positive or a negative outcome--i.e., end in a reward or a lack of reward. We used a saccade-based assay to detect whether the cues automatically attracted or repelled attention from their visual field location. We show that salience--measured in saccades and LIP responses--was enhanced by both novelty and positive reward associations, but these factors were dissociable and habituated on different timescales. The monkeys rapidly recognized that a novel stimulus signaled a negative outcome (and withheld anticipatory licking within the first few presentations), but the salience of that stimulus remained high for multiple subsequent presentations. Therefore, novelty can provide an intrinsic bonus for attention that extends beyond the first presentation and is independent of physical rewards. Copyright © 2014 the authors 0270-6474/14/347947-11$15.00/0.

  18. Frontal-striatum dysfunction during reward processing: Relationships to amotivation in schizophrenia.

    Science.gov (United States)

    Chung, Yu Sun; Barch, Deanna M

    2016-04-01

    Schizophrenia is characterized by deficits of context processing, thought to be related to dorsolateral prefrontal cortex (DLPFC) impairment. Despite emerging evidence suggesting a crucial role of the DLPFC in integrating reward and goal information, we do not know whether individuals with schizophrenia can represent and integrate reward-related context information to modulate cognitive control. To address this question, 36 individuals with schizophrenia (n = 29) or schizoaffective disorder (n = 7) and 27 healthy controls performed a variant of a response conflict task (Padmala & Pessoa, 2011) during fMRI scanning, in both baseline and reward conditions, with monetary incentives on some reward trials. We used a mixed state-item design that allowed us to examine both sustained and transient reward effects on cognitive control. Different from predictions about impaired DLPFC function in schizophrenia, we found an intact pattern of increased sustained DLPFC activity during reward versus baseline blocks in individuals with schizophrenia at a group level but blunted sustained activations in the putamen. Contrary to our predictions, individuals with schizophrenia showed blunted cue-related activations in several regions of the basal ganglia responding to reward-predicting cues. Importantly, as predicted, individual differences in anhedonia/amotivation symptoms severity were significantly associated with reduced sustained DLPFC activation in the same region that showed overall increased activity as a function of reward. These results suggest that individual differences in motivational impairments in schizophrenia may be related to dysfunction of the DLPFC and striatum in motivationally salient situations. (c) 2016 APA, all rights reserved).

  19. Using food as a reward: An examination of parental reward practices.

    Science.gov (United States)

    Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

    2018-01-01

    Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

  20. Don't Worry, Be Happy: Endocannabinoids and Cannabis at the Intersection of Stress and Reward.

    Science.gov (United States)

    Volkow, Nora D; Hampson, Aidan J; Baler, Ruben D

    2017-01-06

    Cannabis enables and enhances the subjective sense of well-being by stimulating the endocannabinoid system (ECS), which plays a key role in modulating the response to stress, reward, and their interactions. However, over time, repeated activation of the ECS by cannabis can trigger neuroadaptations that may impair the sensitivity to stress and reward. This effect, in vulnerable individuals, can lead to addiction and other adverse consequences. The recent shift toward legalization of medical or recreational cannabis has renewed interest in investigating the physiological role of the ECS as well as the potential health effects, both adverse and beneficial, of cannabis. Here we review our current understanding of the ECS and its complex physiological roles. We discuss the implications of this understanding vis-á-vis the ECS's modulation of stress and reward and its relevance to mental disorders in which these processes are disrupted (i.e., addiction, depression, posttraumatic stress disorder, schizophrenia), along with the therapeutic potential of strategies to manipulate the ECS for these conditions.

  1. Effects of reward and punishment on brain activations associated with inhibitory control in cigarette smokers.

    Science.gov (United States)

    Luijten, Maartje; O'Connor, David A; Rossiter, Sarah; Franken, Ingmar H A; Hester, Robert

    2013-11-01

    Susceptibility to use of addictive substances may result, in part, from a greater preference for an immediate small reward relative to a larger delayed reward or relative insensitivity to punishment. This functional magnetic resonance imaging (fMRI) study examined the neural basis of inhibiting an immediately rewarding stimulus to obtain a larger delayed reward in smokers. We also investigated whether punishment could modulate inhibitory control. The Monetary Incentive Go/NoGo (MI-Go/NoGo) task was administered that provided three types of reward outcomes contingent upon inhibitory control performance over rewarding stimuli: inhibition failure was either followed by no monetary reward (neutral condition), a small monetary reward with immediate feedback (reward condition) or immediate monetary punishment (punishment condition). In the reward and punishment conditions, successful inhibitory control resulted in larger delayed rewards. Community sample of smokers in the Melbourne (Australia) area. Nineteen smokers were compared with 17 demographically matched non-smoking controls. Accuracy, reaction times and brain activation associated with the MI-Go/NoGo task. Smokers showed hyperactivation in the right insula (P rewarding stimulus to obtain a larger delayed reward, and during inhibition of neutral stimuli. Group differences in brain activity were not significant in the punishment condition in the right insula and dorsolateral prefrontal cortex, most probably as a result of increased activation in non-smoking controls. Compared with non-smokers, smokers showed increased neural activation when resisting immediately rewarding stimuli and may be less sensitive to punishment as a strategy to increase control over rewarding stimuli. © 2013 Society for the Study of Addiction.

  2. Valence, Not Utility, Underlies Reward-Driven Prioritization in Human Vision.

    Science.gov (United States)

    Barbaro, Ludwig; Peelen, Marius V; Hickey, Clayton

    2017-10-25

    Objects associated with reward draw attention and evoke enhanced activity in visual cortex. What is the underlying mechanism? One possibility is that reward's impact on vision is mediated by unique circuitry that modulates sensory processing, selectively increasing the salience of reward-associated stimuli. Alternatively, effects of reward may be part of a more general mechanism that prioritizes the processing of any beneficial object, importantly including stimuli that are associated with the evasion of loss. Here, we test these competing hypotheses by having male and female humans detect naturalistic objects associated with monetary reward, the evasion of equivalent loss, or neither of these. If vision is economically normative, processing of objects associated with reward and evasion of loss should be prioritized relative to neutral stimuli. Results from fMRI and behavioral experiments show that this is not the case: whereas objects associated with reward were better detected and represented in ventral visual cortex, detection and representation of stimuli associated with the evasion of loss were degraded. Representations in parietal cortex reveal a notable exception to this pattern, showing enhanced encoding of both reward- and loss-associated stimuli. Experience-driven visual prioritization can thus be economically irrational, driven by valence rather than objective utility. SIGNIFICANCE STATEMENT Normative economic models propose that gain should have the same value as evasion of equivalent loss. Is human vision rational in this way? Objects associated with reward draw attention and are well represented in visual cortex. This is thought to have evolutionary origins, highlighting objects likely to provide benefit in the future. But benefit can be conferred not only through gain, but also through evasion of loss. Here we demonstrate that the visual system prioritizes real-world objects presented in images of natural scenes only when these objects have been

  3. The endocannabinoid system and appetite: relevance for food reward.

    Science.gov (United States)

    Jager, Gerry; Witkamp, Renger F

    2014-06-01

    Mounting evidence substantiates the central role of the endocannabinoid system (ECS) in the modulation of both homeostatic and hedonic elements of appetite and food intake. Conversely, feeding status and dietary patterns directly influence activity of the ECS. Following a general introduction on the functioning of the ECS, the present review specifically addresses its role in the modulation of hedonic eating. Humans possess strong motivational systems triggered by rewarding aspects of food. Food reward is comprised of two components: one appetitive (orienting towards food); the other consummatory (hedonic evaluation), also referred to as 'wanting' and 'liking', respectively. Endocannabinoid tone seems to influence both the motivation to feed and the hedonic value of foods, probably by modifying palatability. Human physiology underlying hedonic eating is still not fully understood. A better understanding of the role of the ECS in the rewarding value of specific foods or diets could offer new possibilities to optimise the balance between energy and nutrient intake for different target groups. These groups include the obese and overweight, and potentially individuals suffering from malnutrition. Examples for the latter group are patients with disease-related anorexia, as well as the growing population of frail elderly suffering from persistent loss of food enjoyment and appetite resulting in malnutrition and involuntary weight loss. It has become clear that the psychobiology of food hedonics is extremely complex and the clinical failure of CB1 inverse agonists including rimonabant (Accomplia®) has shown that 'quick wins' in this field are unlikely.

  4. Distinct medial temporal networks encode surprise during motivation by reward versus punishment

    Science.gov (United States)

    Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

    2016-01-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

  5. Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

    Science.gov (United States)

    Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

    2016-10-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

  6. Different populations of subthalamic neurons encode cocaine vs. sucrose reward and predict future error.

    Science.gov (United States)

    Lardeux, Sylvie; Paleressompoulle, Dany; Pernaud, Remy; Cador, Martine; Baunez, Christelle

    2013-10-01

    The search for treatment of cocaine addiction raises the challenge to find a way to diminish motivation for the drug without decreasing it for natural rewards. Subthalamic nucleus (STN) inactivation decreases motivation for cocaine while increasing motivation for food, suggesting that STN can dissociate different rewards. Here, we investigated how rat STN neurons respond to cues predicting cocaine or sucrose and to reward delivery while rats are performing a discriminative stimuli task. We show that different neuronal populations of STN neurons encode cocaine and sucrose. In addition, we show that STN activity at the cue onset predicts future error. When changing the reward predicted unexpectedly, STN neurons show capacities of adaptation, suggesting a role in reward-prediction error. Furthermore, some STN neurons show a response to executive error (i.e., "oops neurons") that is specific to the missed reward. These results position the STN as a nexus where natural rewards and drugs of abuse are coded differentially and can influence the performance. Therefore, STN can be viewed as a structure where action could be taken for the treatment of cocaine addiction.

  7. Insights into glass transition and relaxation behavior using temperature-modulated differential scanning calorimetry

    DEFF Research Database (Denmark)

    Guo, Xiaoju; Mauro, J.C.; Allan, D.C.

    Temperature-modulated differential scanning calorimetry (TMDSC) is based on conventional DSC but with a sinusoidally modulated temperature path. Our simulations of TMDSC signals prove that the frequency correction of non-reversing heat flow can give a master curve within a certain range...... of frequencies. This frequency range is dependent not only on the measurement parameters such as linear heating/cooling rate and frequency and amplitude of the modulation, but also on the previous thermal history before the TMDSC measurement. The frequency correction for the reversing heat flow gives more...

  8. A translational systems biology approach in both animals and humans identifies a functionally related module of accumbal genes involved in the regulation of reward processing and binge drinking in males.

    Science.gov (United States)

    Stacey, David; Lourdusamy, Anbarasu; Ruggeri, Barbara; Maroteaux, Matthieu; Jia, Tianye; Cattrell, Anna; Nymberg, Charlotte; Banaschewski, Tobias; Bhattacharyya, Sohinee; Band, Hamid; Barker, Gareth; Bokde, Arun; Buchel, Christian; Carvalho, Fabiana; Conrod, Patricia; Desrivieres, Sylvane; Easton, Alanna; Fauth-Buehler, Mira; Fernandez-Medarde, Alberto; Flor, Herta; Frouin, Vincent; Gallinat, Jurgen; Garavanh, Hugh; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lawrence, Claire; Loth, Eva; Mann, Karl; Martinot, Jean-Luc; Nees, Frauke; Paus, Tomas; Pausova, Zdenka; Rietschel, Marcella; Rotter, Andrea; Santos, Eugenio; Smolka, Michael; Sommer, Wolfgang; Mameli, Manuel; Spanagel, Rainer; Girault, Jean-Antoine; Mueller, Christian; Schumann, Gunter

    2016-04-01

    The mesolimbic dopamine system, composed primarily of dopaminergic neurons in the ventral tegmental area that project to striatal structures, is considered to be the key mediator of reinforcement-related mechanisms in the brain. Prompted by a genome-wide association meta-analysis implicating the Ras-specific guanine nucleotide-releasing factor 2 (RASGRF2) gene in the regulation of alcohol intake in men, we have recently shown that male Rasgrf2(-/-) mice exhibit reduced ethanol intake and preference accompanied by a perturbed mesolimbic dopamine system. We therefore propose that these mice represent a valid model to further elucidate the precise genes and mechanisms regulating mesolimbic dopamine functioning. Transcriptomic data from the nucleus accumbens (NAcc) of male Rasgrf2(-/-) mice and wild-type controls were analyzed by weighted gene coexpression network analysis (WGCNA). We performed follow-up genetic association tests in humans using a sample of male adolescents from the IMAGEN study characterized for binge drinking (n = 905) and ventral striatal activation during an fMRI reward task (n = 608). The WGCNA analyses using accumbal transcriptomic data revealed 37 distinct "modules," or functionally related groups of genes. Two of these modules were significantly associated with Rasgrf2 knockout status: M5 (p reward task (pempirical < 0.001). It was not possible to determine the extent to which the M5 module was dysregulated in Rasgrf2(-/-) mice by perturbed mesolimbic dopamine signalling or by the loss of Rasgrf2 function in the NAcc. Taken together, our findings indicate that the accumbal M5 module, initially identified as being dysregulated in male Rasgrf2(-/-) mice, is also relevant for human alcohol-related phenotypes potentially through the modulation of reinforcement mechanisms in the NAcc. We therefore propose that the genes comprising this module represent important candidates for further elucidation within the context of alcohol-related phenotypes.

  9. Reward-based learning under hardware constraints - Using a RISC processor embedded in a neuromorphic substrate

    Directory of Open Access Journals (Sweden)

    Simon eFriedmann

    2013-09-01

    Full Text Available In this study, we propose and analyze in simulations a new, highly flexible method of imple-menting synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. Thestudy focuses on globally modulated STDP, as a special use-case of this method. Flexibility isachieved by embedding a general-purpose processor dedicated to plasticity into the wafer. Toevaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spiketrain learning task. A single layer of neurons is trained to fire at specific points in time withonly the reward as feedback. This model is simulated to measure its performance, i.e. the in-crease in received reward after learning. Using this performance as baseline, we then simulatethe model with various constraints imposed by the proposed implementation and compare theperformance. The simulated constraints include discretized synaptic weights, a restricted inter-face between analog synapses and embedded processor, and mismatch of analog circuits. Wefind that probabilistic updates can increase the performance of low-resolution weights, a simpleinterface between analog synapses and processor is sufficient for learning, and performance isinsensitive to mismatch. Further, we consider communication latency between wafer and theconventional control computer system that is simulating the environment. This latency increasesthe delay, with which the reward is sent to the embedded processor. Because of the time continu-ous operation of the analog synapses, delay can cause a deviation of the updates as compared tothe not delayed situation. We find that for highly accelerated systems latency has to be kept to aminimum. This study demonstrates the suitability of the proposed implementation to emulatethe selected reward modulated STDP learning rule. It is therefore an ideal candidate for imple-mentation in an upgraded version of the wafer-scale system developed within the BrainScaleSproject.

  10. Reward-based learning under hardware constraints-using a RISC processor embedded in a neuromorphic substrate.

    Science.gov (United States)

    Friedmann, Simon; Frémaux, Nicolas; Schemmel, Johannes; Gerstner, Wulfram; Meier, Karlheinz

    2013-01-01

    In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special use-case of this method. Flexibility is achieved by embedding a general-purpose processor dedicated to plasticity into the wafer. To evaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spike train learning task. A single layer of neurons is trained to fire at specific points in time with only the reward as feedback. This model is simulated to measure its performance, i.e., the increase in received reward after learning. Using this performance as baseline, we then simulate the model with various constraints imposed by the proposed implementation and compare the performance. The simulated constraints include discretized synaptic weights, a restricted interface between analog synapses and embedded processor, and mismatch of analog circuits. We find that probabilistic updates can increase the performance of low-resolution weights, a simple interface between analog synapses and processor is sufficient for learning, and performance is insensitive to mismatch. Further, we consider communication latency between wafer and the conventional control computer system that is simulating the environment. This latency increases the delay, with which the reward is sent to the embedded processor. Because of the time continuous operation of the analog synapses, delay can cause a deviation of the updates as compared to the not delayed situation. We find that for highly accelerated systems latency has to be kept to a minimum. This study demonstrates the suitability of the proposed implementation to emulate the selected reward modulated STDP learning rule. It is therefore an ideal candidate for implementation in an upgraded version of the wafer-scale system developed within the BrainScaleS project.

  11. Differentiation-inducing factor-1 and -2 function also as modulators for Dictyostelium chemotaxis.

    Directory of Open Access Journals (Sweden)

    Hidekazu Kuwayama

    Full Text Available BACKGROUND: In the early stages of development of the cellular slime mold Dictyostelium discoideum, chemotaxis toward cAMP plays a pivotal role in organizing discrete cells into a multicellular structure. In this process, a series of signaling molecules, such as G-protein-coupled cell surface receptors for cAMP, phosphatidylinositol metabolites, and cyclic nucleotides, function as the signal transducers for controlling dynamics of cytoskeleton. Differentiation-inducing factor-1 and -2 (DIF-1 and DIF-2 were originally identified as the factors (chlorinated alkylphenones that induce Dictyostelium stalk cell differentiation, but it remained unknown whether the DIFs had any other physiologic functions. METHODOLOGY/PRINCIPAL FINDINGS: To further elucidate the functions of DIFs, in the present study we investigated their effects on chemotaxis under various conditions. Quite interestingly, in shallow cAMP gradients, DIF-1 suppressed chemotaxis whereas DIF-2 promoted it greatly. Analyses with various mutants revealed that DIF-1 may inhibit chemotaxis, at least in part, via GbpB (a phosphodiesterase and a decrease in the intracellular cGMP concentration ([cGMP](i. DIF-2, by contrast, may enhance chemotaxis, at least in part, via RegA (another phosphodiesterase and an increase in [cGMP](i. Using null mutants for DimA and DimB, the transcription factors that are required for DIF-dependent prestalk differentiation, we also showed that the mechanisms for the modulation of chemotaxis by DIFs differ from those for the induction of cell differentiation by DIFs, at least in part. CONCLUSIONS/SIGNIFICANCE: Our findings indicate that DIF-1 and DIF-2 function as negative and positive modulators for Dictyostelium chemotaxis, respectively. To our knowledge, this is the first report in any organism of physiologic modulators (small molecules for chemotaxis having differentiation-inducing activity.

  12. Using effort to measure reward value of faces in children with autism.

    Directory of Open Access Journals (Sweden)

    Louise Ewing

    Full Text Available According to one influential account, face processing atypicalities in autism reflect reduced reward value of faces, which results in limited attention to faces during development and a consequent failure to acquire face expertise. Surprisingly, however, there is a paucity of work directly investigating the reward value of faces for individuals with autism and the evidence for diminished face rewards in this population remains equivocal. In the current study, we measured how hard children with autism would work to view faces, using an effortful key-press sequence, and whether they were sensitive to the differential reward value of attractive and unattractive faces. Contrary to expectations, cognitively able children with autism did not differ from typically developing children of similar age and ability in their willingness to work to view faces. Moreover, the effort expended was strongly positively correlated with facial attractiveness ratings in both groups of children. There was also no evidence of atypical reward values for other, less social categories (cars and inverted faces in the children with autism. These results speak against the possibility that face recognition difficulties in autism are explained by atypical reward value of faces.

  13. Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

    Science.gov (United States)

    Leon, M I; Gallistel, C R

    1998-07-01

    For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.

  14. Differences between Dorsal and Ventral Striatum in the Sensitivity of Tonically Active Neurons to Rewarding Events

    Directory of Open Access Journals (Sweden)

    Kevin Marche

    2017-07-01

    Full Text Available Within the striatum, cholinergic interneurons, electrophysiologically identified as tonically active neurons (TANs, represent a relatively homogeneous group in terms of their functional properties. They display typical pause in tonic firing in response to rewarding events which are of crucial importance for reinforcement learning. These responses are uniformly distributed throughout the dorsal striatum (i.e., motor and associative striatum, but it is unknown, at least in monkeys, whether differences in the modulation of TAN activity exist in the ventral striatum (i.e., limbic striatum, a region specialized for processing of motivational information. To address this issue, we examined the activity of dorsal and ventral TANs in two monkeys trained on a Pavlovian conditioning task in which a visual stimulus preceded the delivery of liquid reward by a fixed time interval. We found that the proportion of TANs responding to the stimulus predictive of reward did not vary significantly across regions (58%–80%, whereas the fraction of TANs responding to reward was higher in the limbic striatum (100% compared to the motor (65% and associative striatum (52%. By examining TAN modulation at the level of both the population and the individual neurons, we showed that the duration of pause responses to the stimulus and reward was longer in the ventral than in the dorsal striatal regions. Also, the magnitude of the pause was greater in ventral than dorsal striatum for the stimulus predictive of reward but not for the reward itself. We found similar region-specific differences in pause response duration to the stimulus when the timing of reward was less predictable (fixed replaced by variable time interval. Regional variations in the duration and magnitude of the pause response were transferred from the stimulus to reward when reward was delivered in the absence of any predictive stimulus. It therefore appears that ventral TANs exhibit stronger responses to

  15. Adaptive control of human action: The role of outcome representations and reward signals

    Directory of Open Access Journals (Sweden)

    Hans eMarien

    2013-09-01

    Full Text Available The present paper aims to advance the understanding of the control of human behavior by integrating two lines of literature that so far have led separate lives. First, one line of literature is concerned with the ideomotor principle of human behavior, according to which actions are represented in terms of their outcomes. The second line of literature mainly considers the role of reward signals in adaptive control. Here, we offer a combined perspective on how outcome representations and reward signals work together to modulate adaptive control processes. We propose that reward signals signify the value of outcome representations and facilitate the recruitment of control resources in situations where behavior needs to be maintained or adapted to attain the represented outcome. We discuss recent research demonstrating how adaptive control of goal-directed behavior may emerge when outcome representations are co-activated with positive reward signals.

  16. Intertwining personal and reward relevance: evidence from the drift-diffusion model.

    Science.gov (United States)

    Yankouskaya, A; Bührle, R; Lugt, E; Stolte, M; Sui, J

    2018-01-24

    In their seminal paper 'Is our self nothing but reward', Northoff and Hayes (Biol Psychiatry 69(11):1019-1025, Northoff, Hayes, Biological Psychiatry 69(11):1019-1025, 2011) proposed three models of the relationship between self and reward and opened a continuing debate about how these different fields can be linked. To date, none of the proposed models received strong empirical support. The present study tested common and distinct effects of personal relevance and reward values by de-componenting different stages of perceptual decision making using a drift-diffusion approach. We employed a recently developed associative matching paradigm where participants (N = 40) formed mental associations between five geometric shapes and five labels referring personal relevance in the personal task, or five shape-label pairings with different reward values in the reward task and then performed a matching task by indicating whether a displayed shape-label pairing was correct or incorrect. We found that common effects of personal relevance and monetary reward were manifested in the facilitation of behavioural performance for high personal relevance and high reward value as socially important signals. The differential effects between personal and monetary relevance reflected non-decisional time in a perceptual decision process, and task-specific prioritization of stimuli. Our findings support the parallel processing model (Northoff & Hayes, Biol Psychiatry 69(11):1019-1025, Northoff, Hayes, Biological Psychiatry 69(11):1019-1025, 2011) and suggest that self-specific processing occurs in parallel with high reward processing. Limitations and further directions are discussed.

  17. Human prosaccades and antisaccades under risk: effects of penalties and rewards on visual selection and the value of actions.

    Science.gov (United States)

    Ross, M; Lanyon, L J; Viswanathan, J; Manoach, D S; Barton, J J S

    2011-11-24

    Monkey studies report greater activity in the lateral intraparietal area and more efficient saccades when targets coincide with the location of prior reward cues, even when cue location does not indicate which responses will be rewarded. This suggests that reward can modulate spatial attention and visual selection independent of the "action value" of the motor response. Our goal was first to determine whether reward modulated visual selection similarly in humans, and next, to discover whether reward and penalty differed in effect, if cue effects were greater for cognitively demanding antisaccades, and if financial consequences that were contingent on stimulus location had spatially selective effects. We found that motivational cues reduced all latencies, more for reward than penalty. There was an "inhibition-of-return"-like effect at the location of the cue, but unlike the results in monkeys, cue valence did not modify this effect in prosaccades, and the inhibition-of-return effect was slightly increased rather than decreased in antisaccades. When financial consequences were contingent on target location, locations without reward or penalty consequences lost the benefits seen in noncontingent trials, whereas locations with consequences maintained their gains. We conclude that unlike monkeys, humans show reward effects not on visual selection but on the value of actions. The human saccadic system has both the capacity to enhance responses to multiple locations simultaneously, and the flexibility to focus motivational enhancement only on locations with financial consequences. Reward is more effective than penalty, and both interact with the additional attentional demands of the antisaccade task. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

  18. Amphetamine sensitization alters reward processing in the human striatum and amygdala.

    Directory of Open Access Journals (Sweden)

    Owen G O'Daly

    Full Text Available Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

  19. Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

    Science.gov (United States)

    Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

    2014-01-01

    Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

  20. Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials.

    Science.gov (United States)

    Cox, Anthony; Kohls, Gregor; Naples, Adam J; Mukerji, Cora E; Coffman, Marika C; Rutherford, Helena J V; Mayes, Linda C; McPartland, James C

    2015-10-01

    Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  1. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex.

    Science.gov (United States)

    Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John

    2013-02-13

    A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity.

  2. Differential pulse amplitude modulation for multiple-input single-output OWVLC

    Science.gov (United States)

    Yang, S. H.; Kwon, D. H.; Kim, S. J.; Son, Y. H.; Han, S. K.

    2015-01-01

    White light-emitting diodes (LEDs) are widely used for lighting due to their energy efficiency, eco-friendly, and small size than previously light sources such as incandescent, fluorescent bulbs and so on. Optical wireless visible light communication (OWVLC) based on LED merges lighting and communications in applications such as indoor lighting, traffic signals, vehicles, and underwater communications because LED can be easily modulated. However, physical bandwidth of LED is limited about several MHz by slow time constant of the phosphor and characteristics of device. Therefore, using the simplest modulation format which is non-return-zero on-off-keying (NRZ-OOK), the data rate reaches only to dozens Mbit/s. Thus, to improve the transmission capacity, optical filtering and pre-, post-equalizer are adapted. Also, high-speed wireless connectivity is implemented using spectrally efficient modulation methods: orthogonal frequency division multiplexing (OFDM) or discrete multi-tone (DMT). However, these modulation methods need additional digital signal processing such as FFT and IFFT, thus complexity of transmitter and receiver is increasing. To reduce the complexity of transmitter and receiver, we proposed a novel modulation scheme which is named differential pulse amplitude modulation. The proposed modulation scheme transmits different NRZ-OOK signals with same amplitude and unit time delay using each LED chip, respectively. The `N' parallel signals from LEDs are overlapped and directly detected at optical receiver. Received signal is demodulated by power difference between unit time slots. The proposed scheme can overcome the bandwidth limitation of LEDs and data rate can be improved according to number of LEDs without complex digital signal processing.

  3. Dopamine reward prediction error coding.

    Science.gov (United States)

    Schultz, Wolfram

    2016-03-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware.

  4. Differential expression of CART in feeding and reward circuits in binge eating rat model.

    Science.gov (United States)

    Bharne, Ashish P; Borkar, Chandrashekhar D; Subhedar, Nishikant K; Kokare, Dadasaheb M

    2015-09-15

    Binge eating (BE) disrupts feeding and subverts reward mechanism. Since cocaine- and amphetamine-regulated transcript peptide (CART) mediates satiety as well as reward, its role in BE justifies investigation. To induce BE, rats were provided restricted access to high fat sweet palatable diet (HFSPD) for a period of 4 weeks. Immunoreactivity profile of the CART elements, and accompanying neuroplastic changes were studied in satiety- and reward-regulating brain nuclei. Further, we investigated the effects of CART, CART-antibody or rimonabant on the intake of normal chow or HFSPD. Rats fed on HFSPD showed development of BE-like phenotype as reflected by significant consumption of HFSPD in short time frame, suggestive of dysregulated satiety mechanisms. At the mid-point during BE, CART-immunoreactivity was significantly increased in hypothalamic arcuate (ARC), lateral (LH), nucleus accumbens shell (AcbSh) and paraventricular nucleus of thalamus (PVT). However, for next 22-h post-binge time-period, the animals showed no interest in food, and low CART expression. Pre-binge treatment with rimonabant, a drug recommended for the treatment of BE, produced anorexia, increased CART expression in ARC and LH, but not in AcbSh and PVT. Higher dose of CART was required to produce anorexia in binged rats. While neuronal tracing studies confirmed CART fiber connectivity from ARC and LH to AcbSh, increase in CART and synaptophysin immunostaining in this pathway in BE rats suggested strengthening of the CART connectivity. We conclude that CART bearing ARC-LH-PVT-AcbSh reward circuit may override the satiety signaling in ARC-PVN pathway in BE rats. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Differential coding of reward and movement information in the dorsomedial striatal direct and indirect pathways.

    Science.gov (United States)

    Shin, Jung Hwan; Kim, Dohoung; Jung, Min Whan

    2018-01-26

    The direct and indirect pathways of the basal ganglia have long been thought to mediate behavioral promotion and inhibition, respectively. However, this classic dichotomous model has been recently challenged. To better understand neural processes underlying reward-based learning and movement control, we recorded from direct (dSPNs) and indirect (iSPNs) pathway spiny projection neurons in the dorsomedial striatum of D1-Cre and D2-Cre mice performing a probabilistic Pavlovian conditioning task. dSPNs tend to increase activity while iSPNs decrease activity as a function of reward value, suggesting the striatum represents value in the relative activity levels of dSPNs versus iSPNs. Lick offset-related activity increase is largely dSPN selective, suggesting dSPN involvement in suppressing ongoing licking behavior. Rapid responses to negative outcome and previous reward-related responses are more frequent among iSPNs than dSPNs, suggesting stronger contributions of iSPNs to outcome-dependent behavioral adjustment. These findings provide new insights into striatal neural circuit operations.

  6. CD4+CD25+ regulatory T cells control CD8+ T-cell effector differentiation by modulating IL-2 homeostasis

    Science.gov (United States)

    McNally, Alice; Hill, Geoffrey R.; Sparwasser, Tim; Thomas, Ranjeny; Steptoe, Raymond J.

    2011-01-01

    CD4+CD25+ regulatory T cells (Treg) play a crucial role in the regulation of immune responses. Although many mechanisms of Treg suppression in vitro have been described, the mechanisms by which Treg modulate CD8+ T cell differentiation and effector function in vivo are more poorly defined. It has been proposed, in many instances, that modulation of cytokine homeostasis could be an important mechanism by which Treg regulate adaptive immunity; however, direct experimental evidence is sparse. Here we demonstrate that CD4+CD25+ Treg, by critically regulating IL-2 homeostasis, modulate CD8+ T-cell effector differentiation. Expansion and effector differentiation of CD8+ T cells is promoted by autocrine IL-2 but, by competing for IL-2, Treg limit CD8+ effector differentiation. Furthermore, a regulatory loop exists between Treg and CD8+ effector T cells, where IL-2 produced during CD8+ T-cell effector differentiation promotes Treg expansion. PMID:21502514

  7. Immediate perception of a reward is distinct from the reward’s long-term salience

    Science.gov (United States)

    McGinnis, John P; Jiang, Huoqing; Agha, Moutaz Ali; Sanchez, Consuelo Perez; Lange, Jeff; Yu, Zulin; Marion-Poll, Frederic; Si, Kausik

    2016-01-01

    Reward perception guides all aspects of animal behavior. However, the relationship between the perceived value of a reward, the latent value of a reward, and the behavioral response remains unclear. Here we report that, given a choice between two sweet and chemically similar sugars—L- and D-arabinose—Drosophila melanogaster prefers D- over L- arabinose, but forms long-term memories of L-arabinose more reliably. Behavioral assays indicate that L-arabinose-generated memories require sugar receptor Gr43a, and calcium imaging and electrophysiological recordings indicate that L- and D-arabinose differentially activate Gr43a-expressing neurons. We posit that the immediate valence of a reward is not always predictive of the long-term reinforcement value of that reward, and that a subset of sugar-sensing neurons may generate distinct representations of similar sugars, allowing for rapid assessment of the salient features of various sugar rewards and generation of reward-specific behaviors. However, how sensory neurons communicate information about L-arabinose quality and concentration—features relevant for long-term memory—remains unknown. DOI: http://dx.doi.org/10.7554/eLife.22283.001 PMID:28005005

  8. Individual differences in the habitual use of cognitive reappraisal predict the reward-related processing.

    Science.gov (United States)

    Sai, Liyang; Wang, Sisi; Ward, Anne; Ku, Yixuan; Sang, Biao

    2015-01-01

    Recent studies have shown that instructed cognitive reappraisal can regulate the neural processing of reward. However, it is still unclear whether the habitual use of cognitive reappraisal in everyday life is related to brain activity involved in reward processing. In the present study, participants' neural responses to reward were measured using electroencephalography (EEG) recorded during a gambling task and their tendency to use cognitive reappraisal was assessed using the Emotion Regulation Questionnaire (ERQ). Event-related potential (ERP) results indicated that losses on the gambling task elicited greater negative reward-related feedback negativity (FN) than gains. The differential FN between losses and gains was significantly correlated with cognitive reappraisal scores across participants such that individuals with a higher tendency to use cognitive reappraisal showed stronger reward processing (i.e., amplified FN difference between losses and gains). This correlation remained significant after controlling for expressive suppression scores. However, expressive suppression per se was not correlated with FN differences. Taken together, these results suggest that the habitual use of cognitive reappraisal is associated with increased neural processing of reward.

  9. Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

    Science.gov (United States)

    Panagis, George; Mackey, Brian; Vlachou, Styliani

    2014-01-01

    Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

  10. Cannabinoid regulation of brain reward processing with an emphasis on the role of CB1 receptors: a step back into the future

    Directory of Open Access Journals (Sweden)

    George ePanagis

    2014-07-01

    Full Text Available Over the last decades the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain reward circuits and the regulation of motivational processes. Importantly, behavioural studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioural experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the reinstatement of drug-seeking behaviour procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1 receptor agonists, antagonists and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggests that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction related disorders.

  11. Weak reward source memory in depression reflects blunted activation of VTA/SN and parahippocampus.

    Science.gov (United States)

    Dillon, Daniel G; Dobbins, Ian G; Pizzagalli, Diego A

    2014-10-01

    Reward responses in the medial temporal lobes and dopaminergic midbrain boost episodic memory formation in healthy adults, and weak memory for emotionally positive material in depression suggests this mechanism may be dysfunctional in major depressive disorder (MDD). To test this hypothesis, we performed a study in which unmedicated adults with MDD and healthy controls encoded drawings paired with reward or zero tokens during functional magnetic resonance imaging. In a recognition test, participants judged whether drawings were previously associated with the reward token ('reward source') or the zero token ('zero source'). Unlike controls, depressed participants failed to show better memory for drawings from the reward source vs the zero source. Consistent with predictions, controls also showed a stronger encoding response to reward tokens vs zero tokens in the right parahippocampus and dopaminergic midbrain, whereas the MDD group showed the opposite pattern-stronger responses to zero vs reward tokens-in these regions. Differential activation of the dopaminergic midbrain by reward vs zero tokens was positively correlated with the reward source memory advantage in controls, but not depressed participants. These data suggest that weaker memory for positive material in depression reflects blunted encoding responses in the dopaminergic midbrain and medial temporal lobes. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  12. Heterogeneity of reward mechanisms.

    Science.gov (United States)

    Lajtha, A; Sershen, H

    2010-06-01

    The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

  13. The habenula governs the attribution of incentive salience to reward predictive cues

    Science.gov (United States)

    Danna, Carey L.; Shepard, Paul D.; Elmer, Greg I.

    2013-01-01

    The attribution of incentive salience to reward associated cues is critical for motivation and the pursuit of rewards. Disruptions in the integrity of the neural systems controlling these processes can lead to avolition and anhedonia, symptoms that cross the diagnostic boundaries of many neuropsychiatric illnesses. Here, we consider whether the habenula (Hb), a region recently demonstrated to encode negatively valenced events, also modulates the attribution of incentive salience to a neutral cue predicting a food reward. The Pavlovian autoshaping paradigm was used in the rat as an investigative tool to dissociate Pavlovian learning processes imparting strictly predictive value from learning that attributes incentive motivational value. Electrolytic lesions of the fasciculus retroflexus (fr), the sole pathway through which descending Hb efferents are conveyed, significantly increased incentive salience as measured by conditioned approaches to a cue light predictive of reward. Conversely, generation of a fictive Hb signal via fr stimulation during CS+ presentation significantly decreased the incentive salience of the predictive cue. Neither manipulation altered the reward predictive value of the cue as measured by conditioned approach to the food. Our results provide new evidence supporting a significant role for the Hb in governing the attribution of incentive motivational salience to reward predictive cues and further imply that pathological changes in Hb activity could contribute to the aberrant pursuit of debilitating goals or avolition and depression-like symptoms. PMID:24368898

  14. The habenula governs the attribution of incentive salience to reward predictive cues.

    Directory of Open Access Journals (Sweden)

    Carey L. Danna

    2013-12-01

    Full Text Available The attribution of incentive salience to reward associated cues is critical for motivation and the pursuit of rewards. Disruptions in the integrity of the neural systems controlling these processes can lead to avolition and anhedonia, symptoms that cross the diagnostic boundaries of many neuropsychiatric illnesses. Here, we consider whether the habenula (Hb, a region recently demonstrated to encode negatively valenced events, also modulates the attribution of incentive salience to a neutral cue predicting a food reward. The Pavlovian autoshaping paradigm was used in the rat as an investigative tool to dissociate Pavlovian learning processes imparting strictly predictive value from learning that attributes incentive motivational value. Electrolytic lesions of the fasciculus retroflexus (fr, the sole pathway through which descending Hb efferents are conveyed, significantly increased incentive salience as measured by conditioned approaches to a cue light predictive of reward. Conversely, generation of a fictive Hb signal via fr stimulation during CS+ presentation significantly decreased the incentive salience of the predictive cue. Neither manipulation altered the reward predictive value of the cue as measured by conditioned approach to the food. Our results provide new evidence supporting a significant role for the Hb in governing the attribution of incentive motivational salience to reward predictive cues and further imply that pathological changes in Hb activity could contribute to the aberrant pursuit of debilitating goals or avolition and depression-like symptoms.

  15. Dopamine reward prediction error coding

    OpenAIRE

    Schultz, Wolfram

    2016-01-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards?an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less...

  16. A Receiver for Differential Space-Time -Shifted BPSK Modulation Based on Scalar-MSDD and the EM Algorithm

    Directory of Open Access Journals (Sweden)

    Kim Jae H

    2005-01-01

    Full Text Available In this paper, we consider the issue of blind detection of Alamouti-type differential space-time (ST modulation in static Rayleigh fading channels. We focus our attention on a -shifted BPSK constellation, introducing a novel transformation to the received signal such that this binary ST modulation, which has a second-order transmit diversity, is equivalent to QPSK modulation with second-order receive diversity. This equivalent representation allows us to apply a low-complexity detection technique specifically designed for receive diversity, namely, scalar multiple-symbol differential detection (MSDD. To further increase receiver performance, we apply an iterative expectation-maximization (EM algorithm which performs joint channel estimation and sequence detection. This algorithm uses minimum mean square estimation to obtain channel estimates and the maximum-likelihood principle to detect the transmitted sequence, followed by differential decoding. With receiver complexity proportional to the observation window length, our receiver can achieve the performance of a coherent maximal ratio combining receiver (with differential decoding in as few as a single EM receiver iteration, provided that the window size of the initial MSDD is sufficiently long. To further demonstrate that the MSDD is a vital part of this receiver setup, we show that an initial ST conventional differential detector would lead to strange convergence behavior in the EM algorithm.

  17. Dopaminergic balance between reward maximization and policy complexity

    Directory of Open Access Journals (Sweden)

    Naama eParush

    2011-05-01

    Full Text Available Previous reinforcement-learning models of the basal ganglia network have highlighted the role of dopamine in encoding the mismatch between prediction and reality. Far less attention has been paid to the computational goals and algorithms of the main-axis (actor. Here, we construct a top-down model of the basal ganglia with emphasis on the role of dopamine as both a reinforcement learning signal and as a pseudo-temperature signal controlling the general level of basal ganglia excitability and motor vigilance of the acting agent. We argue that the basal ganglia endow the thalamic-cortical networks with the optimal dynamic tradeoff between two constraints: minimizing the policy complexity (cost and maximizing the expected future reward (gain. We show that this multi-dimensional optimization processes results in an experience-modulated version of the softmax behavioral policy. Thus, as in classical softmax behavioral policies, probability of actions are selected according to their estimated values and the pseudo-temperature, but in addition also vary according to the frequency of previous choices of these actions. We conclude that the computational goal of the basal ganglia is not to maximize cumulative (positive and negative reward. Rather, the basal ganglia aim at optimization of independent gain and cost functions. Unlike previously suggested single-variable maximization processes, this multi-dimensional optimization process leads naturally to a softmax-like behavioral policy. We suggest that beyond its role in the modulation of the efficacy of the cortico-striatal synapses, dopamine directly affects striatal excitability and thus provides a pseudo-temperature signal that modulates the trade-off between gain and cost. The resulting experience and dopamine modulated softmax policy can then serve as a theoretical framework to account for the broad range of behaviors and clinical states governed by the basal ganglia and dopamine systems.

  18. Effects of material and non-material rewards on remembering to do things for others

    Directory of Open Access Journals (Sweden)

    Maria A. Brandimonte

    2015-12-01

    Full Text Available Recent research has shown that pro-social prospective memory, i.e., remembering to do something for others, is negatively affected by the presence of small material rewards. While this competition between pro-social and self-gain motives leads to poor memory for the intention, people do not seem to be aware of the possible collision effects of competing motives (Brandimonte, Ferrante, Bianco, & Villani, 2010. Extending research on this general topic, in two activity-based prospective memory experiments, we explored the effects of different types and amount of rewards on pro-social prospective remembering. In Experiment 1, participants could receive no reward, a low material reward (1 euro, or a high material reward (20 euro for their pro-social prospective memory action. In Experiment 2, their pro-social prospective memory performance could be rewarded or not with an image reward (publicity of their altruistic behavior. Results revealed that introducing a small material reward (Experiment 1 or a non-material reward (Experiment 2 impaired pro-social prospective memory. However, introducing a high material reward eliminated the impairment (Experiment 1. Importantly, in Experiment 1, ongoing task performance in the pro-social condition was faster than in the No PM condition. However, in Experiment 2, ongoing task costs emerged in the presence of a non-material reward, as compared to the pro-social condition. Also, results from two independent ratings showed that people’s predictions on their future pro-social actions were at odds (Experiment 1 or in line (Experiment 2 with actual PM performance. It is suggested that, according to the nature and amount of rewards, memory for a pro-social future action may be modulated by conscious or unconscious motivational mechanisms.

  19. Commitment to Self-Rewards

    OpenAIRE

    Koch, Alexander K.; Nafziger, Julia

    2009-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplish¬ments and are widely recommended as tools for overcoming self-control problems. However, it seems puzzling why self-rewards can work: the prospect of a reward has a motivating force only if the threat of self-denial of the reward after low performance is credible. We explain how a rational forward-looking individual may achieve commitment to self-rewards, by applying Köszegi and Rabin's (2006) model of ...

  20. Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

    Science.gov (United States)

    Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

    2015-05-01

    Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  1. Comparing the effects of food restriction and overeating on brain reward systems.

    Science.gov (United States)

    Avena, Nicole M; Murray, Susan; Gold, Mark S

    2013-10-01

    Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. Copyright © 2013 Elsevier Inc. All rights reserved.

  2. Research on channel characteristics of differential multi pulse position modulation without background noise

    Science.gov (United States)

    Gao, Zhuo; Zhan, Weida; Sun, Quan; Hao, Ziqiang

    2018-04-01

    Differential multi-pulse position modulation (DMPPM) is a new type of modulation technology. There is a fast transmission rate, high bandwidth utilization, high modulation rate characteristics. The study of DMPPM modulation has important scientific value and practical significance. Channel capacity is one of the important indexes to measure the communication capability of communication system, and studying the channel capacity of DMPPM without background noise is the key to analyze the characteristics of DMPPM. The DMPPM theoretical model is established. The symbol structure of DMPPM with guard time slot is analyzed, and the channel capacity expression of DMPPM is deduced. Simulation analysis by MATLAB. The curves of unit channel capacity and capacity efficiency at different pulse and photon counting rates are analyzed. The results show that DMPPM is more advantageous than multi-pulse position modulation (MPPM), and is more suitable for future wireless optical communication system.

  3. Subthalamic stimulation differentially modulates declarative and nondeclarative memory.

    Science.gov (United States)

    Hälbig, Thomas D; Gruber, Doreen; Kopp, Ute A; Scherer, Peter; Schneider, Gerd-Helge; Trottenberg, Thomas; Arnold, Guy; Kupsch, Andreas

    2004-03-01

    Declarative memory has been reported to rely on the medial temporal lobe system, whereas non-declarative memory depends on basal ganglia structures. We investigated the functional role of the subthalamic nucleus (STN), a structure closely connected with the basal ganglia for both types of memory. Via deep brain high frequency stimulation (DBS) we manipulated neural activity of the STN in humans. We found that DBS-STN differentially modulated memory performance: declarative memory was impaired, whereas non-declarative memory was improved in the presence of STN-DBS indicating a specific role of the STN in the activation of memory systems. Copyright 2004 Lippincott Williams & Wilkins

  4. A Stochastic Hybrid Systems framework for analysis of Markov reward models

    International Nuclear Information System (INIS)

    Dhople, S.V.; DeVille, L.; Domínguez-García, A.D.

    2014-01-01

    In this paper, we propose a framework to analyze Markov reward models, which are commonly used in system performability analysis. The framework builds on a set of analytical tools developed for a class of stochastic processes referred to as Stochastic Hybrid Systems (SHS). The state space of an SHS is comprised of: (i) a discrete state that describes the possible configurations/modes that a system can adopt, which includes the nominal (non-faulty) operational mode, but also those operational modes that arise due to component faults, and (ii) a continuous state that describes the reward. Discrete state transitions are stochastic, and governed by transition rates that are (in general) a function of time and the value of the continuous state. The evolution of the continuous state is described by a stochastic differential equation and reward measures are defined as functions of the continuous state. Additionally, each transition is associated with a reset map that defines the mapping between the pre- and post-transition values of the discrete and continuous states; these mappings enable the definition of impulses and losses in the reward. The proposed SHS-based framework unifies the analysis of a variety of previously studied reward models. We illustrate the application of the framework to performability analysis via analytical and numerical examples

  5. Perceived state of self during motion can differentially modulate numerical magnitude allocation.

    Science.gov (United States)

    Arshad, Q; Nigmatullina, Y; Roberts, R E; Goga, U; Pikovsky, M; Khan, S; Lobo, R; Flury, A-S; Pettorossi, V E; Cohen-Kadosh, R; Malhotra, P A; Bronstein, A M

    2016-09-01

    Although a direct relationship between numerical allocation and spatial attention has been proposed, recent research suggests that these processes are not directly coupled. In keeping with this, spatial attention shifts induced either via visual or vestibular motion can modulate numerical allocation in some circumstances but not in others. In addition to shifting spatial attention, visual or vestibular motion paradigms also (i) elicit compensatory eye movements which themselves can influence numerical processing and (ii) alter the perceptual state of 'self', inducing changes in bodily self-consciousness impacting upon cognitive mechanisms. Thus, the precise mechanism by which motion modulates numerical allocation remains unknown. We sought to investigate the influence that different perceptual experiences of motion have upon numerical magnitude allocation while controlling for both eye movements and task-related effects. We first used optokinetic visual motion stimulation (OKS) to elicit the perceptual experience of either 'visual world' or 'self'-motion during which eye movements were identical. In a second experiment, we used a vestibular protocol examining the effects of perceived and subliminal angular rotations in darkness, which also provoked identical eye movements. We observed that during the perceptual experience of 'visual world' motion, rightward OKS-biased judgments towards smaller numbers, whereas leftward OKS-biased judgments towards larger numbers. During the perceptual experience of 'self-motion', judgments were biased towards larger numbers irrespective of the OKS direction. Contrastingly, vestibular motion perception was found not to modulate numerical magnitude allocation, nor was there any differential modulation when comparing 'perceived' vs. 'subliminal' rotations. We provide a novel demonstration that numerical magnitude allocation can be differentially modulated by the perceptual state of self during visual but not vestibular mediated motion

  6. A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task

    Directory of Open Access Journals (Sweden)

    Varsha eSingh

    2013-12-01

    Full Text Available The Iowa Gambling Task (IGT is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit. It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type and task motivation (instruction type. The effects of IGT variant type (reward vs. punishment and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

  7. A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task.

    Science.gov (United States)

    Singh, Varsha

    2013-01-01

    The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type) and task motivation (instruction type). The effects of IGT variant type (reward vs. punishment) and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint) on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

  8. Reward processing and mood-related symptoms: An RDoC and translational neuroscience perspective.

    Science.gov (United States)

    Nusslock, Robin; Alloy, Lauren B

    2017-07-01

    Two objectives of the NIMH Research Domain Criteria (RDoC) initiative are to identify (a) mechanisms that are common to multiple psychiatric disorders, and (b) mechanisms that are unique to specific psychiatric symptoms, and that reflect markers of differential risk for these symptoms. With respect to these objectives, a brain-behavior dimension that has received considerable attention and that is directly relevant to the Positive Valence Systems domain of the RDoC initiative involves reward processing. The present review paper first examines the relationship between reward processing and mood-related symptoms from an RDoC perspective. We then place this work in a larger context by examining the relationship between reward processing abnormalities and psychiatric symptoms defined broadly, including mood-related symptoms, schizophrenia, and addiction. Our review suggests that reward hyposensitivity relates to a subtype of anhedonia characterized by motivational deficits in unipolar depression, and reward hypersensitivity relates to a cluster of hypo/manic symptoms characterized by excessive approach motivation in the context of bipolar disorder. Integrating this perspective with research on reward processing abnormalities in schizophrenia and addiction, we further argue that the principles of equifinality and multifinality may be preferable to a transdiagnostic perspective for conceptualizing the relationship between reward processing and psychiatric symptoms defined broadly. We propose that vulnerability to either motivational anhedonia or approach-related hypo/manic symptoms involve extreme and opposite profiles of reward processing. We further propose that an equifinality and multifinality perspective may serve as a useful framework for future research on reward processing abnormalities and psychiatric symptoms. Copyright © 2017. Published by Elsevier B.V.

  9. The APC/C Coordinates Retinal Differentiation with G1 Arrest through the Nek2-Dependent Modulation of Wingless Signaling.

    Science.gov (United States)

    Martins, Torcato; Meghini, Francesco; Florio, Francesca; Kimata, Yuu

    2017-01-09

    The cell cycle is coordinated with differentiation during animal development. Here we report a cell-cycle-independent developmental role for a master cell-cycle regulator, the anaphase-promoting complex or cyclosome (APC/C), in the regulation of cell fate through modulation of Wingless (Wg) signaling. The APC/C controls both cell-cycle progression and postmitotic processes through ubiquitin-dependent proteolysis. Through an RNAi screen in the developing Drosophila eye, we found that partial APC/C inactivation severely inhibits retinal differentiation independently of cell-cycle defects. The differentiation inhibition coincides with hyperactivation of Wg signaling caused by the accumulation of a Wg modulator, Drosophila Nek2 (dNek2). The APC/C degrades dNek2 upon synchronous G1 arrest prior to differentiation, which allows retinal differentiation through local suppression of Wg signaling. We also provide evidence that decapentaplegic signaling may posttranslationally regulate this APC/C function. Thus, the APC/C coordinates cell-fate determination with the cell cycle through the modulation of developmental signaling pathways. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

  10. Random reward priming is task-contingent: The robustness of the 1-trial reward priming effect

    Directory of Open Access Journals (Sweden)

    Árni Gunnar Ásgeirsson

    2014-04-01

    Full Text Available Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings are thought to reflect that rewarded features become more salient than unrewarded ones on the subsequent trial. Here we attempt to conceptually replicate this effect, testing its generalizability. In three versions of an analogous paradigm to the additional singleton paradigm involving singleton search for a Gabor patch of odd spatial frequency we found no evidence of reward priming, while we only partially replicate the reward priming in the exact original paradigm tested by Hickey and colleagues. The results cast doubt on the proposal that random reward enhances salience, suggested in the original papers, and highlight the need for a more nuanced account. In many other paradigms reward effects have been found to progress gradually, becoming stronger as they build up, and we argue that for robust reward priming, reward schedules need to be more consistent than in the original 1-trial reward priming paradigm.

  11. A correction term for the covariance of renewal-reward processes with multivariate rewards

    NARCIS (Netherlands)

    Patch, B.; Nazarathy, Y.; Taimre, T.

    We consider a renewal-reward process with multivariate rewards. Such a process is constructed from an i.i.d. sequence of time periods, to each of which there is associated a multivariate reward vector. The rewards in each time period may depend on each other and on the period length, but not on the

  12. Individual Differences in the Habitual Use of Cognitive Reappraisal Predict the Reward-related Feedback Negativity

    Directory of Open Access Journals (Sweden)

    Liyang eSai

    2015-09-01

    Full Text Available Recent studies have shown that instructed cognitive reappraisal can regulate the neural processing of reward. However, it is still unclear whether the habitual use of cognitive reappraisal in everyday life can influence brain activity associated with reward processing. In the present study, participant’s neural responses to reward were measured using electroencephalography (EEG recorded during a gambling task, while their tendency to use cognitive reappraisal was assessed using the Emotion Regulation Questionnaire (ERQ. Event-related potential (ERP results indicated that losses on the gambling task elicited greater negative reward-related feedback negativity (FN than gains. The differential FN between losses and gains was significantly correlated with cognitive reappraisal scores across participants, such that individuals with a higher tendency to use cognitive reappraisal showed stronger reward processing (i.e. amplified FN difference between losses and gains. This correlation remained significant after controlling for expressive suppression scores. However, expressive suppression per se was not correlated with FN differences. Taken together, these results suggest that the habitual use of cognitive reappraisal influences the neural processing of reward.

  13. Cocaine affects foraging behaviour and biogenic amine modulated behavioural reflexes in honey bees

    Directory of Open Access Journals (Sweden)

    Eirik Søvik

    2014-11-01

    Full Text Available In humans and other mammals, drugs of abuse alter the function of biogenic amine pathways in the brain leading to the subjective experience of reward and euphoria. Biogenic amine pathways are involved in reward processing across diverse animal phyla, however whether cocaine acts on these neurochemical pathways to cause similar rewarding behavioural effects in animal phyla other than mammals is unclear. Previously, it has been shown that bees are more likely to dance (a signal of perceived reward when returning from a sucrose feeder after cocaine treatment. Here we examined more broadly whether cocaine altered reward-related behaviour, and biogenic amine modulated behavioural responses in bees. Bees developed a preference for locations at which they received cocaine, and when foraging at low quality sucrose feeders increase their foraging rate in response to cocaine treatment. Cocaine also increased reflexive proboscis extension to sucrose, and sting extension to electric shock. Both of these simple reflexes are modulated by biogenic amines. This shows that systemic cocaine treatment alters behavioural responses that are modulated by biogenic amines in insects. Since insect reward responses involve both octopamine and dopamine signalling, we conclude that cocaine treatment altered diverse reward-related aspects of behaviour in bees. We discuss the implications of these results for understanding the ecology of cocaine as a plant defence compound. Our findings further validate the honey bee as a model system for understanding the behavioural impacts of cocaine, and potentially other drugs of abuse.

  14. The Influence of Performance on Bargaining and Distribution of Rewards.

    Science.gov (United States)

    Landau, Samuel B.

    Performance variables were manipulated to elicit differential outcomes of success and failure for dyad members in an attempt to investigate resultant bargaining and distribution of rewards. Seventy, 10-12-year old children (36 female, 34 males) were placed into dyads controlling for age, sex, I.Q., and friendship choices. Self-allocations were…

  15. Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder.

    Science.gov (United States)

    Richey, John A; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W; Dichter, Gabriel S

    2014-03-01

    Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activation in SAD relative to ASD during monetary reward anticipation, whereas both the SAD and ASD group demonstrated decreased bilateral NAc activation relative to the control group during social reward anticipation. During reward outcomes, the SAD group did not differ significantly from the other two groups in ventromedial prefrontal cortex activation to either reward type. Analyses comparing only the ASD and SAD groups revealed greater bilateral amygdala activation to social rewards in SAD relative to ASD during both anticipation and outcome phases, and the magnitude of left amygdala hyperactivation in the SAD group during social reward anticipation was significantly correlated with the severity of trait anxiety symptoms. Results suggest reward network dysfunction to both monetary and social rewards in SAD and ASD during reward anticipation and outcomes, but that NAc hypoactivation during monetary reward anticipation differentiates ASD from SAD.

  16. DISRUPTION OF CONDITIONED REWARD ASSOCIATION BY TYPICAL AND ATYPICAL ANTIPSYCHOTICS

    Science.gov (United States)

    Danna, C.L.; Elmer, G.I.

    2013-01-01

    Antipsychotic drugs are broadly classified into typical and atypical compounds; they vary in their pharmacological profile however a common component is their antagonist effects at the D2 dopamine receptors (DRD2). Unfortunately, diminished DRD2 activation is generally thought to be associated with the severity of neuroleptic-induced anhedonia. The purpose of this study was to determine the effect of the atypical antipsychotic olanzapine and typical antipsychotic haloperidol in a paradigm that reflects the learned transfer of incentive motivational properties to previously neutral stimuli, namely autoshaping. In order to provide a dosing comparison to a therapeutically relevant endpoint, both drugs were tested against amphetamine-induced disruption of prepulse inhibition as well. In the autoshaping task, rats were exposed to repeated pairings of stimuli that were differentially predictive of reward delivery. Conditioned approach to the reward predictive cue (sign-tracking) and to the reward (goal-tracking) increased during repeated pairings in the vehicle treated rats. Haloperidol and olanzapine completely abolished this behavior at relatively low doses (100 μg/kg). This same dose was the threshold dose for each drug to antagonize the sensorimotor gating deficits produced by amphetamine. At lower doses (3–30 μg/kg) both drugs produced a dose-dependent decrease in conditioned approach to the reward predictive cue. There was no difference between drugs at this dose range which indicates that olanzapine disrupts autoshaping at a significantly lower proposed DRD2 receptor occupancy. Interestingly, neither drug disrupted conditioned approach to the reward at the same dose range that disrupted conditioned approach to the reward predictive cue. Thus, haloperidol and olanzapine, at doses well below what is considered therapeutically relevant, disrupts the attribution of incentive motivational value to previously neutral cues. Drug effects on this dimension of reward

  17. Hyperresponsiveness to social rewards in children and adolescents with attention-deficit/hyperactivity disorder (ADHD

    Directory of Open Access Journals (Sweden)

    Herpertz-Dahlmann Beate

    2009-05-01

    Full Text Available Abstract Background Current research suggests that attention-deficit/hyperactivity disorder (ADHD is associated with larger behavioral sensitivity to reinforcement contingencies. However, most studies have focused thus far on the enhancing effects of tangible rewards such as money, neglecting that social-emotional stimuli may also impact task performance in ADHD patients. Methods To determine whether non-social (monetary and social (positive facial expressions rewards differentially improve response inhibition accuracy in children and adolescents with ADHD, we applied an incentive go/no-go task with reward contingencies for successful inhibition and compared ADHD subjects with typically developing individuals. Results Both social and monetary contingencies improved inhibition accuracy in all participants. However, individuals with ADHD displayed a particularly higher profit from social reward than healthy controls, suggesting that cognitive control in ADHD patients can be specifically improved by social reinforcement. By contrast, self-rated motivation associated with task performance was significantly lower in ADHD patients. Conclusion Our findings provide evidence for hyperresponsiveness to social rewards in ADHD patients, which is accompanied by limited self-awareness. These data suggest that social reward procedures may be particularly useful in behavioral interventions in children with ADHD.

  18. Effects of direct social experience on trust decisions and neural reward circuitry

    Directory of Open Access Journals (Sweden)

    Dominic S. Fareri

    2012-10-01

    Full Text Available The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball tossing game with three fictional partners manipulated to be perceived as good, bad or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction-error (PE learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning

  19. Effects of Direct Social Experience on Trust Decisions and Neural Reward Circuitry

    Science.gov (United States)

    Fareri, Dominic S.; Chang, Luke J.; Delgado, Mauricio R.

    2012-01-01

    The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball-tossing game with three fictional partners manipulated to be perceived as good, bad, or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball-tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction error learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning mechanisms. PMID:23087604

  20. Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

    Science.gov (United States)

    Forehand, M R

    2000-12-01

    The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets.

  1. Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

    Science.gov (United States)

    Fouragnan, Elsa; Retzler, Chris; Mullinger, Karen; Philiastides, Marios G

    2015-09-08

    Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

  2. Lipopolysaccharide reduces incentive motivation while boosting preference for high reward in mice.

    Science.gov (United States)

    Vichaya, Elisabeth G; Hunt, Sarah C; Dantzer, Robert

    2014-11-01

    Inflammation has been implicated in the development of various psychiatric disorders, including depression. However, the neurobehavioral mechanism involved in this relationship remains elusive. This gap in knowledge may best be filled by evaluating elementary neurobehavioral units affected by inflammation rather than behavioral changes in conventional animal tests of depression. To this end, the current study used a concurrent choice paradigm to evaluate inflammation-induced motivational changes. Male C57BL/6J mice (n=27) were food restricted to between 85 and 90% of their free-feeding weight and were trained to perform a concurrent choice task where they nose-poked for grain rewards on a fixed ratio (FR) 1 schedule (low effort/low reward) and chocolate-flavored rewards on a FR-10 schedule (high effort/high reward). A counterbalanced-within subjects design was used. A single intraperitoneal injection of 0.33 mg/kg lipopolysaccharide (LPS) was used to induce peripheral inflammation. Twenty-four hours after LPS administration, mice showed a reduction in the total number of nose pokes. A proportionally greater reduction in nose pokes was observed for grain, resulting in an increase in percent chocolate pellets earned. These behavioral changes cannot be explained by reduced appetite as feeding before the test led to a similar increase in percent chocolate pellets earned but without any decrease in responding. These results indicate that inflammation modulates incentive motivation by affecting willingness to exert effort for reward and not by reducing sensitivity to reward.

  3. How musical training affects cognitive development: rhythm, reward and other modulating variables.

    Science.gov (United States)

    Miendlarzewska, Ewa A; Trost, Wiebke J

    2013-01-01

    Musical training has recently gained additional interest in education as increasing neuroscientific research demonstrates its positive effects on brain development. Neuroimaging revealed plastic changes in the brains of adult musicians but it is still unclear to what extent they are the product of intensive music training rather than of other factors, such as preexisting biological markers of musicality. In this review, we synthesize a large body of studies demonstrating that benefits of musical training extend beyond the skills it directly aims to train and last well into adulthood. For example, children who undergo musical training have better verbal memory, second language pronunciation accuracy, reading ability and executive functions. Learning to play an instrument as a child may even predict academic performance and IQ in young adulthood. The degree of observed structural and functional adaptation in the brain correlates with intensity and duration of practice. Importantly, the effects on cognitive development depend on the timing of musical initiation due to sensitive periods during development, as well as on several other modulating variables. Notably, we point to motivation, reward and social context of musical education, which are important yet neglected factors affecting the long-term benefits of musical training. Further, we introduce the notion of rhythmic entrainment and suggest that it may represent a mechanism supporting learning and development of executive functions. It also hones temporal processing and orienting of attention in time that may underlie enhancements observed in reading and verbal memory. We conclude that musical training uniquely engenders near and far transfer effects, preparing a foundation for a range of skills, and thus fostering cognitive development.

  4. How musical training affects cognitive development: rhythm, reward and other modulating variables.

    Directory of Open Access Journals (Sweden)

    Ewa Aurelia Miendlarzewska

    2014-01-01

    Full Text Available Musical training has recently gained additional interest in education as increasing neuroscientific research demonstrates its positive effects on brain development. Neuroimaging revealed plastic changes in the brains of adult musicians but it is still unclear to what extent they are the product of intensive music training rather than of other factors, such as preexisting biological markers of musicality. In this review, we synthesize a large body of studies demonstrating that benefits of musical training extend beyond the skills it directly aims to train and last well into adulthood. For example, children who undergo musical training have better verbal memory, second language pronunciation accuracy, reading ability and executive functions. Learning to play an instrument as a child may even predict academic performance and IQ in young adulthood. The degree of observed structural and functional adaptation in the brain correlates with intensity and duration of practice. Importantly, the effects on cognitive development depend on the timing of musical initiation due to sensitive periods during development, as well as on several other modulating variables. Notably, we point to motivation, reward and social context of musical education, which are important yet neglected factors affecting the long-term benefits of musical training. Further, we introduce the notion of rhythmic entrainment and suggest that it may represent a mechanism supporting learning and development of executive functions. It also hones temporal processing and orienting of attention in time that may underlie enhancements observed in reading and verbal memory. We conclude that musical training uniquely engenders near and far transfer effects, preparing a foundation for a range of skills, and thus fostering cognitive development.

  5. Serotonin transporter genotype modulates social reward and punishment in rhesus macaques.

    Directory of Open Access Journals (Sweden)

    Karli K Watson

    Full Text Available Serotonin signaling influences social behavior in both human and nonhuman primates. In humans, variation upstream of the promoter region of the serotonin transporter gene (5-HTTLPR has recently been shown to influence both behavioral measures of social anxiety and amygdala response to social threats. Here we show that length polymorphisms in 5-HTTLPR predict social reward and punishment in rhesus macaques, a species in which 5-HTTLPR variation is analogous to that of humans.In contrast to monkeys with two copies of the long allele (L/L, monkeys with one copy of the short allele of this gene (S/L spent less time gazing at face than non-face images, less time looking in the eye region of faces, and had larger pupil diameters when gazing at photos of a high versus low status male macaques. Moreover, in a novel primed gambling task, presentation of photos of high status male macaques promoted risk-aversion in S/L monkeys but promoted risk-seeking in L/L monkeys. Finally, as measured by a "pay-per-view" task, S/L monkeys required juice payment to view photos of high status males, whereas L/L monkeys sacrificed fluid to see the same photos.These data indicate that genetic variation in serotonin function contributes to social reward and punishment in rhesus macaques, and thus shapes social behavior in humans and rhesus macaques alike.

  6. Motivation and reward systems

    NARCIS (Netherlands)

    van Eerde, W.; Vodosek, M.; den Hartog, D.N.; McNett, J.M.

    2014-01-01

    Reward systems are identified as one of the human resource management (HRM) practices that may impact motivation. Reward systems may consist of several components, including financial and nonfinancial rewards, in fixed and variable amounts. Reinforcement, expectancy, and equity principles are

  7. Impulsive Choice, Alcohol Consumption, and Pre-Exposure to Delayed Rewards: II. Potential Mechanisms

    Science.gov (United States)

    Stein, Jeffrey S.; Renda, C. Renee; Hinnenkamp, Jay E.; Madden, Gregory J.

    2014-01-01

    In a prior study (Stein et al., 2013), we reported that rats pre-exposed to delayed rewards made fewer impulsive choices, but consumed more alcohol (12% wt/vol), than rats pre-exposed to immediate rewards. To understand the mechanisms that produced these findings, we again pre-exposed rats to either delayed (17.5 s; n = 32) or immediate (n = 30) rewards. In post-tests, delay-exposed rats made significantly fewer impulsive choices at both 15- and 30-s delays to a larger, later food reward than the immediacy-exposed comparison group. Behavior in an open-field test provided little evidence of differential stress exposure between groups. Further, consumption of either 12% alcohol or isocaloric sucrose in subsequent tests did not differ between groups. Because Stein et al. introduced alcohol concentration gradually (3–12%), we speculate that their group differences in 12% alcohol consumption were not determined by alcohol’s pharmacological effects, but by another variable (e.g., taste) that was preserved as an artifact from lower concentrations. We conclude that pre-exposure to delayed rewards generalizes beyond the pre-exposure delay; however, this same experimental variable does not robustly influence alcohol consumption. PMID:25418607

  8. Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.

    Science.gov (United States)

    Smoski, Moria J; Rittenberg, Alison; Dichter, Gabriel S

    2011-12-30

    Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during functional magnetic resonance imaging to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and 13 affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. 2011 Elsevier Ireland Ltd. All rights reserved.

  9. Incorporation of Biomaterials in Multicellular Aggregates Modulates Pluripotent Stem Cell Differentiation

    Science.gov (United States)

    Bratt-Leal, Andrés M.; Carpenedo, Richard L.; Ungrin, Mark; Zandstra, Peter W.; McDevitt, Todd C.

    2010-01-01

    Biomaterials are increasingly being used to engineer the biochemical and biophysical properties of the extracellular stem cell microenvironment in order to tailor niche characteristics and direct cell phenotype. To date, stem cell-biomaterial interactions have largely been studied by introducing stem cells into artificial environments, such as 2D cell culture on biomaterial surfaces, encapsulation of cell suspensions within hydrogel materials, or cell seeding on 3D polymeric scaffolds. In this study, microparticles fabricated from different materials, such as agarose, PLGA and gelatin, were stably integrated, in a dose-dependent manner, within aggregates of pluripotent stem cells (PSCs) prior to differentiation as a means to directly examine stem cell-biomaterial interactions in 3D. Interestingly, the presence of the materials within the stem cell aggregates differentially modulated the gene and protein expression patterns of several differentiation markers without adversely affecting cell viability. Microparticle incorporation within 3D stem cell aggregates can control the spatial presentation of extracellular environmental cues (i.e. soluble factors, extracellular matrix and intercellular adhesion molecules) as a means to direct the differentiation of stem cells for tissue engineering and regenerative medicine applications. In addition, these results suggest that the physical presence of microparticles within stem cell aggregates does not compromise PSC differentiation, but in fact the choice of biomaterials can impact the propensity of stem cells to adopt particular differentiated cell phenotypes. PMID:20864164

  10. Multiple reward-cue contingencies favor expectancy over uncertainty in shaping the reward-cue attentional salience.

    Science.gov (United States)

    De Tommaso, Matteo; Mastropasqua, Tommaso; Turatto, Massimo

    2018-01-25

    Reward-predicting cues attract attention because of their motivational value. A debated question regards the conditions under which the cue's attentional salience is governed more by reward expectancy rather than by reward uncertainty. To help shedding light on this relevant issue, here, we manipulated expectancy and uncertainty using three levels of reward-cue contingency, so that, for example, a high level of reward expectancy (p = .8) was compared with the highest level of reward uncertainty (p = .5). In Experiment 1, the best reward-cue during conditioning was preferentially attended in a subsequent visual search task. This result was replicated in Experiment 2, in which the cues were matched in terms of response history. In Experiment 3, we implemented a hybrid procedure consisting of two phases: an omission contingency procedure during conditioning, followed by a visual search task as in the previous experiments. Crucially, during both phases, the reward-cues were never task relevant. Results confirmed that, when multiple reward-cue contingencies are explored by a human observer, expectancy is the major factor controlling both the attentional and the oculomotor salience of the reward-cue.

  11. The amygdala, reward and emotion.

    Science.gov (United States)

    Murray, Elisabeth A

    2007-11-01

    Recent research provides new insights into amygdala contributions to positive emotion and reward. Studies of neuronal activity in the monkey amygdala and of autonomic responses mediated by the monkey amygdala show that, contrary to a widely held view, the amygdala is just as important for processing positive reward and reinforcement as it is for negative. In addition, neuropsychological studies reveal that the amygdala is essential for only a fraction of what might be considered 'stimulus-reward processing', and that the neural substrates for emotion and reward are partially nonoverlapping. Finally, evidence suggests that two systems within the amygdala, operating in parallel, enable reward-predicting cues to influence behavior; one mediates a general, arousing effect of reward and the other links the sensory properties of reward to emotion.

  12. High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

    Science.gov (United States)

    Cherniawsky, Avital S; Holroyd, Clay B

    2013-03-01

    Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

  13. Addictive drugs and brain stimulation reward.

    Science.gov (United States)

    Wise, R A

    1996-01-01

    Direct electrical or chemical stimulation of specific brain regions can establish response habits similar to those established by natural rewards such as food or sexual contact. Cocaine, mu and delta opiates, nicotine, phencyclidine, and cannabis each have actions that summate with rewarding electrical stimulation of the medial forebrain bundle (MFB). The reward-potentiating effects of amphetamine and opiates are associated with central sites of action where these drugs also have their direct rewarding effects, suggesting common mechanisms for drug reward per se and for drug potentiation of brain stimulation reward. The central sites at which these and perhaps other drugs of abuse potentiate brain stimulation reward and are rewarding in their own right are consistent with the hypothesis that the laboratory reward of brain stimulation and the pharmacological rewards of addictive drugs are habit forming because they act in the brain circuits that subserve more natural and biologically significant rewards.

  14. Differential Heating in the Indian Ocean Differentially Modulates Precipitation in the Ganges and Brahmaputra Basins

    Directory of Open Access Journals (Sweden)

    Md Shahriar Pervez

    2016-10-01

    Full Text Available Indo-Pacific sea surface temperature dynamics play a prominent role in Asian summer monsoon variability. Two interactive climate modes of the Indo-Pacific—the El Niño/Southern Oscillation (ENSO and the Indian Ocean dipole mode—modulate the amount of precipitation over India, in addition to precipitation over Africa, Indonesia, and Australia. However, this modulation is not spatially uniform. The precipitation in southern India is strongly forced by the Indian Ocean dipole mode and ENSO. In contrast, across northern India, encompassing the Ganges and Brahmaputra basins, the climate mode influence on precipitation is much less. Understanding the forcing of precipitation in these river basins is vital for food security and ecosystem services for over half a billion people. Using 28 years of remote sensing observations, we demonstrate that (i the tropical west-east differential heating in the Indian Ocean influences the Ganges precipitation and (ii the north-south differential heating in the Indian Ocean influences the Brahmaputra precipitation. The El Niño phase induces warming in the warm pool of the Indian Ocean and exerts more influence on Ganges precipitation than Brahmaputra precipitation. The analyses indicate that both the magnitude and position of the sea surface temperature anomalies in the Indian Ocean are important drivers for precipitation dynamics that can be effectively summarized using two new indices, one tuned for each basin. These new indices have the potential to aid forecasting of drought and flooding, to contextualize land cover and land use change, and to assess the regional impacts of climate change.

  15. Differential heating in the Indian Ocean differentially modulates precipitation in the Ganges and Brahmaputra basins

    Science.gov (United States)

    Pervez, Md Shahriar; Henebry, Geoffrey M.

    2016-01-01

    Indo-Pacific sea surface temperature dynamics play a prominent role in Asian summer monsoon variability. Two interactive climate modes of the Indo-Pacific—the El Niño/Southern Oscillation (ENSO) and the Indian Ocean dipole mode—modulate the amount of precipitation over India, in addition to precipitation over Africa, Indonesia, and Australia. However, this modulation is not spatially uniform. The precipitation in southern India is strongly forced by the Indian Ocean dipole mode and ENSO. In contrast, across northern India, encompassing the Ganges and Brahmaputra basins, the climate mode influence on precipitation is much less. Understanding the forcing of precipitation in these river basins is vital for food security and ecosystem services for over half a billion people. Using 28 years of remote sensing observations, we demonstrate that (i) the tropical west-east differential heating in the Indian Ocean influences the Ganges precipitation and (ii) the north-south differential heating in the Indian Ocean influences the Brahmaputra precipitation. The El Niño phase induces warming in the warm pool of the Indian Ocean and exerts more influence on Ganges precipitation than Brahmaputra precipitation. The analyses indicate that both the magnitude and position of the sea surface temperature anomalies in the Indian Ocean are important drivers for precipitation dynamics that can be effectively summarized using two new indices, one tuned for each basin. These new indices have the potential to aid forecasting of drought and flooding, to contextualize land cover and land use change, and to assess the regional impacts of climate change.

  16. A Markov reward model checker

    NARCIS (Netherlands)

    Katoen, Joost P.; Maneesh Khattri, M.; Zapreev, I.S.; Zapreev, I.S.

    2005-01-01

    This short tool paper introduces MRMC, a model checker for discrete-time and continuous-time Markov reward models. It supports reward extensions of PCTL and CSL, and allows for the automated verification of properties concerning long-run and instantaneous rewards as well as cumulative rewards. In

  17. The art of anger: reward context turns avoidance responses to anger-related objects into approach.

    Science.gov (United States)

    Aarts, Henk; Ruys, Kirsten I; Veling, Harm; Renes, Robert A; de Groot, Jasper H B; van Nunen, Anna M; Geertjes, Sarit

    2010-10-01

    Anger has a special status among the emotions in that it can elicit avoidance as well as approach motivation. This study tested the ignored role of reward context in potentiating approach rather than avoidance responses toward objects associated with anger. In Experiment 1, angry and neutral facial expressions were parafoveally paired with common objects, and responses to the objects were assessed by subjective reports of motivation to obtain them. In Experiment 2, objects were again paired with angry or neutral faces outside of participants' awareness, and responses toward the objects were indexed by physical effort expended in attempting to win them. Results showed that approach motivation toward anger-related objects can be observed when responding is framed in terms of rewards that one can obtain, whereas avoidance motivation occurs in the absence of such a reward context. These findings point to the importance of a reward context in modulating people's responses to anger.

  18. Premotor and Motor Cortices Encode Reward.

    Directory of Open Access Journals (Sweden)

    Pavan Ramkumar

    Full Text Available Rewards associated with actions are critical for motivation and learning about the consequences of one's actions on the world. The motor cortices are involved in planning and executing movements, but it is unclear whether they encode reward over and above limb kinematics and dynamics. Here, we report a categorical reward signal in dorsal premotor (PMd and primary motor (M1 neurons that corresponds to an increase in firing rates when a trial was not rewarded regardless of whether or not a reward was expected. We show that this signal is unrelated to error magnitude, reward prediction error, or other task confounds such as reward consumption, return reach plan, or kinematic differences across rewarded and unrewarded trials. The availability of reward information in motor cortex is crucial for theories of reward-based learning and motivational influences on actions.

  19. Impaired reward responsiveness in schizophrenia.

    Science.gov (United States)

    Taylor, Nicholas; Hollis, Jeffrey P; Corcoran, Sarah; Gross, Robin; Cuthbert, Bruce; Swails, Lisette W; Duncan, Erica

    2018-03-08

    Anhedonia is a core negative symptom of schizophrenia. Schizophrenia patients report largely intact pleasure in consuming rewards, but have impairments in generating motivated behavior to pursue rewards, and show reduced fMRI activation of the reward pathway during presentation of rewarded stimuli. A computer based task measuring the development of a response bias in favor of rewarded stimuli permits assessment of reward-induced motivation. We hypothesized that subjects with schizophrenia would be impaired on this task. 58 schizophrenia subjects (SCZ) and 52 healthy controls (CON) were studied with a signal detection task to assess reward responsiveness. In multiple trials over three blocks subjects were asked to correctly identify two stimuli that were paired with unequal chance of monetary reward. The critical outcome variable was response bias, the development of a greater percent correct identification of the stimulus that was rewarded more often. An ANOVA on response bias with Block as a repeated-measures factor and Diagnosis as a between-group factor indicated that SCZ subjects achieved a lower bias to rewarded stimuli than CON subjects (F(1,105)=8.82, p=0.004, η 2 =0.078). Post hoc tests indicated that SCZ subjects had significantly impaired bias in Block 1 (p=0.002) and Block 2 (p=0.05), indicating that SCZ were slower to achieve normal levels of bias during the session. SCZ subjects were slower to develop response bias to rewarded stimuli than CON subjects. This finding is consonant with the hypothesis that people with schizophrenia have a blunted capacity to modify behavior in response to reward. Copyright © 2018. Published by Elsevier B.V.

  20. Modulation of the mesolimbic dopamine system by leptin.

    Science.gov (United States)

    Opland, Darren M; Leinninger, Gina M; Myers, Martin G

    2010-09-02

    Nutritional status modulates many forms of reward-seeking behavior, with caloric restriction increasing the drive for drugs of abuse as well as for food. Understanding the interactions between the mesolimbic dopamine (DA) system (which mediates the incentive salience of natural and artificial rewards) and the neural and hormonal systems that sense and regulate energy balance is thus of significant importance. Leptin, which is produced by adipocytes in proportion to fat content as a hormonal signal of long-term energy stores, acts via its receptor (LepRb) on multiple populations of central nervous system neurons to modulate neural circuits in response to body energy stores. Leptin suppresses feeding and plays a central role in the control of energy balance. In addition to demonstrating that leptin modulates hypothalamic and brainstem circuits to promote satiety, recent work has begun to explore the mechanisms by which leptin influences the mesolimbic DA system and related behaviors. Indeed, leptin diminishes several measures of drug and food reward, and promotes a complex set of changes in the mesolimbic DA system. While many of the details remain to be worked out, several lines of evidence suggest that leptin regulates the mesolimbic DA system via multiple neural pathways and processes, and that distinct sets of LepRb neurons each modulate unique aspects of the mesolimbic DA system and behavior in response to leptin. 2010 Elsevier B.V. All rights reserved.

  1. Commitment to self-rewards

    DEFF Research Database (Denmark)

    Koch, Alexander; Nafziger, Julia

    People often overcome self-control problems by promising to reward themselves for accomplishing a task. Such strategies based on self-administered rewards however require the person to believe that she would indeed deny herself the reward if she should fail to achieve the desired outcome. Drawing...... on Koszegi and Rabin's (2006) model of endogenous reference point formation, we show how a rational forward-looking individual can achieve such internal commitment. But our results also demonstrate the limitations of self regulation based on self-rewards....

  2. Introduction: Addiction and Brain Reward and Anti-Reward Pathways

    Science.gov (United States)

    Gardner, Eliot L.

    2013-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the

  3. Modulating Functions Based Algorithm for the Estimation of the Coefficients and Differentiation Order for a Space-Fractional Advection-Dispersion Equation

    KAUST Repository

    Aldoghaither, Abeer

    2015-12-01

    In this paper, a new method, based on the so-called modulating functions, is proposed to estimate average velocity, dispersion coefficient, and differentiation order in a space-fractional advection-dispersion equation, where the average velocity and the dispersion coefficient are space-varying. First, the average velocity and the dispersion coefficient are estimated by applying the modulating functions method, where the problem is transformed into a linear system of algebraic equations. Then, the modulating functions method combined with a Newton\\'s iteration algorithm is applied to estimate the coefficients and the differentiation order simultaneously. The local convergence of the proposed method is proved. Numerical results are presented with noisy measurements to show the effectiveness and robustness of the proposed method. It is worth mentioning that this method can be extended to general fractional partial differential equations.

  4. Modulating Functions Based Algorithm for the Estimation of the Coefficients and Differentiation Order for a Space-Fractional Advection-Dispersion Equation

    KAUST Repository

    Aldoghaither, Abeer; Liu, Da-Yan; Laleg-Kirati, Taous-Meriem

    2015-01-01

    In this paper, a new method, based on the so-called modulating functions, is proposed to estimate average velocity, dispersion coefficient, and differentiation order in a space-fractional advection-dispersion equation, where the average velocity and the dispersion coefficient are space-varying. First, the average velocity and the dispersion coefficient are estimated by applying the modulating functions method, where the problem is transformed into a linear system of algebraic equations. Then, the modulating functions method combined with a Newton's iteration algorithm is applied to estimate the coefficients and the differentiation order simultaneously. The local convergence of the proposed method is proved. Numerical results are presented with noisy measurements to show the effectiveness and robustness of the proposed method. It is worth mentioning that this method can be extended to general fractional partial differential equations.

  5. Dopaminergic Modulation of Risky Decision-Making

    Science.gov (United States)

    Simon, Nicholas W.; Montgomery, Karienn S.; Beas, Blanca S.; Mitchell, Marci R.; LaSarge, Candi L.; Mendez, Ian A.; Bañuelos, Cristina; Vokes, Colin M.; Taylor, Aaron B.; Haberman, Rebecca P.; Bizon, Jennifer L.; Setlow, Barry

    2012-01-01

    Many psychiatric disorders are characterized by abnormal risky decision-making and dysregulated dopamine receptor expression. The current study was designed to determine how different dopamine receptor subtypes modulate risk-taking in young adult rats, using a “Risky Decision-making Task” that involves choices between small “safe” rewards and large “risky” rewards accompanied by adverse consequences. Rats showed considerable, stable individual differences in risk preference in the task, which were not related to multiple measures of reward motivation, anxiety, or pain sensitivity. Systemic activation of D2-like receptors robustly attenuated risk-taking, whereas drugs acting on D1-like receptors had no effect. Systemic amphetamine also reduced risk-taking, an effect which was attenuated by D2-like (but not D1-like) receptor blockade. Dopamine receptor mRNA expression was evaluated in a separate cohort of drug-naive rats characterized in the task. D1 mRNA expression in both nucleus accumbens shell and insular cortex was positively associated with risk-taking, while D2 mRNA expression in orbitofrontal and medial prefrontal cortex predicted risk preference in opposing nonlinear patterns. Additionally, lower levels of D2 mRNA in dorsal striatum were associated with greater risk-taking. These data strongly implicate dopamine signaling in prefrontal corticalstriatal circuitry in modulating decision-making processes involving integration of reward information with risks of adverse consequences. PMID:22131407

  6. Analogical reasoning and the differential outcome effect: transitory bridging of the conceptual gap for rhesus monkeys (Macaca mulatta).

    Science.gov (United States)

    Flemming, Timothy M; Thompson, Roger K R; Beran, Michael J; Washburn, David A

    2011-07-01

    Monkeys, unlike chimpanzees and humans, have a marked difficulty acquiring relational matching-to-sample (RMTS) tasks that likely reflect the cognitive foundation upon which analogical reasoning rests. In the present study, rhesus monkeys (Macaca mulatta) completed a categorical (identity and nonidentity) RMTS task with differential reward (pellet ratio) and/or punishment (timeout ratio) outcomes for correct and incorrect choices. Monkeys in either differential reward-only or punishment-only conditions performed at chance levels. However, the RMTS performance of monkeys experiencing both differential reward and punishment conditions was significantly better than chance. Subsequently when all animals experienced nondifferential outcomes tests, their RMTS performance levels were at chance. These results indicate that combining differential reward and punishment contingencies provide an effective, albeit transitory, scaffolding for monkeys to judge analogical relations-between-relations. PsycINFO Database Record (c) 2011 APA, all rights reserved

  7. Deep brain stimulation of the subthalamic nucleus modulates sensitivity to decision outcome value in Parkinson’s disease

    Science.gov (United States)

    Seymour, Ben; Barbe, Michael; Dayan, Peter; Shiner, Tamara; Dolan, Ray; Fink, Gereon R.

    2016-09-01

    Deep brain stimulation (DBS) of the subthalamic nucleus in Parkinson’s disease is known to cause a subtle but important adverse impact on behaviour, with impulsivity its most widely reported manifestation. However, precisely which computational components of the decision process are modulated is not fully understood. Here we probe a number of distinct subprocesses, including temporal discount, outcome utility, instrumental learning rate, instrumental outcome sensitivity, reward-loss trade-offs, and perseveration. We tested 22 Parkinson’s Disease patients both on and off subthalamic nucleus deep brain stimulation (STN-DBS), while they performed an instrumental learning task involving financial rewards and losses, and an inter-temporal choice task for financial rewards. We found that instrumental learning performance was significantly worse following stimulation, due to modulation of instrumental outcome sensitivity. Specifically, patients became less sensitive to decision values for both rewards and losses, but without any change to the learning rate or reward-loss trade-offs. However, we found no evidence that DBS modulated different components of temporal impulsivity. In conclusion, our results implicate the subthalamic nucleus in a modulation of outcome value in experience-based learning and decision-making in Parkinson’s disease, suggesting a more pervasive role of the subthalamic nucleus in the control of human decision-making than previously thought.

  8. Reward and punishment.

    Science.gov (United States)

    Sigmund, K; Hauert, C; Nowak, M A

    2001-09-11

    Minigames capturing the essence of Public Goods experiments show that even in the absence of rationality assumptions, both punishment and reward will fail to bring about prosocial behavior. This result holds in particular for the well-known Ultimatum Game, which emerges as a special case. But reputation can induce fairness and cooperation in populations adapting through learning or imitation. Indeed, the inclusion of reputation effects in the corresponding dynamical models leads to the evolution of economically productive behavior, with agents contributing to the public good and either punishing those who do not or rewarding those who do. Reward and punishment correspond to two types of bifurcation with intriguing complementarity. The analysis suggests that reputation is essential for fostering social behavior among selfish agents, and that it is considerably more effective with punishment than with reward.

  9. Reward Expectancy Strengthens CA1 Theta and Beta Band Synchronization and Hippocampal-Ventral Striatal Coupling.

    Science.gov (United States)

    Lansink, Carien S; Meijer, Guido T; Lankelma, Jan V; Vinck, Martin A; Jackson, Jadin C; Pennartz, Cyriel M A

    2016-10-12

    The use of information from the hippocampal memory system in motivated behavior depends on its communication with the ventral striatum. When an animal encounters cues that signal subsequent reward, its reward expectancy is raised. It is unknown, however, how this process affects hippocampal dynamics and their influence on target structures, such as ventral striatum. We show that, in rats, reward-predictive cues result in enhanced hippocampal theta and beta band rhythmic activity during subsequent action, compared with uncued goal-directed navigation. The beta band component, also labeled theta's harmonic, involves selective hippocampal CA1 cell groups showing frequency doubling of firing periodicity relative to theta rhythmicity and it partitions the theta cycle into segments showing clear versus poor spike timing organization. We found that theta phase precession occurred over a wider range than previously reported. This was apparent from spikes emitted near the peak of the theta cycle exhibiting large "phase precessing jumps" relative to spikes in foregoing cycles. Neither this phenomenon nor the regular manifestation of theta phase precession was affected by reward expectancy. Ventral striatal neuronal firing phase-locked not only to hippocampal theta, but also to beta band activity. Both hippocampus and ventral striatum showed increased synchronization between neuronal firing and local field potential activity during cued compared with uncued goal approaches. These results suggest that cue-triggered reward expectancy intensifies hippocampal output to target structures, such as the ventral striatum, by which the hippocampus may gain prioritized access to systems modulating motivated behaviors. Here we show that temporally discrete cues raising reward expectancy enhance both theta and beta band activity in the hippocampus once goal-directed navigation has been initiated. These rhythmic activities are associated with increased synchronization of neuronal firing

  10. Modulating functions-based method for parameters and source estimation in one-dimensional partial differential equations

    KAUST Repository

    Asiri, Sharefa M.; Laleg-Kirati, Taous-Meriem

    2016-01-01

    In this paper, modulating functions-based method is proposed for estimating space–time-dependent unknowns in one-dimensional partial differential equations. The proposed method simplifies the problem into a system of algebraic equations linear

  11. Short- and long-term modulation of synaptic inputs to brain reward areas by nicotine

    NARCIS (Netherlands)

    Fagen, Z.M.; Mansvelder, H.D.; Keath, R.; McGehee, D.S.

    2003-01-01

    Dopamine signaling in brain reward areas is a key element in the development of drug abuse and dependence. Recent anatomical and electrophysiological research has begun to elucidate both complexity and specificity In synaptic connections between ventral tegmental neurons and their inputs.

  12. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Science.gov (United States)

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  13. Leptin Suppresses the Rewarding Effects of Running via STAT3 Signaling in Dopamine Neurons.

    Science.gov (United States)

    Fernandes, Maria Fernanda A; Matthys, Dominique; Hryhorczuk, Cécile; Sharma, Sandeep; Mogra, Shabana; Alquier, Thierry; Fulton, Stephanie

    2015-10-06

    The adipose hormone leptin potently influences physical activity. Leptin can decrease locomotion and running, yet the mechanisms involved and the influence of leptin on the rewarding effects of running ("runner's high") are unknown. Leptin receptor (LepR) signaling involves activation of signal transducer and activator of transcription-3 (STAT3), including in dopamine neurons of the ventral tegmental area (VTA) that are essential for reward-relevant behavior. We found that mice lacking STAT3 in dopamine neurons exhibit greater voluntary running, an effect reversed by viral-mediated STAT3 restoration. STAT3 deletion increased the rewarding effects of running whereas intra-VTA leptin blocked it in a STAT3-dependent manner. Finally, STAT3 loss-of-function reduced mesolimbic dopamine overflow and function. Findings suggest that leptin influences the motivational effects of running via LepR-STAT3 modulation of dopamine tone. Falling leptin is hypothesized to increase stamina and the rewarding effects of running as an adaptive means to enhance the pursuit and procurement of food. Copyright © 2015 Elsevier Inc. All rights reserved.

  14. Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons

    Science.gov (United States)

    Park, Junchol

    2017-01-01

    Actions motivated by rewards are often associated with risk of punishment. Little is known about the neural representation of punishment risk during reward-seeking behavior. We modeled this circumstance in rats by designing a task where actions were consistently rewarded but probabilistically punished. Spike activity and local field potentials were recorded during task performance simultaneously from VTA and mPFC, two reciprocally connected regions implicated in reward-seeking and aversive behaviors. At the single unit level, we found that ensembles of putative dopamine and non-dopamine VTA neurons and mPFC neurons encode the relationship between action and punishment. At the network level, we found that coherent theta oscillations synchronize VTA and mPFC in a bottom-up direction, effectively phase-modulating the neuronal spike activity in the two regions during punishment-free actions. This synchrony declined as a function of punishment probability, suggesting that during reward-seeking actions, risk of punishment diminishes VTA-driven neural synchrony between the two regions. PMID:29058673

  15. HDAC inhibitors: modulating leukocyte differentiation, survival, proliferation and inflammation.

    Science.gov (United States)

    Sweet, Matthew J; Shakespear, Melanie R; Kamal, Nabilah A; Fairlie, David P

    2012-01-01

    Therapeutic effects of histone deacetylase (HDAC) inhibitors in cancer models were first linked to their ability to cause growth arrest and apoptosis of tumor cells. It is now clear that these agents also have pleiotropic effects on angiogenesis and the immune system, and some of these properties are likely to contribute to their anti-cancer activities. It is also emerging that inhibitors of specific HDACs affect the differentiation, survival and/or proliferation of distinct immune cell populations. This is true for innate immune cells such as macrophages, as well as cells of the acquired immune system, for example, T-regulatory cells. These effects may contribute to therapeutic profiles in some autoimmune and chronic inflammatory disease models. Here, we review our current understanding of how classical HDACs (HDACs 1-11) and their inhibitors impact on differentiation, survival and proliferation of distinct leukocyte populations, as well as the likely relevance of these effects to autoimmune and inflammatory disease processes. The ability of HDAC inhibitors to modulate leukocyte survival may have implications for the rationale of developing selective inhibitors as anti-inflammatory drugs.

  16. Context-specific activation of hippocampus and SN/VTA by reward is related to enhanced long-term memory for embedded objects.

    Science.gov (United States)

    Loh, Eleanor; Kumaran, Dharshan; Koster, Raphael; Berron, David; Dolan, Ray; Duzel, Emrah

    2016-10-01

    Animal studies indicate that hippocampal representations of environmental context modulate reward-related processing in the substantia nigra and ventral tegmental area (SN/VTA), a major origin of dopamine in the brain. Using functional magnetic resonance imaging (fMRI) in humans, we investigated the neural specificity of context-reward associations under conditions where the presence of perceptually similar neutral contexts imposed high demands on a putative hippocampal function, pattern separation. The design also allowed us to investigate how contextual reward enhances long-term memory for embedded neutral objects. SN/VTA activity underpinned specific context-reward associations in the face of perceptual similarity. A reward-related enhancement of long-term memory was restricted to the condition where the rewarding and the neutral contexts were perceptually similar, and in turn was linked to co-activation of the hippocampus (subfield DG/CA3) and SN/VTA. Thus, an ability of contextual reward to enhance memory for focal objects is closely linked to context-related engagement of hippocampal-SN/VTA circuitry. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

  17. Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence.

    Science.gov (United States)

    Casement, Melynda D; Keenan, Kate E; Hipwell, Alison E; Guyer, Amanda E; Forbes, Erika E

    2016-02-01

    Emerging evidence suggests that insomnia may disrupt reward-related brain function-a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms-including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)-contribute to depressive symptoms in adolescent girls. Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. © 2016 Associated Professional Sleep Societies, LLC.

  18. miR-146a modulates autoreactive Th17 cell differentiation and regulates organ-specific autoimmunity.

    Science.gov (United States)

    Li, Bo; Wang, Xi; Choi, In Young; Wang, Yu-Chen; Liu, Siyuan; Pham, Alexander T; Moon, Heesung; Smith, Drake J; Rao, Dinesh S; Boldin, Mark P; Yang, Lili

    2017-10-02

    Autoreactive CD4 T cells that differentiate into pathogenic Th17 cells can trigger autoimmune diseases. Therefore, investigating the regulatory network that modulates Th17 differentiation may yield important therapeutic insights. miR-146a has emerged as a critical modulator of immune reactions, but its role in regulating autoreactive Th17 cells and organ-specific autoimmunity remains largely unknown. Here, we have reported that miR-146a-deficient mice developed more severe experimental autoimmune encephalomyelitis (EAE), an animal model of human multiple sclerosis (MS). We bred miR-146a-deficient mice with 2D2 T cell receptor-Tg mice to generate 2D2 CD4 T cells that are deficient in miR-146a and specific for myelin oligodendrocyte glycoprotein (MOG), an autoantigen in the EAE model. miR-146a-deficient 2D2 T cells induced more severe EAE and were more prone to differentiate into Th17 cells. Microarray analysis revealed enhancements in IL-6- and IL-21-induced Th17 differentiation pathways in these T cells. Further study showed that miR-146a inhibited the production of autocrine IL-6 and IL-21 in 2D2 T cells, which in turn reduced their Th17 differentiation. Thus, our study identifies miR-146a as an important molecular brake that blocks the autocrine IL-6- and IL-21-induced Th17 differentiation pathways in autoreactive CD4 T cells, highlighting its potential as a therapeutic target for treating autoimmune diseases.

  19. Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

    Science.gov (United States)

    Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

    2016-09-22

    The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

  20. Extinction Can Reduce the Impact of Reward Cues on Reward-Seeking Behavior.

    Science.gov (United States)

    Lovibond, Peter F; Satkunarajah, Michelle; Colagiuri, Ben

    2015-07-01

    Reward-associated cues are thought to promote relapse after treatment of appetitive disorders such as drug-taking, binge eating, and gambling. This process has been modelled in the laboratory using a Pavlovian-instrumental transfer (PIT) design in which Pavlovian cues facilitate instrumental reward-directed action. Attempts to reduce facilitation by cue exposure (extinction) have produced mixed results. We tested the effect of extinction in a recently developed PIT procedure using a natural reward, chocolate, in human participants. Facilitation of instrumental responding was only observed in participants who were aware of the Pavlovian contingencies. Pavlovian extinction successfully reduced, but did not completely eliminate, expectancy of reward and facilitation of instrumental responding. The results indicate that exposure can reduce the ability of cues to promote reward-directed behavior in the laboratory. However, the residual potency of extinguished cues means that additional active strategies may be needed in clinical practice to train patients to resist the impact of these cues in their environment. Copyright © 2015. Published by Elsevier Ltd.

  1. Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation.

    Science.gov (United States)

    Kawamichi, Hiroaki; Sugawara, Sho K; Hamano, Yuki H; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

    2016-04-19

    Positive social interactions contribute to the sense that one's life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants' preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference.

  2. BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

    OpenAIRE

    Miyapuram Krishna P; Tobler Philippe N; Gregorios-Pippas Lucy; Schultz Wolfram

    2012-01-01

    Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewa...

  3. Do dopaminergic gene polymorphisms affect mesolimbic reward activation of music listening response? Therapeutic impact on Reward Deficiency Syndrome (RDS).

    Science.gov (United States)

    Blum, Kenneth; Chen, Thomas J H; Chen, Amanda L H; Madigan, Margaret; Downs, B William; Waite, Roger L; Braverman, Eric R; Kerner, Mallory; Bowirrat, Abdalla; Giordano, John; Henshaw, Harry; Gold, Mark S

    2010-03-01

    Using fMRI, Menon and Levitin [9] clearly found for the first time that listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the nucleus accumbens (NAc) and the ventral tegmental area (VTA), as well as the hypothalamus, and insula, which are thought to be involved in regulating autonomic and physiological responses to rewarding and emotional stimuli. Importantly, responses in the NAc and VTA were strongly correlated pointing to an association between dopamine release and NAc response to music. Listing to pleasant music induced a strong response and significant activation of the VTA-mediated interaction of the NAc with the hypothalamus, insula, and orbitofrontal cortex. Blum et al. [10] provided the first evidence that the dopamine D2 receptor gene (DRD2) Taq 1 A1 allele significantly associated with severe alcoholism whereby the author's suggested that they found the first "reward gene" located in the mesolimbic system. The enhanced functional and effective connectivity between brain regions mediating reward, autonomic, and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. However, little is known about why some people have a more or less powerful mesolimbic experience when they are listening to music. It is well-known that music may induce an endorphinergic response that is blocked by naloxone, a known opioid antagonist (Goldstein [19]). Opioid transmission in the NAc is associated with dopamine release in the VTA. Moreover, dopamine release in the VTA is linked to polymorphisms of the DRD2 gene and even attention-deficit hyperactivity disorder (ADHD), whereby carriers of the DRD2 A1 allele show a reduced NAc release of dopamine (DA). Thus it is conjectured that similar mechanisms in terms of adequate dopamine release and subsequent activation of reward circuitry by listening to music might also be

  4. Activation of cannabinoid system in anterior cingulate cortex and orbitofrontal cortex modulates cost-benefit decision making.

    Science.gov (United States)

    Khani, Abbas; Kermani, Mojtaba; Hesam, Soghra; Haghparast, Abbas; Argandoña, Enrike G; Rainer, Gregor

    2015-06-01

    Despite the evidence for altered decision making in cannabis abusers, the role of the cannabinoid system in decision-making circuits has not been studied. Here, we examined the effects of cannabinoid modulation during cost-benefit decision making in the anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC), key brain areas involved in decision making. We trained different groups of rats in a delay-based and an effort-based form of cost-benefit T-maze decision-making task. During test days, the rats received local injections of either vehicle or ACEA, a cannabinoid type-1 receptor (CB1R) agonist in the ACC or OFC. We measured spontaneous locomotor activity following the same treatments and characterized CB1Rs localization on different neuronal populations within these regions using immunohistochemistry. We showed that CB1R activation in the ACC impaired decision making such that rats were less willing to invest physical effort to gain high reward. Similarly, CB1R activation in the OFC induced impulsive pattern of choice such that rats preferred small immediate rewards to large delayed rewards. Control tasks ensured that the effects were specific for differential cost-benefit tasks. Furthermore, we characterized widespread colocalizations of CB1Rs on GABAergic axonal ends but few colocalizations on glutamatergic, dopaminergic, and serotonergic neuronal ends. These results provide first direct evidence that the cannabinoid system plays a critical role in regulating cost-benefit decision making in the ACC and OFC and implicate cannabinoid modulation of synaptic ends of predominantly interneurons and to a lesser degree other neuronal populations in these two frontal regions.

  5. Discounting of Monetary Rewards that are Both Delayed and Probabilistic: Delay and Probability Combine Multiplicatively, not Additively

    Science.gov (United States)

    Vanderveldt, Ariana; Green, Leonard; Myerson, Joel

    2014-01-01

    The value of an outcome is affected both by the delay until its receipt (delay discounting) and by the likelihood of its receipt (probability discounting). Despite being well-described by the same hyperboloid function, delay and probability discounting involve fundamentally different processes, as revealed, for example, by the differential effects of reward amount. Previous research has focused on the discounting of delayed and probabilistic rewards separately, with little research examining more complex situations in which rewards are both delayed and probabilistic. In two experiments, participants made choices between smaller rewards that were both immediate and certain and larger rewards that were both delayed and probabilistic. Analyses revealed significant interactions between delay and probability factors inconsistent with an additive model. In contrast, a hyperboloid discounting model in which delay and probability were combined multiplicatively provided an excellent fit to the data. These results suggest that the hyperboloid is a good descriptor of decision making in complicated monetary choice situations like those people encounter in everyday life. PMID:24933696

  6. Reward eliminates retrieval-induced forgetting.

    Science.gov (United States)

    Imai, Hisato; Kim, Dongho; Sasaki, Yuka; Watanabe, Takeo

    2014-12-02

    Although it is well known that reward enhances learning and memory, how extensively such enhancement occurs remains unclear. To address this question, we examined how reward influences retrieval-induced forgetting (RIF) in which the retrieval of a nonpracticed item under the same category as a practiced item is worse than the retrieval of a nonpracticed item outside the category. Subjects were asked to try to encode category-exemplar pairs (e.g., FISH-salmon). Then, they were presented with a category name and a two-letter word stem (e.g., FISH-sa) and were asked to complete an encoded word (retrieval practice). For a correct response, apple juice was given as a reward in the reward condition and a beeping sound was presented in the no-reward condition. Finally, subjects were asked to report whether each exemplar had been presented in the first phase. RIF was replicated in the no-reward condition. However, in the reward condition, RIF was eliminated. These results suggest that reward enhances processing of retrieval of unpracticed members by mechanisms such as spreading activation within the same category, irrespective of whether items were practiced or not.

  7. Modulation of Rat 50-kHz Ultrasonic Vocalizations by Glucocorticoid Signaling: Possible Relevance to Reward and Motivation.

    Science.gov (United States)

    Simola, Nicola; Paci, Elena; Serra, Marcello; Costa, Giulia; Morelli, Micaela

    2018-01-01

    Rats emit 50-kHz ultrasonic vocalizations (USVs) to communicate positive emotional states, and these USVs are increasingly being investigated in preclinical studies on reward and motivation. Although it is the activation of dopamine receptors that initiates the emission of 50-kHz USVs, non-dopaminergic mechanisms may modulate calling in the 50 kHz frequency band. To further elucidate these mechanisms, the present study investigated whether the pharmacological manipulation of glucocorticoid signaling influenced calling. Rats were administered corticosterone (1-5 mg/kg, s.c.), the glucocorticoid receptor antagonist mifepristone (40 or 100 mg/kg, s.c.), or the corticosterone synthesis inhibitor metyrapone (50 or 100 mg/kg, i.p.). The effects of these drugs on calling initiation and on calling recorded during nonaggressive social contacts or after the administration of amphetamine (0.25 or 1 mg/kg, i.p.) were then evaluated. Corticosterone failed to initiate the emission of 50-kHz USVs and did not influence pro-social and amphetamine-stimulated calling. Similarly, mifepristone and metyrapone did not initiate calling. However, metyrapone suppressed pro-social calling and calling stimulated by a moderate dose (1 mg/kg, i.p.) of amphetamine. Conversely, mifepristone attenuated calling stimulated by a low (0.25 mg/kg, i.p.), but not moderate (1 mg/kg, i.p.), dose of amphetamine and had no influence on pro-social calling. The present results demonstrate that glucocorticoid signaling modulates calling in the 50 kHz frequency band only in certain conditions and suggest that mechanisms different from the inhibition of corticosterone synthesis may participate in the suppression of calling by metyrapone. © The Author 2017. Published by Oxford University Press on behalf of CINP.

  8. The role of BDNF, leptin, and catecholamines in reward learning in bulimia nervosa.

    Science.gov (United States)

    Homan, Philipp; Grob, Simona; Milos, Gabriella; Schnyder, Ulrich; Eckert, Anne; Lang, Undine; Hasler, Gregor

    2014-12-07

    A relationship between bulimia nervosa and reward-related behavior is supported by several lines of evidence. The dopaminergic dysfunctions in the processing of reward-related stimuli have been shown to be modulated by the neurotrophin brain derived neurotrophic factor (BDNF) and the hormone leptin. Using a randomized, double-blind, placebo-controlled, crossover design, a reward learning task was applied to study the behavior of 20 female subjects with remitted bulimia nervosa and 27 female healthy controls under placebo and catecholamine depletion with alpha-methyl-para-tyrosine (AMPT). The plasma levels of BDNF and leptin were measured twice during the placebo and the AMPT condition, immediately before and 1 hour after a standardized breakfast. AMPT-induced differences in plasma BDNF levels were positively correlated with the AMPT-induced differences in reward learning in the whole sample (P=.05). Across conditions, plasma brain derived neurotrophic factor levels were higher in remitted bulimia nervosa subjects compared with controls (diagnosis effect; P=.001). Plasma BDNF and leptin levels were higher in the morning before compared with after a standardized breakfast across groups and conditions (time effect; Pbulimia nervosa and controls. A role of leptin in reward learning is not supported by this study. However, leptin levels were sensitive to a depletion of catecholamine stores in both remitted bulimia nervosa and controls. © The Author 2015. Published by Oxford University Press on behalf of CINP.

  9. Modulating functions-based method for parameters and source estimation in one-dimensional partial differential equations

    KAUST Repository

    Asiri, Sharefa M.

    2016-10-20

    In this paper, modulating functions-based method is proposed for estimating space–time-dependent unknowns in one-dimensional partial differential equations. The proposed method simplifies the problem into a system of algebraic equations linear in unknown parameters. The well-posedness of the modulating functions-based solution is proved. The wave and the fifth-order KdV equations are used as examples to show the effectiveness of the proposed method in both noise-free and noisy cases.

  10. Reward enhances tic suppression in children within months of tic disorder onset

    Directory of Open Access Journals (Sweden)

    Deanna J. Greene

    2015-02-01

    Full Text Available Tic disorders are childhood onset neuropsychiatric disorders characterized by motor and/or vocal tics. Research has demonstrated that children with chronic tics (including Tourette syndrome and Chronic Tic Disorder: TS/CTD can suppress tics, particularly when an immediate, contingent reward is given for successful tic suppression. As a diagnosis of TS/CTD requires tics to be present for at least one year, children in these tic suppression studies had been living with tics for quite some time. Thus, it is unclear whether the ability to inhibit tics is learned over time or present at tic onset. Resolving that issue would inform theories of how tics develop and how behavior therapy for tics works. We investigated tic suppression in school-age children as close to the time of tic onset as possible, and no later than six months after onset. Children were asked to suppress their tics both in the presence and absence of a contingent reward. Results demonstrated that these children, like children with TS/CTD, have some capacity to suppress tics, and that immediate reward enhances that capacity. These findings demonstrate that the modulating effect of reward on inhibitory control of tics is present within months of tic onset, before tics have become chronic.

  11. REWARD ENHANCES TIC SUPPRESSION IN CHILDREN WITHIN MONTHS OF TIC DISORDER ONSET

    Science.gov (United States)

    Greene, Deanna J.; Koller, Jonathan M.; Robichaux-Viehoever, Amy; Bihun, Emily C.; Schlaggar, Bradley L.; Black, Kevin J.

    2014-01-01

    Tic disorders are childhood onset neuropsychiatric disorders characterized by motor and/or vocal tics. Research has demonstrated that children with chronic tics (including Tourette syndrome and Chronic Tic Disorder: TS/CTD) can suppress tics, particularly when an immediate, contingent reward is given for successful tic suppression. As a diagnosis of TS/CTD requires tics to be present for at least one year, children in these tic suppression studies had been living with tics for quite some time. Thus, it is unclear whether the ability to inhibit tics is learned over time or present at tic onset. Resolving that issue would inform theories of how tics develop and how behavior therapy for tics works. We investigated tic suppression in school-age children as close to the time of tic onset as possible, and no later than six months after onset. Children were asked to suppress their tics both in the presence and absence of a contingent reward. Results demonstrated that these children, like children with TS/CTD, have some capacity to suppress tics, and that immediate reward enhances that capacity. These findings demonstrate that the modulating effect of reward on inhibitory control of tics is present within months of tic onset, before tics have become chronic. PMID:25220075

  12. E2F6: a member of the E2F family that does not modulate squamous differentiation

    International Nuclear Information System (INIS)

    Wong, C.F.; Barnes, Liam M.; Smith, Louise; Popa, Claudia; Serewko-Auret, Magdalena M.; Saunders, Nicholas A.

    2004-01-01

    The inhibition of E2F has been demonstrated to be important in the initiation of squamous differentiation by two independent manners: promotion of growth arrest and the relief of the differentiation-suppressive properties of E2Fs. E2F6 is reported to behave as a transcriptional repressor of the E2F family. In this study, we examined the ability of E2F6 to act as the molecular switch required for E2F inhibition in order for keratinocytes to enter a terminal differentiation programme. Results demonstrated that whilst E2F6 was able to suppress E2F activity in proliferating keratinocytes, it did not modulate squamous differentiation in a differentiated keratinocyte. Furthermore, inhibition of E2F, by overexpressing E2F6, was not sufficient to sensitise either proliferating keratinocytes or the squamous cell carcinoma cell line, KJD-1/SV40, to differentiation-inducing agents. Significantly, although E2F6 could suppress E2F activity in proliferating cells, it could not inhibit proliferation of KJD-1/SV40 cells. These results demonstrate that E2F6 does not contain the domains required for modulation of squamous differentiation and imply isoform-specific functions for individual E2F family members

  13. Differential protein modulation in midguts of Aedes aegypti infected with chikungunya and dengue 2 viruses.

    Science.gov (United States)

    Tchankouo-Nguetcheu, Stéphane; Khun, Huot; Pincet, Laurence; Roux, Pascal; Bahut, Muriel; Huerre, Michel; Guette, Catherine; Choumet, Valérie

    2010-10-05

    Arthropod borne virus infections cause several emerging and resurgent infectious diseases. Among the diseases caused by arboviruses, dengue and chikungunya are responsible for a high rate of severe human diseases worldwide. The midgut of mosquitoes is the first barrier for pathogen transmission and is a target organ where arboviruses must replicate prior to infecting other organs. A proteomic approach was undertaken to characterize the key virus/vector interactions and host protein modifications that happen in the midgut for viral transmission to eventually take place. Using a proteomics differential approach with two-Dimensional Differential in-Gel Electrophoresis (2D-DIGE), we defined the protein modulations in the midgut of Aedes aegypti that were triggered seven days after an oral infection (7 DPI) with dengue 2 (DENV-2) and chikungunya (CHIKV) viruses. Gel profile comparisons showed that the level of 18 proteins was modulated by DENV-2 only and 12 proteins were modulated by CHIKV only. Twenty proteins were regulated by both viruses in either similar or different ways. Both viruses caused an increase of proteins involved in the generation of reactive oxygen species, energy production, and carbohydrate and lipid metabolism. Midgut infection by DENV-2 and CHIKV triggered an antioxidant response. CHIKV infection produced an increase of proteins involved in detoxification. Our study constitutes the first analysis of the protein response of Aedes aegypti's midgut infected with viruses belonging to different families. It shows that the differentially regulated proteins in response to viral infection include structural, redox, regulatory proteins, and enzymes for several metabolic pathways. Some of these proteins like antioxidant are probably involved in cell protection. On the other hand, we propose that the modulation of other proteins like transferrin, hsp60 and alpha glucosidase, may favour virus survival, replication and transmission, suggesting a subversion of

  14. Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment.

    Science.gov (United States)

    Guitart-Masip, Marc; Economides, Marcos; Huys, Quentin J M; Frank, Michael J; Chowdhury, Rumana; Duzel, Emrah; Dayan, Peter; Dolan, Raymond J

    2014-03-01

    Decision-making involves two fundamental axes of control namely valence, spanning reward and punishment, and action, spanning invigoration and inhibition. We recently exploited a go/no-go task whose contingencies explicitly decouple valence and action to show that these axes are inextricably coupled during learning. This results in a disadvantage in learning to go to avoid punishment and in learning to no-go to obtain a reward. The neuromodulators dopamine and serotonin are likely to play a role in these asymmetries: Dopamine signals anticipation of future rewards and is also involved in an invigoration of motor responses leading to reward, but it also arbitrates between different forms of control. Conversely, serotonin is implicated in motor inhibition and punishment processing. To investigate the role of dopamine and serotonin in the interaction between action and valence during learning.Methods We combined computational modeling with pharmacological manipulation in 90 healthy human volunteers, using levodopa and citalopram to affect dopamine and serotonin, respectively. We found that, after administration of levodopa,action learning was less affected by outcome valence when compared with the placebo and citalopram groups. This highlights in this context a predominant effect of levodopa in controlling the balance between different forms of control.Citalopram had distinct effects, increasing participants'tendency to perform active responses independent of outcome valence, consistent with a role in decreasing motor inhibition. Our findings highlight the rich complexities of the roles played by dopamine and serotonin during instrumental learning.

  15. Adolescent neural response to reward is related to participant sex and task motivation.

    Science.gov (United States)

    Alarcón, Gabriela; Cservenka, Anita; Nagel, Bonnie J

    2017-02-01

    Risky decision making is prominent during adolescence, perhaps contributed to by heightened sensation seeking and ongoing maturation of reward and dopamine systems in the brain, which are, in part, modulated by sex hormones. In this study, we examined sex differences in the neural substrates of reward sensitivity during a risky decision-making task and hypothesized that compared with girls, boys would show heightened brain activation in reward-relevant regions, particularly the nucleus accumbens, during reward receipt. Further, we hypothesized that testosterone and estradiol levels would mediate this sex difference. Moreover, we predicted boys would make more risky choices on the task. While boys showed increased nucleus accumbens blood oxygen level-dependent (BOLD) response relative to girls, sex hormones did not mediate this effect. As predicted, boys made a higher percentage of risky decisions during the task. Interestingly, boys also self-reported more motivation to perform well and earn money on the task, while girls self-reported higher state anxiety prior to the scan session. Motivation to earn money partially mediated the effect of sex on nucleus accumbens activity during reward. Previous research shows that increased motivation and salience of reinforcers is linked with more robust striatal BOLD response, therefore psychosocial factors, in addition to sex, may play an important role in reward sensitivity. Elucidating neurobiological mechanisms that support adolescent sex differences in risky decision making has important implications for understanding individual differences that lead to advantageous and adverse behaviors that affect health outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

  16. Reactive oxygen species modulator 1, a novel protein, combined with carcinoembryonic antigen in differentiating malignant from benign pleural effusion.

    Science.gov (United States)

    Chen, Xianmeng; Zhang, Na; Dong, Jiahui; Sun, Gengyun

    2017-05-01

    The differential diagnosis of malignant pleural effusion and benign pleural effusion remains a clinical problem. Reactive oxygen species modulator 1 is a novel protein overexpressed in various human tumors. The objective of this study was to evaluate the diagnostic value of joint detection of reactive oxygen species modulator 1 and carcinoembryonic antigen in the differential diagnosis of malignant pleural effusion and benign pleural effusion. One hundred two consecutive patients with pleural effusion (including 52 malignant pleural effusion and 50 benign pleural effusion) were registered in this study. Levels of reactive oxygen species modulator 1 and carcinoembryonic antigen were measured by enzyme-linked immunosorbent assay and radioimmunoassay, respectively. Results showed that the concentrations of reactive oxygen species modulator 1 both in pleural fluid and serum of patients with malignant pleural effusion were significantly higher than those of benign pleural effusion (both p pleural fluid reactive oxygen species modulator 1 were 61.54% and 82.00%, respectively, with the optimized cutoff value of 589.70 pg/mL. However, the diagnostic sensitivity and specificity of serum reactive oxygen species modulator 1 were only 41.38% and 86.21%, respectively, with the cutoff value of 27.22 ng/mL, indicating that serum reactive oxygen species modulator 1 may not be a good option in the differential diagnosis of malignant pleural effusion and benign pleural effusion. The sensitivity and specificity of pleural fluid carcinoembryonic antigen were 69.23% and 88.00%, respectively, at the cutoff value of 3.05 ng/mL, while serum carcinoembryonic antigen were 80.77% and 72.00% at the cutoff value of 2.60 ng/mL. The sensitivity could be raised to 88.17% in parallel detection of plural fluid reactive oxygen species modulator 1 and carcinoembryonic antigen concentration, and the specificity could be improved to 97.84% in serial detection.

  17. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    Directory of Open Access Journals (Sweden)

    Carsten Murawski

    Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  18. Differential network analysis reveals genetic effects on catalepsy modules.

    Directory of Open Access Journals (Sweden)

    Ovidiu D Iancu

    Full Text Available We performed short-term bi-directional selective breeding for haloperidol-induced catalepsy, starting from three mouse populations of increasingly complex genetic structure: an F2 intercross, a heterogeneous stock (HS formed by crossing four inbred strains (HS4 and a heterogeneous stock (HS-CC formed from the inbred strain founders of the Collaborative Cross (CC. All three selections were successful, with large differences in haloperidol response emerging within three generations. Using a custom differential network analysis procedure, we found that gene coexpression patterns changed significantly; importantly, a number of these changes were concordant across genetic backgrounds. In contrast, absolute gene-expression changes were modest and not concordant across genetic backgrounds, in spite of the large and similar phenotypic differences. By inferring strain contributions from the parental lines, we are able to identify significant differences in allelic content between the selected lines concurrent with large changes in transcript connectivity. Importantly, this observation implies that genetic polymorphisms can affect transcript and module connectivity without large changes in absolute expression levels. We conclude that, in this case, selective breeding acts at the subnetwork level, with the same modules but not the same transcripts affected across the three selections.

  19. Developmental changes in the reward positivity: An electrophysiological trajectory of reward processing

    Directory of Open Access Journals (Sweden)

    Carmen N. Lukie

    2014-07-01

    Full Text Available Children and adolescents learn to regulate their behavior by utilizing feedback from the environment but exactly how this ability develops remains unclear. To investigate this question, we recorded the event-related brain potential (ERP from children (8–13 years, adolescents (14–17 years and young adults (18–23 years while they navigated a “virtual maze” in pursuit of monetary rewards. The amplitude of the reward positivity, an ERP component elicited by feedback stimuli, was evaluated for each age group. A current theory suggests the reward positivity is produced by the impact of reinforcement learning signals carried by the midbrain dopamine system on anterior cingulate cortex, which utilizes the signals to learn and execute extended behaviors. We found that the three groups produced a reward positivity of comparable size despite relatively longer ERP component latencies for the children, suggesting that the reward processing system reaches maturity early in development. We propose that early development of the midbrain dopamine system facilitates the development of extended goal-directed behaviors in anterior cingulate cortex.

  20. Random reward priming is task-contingent

    DEFF Research Database (Denmark)

    Ásgeirsson, Árni Gunnar; Kristjánsson, Árni

    2014-01-01

    Consistent financial reward of particular features influences the allocation of visual attention in many ways. More surprising are 1-trial reward priming effects on attention where reward schedules are random and reward on one trial influences attentional allocation on the next. Those findings...

  1. Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans.

    Science.gov (United States)

    Vaidya, Avinash R; Fellows, Lesley K

    2015-09-16

    Adaptively interacting with our environment requires extracting information that will allow us to successfully predict reward. This can be a challenge, particularly when there are many candidate cues, and when rewards are probabilistic. Recent work has demonstrated that visual attention is allocated to stimulus features that have been associated with reward on previous trials. The ventromedial frontal lobe (VMF) has been implicated in learning in dynamic environments of this kind, but the mechanism by which this region influences this process is not clear. Here, we hypothesized that the VMF plays a critical role in guiding attention to reward-predictive stimulus features based on feedback. We tested the effects of VMF damage in human subjects on a visual search task in which subjects were primed to attend to task-irrelevant colors associated with different levels of reward, incidental to the search task. Consistent with previous work, we found that distractors had a greater influence on reaction time when they appeared in colors associated with high reward in the previous trial compared with colors associated with low reward in healthy control subjects and patients with prefrontal damage sparing the VMF. However, this reward modulation of attentional priming was absent in patients with VMF damage. Thus, an intact VMF is necessary for directing attention based on experience with cue-reward associations. We suggest that this region plays a role in selecting reward-predictive cues to facilitate future learning. There has been a swell of interest recently in the ventromedial frontal cortex (VMF), a brain region critical to associative learning. However, the underlying mechanism by which this region guides learning is not well understood. Here, we tested the effects of damage to this region in humans on a task in which rewards were linked incidentally to visual features, resulting in trial-by-trial attentional priming. Controls and subjects with prefrontal damage

  2. Dopamine and glucose, obesity and Reward Deficiency Syndrome

    Directory of Open Access Journals (Sweden)

    Kenneth eBlum

    2014-09-01

    Full Text Available Obesity and many well described eating disorders are accurately considered a global epidemic. The consequences of Reward Deficiency Syndrome, a genetic and epigenetic phenomena that involves the interactions of powerful neurotransmitters, are impairments of brain reward circuitry, hypodopaminergic function and abnormal craving behavior. Numerous sound neurochemical and genetic studies provide strong evidence that food addiction is similar to psychoactive drug addiction. Important facts which could translate to potential therapeutic targets espoused in this review include: 1 brain dopamine (DA production and use is stimulated by consumption of alcohol in large quantities or carbohydrates bingeing; 2 in the mesolimbic system the enkephalinergic neurons are in close proximity, to glucose receptors; 3 highly concentrated glucose activates the calcium channel to stimulate dopamine release from P12 cells; 4 blood glucose and cerebrospinal fluid concentrations of homovanillic acid, the dopamine metabolite, are significantly correlated and 5 2-deoxyglucose the glucose analogue, in pharmacological doses associates with enhanced dopamine turnover and causes acute glucoprivation. Evidence from animal studies and human fMRI support the hypothesis that multiple, but similar brain circuits are disrupted in obesity and drug dependence and DA-modulated reward circuits are involved in pathologic eating behaviors. Treatment for addiction to glucose and drugs alike, based on a consensus of neuroscience research, should incorporate dopamine agonist therapy, in contrast to current theories and practices that use dopamine antagonists. Until now, powerful dopamine-D2 agonists have failed clinically, due to chronic down regulation of D2 receptors instead, consideration of novel less powerful D2 agonists that up-regulate D2 receptors seems prudent. We encourage new strategies targeted at improving DA function in the treatment and prevention of obesity a subtype of

  3. Incremental effects of reward on creativity.

    Science.gov (United States)

    Eisenberger, R; Rhoades, L

    2001-10-01

    The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization.

  4. Expected reward value and reward uncertainty have temporally dissociable effects on memory formation

    OpenAIRE

    Adcock, R; Clement, Nathaniel; Chiew, Kimberly; Dickerson, Kathryn; Stanek, Jessica

    2018-01-01

    Anticipating rewards has been shown to enhance memory formation. While substantial evidence implicates dopamine in this behavioral effect, the precise mechanisms remain ambiguous. Because dopamine nuclei show two distinct physiological signatures of reward prediction, we hypothesized two dissociable effects on memory formation. These two signatures are a phasic dopamine response immediately following a reward cue that encodes its expected value, and a sustained, ramping dopamine response that...

  5. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    Science.gov (United States)

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  6. Neural correlates of reward processing in healthy siblings of patients with schizophrenia : Reward processing in schizophrenia siblings

    NARCIS (Netherlands)

    Hanssen, E.M.E.

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be

  7. Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory.

    Science.gov (United States)

    Murty, Vishnu P; Tompary, Alexa; Adcock, R Alison; Davachi, Lila

    2017-01-18

    Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the

  8. Brain reward system's alterations in response to food and monetary stimuli in overweight and obese individuals.

    Science.gov (United States)

    Verdejo-Román, Juan; Vilar-López, Raquel; Navas, Juan F; Soriano-Mas, Carles; Verdejo-García, Antonio

    2017-02-01

    The brain's reward system is crucial to understand obesity in modern society, as increased neural responsivity to reward can fuel the unhealthy food choices that are driving the growing obesity epidemic. Brain's reward system responsivity to food and monetary rewards in individuals with excessive weight (overweight and obese) versus normal weight controls, along with the relationship between this responsivity and body mass index (BMI) were tested. The sample comprised 21 adults with obesity (BMI > 30), 21 with overweight (BMI between 25 and 30), and 39 with normal weight (BMI food (Willing to Pay) and monetary rewards (Monetary Incentive Delay). Neural activations within the brain reward system were compared across the three groups. Curve fit analyses were conducted to establish the association between BMI and brain reward system's response. Individuals with obesity had greater food-evoked responsivity in the dorsal and ventral striatum compared with overweight and normal weight groups. There was an inverted U-shape association between BMI and monetary-evoked responsivity in the ventral striatum, medial frontal cortex, and amygdala; that is, individuals with BMIs between 27 and 32 had greater responsivity to monetary stimuli. Obesity is associated with greater food-evoked responsivity in the ventral and dorsal striatum, and overweight is associated with greater monetary-evoked responsivity in the ventral striatum, the amygdala, and the medial frontal cortex. Findings suggest differential reactivity of the brain's reward system to food versus monetary rewards in obesity and overweight. Hum Brain Mapp 38:666-677, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

  9. Social reward shapes attentional biases.

    Science.gov (United States)

    Anderson, Brian A

    2016-01-01

    Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

  10. Oxytocin modulates third-party sanctioning of selfish and generous behavior within and between groups

    NARCIS (Netherlands)

    Daughters, K.; Manstead, A.S.R.; Ten Velden, F.S.; De Dreu, C.K.W.

    Human groups function because members trust each other and reciprocate cooperative contributions, and reward others’ cooperation and punish their non-cooperation. Here we examined the possibility that such third-party punishment and reward of others’ trust and reciprocation is modulated by oxytocin,

  11. Motivational State, Reward Value, and Pavlovian Cues Differentially Affect Skilled Forelimb Grasping in Rats

    Science.gov (United States)

    Mosberger, Alice C.; de Clauser, Larissa; Kasper, Hansjörg; Schwab, Martin E.

    2016-01-01

    Motor skills represent high-precision movements performed at optimal speed and accuracy. Such motor skills are learned with practice over time. Besides practice, effects of motivation have also been shown to influence speed and accuracy of movements, suggesting that fast movements are performed to maximize gained reward over time as noted in…

  12. Discrete-time rewards model-checked

    NARCIS (Netherlands)

    Larsen, K.G.; Andova, S.; Niebert, Peter; Hermanns, H.; Katoen, Joost P.

    2003-01-01

    This paper presents a model-checking approach for analyzing discrete-time Markov reward models. For this purpose, the temporal logic probabilistic CTL is extended with reward constraints. This allows to formulate complex measures – involving expected as well as accumulated rewards – in a precise and

  13. Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

    Science.gov (United States)

    Anderson, Brian A

    2017-03-01

    Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  14. Selective attention moderates the relationship between attentional capture by signals of nondrug reward and illicit drug use

    NARCIS (Netherlands)

    Albertella, L.; Copeland, J.; Pearson, D.; Watson, P.; Wiers, R.W.; Le Pelley, M.E.

    2017-01-01

    BACKGROUND: The current study examined whether cognitive control moderates the association between (non-drug) reward-modulated attentional capture and use of alcohol and other drugs (AOD). METHODS: Participants were 66 university students who completed an assessment including questions about AOD

  15. Within-subject neural reactivity to reward and threat is inverted in young adolescents.

    Science.gov (United States)

    Thomason, M E; Marusak, H A

    2017-07-01

    As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

  16. Mesenchymal Stem Cells Modulate Differentiation of Myeloid Progenitor Cells During Inflammation.

    Science.gov (United States)

    Amouzegar, Afsaneh; Mittal, Sharad K; Sahu, Anuradha; Sahu, Srikant K; Chauhan, Sunil K

    2017-06-01

    Mesenchymal stem cells (MSCs) possess distinct immunomodulatory properties and have tremendous potential for use in therapeutic applications in various inflammatory diseases. MSCs have been shown to regulate pathogenic functions of mature myeloid inflammatory cells, such as macrophages and neutrophils. Intriguingly, the capacity of MSCs to modulate differentiation of myeloid progenitors (MPs) to mature inflammatory cells remains unknown to date. Here, we report the novel finding that MSCs inhibit the expression of differentiation markers on MPs under inflammatory conditions. We demonstrate that the inhibitory effect of MSCs is dependent on direct cell-cell contact and that this intercellular contact is mediated through interaction of CD200 expressed by MSCs and CD200R1 expressed by MPs. Furthermore, using an injury model of sterile inflammation, we show that MSCs promote MP frequencies and suppress infiltration of inflammatory cells in the inflamed tissue. We also find that downregulation of CD200 in MSCs correlates with abrogation of their immunoregulatory function. Collectively, our study provides unequivocal evidence that MSCs inhibit differentiation of MPs in the inflammatory environment via CD200-CD200R1 interaction. Stem Cells 2017;35:1532-1541. © 2017 AlphaMed Press.

  17. Reward enhances tic suppression in children within months of tic disorder onset.

    Science.gov (United States)

    Greene, Deanna J; Koller, Jonathan M; Robichaux-Viehoever, Amy; Bihun, Emily C; Schlaggar, Bradley L; Black, Kevin J

    2015-02-01

    Tic disorders are childhood onset neuropsychiatric disorders characterized by motor and/or vocal tics. Research has demonstrated that children with chronic tics (including Tourette syndrome and Chronic Tic Disorder: TS/CTD) can suppress tics, particularly when an immediate, contingent reward is given for successful tic suppression. As a diagnosis of TS/CTD requires tics to be present for at least one year, children in these tic suppression studies had been living with tics for quite some time. Thus, it is unclear whether the ability to inhibit tics is learned over time or present at tic onset. Resolving that issue would inform theories of how tics develop and how behavior therapy for tics works. We investigated tic suppression in school-age children as close to the time of tic onset as possible, and no later than six months after onset. Children were asked to suppress their tics both in the presence and absence of a contingent reward. Results demonstrated that these children, like children with TS/CTD, have some capacity to suppress tics, and that immediate reward enhances that capacity. These findings demonstrate that the modulating effect of reward on inhibitory control of tics is present within months of tic onset, before tics have become chronic. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

  18. BOLD responses in reward regions to hypothetical and imaginary monetary rewards

    NARCIS (Netherlands)

    Miyapuram, K.P.; Tobler, P.N.; Gregorios-Pippas, L.; Schultz, W.

    2012-01-01

    Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary

  19. Neural evidence for description dependent reward processing in the framing effect.

    Science.gov (United States)

    Yu, Rongjun; Zhang, Ping

    2014-01-01

    Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN), which indexes the "worse than expected" negative prediction error in the anterior cingulate cortex (ACC), was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to "better than expected" positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect.

  20. Neural evidence for description dependent reward processing in the framing effect

    Directory of Open Access Journals (Sweden)

    Rongjun eYu

    2014-03-01

    Full Text Available Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN, which indexes the worse than expected negative prediction error in the anterior cingulate cortex, was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to better than expected positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect.

  1. Placebo analgesia and reward processing: integrating genetics, personality, and intrinsic brain activity.

    Science.gov (United States)

    Yu, Rongjun; Gollub, Randy L; Vangel, Mark; Kaptchuk, Ted; Smoller, Jordan W; Kong, Jian

    2014-09-01

    Our expectations about an event can strongly shape our subjective evaluation and actual experience of events. This ability, applied to the modulation of pain, has the potential to affect therapeutic analgesia substantially and constitutes a foundation for non-pharmacological pain relief. A typical example of such modulation is the placebo effect. Studies indicate that placebo may be regarded as a reward, and brain activity in the reward system is involved in this modulation process. In the present study, we combined resting-state functional magnetic resonance imaging (rs-fMRI) measures, genotype at a functional COMT polymorphism (Val158Met), and personality measures in a model to predict the magnitude of placebo conditioning effect indicated by subjective pain rating reduction to calibrated noxious stimuli. We found that the regional homogeneity (ReHo), an index of local neural coherence, in the ventral striatum, was significantly associated with conditioning effects on pain rating changes. We also found that the number of Met alleles at the COMT polymorphism was linearly correlated to the suppression of pain. In a fitted regression model, we found the ReHo in the ventral striatum, COMT genotype, and Openness scores accounted for 59% of the variance in the change in pain ratings. The model was further tested using a separate data set from the same study. Our findings demonstrate the potential of combining resting-state connectivity, genetic information, and personality to predict placebo effect. Copyright © 2014 Wiley Periodicals, Inc.

  2. Intracellular calcium levels determine differential modulation of allosteric interactions within G protein-coupled receptor heteromers.

    Science.gov (United States)

    Navarro, Gemma; Aguinaga, David; Moreno, Estefania; Hradsky, Johannes; Reddy, Pasham P; Cortés, Antoni; Mallol, Josefa; Casadó, Vicent; Mikhaylova, Marina; Kreutz, Michael R; Lluís, Carme; Canela, Enric I; McCormick, Peter J; Ferré, Sergi

    2014-11-20

    The pharmacological significance of the adenosine A2A receptor (A2AR)-dopamine D2 receptor (D2R) heteromer is well established and it is being considered as an important target for the treatment of Parkinson’s disease and other neuropsychiatric disorders. However, the physiological factors that control its distinctive biochemical properties are still unknown. We demonstrate that different intracellular Ca2+ levels exert a differential modulation of A2AR-D2R heteromer-mediated adenylyl-cyclase and MAPK signaling in striatal cells. This depends on the ability of low and high Ca2+ levels to promote a selective interaction of the heteromer with the neuronal Ca2+-binding proteins NCS-1 and calneuron-1, respectively. These Ca2+-binding proteins differentially modulate allosteric interactions within the A2AR-D2R heteromer, which constitutes a unique cellular device that integrates extracellular (adenosine and dopamine) and intracellular (Ca+2) signals to produce a specific functional response.

  3. Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

    Science.gov (United States)

    Demoto, Yoshihiko; Okada, Go; Okamoto, Yasumasa; Kunisato, Yoshihiko; Aoyama, Shiori; Onoda, Keiichi; Munakata, Ayumi; Nomura, Michio; Tanaka, Saori C; Schweighofer, Nicolas; Doya, Kenji; Yamawaki, Shigeto

    2012-01-01

    In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation. Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning. Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula. These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns. Copyright © 2012 S. Karger AG, Basel.

  4. Reward-driven modulation of adaptive control: How prospective monetary gains interact with unpredictable control demands

    NARCIS (Netherlands)

    Marien, Hans; Aarts, Henk; Custers, Ruud

    2014-01-01

    Shifting attention is an effortful control process and incurs a cost on the cognitive system. Previous research suggests that rewards, such as monetary gains, will selectively enhance the ability to shift attention when this demand for control is explicitly cued. Here, we hypothesized that

  5. Nicotine anxiogenic and rewarding effects are decreased in mice lacking beta-endorphin.

    Science.gov (United States)

    Trigo, José M; Zimmer, Andreas; Maldonado, Rafael

    2009-06-01

    The endogenous opioid system plays an important role in the behavioral effects of nicotine. Thus, micro-opioid receptor and the endogenous opioids derived from proenkephalin are involved in the central effects of nicotine. However, the role played by the different endogenous opioid peptides in the acute and chronic effects of nicotine remains to be fully established. Mice lacking beta-endorphin were acutely injected with nicotine at different doses to evaluate locomotor, anxiogenic and antinociceptive responses. The rewarding properties of nicotine were evaluated by using the conditioned place-preference paradigm. Mice chronically treated with nicotine were acutely injected with mecamylamine to study the behavioral expression of nicotine withdrawal. Mice lacking beta-endorphin exhibited a spontaneous hypoalgesia and hyperlocomotion and a reduction on the anxiogenic and rewarding effects induced by nicotine. Nicotine induced similar antinociception and hypolocomotion in both genotypes and no differences were found in the development of physical dependence. The dissociation between nicotine rewarding properties and physical dependence suggests a differential implication of beta-endorphin in these addictive related responses.

  6. Nicotine anxiogenic and rewarding effects are decreased in mice lacking β-endorphin

    Science.gov (United States)

    Trigo, José M.; Zimmer, Andreas; Maldonado, Rafael

    2009-01-01

    The endogenous opioid system plays an important role in the behavioral effects of nicotine. Thus, μ-opioid receptor and the endogenous opioids derived from proenkephalin are involved in the central effects of nicotine. However, the role played by the different endogenous opioid peptides in the acute and chronic effects of nicotine remains to be fully established. Mice lacking β-endorphin were acutely injected with nicotine at different doses to evaluate locomotor, anxiogenic and antinociceptive responses. The rewarding properties of nicotine were evaluated by using the conditioned place-preference paradigm. Mice chronically treated with nicotine were acutely injected with mecamylamine to study the behavioral expression of nicotine withdrawal. Mice lacking β-endorphin exhibited a spontaneous hypoalgesia and hyperlocomotion and a reduction on the anxiogenic and rewarding effects induced by nicotine. Nicotine induced similar antinociception and hypolocomotion in both genotypes and no differences were found in the development of physical dependence. The dissociation between nicotine rewarding properties and physical dependence suggests a differential implication of β-endorphin in these addictive related responses. PMID:19376143

  7. 25 Gbit/s differential phase-shift-keying signal generation using directly modulated quantum-dot semiconductor optical amplifiers

    International Nuclear Information System (INIS)

    Zeghuzi, A.; Schmeckebier, H.; Stubenrauch, M.; Bimberg, D.; Meuer, C.; Schubert, C.; Bunge, C.-A.

    2015-01-01

    Error-free generation of 25-Gbit/s differential phase-shift keying (DPSK) signals via direct modulation of InAs quantum-dot (QD) based semiconductor optical amplifiers (SOAs) is experimentally demonstrated with an input power level of −5 dBm. The QD SOAs emit in the 1.3-μm wavelength range and provide a small-signal fiber-to-fiber gain of 8 dB. Furthermore, error-free DPSK modulation is achieved for constant optical input power levels from 3 dBm down to only −11 dBm for a bit rate of 20 Gbit/s. Direct phase modulation of QD SOAs via current changes is thus demonstrated to be much faster than direct gain modulation

  8. Rat nucleus accumbens core astrocytes modulate reward and the motivation to self-administer ethanol after abstinence.

    Science.gov (United States)

    Bull, Cecilia; Freitas, Kelen C C; Zou, Shiping; Poland, Ryan S; Syed, Wahab A; Urban, Daniel J; Minter, Sabrina C; Shelton, Keith L; Hauser, Kurt F; Negus, S Stevens; Knapp, Pamela E; Bowers, M Scott

    2014-11-01

    Our understanding of the active role that astrocytes play in modulating neuronal function and behavior is rapidly expanding, but little is known about the role that astrocytes may play in drug-seeking behavior for commonly abused substances. Given that the nucleus accumbens is critically involved in substance abuse and motivation, we sought to determine whether nucleus accumbens astrocytes influence the motivation to self-administer ethanol following abstinence. We found that the packing density of astrocytes that were expressing glial fibrillary acidic protein increased in the nucleus accumbens core (NAcore) during abstinence from EtOH self-administration. No change was observed in the nucleus accumbens shell. This increased NAcore astrocyte density positively correlated with the motivation for ethanol. Astrocytes can communicate with one another and influence neuronal activity through gap-junction hemichannels. Because of this, the effect of blocking gap-junction hemichannels on the motivation for ethanol was examined. The motivation to self-administer ethanol after 3 weeks abstinence was increased following microinjection of gap-junction hemichannel blockers into the NAcore at doses that block both neuronal and astrocytic channels. In contrast, no effect was observed following microinjection of doses that are not thought to block astrocytic channels or following microinjection of either dose into the nucleus accumbens shell. Additionally, the motivation for sucrose after 3 weeks abstinence was unaffected by NAcore gap-junction hemichannel blockers. Next, Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) were selectively expressed in NAcore astrocytes to test the effect of astrocyte stimulation. DREADD activation increased cytosolic calcium in primary astrocytes, facilitated responding for rewarding brain stimulation, and reduced the motivation for ethanol after 3 weeks abstinence. This is the first work to modulate drug-seeking behavior with

  9. Differential protein modulation in midguts of Aedes aegypti infected with chikungunya and dengue 2 viruses.

    Directory of Open Access Journals (Sweden)

    Stéphane Tchankouo-Nguetcheu

    Full Text Available BACKGROUND: Arthropod borne virus infections cause several emerging and resurgent infectious diseases. Among the diseases caused by arboviruses, dengue and chikungunya are responsible for a high rate of severe human diseases worldwide. The midgut of mosquitoes is the first barrier for pathogen transmission and is a target organ where arboviruses must replicate prior to infecting other organs. A proteomic approach was undertaken to characterize the key virus/vector interactions and host protein modifications that happen in the midgut for viral transmission to eventually take place. METHODOLOGY AND PRINCIPAL FINDINGS: Using a proteomics differential approach with two-Dimensional Differential in-Gel Electrophoresis (2D-DIGE, we defined the protein modulations in the midgut of Aedes aegypti that were triggered seven days after an oral infection (7 DPI with dengue 2 (DENV-2 and chikungunya (CHIKV viruses. Gel profile comparisons showed that the level of 18 proteins was modulated by DENV-2 only and 12 proteins were modulated by CHIKV only. Twenty proteins were regulated by both viruses in either similar or different ways. Both viruses caused an increase of proteins involved in the generation of reactive oxygen species, energy production, and carbohydrate and lipid metabolism. Midgut infection by DENV-2 and CHIKV triggered an antioxidant response. CHIKV infection produced an increase of proteins involved in detoxification. CONCLUSION/SIGNIFICANCE: Our study constitutes the first analysis of the protein response of Aedes aegypti's midgut infected with viruses belonging to different families. It shows that the differentially regulated proteins in response to viral infection include structural, redox, regulatory proteins, and enzymes for several metabolic pathways. Some of these proteins like antioxidant are probably involved in cell protection. On the other hand, we propose that the modulation of other proteins like transferrin, hsp60 and alpha

  10. Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys.

    Science.gov (United States)

    Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J

    2009-01-01

    Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject.

  11. Registered nurses' perceptions of rewarding and its significance.

    Science.gov (United States)

    Seitovirta, Jaana; Lehtimäki, Aku-Ville; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; Kvist, Tarja

    2017-11-07

    To examine reward type preferences and their relationships with the significance of rewarding perceived by registered nurses in Finland. Previous studies have found relationships between nurses' rewarding and their motivation at work, job satisfaction and organisational commitment. Data were collected in a cross-sectional, descriptive, questionnaire survey from 402 registered nurses using the Registered Nurses' Perceptions of Rewarding Scale in 2015, and analysed with descriptive and multivariate statistical methods. Registered nurses assigned slightly higher values to several non-financial than to financial rewards. The non-financial reward types appreciation and feedback from work community, worktime arrangements, work content, and opportunity to develop, influence and participate were highly related to the significance of rewarding. We identified various rewards that registered nurses value, and indications that providing an appropriate array of rewards, particularly non-financial rewards, is a highly beneficial element of nursing management. It is important to understand the value of rewards for nursing management. Nurse managers should offer diverse rewards to their registered nurses to promote excellent performance and to help efforts to secure and maintain high-quality, safe patient care. The use of appropriate rewards is especially crucial to improving registered nurses' reward satisfaction and job satisfaction globally in the nursing profession. © 2017 John Wiley & Sons Ltd.

  12. Neuronal differentiation modulates the dystrophin Dp71d binding to the nuclear matrix

    International Nuclear Information System (INIS)

    Rodriguez-Munoz, Rafael; Villarreal-Silva, Marcela; Gonzalez-Ramirez, Ricardo; Garcia-Sierra, Francisco; Mondragon, Monica; Mondragon, Ricardo; Cerna, Joel; Cisneros, Bulmaro

    2008-01-01

    The function of dystrophin Dp71 in neuronal cells remains unknown. To approach this issue, we have selected the PC12 neuronal cell line. These cells express both a Dp71f cytoplasmic variant and a Dp71d nuclear isoform. In this study, we demonstrated by electron and confocal microscopy analyses of in situ nuclear matrices and Western blotting evaluation of cell extracts that Dp71d associates with the nuclear matrix. Interestingly, this binding is modulated during NGF-induced neuronal differentiation of PC12 cells with a twofold increment in the differentiated cells, compared to control cells. Also, distribution of Dp71d along the periphery of the nuclear matrix observed in the undifferentiated cells is replaced by intense fluorescent foci localized in Center of the nucleoskeletal structure. In summary, we revealed that Dp71d is a dynamic component of nuclear matrix that might participate in the nuclear modeling occurring during neuronal differentiation

  13. Distinctive Modulation of Dopamine Release in the Nucleus Accumbens Shell Mediated by Dopamine and Acetylcholine Receptors.

    Science.gov (United States)

    Shin, Jung Hoon; Adrover, Martin F; Alvarez, Veronica A

    2017-11-15

    Nucleus accumbens (NAc) shell shows unique dopamine (DA) signals in vivo and plays a unique role in DA-dependent behaviors such as reward-motivated learning and the response to drugs of abuse. A disynaptic mechanism for DA release was reported and shown to require synchronized firing of cholinergic interneurons (CINs) and activation of nicotinic acetylcholine (ACh) receptors (nAChRs) in DA neuron (DAN) axons. The properties of this disynaptic mechanism of DA transmission are not well understood in the NAc shell. In this study, in vitro fast-scan cyclic voltammetry was used to examine the modulation of DA transmission evoked by CINs firing in the shell of mice and compared with other striatal regions. We found that DA signals in the shell displayed significant degree of summation in response to train stimulation of CINs, contrary to core and dorsal striatum. The summation was amplified by a D2-like receptor antagonist and experiments with mice with targeted deletion of D2 receptors to DANs or CINs revealed that D2 receptors in CINs mediate a fast inhibition observed within 100 ms of the first pulse, whereas D2 autoreceptors in DAN terminals are engaged in a slower inhibition that peaks at ∼500 ms. ACh also contributes to the use-dependent inhibition of DA release through muscarinic receptors only in the shell, where higher activity of acetylcholinesterase minimizes nAChR desensitization and promotes summation. These findings show that DA signals are modulated differentially by endogenous DA and ACh in the shell, which may underlie the unique features of shell DA signals in vivo SIGNIFICANCE STATEMENT The present study reports that dopamine (DA) release evoked by activation of cholinergic interneurons displays a high degree of summation in the shell and shows unique modulation by endogenous DA and acetylcholine. Desensitization of nicotinic receptors, which is a prevailing mechanism for use-dependent inhibition in the nucleus accumbens core and dorsal striatum, is

  14. The relationship between personality types and reward preferences

    Directory of Open Access Journals (Sweden)

    R. Nienaber

    2011-12-01

    Full Text Available Orientation: Research has shown that total rewards models structured according to individual preferences, positively influence efforts to attract, retain and motivate key employees. Yet, this is seldom done. Structuring total rewards models according to the preferences of employee segments is a viable alternative to accommodate individual preferences. Research purpose: The primary aim of the study was to determine the relationship between personality types and reward preferences. The secondary aim was to determine the reward preferences for different demographic groups. Motivation for the study: An enhanced understanding of reward preferences for different employee segments will enable employers to offer more competitive reward options to their employees. This may, in turn, have a positive impact on retention. Research design, approach and method: Two measuring instruments, the MBTI® Form GRV and the Rewards Preferences Questionnaire, were distributed electronically to 5 000 potential respondents. The results from 589 sets of questionnaires were used in the data analyses. Primary and secondary factor analyses were done on the items in the Rewards Preferences Questionnaire. Main findings/results: The study confirmed that individuals with certain personality types and personality preferences, have different preferences for certain reward categories. There was a stronger relationship between reward preferences and personality preferences than for reward preferences and personality types. Preferences for reward categories by different demographic groups were confirmed. The significant difference in reward preferences between Black and White respondents in particular was noteworthy, with Black respondents indicating significantly higher mean scores for all reward categories than White respondents. Finally, a total rewards framework influenced by the most prominent preferences for reward categories, was designed. Practical/Managerial implications

  15. Exogenous hydrogen sulfide promotes cell proliferation and differentiation by modulating autophagy in human keratinocytes

    International Nuclear Information System (INIS)

    Xie, Xin; Dai, Hui; Zhuang, Binyu; Chai, Li; Xie, Yanguang; Li, Yuzhen

    2016-01-01

    The effects and the underlying mechanisms of hydrogen sulfide (H 2 S) on keratinocyte proliferation and differentiation are still less known. In the current study, we investigated the effects and the underlying mechanisms of exogenous H 2 S on keratinocyte proliferation and differentiation. Human keratinocytes (HaCaT cells) were treated with various concentrations (0.05, 0.25, 0.5 and 1 mM) of sodium hydrosulfide (NaHS, a donor of H 2 S) for 24 h. A CCK-8 assay was used to assess cell viability. Western blot analysis was performed to determine the expression levels of proteins associated with differentiation and autophagy. Transmission electron microscopy was performed to observe autophagic vacuoles, and flow cytometry was applied to evaluate apoptosis. NaHS promoted the viability, induced the differentiation, and enhanced autophagic activity in a dose-dependent manner in HaCaT cells but had no effect on cell apoptosis. Blockage of autophagy by ATG5 siRNA inhibited NaHS-induced cell proliferation and differentiation. The current study demonstrated that autophagy in response to exogenous H 2 S treatment promoted keratinocyte proliferation and differentiation. Our results provide additional insights into the potential role of autophagy in keratinocyte proliferation and differentiation. - Highlights: • Exogenous H 2 S promotes keratinocyte proliferation and differentiation. • The effects of H 2 S on proliferation and differentiation is modulated by autophagy. • Exogenous H 2 S has no effect on keratinocyte apoptosis.

  16. Solving Linear Differential Equations

    NARCIS (Netherlands)

    Nguyen, K.A.; Put, M. van der

    2010-01-01

    The theme of this paper is to 'solve' an absolutely irreducible differential module explicitly in terms of modules of lower dimension and finite extensions of the differential field K. Representations of semi-simple Lie algebras and differential Galo is theory are the main tools. The results extend

  17. Fear Memory Recall Potentiates Opiate Reward Sensitivity through Dissociable Dopamine D1 vs. D4 Receptor-Dependent Memory Mechanisms in the Prefrontal Cortex.

    Science.gov (United States)

    Li, Jing Jing; Szkudlarek, Hanna; Renard, Justine; Hudson, Roger; Rushlow, Walter; Laviolette, Steven R

    2018-04-23

    Disturbances in prefrontal cortical (PFC) dopamine (DA) transmission are well-established features of psychiatric disorders involving pathological memory processing, such as post-traumatic stress disorder (PTSD) and opioid addiction. Transmission through PFC DA D4 receptors (D4R) has been shown to potentiate the emotional salience of normally non-salient emotional memories whereas transmission through PFC DA D1 receptors (D1R) has been demonstrated to selectively block recall of reward or aversion-related associative memories. In the present study, using a combination of fear conditioning and opiate reward conditioning in male rats, we examined the role of PFC D4/D1R signaling during the processing of fear-related memory acquisition and recall and subsequent sensitivity to opiate reward memory formation. We report that PFC D4R activation potentiates the salience of normally sub-threshold fear conditioning memory cues and simultaneously potentiates the rewarding effects of systemic or intra-ventral tegmental area (VTA) morphine conditioning cues. In contrast, blocking the recall of salient fear memories with intra-PFC D1R activation, blocks the ability of fear memory recall to potentiate systemic or intra-VTA morphine place preference. These effects were dependent upon dissociable PFC phosphorylation states involving calcium-calmodulin-kinase II (CaMKII-α) or extracellular-signal-related-kinase 1-2 (ERK 1/2), following intra-PFC D4 or D1R activation, respectively. Together, these findings reveal new insights into how aberrant PFC DAergic transmission and associated downstream molecular signaling pathways may modulate fear-related emotional memory processing and concomitantly increase opioid addiction vulnerability. Significance Statement: Post-traumatic stress disorder is highly comorbid with addiction. In this study, we use a translational model of fear memory conditioning to examine how transmission through dopamine D1 or D4 receptors, in the prefrontal cortex

  18. Brain Circuits Encoding Reward from Pain Relief.

    Science.gov (United States)

    Navratilova, Edita; Atcherley, Christopher W; Porreca, Frank

    2015-11-01

    Relief from pain in humans is rewarding and pleasurable. Primary rewards, or reward-predictive cues, are encoded in brain reward/motivational circuits. While considerable advances have been made in our understanding of reward circuits underlying positive reinforcement, less is known about the circuits underlying the hedonic and reinforcing actions of pain relief. We review findings from electrophysiological, neuroimaging, and behavioral studies supporting the concept that the rewarding effect of pain relief requires opioid signaling in the anterior cingulate cortex (ACC), activation of midbrain dopamine neurons, and the release of dopamine in the nucleus accumbens (NAc). Understanding of circuits that govern the reward of pain relief may allow the discovery of more effective and satisfying therapies for patients with acute or chronic pain.

  19. Dopamine selectively remediates 'model-based' reward learning: a computational approach.

    Science.gov (United States)

    Sharp, Madeleine E; Foerde, Karin; Daw, Nathaniel D; Shohamy, Daphna

    2016-02-01

    Patients with loss of dopamine due to Parkinson's disease are impaired at learning from reward. However, it remains unknown precisely which aspect of learning is impaired. In particular, learning from reward, or reinforcement learning, can be driven by two distinct computational processes. One involves habitual stamping-in of stimulus-response associations, hypothesized to arise computationally from 'model-free' learning. The other, 'model-based' learning, involves learning a model of the world that is believed to support goal-directed behaviour. Much work has pointed to a role for dopamine in model-free learning. But recent work suggests model-based learning may also involve dopamine modulation, raising the possibility that model-based learning may contribute to the learning impairment in Parkinson's disease. To directly test this, we used a two-step reward-learning task which dissociates model-free versus model-based learning. We evaluated learning in patients with Parkinson's disease tested ON versus OFF their dopamine replacement medication and in healthy controls. Surprisingly, we found no effect of disease or medication on model-free learning. Instead, we found that patients tested OFF medication showed a marked impairment in model-based learning, and that this impairment was remediated by dopaminergic medication. Moreover, model-based learning was positively correlated with a separate measure of working memory performance, raising the possibility of common neural substrates. Our results suggest that some learning deficits in Parkinson's disease may be related to an inability to pursue reward based on complete representations of the environment. © The Author (2015). Published by Oxford University Press on behalf of the Guarantors of Brain. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

  20. Reward system dysfunction in autism spectrum disorders

    Science.gov (United States)

    Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2013-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

  1. Differential on-on keying: A robust non-coherent digital modulation scheme

    KAUST Repository

    Kaddoum, Georges

    2015-05-01

    A robust digital modulation scheme, called differential on-on keying (DOOK), is presented in this paper which outperforms the conventional on-off keying (OOK). In this scheme, a sinusoidal signal is transmitted during the first half of the bit duration while a replica or an inverted version of the sinusoidal signal is transmitted during the second half for logic one or logic zero, respectively. Non-coherent receiver correlates the two halves of the received signal over half bit duration to construct a decision variable. Bit error performance is analyzed over AWGN and Rayleigh fading channels and compared to the conventional OOK.

  2. Differential on-on keying: A robust non-coherent digital modulation scheme

    KAUST Repository

    Kaddoum, Georges; Ahmed, Mohammed F. A.; Al-Naffouri, Tareq Y.

    2015-01-01

    A robust digital modulation scheme, called differential on-on keying (DOOK), is presented in this paper which outperforms the conventional on-off keying (OOK). In this scheme, a sinusoidal signal is transmitted during the first half of the bit duration while a replica or an inverted version of the sinusoidal signal is transmitted during the second half for logic one or logic zero, respectively. Non-coherent receiver correlates the two halves of the received signal over half bit duration to construct a decision variable. Bit error performance is analyzed over AWGN and Rayleigh fading channels and compared to the conventional OOK.

  3. The effects of intranasal oxytocin on reward circuitry responses in children with autism spectrum disorder.

    Science.gov (United States)

    Greene, R K; Spanos, M; Alderman, C; Walsh, E; Bizzell, J; Mosner, M G; Kinard, J L; Stuber, G D; Chandrasekhar, T; Politte, L C; Sikich, L; Dichter, G S

    2018-03-27

    Intranasal oxytocin (OT) has been shown to improve social communication functioning of individuals with autism spectrum disorder (ASD) and, thus, has received considerable interest as a potential ASD therapeutic agent. Although preclinical research indicates that OT modulates the functional output of the mesocorticolimbic dopamine system that processes rewards, no clinical brain imaging study to date has examined the effects of OT on this system using a reward processing paradigm. To address this, we used an incentive delay task to examine the effects of a single dose of intranasal OT, versus placebo (PLC), on neural responses to social and nonsocial rewards in children with ASD. In this placebo-controlled double-blind study, 28 children and adolescents with ASD (age: M = 13.43 years, SD = 2.36) completed two fMRI scans, one after intranasal OT administration and one after PLC administration. During both scanning sessions, participants completed social and nonsocial incentive delay tasks. Task-based neural activation and connectivity were examined to assess the impact of OT relative to PLC on mesocorticolimbic brain responses to social and nonsocial reward anticipation and outcomes. Central analyses compared the OT and PLC conditions. During nonsocial reward anticipation, there was greater activation in the right nucleus accumbens (NAcc), left anterior cingulate cortex (ACC), bilateral orbital frontal cortex (OFC), left superior frontal cortex, and right frontal pole (FP) during the OT condition relative to PLC. Alternatively, during social reward anticipation and outcomes, there were no significant increases in brain activation during the OT condition relative to PLC. A Treatment Group × Reward Condition interaction revealed relatively greater activation in the right NAcc, right caudate nucleus, left ACC, and right OFC during nonsocial relative to social reward anticipation during the OT condition relative to PLC. Additionally, these analyses revealed

  4. Neural evidence for description dependent reward processing in the framing effect

    Science.gov (United States)

    Yu, Rongjun; Zhang, Ping

    2014-01-01

    Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN), which indexes the “worse than expected” negative prediction error in the anterior cingulate cortex (ACC), was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to “better than expected” positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect. PMID:24733998

  5. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    Science.gov (United States)

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

  6. Reward-based hypertension control by a synthetic brain-dopamine interface.

    Science.gov (United States)

    Rössger, Katrin; Charpin-El Hamri, Ghislaine; Fussenegger, Martin

    2013-11-05

    Synthetic biology has significantly advanced the design of synthetic trigger-controlled devices that can reprogram mammalian cells to interface with complex metabolic activities. In the brain, the neurotransmitter dopamine coordinates communication with target neurons via a set of dopamine receptors that control behavior associated with reward-driven learning. This dopamine transmission has recently been suggested to increase central sympathetic outflow, resulting in plasma dopamine levels that correlate with corresponding brain activities. By functionally rewiring the human dopamine receptor D1 (DRD1) via the second messenger cyclic adenosine monophosphate (cAMP) to synthetic promoters containing cAMP response element-binding protein 1(CREB1)-specific cAMP-responsive operator modules, we have designed a synthetic dopamine-sensitive transcription controller that reversibly fine-tunes specific target gene expression at physiologically relevant brain-derived plasma dopamine levels. Following implantation of circuit-transgenic human cell lines insulated by semipermeable immunoprotective microcontainers into mice, the designer device interfaced with dopamine-specific brain activities and produced a systemic expression response when the animal's reward system was stimulated by food, sexual arousal, or addictive drugs. Reward-triggered brain activities were able to remotely program peripheral therapeutic implants to produce sufficient amounts of the atrial natriuretic peptide, which reduced the blood pressure of hypertensive mice to the normal physiologic range. Seamless control of therapeutic transgenes by subconscious behavior may provide opportunities for treatment strategies of the future.

  7. Reward Merit with Praise.

    Science.gov (United States)

    Andrews, Hans A.

    1987-01-01

    Describes the efforts of two educational institutions to reward teaching excellence using positive feedback rather than merit pay incentives. An Arizona district, drawing on Herzberg's motivation theories, offers highly individualized rewards ranging from computers to conference money, while an Illinois community college bestows engraved plaques…

  8. Fucoidan, a Sulfated Polysaccharide, Inhibits Osteoclast Differentiation and Function by Modulating RANKL Signaling

    Directory of Open Access Journals (Sweden)

    Young Woo Kim

    2014-10-01

    Full Text Available Multinucleated osteoclasts differentiate from hematopoietic progenitors of the monocyte/macrophage lineage. Because of its pivotal role in bone resorption, regulation of osteoclast differentiation is a potential therapeutic approach to the treatment of erosive bone disease. In this study, we have found that fucoidan, a sulfated polysaccharide extracted from brown seaweed, inhibited osteoclast differentiation. In particular, addition of fucoidan into the early stage osteoclast cultures significantly inhibited receptor activator of nuclear factor kappa B (NF-κB ligand (RANKL-induced osteoclast formation, thus suggesting that fucoidan affects osteoclast progenitors. Furthermore, fucoidan significantly inhibited the activation of RANKL-dependent mitogen-activated protein kinases (MAPKs such as JNK, ERK, and p38, and also c-Fos and NFATc1, which are crucial transcription factors for osteoclastogenesis. In addition, the activation of NF-κB, which is an upstream transcription factor modulating NFATc1 expression, was alleviated in the fucoidan-treated cells. These results collectively suggest that fucoidan inhibits osteoclastogenesis from bone marrow macrophages by inhibiting RANKL-induced p38, JNK, ERK and NF-κB activation, and by downregulating the expression of genes that partake in both osteoclast differentiation and resorption.

  9. Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward.

    Science.gov (United States)

    McMurray, Matthew S; Conway, Sineadh M; Roitman, Jamie D

    2017-01-01

    Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

  10. Impaired reward learning and intact motivation after serotonin depletion in rats.

    Science.gov (United States)

    Izquierdo, Alicia; Carlos, Kathleen; Ostrander, Serena; Rodriguez, Danilo; McCall-Craddolph, Aaron; Yagnik, Gargey; Zhou, Feimeng

    2012-08-01

    Aside from the well-known influence of serotonin (5-hydroxytryptamine, 5-HT) on emotional regulation, more recent investigations have revealed the importance of this monoamine in modulating cognition. Parachlorophenylalanine (PCPA) depletes 5-HT by inhibiting tryptophan hydroxylase, the enzyme required for 5-HT synthesis and, if administered at sufficiently high doses, can result in a depletion of at least 90% of the brain's 5-HT levels. The present study assessed the long-lasting effects of widespread 5-HT depletions on two tasks of cognitive flexibility in Long Evans rats: effort discounting and reversal learning. We assessed performance on these tasks after administration of either 250 or 500 mg/kg PCPA or saline (SAL) on two consecutive days. Consistent with a previous report investigating the role of 5-HT on effort discounting, pretreatment with either dose of PCPA resulted in normal effortful choice: All rats continued to climb tall barriers to obtain large rewards and were not work-averse. Additionally, rats receiving the lower dose of PCPA displayed normal reversal learning. However, despite intact motivation to work for food rewards, rats receiving the largest dose of PCPA were unexpectedly impaired relative to SAL rats on the pretraining stages leading up to reversal learning, ultimately failing to approach and respond to the stimuli associated with reward. High performance liquid chromatography (HPLC) with electrochemical detection confirmed 5-HT, and not dopamine, levels in the ventromedial frontal cortex were correlated with this measure of associative reward learning. Copyright © 2012 Elsevier B.V. All rights reserved.

  11. Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

    Science.gov (United States)

    Baker, Travis E; Holroyd, Clay B

    2011-04-01

    The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

  12. A non-correlator-based digital communication system using interleaved chaotic differential peaks keying (I-CDPK) modulation and chaotic synchronization

    International Nuclear Information System (INIS)

    Chien, T.-I; Hung, Y.-C.; Liao, T.-L.

    2006-01-01

    This paper presents a novel non-correlator-based digital communication system with the application of interleaved chaotic differential peaks keying (I-CDPK) modulation technique. The proposed communication system consists of four major modules: I-CDPK modulator (ICM), frequency modulation (FM) transmitter, FM receiver and I-CDPK demodulator (ICDM). In the ICM module, there are four components: a chaotic circuit to generate the chaotic signals, A/D converter, D/A converter and a digital processing mechanism to control all signal flows and performs I-CDPK modulation corresponding to the input digital bits. For interleaving every input digital bit set, every state of the chaotic system is used to represent one portion of it, but only a scalar state variable (i.e. the system output) is sent to the ICDM's chaotic circuit through both FM transmitter and FM receiver. An observer-based chaotic synchronization scheme is designed to synchronize the chaotic circuits of the ICM and ICDM. Meanwhile, the bit detector in ICDM is devoted to recover the transmitted input digital bits. Some numerical simulations of an illustrative communication system are given to demonstrate its theoretical effectiveness. Furthermore, the performance of bit error rate of the proposed system is analyzed and compared with those of the correlator-based communication systems adopting coherent binary phase shift keying (BPSK) and coherent differential chaotic shift keying (DCSK) schemes

  13. Gut peptide GLP-1 and its analogue, Exendin-4, decrease alcohol intake and reward.

    Directory of Open Access Journals (Sweden)

    Rozita H Shirazi

    Full Text Available Glucagon-like-peptide-1 (GLP-1 is a gut- and neuro-peptide with an important role in the regulation of food intake and glucose metabolism. Interestingly, GLP-1 receptors (GLP-1R are expressed in key mesolimbic reward areas (including the ventral tegmental area, VTA, innervated by hindbrain GLP-1 neurons. Recently GLP-1 has emerged as a potential regulator of food reward behavior, an effect driven by the mesolimbic GLP-1Rs. Its role in other reward behaviors remains largely unexplored. Since a considerable overlap has been suggested for circuitry controlling reward behavior derived from food and alcohol we hypothesized that GLP-1 and GLP-1Rs could regulate alcohol intake and alcohol reward. We sought to determine whether GLP-1 or its clinically safe stable analogue, Exendin-4, reduce alcohol intake and reward. To determine the potential role of the endogenous GLP-1 in alcohol intake we evaluated whether GLP-1R antagonist, Exendin 9-39, can increase alcohol intake. Furthermore, we set out to evaluate whether VTA GLP-1R activation is sufficient to reduce alcohol intake. Male Wistar rats injected peripherally with GLP-1 or Exendin-4 reduced their alcohol intake in an intermittent access two bottle free choice drinking model. Importantly, a contribution of endogenously released GLP-1 is highlighted by our observation that blockade of GLP-1 receptors alone resulted in an increased alcohol intake. Furthermore, GLP-1 injection reduced alcohol reward in the alcohol conditioned place preference test in mice. To evaluate the neuroanatomical substrate linking GLP-1 with alcohol intake/reward, we selectively microinjected GLP-1 or Exendin 4 into the VTA. This direct stimulation of the VTA GLP-1 receptors potently reduced alcohol intake. Our findings implicate GLP-1R signaling as a novel modulator of alcohol intake and reward. We show for the first time that VTA GLP-1R stimulation leads to reduced alcohol intake. Considering that GLP-1 analogues are already

  14. Oxytocin modulates hemodynamic responses to monetary incentives in humans

    Science.gov (United States)

    Mickey, Brian J.; Heffernan, Joseph; Heisel, Curtis; Peciña, Marta; Hsu, David T.; Zubieta, Jon-Kar; Love, Tiffany M.

    2016-01-01

    Oxytocin is a neuropeptide widely recognized for its role in regulating social and reproductive behavior. Increasing evidence from animal models suggests that oxytocin also modulates reward circuitry in non-social contexts, but evidence in humans is lacking. Here we examined the effects of oxytocin administration on reward circuit function in 18 healthy men as they performed a monetary incentive task. The blood oxygenation level dependent (BOLD) signal was measured using functional magnetic resonance imaging in the context of a randomized, double-blind, placebo-controlled, crossover trial of intranasal oxytocin. We found that oxytocin increases the BOLD signal in the midbrain (substantia nigra and ventral tegmental area) during the late phase of the hemodynamic response to incentive stimuli. Oxytocin’s effects on midbrain responses correlated positively with its effects on positive emotional state. We did not detect an effect of oxytocin on responses in the nucleus accumbens. Whole-brain analyses revealed that oxytocin attenuated medial prefrontal cortical deactivation specifically during anticipation of loss. Our findings demonstrate that intranasal administration of oxytocin modulates human midbrain and medial prefrontal function during motivated behavior. These findings suggest that endogenous oxytocin is a neurochemical mediator of reward behaviors in humans – even in a non-social context – and that the oxytocinergic system is a potential target of pharmacotherapy for psychiatric disorders that involve dysfunction of reward circuitry. PMID:27614896

  15. Oxytocin modulates hemodynamic responses to monetary incentives in humans.

    Science.gov (United States)

    Mickey, Brian J; Heffernan, Joseph; Heisel, Curtis; Peciña, Marta; Hsu, David T; Zubieta, Jon-Kar; Love, Tiffany M

    2016-12-01

    Oxytocin is a neuropeptide widely recognized for its role in regulating social and reproductive behavior. Increasing evidence from animal models suggests that oxytocin also modulates reward circuitry in non-social contexts, but evidence in humans is lacking. We examined the effects of oxytocin administration on reward circuit function in 18 healthy men as they performed a monetary incentive task. The blood oxygenation level-dependent (BOLD) signal was measured using functional magnetic resonance imaging in the context of a randomized, double-blind, placebo-controlled, crossover trial of intranasal oxytocin. We found that oxytocin increases the BOLD signal in the midbrain (substantia nigra and ventral tegmental area) during the late phase of the hemodynamic response to incentive stimuli. Oxytocin's effects on midbrain responses correlated positively with its effects on positive emotional state. We did not detect an effect of oxytocin on responses in the nucleus accumbens. Whole-brain analyses revealed that oxytocin attenuated medial prefrontal cortical deactivation specifically during anticipation of loss. Our findings demonstrate that intranasal administration of oxytocin modulates human midbrain and medial prefrontal function during motivated behavior. These findings suggest that endogenous oxytocin is a neurochemical mediator of reward behaviors in humans-even in a non-social context-and that the oxytocinergic system is a potential target of pharmacotherapy for psychiatric disorders that involve dysfunction of reward circuitry.

  16. A test of the reward-value hypothesis.

    Science.gov (United States)

    Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

    2017-03-01

    Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

  17. Reward inference by primate prefrontal and striatal neurons.

    Science.gov (United States)

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

    2014-01-22

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

  18. Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task.

    Science.gov (United States)

    van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

    2015-01-01

    Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5-14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.

  19. Extinction and renewal of cue-elicited reward-seeking.

    Science.gov (United States)

    Bezzina, Louise; Lee, Jessica C; Lovibond, Peter F; Colagiuri, Ben

    2016-12-01

    Reward cues can contribute to overconsumption of food and drugs and can relapse. The failure of exposure therapies to reduce overconsumption and relapse is generally attributed to the context-specificity of extinction. However, no previous study has examined whether cue-elicited reward-seeking (as opposed to cue-reactivity) is sensitive to context renewal. We tested this possibility in 160 healthy volunteers using a Pavlovian-instrumental transfer (PIT) design involving voluntary responding for a high value natural reward (chocolate). One reward cue underwent Pavlovian extinction in the same (Group AAA) or different context (Group ABA) to all other phases. This cue was compared with a second non-extinguished reward cue and an unpaired control cue. There was a significant overall PIT effect with both reward cues eliciting reward-seeking on test relative to the unpaired cue. Pavlovian extinction substantially reduced this effect, with the extinguished reward cue eliciting less reward-seeking than the non-extinguished reward cue. Most interestingly, extinction of cue-elicited reward-seeking was sensitive to renewal, with extinction less effective for reducing PIT when conducted in a different context. These findings have important implications for extinction-based interventions for reducing maladaptive reward-seeking in practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

  20. Olfactory tubercle stimulation alters odor preference behavior and recruits forebrain reward and motivational centers

    Directory of Open Access Journals (Sweden)

    Brynn J FitzGerald

    2014-03-01

    Full Text Available Rodents show robust behavioral responses to odors, including strong preferences or aversions for certain odors. The neural mechanisms underlying the effects of odors on these behaviors in animals are not well understood. Here, we provide an initial proof-of-concept study into the role of the olfactory tubercle (OT, a structure with known anatomical connectivity with both brain reward and olfactory structures, in regulating odor-motivated behaviors. We implanted c57bl/6 male mice with an ipsilateral bipolar electrode into the OT to administer electric current and thereby yield gross activation of the OT. We confirmed that electrical stimulation of the OT was rewarding, with mice frequently self-administering stimulation on a fixed ratio schedule. In a separate experiment, mice were presented with either fox urine or peanut odors in a three-chamber preference test. In absence of OT stimulation, significant preference for the peanut odor chamber was observed which was abolished in the presence of OT stimulation. Perhaps providing a foundation for this modulation in behavior, we found that OT stimulation significantly increased the number of c-Fos positive neurons in not only the OT, but also in forebrain structures essential to motivated behaviors, including the nucleus accumbens and lateral septum. The present results support the notion that the OT is integral to the display of motivated behavior and possesses the capacity to modulate odor hedonics either by directly altering odor processing or perhaps by indirect actions on brain reward and motivation structures.

  1. Reward Dependence and Harm Avoidance among Patients with Binge-Purge Type Eating Disorders.

    Science.gov (United States)

    Gat-Lazer, Sigal; Geva, Ronny; Gur, Eitan; Stein, Daniel

    2017-05-01

    The Cloninger's Psychobiological Model of Temperament and Character includes temperamental dimensions such as reward dependence (RD) and harm avoidance (HA). Studies of RD differentiate between sensitivity to reward (SR) versus to punishment (SP). We investigated the interrelationship between HA and RD in acutely ill patients with binge/purge (B/P) type eating disorders (EDs) and following symptomatic stabilization. Fifty patients with B/P EDs were assessed at admission to inpatient treatment, 36 of whom were reassessed at discharge. Thirty-six controls were similarly assessed. Participants completed Tridimensional Personality Questionnaire (TPQ), Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ), and took the Gambling Task. Patients with B/P EDs had higher TPQ-RD and lower TPQ-HA accompanied by lower SPSRQ-SR and SPSRQ-SP. SPSRQ-SP correlated positively and negatively with TPQ-HA and TPQ-RD, respectively. Combination of lower TPQ-HA, lower SPSRQ-SP, and greater risk-taking inclination may maintain disordered eating in patients with B/P EDs. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association.

  2. Reward, Distraction, and the Overjustification Effect

    Science.gov (United States)

    Smith, Timothy W.; Pittman, Thane S.

    1978-01-01

    This study tests two differing hypotheses: the competing response hypothesis, which states that both reward and non-reward distractions produce decreases in interest which weaken over repeated trials, and the attribution/overjustification hypothesis, which maintains that rewards produce a decrease in interest that does not weaken over trials.…

  3. Renewal processes with costs and rewards

    NARCIS (Netherlands)

    Vlasiou, M.; Cochran, J.J.; Cox, L.A.; Keskinocak, P.; Kharoufeh, J.P.; Smith, J.C.

    2011-01-01

    We review the theory of renewal reward processes, which describes renewal processes that have some cost or reward associated with each cycle. We present a new simplified proof of the renewal reward theorem that mimics the proof of the Elementary Renewal Theorem and avoids the technicalities in the

  4. Exogenous hydrogen sulfide promotes cell proliferation and differentiation by modulating autophagy in human keratinocytes

    Energy Technology Data Exchange (ETDEWEB)

    Xie, Xin [Department of Dermatology, The Second Affiliated Hospital of Harbin Medical University, Harbin, 150086, Heilongjiang Province (China); Dai, Hui [Department of Cardiology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province (China); Zhuang, Binyu [Department of Dermatology, The Second Affiliated Hospital of Harbin Medical University, Harbin, 150086, Heilongjiang Province (China); Chai, Li; Xie, Yanguang [Institute of Dermatology of Heilongjiang Province, Harbin, 150001, Heilongjiang Province (China); Li, Yuzhen, E-mail: liyuzhen@medmail.com.cn [Department of Dermatology, The Second Affiliated Hospital of Harbin Medical University, Harbin, 150086, Heilongjiang Province (China)

    2016-04-08

    The effects and the underlying mechanisms of hydrogen sulfide (H{sub 2}S) on keratinocyte proliferation and differentiation are still less known. In the current study, we investigated the effects and the underlying mechanisms of exogenous H{sub 2}S on keratinocyte proliferation and differentiation. Human keratinocytes (HaCaT cells) were treated with various concentrations (0.05, 0.25, 0.5 and 1 mM) of sodium hydrosulfide (NaHS, a donor of H{sub 2}S) for 24 h. A CCK-8 assay was used to assess cell viability. Western blot analysis was performed to determine the expression levels of proteins associated with differentiation and autophagy. Transmission electron microscopy was performed to observe autophagic vacuoles, and flow cytometry was applied to evaluate apoptosis. NaHS promoted the viability, induced the differentiation, and enhanced autophagic activity in a dose-dependent manner in HaCaT cells but had no effect on cell apoptosis. Blockage of autophagy by ATG5 siRNA inhibited NaHS-induced cell proliferation and differentiation. The current study demonstrated that autophagy in response to exogenous H{sub 2}S treatment promoted keratinocyte proliferation and differentiation. Our results provide additional insights into the potential role of autophagy in keratinocyte proliferation and differentiation. - Highlights: • Exogenous H{sub 2}S promotes keratinocyte proliferation and differentiation. • The effects of H{sub 2}S on proliferation and differentiation is modulated by autophagy. • Exogenous H{sub 2}S has no effect on keratinocyte apoptosis.

  5. Nucleus Accumbens and Its Role in Reward and Emotional Circuitry: A Potential Hot Mess in Substance Use and Emotional Disorders

    Directory of Open Access Journals (Sweden)

    Mani Pavuluri

    2017-04-01

    Full Text Available Nucleus accumbens (NAc is a key region in the brain that is integral to both the reward and the emotional systems. The aim of the current paper is to synthesize the basic and the clinical neuroscience discoveries relevant to the NAc for the purpose of two-way translation. Selected literature on the structure and the functionality of the NAc is reviewed across animal and human studies. Dopamine, gamma-aminobutyric acid (GABA and glutamate are the three key neurotransmitters that modulate the reward function and the motor activity. Dissociative roles of the core and the shell of the NAc include getting to the reward and staying on task with discretion, respectively. NAc shows decreased activation to reward in the individuals with major depressive disorder and the bipolar disorder, relative to that healthy controls (HC. The “difficult to please” or insatiability in response to reward in the emotional disorders may possibly be explained by such a neural pattern. Furthermore, it is likely that the increased amygdala activity reported in mood disorders could be accentuating the “wanting” of the reward by the virtue of its connections with the NAc, explaining the potential “hot mess”. In contrast, the NAc shows increased reward response in substance use disorders, relative to HC, in response to reward and emotional tasks. Accurate characterization of the NAc and its functionality in the human imaging studies of mood and substance use has important treatment implications.

  6. Neural processing of reward in adolescent rodents

    Directory of Open Access Journals (Sweden)

    Nicholas W. Simon

    2015-02-01

    Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.

  7. Gαq Regulates the Development of Rheumatoid Arthritis by Modulating Th1 Differentiation.

    Science.gov (United States)

    Wang, Dashan; Liu, Yuan; Li, Yan; He, Yan; Zhang, Jiyun; Shi, Guixiu

    2017-01-01

    The G α q-containing G protein, an important member of G q/11 class, is ubiquitously expressed in mammalian cells. G α q has been found to play an important role in immune regulation and development of autoimmune disease such as rheumatoid arthritis (RA). However, how G α q participates in the pathogenesis of RA is still not fully understood. In the present study, we aimed to find out whether G α q controls RA via regulation of Th1 differentiation. We observed that the expression of G α q was negatively correlated with the expression of signature Th1 cytokine (IFN- γ ) in RA patients, which suggests a negative role of G α q in differentiation of Th1 cells. By using G α q knockout ( Gnaq-/- ) mice, we demonstrated that loss of G α q led to enhanced Th1 cell differentiation. G α q negative regulated the differentiation of Th1 cell by modulating the expression of T-bet and the activity of STAT4. Furthermore, we detected the increased ratio of Th1 cells in Gnaq-/- bone marrow (BM) chimeras spontaneously developing inflammatory arthritis. In conclusion, results presented in the study demonstrate that loss of G α q promotes the differentiation of Th1 cells and contributes to the pathogenesis of RA.

  8. Reward Inference by Primate Prefrontal and Striatal Neurons

    OpenAIRE

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

    2014-01-01

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Im...

  9. Ventral pallidum roles in reward and motivation.

    Science.gov (United States)

    Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

    2009-01-23

    In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

  10. A new module in neural differentiation control: two microRNAs upregulated by retinoic acid, miR-9 and -103, target the differentiation inhibitor ID2.

    Directory of Open Access Journals (Sweden)

    Daniela Annibali

    Full Text Available The transcription factor ID2 is an important repressor of neural differentiation strongly implicated in nervous system cancers. MicroRNAs (miRNAs are increasingly involved in differentiation control and cancer development. Here we show that two miRNAs upregulated on differentiation of neuroblastoma cells--miR-9 and miR-103--restrain ID2 expression by directly targeting the coding sequence and 3' untranslated region of the ID2 encoding messenger RNA, respectively. Notably, the two miRNAs show an inverse correlation with ID2 during neuroblastoma cell differentiation induced by retinoic acid. Overexpression of miR-9 and miR-103 in neuroblastoma cells reduces proliferation and promotes differentiation, as it was shown to occur upon ID2 inhibition. Conversely, an ID2 mutant that cannot be targeted by either miRNA prevents retinoic acid-induced differentiation more efficient than wild-type ID2. These findings reveal a new regulatory module involving two microRNAs upregulated during neural differentiation that directly target expression of the key differentiation inhibitor ID2, suggesting that its alteration may be involved in neural cancer development.

  11. Nouns referring to tools and natural objects differentially modulate the motor system.

    Science.gov (United States)

    Gough, Patricia M; Riggio, Lucia; Chersi, Fabian; Sato, Marc; Fogassi, Leonardo; Buccino, Giovanni

    2012-01-01

    While increasing evidence points to a critical role for the motor system in language processing, the focus of previous work has been on the linguistic category of verbs. Here we tested whether nouns are effective in modulating the motor system and further whether different kinds of nouns - those referring to artifacts or natural items, and items that are graspable or ungraspable - would differentially modulate the system. A Transcranial Magnetic Stimulation (TMS) study was carried out to compare modulation of the motor system when subjects read nouns referring to objects which are Artificial or Natural and which are Graspable or Ungraspable. TMS was applied to the primary motor cortex representation of the first dorsal interosseous (FDI) muscle of the right hand at 150 ms after noun presentation. Analyses of Motor Evoked Potentials (MEPs) revealed that across the duration of the task, nouns referring to graspable artifacts (tools) were associated with significantly greater MEP areas. Analyses of the initial presentation of items revealed a main effect of graspability. The findings are in line with an embodied view of nouns, with MEP measures modulated according to whether nouns referred to natural objects or artifacts (tools), confirming tools as a special class of items in motor terms. Additionally our data support a difference for graspable versus non graspable objects, an effect which for natural objects is restricted to initial presentation of items. Copyright © 2011 Elsevier Ltd. All rights reserved.

  12. It's about time: Earlier rewards increase intrinsic motivation.

    Science.gov (United States)

    Woolley, Kaitlin; Fishbach, Ayelet

    2018-06-01

    Can immediate (vs. delayed) rewards increase intrinsic motivation? Prior research compared the presence versus absence of rewards. By contrast, this research compared immediate versus delayed rewards, predicting that more immediate rewards increase intrinsic motivation by creating a perceptual fusion between the activity and its goal (i.e., the reward). In support of the hypothesis, framing a reward from watching a news program as more immediate (vs. delayed) increased intrinsic motivation to watch the program (Study 1), and receiving more immediate bonus (vs. delayed, Study 2; and vs. delayed and no bonus, Study 3) increased intrinsic motivation in an experimental task. The effect of reward timing was mediated by the strength of the association between an activity and a reward, and was specific to intrinsic (vs. extrinsic) motivation-immediacy influenced the positive experience of an activity, but not perceived outcome importance (Study 4). In addition, the effect of the timing of rewards was independent of the effect of the magnitude of the rewards (Study 5). (PsycINFO Database Record (c) 2018 APA, all rights reserved).

  13. Evolutionary advantages of adaptive rewarding

    International Nuclear Information System (INIS)

    Szolnoki, Attila; Perc, Matjaž

    2012-01-01

    Our well-being depends on both our personal success and the success of our society. The realization of this fact makes cooperation an essential trait. Experiments have shown that rewards can elevate our readiness to cooperate, but since giving a reward inevitably entails paying a cost for it, the emergence and stability of such behavior remains elusive. Here we show that allowing for the act of rewarding to self-organize in dependence on the success of cooperation creates several evolutionary advantages that instill new ways through which collaborative efforts are promoted. Ranging from indirect territorial battle to the spontaneous emergence and destruction of coexistence, phase diagrams and the underlying spatial patterns reveal fascinatingly rich social dynamics that explain why this costly behavior has evolved and persevered. Comparisons with adaptive punishment, however, uncover an Achilles heel of adaptive rewarding, coming from over-aggression, which in turn hinders optimal utilization of network reciprocity. This may explain why, despite its success, rewarding is not as firmly embedded into our societal organization as punishment. (paper)

  14. Addiction and Reward-related Genes Show Altered Expression in the Postpartum Nucleus Accumbens

    Directory of Open Access Journals (Sweden)

    Changjiu eZhao

    2014-11-01

    Full Text Available Motherhood involves a switch in natural rewards, whereby offspring become highly rewarding. Nucleus accumbens (NAC is a key CNS region for natural rewards and addictions, but to date no study has evaluated on a large scale the events in NAC that underlie the maternal change in natural rewards. In this study we utilized microarray and bioinformatics approaches to evaluate postpartum NAC gene expression changes in mice. Modular Single-set Enrichment Test (MSET indicated that postpartum (relative to virgin NAC gene expression profile was significantly enriched for genes related to addiction and reward in 5 of 5 independently curated databases (e.g., Malacards, Phenopedia. Over 100 addiction/reward related genes were identified and these included: Per1, Per2, Arc, Homer2, Creb1, Grm3, Fosb, Gabrb3, Adra2a, Ntrk2, Cry1, Penk, Cartpt, Adcy1, Npy1r, Htr1a, Drd1a, Gria1, and Pdyn. ToppCluster analysis found maternal NAC expression profile to be significantly enriched for genes related to the drug action of nicotine, ketamine, and dronabinol. Pathway analysis indicated postpartum NAC as enriched for RNA processing, CNS development/differentiation, and transcriptional regulation. Weighted Gene Coexpression Network Analysis identified possible networks for transcription factors, including Nr1d1, Per2, Fosb, Egr1, and Nr4a1. The postpartum state involves increased risk for mental health disorders and MSET analysis indicated postpartum NAC to be enriched for genes related to depression, bipolar disorder, and schizophrenia. Mental health related genes included: Fabp7, Grm3, Penk, and Nr1d1. We confirmed via quantitative PCR Nr1d1, Per2, Grm3, Penk, Drd1a, and Pdyn. This study indicates for the first time that postpartum NAC involves large scale gene expression alterations linked to addiction and reward. Because the postpartum state also involves decreased response to drugs, the findings could provide insights into how to mitigate addictions.

  15. Hyperactivity and frustration: the influence of control over and size of rewards in delaying gratification.

    Science.gov (United States)

    Rapport, M D; Tucker, S B; DuPaul, G J; Merlo, M; Stoner, G

    1986-06-01

    This study examined the differential effects of frustration on normal children and those diagnosed as having Attention Deficit Disorder with Hyperactivity. Each group consisted of 16 boys between the ages of 6 and 8 years who were prematched for age, grade, and classroom placement. All children completed a series of arithmetic problems in order to earn toy rewards. Using a variant of Mischel's (1974) delay-of-gratification paradigm, children were presented with two choice-of-delay conditions in a randomly assigned, counterbalanced sequence: a free-choice conflict situation involving a long-passive or short-active reward delay, and a short-active delay. Results showed that a significantly greater proportion of hyperactive children chose to complete problems for an immediate reward compared to their normal control counterparts (p less than .01). Group differences were no longer apparent in the short-active delay trial. The results are discussed in terms of frustration tolerance and contributing factors such as cognitive-attentional style. Implications for treatment and future directions are delineated.

  16. Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI.

    Science.gov (United States)

    Jiang, Tao; Soussignan, Robert; Schaal, Benoist; Royet, Jean-Pierre

    2015-04-01

    Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  17. Hunger and Satiety Gauge Reward Sensitivity

    Directory of Open Access Journals (Sweden)

    Ryan Michael Cassidy

    2017-05-01

    Full Text Available Many of the neurocircuits and hormones known to underlie the sensations of hunger and satiety also substantially alter the activity of the dopaminergic reward system. Much interest lies in the ways that hunger, satiety, and reward tie together, as the epidemic of obesity seems tied to the recent development and mass availability of highly palatable foods. In this review, we will first discuss the basic neurocircuitry of the midbrain and basal forebrain reward system. We will elaborate how several important mediators of hunger—the agouti-related protein neurons of the arcuate nucleus, the lateral hypothalamic nucleus, and ghrelin—enhance the sensitivity of the dopaminergic reward system. Then, we will elaborate how mediators of satiety—the nucleus tractus solitarius, pro-opiomelanocortin neurons of the arcuate nucleus, and its peripheral hormonal influences such as leptin—reduce the reward system sensitivity. We hope to provide a template by which future research may identify the ways in which highly rewarding foods bypass this balanced system to produce excessive food consumption.

  18. Dopamine receptors D3 and D5 regulate CD4(+)T-cell activation and differentiation by modulating ERK activation and cAMP production.

    Science.gov (United States)

    Franz, Dafne; Contreras, Francisco; González, Hugo; Prado, Carolina; Elgueta, Daniela; Figueroa, Claudio; Pacheco, Rodrigo

    2015-07-15

    Dopamine receptors have been described in T-cells, however their signalling pathways coupled remain unknown. Since cAMP and ERKs play key roles regulating T-cell physiology, we aim to determine whether cAMP and ERK1/2-phosphorylation are modulated by dopamine receptor 3 (D3R) and D5R, and how this modulation affects CD4(+) T-cell activation and differentiation. Our pharmacologic and genetic evidence shows that D3R-stimulation reduced cAMP levels and ERK2-phosphorylation, consequently increasing CD4(+) T-cell activation and Th1-differentiation, respectively. Moreover, D5R expression reinforced TCR-triggered ERK1/2-phosphorylation and T-cell activation. In conclusion, these findings demonstrate how D3R and D5R modulate key signalling pathways affecting CD4(+) T-cell activation and Th1-differentiation. Copyright © 2015 Elsevier B.V. All rights reserved.

  19. Identifying nurses' rewards: a qualitative categorization study in Belgium

    Directory of Open Access Journals (Sweden)

    Du Bois Cindy

    2006-07-01

    Full Text Available Abstract Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher

  20. Social and monetary reward processing in autism spectrum disorders.

    Science.gov (United States)

    Delmonte, Sonja; Balsters, Joshua H; McGrath, Jane; Fitzgerald, Jacqueline; Brennan, Sean; Fagan, Andrew J; Gallagher, Louise

    2012-09-26

    Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. In line with social motivation theory, the ASD

  1. Memory Consolidation and Neural Substrate of Reward

    Directory of Open Access Journals (Sweden)

    Redolar-Ripoll, Diego

    2012-08-01

    Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.

  2. Incentive theory: IV. Magnitude of reward

    OpenAIRE

    Killeen, Peter R.

    1985-01-01

    Incentive theory is successfully applied to data from experiments in which the amount of food reward is varied. This is accomplished by assuming that incentive value is a negatively accelerated function of reward duration. The interaction of the magnitude of a reward with its delay is confirmed, and the causes and implications of this interaction are discussed.

  3. Integration of reward signalling and appetite regulating peptide systems in the control of food-cue responses.

    Science.gov (United States)

    Reichelt, A C; Westbrook, R F; Morris, M J

    2015-11-01

    Understanding the neurobiological substrates that encode learning about food-associated cues and how those signals are modulated is of great clinical importance especially in light of the worldwide obesity problem. Inappropriate or maladaptive responses to food-associated cues can promote over-consumption, leading to excessive energy intake and weight gain. Chronic exposure to foods rich in fat and sugar alters the reinforcing value of foods and weakens inhibitory neural control, triggering learned, but maladaptive, associations between environmental cues and food rewards. Thus, responses to food-associated cues can promote cravings and food-seeking by activating mesocorticolimbic dopamine neurocircuitry, and exert physiological effects including salivation. These responses may be analogous to the cravings experienced by abstaining drug addicts that can trigger relapse into drug self-administration. Preventing cue-triggered eating may therefore reduce the over-consumption seen in obesity and binge-eating disorder. In this review we discuss recent research examining how cues associated with palatable foods can promote reward-based feeding behaviours and the potential involvement of appetite-regulating peptides including leptin, ghrelin, orexin and melanin concentrating hormone. These peptide signals interface with mesolimbic dopaminergic regions including the ventral tegmental area to modulate reactivity to cues associated with palatable foods. Thus, a novel target for anti-obesity therapeutics is to reduce non-homeostatic, reward driven eating behaviour, which can be triggered by environmental cues associated with highly palatable, fat and sugar rich foods. © 2015 The British Pharmacological Society.

  4. Functional connectivity with ventromedial prefrontal cortex reflects subjective value for social rewards.

    Science.gov (United States)

    Smith, David V; Clithero, John A; Boltuck, Sarah E; Huettel, Scott A

    2014-12-01

    According to many studies, the ventromedial prefrontal cortex (VMPFC) encodes the subjective value of disparate rewards on a common scale. Yet, a host of other reward factors-likely represented outside of VMPFC-must be integrated to construct such signals for valuation. Using functional magnetic resonance imaging (fMRI), we tested whether the interactions between posterior VMPFC and functionally connected brain regions predict subjective value. During fMRI scanning, participants rated the attractiveness of unfamiliar faces. We found that activation in dorsal anterior cingulate cortex, anterior VMPFC and caudate increased with higher attractiveness ratings. Using data from a post-scan task in which participants spent money to view attractive faces, we quantified each individual's subjective value for attractiveness. We found that connectivity between posterior VMPFC and regions frequently modulated by social information-including the temporal-parietal junction (TPJ) and middle temporal gyrus-was correlated with individual differences in subjective value. Crucially, these additional regions explained unique variation in subjective value beyond that extracted from value regions alone. These findings indicate not only that posterior VMPFC interacts with additional brain regions during valuation, but also that these additional regions carry information employed to construct the subjective value for social reward. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  5. Contrasting effects of lithium chloride and CB1 receptor blockade on enduring changes in the valuation of reward.

    Directory of Open Access Journals (Sweden)

    Giovanni eHernandez

    2011-09-01

    Full Text Available When an organism has been trained to respond for a reward, its learned behavior can be characterized as goal-directed or habitual based on whether or not it is susceptible to reward devaluation. Here, we evaluated whether instrumental responding for brain stimulation reward (BSR can devalued using a paradigm traditionally used for natural rewards. Rats were trained to lever press for BSR. Subsequently, BSR was paired with either lithium chloride (LiCl, 5 mg/kg, i.p, a pro-emetic, or AM251, a CB1 receptor antagonist (3 mg/kg, i.p.. Pairings of BSR with these two compounds or their respective vehicle were performed in a novel environment so that only unconditional effects of BSR were affected by the pharmacological manipulations. Subsequently, in a probe test, all rats were returned in the drug-free state to the boxes where they had received training instrumental responding was reassessed in the absence of BSR delivery. LiCl produced enduring decreases in the number of responses during the test session, whereas AM251 had no effect. These results show that instrumental responding for BSR is susceptible to devaluation, in accord with the proposal that this behavior is supported at least in part by associations between the response and the rewarding outcome. Furthermore, they suggest that the reward modulation observed in studies involving the use of CB1 receptor antagonists arises from changes in the organism’s motivation rather than due to drug-induced changes in the intrinsic value of reward.

  6. Contrasting Effects of Lithium Chloride and CB1 Receptor Blockade on Enduring Changes in the Valuation of Reward.

    Science.gov (United States)

    Hernandez, Giovanni; Bernstein, David; Schoenbaum, Geoffrey; Cheer, Joseph F

    2011-01-01

    When an organism responds for a reward, its learned behavior can be characterized as goal-directed or habitual based on whether or not it is susceptible to reward devaluation. Here, we evaluated whether instrumental responding for brain stimulation reward (BSR) can be devalued using a paradigm traditionally used for natural rewards. Rats were trained to lever press for BSR; afterward, BSR was paired with either lithium chloride (LiCl, 5 mg/kg, i.p.), a pro-emetic, or AM251, a CB1 receptor antagonist (3 mg/kg, i.p.) or the vehicle of these compounds. Pairings of BSR with these compounds and their vehicles were performed in a novel environment so that only unconditional effects of BSR would be affected by the pharmacological manipulations. Subsequently, in a probe test, all rats were returned in the drug-free state to the boxes where they had received training and instrumental responding was reassessed in the absence of BSR delivery. When compared to control, LiCl produced a significant decrease in the number of responses during the test session, whereas AM251 did not. These results show that instrumental responding for BSR is susceptible to devaluation, in accord with the proposal that this behavior is supported at least in part by associations between the response and the rewarding outcome. Further, they suggest that reward modulation observed in studies involving the use of CB1 receptor antagonists arises from changes in the organism's motivation rather than drug-induced changes in the intrinsic value of reward.

  7. Impaired cross-talk between mesolimbic food reward processing and metabolic signaling predicts body mass index

    Directory of Open Access Journals (Sweden)

    Joe J Simon

    2014-10-01

    Full Text Available The anticipation of the pleasure derived from food intake drives the motivation to eat, and hence facilitate overconsumption of food which ultimately results in obesity. Brain imaging studies provide evidence that mesolimbic brain regions underlie both general as well as food related anticipatory reward processing. In light of this knowledge, the present study examined the neural responsiveness of the ventral striatum in participants with a broad BMI spectrum. The study differentiated between general (i.e. monetary and food related anticipatory reward processing. We recruited a sample of volunteers with greatly varying body weights, ranging from a low BMI (below 20 kg/m² over a normal (20 to 25 kg/m² and overweight (25 to 30 kg/m² BMI, to class I (30 to 35 kg/m² and class II (35 to 40 kg/m² obesity. A total of 24 participants underwent functional magnetic resonance imaging whilst performing both a food and monetary incentive delay task, which allows to measure neural activation during the anticipation of rewards. After the presentation of a cue indicating the amount of food or money to be won, participants had to react correctly in order to earn snack points or money coins which could then be exchanged for real food or money, respectively, at the end of the experiment. During the anticipation of both types of rewards, participants displayed activity in the ventral striatum, a region that plays a pivotal role in the anticipation of rewards. Additionally, we observed that specifically anticipatory food reward processing predicted the individual BMI (current and maximum lifetime. This relation was found to be mediated by impaired hormonal satiety signaling, i.e. increased leptin levels and insulin resistance. These findings suggest that heightened food reward motivation contributes to obesity through impaired metabolic signaling.

  8. A Simple Differential Modulation Scheme for Quasi-Orthogonal Space-Time Block Codes with Partial Transmit Diversity

    Directory of Open Access Journals (Sweden)

    Lingyang Song

    2007-04-01

    Full Text Available We report a simple differential modulation scheme for quasi-orthogonal space-time block codes. A new class of quasi-orthogonal coding structures that can provide partial transmit diversity is presented for various numbers of transmit antennas. Differential encoding and decoding can be simplified for differential Alamouti-like codes by grouping the signals in the transmitted matrix and decoupling the detection of data symbols, respectively. The new scheme can achieve constant amplitude of transmitted signals, and avoid signal constellation expansion; in addition it has a linear signal detector with very low complexity. Simulation results show that these partial-diversity codes can provide very useful results at low SNR for current communication systems. Extension to more than four transmit antennas is also considered.

  9. A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex.

    Science.gov (United States)

    Huertas, Marco A; Hussain Shuler, Marshall G; Shouval, Harel Z

    2015-09-16

    Many actions performed by animals and humans depend on an ability to learn, estimate, and produce temporal intervals of behavioral relevance. Exemplifying such learning of cued expectancies is the observation of reward-timing activity in the primary visual cortex (V1) of rodents, wherein neural responses to visual cues come to predict the time of future reward as behaviorally experienced in the past. These reward-timing responses exhibit significant heterogeneity in at least three qualitatively distinct classes: sustained increase or sustained decrease in firing rate until the time of expected reward, and a class of cells that reach a peak in firing at the expected delay. We elaborate upon our existing model by including inhibitory and excitatory units while imposing simple connectivity rules to demonstrate what role these inhibitory elements and the simple architectures play in sculpting the response dynamics of the network. We find that simply adding inhibition is not sufficient for obtaining the different distinct response classes, and that a broad distribution of inhibitory projections is necessary for obtaining peak-type responses. Furthermore, although changes in connection strength that modulate the effects of inhibition onto excitatory units have a strong impact on the firing rate profile of these peaked responses, the network exhibits robustness in its overall ability to predict the expected time of reward. Finally, we demonstrate how the magnitude of expected reward can be encoded at the expected delay in the network and how peaked responses express this reward expectancy. Heterogeneity in single-neuron responses is a common feature of neuronal systems, although sometimes, in theoretical approaches, it is treated as a nuisance and seldom considered as conveying a different aspect of a signal. In this study, we focus on the heterogeneous responses in the primary visual cortex of rodents trained with a predictable delayed reward time. We describe under what

  10. The Timing Effects of Reward, Business Longevity, and Involvement on Consumers’ Responses to a Reward Program

    Directory of Open Access Journals (Sweden)

    Badri Munir Sukoco

    2015-06-01

    Full Text Available Managers could elicit customers’ repeat purchase behavior through a well-designed reward program. This study examines two extrinsic cues - business longevity and timing effects of reward – to determine the consumers’ perceived risk and intention to participate in this kind of program. Moreover, this study discusses how different levels of involvement might interact with these two cues. An experiment with a 2 (business longevity: long vs. short x 2 (timing of reward: delayed vs. immediate x 2 (involvement: high vs. low between-subject factorial design is conducted to validate the proposed research hypotheses. The results show that an immediate reward offered by an older, more established, firm for a highly-involved product, make loyalty programs less risky and consequently attract consumers to participate. Interestingly, immediate rewards that are offered by older firms for a product that customers are less involved in has the opposite effects. Managerial and academic implications are further presented in this study.

  11. Stingless bees (Melipona scutellaris) learn to associate footprint cues at food sources with a specific reward context.

    Science.gov (United States)

    Roselino, Ana Carolina; Rodrigues, André Vieira; Hrncir, Michael

    2016-10-01

    Foraging insects leave chemical footprints on flowers that subsequent foragers may use as indicators for recent flower visits and, thus, potential resource depletion. Accordingly, foragers should reject food sources presenting these chemical cues. Contrasting this assumption, experimental studies in stingless bees (Apidae, Meliponini), so far, demonstrated an attractive effect of footprints. These findings lead to doubts about the meaning of these chemical cues in natural foraging contexts. Here, we asked whether foragers of stingless bees (Melipona scutellaris) use footprints according to the previously experienced reward level of visited food sources. Bees were trained to artificial flower patches, at which the reward of a flower either decreased or, alternatively, increased after a visit by a forager. Individuals were allowed a total of nine foraging bouts to the patch, after which their preference for visited or unvisited flowers was tested. In the choice tests, bees trained under the decreasing reward context preferred unvisited flowers, whereas individuals trained under the increasing reward context preferred visited flowers. Foragers without experience chose randomly between visited and unvisited flowers. These results demonstrate that M. scutellaris learns to associate unspecific footprint cues at food sources with differential, specific reward contexts, and uses these chemical cues accordingly for their foraging decisions.

  12. Reward Circuitry in Addiction.

    Science.gov (United States)

    Cooper, Sarah; Robison, A J; Mazei-Robison, Michelle S

    2017-07-01

    Understanding the brain circuitry that underlies reward is critical to improve treatment for many common health issues, including obesity, depression, and addiction. Here we focus on insights into the organization and function of reward circuitry and its synaptic and structural adaptations in response to cocaine exposure. While the importance of certain circuits, such as the mesocorticolimbic dopamine pathway, are well established in drug reward, recent studies using genetics-based tools have revealed functional changes throughout the reward circuitry that contribute to different facets of addiction, such as relapse and craving. The ability to observe and manipulate neuronal activity within specific cell types and circuits has led to new insight into not only the basic connections between brain regions, but also the molecular changes within these specific microcircuits, such as neurotrophic factor and GTPase signaling or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor function, that underlie synaptic and structural plasticity evoked by drugs of abuse. Excitingly, these insights from preclinical rodent work are now being translated into the clinic, where transcranial magnetic simulation and deep brain stimulation therapies are being piloted in human cocaine dependence. Thus, this review seeks to summarize current understanding of the major brain regions implicated in drug-related behaviors and the molecular mechanisms that contribute to altered connectivity between these regions, with the postulation that increased knowledge of the plasticity within the drug reward circuit will lead to new and improved treatments for addiction.

  13. Differential effects of fructose versus glucose on brain and appetitive responses to food cues and decisions for food rewards.

    Science.gov (United States)

    Luo, Shan; Monterosso, John R; Sarpelleh, Kayan; Page, Kathleen A

    2015-05-19

    Prior studies suggest that fructose compared with glucose may be a weaker suppressor of appetite, and neuroimaging research shows that food cues trigger greater brain reward responses in a fasted relative to a fed state. We sought to determine the effects of ingesting fructose versus glucose on brain, hormone, and appetitive responses to food cues and food-approach behavior. Twenty-four healthy volunteers underwent two functional magnetic resonance imaging (fMRI) sessions with ingestion of either fructose or glucose in a double-blinded, random-order cross-over design. fMRI was performed while participants viewed images of high-calorie foods and nonfood items using a block design. After each block, participants rated hunger and desire for food. Participants also performed a decision task in which they chose between immediate food rewards and delayed monetary bonuses. Hormones were measured at baseline and 30 and 60 min after drink ingestion. Ingestion of fructose relative to glucose resulted in smaller increases in plasma insulin levels and greater brain reactivity to food cues in the visual cortex (in whole-brain analysis) and left orbital frontal cortex (in region-of-interest analysis). Parallel to the neuroimaging findings, fructose versus glucose led to greater hunger and desire for food and a greater willingness to give up long-term monetary rewards to obtain immediate high-calorie foods. These findings suggest that ingestion of fructose relative to glucose results in greater activation of brain regions involved in attention and reward processing and may promote feeding behavior.

  14. Comparison of Caffeine and d-amphetamine in Cocaine-Dependent Subjects: Differential Outcomes on Subjective and Cardiovascular Effects, Reward Learning, and Salivary Paraxanthine.

    Science.gov (United States)

    Lane, Scott D; Green, Charles E; Schmitz, Joy M; Rathnayaka, Nuvan; Fang, Wendy B; Ferré, Sergi; Moeller, F Gerard

    2014-01-01

    Due to indirect modulation of dopamine transmission, adenosine receptor antagonists may be useful in either treating cocaine use or improving disrupted cognitive-behavioral functions associated with chronic cocaine use. To compare and contrast the stimulant effects of adenosine antagonism to direct dopamine stimulation, we administered 150 mg and 300 mg caffeine, 20 mg amphetamine, and placebo to cocaine-dependent vs. healthy control subjects, matched on moderate caffeine use. Data were obtained on measures of cardiovascular effects, subjective drug effects (ARCI, VAS, DEQ), and a probabilistic reward-learning task sensitive to dopamine modulation. Levels of salivary caffeine and the primary caffeine metabolite paraxanthine were obtained on placebo and caffeine dosing days. Cardiovascular results revealed main effects of dose for diastolic blood pressure and heart rate; follow up tests showed that controls were most sensitive to 300 mg caffeine and 20 mg amphetamine; cocaine-dependent subjects were sensitive only to 300 mg caffeine. Subjective effects results revealed dose × time and dose × group interactions on the ARCI A, ARCI LSD, and VAS 'elated' scales; follow up tests did not show systematic differences between groups with regard to caffeine or d-amphetamine. Large between-group differences in salivary paraxanthine (but not salivary caffeine) levels were obtained under both caffeine doses. The cocaine-dependent group expressed significantly higher paraxanthine levels than controls under 150 mg and 3-4 fold greater levels under 300 mg at 90 min and 150 min post caffeine dose. However, these differences also covaried with cigarette smoking status (not balanced between groups), and nicotine smoking is known to alter caffeine/paraxanthine metabolism via cytochrome P450 enzymes. These preliminary data raise the possibility that adenosine antagonists may affect cocaine-dependent and non-dependent subjects differently. In conjunction with previous preclinical and

  15. Sensitivity to Temporal Reward Structure in Amygdala Neurons

    OpenAIRE

    Bermudez, Maria A.; Göbel, Carl; Schultz, Wolfram

    2012-01-01

    Summary The time of reward and the temporal structure of reward occurrence fundamentally influence behavioral reinforcement and decision processes [1–11]. However, despite knowledge about timing in sensory and motor systems [12–17], we know little about temporal mechanisms of neuronal reward processing. In this experiment, visual stimuli predicted different instantaneous probabilities of reward occurrence that resulted in specific temporal reward structures. Licking behavior demonstrated that...

  16. Reward sensitivity and food addiction in women.

    Science.gov (United States)

    Loxton, Natalie J; Tipman, Renée J

    2017-08-01

    Sensitivity to the rewarding properties of appetitive substances has long been implicated in excessive consumption of palatable foods and drugs of abuse. Previous research focusing on individual differences in reward responsiveness has found heightened trait reward sensitivity to be associated with binge-eating, hazardous drinking, and illicit substance use. Food addiction has been proposed as an extreme form of compulsive-overeating and has been associated with genetic markers of heightened reward responsiveness. However, little research has explicitly examined the association between reward sensitivity and food addiction. Further, the processes by which individual differences in this trait are associated with excessive over-consumption has not been determined. A total of 374 women from the community completed an online questionnaire assessing reward sensitivity, food addiction, emotional, externally-driven, and hedonic eating. High reward sensitivity was significantly associated with greater food addiction symptoms (r = 0.31). Bootstrapped tests of indirect effects found the relationship between reward sensitivity and food addiction symptom count to be uniquely mediated by binge-eating, emotional eating, and hedonic eating (notably, food availability). These indirect effects held even when controlling for BMI, anxiety, depression, and trait impulsivity. This study further supports the argument that high levels of reward sensitivity may offer a trait marker of vulnerability to excessive over-eating, beyond negative affect and impulse-control deficits. That the hedonic properties of food (especially food availability), emotional, and binge-eating behavior act as unique mediators suggest that interventions for reward-sensitive women presenting with food addiction may benefit from targeting food availability in addition to management of negative affect. Copyright © 2016 Elsevier Ltd. All rights reserved.

  17. Video game training and the reward system.

    Science.gov (United States)

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  18. Differential mesolimbic and prefrontal alterations during reward anticipation and consummation in positive and negative schizotypy.

    Science.gov (United States)

    Yan, Chao; Wang, Yi; Su, Li; Xu, Ting; Yin, Da-Zhi; Fan, Ming-Xia; Deng, Ci-Ping; Wang, Zhao-Xin; Lui, Simon S Y; Cheung, Eric F C; Chan, Raymond C K

    2016-08-30

    Schizotypy is associated with anhedonia. However, previous findings on the neural substrates of anhedonia in schizotypy are mixed. In the present study, we measured the neural substrates associated with reward anticipation and consummation in positive and negative schizotypy using functional MRI. The Monetary Incentive Delay task was administered to 33 individuals with schizotypy (18 positive schizotypy (PS),15 negative schizotypy (NS)) and 22 healthy controls. Comparison between schizotypy individuals and controls were performed using two-sample T tests for contrast images involving gain versus non-gain anticipation condition and gain versus non-gain consummation condition. Multiple comparisons were corrected using Monte Carlo Simulation correction of panticipation or consummation. However, during the consummatory phase, NS individuals rather than PS individuals showed diminished left amygdala and left putamen activity compared with controls. We observed significantly weaker activation at the left ventral striatum during gain anticipation in NS individuals compared with controls. PS individuals, however, exhibited enhanced right ventral lateral prefrontal activity. These findings suggest that different dimensions of schizotypy may be underlied by different neural dysfunctions in reward anticipation and consummation. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  19. Decision making in the reward and punishment variants of the Iowa gambling task: Evidence of foresight or framing?

    Directory of Open Access Journals (Sweden)

    Varsha eSingh

    2012-07-01

    Full Text Available Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160. It was contended that risk-aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment, the order in which the frame was triggered (order type: reward–punishment or punishment–reward, and the four types of instructions that delineated motivation towards reward from that of punishment (reward, punishment, reward and punishment, and no-hint were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p < 0.001. The order in which a variant was presented, and the type of the instructions that were used both had an effect on long-term decision making in the two IGT variants (p < 0.05. A post hoc test suggested that the instructions that differentiated between reward and punishment resulted in greater foresight than the commonly used IGT instructions that fail to distinguish between reward and punishment. As observed in previous studies, there were more number of participants (60% who showed greater foresight in the punishment variant than in the reward variant (p< 0.001. The results suggest that foresight in IGT decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision-making framework. Benefits of integrating findings from behavioral studies

  20. Video game training and the reward system

    OpenAIRE

    Lorenz, R.; Gleich, T.; Gallinat, J.; Kühn, S.

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors ...

  1. Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward.

    Directory of Open Access Journals (Sweden)

    Joachim T Geaney

    Full Text Available Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS, a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment. In a university community sample (N = 97, we examined the TEPS subscales as predictors of (1 the willingness to expend effort for monetary rewards, and (2 affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale.

  2. Reward-dependent learning in neuronal networks for planning and decision making.

    Science.gov (United States)

    Dehaene, S; Changeux, J P

    2000-01-01

    gives access to enhanced rates of learning via an elementary process of internal or covert mental simulation. We have recently applied these ideas to a new model, developed with M. Kerszberg, which hypothesizes that prefrontal cortex and its reward-related connections contribute crucially to conscious effortful tasks. This model distinguishes two main computational spaces within the human brain: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative and attentional processors. We postulate that workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice; they selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously co-activated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. This model makes predictions concerning the spatio-temporal activation patterns during brain imaging of cognitive tasks, particularly concerning the conditions of activation of dorsolateral prefrontal cortex and anterior cingulate, their relation to reward mechanisms, and their specific reaction during error processing.

  3. Facilitation of voluntary goal-directed action by reward cues.

    Science.gov (United States)

    Lovibond, Peter F; Colagiuri, Ben

    2013-10-01

    Reward-associated cues are known to influence motivation to approach both natural and man-made rewards, such as food and drugs. However, the mechanisms underlying these effects are not well understood. To model these processes in the laboratory with humans, we developed an appetitive Pavlovian-instrumental transfer procedure with a chocolate reward. We used a single unconstrained response that led to an actual rather than symbolic reward to assess the strength of reward motivation. Presentation of a chocolate-paired cue, but not an unpaired cue, markedly enhanced instrumental responding over a 30-s period. The same pattern was observed with 10-s and 30-s cues, showing that close cue-reward contiguity is not necessary for facilitation of reward-directed action. The results confirm that reward-related cues can instigate voluntary action to obtain that reward. The effectiveness of long-duration cues suggests that in clinical settings, attention should be directed to both proximal and distal cues for reward.

  4. Touch massage, a rewarding experience.

    Science.gov (United States)

    Lindgren, Lenita; Jacobsson, Maritha; Lämås, Kristina

    2014-12-01

    This study aims to describe and analyze healthy individuals' expressed experiences of touch massage (TM). Fifteen healthy participants received whole body touch massage during 60 minutes for two separate occasions. Interviews were analyzed by narrative analysis. Four identifiable storyline was found, Touch massage as an essential need, in this storyline the participants talked about a desire and need for human touch and TM. Another storyline was about, Touch massage as a pleasurable experience and the participants talked about the pleasure of having had TM. In the third storyline Touch massage as a dynamic experience, the informants talked about things that could modulate the experience of receiving TM. In the last storyline, Touch massage influences self-awareness, the participants described how TM affected some of their psychological and physical experiences. Experiences of touch massage was in general described as pleasant sensations and the different storylines could be seen in the light of rewarding experiences. © The Author(s) 2014.

  5. Learning Reward Uncertainty in the Basal Ganglia.

    Directory of Open Access Journals (Sweden)

    John G Mikhael

    2016-09-01

    Full Text Available Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid options with variable reward can be controlled by increasing (or decreasing the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions.

  6. Rewards and advancements for clinical pharmacists.

    Science.gov (United States)

    Goodwin, S Diane; Kane-Gill, Sandra L; Ng, Tien M H; Melroy, Joel T; Hess, Mary M; Tallian, Kimberly; Trujillo, Toby C; Vermeulen, Lee C

    2010-01-01

    The American College of Clinical Pharmacy charged the Clinical Practice Affairs Committee to review and update the College's 1995 White Paper, "Rewards and Advancements for Clinical Pharmacy Practitioners." Because of the limited data on the present state of rewards and advancements for clinical pharmacists, an online survey of "front-line" clinical pharmacists and pharmacy managers was conducted (1126 total respondents, 14% response rate). The resulting White Paper discusses motivators and existing systems of rewards and advancements for clinical pharmacists, as well as perceived barriers to implementation of these systems. Clinical pharmacists reported work-life balance, a challenging position, and opportunities for professional advancement as the most important factors for career success. At the time of the survey, financial rewards appeared not to be a major motivator for clinical pharmacists. Managers underestimated the importance that clinical pharmacists place on work-life balance and favorable work schedules. Although almost two thirds of the clinical pharmacists surveyed had not developed a professional development plan, 84% indicated an interest in career planning. Both clinical pharmacists and managers rated the lack of a clear reward and advancement structure as the most important barrier to effective systems of rewards and advancements. Pharmacy managers and administrators are encouraged to develop effective systems of rewards and advancements for clinical pharmacists that positively impact patient care and the institution's mission; these systems will benefit the clinical pharmacist, the health care institution, and the patient.

  7. The risk variant in ODZ4 for bipolar disorder impacts on amygdala activation during reward processing.

    Science.gov (United States)

    Heinrich, Angela; Lourdusamy, Anbarasu; Tzschoppe, Jelka; Vollstädt-Klein, Sabine; Bühler, Mira; Steiner, Sabina; Bach, Christiane; Poustka, Luise; Banaschewski, Tobias; Barker, Gareth; Büchel, Christian; Conrod, Patricia; Garavan, Hugh; Gallinat, Jürgen; Heinz, Andreas; Ittermann, Bernd; Loth, Eva; Mann, Karl; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Smolka, Michael; Ströhle, Andreas; Struve, Maren; Witt, Stephanie; Flor, Herta; Schumann, Gunter; Rietschel, Marcella; Nees, Frauke

    2013-06-01

    Bipolar disorder is a severe mood disorder, which normally begins during adolescence or early adulthood and has a heritability of up to 80%. The largest genome-wide association analysis of bipolar disorder recently identified a new genome-wide associated variant in OZD4 (rs12576775). The aim of the present study was to further elucidate the role of this risk variant in the disease process using an imaging genetics approach. As increased amygdala and striatal responses during the processing of reward and emotion are characteristic for bipolar disorder patients, it was tested whether the risk variant has an influence on this endophenotype in healthy adolescents. We examined the impact of the risk variant rs12576775 on functional magnetic resonance imaging data in an adolescent sample (N = 485). Differential activation between carriers of the risk allele (G-allele) and homozygous A-allele carriers in the amygdala and the striatum during a modification of the monetary incentive delay task (examining reward) and a face task (examining emotion) was analyzed. Carriers of the risk allele showed an increased blood oxygen level-dependent response in the amygdala during reward sensitivity (p = 0.05) and reward expectation (p < 0.05) but not during the face task. No significant group differences were found in the striatum during both reward and emotion processing. Our results indicate that the ODZ4 risk variant influences reward processing in the amygdala. Alterations in the processing of emotion may have different underlying mechanisms and need to be further examined. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

  8. Model Checking Multivariate State Rewards

    DEFF Research Database (Denmark)

    Nielsen, Bo Friis; Nielson, Flemming; Nielson, Hanne Riis

    2010-01-01

    We consider continuous stochastic logics with state rewards that are interpreted over continuous time Markov chains. We show how results from multivariate phase type distributions can be used to obtain higher-order moments for multivariate state rewards (including covariance). We also generalise...

  9. Self-rewards and personal motivation

    DEFF Research Database (Denmark)

    Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

    2014-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool...

  10. Self-Rewards and Personal Motivation

    DEFF Research Database (Denmark)

    Koch, Alexander Karl; Nafziger, Julia; Suvorov, Anton

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool...

  11. Self-rewards and personal motivation

    NARCIS (Netherlands)

    Koch, A.K.; Nafziger, J.; Suvorov, A.; van de Ven, J.

    2014-01-01

    Self-administered rewards are ubiquitous. They serve as incentives for personal accomplishments and are widely recommended to increase personal motivation. We show that in a model with time-inconsistent and reference-dependent preferences, self-rewards can be a credible and effective tool to

  12. Video Game Training and the Reward System

    Directory of Open Access Journals (Sweden)

    Robert C. Lorenz

    2015-02-01

    Full Text Available Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual towards playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training.Fifty healthy participants were randomly assigned to a video game training (TG or control group (CG. Before and after training/control period, functional magnetic resonance imaging (fMRI was conducted using a non-video game related reward task.At pretest, both groups showed strongest activation in ventral striatum (VS during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated.This longitudinal study revealed that video game training may preserve reward responsiveness in the ventral striatum in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  13. Video game training and the reward system

    Science.gov (United States)

    Lorenz, Robert C.; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

  14. Reward disrupts reactivated human skill memory.

    Science.gov (United States)

    Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

    2016-06-16

    Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing reactivated memories did not strengthen the memory, but rather led to disruption of the memory trace, breaking down the link between memory reactivation and subsequent memory strength. Statistical modeling further revealed a strong mediating role for memory reactivation in linking between memory encoding and subsequent memory strength only when the memory was replayed without reinforcement. We suggest that, rather than reinforcing the existing memory trace, reward creates a competing memory trace, impairing expression of the original reward-free memory. This mechanism sheds light on the processes underlying skill acquisition, having wide translational implications.

  15. Community-based faculty: motivation and rewards.

    Science.gov (United States)

    Fulkerson, P K; Wang-Cheng, R

    1997-02-01

    The reasons why practicing physicians precept students in their offices, and the rewards they wish to receive for this work, have not been clearly elucidated. This study determined the reasons for precepting and the rewards expected among a network of preceptors in Milwaukee. A questionnaire was mailed to 120 community-based physician preceptors in a required, third-year ambulatory care clerkship. Respondents were asked to identify why they volunteered and what they considered appropriate recognition or reward. The personal satisfaction derived from the student-teacher interaction was, by far, the most important motivator for preceptors (84%). The most preferred rewards for teaching included clinical faculty appointment, CME and bookstore discounts, computer networking, and workshops for improving skills in clinical teaching. Community-based private physicians who participate in medical student education programs are primarily motivated by the personal satisfaction that they derive from the teaching encounter. An effective preceptor recognition/reward program can be developed using input from the preceptors themselves.

  16. Acute D3 Antagonist GSK598809 Selectively Enhances Neural Response During Monetary Reward Anticipation in Drug and Alcohol Dependence

    Science.gov (United States)

    Murphy, Anna; Nestor, Liam J; McGonigle, John; Paterson, Louise; Boyapati, Venkataramana; Ersche, Karen D; Flechais, Remy; Kuchibatla, Shankar; Metastasio, Antonio; Orban, Csaba; Passetti, Filippo; Reed, Laurence; Smith, Dana; Suckling, John; Taylor, Eleanor; Robbins, Trevor W; Lingford-Hughes, Anne; Nutt, David J; Deakin, John FW; Elliott, Rebecca

    2017-01-01

    Evidence suggests that disturbances in neurobiological mechanisms of reward and inhibitory control maintain addiction and provoke relapse during abstinence. Abnormalities within the dopamine system may contribute to these disturbances and pharmacologically targeting the D3 dopamine receptor (DRD3) is therefore of significant clinical interest. We used functional magnetic resonance imaging to investigate the acute effects of the DRD3 antagonist GSK598809 on anticipatory reward processing, using the monetary incentive delay task (MIDT), and response inhibition using the Go/No-Go task (GNGT). A double-blind, placebo-controlled, crossover design approach was used in abstinent alcohol dependent, abstinent poly-drug dependent and healthy control volunteers. For the MIDT, there was evidence of blunted ventral striatal response to reward in the poly-drug-dependent group under placebo. GSK598809 normalized ventral striatal reward response and enhanced response in the DRD3-rich regions of the ventral pallidum and substantia nigra. Exploratory investigations suggested that the effects of GSK598809 were mainly driven by those with primary dependence on alcohol but not on opiates. Taken together, these findings suggest that GSK598809 may remediate reward deficits in substance dependence. For the GNGT, enhanced response in the inferior frontal cortex of the poly-drug group was found. However, there were no effects of GSK598809 on the neural network underlying response inhibition nor were there any behavioral drug effects on response inhibition. GSK598809 modulated the neural network underlying reward anticipation but not response inhibition, suggesting that DRD3 antagonists may restore reward deficits in addiction. PMID:28042871

  17. Intersection of reward and memory in monkey rhinal cortex.

    Science.gov (United States)

    Clark, Andrew M; Bouret, Sebastien; Young, Adrienne M; Richmond, Barry J

    2012-05-16

    In humans and other animals, the vigor with which a reward is pursued depends on its desirability, that is, on the reward's predicted value. Predicted value is generally context-dependent, varying according to the value of rewards obtained in the recent and distant past. Signals related to reward prediction and valuation are believed to be encoded in a circuit centered around midbrain dopamine neurons and their targets in the prefrontal cortex and basal ganglia. Notably absent from this hypothesized reward pathway are dopaminergic targets in the medial temporal lobe. Here we show that a key part of the medial temporal lobe memory system previously reported to be important for sensory mnemonic and perceptual processing, the rhinal cortex (Rh), is required for using memories of previous reward values to predict the value of forthcoming rewards. We tested monkeys with bilateral Rh lesions on a task in which reward size varied across blocks of uncued trials. In this experiment, the only cues for predicting current reward value are the sizes of rewards delivered in previous blocks. Unexpectedly, monkeys with Rh ablations, but not intact controls, were insensitive to differences in predicted reward, responding as if they expected all rewards to be of equal magnitude. Thus, it appears that Rh is critical for using memory of previous rewards to predict the value of forthcoming rewards. These results are in agreement with accumulating evidence that Rh is critical for establishing the relationships between temporally interleaved events, which is a key element of episodic memory.

  18. Putting the brakes on the "drive to eat": Pilot effects of naltrexone and reward based eating on food cravings among obese women

    Science.gov (United States)

    Mason, Ashley E.; Laraia, Barbara; Daubenmier, Jennifer; Hecht, Frederick M.; Lustig, Robert H.; Puterman, Eli; Adler, Nancy; Dallman, Mary; Kiernan, Michaela; Gearhardt, Ashley N.; Epel, Elissa S.

    2015-01-01

    Purpose Obese individuals vary in their experience of food cravings and tendency to engage in reward-driven eating, both of which can be modulated by the neural reward system rather than physiological hunger. We examined two predictions in a sample of obese women: (1) whether opioidergic blockade reduced food-craving intensity, and (2) whether opioidergic blockade reduced an association between food-craving intensity and reward-driven eating, which is a trait-like index of three factors (lack of control over eating, lack of satiation, preoccupation with food). Methods Forty-four obese, pre-menopausal women completed the Reward-based Eating Drive (RED) scale at study start and daily food-craving intensity on 5 days on which they ingested either a pill-placebo (2 days), a 25mg naltrexone dose (1 day), or a standard 50mg naltrexone dose (2 days). Results Craving intensity was similar under naltrexone and placebo doses. The association between food-craving intensity and reward-driven eating significantly differed between placebo and 50mg naltrexone doses. Reward-driven eating and craving intensity were significantly positively associated under both placebo doses. As predicted, opioidergic blockade (for both doses 25mg and 50mg naltrexone) reduced this positive association between reward-driven eating and craving intensity to non-significance. Conclusions Opioidergic blockade did not reduce craving intensity; however, blockade reduced an association between trait-like reward-driven eating and daily food-craving intensity, and may help identify an important endophenotype within obesity. PMID:26164674

  19. Distinct Motivational Effects of Contingent and Noncontingent Rewards.

    Science.gov (United States)

    Manohar, Sanjay G; Finzi, Rebecca Dawn; Drew, Daniel; Husain, Masud

    2017-07-01

    When rewards are available, people expend more energy, increasing their motivational vigor. In theory, incentives might drive behavior for two distinct reasons: First, they increase expected reward; second, they increase the difference in subjective value between successful and unsuccessful performance, which increases contingency-the degree to which action determines outcome. Previous studies of motivational vigor have never compared these directly. Here, we indexed motivational vigor by measuring the speed of eye movements toward a target after participants heard a cue indicating how outcomes would be determined. Eye movements were faster when the cue indicated that monetary rewards would be contingent on performance than when the cue indicated that rewards would be random. But even when the cue indicated that a reward was guaranteed regardless of speed, movement was still faster than when no reward was available. Motivation by contingent and certain rewards was uncorrelated across individuals, which suggests that there are two separable, independent components of motivation. Contingent motivation generated autonomic arousal, and unlike noncontingent motivation, was effective with penalties as well as rewards.

  20. Reduced reward-related neural response to mimicry in individuals with autism.

    Science.gov (United States)

    Hsu, Chun-Ting; Neufeld, Janina; Chakrabarti, Bhismadev

    2018-03-01

    Mimicry is a facilitator of social bonds in humans, from infancy. This facilitation is made possible through changing the reward value of social stimuli; for example, we like and affiliate more with people who mimic us. Autism spectrum disorders (ASD) are marked by difficulties in forming social bonds. In this study, we investigate whether the reward-related neural response to being mimicked is altered in individuals with ASD, using a simple conditioning paradigm. Multiple studies in humans and nonhuman primates have established a crucial role for the ventral striatal (VS) region in responding to rewards. In this study, adults with ASD and matched controls first underwent a conditioning task outside the scanner, where they were mimicked by one face and 'anti-mimicked' by another. In the second part, participants passively viewed the conditioned faces in a 3T MRI scanner using a multi-echo sequence. The differential neural response towards mimicking vs. anti-mimicking faces in the VS was tested for group differences as well as an association with self-reported autistic traits. Multiple regression analysis revealed lower left VS response to mimicry (mimicking > anti-mimicking faces) in the ASD group compared to controls. The VS response to mimicry was negatively correlated with autistic traits across the whole sample. Our results suggest that for individuals with ASD and high autistic traits, being mimicked is associated with lower reward-related neural response. This result points to a potential mechanism underlying the difficulties reported by many of individuals with ASD in building social rapport. © 2017 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

  1. M19 modulates skeletal muscle differentiation and insulin secretion in pancreatic β-cells through modulation of respiratory chain activity.

    Directory of Open Access Journals (Sweden)

    Linda Cambier

    Full Text Available Mitochondrial dysfunction due to nuclear or mitochondrial DNA alterations contributes to multiple diseases such as metabolic myopathies, neurodegenerative disorders, diabetes and cancer. Nevertheless, to date, only half of the estimated 1,500 mitochondrial proteins has been identified, and the function of most of these proteins remains to be determined. Here, we characterize the function of M19, a novel mitochondrial nucleoid protein, in muscle and pancreatic β-cells. We have identified a 13-long amino acid sequence located at the N-terminus of M19 that targets the protein to mitochondria. Furthermore, using RNA interference and over-expression strategies, we demonstrate that M19 modulates mitochondrial oxygen consumption and ATP production, and could therefore regulate the respiratory chain activity. In an effort to determine whether M19 could play a role in the regulation of various cell activities, we show that this nucleoid protein, probably through its modulation of mitochondrial ATP production, acts on late muscle differentiation in myogenic C2C12 cells, and plays a permissive role on insulin secretion under basal glucose conditions in INS-1 pancreatic β-cells. Our results are therefore establishing a functional link between a mitochondrial nucleoid protein and the modulation of respiratory chain activities leading to the regulation of major cellular processes such as myogenesis and insulin secretion.

  2. Mechanisms of impulsive choice: III. The role of reward processes

    Science.gov (United States)

    Marshall, Andrew T.

    2015-01-01

    Two experiments examined the relationship between reward processing and impulsive choice. In Experiment 1, rats chose between a smaller-sooner (SS) reward (1 pellet, 10 s) and a larger-later (LL) reward (1, 2, and 4 pellets, 30 s). The rats then experienced concurrent variable-interval 30-s schedules with variations in reward magnitude to evaluate reward magnitude discrimination. LL choice behavior positively correlated with reward magnitude discrimination. In Experiment 2, rats chose between an SS reward (1 pellet, 10 s) and an LL reward (2 and 4 pellets, 30 s). The rats then received either a reward intervention which consisted of concurrent fixed-ratio schedules associated with different magnitudes to improve their reward magnitude discrimination, or a control task. All rats then experienced a post-intervention impulsive choice task followed by a reward magnitude discrimination task to assess intervention efficacy. The rats that received the intervention exhibited increases in post-intervention LL choice behavior, and made more responses for larger-reward magnitudes in the reward magnitude discrimination task, suggesting that the intervention heightened sensitivities to reward magnitude. The results suggest that reward magnitude discrimination plays a key role in individual differences in impulsive choice, and could be a potential target for further intervention developments. PMID:26506254

  3. Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

    Directory of Open Access Journals (Sweden)

    Daniel Charles Castro

    2015-06-01

    Full Text Available The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc and ventral pallidum (VP, in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (‘liking’ and motivational incentive salience (‘wanting’ of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating versus intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including ‘liking’ and ‘wanting’ for food rewards.

  4. Validation and extension of the reward-mountain model.

    Science.gov (United States)

    Breton, Yannick-André; Mullett, Ada; Conover, Kent; Shizgal, Peter

    2013-01-01

    The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: (1) altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and (2) this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

  5. Informationally administered reward enhances intrinsic motivation in schizophrenia.

    Science.gov (United States)

    Lee, Hyeon-Seung; Jang, Seon-Kyeong; Lee, Ga-Young; Park, Seon-Cheol; Medalia, Alice; Choi, Kee-Hong

    2017-10-01

    Even when individuals with schizophrenia have an intact ability to enjoy rewarding moments, the means to assist them to translate rewarding experiences into goal-directed behaviors is unclear. The present study sought to determine whether informationally administered rewards enhance intrinsic motivation to foster goal-directed behaviors in individuals with schizophrenia (SZ) and healthy controls (HCs). Eighty-four participants (SZ=43, HCs=41) were randomly assigned to conditions involving either a performance-contingent reward with an informationally administered reward or a task-contingent reward with no feedback. Participants were asked to play two cognitive games of equalized difficulty. Accuracy, self-reported intrinsic motivation, free-choice intrinsic motivation (i.e., game play during a free-choice observation period), and perceived competency were measured. Intrinsic motivation and perceived competency in the cognitive games were similar between the two participant groups. The informationally administered reward significantly enhanced self-reported intrinsic motivation and perceived competency in both the groups. The likelihood that individuals with schizophrenia would play the game during the free-choice observation period was four times greater in the informationally administered reward condition than that in the no-feedback condition. Our findings suggest that, in the context of cognitive remediation, individuals with schizophrenia would benefit from informationally administered rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

  6. Study of gamma irradiated polyethylenes by temperature modulated differential scanning calorimetry

    International Nuclear Information System (INIS)

    Secerov, B.; Galovic, S.; Trifunovic, S.; Milicevic, D.; Suljovrujic, E.

    2011-01-01

    Complete text of publication follows. The various polyethylenes (PEs) and effects of high energy radiation on theirs structures were widely studied in the past using conventional Differential Scanning Calorimetry (DSC) measurements. In this work, we applied the Temperature Modulated Differential Scanning Calorimetry (TMDSC) technique in order to obtain more information about the influence of initial structural differences and gamma radiation on the evolution in structure and thermal properties of different polyethylenes. For this reason, low density polyethylene (LDPE), linear low density polyethylene (LLDPE) and high density polyethylene (HDPE) samples were exposed to gamma radiation, in air, to a wide range of absorbed doses (up to 2400 kGy). The separation of the total heat flow TMDSC signal into a reversing and nonreversing part enabled to observed the low temperature enthalpy relaxation (related to the existence of the 'rigid amorphous phase') and recrystallization processes as well as to follow their and/or radiation-induced evolution of melting in a more revealing manner compared to the case of the conventional DSC. Consequently, our results indicate that TMDSC could improve the understanding of radiation-induced effects in polymers.

  7. Characterization of the phase transformations in shape-memory alloys by modulated differential scanning calorimetry

    International Nuclear Information System (INIS)

    Wei, Z.G.; Sandstroem, R.

    1999-01-01

    Modulated differential scanning calorimetry (MDSC) is a recently developed calorimetric technique, which has demonstrated some significant advantages over the conventional differential scanning calorimetry (DSC). By separating the reversing quantity from the non-reversing component in the total thermal events, it provides some new information that can not be obtained from the conventional DSC. The technique has been applied to various polycrystalline and single crystalline shape-memory alloys, including Cu-Zn-Al, Cu-Al-Ni, Ti-Ni(Cu), Ni-Mn-Ga and Fe-Mn-Si, to characterize the martensitic transformations, bainitic transformation, chemical and magnetic ordering transitions, atomic reordering and other kinetic relaxation processes in the alloys. The preliminary results of the MDSC measurements are summarized and the interpretation of the MDSC results and some factors affecting the results are discussed. (orig.)

  8. Basolateral amygdala lesions abolish mutual reward preferences in rats.

    Science.gov (United States)

    Hernandez-Lallement, Julen; van Wingerden, Marijn; Schäble, Sandra; Kalenscher, Tobias

    2016-01-01

    In a recent study, we demonstrated that rats prefer mutual rewards in a Prosocial Choice Task. Here, employing the same task, we show that the integrity of basolateral amygdala was necessary for the expression of mutual reward preferences. Actor rats received bilateral excitotoxic (n=12) or sham lesions (n=10) targeting the basolateral amygdala and were subsequently tested in a Prosocial Choice Task where they could decide between rewarding ("Both Reward") or not rewarding a partner rat ("Own Reward"), either choice yielding identical reward to the actors themselves. To manipulate the social context and control for secondary reinforcement sources, actor rats were paired with either a partner rat (partner condition) or with an inanimate rat toy (toy condition). Sham-operated animals revealed a significant preference for the Both-Reward-option in the partner condition, but not in the toy condition. Amygdala-lesioned animals exhibited significantly lower Both-Reward preferences than the sham group in the partner but not in the toy condition, suggesting that basolateral amygdala was required for the expression of mutual reward preferences. Critically, in a reward magnitude discrimination task in the same experimental setup, both sham-operated and amygdala-lesioned animals preferred large over small rewards, suggesting that amygdala lesion effects were restricted to decision making in social contexts, leaving self-oriented behavior unaffected. Copyright © 2015 Elsevier Inc. All rights reserved.

  9. Heaven can wait. How religion modulates temporal discounting.

    Science.gov (United States)

    Paglieri, Fabio; Borghi, Anna M; Colzato, Lorenza S; Hommel, Bernhard; Scorolli, Claudia

    2013-11-01

    Evidence suggests that religious systems have specific effects on attentional and action control processes. The present study investigated whether religions also modulate choices that involve higher-order knowledge and the delay of gratification in particular. We tested Dutch Calvinists, Italian Catholics, and Atheists from both countries/cultures using an intertemporal choice task where participants could choose between a small immediate and a larger delayed monetary reward. Based on the Calvinist theory of predestination and the Catholic concept of a cycle of sin-confession-expiation, we predicted a reduced delay tolerance, i.e., higher discount rate, for Italian Catholics than for Dutch Calvinists, and intermediate rates for the two atheist groups. Analyses of discount rates support our hypotheses. We also found a magnitude effect on temporal discounting and faster responses for large than for small rewards across religions and countries/cultures. We conclude that temporal discounting is specifically modulated by religious upbringing rather than by generic cultural differences.

  10. Reward disrupts reactivated human skill memory

    OpenAIRE

    Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

    2016-01-01

    Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing re...

  11. Sex versus sweet: opposite effects of opioid drugs on the reward of sucrose and sexual pheromones.

    Science.gov (United States)

    Agustín-Pavón, Carmen; Martínez-Ricós, Joana; Martínez-García, Fernando; Lanuza, Enrique

    2008-04-01

    Endogenous opioids mediate some reward processes involving both natural (food, sweet taste) and artificial (morphine, heroin) rewards. In contrast, sexual behavior (which is also reinforcing) is generally inhibited by opioids. To establish the role of endogenous opioids for a newly described natural reinforcer, namely male sexual pheromones for female mice, we checked the effects of systemic injections of the general opioid antagonist naloxone (1-10 mg/kg) and the agonist fentanyl (0.1- 0.5 mg/kg) in a number of behavioral tests. Naloxone affected neither the innate preference for male-soiled bedding (vs. female-soiled bedding) in 2-choice tests nor the induction of place conditioning using male pheromones as rewarding stimuli, although it effectively blocked the preference for consuming a sucrose solution. In contrast, fentanyl inhibited the preference for male chemosignals without altering sucrose preference. These results suggest that, in macrosmatic animals such as rodents, opioidergic inhibition of sexual behavior might be due, at least partially, to an impaired processing of pheromonal cues and that the hedonic value of sweet-tasting solutions and sexual pheromones are under different opioid modulation.

  12. Information search with situation-specific reward functions

    Directory of Open Access Journals (Sweden)

    Bjorn Meder

    2012-03-01

    Full Text Available can strongly conflict with the goal of obtaining information for improving payoffs. Two environments with such a conflict were identified through computer optimization. Three subsequent experiments investigated people's search behavior in these environments. Experiments 1 and 2 used a multiple-cue probabilistic category-learning task to convey environmental probabilities. In a subsequent search task subjects could query only a single feature before making a classification decision. The crucial manipulation concerned the search-task reward structure. The payoffs corresponded either to accuracy, with equal rewards associated with the two categories, or to an asymmetric payoff function, with different rewards associated with each category. In Experiment 1, in which learning-task feedback corresponded to the true category, people later preferentially searched the accuracy-maximizing feature, whether or not this would improve monetary rewards. In Experiment 2, an asymmetric reward structure was used during learning. Subjects searched the reward-maximizing feature when asymmetric payoffs were preserved in the search task. However, if search-task payoffs corresponded to accuracy, subjects preferentially searched a feature that was suboptimal for reward and accuracy alike. Importantly, this feature would have been most useful, under the learning-task payoff structure. Experiment 3 found that, if words and numbers are used to convey environmental probabilities, neither reward nor accuracy consistently predicts search. These findings emphasize the necessity of taking into account people's goals and search-and-decision processes during learning, thereby challenging current models of information search.

  13. Inhibiting food reward: delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women.

    Science.gov (United States)

    Appelhans, Bradley M; Woolf, Kathleen; Pagoto, Sherry L; Schneider, Kristin L; Whited, Matthew C; Liebman, Rebecca

    2011-11-01

    Overeating is believed to result when the appetitive motivation to consume palatable food exceeds an individual's capacity for inhibitory control of eating. This hypothesis was supported in recent studies involving predominantly normal weight women, but has not been tested in obese populations. The current study tested the interaction between food reward sensitivity and inhibitory control in predicting palatable food intake among energy-replete overweight and obese women (N = 62). Sensitivity to palatable food reward was measured with the Power of Food Scale. Inhibitory control was assessed with a computerized choice task that captures the tendency to discount large delayed rewards relative to smaller immediate rewards. Participants completed an eating in the absence of hunger protocol in which homeostatic energy needs were eliminated with a bland preload of plain oatmeal, followed by a bogus laboratory taste test of palatable and bland snacks. The interaction between food reward sensitivity and inhibitory control was a significant predictor of palatable food intake in regression analyses controlling for BMI and the amount of preload consumed. Probing this interaction indicated that higher food reward sensitivity predicted greater palatable food intake at low levels of inhibitory control, but was not associated with intake at high levels of inhibitory control. As expected, no associations were found in a similar regression analysis predicting intake of bland foods. Findings support a neurobehavioral model of eating behavior in which sensitivity to palatable food reward drives overeating only when accompanied by insufficient inhibitory control. Strengthening inhibitory control could enhance weight management programs.

  14. Neurocircuitry of drug reward

    Science.gov (United States)

    Ikemoto, Satoshi; Bonci, Antonello

    2013-01-01

    In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

  15. Neural reward and punishment sensitivity in cigarette smokers.

    Science.gov (United States)

    Potts, Geoffrey F; Bloom, Erika L; Evans, David E; Drobes, David J

    2014-11-01

    Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  16. Employee Reward Systems in Organizations

    Directory of Open Access Journals (Sweden)

    Došenović Dragana

    2016-06-01

    Full Text Available Employee rewarding is one of the activities of human resource management concerning the management of money, goods and services that employees receive from their employer in exchange for their work. Given that a properly designed reward system is one of the conditions for a stable business, successful performance of work activities and the achievement of set objectives in each organization, the basic theme of this paper is the employee reward system, with a special focus on different elements of it. The purpose of this paper is to describe the role and significance of the observed system and to draw attention to its role in employee’s motivation.

  17. Role of delay-based reward in the spatial cooperation

    Science.gov (United States)

    Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

    2017-01-01

    Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

  18. Nicotine Withdrawal Induces Neural Deficits in Reward Processing.

    Science.gov (United States)

    Oliver, Jason A; Evans, David E; Addicott, Merideth A; Potts, Geoffrey F; Brandon, Thomas H; Drobes, David J

    2017-06-01

    Nicotine withdrawal reduces neurobiological responses to nonsmoking rewards. Insight into these reward deficits could inform the development of targeted interventions. This study examined the effect of withdrawal on neural and behavioral responses during a reward prediction task. Smokers (N = 48) attended two laboratory sessions following overnight abstinence. Withdrawal was manipulated by having participants smoke three regular nicotine (0.6 mg yield; satiation) or very low nicotine (0.05 mg yield; withdrawal) cigarettes. Electrophysiological recordings of neural activity were obtained while participants completed a reward prediction task that involved viewing four combinations of predictive and reward-determining stimuli: (1) Unexpected Reward; (2) Predicted Reward; (3) Predicted Punishment; (4) Unexpected Punishment. The task evokes a medial frontal negativity that mimics the phasic pattern of dopaminergic firing in ventral tegmental regions associated with reward prediction errors. Nicotine withdrawal decreased the amplitude of the medial frontal negativity equally across all trial types (p nicotine dependence (p Nicotine withdrawal had equivocal impact across trial types, suggesting reward processing deficits are unlikely to stem from changes in phasic dopaminergic activity during prediction errors. Effects on tonic activity may be more pronounced. Pharmacological interventions directly targeting the dopamine system and behavioral interventions designed to increase reward motivation and responsiveness (eg, behavioral activation) may aid in mitigating withdrawal symptoms and potentially improving smoking cessation outcomes. Findings from this study indicate nicotine withdrawal impacts reward processing signals that are observable in smokers' neural activity. This may play a role in the subjective aversive experience of nicotine withdrawal and potentially contribute to smoking relapse. Interventions that address abnormal responding to both pleasant and

  19. A Fly's Eye View of Natural and Drug Reward.

    Science.gov (United States)

    Lowenstein, Eve G; Velazquez-Ulloa, Norma A

    2018-01-01

    Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

  20. Variation in reward quality and pollinator attraction: the consumer does not always get it right.

    Science.gov (United States)

    Carr, David E; Haber, Ariela I; LeCroy, Kathryn A; Lee, De'Ashia E; Link, Rosabeth I

    2015-04-09

    Nearly all bees rely on pollen as the sole protein source for the development of their larvae. The central importance of pollen for the bee life cycle should exert strong selection on their ability to locate the most rewarding sources of pollen. Despite this importance, very few studies have examined the influence of intraspecific variation in pollen rewards on the foraging decisions of bees. Previous studies have demonstrated that inbreeding reduces viability and hence protein content in Mimulus guttatus (seep monkeyflower) pollen and that bees strongly discriminate against inbred in favour of outbred plants. We examined whether variation in pollen viability could explain this preference using a series of choice tests with living plants, artificial plants and olfactometer tests using the bumble bee Bombus impatiens. We found that B. impatiens preferred to visit artificial plants provisioned with fertile anthers over those provisioned with sterile anthers. They also preferred fertile anthers when provided only olfactory cues. These bumble bees were unable to discriminate among live plants from subpopulations differing dramatically in pollen viability, however. They preferred outbred plants even when those plants were from subpopulations with pollen viability as low as the inbred populations. Their preference for outbred plants was evident even when only olfactory cues were available. Our data showed that bumble bees are able to differentiate between anthers that provide higher rewards when cues are isolated from the rest of the flower. When confronted with cues from the entire flower, their choices are independent of the quality of the pollen reward, suggesting that they are responding more strongly to cues unassociated with rewards than to those correlated with rewards. If so, this suggests that a sensory bias or some level of deception may be involved with advertisement to pollinators in M. guttatus. Published by Oxford University Press on behalf of the Annals of