Lou, Bin; Hsu, Wha-Yin; Sajda, Paul
expected reward. Here, we use electroencephelography to identify trial-by-trial neural activity of perceived stimulus salience, showing that this activity can be combined with the value of choice options to form a representation of expected reward. Our results provide insight into the neural processing governing the interaction between salience and value and the formation of subjective expected reward and prediction error. This work is potentially important for identifying neural markers of abnormal sensory/value processing, as is seen in some cases of psychiatric illnesses. PMID:26400937
Platek, Steven M; Singh, Devendra
Secondary sexual characteristics convey information about reproductive potential. In the same way that facial symmetry and masculinity, and shoulder-to-hip ratio convey information about reproductive/genetic quality in males, waist-to-hip-ratio (WHR) is a phenotypic cue to fertility, fecundity, neurodevelopmental resources in offspring, and overall health, and is indicative of "good genes" in women. Here, using fMRI, we found that males show activation in brain reward centers in response to naked female bodies when surgically altered to express an optimal (approximately 0.7) WHR with redistributed body fat, but relatively unaffected body mass index (BMI). Relative to presurgical bodies, brain activation to postsurgical bodies was observed in bilateral orbital frontal cortex. While changes in BMI only revealed activation in visual brain substrates, changes in WHR revealed activation in the anterior cingulate cortex, an area associated with reward processing and decision-making. When regressing ratings of attractiveness on brain activation, we observed activation in forebrain substrates, notably the nucleus accumbens, a forebrain nucleus highly involved in reward processes. These findings suggest that an hourglass figure (i.e., an optimal WHR) activates brain centers that drive appetitive sociality/attention toward females that represent the highest-quality reproductive partners. This is the first description of a neural correlate implicating WHR as a putative honest biological signal of female reproductive viability and its effects on men's neurological processing. PMID:20140088
Full Text Available The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of goal-directed behavior. The neural substrate underling this processing of reward information is a reliable way of improving learning and memory processes. Evidence from several studies indicates that this neural system can facilitate memory consolidation in a wide variety of learning tasks. From a molecular perspective, certain cardinal features of reward have been described as forms of memory. Studies of human addicts and studies in animal models of addiction show that chronic drug exposure produces stable changes in the brain at the cellular and molecular levels that underlie the long-lasting behavioral plasticity associated with addiction. These molecular and cellular adaptations involved in addiction are also implicated in learning and memory processes. Dopamine seems to be a critical common signal to activate different genetic mechanisms that ultimately remodel synapses and circuits. Despite memory is an active and complex process mediated by different brain areas, the neural substrate of reward is able to improve memory consolidation in a several paradigms. We believe that there are many equivalent traits between reward and learning and memory processes.
Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E;
functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine or...... placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making...... involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation....
Nicholas W. Simon
Full Text Available Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents.
Childhood maltreatment, which markedly increases risks for psychopathology, is associated with structural and functional brain differences. Especially, exposure to parental verbal abuse (PVA) or interparental violence during childhood is associated with negative outcomes such as depression, posttraumatic stress disorder (PTSD), and reduced cognitive abilities. Other forms of childhood maltreatment have been associated with brain structure or developmental alteration. Our earlier studies elucidated potential discernible effects of PVA and witnessing domestic violence during childhood on brain morphology, including gray matter volume or cortical thickness. Brain regions that process and convey the adverse sensory input of the abuse might be modified specifically by such experiences, particularly in subjects exposed to a single type of maltreatment. Exposure to multiple types of maltreatment is more commonly associated with morphological alterations in the corticolimbic regions. These findings fit with preclinical studies showing that sensory cortices are highly plastic structures. Using tasks with high and low monetary rewards while subjects underwent functional MRI, we also examined whether neural activity during reward processing was altered, or not, in children and adolescents with reactive attachment disorder (RAD). Significantly reduced activity in the caudate and nucleus accumbens was observed during a high monetary reward condition in the RAD group compared to the typically developed group. The striatal neural reward activity in the RAD group was also markedly decreased. The present results suggest that dopaminergic dysfunction occurred in the striatum in children and adolescents with RAD, potentially leading to a future risk of psychiatric disorders such as dependence. PMID:27150924
Scheres, A.P.J.; Water, E. de; Mies, G.W.
Temporal reward discounting (TD) refers to the decrease in subjective value of a reward when the delay to that reward increases. In recent years, a growing number of studies on the neural correlates of temporal reward discounting have been conducted. This article focuses on functional magnetic reson
Although attention deficit hyperactivity disorders (ADHD) and autism spectrum disorders (ASD) share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC). A significant group by reward type i...
Full Text Available Although attention deficit hyperactivity disorders (ADHD and autism spectrum disorders (ASD share certain neurocognitive characteristics, it has been hypothesized to differentiate the two disorders based on their brain's reward responsiveness to either social or monetary reward. Thus, the present fMRI study investigated neural activation in response to both reward types in age and IQ-matched boys with ADHD versus ASD relative to typically controls (TDC. A significant group by reward type interaction effect emerged in the ventral striatum with greater activation to monetary versus social reward only in TDC, whereas subjects with ADHD responded equally strong to both reward types, and subjects with ASD showed low striatal reactivity across both reward conditions. Moreover, disorder-specific neural abnormalities were revealed, including medial prefrontal hyperactivation in response to social reward in ADHD versus ventral striatal hypoactivation in response to monetary reward in ASD. Shared dysfunction was characterized by fronto-striato-parietal hypoactivation in both clinical groups when money was at stake. Interestingly, lower neural activation within parietal circuitry was associated with higher autistic traits across the entire study sample. In sum, the present findings concur with the assumption that both ASD and ADHD display distinct and shared neural dysfunction in response to reward.
Platek, Steven M.; Singh, Devendra
Secondary sexual characteristics convey information about reproductive potential. In the same way that facial symmetry and masculinity, and shoulder-to-hip ratio convey information about reproductive/genetic quality in males, waist-to-hip-ratio (WHR) is a phenotypic cue to fertility, fecundity, neurodevelopmental resources in offspring, and overall health, and is indicative of “good genes” in women. Here, using fMRI, we found that males show activation in brain reward centers in response to n...
Aswolinskiy, Witali; Pipa, Gordon
Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain. PMID:25852533
Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making. PMID:15082317
Inge eVan Rijn
Full Text Available A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity, however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015, in which participants (n=30 tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n=18 (Griffioen-Roose et al., 2013. First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS questionnaire.When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate, right amygdala and anterior cingulate cortex (bilaterally correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per
The aim of this report is to analyze the relationships between reward and learning and memory processes. Different studies have described how information about rewards influences behavior and how the brain uses this reward information to control learning and memory processes. Reward nature seems to be processed in different ways by neurons in different brain structures, ranging from the detection and perception of rewards to the use of information about predicted rewards for the control of go...
Soder, Heather E; de Dios, Constanza; Potts, Geoffrey F
The prefrontal cortex may play a role in attention selection using motivational information from the mesotelencephalic dopamine system, a neural system that responds to reward prediction violations. If so, neural indices of attention selection and reward prediction violation should have overlapping spatiotemporal distributions. Attention selection elicits a frontal event-related potential component around 200-300 ms, the frontal selection positivity. A component with similar spatiotemporal characteristics, the reward positivity is elicited in reward prediction designs to outcomes that are better than expected. The current study used dense sensor array recording in a sample of 41 participants performing visual oddball (attention) and a reward prediction 'slot machine-like' design to compare the spatiotemporal distributions of the frontal selection positivity and the reward positivity. The components did not differ in their peak latencies and had overlapping scalp topographies, supporting the hypothesis that these positivities represent attachment of incentive salience to perceptual representations in the prefrontal cortex. PMID:27232519
Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I; Schott, Björn H
Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965
Full Text Available Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread and trait (pessimism sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation.
Cascio Carissa J
Full Text Available Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD.
Learning and memory are two corresponding neural processes. Learning is a neural actitivity depending on experience and changing organ’s behaviour to adapt the enviorement.Memory is a neural processing which storages and retrieves learned information. Reward and punishment learning and memory protect animals to approach the benefits and avoid risks for better life. Although researches are exploring the mechanism of the brain work, a large amount of studies are required to reveal the truth in ...
Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K; Kirschner, Matthias; Kraehenmann, Rainer; Stämpfli, Philipp; Herdener, Marcus; Seifritz, Erich; Quednow, Boris B
Changed reward functions have been proposed as a core feature of stimulant addiction, typically observed as reduced neural responses to non-drug-related rewards. However, it was unclear yet how specific this deficit is for different types of non-drug rewards arising from social and non-social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17 matched stimulant-naive healthy controls. Cocaine users, compared with controls, showed blunted neural responses to both social and non-social reward. Activation differences were located in the ventromedial prefrontal cortex overlapping for both reward types and, thus, suggesting a non-specific deficit in the processing of non-drug rewards. Interestingly, in the posterior lateral orbitofrontal cortex, social reward responses of cocaine users decreased with the degree to which they were influenced by social feedback from the experts, a response pattern that was opposite to that observed in healthy controls. The present results suggest that cocaine users likely suffer from a generalized impairment in value representation as well as from an aberrant processing of social feedback. PMID:26969866
Full Text Available Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.
Recurrent neural networks in the chaotic regime exhibit complex dynamics reminiscent of high-level cortical activity during behavioral tasks. However, existing training methods for such networks are either biologically implausible, or require a real-time continuous error signal to guide the learning process. This is in contrast with most behavioral tasks, which only provide time-sparse, delayed rewards. Here we show that a biologically plausible reward-modulated Hebbian learning algorithm, pr...
Massi, Bart; Luhmann, Christian C
Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation. PMID:25962511
Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter
Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827
Schultz, W.; Preuschoff, K; Camerer, C.; Hsu, M; Fiorillo, C D; Tobler, Philippe N.; Bossaerts, P.
The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitu...
Diao, Liuting; Qi, Senqing; Xu, Mengsi; Li, Zhiai; Ding, Cody; Chen, Antao; Zheng, Yan; Yang, Dong
Consciously initiated cognitive control is generally determined by motivational incentives (e.g., monetary reward). Recent studies have revealed that human cognitive control processes can nevertheless operate without awareness. However, whether monetary reward can impinge on unconscious cognitive control remains unclear. To clarify this issue, a task consisting of several runs was designed to combine a modified version of the reward-priming paradigm with an unconscious version of the Go/No-Go task. At the beginning of each run, participants were exposed to a high- or low-value coin, followed by the modified Go/No-Go task. Participants could earn the coin only if they responded correctly to each trial of the run. Event-related potential (ERP) results indicated that high-value rewards (vs. low-value rewards) induced a greater centro-parietal P3 component associated with conscious and unconscious inhibitory control. Moreover, the P3 amplitude correlated positively with the magnitude of reaction time slowing reflecting the intensity of activation of unconscious inhibitory control in the brain. These findings suggest that high-value reward may facilitate human higher-order inhibitory processes that are independent of conscious awareness, which provides insights into the brain processes that underpin motivational modulation of cognitive control. PMID:27346057
Telzer, Eva H; Fuligni, Andrew J; Lieberman, Matthew D; Galván, Adriana
The pursuit of happiness and reward is an impetus for everyday human behavior and the basis of well-being. Although optimal well-being may be achieved through eudaimonic activities (e.g., meaning and purpose), individuals tend to orient toward hedonic activities (e.g., pleasure seeking), potentially placing them at risk for ill-being. We implemented a longitudinal study and followed adolescents over 1 y to examine whether neural sensitivity to eudaimonic (e.g., prosocial decisions) and hedonic (e.g., selfish rewards and risky decisions) rewards differentially predicts longitudinal changes in depressive symptoms. Ventral striatum activation during eudaimonic decisions predicted longitudinal declines in depressive symptoms, whereas ventral striatum activation to hedonic decisions related to longitudinal increases in depressive symptoms. These findings underscore how the motivational context underlying neural sensitivity to rewards can differentially predict changes in well-being over time. Importantly, to our knowledge, this is the first study to show that striatal activation within an individual can be both a source of risk and protection. PMID:24753574
Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan
Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects...
Hooker, Christine I.; Verosky, Sara C.; Miyakawa, Asako; Knight, Robert T.; D'Esposito, Mark
Fear and reward learning can occur through direct experience or observation. Both channels can enhance survival or create maladaptive behavior. We used fMRI to isolate neural mechanisms of observational fear and reward learning and investigate whether neural response varied according to individual differences in neuroticism and extraversion.…
Cascio Carissa J; Foss-Feig Jennifer H; Heacock Jessica L; Newsom Cassandra R; Cowan Ronald L; Benningfield Margaret M; Rogers Baxter P; Cao Aize
Abstract Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD) is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our...
Hikida, Takatoshi; Morita, Makiko; Macpherson, Tom
The basal ganglia are key neural substrates not only for motor function, but also cognitive functions including reward and aversive learning. Critical for these processes are the functional role played by two projection neurons within nucleus accumbens (NAc); the D1- and D2-expressing neurons. Recently, we have developed a novel reversible neurotransmission blocking technique that specifically blocks neurotransmission from NAc D1- and D2-expressing neurons, allowing for in vivo analysis. In this review, we outline the functional dissociation of NAc D1- and D2-expressing neurons of the basal ganglia in reward and aversive learning, as well as drug addiction. These studies have revealed the importance of activation of NAc D1 receptors for reward learning and drug addiction, and inactivation of NAc D2 receptors for aversive learning and flexibility. Based on these findings, we propose a neural mechanism, in which dopamine neurons in the ventral tegmental area that send inputs to the NAc work as a switch between D1- and D2-expressing neurons. These basal ganglia neural mechanisms will give us new insights into the pathophysiology of neuropsychiatric diseases. PMID:26827817
Full Text Available Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI protocol using the Monetary Incentive Delay (MID task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex. Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus, suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development.
Urošević, Snežana; Luciana, Monica; Jensen, Jonathan B.; Youngstrom, Eric A.; Thomas, Kathleen M.
Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD) and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age) associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI) protocol using the Monetary Incentive Delay (MID) task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex). Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus), suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development. PMID:27114896
Full Text Available Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies.
van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Paul A.M. Smeets
A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simpl...
Inge eVan Rijn; Sanne eGriffioen-Roose; Cees ede Graaf; Paul A.M. Smeets
A food’s reward value is dependent on its caloric content. Furthermore, a food’s acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n=30) tasted simple ...
Full Text Available Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behaviour. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.
Hasler, Brant P.; Sitnick, Stephanie L.; Shaw, Daniel S.; Erika E. Forbes
Evening chronotypes not only differ from morning-types in their sleep and circadian timing, but they are prone to problematic outcomes involving reward function, including affective disturbance, sensation seeking, and substance involvement. We explored the neural mechanisms underlying these chronotype differences by comparing the neural response to reward in morning- and evening-types. Using a monetary reward fMRI paradigm, we compared the neural response to reward in 13 morning-types and 21 ...
Hooker, Christine I.; Verosky, Sara C.; Miyakawa, Asako; Robert T Knight; D’Esposito, Mark
Fear and reward learning can occur through direct experience or observation. Both channels can enhance survival or create maladaptive behavior. We used fMRI to isolate neural mechanisms of observational fear and reward learning and investigate whether neural response varied according to individual differences in neuroticism and extraversion. Participants learned object-emotion associations by observing a woman respond with fearful (or neutral) and happy (or neutral) facial expressions to nove...
Ait Oumeziane, Belel; Foti, Dan
Recent theoretical models underline reward sensitivity as a potential endophenotype for major depressive disorder. Neural and behavioral evidence reveals depression is associated with reduced reward sensitivity. However, reward dysfunction is not unique to depression, as it is also common across disorders of poor impulse control. We examined the interrelationships of depression (Depression, Anxiety, and Stress Scale [DASS-21]) and impulsivity (UPPS-P Impulsive Behavior Scale) with reward sensitivity among a large, representative sample (N = 260). ERPs were recorded to isolate two neural indicators of consummatory reward processing: initial evaluation of rewards in the 250-350 ms time window postonset of feedback (reward positivity [RewP]), and salience to monetary outcomes (P3). Significant interactions were observed between depression and impulsivity facets across these two stages of reward processing: depression and positive urgency predicted RewP amplitude to reward outcomes (win vs. loss); depression and one other impulsivity trait, (lack of) premeditation, predicted P3 amplitude to monetary outcomes. Conversely, high symptoms of depression were related to three biobehavioral profiles: (1) blunted RewP in conjunction with high positive urgency, (2) combination of blunted RewP and low (lack of) premeditation, and (3) blunted P3 to monetary wins/losses, in conjunction with low (lack of) premeditation. Findings illustrate that reward-related dysfunctions may be optimally conceptualized when examining the interactions between dimensions of internalizing and externalizing psychopathology. PMID:27193188
Taylor, Jessica E; Ogawa, Akitoshi; Sakagami, Masamichi
By saying "Anyone who has never made a mistake has never tried anything new", Albert Einstein himself allegedly implied that the making and processing of errors are essential for behavioral adaption to a new or changing environment. These essential error-related cognitive and neural processes are likely influenced by reward value. However, previous studies have not dissociated accuracy and value and so the distinct effect of reward on error processing in the brain remained unknown. Therefore, we set out to investigate this at various points in decision-making. We used functional magnetic resonance imaging to scan participants while they completed a random dot motion discrimination task where reward and non-reward were associated with stimuli via classical conditioning. Pre-error activity was found in the medial frontal cortex prior to response but this was not related to reward value. At response time, error-related activity was found to be significantly greater in reward than non-reward trials in the midcingulate cortex. Finally at outcome time, error-related activity was found in the anterior cingulate cortex in non-reward trials. These results show that reward value enhances post-decision but not pre-decision error-related activities and these results therefore have implications for theories of error correction and confidence. PMID:26739226
Gossen, Anna; Groppe, Sarah E; Winkler, Lina; Kohls, Gregor; Herrington, John; Schultz, Robert T; Gründer, Gerhard; Spreckelmeyer, Katja N
Data from developmental psychology suggests a link between the growth of socio-emotional competences and the infant's sensitivity to the salience of social stimuli. The aim of the present study was to find evidence for this relationship in healthy adults. Thirty-five participants were recruited based on their score above the 85th or below the 15th percentile of the empathy quotient questionnaire (EQ, Baron-Cohen and Wheelwright, 2004). Functional magnetic resonance imaging (fMRI) was used to compare neural responses to cues of social and non-social (monetary) reward. When compared to the high-EQ group, the low-EQ group showed reduced activity of the brain s reward system, specifically the right nucleus accumbens, in response to cues predictive of social reward (videos showing gestures of approval)-but increased activation in this area for monetary incentives. Our data provide evidence for a link between self-reported deficits in social proficiency and reduced sensitivity to the motivational salience of positive social stimuli. PMID:23512930
Dominic S. Fareri
Full Text Available The human striatum is integral for reward-processing and supports learning by linking experienced outcomes with prior expectations. Recent endeavors implicate the striatum in processing outcomes of social interactions, such as social approval/rejection, as well as in learning reputations of others. Interestingly, social impressions often influence our behavior with others during interactions. Information about an interaction partner’s moral character acquired from biographical information hinders updating of expectations after interactions via top down modulation of reward circuitry. An outstanding question is whether initial impressions formed through experience similarly modulate the ability to update social impressions at the behavioral and neural level. We investigated the role of experienced social information on trust behavior and reward-related BOLD activity. Participants played a computerized ball tossing game with three fictional partners manipulated to be perceived as good, bad or neutral. Participants then played an iterated trust game as investors with these same partners while undergoing fMRI. Unbeknownst to participants, partner behavior in the trust game was random and unrelated to their ball-tossing behavior. Participants’ trust decisions were influenced by their prior experience in the ball tossing game, investing less often with the bad partner compared to the good and neutral. Reinforcement learning models revealed that participants were more sensitive to updating their beliefs about good and bad partners when experiencing outcomes consistent with initial experience. Increased striatal and anterior cingulate BOLD activity for positive versus negative trust game outcomes emerged, which further correlated with model-derived prediction-error (PE learning signals. These results suggest that initial impressions formed from direct social experience can be continually shaped by consistent information through reward learning
Melynda D. Casement
Full Text Available Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC, striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence.
Anne S Warlaumont
Full Text Available At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic
Full Text Available Dopamine-containing neurons have been implicated in reward and decision making. One element of the supporting evidence is that cocaine, like other drugs that increase dopaminergic neurotransmission, powerfully potentiates reward seeking. We analyze this phenomenon from a novel perspective, introducing a new conceptual framework and new methodology for determining the stage(s of neural processing at which drugs, lesions and physiological manipulations act to influence reward-seeking behavior. Cocaine strongly boosts the proclivity of rats to work for rewarding electrical brain stimulation. We show that the conventional conceptual framework and methods do not distinguish between three conflicting accounts of how the drug produces this effect: increased sensitivity of brain reward circuitry, increased gain, or decreased subjective reward costs. Sensitivity determines the stimulation strength required to produce a reward of a given intensity (a measure analogous to the KM of an enzyme whereas gain determines the maximum intensity attainable (a measure analogous to the vmax of an enzyme-catalyzed reaction. To distinguish sensitivity changes from the other determinants, we measured and modeled reward seeking as a function of both stimulation strength and opportunity cost. The principal effect of cocaine was a two-fourfold increase in willingness to pay for the electrical reward, an effect consistent with increased gain or decreased subjective cost. This finding challenges the long-standing view that cocaine increases the sensitivity of brain reward circuitry. We discuss the implications of the results and the analytic approach for theories of how dopaminergic neurons and other diffuse modulatory brain systems contribute to reward pursuit, and we explore the implications of the conceptual framework for the study of natural rewards, drug reward, and mood.
Gunderman, Richard B; Kamer, Aaron P
For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. PMID:21531311
Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin
Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551
Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin
Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551
Li, Yansong; Vanni-Mercier, Giovanna; Isnard, Jean; Mauguière, François; Dreher, Jean-Claude
SEE KRINGELBACH AND RAPUANO DOI101093/BRAIN/AWW049 FOR A SCIENTIFIC COMMENTARY ON THIS ARTICLE: The orbitofrontal cortex is known to carry information regarding expected reward, risk and experienced outcome. Yet, due to inherent limitations in lesion and neuroimaging methods, the neural dynamics of these computations has remained elusive in humans. Here, taking advantage of the high temporal definition of intracranial recordings, we characterize the neurophysiological signatures of the intact orbitofrontal cortex in processing information relevant for risky decisions. Local field potentials were recorded from the intact orbitofrontal cortex of patients suffering from drug-refractory partial epilepsy with implanted depth electrodes as they performed a probabilistic reward learning task that required them to associate visual cues with distinct reward probabilities. We observed three successive signals: (i) around 400 ms after cue presentation, the amplitudes of the local field potentials increased with reward probability; (ii) a risk signal emerged during the late phase of reward anticipation and during the outcome phase; and (iii) an experienced value signal appeared at the time of reward delivery. Both the medial and lateral orbitofrontal cortex encoded risk and reward probability while the lateral orbitofrontal cortex played a dominant role in coding experienced value. The present study provides the first evidence from intracranial recordings that the human orbitofrontal cortex codes reward risk both during late reward anticipation and during the outcome phase at a time scale of milliseconds. Our findings offer insights into the rapid mechanisms underlying the ability to learn structural relationships from the environment. PMID:26811252
David A. Peterson; Lotz, Daniel T.; Halgren, Eric; Sejnowski, Terrence J.; Poizner, Howard
Our ability to selectively engage with our environment enables us to guide our learning and to take advantage of its benefits. When facing multiple possible actions, our choices are a critical aspect of learning. In the case of learning from rewarding feedback, there has been substantial theoretical and empirical progress in elucidating the associated behavioral and neural processes, predominantly in terms of a reward prediction error, a measure of the discrepancy between actual versus expect...
Murray, Jennifer E; Bevins, Rick A
The discovery that delta-9-tetrahydrocannabinol (Δ(9)-THC) is the primary psychoactive ingredient in marijuana prompted research that helped elucidate the endogenous cannabinoid system of the brain. Δ(9)-THC and other cannabinoid ligands with agonist action (CP 55,940, HU210, and WIN 55,212-2) increase firing of dopamine neurons and increase synaptic dopamine in brain regions associated with reward and drug addiction. Such changes in cellular processes have prompted investigators to examine the conditioned rewarding effects of the cannabinoid ligands using the place conditioning task with rats and mice. As reviewed here, these cannabinoid ligands can condition place preferences (evidence for rewarding effects) and place aversions (evidence for aversive qualities). Notably, the procedural details used in these place conditioning studies have varied across laboratories. Such variation includes differences in apparatus type, existence of procedural biases, dose, number of conditioning trials, injection-to-placement intervals, and pre-training drug exposure. Some differences in outcome across studies can be explained by these procedural variables. For example, low doses of Δ(9)-THC appear to have conditioned rewarding effects, whereas higher doses have aversive effects that either mask these rewarding effects or condition a place aversion. Throughout this review we highlight key areas that need further research. PMID:20495676
Baruni, Jalal K; Lau, Brian; Salzman, C Daniel
Neural activity in visual area V4 is enhanced when attention is directed into neuronal receptive fields. However, the source of this enhancement is unclear, as most physiological studies have manipulated attention by changing the absolute reward associated with a particular location as well as its value relative to other locations. We trained monkeys to discriminate the orientation of two stimuli presented simultaneously in different hemifields while we independently varied the reward magnitude associated with correct discrimination at each location. Behavioral measures of attention were controlled by the relative value of each location. By contrast, neurons in V4 were consistently modulated by absolute reward value, exhibiting increased activity, increased gamma-band power and decreased trial-to-trial variability whenever receptive field locations were associated with large rewards. These data challenge the notion that the perceptual benefits of spatial attention rely on increased signal-to-noise in V4. Instead, these benefits likely derive from downstream selection mechanisms. PMID:26479590
Ye, Weijie; Liu, Shenquan; Liu, Xuanliang; Yu, Yuguo
Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association. PMID:27284696
Platek, Steven M; Krill, Austen L; Wilson, Benjamin
On the basis of Hamilton's (Hamilton, W. D. (1964). The genetical evolution of social behavior I, II. Journal of Theoretical Biology, 7, 17-52) theory of inclusive fitness, self-facial resemblance is hypothesized as a mechanism for self-referent phenotypic matching by which humans can detect kin. To understand the mechanisms underlying pro-sociality toward self-resembling faces, we investigated the neural correlates of implicit trustworthiness ratings for self-resembling faces. Here we show that idiosyncratic trustworthiness ratings of self-resembling faces predict brain activation in the ventral inferior, middle and medial frontal gyri, substrates involved in reward processing. These findings demonstrate that neural reward centers are implicated in evaluating implicit pro-social behaviors toward self-resembling faces. These findings suggest that humans have evolved to use neurocomputational architecture dedicated to face processing and reward evaluation for the differentiation of kin, which drives implicit idiosyncratic affectively regulated social interactions. PMID:18761362
Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T; Sugawara, Sho K; Tanabe, Hiroki C; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro
Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener. PMID:25188354
Full Text Available Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.
Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F
Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness. PMID:22479547
Gupta, Rashmi; Dominguez Borras, Judith; Vuilleumier, Patrik
In recent years, affective neuroscience has emerged as an important discipline to study the brain mechanisms of affect and emotion by employing various methods, ranging from neuroimaging and neurobiology through to drug and lesion studies (Davidson et al., 2003; Deak, 2011; Kringelbach, 2005, Kringelbach & Berridge 2008; LeDoux & Phelps 2000; Leknes & Tracey 2008). Ample research has demonstrated that emotionally significant and rewarding information often produces strong effects on other pro...
Full Text Available BACKGROUND: Pathological gambling (PG and obsessive-compulsive disorder (OCD are conceptualized as a behavioral addiction, with a dependency on repetitive gambling behavior and rewarding effects following compulsive behavior, respectively. However, no neuroimaging studies to date have examined reward circuitry during the anticipation phase of reward in PG compared with in OCD while considering repetitive gambling and compulsion as addictive behaviors. METHODS/PRINCIPAL FINDINGS: To elucidate the neural activities specific to the anticipation phase of reward, we performed event-related functional magnetic resonance imaging (fMRI in young adults with PG and compared them with those in patients with OCD and healthy controls. Fifteen male patients with PG, 13 patients with OCD, and 15 healthy controls, group-matched for age, gender, and IQ, participated in a monetary incentive delay task during fMRI scanning. Neural activation in the ventromedial caudate nucleus during anticipation of both gain and loss decreased in patients with PG compared with that in patients with OCD and healthy controls. Additionally, reduced activation in the anterior insula during anticipation of loss was observed in patients with PG compared with that in patients with OCD which was intermediate between that in OCD and healthy controls (healthy controls < PG < OCD, and a significant positive correlation between activity in the anterior insula and South Oaks Gambling Screen score was found in patients with PG. CONCLUSIONS: Decreased neural activity in the ventromedial caudate nucleus during anticipation may be a specific neurobiological feature for the pathophysiology of PG, distinguishing it from OCD and healthy controls. Correlation of anterior insular activity during loss anticipation with PG symptoms suggests that patients with PG fit the features of OCD associated with harm avoidance as PG symptoms deteriorate. Our findings have identified functional disparities and
Simon, Joe J; Cordeiro, Sheila A; Weber, Marc-André; Friederich, Hans-Christoph; Wolf, Robert C; Weisbrod, Matthias; Kaiser, Stefan
Dysfunctional patterns of activation in brain reward networks have been suggested as a core element in the pathophysiology of schizophrenia. However, it remains unclear whether this dysfunction is specific to schizophrenia or can be continuously observed across persons with different levels of nonclinical and clinical symptom expression. Therefore, we sought to investigate whether the pattern of reward system dysfunction is consistent with a dimensional or categorical model of psychosis-like symptom expression. 23 patients with schizophrenia and 37 healthy control participants with varying levels of psychosis-like symptoms, separated into 3 groups of low, medium, and high symptom expression underwent event-related functional magnetic resonance imaging while performing a Cued Reinforcement Reaction Time task. We observed lower activation in the ventral striatum during the expectation of high vs no reward to be associated with higher symptom expression across all participants. No significant difference between patients with schizophrenia and healthy participants with high symptom expression was found. However, connectivity between the ventral striatum and the medial orbitofrontal cortex was specifically reduced in patients with schizophrenia. Dysfunctional local activation of the ventral striatum depends less on diagnostic category than on the degree of symptom expression, therefore showing a pattern consistent with a psychosis continuum. In contrast, aberrant connectivity in the reward system is specific to patients with schizophrenia, thereby supporting a categorical view. Thus, the results of the present study provide evidence for both continuous and discontinuous neural substrates of symptom expression across patients with schizophrenia and the general population. PMID:26006262
Thomas Fitzgerald; Ray Dolan
Temporal difference learning models propose phasic dopamine signalling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of b...
Chen, Pin-Hao A.; Whalen, Paul J.; Freeman, Jonathan B.; Taylor, James M.; Heatherton, Todd F.
This study examined whether neural responses in the ventral striatum (VS) to in-group facial expressions—presented without explicit awareness—could predict friendship patterns in newly arrived individuals from China six months later. Individuals who initially showed greater VS activity in response to in-group happy expressions during functional neuroimaging later made considerably more in-group friends, suggesting that VS activity might reflect reward processes that drive in-group approach behaviors. PMID:26185595
Richey, John A.; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R.; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W.; Dichter, Gabriel S.
Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activati...
Dutcher, Janine M; Creswell, J David; Pacilio, Laura E; Harris, Peter R; Klein, William M P; Levine, John M; Bower, Julienne E; Muscatell, Keely A; Eisenberger, Naomi I
Self-affirmation (reflecting on important personal values) has been shown to have a range of positive effects; however, the neural basis of self-affirmation is not known. Building on studies showing that thinking about self-preferences activates neural reward pathways, we hypothesized that self-affirmation would activate brain reward circuitry during functional MRI (fMRI) studies. In Study 1, with college students, making judgments about important personal values during self-affirmation activated neural reward regions (i.e., ventral striatum), whereas making preference judgments that were not self-relevant did not. Study 2 replicated these results in a community sample, again showing that self-affirmation activated the ventral striatum. These are among the first fMRI studies to identify neural processes during self-affirmation. The findings extend theory by showing that self-affirmation may be rewarding and may provide a first step toward identifying a neural mechanism by which self-affirmation may produce a wide range of beneficial effects. PMID:26917214
Goldstein, Rita Z.; Tomasi, Dardo; Alia-Klein, Nelly; Cottone, Lisa A.; Zhang, Lei; Telang, Frank; Volkow, Nora D.
Drug addiction is characterized by marked disruptions in the ability to process reward. Here we evaluated in cocaine addicted and healthy control participants the subjective sensitivity to reward gradients and its association with neural responses to sustained reward. A self-report questionnaire was used to assess the former. A functional magnetic resonance imaging task that utilized monetary reward as feedback in a blocked design was used to assess the latter. Results revealed that whereas c...
Takemura, Hiromasa; Samejima, Kazuyuki; Vogels, Rufin; Sakagami, Masamichi; Okuda, Jiro
Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus–reward experiences. It remains unknown, however, how sensory pr...
Pitchers, Kyle K.; Vialou, Vincent; Nestler, Eric J.; Laviolette, Steven R; Lehman, Michael N.; Coolen, Lique M.
Drugs of abuse induce neuroplasticity in the natural reward pathway, specifically the nucleus accumbens (NAc), thereby causing development and expression of addictive behavior. Recent evidence suggests that natural rewards may cause similar changes in the NAc, suggesting that drugs may activate mechanisms of plasticity shared with natural rewards, and allowing for unique interplay between natural and drug rewards. In this study, we demonstrate that sexual experience in male rats when followed...
von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P.; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J.; Hoekstra, Pieter J.; Hartman, Catharina A.; Faraone, Stephen V.; van Rooij, Daan; van Dongen, Eelco V.; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan
Objective Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is unknown whether reward processing is abnormal in unaffected siblings of participants with ADHD. Method We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n=150), their unaffected siblings (n=92), and control participants (n=108), all of the same age. Results Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex, and ventral striatum during reward receipt. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and the orbitofrontal cortex during receipt. Conclusion ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters have to replicate our findings. PMID:25901776
Ben-Shaanan, Tamar L; Azulay-Debby, Hilla; Dubovik, Tania; Starosvetsky, Elina; Korin, Ben; Schiller, Maya; Green, Nathaniel L; Admon, Yasmin; Hakim, Fahed; Shen-Orr, Shai S; Rolls, Asya
Positive expectations contribute to the clinical benefits of the placebo effect. Such positive expectations are mediated by the brain's reward system; however, it remains unknown whether and how reward system activation affects the body's physiology and, specifically, immunity. Here we show that activation of the ventral tegmental area (VTA), a key component of the reward system, strengthens immunological host defense. We used 'designer receptors exclusively activated by designer drugs' (DREADDs) to directly activate dopaminergic neurons in the mouse VTA and characterized the subsequent immune response after exposure to bacteria (Escherichia coli), using time-of-flight mass cytometry (CyTOF) and functional assays. We found an increase in innate and adaptive immune responses that were manifested by enhanced antibacterial activity of monocytes and macrophages, reduced in vivo bacterial load and a heightened T cell response in the mouse model of delayed-type hypersensitivity. By chemically ablating the sympathetic nervous system (SNS), we showed that the reward system's effects on immunity are, at least partly, mediated by the SNS. Thus, our findings establish a causal relationship between the activity of the VTA and the immune response to bacterial infection. PMID:27376577
Hosokawa, Takayuki; Watanabe, Masataka
How people work to obtain a reward depends on the context of the reward delivery, such as the presence/absence of competition and the contingency of reward delivery. Since resources are limited, winning a competition is critically important for organisms' obtaining a reward. People usually expect ordinary performance-reward contingency, with better performers obtaining better rewards. Unordinary reward contingency, such as egalitarianism (equal rewards/no-rewards to both good and poor performers), dampens people's motivation. We previously reported that monkeys were more motivated, and neurons in the lateral prefrontal cortex (LPFC) showed higher outcome-related activity in a competitive than in a noncompetitive game (Hosokawa and Watanabe, 2012). However, monkey's behavior and LPFC neuronal activity have not been examined in a competitive situation with an unordinary performance-reward contingency. Also, the fixed performance-reward contingency in the previous study did not allow us to examine effects of win/loss separately from those of reward/no-reward on prefrontal neuronal activity. Here, we employed the egalitarian competitive situation in which both the winner and loser, or neither of them, got a reward as well as the normal competitive situation in which only the winner got a reward. Monkey's behavioral performance greatly deteriorated in trials with the egalitarian outcome conditions. LPFC neurons showed activities that reflected the normal or egalitarian outcome condition while very few neurons coded win/loss independent of reward/no-reward. Importantly, we found neurons that showed reward-related activity in the normal, but not in the egalitarian outcome conditions, even though the same reward was given to the animal. These results indicate that LPFC may play an important role in monitoring the current reward contingency and integrating it with the performance outcome (win-loss) for better performing the competitive game, and thus for better survival
Yan, Chao; Su, Li; Wang, Yi; Xu, Ting; Yin, Da-Zhi; Fan, Ming-Xia; Deng, Ci-Ping; Hu, Yang; Wang, Zhao-Xin; Cheung, Eric F C; Lim, Kelvin O; Chan, Raymond C K
The role of the orbitofrontal cortex (OFC) in value processing is a focus of research. Conventional imaging analysis, where smoothing and averaging are employed, may not be sufficiently sensitive in studying the OFC, which has heterogeneous anatomical structures and functions. In this study, we employed representational similarity analysis (RSA) to reveal the multi-voxel fMRI patterns in the OFC associated with value processing during the anticipatory and the consummatory phases. We found that multi-voxel activation patterns in the OFC encoded magnitude and partial valence information (win vs. loss) but not outcome (favourable vs. unfavourable) during reward consummation. Furthermore, the lateral OFC rather than the medial OFC encoded loss information. Also, we found that OFC encoded values in a similar way to the ventral striatum (VS) or the anterior insula (AI) during reward anticipation regardless of motivated response and to the medial prefrontal cortex (MPFC) and the VS in reward consummation. In contrast, univariate analysis did not show changes of activation in the OFC. These findings suggest an important role of the OFC in value processing during reward anticipation and consummation. PMID:27378417
Konova, Anna B; Moeller, Scott J; Parvaz, Muhammad A; Froböse, Monja I; Alia-Klein, Nelly; Goldstein, Rita Z
There is some evidence that cocaine addiction manifests as more severe in women than men. Here, we examined whether these sex-specific differences in the clinical setting parallel differential neurobehavioral sensitivity to rewards in the laboratory setting. Twenty-eight (14 females/14 males) cocaine-dependent and 25 (11 females/14 males) healthy individuals completed a monetary reward task during fMRI. Results showed that the effects of cocaine dependence and sex overlapped in regions traditionally considered part of the mesocorticolimbic brain circuits including the hippocampus and posterior cingulate cortex (PCC), as well as those outside of this circuit (e.g., the middle temporal gyrus). The nature of this 'overlap' was such that both illness and female sex were associated with lower activations in these regions in response to money. Diagnosis-by-sex interactions instead emerged in the frontal cortex, such that cocaine-dependent females exhibited lower precentral gyrus and greater inferior frontal gyrus (IFG) activations relative to cocaine-dependent males and healthy females. Within these regions modulated both by diagnosis and sex, lower activation in the hippocampus and PCC, and higher IFG activations, correlated with increased subjective craving during the task. Results suggest sex-specific differences in addiction extend to monetary rewards and may contribute to core symptoms linked to relapse. PMID:26809268
刘耀中; 唐志文; 叶海英
Reward and punishment play an important role in the study of human cooperation today.In our daily lives,it often happens that a person deserves being rewarded but the reward does not come,or he deserves being punished but the punishment does not come, either.Previous studies did not discuss much about the situation in which a person makes the right response but does not receive the reward he deserves,or the wrong response but does not receive the punishment.In this study,we try to explore how individuals' brain will respond to both of the two conditions we mentioned above using the Flanker experimental paradigm and ERP(Event - related potential) technology in order to find out what the neural processing mechanisms are for those rewards and punishments,as well as their FRN effects.We also try to analyze the relationship between the individuals neural mechanism and the Reinforcement Sensitivity Theory using the behavioral inhibition system(BIS) / behavioral approach system(BAS) analytical methods to reveal the psychological processing mechanism of punishment and reward. Here,we selected 15 candidates and conducted a 2- stimulus type(reward vs.punishment)×2 expectation deviated(Yes vs. No) experiment.All the 15 candidates were induced to accept all of the four experimental treatments.The results showed that(1) the individual's expectation that was deviated caused higher FRN;(2) when the individual was punished,a higher FRN appeared,and when he was rewarded,a higher P3 appeared;(3) there was no significant relationship between FRN and individuals sensitivity of being punished or failing to be rewarded.All those results above indicate;(1) if a person does not receive the reward he deserves,the effect caused will be the same as being punished and the correlation between BIS and FRN is confirmed.Individuals will experience a negative emotion.So we suggest that such condition may be adjusted by the punishment system;(2) when the expected punishment does not appear
Roesch, Matthew R; Calu, Donna J.; Schoenbaum, Geoffrey
The dopamine system is thought to be involved in making decisions about reward. Here we recorded from the ventral tegmental area in rats learning to choose between differently delayed and sized rewards. As expected, the activity of many putative dopamine neurons reflected reward prediction errors, changing when the value of the reward increased or decreased unexpectedly. During learning, neural responses to reward in these neurons waned and responses to cues that predicted reward emerged. Not...
Full Text Available Dopaminergic neurons in the mammalian substantia nigra displaycharacteristic phasic responses to stimuli which reliably predict thereceipt of primary rewards. These responses have been suggested toencode reward prediction-errors similar to those used in reinforcementlearning. Here, we propose a model of dopaminergic activity in whichprediction error signals are generated by the joint action ofshort-latency excitation and long-latency inhibition, in a networkundergoing dopaminergic neuromodulation of both spike-timing dependentsynaptic plasticity and neuronal excitability. In contrast toprevious models, sensitivity to recent events is maintained by theselective modification of specific striatal synapses, efferent tocortical neurons exhibiting stimulus-specific, temporally extendedactivity patterns. Our model shows, in the presence of significantbackground activity, (i a shift in dopaminergic response from rewardto reward predicting stimuli, (ii preservation of a response tounexpected rewards, and (iii a precisely-timed below-baseline dip inactivity observed when expected rewards are omitted.
Joshua ePoore; Jennifer ePfeifer; Elliot eBerkman; Tristen eInagaki; Benjamin Locke Welborn; Matthew eLieberman
The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to...
Krystyna Anna Mathiak
Full Text Available Neurofeedback (NF based on real-time functional magnetic resonance imaging (rt-fMRI allows voluntary regulation of the activity in a selected brain region. For the training of this regulation, a well-designed feedback system is required. Social reward may serve as an effective incentive in NF paradigms, but its efficiency has not yet been tested. Therefore, we developed a social reward NF paradigm and assessed it in comparison with a typical visual NF paradigm (moving bar. We trained 24 healthy participants, on three consecutive days, to control activation in dorsal anterior cingulate cortex (ACC with fMRI-based NF. In the social feedback group, an avatar gradually smiled when ACC activity increased, whereas in the standard feedback group, a moving bar indicated the activation level. To assess a transfer of the NF training both groups were asked to up-regulate their brain activity without receiving feedback immediately before and after the NF training (pre- and post-test. Finally, the effect of the acquired NF training on ACC function was evaluated in a cognitive interference task (Simon task during the pre- and post-test. Social reward led to stronger activity in the ACC and reward-related areas during the NF training when compared to standard feedback. After the training, both groups were able to regulate ACC without receiving feedback, with a trend for stronger responses in the social feedback group. Moreover, despite a lack of behavioral differences, significant higher ACC activations emerged in the cognitive interference task, reflecting a stronger generalization of the NF training on cognitive interference processing after social feedback. Social reward can increase self-regulation in fMRI-based NF and strengthen its effects on neural processing in related tasks, such as cognitive interference. An advantage of social feedback is that a direct external reward is provided as in natural social interactions, opening perspectives for implicit
Tsao, Sinchai; Adam, Tanja C.; Goran, Michael I.; Singh, Manbir
The factors behind the neural mechanisms that motivate food choice and obesity are not well known. Furthermore, it is not known when these neural mechanisms develop and how they are influenced by both genetic and environmental factors. This study uses fMRI together with clinical data to shed light on the aforementioned questions by investigating how appetite-related activation in the brain changes with low versus high caloric foods in pre-pubescent girls. Previous studies have shown that obese adults have less striatal D2 receptors and thus reduced Dopamine (DA) signaling leading to the reward-deficit theory of obesity. However, overeating in itself reduces D2 receptor density, D2 sensitivity and thus reward sensitivity. The results of this study will show how early these neural mechanisms develop and what effect the drastic endocrinological changes during puberty has on these mechanisms. Our preliminary results showed increased activations in the Putamen, Insula, Thalamus and Hippocampus when looking at activations where High Calorie > Low Calorie. When comparing High Calorie > Control and Low Calorie > Control, the High > Control test showed increased significant activation in the frontal lobe. The Low > Control also yielded significant activation in the Left and Right Fusiform Gyrus, which did not appear in the High > Control test. These results indicate that the reward pathway activations previously shown in post-puberty and adults are present in pre-pubescent teens. These results may suggest that some of the preferential neural mechanisms of reward are already present pre-puberty.
Bastle, Ryan M; Peartree, Natalie A; Goenaga, Julianna; Hatch, Kayla N; Henricks, Angela; Scott, Samantha; Hood, Lauren E; Neisewander, Janet L
Smoking initiation predominantly occurs during adolescence, often in the presence of peers. Therefore, understanding the neural mechanisms underlying the rewarding effects of nicotine and social stimuli is vital. Using the conditioned place preference (CPP) procedure, we measured immediate early gene (IEG) expression in animals following exposure either to a reward-conditioned environment or to the unconditioned stimuli (US). Adolescent, male rats were assigned to the following CPP US conditions: (1) Saline+Isolated, (2) Nicotine+Isolated, (3) Saline+Social, or (4) Nicotine+Social. For Experiment 1, brain tissue was collected 90min following the CPP expression test and processed for Fos immunohistochemistry. We found that rats conditioned with nicotine with or without a social partner exhibited CPP; however, we found no group differences in Fos expression in any brain region analyzed, with the exception of the nucleus accumbens core that exhibited a social-induced attenuation in Fos expression. For Experiment 2, brain tissue was collected 90min following US exposure during the last conditioning session. We found social reward-induced increases in IEG expression in striatal and amydalar subregions. In contrast, nicotine reduced IEG expression in prefrontal and striatal subregions. Reward interactions were also found in the dorsolateral striatum, basolateral amygdala, and ventral tegmental area where nicotine alone attenuated IEG expression and social reward reversed this effect. These results suggest that in general social rewards enhance, whereas nicotine attenuates, activation of mesocorticolimbic regions; however, the rewards given together interact to enhance activation in some regions. The findings contribute to knowledge of how a social environment influences nicotine effects. PMID:27435419
Rademacher, Lena; Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N.
Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60–78 ...
Martin-Soelch, C; Chevalley, AF; Kunig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, KL
Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with (H2O)
Nikolova Yuliya S
Full Text Available Abstract Background Research into neural mechanisms of drug abuse risk has focused on the role of dysfunction in neural circuits for reward. In contrast, few studies have examined the role of dysfunction in neural circuits of threat in mediating drug abuse risk. Although typically regarded as a risk factor for mood and anxiety disorders, threat-related amygdala reactivity may serve as a protective factor against substance use disorders, particularly in individuals with exaggerated responsiveness to reward. Findings We used well-established neuroimaging paradigms to probe threat-related amygdala and reward-related ventral striatum reactivity in a sample of 200 young adult students from the ongoing Duke Neurogenetics Study. Recent life stress and problem drinking were assessed using self-report. We found a significant three-way interaction between threat-related amygdala reactivity, reward-related ventral striatum reactivity, and recent stress, wherein individuals with higher reward-related ventral striatum reactivity exhibit higher levels of problem drinking in the context of stress, but only if they also have lower threat-related amygdala reactivity. This three-way interaction predicted both contemporaneous problem drinking and problem drinking reported three-months later in a subset of participants. Conclusions These findings suggest complex interactions between stress and neural responsiveness to both threat and reward mediate problem drinking. Furthermore, they highlight a novel protective role for threat-related amygdala reactivity against drug use in individuals with high neural reactivity to reward.
Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia
Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. PMID:26499261
Kohls, Gregor; Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin
Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in r...
Full Text Available The neuromodulators serotonin, acetylcholine, and dopamine have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the roles of the other neuromodulators remain elusive. Reportedly, neurons in the dorsal raphe nucleus, one major source of serotonin, continually track the state of expectation of future rewards by showing a correlated response to the start of a behavioral task, reward cue presentation, and reward delivery. Here, we show that neurons in the pedunculopontine tegmental nucleus (PPTN, one major source of acetylcholine, showed similar encoding of the expectation of future rewards by a systematic increase or decrease in tonic activity. We recorded and analyzed PPTN neuronal activity in monkeys during a reward conditioned visually guided saccade task. The firing patterns of many PPTN neurons were tonically increased or decreased throughout the task period. The tonic activity pattern of neurons was correlated with their encoding of the predicted reward value; neurons exhibiting an increase or decrease in tonic activity showed higher or lower activity in the large reward-predicted trials, respectively. Tonic activity and reward-related modulation ended around the time of reward delivery. Additionally, some tonic changes in activity started prior to the appearance of the initial stimulus, and were related to the anticipatory fixational behavior. A partially overlapping population of neurons showed both the initial anticipatory response and subsequent predicted reward value-dependent activity modulation by their systematic increase or decrease of tonic activity. These bi-directional reward- and anticipatory behavior-related modulation patterns are suitable for the presumed role of the PPTN in reward processing and
Oei, Nicole Y. L.; Rombouts, Serge ARB; Soeter, Roelof P.; van Gerven, Joop M; Both, Stephanie
Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive–compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the ‘reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. You...
Tobler, Philippe N; Preller, Katrin H; Campbell-Meiklejohn, Daniel K;
-social reinforcements. We used functional neuroimaging in cocaine users to investigate explicit social reward as modeled by agreement of music preferences with music experts. In addition, we investigated non-social reward as modeled by winning desired music pieces. The study included 17 chronic cocaine users and 17...... the processing of non-drug rewards. Interestingly, in the posterior lateral orbitofrontal cortex, social reward responses of cocaine users decreased with the degree to which they were influenced by social feedback from the experts, a response pattern that was opposite to that observed in healthy...
Miyazaki, Kayoko W.; Miyazaki, Katsuhiko; Doya, Kenji
The forebrain serotonergic system is a crucial component in the control of impulsive behaviours. However, there is no direct evidence for natural serotonin activity during behaviours for delayed rewards as opposed to immediate rewards. Herein we show that serotonin efflux is enhanced while rats perform a task that requires waiting for a delayed reward. We simultaneously measured the levels of serotonin and dopamine in the dorsal raphe nucleus using in vivo microdialysis. Rats performed a sequ...
Keating, Charlotte; Tilbrook, Alan J; Rossell, Susan L; Enticott, Peter G; Fitzgerald, Paul B
Individuals with anorexia nervosa (AN) demonstrate a relentless engagement in behaviors aimed to reduce their weight, which leads to severe underweight status, and occasionally death. Neurobiological abnormalities, as a consequence of starvation are controversial: evidence, however, demonstrates abnormalities in the reward system of patients, and recovered individuals. Despite this, a unifying explanation for reward abnormalities observed in AN and their relevance to symptoms of the illness, remains incompletely understood. Theories explaining reward dysfunction have conventionally focused on anhedonia, describing that patients have an impaired ability to experience reward or pleasure. We review taste reward literature and propose that patients' reduced responses to conventional taste-reward tasks may reflect a fear of weight gain associated with the caloric nature of the tasks, rather than an impaired ability to experience reward. Consistent with this, we propose that patients are capable of 'liking' hedonic taste stimuli (e.g., identifying them), however, they do not 'want' or feel motivated for the stimuli in the same way that healthy controls report. Recent brain imaging data on more complex reward processing tasks provide insights into fronto-striatal neural circuit dysfunction related to altered reward processing in AN that challenges the relevance of anhedonia in explaining reward dysfunction in AN. In this way, altered activity of the anterior cingulate cortex and striatum could explain patients' pathological engagement in behaviors they consider rewarding (e.g., self-starvation) that are otherwise aversive or punishing, to those without the eating disorder. Such evidence for altered patterns of brain activity associated with reward processing tasks in patients and recovered individuals may provide important information about mechanisms underlying symptoms of AN, their future investigation, and the development of treatment approaches. PMID:22349445
Choi, Uk-Su; Kim, Sun-Young; Sim, Hyeon Jeong; Lee, Seo-Young; Park, Sung-Yeon; Jeong, Joon-Sup; Seol, Kyeong In; Yoon, Hyo-Woon; Jhung, Kyungun; Park, Jee-In; Cheon, Keun-Ah
Purpose We aimed to determine whether Autism Spectrum Disorder (ASD) would show neural abnormality of the social reward system using functional MRI (fMRI). Materials and Methods 27 ASDs and 12 typically developing controls (TDCs) participated in this study. The social reward task was developed, and all participants performed the task during fMRI scanning. Results ASDs and TDCs with a social reward learning effect were selected on the basis of behavior data. We found significant differences in...
Dreher, Jean-Claude; Schmidt, Peter J.; Kohn, Philip; Furman, Daniella; Rubinow, David; Berman, Karen Faith
There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days ...
Hauser, Tobias U; Iannaccone, Reto; Walitza, Susanne; Brandeis, Daniel; Brem, Silvia
Adolescence is associated with quickly changing environmental demands which require excellent adaptive skills and high cognitive flexibility. Feedback-guided adaptive learning and cognitive flexibility are driven by reward prediction error (RPE) signals, which indicate the accuracy of expectations and can be estimated using computational models. Despite the importance of cognitive flexibility during adolescence, only little is known about how RPE processing in cognitive flexibility deviates between adolescence and adulthood. In this study, we investigated the developmental aspects of cognitive flexibility by means of computational models and functional magnetic resonance imaging (fMRI). We compared the neural and behavioral correlates of cognitive flexibility in healthy adolescents (12-16years) to adults performing a probabilistic reversal learning task. Using a modified risk-sensitive reinforcement learning model, we found that adolescents learned faster from negative RPEs than adults. The fMRI analysis revealed that within the RPE network, the adolescents had a significantly altered RPE-response in the anterior insula. This effect seemed to be mainly driven by increased responses to negative prediction errors. In summary, our findings indicate that decision making in adolescence goes beyond merely increased reward-seeking behavior and provides a developmental perspective to the behavioral and neural mechanisms underlying cognitive flexibility in the context of reinforcement learning. PMID:25234119
William H. Alexander
Full Text Available The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC, has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs, while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.
Full Text Available The human reward system is sensitive to both social (e.g., validation and non-social rewards (e.g., money and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward—social validation—and this activity’s relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants’ expectations for their romantic partners’ positive regard of them were confirmed (validated or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.
De Decker, Annelies; Sioen, Isabelle; Verbeken, Sandra; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan
In the current study, the associations of reward sensitivity with weight related behaviors and body mass index were investigated in a general population sample of 443 Flemish children (50.3% boys) aged 5.5-12 years. Cross-sectional data on palatable food consumption frequency, screen time, physical activity, parental education level and measured length and weight were collected. The Drive subscale of the 'Behavioral Inhibition Scale/Behavioral Activation Scale' was used as a short method to measure reward sensitivity. A significant positive association of reward sensitivity with the fast food and sweet drink consumption frequency was found. Furthermore, a significant positive association of reward sensitivity with the z-score of body mass index was demonstrated, which explained additional variance to the variance explained by palatable food consumption frequency, screen time, physical activity and parental education level. Hence, the assessment of reward sensitivity may have an added value to the assessment of weight-related behavior indicators when evaluating the determinants of overweight in a child. In sum, children high in reward sensitivity might be more attracted to fast food and sweet drinks, and hence, might be more vulnerable to develop unfavorable food habits and overweight. These findings suggest that considering inter-individual differences in reward sensitivity is of importance in future childhood obesity prevention campaigns. PMID:26898320
Manoonpong, Poramate; Kolodziejski, Christoph; Wörgötter, Florentin;
associations. Based on these biological findings, we propose a new learning model to achieve successful control policies for artificial systems. This model combines correlation-based learning using input correlation learning (ICO learning) and reward-based learning using continuous actor–critic reinforcement...
Guo, Zongjun; Chen, Juan; Liu, Shien; Li, Yuhuan; Sun, Bo; Gao, Zhenbo
Reward-based decision-making has been found to activate several brain areas, including the ventrolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and mesolimbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healt...
Nielsen, Mette Ødegaard; Rostrup, Egill; Wulff, Sanne;
associated with an increase in mean (SD) reward activity in the same region during treatment (0.28 [0.74]; F37,1 = 4.48; P = .04). Conclusions and Relevance: Activity in striatal regions of the reward system appears to be associated with the individual variability in the predisposition for antipsychotic......-associated weight gain. Moreover, pharmacologic modulation of the reward system may play a role in antipsychotic-associated weight gain.......Importance: Weight gain is a common and serious adverse effect of antipsychotic treatment. A variable individual predisposition to development of metabolic disturbances calls for predictive biological markers. Objectives: To investigate whether attenuated striatal activity during reward...
Full Text Available In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED, a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating disorders, our findings suggest a role of an active reward system during sleep in the manifestation of SRED.
Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert
Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m(2) ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a 'wanting' and 'liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814
Tau, Gregory Z.; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G.; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S.
Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary reward...
Lega, Bradley C; Kahana, Michael J; Jaggi, Jurg; Baltuch, Gordon H; Zaghloul, Kareem
Accumulated evidence from animal studies implicates the ventral striatum in the processing of reward information. Recently, deep brain stimulation (DBS) surgery has enabled researchers to analyze neurophysiological recordings from humans engaged in reward tasks. We present data recorded from the human ventral striatum during deep brain stimulation surgery as a participant played a video game coupled to the receipt of visual reward images. To our knowledge, we identify the first instances of reward-sensitive single unit activity in the human ventral striatum. Local field potential data suggest that alpha oscillations are sensitive to positive feedback, whereas beta oscillations exhibit significantly higher power during unrewarded trials. We report evidence of alpha-gamma cross-frequency coupling that differentiates between positive and negative feedback. PMID:21975313
de Macedo, Isabel Cristina; de Freitas, Joice Soares; da Silva Torres, Iraci Lucena
The changes in eating patterns that have occurred in recent decades are an important cause of obesity. Food intake and energy expenditure are controlled by a complex neural system involving the hypothalamic centers and peripheral satiety system (gastrointestinal and pancreatic hormones). Highly palatable and caloric food disrupts appetite regulation; however, palatable foods induce pleasure and reward. The cafeteria diet is such a palatable diet and has been shown consistently to increase body weight and induce hyperplasia in animal obesity models. Moreover, palatable high-fat foods (such as those of the cafeteria diet) can induce addiction-like deficits in brain reward function and are considered to be an important source of motivation that might drive overeating and contribute to the development of obesity. The mechanism of neural adaptation triggered by palatable foods is similar to those that have been reported for nondrug addictions and long-term drug use. Thus, this review attempts to describe the potential mechanisms that might lead to highly palatable diets, such as the cafeteria diet, triggering addiction, or compulsion through the reward system. PMID:27087806
Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K
Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states. PMID:26708106
Kim, Ji-Woong; Kim, Sung-Eun; Kim, Jae-Jin; Jeong, Bumseok; Park, Chang-Hyun; Son, Ae Ree; Song, Ji Eun; Ki, Seon Wan
Compassion is one of the essential components which enable individuals to enter into and maintain relationships of caring. Compassion tends to motivate us to help people who are emotionally suffering. It is also known that a feeling of intrinsic reward may occur as a result of experiencing compassion for others. We conducted this study to understand the neural nature of compassion for other people's emotional state. Twenty-one healthy normal volunteers participated in this study. We used a 2 x 2 factorial design in which each subject was asked to assume a compassionate attitude or passive attitude while viewing the sad or neutral facial affective pictures during functional magnetic imaging. The main effect of a compassionate attitude was observed in the medial frontal cortex, the subgenual frontal cortex, the inferior frontal cortex and the midbrain regions. A test of the interaction between a compassionate attitude and sad facial affect revealed significant activations in the midbrain-ventral striatum/septal network region. The results of this study suggest that taking a compassionate attitude towards other people's sad expressions modulate the activities of the midbrain-ventral striatum/septal region network, which is known to play a role in the prosocial/social approach motivation and its accompanied rewarding feeling. PMID:19428038
Kerr, Kara L; Avery, Jason A; Barcalow, Joel C; Moseman, Scott E; Bodurka, Jerzy; Bellgowan, Patrick S F; Simmons, W Kyle
Trait impulsivity is characterized by behavioral disinhibition and rash decision-making that contribute to many maladaptive behaviors. Previous research demonstrates that trait impulsivity is related to the activity of brain regions underlying reward sensitivity and emotion regulation, but little is known about this relationship in the context of immediately available primary reward. This is unfortunate, as impulsivity in these contexts can lead to unhealthy behaviors, including poor food choices, dangerous drug use and risky sexual practices. In addition, little is known about the relationship between integration of reward and affective neurocircuitry, as measured by resting-state functional connectivity, and trait impulsivity in everyday life, as measured with a commonly used personality inventory. We therefore asked healthy adults to undergo a functional magnetic resonance imaging task in which they saw cues indicating the imminent oral administration of rewarding taste, as well as a resting-state scan. Trait impulsivity was associated with increased activation during anticipation of primary reward in the anterior cingulate cortex (ACC) and amygdala. Additionally, resting-state functional connectivity between the ACC and the right amygdala was negatively correlated with trait impulsivity. These findings demonstrate that trait impulsivity is related not only to ACC-amygdala activation but also to how tightly coupled these regions are to one another. PMID:24526181
Losin, Elizabeth A. Reynolds; Iacoboni, Macro; Martin, Alia; DAPRETTO, MIRELLA
Imitation is an important component of human social learning throughout life. Theoretical models and empirical data from anthropology and psychology suggest that people tend to imitate self-similar individuals, and that such imitation biases increase the adaptive value (e.g., self-relevance) of learned information. It is unclear, however, what neural mechanisms underlie people's tendency to imitate those similar to themselves. We focused on the own-gender imitation bias, a pervasive bias thou...
Zongjun Guo; Juan Chen; Shien Liu; Yuhuan Li; Bo Sun; Zhenbo Gao
Reward-based decision-making has been found to activate several brain areas, including the ven-trolateral prefrontal lobe, orbitofrontal cortex, anterior cingulate cortex, ventral striatum, and meso-limbic dopaminergic system. In this study, we observed brain areas activated under three degrees of uncertainty in a reward-based decision-making task (certain, risky, and ambiguous). The tasks were presented using a brain function audiovisual stimulation system. We conducted brain scans of 15 healthy volunteers using a 3.0T magnetic resonance scanner. We used SPM8 to analyze the location and intensity of activation during the reward-based decision-making task, with respect to the three conditions. We found that the orbitofrontal cortex was activated in the certain reward con-dition, while the prefrontal cortex, precentral gyrus, occipital visual cortex, inferior parietal lobe, ce-rebel ar posterior lobe, middle temporal gyrus, inferior temporal gyrus, limbic lobe, and midbrain were activated during the ‘risk’ condition. The prefrontal cortex, temporal pole, inferior temporal gyrus, occipital visual cortex, and cerebel ar posterior lobe were activated during ambiguous deci-sion-making. The ventrolateral prefrontal lobe, frontal pole of the prefrontal lobe, orbitofrontal cortex, precentral gyrus, inferior temporal gyrus, fusiform gyrus, supramarginal gyrus, inferior parietal lo-bule, and cerebel ar posterior lobe exhibited greater activation in the‘risk’ than in the‘certain’ con-dition (P<0.05). The frontal pole and dorsolateral region of the prefrontal lobe, as wel as the ce-rebel ar posterior lobe, showed significantly greater activation in the ‘ambiguous’ condition com-pared to the ‘risk’ condition (P < 0.05). The prefrontal lobe, occipital lobe, parietal lobe, temporal lobe, limbic lobe, midbrain, and posterior lobe of the cerebel um were activated during deci-sion-making about uncertain rewards. Thus, we observed different levels and regions of
Full Text Available Pathological gambling (PG is a chronic mental disorder characterized by a difficulty restraining gambling behavior despite negative consequences. Although brain abnormalities in patients with substance use disorders are caused by repetitive drug use and recover partly with drug abstinence, the relationship between brain activity and duration of illness or abstinence of gambling behavior in PG patients remains unclear. Here, using functional magnetic resonance imaging, we compared the brain activity of 23 PG patients recruited from a treatment facility with 27 demographically-matched healthy control subjects during reward anticipation, and examined the correlations between brain activity and duration of illness or abstinence in PG patients. During reward anticipation, PG patients showed decreased activity compared to healthy controls in a broad range of the reward system regions, including the insula cortex. In PG patients, activation in the left insula showed a significant negative correlation with illness duration. Our findings suggest that insular activation during reward anticipation may serve as a marker of progression of pathological gambling.
Nicholas A Donnelly
Full Text Available Actions expressed prematurely without regard for their consequences are considered impulsive. Such behaviour is governed by a network of brain regions including the prefrontal cortex (PFC and nucleus accumbens (NAcb and is prevalent in disorders including attention deficit hyperactivity disorder (ADHD and drug addiction. However, little is known of the relationship between neural activity in these regions and specific forms of impulsive behaviour. In the present study we investigated local field potential (LFP oscillations in distinct sub-regions of the PFC and NAcb on a 5-choice serial reaction time task (5-CSRTT, which measures sustained, spatially-divided visual attention and action restraint. The main findings show that power in gamma frequency (50-60 Hz LFP oscillations transiently increases in the PFC and NAcb during both the anticipation of a cue signalling the spatial location of a nose-poke response and again following correct responses. Gamma oscillations were coupled to low-frequency delta oscillations in both regions; this coupling strengthened specifically when an error response was made. Theta (7-9 Hz LFP power in the PFC and NAcb increased during the waiting period and was also related to response outcome. Additionally, both gamma and theta power were significantly affected by upcoming premature responses as rats waited for the visual cue to respond. In a subgroup of rats showing persistently high levels of impulsivity we found that impulsivity was associated with increased error signals following a nose-poke response, as well as reduced signals of previous trial outcome during the waiting period. Collectively, these in-vivo neurophysiological findings further implicate the PFC and NAcb in anticipatory impulsive responses and provide evidence that abnormalities in the encoding of rewarding outcomes may underlie trait-like impulsive behaviour.
Full Text Available The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefore propose that pathological gambling in PD results from the need to seek higher rewards to overcome the blunted response in this system.
Ribeiro, Maria J.; Schofield, Michael G.; Kemenes, Ildiko; O'Shea, Michael; Kemenes, Gyorgy; Benjamin, Paul R.
Although an important role for the mitogen-activated protein kinase (MAPK) has been established for memory consolidation in a variety of learning paradigms, it is not known if this pathway is also involved in appetitive classical conditioning. We address this question by using a single-trial food-reward conditioning paradigm in the freshwater…
We study a class of artificial neural networks in which a physics-like conservation law upon the activity of connected neurons is imposed at each time. We postulate that the modification of the network activities may be interpreted as a learning capability if a judicious conservation law is chosen. We illustrate our claim by modeling a rat behavior in a labyrinth: the exploration of the labyrinth permits to create connections between neurons (latent learning), whereas the discovery of food in...
Dominik R Bach
Full Text Available The ability to flexibly adapt responses to changes in the environment is important for survival. Previous research in humans separately examined the mechanisms underlying acquisition and extinction of aversive and appetitive conditioned responses. It is yet unclear how aversive and appetitive learning interact on a neural level during counterconditioning in humans. This functional magnetic resonance imaging (fMRI study investigated the interaction of fear conditioning and subsequent reward learning. In the first phase (fear acquisition, images predicted aversive electric shocks or no aversive outcome. In the second phase (counterconditioning, half of the CS+ and CS- were associated with monetary reward in the absence of electric stimulation. The third phase initiated reinstatement of fear through presentation of electric shocks, followed by CS presentation in the absence of shock or reward. Results indicate that participants were impaired at learning the reward contingencies for stimuli previously associated with shock. In the counterconditioning phase, prior fear association interacted with reward representation in the amygdala, where activation was decreased for rewarded compared to unrewarded CS- trials, while there was no reward-related difference in CS+ trials. In the reinstatement phase, an interaction of previous fear association and previous reward status was observed in a reward network consisting of substantia nigra / ventral tegmental area (SN/VTA, striatum and orbitofrontal cortex (OFC, where activation was increased by previous reward association only for CS- but not for CS+ trials. These findings suggest that during counterconditioning, prior fear conditioning interferes with reward learning, subsequently leading to lower activation of the reward network.
Klein-Flügge, Miriam Cornelia; Barron, Helen Catharine; Brodersen, Kay Henning; Dolan, Raymond J; Behrens, Timothy Edward John
A dominant focus in studies of learning and decision-making is the neural coding of scalar reward value. This emphasis ignores the fact that choices are strongly shaped by a rich representation of potential rewards. Here, using fMRI adaptation, we demonstrate that responses in the human orbitofrontal cortex (OFC) encode a representation of the specific type of food reward predicted by a visual cue. By controlling for value across rewards and by linking each reward with two distinct stimuli, we could test for representations of reward-identity that were independent of associative information. Our results show reward-identity representations in a medial-caudal region of OFC, independent of the associated predictive stimulus. This contrasts with a more rostro-lateral OFC region encoding reward-identity representations tied to the predicate stimulus. This demonstration of adaptation in OFC to reward specific representations opens an avenue for investigation of more complex decision mechanisms that are not immediately accessible in standard analyses, which focus on correlates of average activity. PMID:23407973
Full Text Available Due to ongoing development, adolescence may be a period of heightened vulnerability to the neurotoxic effects of alcohol. Binge drinking may alter reward-driven behavior and neurocircuitry, thereby increasing risk for escalating alcohol use. Therefore, we compared reward processing in adolescents with and without a history of recent binge drinking. At their baseline study visit, all participants (age = 14.86 ± 0.88 were free of heavy alcohol use and completed a modified version of the Wheel of Fortune (WOF functional magnetic resonance imaging task. Following this visit, 17 youth reported binge drinking on ≥3 occasions within a 90 day period and were matched to 17 youth who remained alcohol and substance-naïve. All participants repeated the WOF task during a second visit (age = 16.83 ± 1.22. No significant effects were found in a region of interest analysis of the ventral striatum, but whole-brain analyses showed significant group differences in reward response at the second study visit in the left cerebellum, controlling for baseline visit brain activity (p/α < 0.05, which was negatively correlated with mean number of drinks consumed/drinking day in the last 90 days. These findings suggest that binge drinking during adolescence may alter brain activity during reward processing in a dose-dependent manner.
Horner, Katy M; Finlayson, Graham; Byrne, Nuala M; King, Neil A
Habitual exercise could contribute to weight management by altering processes of food reward via the gut-brain axis. We investigated hedonic processes of food reward in active and inactive men and characterised relationships with gastric emptying and body fat. Forty-four men (active: n=22; inactive: n=22, BMI range 21-36kg/m(2); percent fat mass range 9-42%) were studied. Participants were provided with a standardised fixed breakfast and an ad libitum lunch meal 5h later. Explicit liking, implicit wanting and preference among high-fat, low-fat, sweet and savoury food items were assessed immediately post-breakfast (fed state) and again pre-lunch (hungry state) using the Leeds Food Preference Questionnaire. Gastric emptying was assessed by (13)C-octanoic acid breath test. Active individuals exhibited a lower liking for foods overall and a greater implicit wanting for low-fat savoury foods in the fed state, compared to inactive men. Differences in the fed state remained significant after adjusting for percent fat mass. Active men also had a greater increase in liking for savoury foods in the interval between breakfast and lunch. Faster gastric emptying was associated with liking for savoury foods and with an increase in liking for savoury foods in the postprandial interval. In contrast, greater implicit wanting for high-fat foods was associated with slower gastric emptying. These associations were independent of each other, activity status and body fat. In conclusion, active and inactive men differ in processes of food reward. The rate of gastric emptying may play a role in the association between physical activity status and food reward, via the gut-brain axis. PMID:27072508
Carelli, Regina M; West, Elizabeth A
An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine
Gnadt, William; Grossberg, Stephen
How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goal-oriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and size-invariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory
Tomasi, Dardo; Wang, Gene-Jack; Studentsova, Yana; Volkow, Nora D
Temporal prediction (TP) is needed to anticipate future events and is essential for survival. Our sense of time is modulated by emotional and interoceptive (corporal) states that are hypothesized to rely on a dopamine (DA)-modulated "internal clock" in the basal ganglia. However, the neurobiological substrates for TP in the human brain have not been identified. We tested the hypothesis that TP involves DA striato-cortical pathways, and that accurate responses are reinforcing in themselves and activate the nucleus accumbens (NAc). Functional magnetic resonance imaging revealed the involvement of the NAc and anterior insula in the temporal precision of the responses, and of the ventral tegmental area in error processing. Moreover, NAc showed higher activation for successful than for unsuccessful trials, indicating that accurate TP per se is rewarding. Inasmuch as activation of the NAc is associated with drug-induced addictive behaviors, its activation by accurate TP could help explain why video games that rely on TP can trigger compulsive behaviors. PMID:25389123
Full Text Available The use of molecular tools to study the neurobiology of complex behaviors has been hampered by an inability to target the desired changes to relevant groups of neurons. Specific memories and specific sensory representations are sparsely encoded by a small fraction of neurons embedded in a sea of morphologically and functionally similar cells. In this review we discuss genetics techniques that are being developed to address this difficulty. In several studies the use of promoter elements that are responsive to neural activity have been used to drive long lasting genetic alterations into neural ensembles that are activated by natural environmental stimuli. This approach has been used to examine neural activity patterns during learning and retrieval of a memory, to examine the regulation of receptor trafficking following learning and to functionally manipulate a specific memory trace. We suggest that these techniques will provide a general approach to experimentally investigate the link between patterns of environmentally activated neural firing and cognitive processes such as perception and memory.
Full Text Available An emerging literature suggests that the mPFC is crucial for the ability to track behavioral outcomes over time and has a critical role in successful foraging. Here, we examine this issue by analyzing changes in neuronal spike activity and local field potentials in the rat mPFC in relation to the consumption of rewarding stimuli. Using multi-electrode recording methods, we simultaneously recorded from ensembles of neurons and field potentials in the mPFC during the performance of an operant delayed alternation task and a variable-interval licking procedure. In both tasks, we found that consummatory behavior (licking activates many mPFC neurons and is associated with theta-band phase locking by mPFC field potentials. Many neurons that were modulated by the delivery of reward were also modulated when rats emitted bouts of licks during the period of consumption. The majority of these licking-modulated neurons were found in the rostral part of the prelimbic cortex, a region that is heavily interconnected with the gustatory insular cortex and projects to subcortical feeding-related centers. Based on the tight coupling between spike activity, theta-band phase locking, and licking behavior, we suggest that reward-related activity in the mPFC is driven by consummatory behavior.
Gearhardt, Ashley N; Yokum, Sonja; Stice, Eric; Harris, Jennifer L; Brownell, Kelly D
Adolescents view thousands of food commercials annually, but the neural response to food advertising and its association with obesity is largely unknown. This study is the first to examine how neural response to food commercials differs from other stimuli (e.g. non-food commercials and television show) and to explore how this response may differ by weight status. The blood oxygen level-dependent functional magnetic resonance imaging activation was measured in 30 adolescents ranging from lean to obese in response to food and non-food commercials imbedded in a television show. Adolescents exhibited greater activation in regions implicated in visual processing (e.g. occipital gyrus), attention (e.g. parietal lobes), cognition (e.g. temporal gyrus and posterior cerebellar lobe), movement (e.g. anterior cerebellar cortex), somatosensory response (e.g. postcentral gyrus) and reward [e.g. orbitofrontal cortex and anterior cingulate cortex (ACC)] during food commercials. Obese participants exhibited less activation during food relative to non-food commercials in neural regions implicated in visual processing (e.g. cuneus), attention (e.g. posterior cerebellar lobe), reward (e.g. ventromedial prefrontal cortex and ACC) and salience detection (e.g. precuneus). Obese participants did exhibit greater activation in a region implicated in semantic control (e.g. medial temporal gyrus). These findings may inform current policy debates regarding the impact of food advertising to minors. PMID:23576811
Full Text Available Despite evidence supporting a relationship between impulsivity and naturalistic risk-taking, the relationship of impulsivity with laboratory-based measures of risky decision-making remains unclear. One factor contributing to this gap in our understanding is the degree to which different risky decision-making tasks vary in their details. We conducted an fMRI investigation of the Angling Risk Task (ART, which is an improved behavioral measure of risky decision-making. In order to examine whether the observed pattern of neural activation was specific to the ART or generalizable, we also examined correlates of the Balloon Analogue Risk Taking (BART task in the same sample of 23 healthy adults. Exploratory analyses were conducted to examine the relationship between neural activation, performance, impulsivity and self-reported risk-taking. While activation in a valuation network was associated with reward tracking during the ART but not the BART, increased fronto-cingulate activation was seen during risky choice trials in the BART as compared to the ART. Thus, neural activation during risky decision-making trials differed between the two tasks, and this observation was likely driven by differences in task parameters, namely the absence vs. presence of ambiguity and/or stationary vs. increasing probability of loss on the ART and BART, respectively. Exploratory association analyses suggest that sensitivity of neural response to the magnitude of potential reward during the ART was associated with a suboptimal performance strategy, higher scores on a scale of dysfunctional impulsivity and a greater likelihood of engaging in risky behaviors, while this pattern was not seen for the BART. Our results suggest that the ART is decomposable and associated with distinct patterns of neural activation; this represents a preliminary step towards characterizing a behavioral measure of risky decision-making that may support a better understanding of naturalistic risk-taking.
Chein, Jason; Albert, Dustin; O’Brien, Lia; Uckert, Kaitlyn; Steinberg, Laurence
The presence of peers increases risk taking among adolescents but not adults. We posited that the presence of peers may promote adolescent risk taking by sensitizing brain regions associated with the anticipation of potential rewards. Using fMRI, we measured brain activity in adolescents, young adults, and adults as they made decisions in a simulated driving task. Participants completed one task block while alone, and one block while their performance was observed by peers in an adjacent room...
Jordi Riba; Krämer, Ulrike M.; Marcus Heldmann; Sylvia Richter; Münte, Thomas F.
The use of D2/D3 dopaminergic agonists in Parkinson's disease (PD) may lead to pathological gambling. In a placebo-controlled double-blind study in healthy volunteers, we observed riskier choices in a lottery task after administration of the D3 receptor-preferring agonist pramipexole thus mimicking risk-taking behavior in PD. Moreover, we demonstrate decreased activation in the rostral basal ganglia and midbrain, key structures of the reward system, following unexpected high gains and therefo...
Gradin, Victoria; Waiter, Gordon; O'Connor, Akira Robert; Romaniuk, Liana; Stickle, Catriona; Matthews, Keith; Hall, Jeremy; Steele, Douglas
Theories of schizophrenia propose that abnormal functioning of the neural reward system is linked to negative and psychotic symptoms, by disruption of reward processing and promotion of context-independent false associations. Recently it has been argued that an insula-anterior cingulate cortex (ACC) salience network system enables switching of brain states from the default mode to a task-related activity mode. Abnormal interaction between the insula-ACC system and reward processing regions ma...
Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.
Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…
Ricciardi, L. M.; Lánský, Petr
London : Nature publishing group, 2003 - (Nadel, L.), s. 968-972 ISBN 0-333-79261-0 R&D Projects: GA ČR GA309/02/0168 Institutional research plan: CEZ:AV0Z5011922 Keywords : Neuronal activity, Diffusion model Subject RIV: ED - Physiology
Full Text Available The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2 × 2 factorial design, while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude emerged at ∼ 100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20-30 Hz and low (13-20 Hz beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine.
Blum, Kenneth; Liu, Yijun; Wang, Wei; Wang, Yarong; Zhang, Yi; Oscar-Berman, Marlene; Smolen, Andrew; Febo, Marcelo; Han, David; Simpatico, Thomas; Cronjé, Frans J; Demetrovics, Zsolt; Gold, Mark S
Recently, Willuhn et al. reported that cocaine use and even non-substance-related addictive behavior increases as dopaminergic function is reduced. Chronic cocaine exposure has been associated with decreases in D2/D3 receptors and was also associated with lower activation of cues in occipital cortex and cerebellum, in a recent PET study by Volkow's et al. Therefore, treatment strategies, like dopamine agonist therapy, that might conserve dopamine function may be an interesting approach to relapse prevention in psychoactive drug and behavioral addictions. To this aim, we evaluated the effect of KB220Z™ on reward circuitry of 10 heroin addicts undergoing protracted abstinence (average 16.9 months). In a randomized placebo-controlled crossover study of KB220Z, five subjects completed a triple-blinded experiment in which the subject, the person administering the treatment, and the person evaluating the response to treatment were blinded to the treatment that any particular subject was receiving. In addition, nine subjects were genotyped utilizing the GARSDX™ test. We preliminarily report that KB220Z induced an increase in BOLD activation in caudate-accumbens-dopaminergic pathways compared to placebo following 1-hour acute administration. Furthermore, KB220Z also reduced resting-state activity in the putamen of abstinent heroin addicts. In the second phase of this pilot study of all 10 abstinent heroin-dependent subjects, we observed that three brain regions of interest were significantly activated from resting state by KB220Z compared to placebo (p addiction by direct or indirect dopaminergic interaction. Due to small sample size, we caution definitive interpretation of these preliminary results, and confirmation with additional research and ongoing rodent and human studies of KB220Z is required. PMID:25526228
Sun, Ninglei; Laviolette, Steven R
The mesolimbic pathway comprising the ventral tegmental area (VTA) and projection terminals in the nucleus accumbens (NAc) has been identified as a critical neural system involved in processing both the rewarding and aversive behavioral effects of nicotine. Transmission through dopamine (DA) receptors functionally modulates these effects directly within the NAc. Nevertheless, the neuronal mechanisms within the NAc responsible for these bivalent behavioral effects are presently not known. Usin...
Periodic neural activity not locked to the stimulus or to motor responses is usually ignored. Here, we present new tools for modeling and quantifying the information transmission based on periodic neural activity that occurs with quasi-random phase relative to the stimulus. We propose a model to reproduce characteristic features of oscillatory spike trains, such as histograms of inter-spike intervals and phase locking of spikes to an oscillatory influence. The proposed model is based on an inhomogeneous Gamma process governed by a density function that is a product of the usual stimulus-dependent rate and a quasi-periodic function. Further, we present an analysis method generalizing the direct method (Rieke et al, 1999; Brenner et al, 2000) to assess the information content in such data. We demonstrate these tools on recordings from relay cells in the lateral geniculate nucleus of the cat.
Kenkel, W M; Yee, J R; Moore, K; Madularu, D; Kulkarni, P; Gamber, K; Nedelman, M; Ferris, C F
Anxiety and social deficits, often involving communication impairment, are fundamental clinical features of fragile X syndrome. There is growing evidence that dysregulation in reward processing is a contributing factor to the social deficits observed in many psychiatric disorders. Hence, we hypothesized that transgenic fragile X mental retardation 1 gene (fmr1) KO (FX) rats would display alterations in reward processing. To this end, awake control and FX rats were imaged for changes in blood oxygen level dependent (BOLD) signal intensity in response to the odor of almond, a stimulus to elicit the innate reward response. Subjects were 'odor naive' to this evolutionarily conserved stimulus. The resulting changes in brain activity were registered to a three-dimensional segmented, annotated rat atlas delineating 171 brain regions. Both wild-type (WT) and FX rats showed robust brain activation to a rewarding almond odor, though FX rats showed an altered temporal pattern and tended to have a higher number of voxels with negative BOLD signal change from baseline. This pattern of greater negative BOLD was especially apparent in the Papez circuit, critical to emotional processing and the mesolimbic/habenular reward circuit. WT rats showed greater positive BOLD response in the supramammillary area, whereas FX rats showed greater positive BOLD response in the dorsal lateral striatum, and greater negative BOLD response in the retrosplenial cortices, the core of the accumbens and the lateral preoptic area. When tested in a freely behaving odor-investigation paradigm, FX rats failed to show the preference for almond odor which typifies WT rats. However, FX rats showed investigation profiles similar to WT when presented with social odors. These data speak to an altered processing of this highly salient novel odor in the FX phenotype and lend further support to the notion that altered reward systems in the brain may contribute to fragile X syndrome symptomology. PMID:27003189
Herwig Uwe; Kaffenberger Tina; Schell Caroline; Jäncke Lutz; Brühl Annette B
Abstract Background Self-referential cognitions are important for self-monitoring and self-regulation. Previous studies have addressed the neural correlates of self-referential processes in response to or related to external stimuli. We here investigated brain activity associated with a short, exclusively mental process of self-reflection in the absence of external stimuli or behavioural requirements. Healthy subjects reflected either on themselves, a personally known or an unknown person dur...
Kujawa, Autumn; Proudfit, Greg Hajcak; Kessel, Ellen M; Dyson, Margaret; Olino, Thomas; Klein, Daniel N
Reward reactivity and positive emotion are key components of a theoretical, early-emerging approach motivational system, yet few studies have examined associations between positive emotion and neural reactivity to reward across development. In this multi-method prospective study, we examined the association of laboratory observations of positive emotionality (PE) at age 3 and self-reported positive affect (PA) at age 9 with an event-related potential component sensitive to the relative response to winning vs. losing money, the feedback negativity (ΔFN), at age 9 (N=381). Males had a larger ΔFN than females, and both greater observed PE at age 3 and self-reported PA at age 9 significantly, but modestly, predicted an enhanced ΔFN at age 9. Negative emotionality and behavioral inhibition did not predict ΔFN. Results contribute to understanding the neural correlates of PE and suggest that the FN and PE may be related to the same biobehavioral approach system. PMID:25433097
Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A.; Olson, Lars; Werme, Martin
Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genet...
Schevernels, Hanne; Krebs, Ruth M.; Santens, Patrick; Woldorff, Marty G.; Boehler, C. Nico
Recently, attempts have been made to disentangle the neural underpinnings of preparatory processes related to reward and attention. Functional magnetic resonance imaging (fMRI) research showed that neural activity related to the anticipation of reward and to attentional demands invokes neural activity patterns featuring large-scale overlap, along with some differences and interactions. Due to the limited temporal resolution of fMRI, however, the temporal dynamics of these processes remain unclear. Here, we report an event-related potentials (ERP) study in which cued attentional demands and reward prospect were combined in a factorial design. Results showed that reward prediction dominated early cue processing, as well as the early and later parts of the contingent negative variation (CNV) slow-wave ERP component that has been associated with task-preparation processes. Moreover these reward-related electrophysiological effects correlated across participants with response-time speeding on reward-prospect trials. In contrast, cued attentional demands affected only the later part of the CNV, with the highest amplitudes following cues predicting high-difficulty potential-reward targets, thus suggesting maximal task preparation when the task requires it and entails reward prospect. Consequently, we suggest that task-preparation processes triggered by reward can arise earlier, and potentially more directly, than strategic top-down aspects of preparation based on attentional demands. PMID:24064071
Full Text Available We previously reported that sympathetic activity was associated with exploration in decision-making indexed by entropy, which is a concept in information theory and indexes randomness of choices or the degree of deviation from sticking to recent experiences of gains and losses, and that activation of the anterior insula mediated this association. The current study aims to replicate and to expand these findings in a situation where contingency between options and outcomes is manipulated. Sixteen participants performed a stochastic decision-making task in which we manipulated a condition with low uncertainty of gain/loss (contingent-reward condition and a condition with high uncertainty of gain/loss (random-reward condition. Regional cerebral blood flow was measured by 15O-water positron emission tomography (PET, and cardiovascular parameters and catecholamine in the peripheral blood were measured, during the task. In the contingent-reward condition, norepinephrine as an index of sympathetic activity was positively correlated with entropy indicating exploration in decision-making. Norepinephrine was negatively correlated with neural activity in the right posterior insula, rostral anterior cingulate cortex, and dorsal pons, suggesting neural bases for detecting changes of bodily states. Furthermore, right anterior insular activity was negatively correlated with entropy, suggesting influences on exploration in decision-making. By contrast, in the random-reward condition, entropy correlated with activity in the dorsolateral prefrontal and parietal cortices but not with sympathetic activity. These findings suggest that influences of sympathetic activity on exploration in decision-making and its underlying neural mechanisms might be dependent on the degree of uncertainty of situations.
Full Text Available Dopamine plays a critical role in motor control, addiction, and reward-seeking behaviors, and its release dynamics have traditionally been linked to changes in midbrain dopamine neuron activity. Here, we report that selective endogenous cholinergic activation achieved via in vitro optogenetic stimulation of nucleus accumbens, a terminal field of dopaminergic neurons, elicits real-time dopamine release. This mechanism occurs via direct actions on dopamine terminals, does not require changes in neuron firing within the midbrain, and is dependent on glutamatergic receptor activity. More importantly, we demonstrate that in vivo selective activation of cholinergic interneurons is sufficient to elicit dopamine release in the nucleus accumbens. Therefore, the control of accumbal extracellular dopamine levels by endogenous cholinergic activity results from a complex convergence of neurotransmitter/neuromodulator systems that may ultimately synergize to drive motivated behavior.
Baskin-Sommers, Arielle R; Foti, Dan
A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. PMID:25655926
Alexandru D P Papoiu
Full Text Available Previous brain imaging studies investigating the brain processing of scratching used an exogenous intervention mimicking scratching, performed not by the subjects themselves, but delivered by an investigator. In real life, scratching is a conscious, voluntary, controlled motor response to itching, which is directed to the perceived site of distress. In this study we aimed to visualize in real-time by brain imaging the core mechanisms of the itch-scratch cycle when scratching was performed by subjects themselves. Secondly, we aimed to assess the correlations between brain patterns of activation and psychophysical ratings of itch relief or pleasurability of scratching. We also compared the patterns of brain activity evoked by self-scratching vs. passive scratching. We used a robust tridimensional Arterial Spin Labeling fMRI technique that is less sensitive to motion artifacts: 3D gradient echo and spin echo (GRASE--Propeller. Active scratching was accompanied by a higher pleasurability and induced a more pronounced deactivation of the anterior cingulate cortex and insula, in comparison with passive scratching. A significant involvement of the reward system including the ventral tegmentum of the midbrain, coupled with a mechanism deactivating the periaqueductal gray matter (PAG, suggests that itch modulation operates in reverse to the mechanism known to suppress pain. Our findings not only confirm a role for the central networks processing reward in the pleasurable aspects of scratching, but also suggest they play a role in mediating itch relief.
Full Text Available How does witnessing a hateful person in pain compare to witnessing a likable person in pain? The current study compared the brain bases for how we perceive likable people in pain with those of viewing hateful people in pain. While social bonds are built through sharing the plight and pain of others in the name of empathy, viewing a hateful person in pain also has many potential ramifications. In this functional Magnetic Resonance Imaging (fMRI study, Caucasian Jewish male participants viewed videos of (1 disliked, hateful, anti-Semitic individuals, and (2 liked, non-hateful, tolerant individuals in pain. The results showed that, compared with viewing liked people, viewing hateful people in pain elicited increased responses in regions associated with observation of physical pain (the insular cortex, the anterior cingulate cortex, and the somatosensory cortex, reward processing (the striatum, and frontal regions associated with emotion regulation. Functional connectivity analyses revealed connections between seed regions in the left anterior cingulate cortex and right insular cortex with reward regions, the amygdala, and frontal regions associated with emotion regulation. These data indicate that regions of the brain active while viewing someone in pain may be more active in response to the danger or threat posed by witnessing the pain of a hateful individual more so than the desire to empathize with a likable person’s pain.
Pitchers, Kyle K.; Coppens, Caroline M.; Beloate, Lauren N.; Fuller, Jonathan; Van, Sandy; Frohmader, Karla S.; Laviolette, Steven R.; Lehman, Michael N.; Coolen, Lique M.
Natural reward and drugs of abuse converge on the mesolimbic pathway and activate common mechanism of neural plasticity in the nucleus accumbens. Chronic exposure to opiates induces plasticity in dopaminergic neurons of the ventral tegmental area (VTA), which regulates morphine reward tolerance. Her
Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J
Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. PMID:27170428
McCarty, Shane; Teie, Sophia; McCutchen, Jenna; Geller, E Scott
This field study evaluated the impact of an intervention designed to prevent bullying among elementary-school students by prompting and rewarding prosocial behavior. More specifically, teachers of 404 second-, third-, fourth-, fifth-, and sixth-grade students from an elementary school in northeast Virginia asked their students to look out for other students' prosocial behaviors (termed "actively caring") and to submit their stories about actively caring. At the start of every class day, the teachers read three of these stories and recognized one story and the two associated students (i.e., the observer and the performer) by providing each with a wristband engraved with "Actively Caring for People." For six consecutive Fridays, students reported their observations of bullying and completed a single item estimate of self-esteem. Weekly surveys revealed reductions in "being bullied" and "bullying others," as well as an increase in self-esteem. PMID:27309025
Gong, Mengyuan; Yang, Feitong; Li, Sheng
Although valuable objects are attractive in nature, people often encounter situations where they would prefer to avoid such distraction while focusing on the task goal. Contrary to the typical effect of attentional capture by a reward-associated item, we provide evidence for a facilitation effect derived from the active suppression of a high reward-associated stimulus when cuing its identity as distractor before the display of search arrays. Selection of the target is shown to be significantly faster when the distractors were in high reward-associated colour than those in low reward-associated or non-rewarded colours. This behavioural reward effect was associated with two neural signatures before the onset of the search display: the increased frontal theta oscillation and the strengthened top-down modulation from frontal to anterior temporal regions. The former suggests an enhanced working memory representation for the reward-associated stimulus and the increased need for cognitive control to override Pavlovian bias, whereas the latter indicates that the boost of inhibitory control is realized through a frontal top-down mechanism. These results suggest a mechanism in which the enhanced working memory representation of a reward-associated feature is integrated with task demands to modify attentional priority during active distractor suppression and benefit behavioural performance. PMID:26797805
Carelli, Regina M.; West, Elizabeth A.
An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, ...
Sjoerd J.H. Ebisch
Full Text Available A romantic caress is a basic expression of affiliative behavior and a primary reinforcer. Given its inherent affective valence, its performance also would imply the prediction of reward values. For example, touching a person for whom one has strong passionate feelings likely is motivated by a strong desire for physical contact and associated with the anticipation of hedonic experiences. The present study aims at investigating how the anticipatory neural processes of active romantic caress are modulated by the intensity of the desire for affective contact as reflected by passionate feelings for the other. Functional magnetic resonance imaging scanning was performed in romantically involved partners using a paradigm that allowed to isolate the specific anticipatory representations of active romantic caress, compared with control caress, while testing for the relationship between neural activity and measures of feelings of passionate love for the other. The results demonstrated that right posterior insula activity in anticipation of romantic caress significantly co-varied with the intensity of desire for union with the other. This effect was independent of the sensory-affective properties of the performed touch, like its pleasantness. Furthermore, functional connectivity analysis showed that the same posterior insula cluster interacted with brain regions related to sensory-motor functions as well as to the processing and anticipation of reward. The findings provide insight on the neural substrate mediating between the desire for and the performance of romantic caress. In particular, we propose that anticipatory activity patterns in posterior insula may modulate subsequent sensory-affective processing of skin-to-skin contact.
Egan, Ann E; Ulrich-Lai, Yvonne M
Pharmacological rewards, such as drugs of abuse, evoke physiological stress responses, including increased heart rate and blood pressure, and activation of the hypothalamic-pituitary-adrenal (HPA) axis. It is not clear to what extent the natural reward of palatable foods elicits similar physiological responses. In order to address this question, HPA axis hormones, heart rate, blood pressure and brain pCREB immunolabeling were assessed following novel and repeated sucrose exposure. Briefly, adult, male rats with ad libitum food and water were given either a single (day 1) or repeated (twice-daily for 14 days) brief (up to 30 min) exposure to a second drink bottle containing 4 ml of 30% sucrose drink vs. water (as a control for bottle presentation). Sucrose-fed rats drank more than water-fed on all days of exposure, as expected. On day 1 of exposure, heart rate, blood pressure, plasma corticosterone, and locomotion were markedly increased by presentation of the second drink bottle regardless of drink type. After repeated exposure (day 14), these responses habituated to similar extents regardless of drink type and pCREB immunolabeling in the hypothalamic paraventricular nucleus (PVN) also did not vary with drink type, whereas basolateral amygdala pCREB was increased by sucrose intake. Taken together, these data suggest that while sucrose is highly palatable, physiological stress responses were evoked principally by the drink presentation itself (e.g., an unfamiliar intervention by the investigators), as opposed to the palatability of the offered drink. PMID:25747321
Costumero, V; Barrós-Loscertales, A; Bustamante, J C; Fuentes, P; Rosell-Negre, P; Ventura-Campos, N; Ávila, C
Existing evidence suggests that the presence of reward cues modifies the activity in attentional networks, however, the nature of these influences remains poorly understood. Here, we performed independent component analysis (ICA) in two fMRI datasets corresponding to two incentive delay tasks, which compared the response to reward (money and erotic pictures) and neutral cues, and yielded activations in the ventral striatum using a general linear model approach. Across both experiments, ICA revealed that both the right frontoparietal network and default mode network time courses were positively and negatively modulated by reward cues, respectively. Moreover, this dual neural response pattern was enhanced in individuals with strong reward sensitivity. Therefore, ICA may be a complementary tool to investigate the relevant role of attentional networks on reward processing, and to investigate reward sensitivity in normal and pathological populations. PMID:24696182
Full Text Available BACKGROUND: The processing of reward and punishment stimuli in humans appears to involve brain oscillatory activity of several frequencies, probably each with a distinct function. The exact nature of associations of these electrophysiological measures with impulsive or risk-seeking personality traits is not completely clear. Thus, the aim of the present study was to investigate event-related oscillatory activity during reward processing across a wide spectrum of frequencies, and its associations with impulsivity and sensation seeking in healthy subjects. METHODS: During recording of a 32-channel EEG 22 healthy volunteers were characterized with the Barratt Impulsiveness and the Sensation Seeking Scale and performed a computerized two-choice gambling task comprising different feedback options with positive vs. negative valence (gain or loss and high or low magnitude (5 vs. 25 points. RESULTS: We observed greater increases of amplitudes of the feedback-related negativity and of activity in the theta, alpha and low-beta frequency range following loss feedback and, in contrast, greater increase of activity in the high-beta frequency range following gain feedback. Significant magnitude effects were observed for theta and delta oscillations, indicating greater amplitudes upon feedback concerning large stakes. The theta amplitude changes during loss were negatively correlated with motor impulsivity scores, whereas alpha and low-beta increase upon loss and high-beta increase upon gain were positively correlated with various dimensions of sensation seeking. CONCLUSIONS: The findings suggest that the processing of feedback information involves several distinct processes, which are subserved by oscillations of different frequencies and are associated with different personality traits.
Hyatt, Christopher J; Assaf, Michal; Muska, Christine E; Rosen, Rivkah I; Thomas, Andre D; Johnson, Matthew R; Hylton, Jennifer L; Andrews, Melissa M; Reynolds, Brady A; Krystal, John H; Potenza, Marc N; Pearlson, Godfrey D
Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses). PMID:22606228
Christopher J Hyatt
Full Text Available Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI in current (CCD; n = 30 and former (FCD; n = 28 cocaine dependent subjects as well as healthy control (HC; n = 31 subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses.
Eva H. Telzer
Full Text Available The prevailing view in the field of adolescent brain development is that heightened activity in the mesolimbic dopaminergic reward system serves as a liability, orienting adolescents toward risky behaviors, increasing their sensitivity to social evaluation and loss, and resulting in compromised well-being. Several findings inconsistent with this deficit view challenge the perspective that adolescent reward sensitivity largely serves as a liability and highlights the potential adaptive function that heightened striatal reactivity can serve. The goal of this review is to refine our understanding of dopaminergic reward sensitivity in adolescence. I review several studies showing that ventral striatum activation serves an adaptive function for adolescents’ health and well being relating to declines in both risk taking and depression and increases in cognitive persistence and achievement.
Spreckelmeyer, Katja N.; Krach, Sören; Kohls, Gregor; Rademacher, Lena; Irmak, Arda; Konrad, Kerstin; Kircher, Tilo; Gründer, Gerhard
Motivation for goal-directed behaviour largely depends on the expected value of the anticipated reward. The aim of the present study was to examine how different levels of reward value are coded in the brain for two common forms of human reward: money and social approval. To account for gender differences 16 male and 16 female participants performed an incentive delay task expecting to win either money or positive social feedback. fMRI recording during the anticipation phase revealed proporti...
Full Text Available Although reward probability is an important factor that shapes animal behavior, it is not well understood however, how the primate brain translates reward expectation into the vigor of movement (reaction time and speed. To address this question, we trained two monkeys in a reaction time task that required wrist movements in response to vibrotactile and visual stimuli, with a variable reward schedule. Correct performance was rewarded in 75 % of the trials. Monkeys were certain that they would be rewarded only in the trials immediately following withheld rewards. In these trials, the animals responded sooner and moved faster. Single-unit recordings from the dorsal striatum revealed that modulations in striatal neurons reflected such modulations of movement vigor. First, in the trials with certain rewards, striatal neurons modulated their firing rates earlier. Second, magnitudes of changes in neuronal firing rates depended on whether or not monkeys were certain about the reward. Third, these modulations depended on the sensory modality of the cue (visual vs. vibratory and/or movement direction (flexions vs. extensions. We conclude that dorsal striatum may be a part of the mechanism responsible for the modulation of movement vigor in response to changes of reward predictability.
Chartoff, Elena H; Ebner, Shayla R; Sparrow, Angela; Potter, David; Baker, Phillip M; Ragozzino, Michael E; Roitman, Mitchell F
Negative affective states can increase the rewarding value of drugs of abuse and promote drug taking. Chronic cocaine exposure increases levels of the neuropeptide dynorphin, an endogenous ligand at kappa opioid receptors (KOR) that suppresses dopamine release in the nucleus accumbens (NAc) and elicits negative affective states upon drug withdrawal. However, there is evidence that the effects of KOR activation on affective state are biphasic: immediate aversive effects are followed by delayed increases in reward. The impact of KOR-induced affective states on reward-related effects of cocaine over time is not known. We hypothesize that the initial aversive effects of KOR activation increase, whereas the delayed rewarding effects decrease, the net effects of cocaine on reward and dopamine release. We treated rats with cocaine at various times (15 min to 48 h) after administration of the selective KOR agonist salvinorin A (salvA). Using intracranial self-stimulation and fast scan cyclic voltammetry, we found that cocaine-induced increases in brain stimulation reward and evoked dopamine release in the NAc core were potentiated when cocaine was administered within 1 h of salvA, but attenuated when administered 24 h after salvA. Quantitative real-time PCR was used to show that KOR and prodynorphin mRNA levels were decreased in the NAc, whereas tyrosine hydroxylase and dopamine transporter mRNA levels and tissue dopamine content were increased in the ventral tegmental area 24 h post-salvA. These findings raise the possibility that KOR activation-as occurs upon withdrawal from chronic cocaine-modulates vulnerability to cocaine in a time-dependent manner. PMID:26239494
Guegan, Thomas; Cutando, Laura; Gangarossa, Giuseppe; Santini, Emanuela; Fisone, Gilberto; Martinez, Albert; Valjent, Emmanuel; Maldonado, Rafael; Martin, Miquel
Food palatability produces behavioral modifications that resemble those induced by drugs of abuse. Palatability-induced behavioral changes require both, the activation of the endogenous cannabinoid system, and changes in structural plasticity in neurons of the brain reward pathway. The ERK intracellular pathway is activated by CB1 receptors (CB1-R) and plays a crucial role in neuroplasticity. We investigated the activation of the ERK signaling cascade in the mesocorticolimbic system induced by operant training to obtain highly palatable isocaloric food and the involvement of the CB1-R in these responses. Using immunofluorescence techniques, we analyzed changes in ERK intracellular pathway activation in the mesocorticolimbic system of wild-type and CB1 knockout mice (CB1-/-) trained on an operant paradigm to obtain standard, highly caloric or highly palatable isocaloric food. Operant training for highly palatable isocaloric food, but not for standard or highly caloric food, produced a robust activation of the ERK signaling cascade in the same brain areas where this training modified structural plasticity. These changes induced by the operant training were absent in CB1-/-. We can conclude that the activation of the ERK pathway is associated to the neuroplasticity induced by operant training for highly palatable isocaloric food and might be involved in CB1-R mediated alterations in behavior and structural plasticity. PMID:22580057
Kreiner, David S.
College students in two sections of a general psychology course participated in a demonstration of a simple neural circuit. The activity was based on a neural circuit that Jeffress proposed for localizing sounds. Students in one section responded to a questionnaire prior to participating in the activity, while students in the other section…
Hoch, Tobias; Kreitz, Silke; Gaffling, Simone; Pischetsrieder, Monika; Hess, Andreas
The snack food potato chips induces food intake in ad libitum fed rats, which is associated with modulation of the brain reward system and other circuits. Here, we show that food intake in satiated rats is triggered by an optimal fat/carbohydrate ratio. Like potato chips, an isocaloric fat/carbohydrate mixture influenced whole brain activity pattern of rats, affecting circuits related e.g. to reward/addiction, but the number of modulated areas and the extent of modulation was lower compared t...
Kassam, Karim S; Markey, Amanda R; Cherkassky, Vladimir L; Loewenstein, George; Just, Marcel Adam
We attempt to determine the discriminability and organization of neural activation corresponding to the experience of specific emotions. Method actors were asked to self-induce nine emotional states (anger, disgust, envy, fear, happiness, lust, pride, sadness, and shame) while in an fMRI scanner. Using a Gaussian Naïve Bayes pooled variance classifier, we demonstrate the ability to identify specific emotions experienced by an individual at well over chance accuracy on the basis of: 1) neural activation of the same individual in other trials, 2) neural activation of other individuals who experienced similar trials, and 3) neural activation of the same individual to a qualitatively different type of emotion induction. Factor analysis identified valence, arousal, sociality, and lust as dimensions underlying the activation patterns. These results suggest a structure for neural representations of emotion and inform theories of emotional processing. PMID:23840392
Trost, Sarah; Diekhof, Esther Kristina; Zvonik, Kerstin; Lewandowski, Mirjana; Usher, Juliana; Keil, Maria; Zilles, David; Falkai, Peter; Dechent, Peter; Gruber, Oliver
Bipolar disorder (BD) is characterized by recurrent mood episodes ranging from severe depression to acute full-blown mania. Both states of this severe psychiatric disorder have been associated with alterations of reward processing in the brain. Here, we present results of a functional magnetic resonance imaging (fMRI) study on the neural correlates and functional interactions underlying reward gain processing and reward dismissal in favor of a long-term goal in bipolar patients. Sixteen medicated patients diagnosed with bipolar I disorder, euthymic to mildly depressed, and sixteen matched healthy controls performed the 'desire-reason dilemma' (DRD) paradigm demanding rejection of priorly conditioned reward stimuli to successfully pursue a superordinate goal. Both groups exhibited significant activations in reward-related brain regions, particularly in the mesolimbic reward system. However, bipolar patients showed reduced neural responses of the ventral striatum (vStr) when exploiting a reward stimulus, and exhibited a decreased suppression of the reward-related activation of the mesolimbic reward system while having to reject immediate reward in favor of the long-term goal. Further, functional interaction between the anteroventral prefrontal cortex and the vStr in the 'DRD' was significantly impaired in the bipolar group. These findings provide evidence for a reduced responsivity of the vStr to reward stimuli in BD, possibly related to clinical features like anhedonia. The disturbed top-down control of mesolimbic reward signals by prefrontal brain regions in BD can be interpreted in terms of a disease-related enhanced impulsivity, a trait marker of BD. PMID:24535101
Rigoli, Francesco; Rutledge, Robb B; Dayan, Peter; Dolan, Raymond J
Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values of options depended on several factors, including a baseline gambling propensity, a gambling preference dependent on reward amount, and a contextual reward adaptation factor. Combining this behavioural model with simultaneous functional magnetic resonance imaging we probed neural responses in three key regions linked to reward and value, namely ventral tegmental area/substantia nigra (VTA/SN), ventromedial prefrontal cortex (vmPFC) and ventral striatum (VST). We show that activity in the VTA/SN reflected contextual reward statistics to the extent that context affected behaviour, activity in the vmPFC represented a value difference between chosen and unchosen options while VST responses reflected a non-linear mapping between the actual objective rewards and their subjective value. The findings highlight a multifaceted basis for choice behaviour with distinct mappings between components of this behaviour and value sensitive brain regions. PMID:26707890
Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J
When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947
Alexander Niklas Häusler
Full Text Available Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP, reward reception (RR and reward prediction errors (RPE showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.
Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd
Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594
Rutten, W.L.C.; Pelt, van J.
A hybrid neuro-electronic interface is a cell-cultured micro electrode array, acting as a neural information transducer for stimulation and/or recording of neural activity in the brain or the spinal cord (ventral motor region or dorsal sensory region). It consists of an array of micro electrodes on
Alexander W. Cappelen; Tungodden, Bertil
According to liberal egalitarian ethics, individuals should be rewarded for factors under their control, but not for factors outside their control. A fundamental challenge to liberal egalitarian theories of justice is how to do this without violating minimal egalitarian and liberal requirements. The paper analyses the effects of two such requirements: the principle of equal reward and the principle of reward independence. The exact formulations of these principles depend on how we interpret t...
Alexander W. Cappelen; Tungodden, Bertil
According to liberal egalitarian ethics, individuals should be rewarded for factors under their control, but not for factors outside their control. A fundamental challenge to liberal egalitarian theories of justice is how to do this without violating minimal egalitarian and liberal requirements. The paper analyses the effects of two such requirements: the principle of equal reward and the principle of reward independence. The exact formulations of these principles depend on ...
Full Text Available Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: We do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: While performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one’s competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI. We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: After verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn.
Full Text Available This preliminary study examined the extent to which regional brain activation during a reward cue antisaccade (AS task was associated with 6-month treatment outcome in adolescent substance users. Antisaccade performance provides a sensitive measure of executive function and cognitive control, and generally improves with reward cues. We hypothesized that when preparing to execute an AS, greater activation in regions associated with cognitive and oculomotor control supporting AS, particularly during reward cue trials, would be associated with lower substance use severity at 6-month follow-up. Adolescents (n = 14, ages 14–18 recruited from community-based outpatient treatment completed an fMRI reward cue AS task (reward and neutral conditions, and provided follow-up data. Results indicated that AS errors decreased in reward, compared to neutral, trials. AS behavioral performance, however, was not associated with treatment outcome. As hypothesized, activation in regions of interest (ROIs associated with cognitive (e.g., ventrolateral prefrontal cortex and oculomotor control (e.g., supplementary eye field during reward trials were inversely correlated with marijuana problem severity at 6-months. ROI activation during neutral trials was not associated with outcomes. Results support the role of motivational (reward cue factors to enhance cognitive control processes, and suggest a potential brain-based correlate of youth treatment outcome.
Sher, A. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States)], E-mail: email@example.com; Chichilnisky, E.J. [Systems Neurobiology, Salk Institute, La Jolla, CA (United States); Dabrowski, W. [AGH University of Science and Technology, Cracow (Poland); Grillo, A.A.; Grivich, M. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States); Gunning, D. [University of Glasgow, Glasgow (United Kingdom); Hottowy, P. [AGH University of Science and Technology, Cracow (Poland); Kachiguine, S.; Litke, A.M. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States); Mathieson, K. [University of Glasgow, Glasgow (United Kingdom); Petrusca, D. [Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA (United States)
Large circuits of neurons are employed by the brain to encode and process information. How this encoding and processing is carried out is one of the central questions in neuroscience. Since individual neurons communicate with each other through electrical signals (action potentials), the recording of neural activity with arrays of extracellular electrodes is uniquely suited for the investigation of this question. Such recordings provide the combination of the best spatial (individual neurons) and temporal (individual action-potentials) resolutions compared to other large-scale imaging methods. Electrical stimulation of neural activity in turn has two very important applications: it enhances our understanding of neural circuits by allowing active interactions with them, and it is a basis for a large variety of neural prosthetic devices. Until recently, the state-of-the-art in neural activity recording systems consisted of several dozen electrodes with inter-electrode spacing ranging from tens to hundreds of microns. Using silicon microstrip detector expertise acquired in the field of high-energy physics, we created a unique neural activity readout and stimulation framework that consists of high-density electrode arrays, multi-channel custom-designed integrated circuits, a data acquisition system, and data-processing software. Using this framework we developed a number of neural readout and stimulation systems: (1) a 512-electrode system for recording the simultaneous activity of as many as hundreds of neurons, (2) a 61-electrode system for electrical stimulation and readout of neural activity in retinas and brain-tissue slices, and (3) a system with telemetry capabilities for recording neural activity in the intact brain of awake, naturally behaving animals. We will report on these systems, their various applications to the field of neurobiology, and novel scientific results obtained with some of them. We will also outline future directions.
Large circuits of neurons are employed by the brain to encode and process information. How this encoding and processing is carried out is one of the central questions in neuroscience. Since individual neurons communicate with each other through electrical signals (action potentials), the recording of neural activity with arrays of extracellular electrodes is uniquely suited for the investigation of this question. Such recordings provide the combination of the best spatial (individual neurons) and temporal (individual action-potentials) resolutions compared to other large-scale imaging methods. Electrical stimulation of neural activity in turn has two very important applications: it enhances our understanding of neural circuits by allowing active interactions with them, and it is a basis for a large variety of neural prosthetic devices. Until recently, the state-of-the-art in neural activity recording systems consisted of several dozen electrodes with inter-electrode spacing ranging from tens to hundreds of microns. Using silicon microstrip detector expertise acquired in the field of high-energy physics, we created a unique neural activity readout and stimulation framework that consists of high-density electrode arrays, multi-channel custom-designed integrated circuits, a data acquisition system, and data-processing software. Using this framework we developed a number of neural readout and stimulation systems: (1) a 512-electrode system for recording the simultaneous activity of as many as hundreds of neurons, (2) a 61-electrode system for electrical stimulation and readout of neural activity in retinas and brain-tissue slices, and (3) a system with telemetry capabilities for recording neural activity in the intact brain of awake, naturally behaving animals. We will report on these systems, their various applications to the field of neurobiology, and novel scientific results obtained with some of them. We will also outline future directions
NAKAMURA, KAE; Matsumoto, Masayuki; Hikosaka, Okihide
The dopamine system has been thought to play a central role in guiding behavior based on rewards. Recent pharmacological studies suggest that another monoamine neurotransmitter, serotonin, is also involved in reward processing. To elucidate the functional relationship between serotonin neurons and dopamine neurons, we performed single unit recording in the dorsal raphe nucleus (DRN), a major source of serotonin, and the substantia nigra pars compacta, a major source of dopamine, while monkeys...
Nestor, Liam; Hester, Robert; Garavan, Hugh
Despite an increased understanding of the pharmacology and long-term cognitive effects of cannabis in humans, there has been no research to date examining its chronic effects upon reward processing in the brain. Motivational theories regarding long-term drug use posit contrasting predictions with respect to how drug users are likely to process non-drug incentives. The reward deficiency syndrome (RDS) of addiction posits that there are deficits in dopamine (DA) motivational circuitry for non-d...
Victor Costumero; Alfonso Barrós-Loscertales; Juan Carlos Bustamante; Noelia Ventura-Campos; Paola Fuentes; Patricia Rosell-Negre; César Ávila
The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men compl...
Lampros ePerogamvros; Roland eHasler; Patrick eBaud; Claude Robert Cloninger; Sophie eSchwartz; Stephen ePerrig
In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity on reward-related questionnaires. In light of new evidence on the mesolimbic dopaminergic implication in co...
Ganguly, Karunesh; Poo, Mu-Ming
Much progress has been made in understanding how behavioral experience and neural activity can modify the structure and function of neural circuits during development and in the adult brain. Studies of physiological and molecular mechanisms underlying activity-dependent plasticity in animal models have suggested potential therapeutic approaches for a wide range of brain disorders in humans. Physiological and electrical stimulations as well as plasticity-modifying molecular agents may facilitate functional recovery by selectively enhancing existing neural circuits or promoting the formation of new functional circuits. Here, we review the advances in basic studies of neural plasticity mechanisms in developing and adult nervous systems and current clinical treatments that harness neural plasticity, and we offer perspectives on future development of plasticity-based therapy. PMID:24183023
Wiemerslage, Lyle; Nilsson, Emil K; Solstrand Dahlberg, Linda; Ence-Eriksson, Fia; Castillo, Sandra; Larsen, Anna L; Bylund, Simon B A; Hogenkamp, Pleunie S; Olivo, Gaia; Bandstein, Marcus; Titova, Olga E; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J; Schiöth, Helgi B
Understanding how genetics influences obesity, brain activity and eating behaviour will add important insight for developing strategies for weight-loss treatment, as obesity may stem from different causes and as individual feeding behaviour may depend on genetic differences. To this end, we examined how an obesity risk allele for the FTO gene affects brain activity in response to food images of different caloric content via functional magnetic resonance imaging (fMRI). Thirty participants homozygous for the rs9939609 single nucleotide polymorphism were shown images of low- or high-calorie food while brain activity was measured via fMRI. In a whole-brain analysis, we found that people with the FTO risk allele genotype (AA) had increased activity compared with the non-risk (TT) genotype in the posterior cingulate, cuneus, precuneus and putamen. Moreover, higher body mass index in the AA genotype was associated with reduced activity to food images in areas important for emotion (cingulate cortex), but also in areas important for impulse control (frontal gyri and lentiform nucleus). Lastly, we corroborate our findings with behavioural scales for the behavioural inhibition and activation systems. Our results suggest that the two genotypes are associated with differential neural processing of food images, which may influence weight status through diminished impulse control and reward processing. PMID:26797854
Full Text Available Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players’ active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins and failures (losses in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing and watched a pre-recorded gameplay video (vicarious playing while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI. Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC during winning than losing, both during active and vicarious playing conditions. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing.
Jensen, Karin B; Kaptchuk, Ted J; Chen, Xiaoyan; Kirsch, Irving; Ingvar, Martin; Gollub, Randy L; Kong, Jian
Fundamental aspects of human behavior operate outside of conscious awareness. Yet, theories of conditioned responses in humans, such as placebo and nocebo effects on pain, have a strong emphasis on conscious recognition of contextual cues that trigger the response. Here, we investigated the neural pathways involved in nonconscious activation of conditioned pain responses, using functional magnetic resonance imaging in healthy participants. Nonconscious compared with conscious activation of conditioned placebo analgesia was associated with increased activation of the orbitofrontal cortex, a structure with direct connections to affective brain regions and basic reward processing. During nonconscious nocebo, there was increased activation of the thalamus, amygdala, and hippocampus. In contrast to previous assumptions about conditioning in humans, our results show that conditioned pain responses can be elicited independently of conscious awareness and our results suggest a hierarchical activation of neural pathways for nonconscious and conscious conditioned responses. Demonstrating that the human brain has a nonconscious mechanism for responding to conditioned cues has major implications for the role of associative learning in behavioral medicine and psychiatry. Our results may also open up for novel approaches to translational animal-to-human research since human consciousness and animal cognition is an inherent paradox in all behavioral science. PMID:25452576
Full Text Available The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80 as well as age- and smoking-matched male healthy controls (HCs; N = 89. Depressive symptoms were assessed using the Beck Depression Inventory (BDI. DGs and HCs were divided into subgroups (“high” and “low” based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.
Berthoud, Hans-Rudolf; Lenard, Natalie R.; Shin, Andrew C.
Given the unabated obesity problem, there is increasing appreciation of expressions like “my eyes are bigger than my stomach,” and recent studies in rodents and humans suggest that dysregulated brain reward pathways may be contributing not only to drug addiction but also to increased intake of palatable foods and ultimately obesity. After describing recent progress in revealing the neural pathways and mechanisms underlying food reward and the attribution of incentive salience by internal stat...
Ji, Na; Freeman, Jeremy; Smith, Spencer L
Neural circuitry has evolved to form distributed networks that act dynamically across large volumes. Conventional microscopy collects data from individual planes and cannot sample circuitry across large volumes at the temporal resolution relevant to neural circuit function and behaviors. Here we review emerging technologies for rapid volume imaging of neural circuitry. We focus on two critical challenges: the inertia of optical systems, which limits image speed, and aberrations, which restrict the image volume. Optical sampling time must be long enough to ensure high-fidelity measurements, but optimized sampling strategies and point-spread function engineering can facilitate rapid volume imaging of neural activity within this constraint. We also discuss new computational strategies for processing and analyzing volume imaging data of increasing size and complexity. Together, optical and computational advances are providing a broader view of neural circuit dynamics and helping elucidate how brain regions work in concert to support behavior. PMID:27571194
Smith, Alec; Bernheim, B. Douglas; Camerer, Colin
We investigate the feasibility of inferring the choices people would make (if given the opportunity) based on their neural responses to the pertinent prospects when they are not engaged in actual decision making. The ability to make such inferences is of potential value when choice data are unavailable, or limited in ways that render standard methods of estimating choice mappings problematic. We formulate prediction models relating choices to “non-choice” neural responses and use them to predict out-of-sample choices for new items and for new groups of individuals. The predictions are sufficiently accurate to establish the feasibility of our approach. PMID:25729468
Full Text Available OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.
In this dissertation I investigate whether market rewards to a pattern of increasing earnings vary with certain signals of whether the pattern is genuine or fabricated. Among these signals, I examine growth in cash flows, accrual-based earnings management, earnings management through the manipulation of real operating activities, and conservative accounting. The findings show that market participants assign higher price-earnings multiples to firms when their pattern of increasi...
Full Text Available We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC boys underwent functional magnetic resonance imaging (fMRI while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small and feedback availability (no-feedback; feedback. While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.
Hammer, Rubi; Tennekoon, Michael; Cooke, Gillian E; Gayda, Jessica; Stein, Mark A; Booth, James R
We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC) boys underwent functional magnetic resonance imaging (fMRI) while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small) and feedback availability (no-feedback; feedback). While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys) only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory. PMID:26142072
Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior. PMID:26838982
Kogler, Lydia; Müller, Veronika I; Chang, Amy; Eickhoff, Simon B; Fox, Peter T; Gur, Ruben C; Derntl, Birgit
Stress is present in everyday life in various forms and situations. Two stressors frequently investigated are physiological and psychosocial stress. Besides similar subjective and hormonal responses, it has been suggested that they also share common neural substrates. The current study used activation-likelihood-estimation meta-analysis to test this assumption by integrating results of previous neuroimaging studies on stress processing. Reported results are cluster-level FWE corrected. The inferior frontal gyrus (IFG) and the anterior insula (AI) were the only regions that demonstrated overlapping activation for both stressors. Analysis of physiological stress showed consistent activation of cognitive and affective components of pain processing such as the insula, striatum, or the middle cingulate cortex. Contrarily, analysis across psychosocial stress revealed consistent activation of the right superior temporal gyrus and deactivation of the striatum. Notably, parts of the striatum appeared to be functionally specified: the dorsal striatum was activated in physiological stress, whereas the ventral striatum was deactivated in psychosocial stress. Additional functional connectivity and decoding analyses further characterized this functional heterogeneity and revealed higher associations of the dorsal striatum with motor regions and of the ventral striatum with reward processing. Based on our meta-analytic approach, activation of the IFG and the AI seems to indicate a global neural stress reaction. While physiological stress activates a motoric fight-or-flight reaction, during psychosocial stress attention is shifted towards emotion regulation and goal-directed behavior, and reward processing is reduced. Our results show the significance of differentiating physiological and psychosocial stress in neural engagement. Furthermore, the assessment of deactivations in addition to activations in stress research is highly recommended. PMID:26123376
Fadly Jashi Darsivan
Full Text Available This paper proposes the application of neural network as a controller to isolate engine vibration in an active engine mounting system. It has been shown that the NARMA-L2 neurocontroller has the ability to reject disturbances from a plant. The disturbance is assumed to be both impulse and sinusoidal disturbances that are induced by the engine. The performance of the neural network controller is compared with conventional PD and PID controllers tuned using Ziegler-Nichols. From the result simulated the neural network controller has shown better ability to isolate the engine vibration than the conventional controllers.
Waite Roger L
proliferation of D2 receptors. Proposal and conclusion The authors propose that D2 receptor stimulation can be accomplished via the use of Synapatmine™, a natural but therapeutic nutraceutical formulation that potentially induces DA release, causing the same induction of D2-directed mRNA and thus proliferation of D2 receptors in the human. This proliferation of D2 receptors in turn will induce the attenuation of craving behavior. In fact as mentioned earlier, this model has been proven in research showing DNA-directed compensatory overexpression (a form of gene therapy of the DRD2 receptors, resulting in a significant reduction in alcohol craving behavior in alcohol preferring rodents. Utilizing natural dopaminergic repletion therapy to promote long term dopaminergic activation will ultimately lead to a common, safe and effective modality to treat Reward Deficiency Syndrome (RDS behaviors including Substance Use Disorders (SUD, Attention Deficit Hyperactivity Disorder (ADHD, Obesity and other reward deficient aberrant behaviors. This concept is further supported by the more comprehensive understanding of the role of dopamine in the NAc as a "wanting" messenger in the meso-limbic DA system.
John A Clithero
Full Text Available To dissociate a choice from its antecedent neural states, motivation associated with the expected outcome must be captured in the absence of choice. Yet, the neural mechanisms that mediate behavioral idiosyncrasies in motivation, particularly with regard to complex economic preferences, are rarely examined in situations without overt decisions. We employed functional magnetic resonance imaging (fMRI in a large sample of participants while they anticipated earning rewards from two different modalities: monetary and candy rewards. An index for relative motivation toward different reward types was constructed using reaction times to the target for earning rewards. Activation in the nucleus accumbens (NAcc and anterior insula (aINS predicted individual variation in relative motivation between our reward modalities. NAcc activation, however, mediated the effects of aINS, indicating the NAcc is the likely source of this relative weighting. These results demonstrate that neural idiosyncrasies in reward efficacy exist even in the absence of explicit choices, and extend the role of NAcc as a critical brain region for such choice-free motivation.
Wen, Shiping; Zeng, Zhigang; Huang, Tingwen; Meng, Qinggang; Yao, Wei
This paper investigates the problem of global exponential lag synchronization of a class of switched neural networks with time-varying delays via neural activation function and applications in image encryption. The controller is dependent on the output of the system in the case of packed circuits, since it is hard to measure the inner state of the circuits. Thus, it is critical to design the controller based on the neuron activation function. Comparing the results, in this paper, with the existing ones shows that we improve and generalize the results derived in the previous literature. Several examples are also given to illustrate the effectiveness and potential applications in image encryption. PMID:25594985
Okado, Yoko; Stark, Craig E.L.
False memories are often demonstrated using the misinformation paradigm, in which a person's recollection of a witnessed event is altered after exposure to misinformation about the event. The neural basis of this phenomenon, however, remains unknown. We used fMRI to investigate encoding processes during the viewing of an event and misinformation to see whether neural activity during either encoding phase could predict what would be remembered. fMRI data were collected as participants studied ...
Gregor Rainer; Han Lee; Logothetis, Nikos K.
One of the most remarkable capabilities of the adult brain is its ability to learn and continuously adapt to an ever-changing environment. While many studies have documented how learning improves the perception and identification of visual stimuli, relatively little is known about how it modifies the underlying neural mechanisms. We trained monkeys to identify natural images that were degraded by interpolation with visual noise. We found that learning led to an improvement in monkeys' ability...
Martin-Solch, C; Magyar, S; Kunig, G; Missimer, J; Schultz, W; Leenders, KL
Tobacco smoking is the most frequent form of substance abuse. Several studies have shown that the addictive action of nicotine is mediated by the mesolimbic. dopamine system. This system is implicated in reward processing. In order to better understand the relationship between nicotine addiction and
Schei, Jennifer Lynn
Optical imaging technologies can be used to record neural and hemodynamic activity. Neural activity elicits physiological changes that alter the optical tissue properties. Specifically, changes in polarized light are concomitant with neural depolarization. We measured polarization changes from an isolated lobster nerve during action potential propagation using both reflected and transmitted light. In transmission mode, polarization changes were largest throughout the center of the nerve, suggesting that most of the optical signal arose from the inner nerve bundle. In reflection mode, polarization changes were largest near the edges, suggesting that most of the optical signal arose from the outer sheath. To overcome irregular cell orientation found in the brain, we measured polarization changes from a nerve tied in a knot. Our results show that neural activation produces polarization changes that can be imaged even without regular cell orientations. Neural activation expends energy resources and elicits metabolic delivery through blood vessel dilation, increasing blood flow and volume. We used spectroscopic imaging techniques combined with electrophysiological measurements to record evoked neural and hemodynamic responses from the auditory cortex of the rat. By using implantable optics, we measured responses across natural wake and sleep states, as well as responses following different amounts of sleep deprivation. During quiet sleep, evoked metabolic responses were larger compared to wake, perhaps because blood vessels were more compliant. When animals were sleep deprived, evoked hemodynamic responses were smaller following longer periods of deprivation. These results suggest that prolonged neural activity through sleep deprivation may diminish vascular compliance as indicated by the blunted vascular response. Subsequent sleep may allow vessels to relax, restoring their ability to deliver blood. These results also suggest that severe sleep deprivation or chronic
A new active control scheme, based on neural network, for the suppression of oscillation in multiple-degree-of-freedom (MDOF) offshore platforms, is studied in this paper. With the main advantages of neural network, i.e. the inherent robustness, fault tolerance, and generalized capability of its parallel massive interconnection structure, the active structural control of offshore platforms under random waves is accomplished by use of the BP neural network model. The neural network is trained offline with the data generated from numerical analysis, and it simulates the process of Classical Linear Quadratic Regular Control for the platform under random waves. After the learning phase, the trained network has learned about the nonlinear dynamic behavior of the active control system, and is capable of predicting the active control forces of the next time steps. The results obtained show that the active control is feasible and effective, and it finally overcomes time delay owing to the robustness, fault tolerance, and generalized capability of artificial neural network.
Navratilova, Edita; Morimura, Kozo; Xie, Jennifer Y; Atcherley, Christopher W; Ossipov, Michael H; Porreca, Frank
Chronic pain is an important public health problem that negatively impacts the quality of life of affected individuals and exacts enormous socioeconomic costs. Chronic pain is often accompanied by comorbid emotional disorders including anxiety, depression, and possibly anhedonia. The neural circuits underlying the intersection of pain and pleasure are not well understood. We summarize recent human and animal investigations and demonstrate that aversive aspects of pain are encoded in brain regions overlapping with areas processing reward and motivation. We highlight findings revealing anatomical and functional alterations of reward/motivation circuits in chronic pain. Finally, we review supporting evidence for the concept that pain relief is rewarding and activates brain reward/motivation circuits. Adaptations in brain reward circuits may be fundamental to the pathology of chronic pain. Knowledge of brain reward processing in the context of pain could lead to the development of new therapeutics for the treatment of emotional aspects of pain and comorbid conditions. J. Comp. Neurol. 524:1646-1652, 2016. © 2016 Wiley Periodicals, Inc. PMID:26788716
Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.
Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent dep...
Sören Krach; Paulus, Frieder M.; Maren Bodden; TIlo Kircher
The objective of this short review is to highlight rewarding aspects of social interactions for humans and discuss their neural basis. Thereby we report recent research findings to illustrate how social stimuli in general are processed in the reward system and highlight the role of Theory of Mind (ToM) as one mediating process for experiencing social reward during social interactions. In conclusion we discuss clinical implications for psychiatry and psychotherapy.
Sharma, Annapurna; Chung, Wan-Young
This paper presents the designing of a neural network for the classification of Human activity. A Triaxial accelerometer sensor, housed in a chest worn sensor unit, has been used for capturing the acceleration of the movements associated. All the three axis acceleration data were collected at a base station PC via a CC2420 2.4GHz ISM band radio (zigbee wireless compliant), processed and classified using MATLAB. A neural network approach for classification was used with an eye on theoretical and empirical facts. The work shows a detailed description of the designing steps for the classification of human body acceleration data. A 4-layer back propagation neural network, with Levenberg-marquardt algorithm for training, showed best performance among the other neural network training algorithms.
Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of...... evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions....... Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward...
Carlezon, William A; Thomas, Mark J.
The nucleus accumbens (NAc) is a critical element of the mesocorticolimbic system, a brain circuit implicated in reward and motivation. This basal forebrain structure receives dopamine (DA) input from the ventral tegmental area (VTA) and glutamate (GLU) input from regions including the prefrontal cortex (PFC), amygdala (AMG), and hippocampus (HIP). As such, it integrates inputs from limbic and cortical regions, linking motivation with action. The NAc has a well-established role in mediating t...
Perogamvros, Lampros; Baud, Patrick; Hasler, Roland; Cloninger, Claude Robert; Schwartz, Sophie; Perrig, Stephen
In this paper, we present two carefully documented cases of patients with sleep-related eating disorder (SRED), a parasomnia which is characterized by involuntary compulsive eating during the night and whose pathophysiology is not known. Using video-polysomnography, a dream diary and psychometric examination, we found that both patients present elevated novelty seeking and increased reward sensitivity. In light of new evidence on the mesolimbic dopaminergic implication in compulsive eating di...
Anders, Silke; de Jong, Roos; Beck, Christian; Haynes, John-Dylan; Ethofer, Thomas
Being able to comprehend another person's intentions and emotions is essential for successful social interaction. However, it is currently unknown whether the human brain possesses a neural mechanism that attracts people to others whose mental states they can easily understand. Here we show that the degree to which a person feels attracted to another person can change while they observe the other's affective behavior, and that these changes depend on the observer's confidence in having correctly understood the other's affective state. At the neural level, changes in interpersonal attraction were predicted by activity in the reward system of the observer's brain. Importantly, these effects were specific to individual observer-target pairs and could not be explained by a target's general attractiveness or expressivity. Furthermore, using multivoxel pattern analysis (MVPA), we found that neural activity in the reward system of the observer's brain varied as a function of how well the target's affective behavior matched the observer's neural representation of the underlying affective state: The greater the match, the larger the brain's intrinsic reward signal. Taken together, these findings provide evidence that reward-related neural activity during social encounters signals how well an individual's "neural vocabulary" is suited to infer another person's affective state, and that this intrinsic reward might be a source of changes in interpersonal attraction. PMID:27044071
Nagai, Taku; Nakamuta, Shinichi; Kuroda, Keisuke; Nakauchi, Sakura; Nishioka, Tomoki; Takano, Tetsuya; Zhang, Xinjian; Tsuboi, Daisuke; Funahashi, Yasuhiro; Nakano, Takashi; Yoshimoto, Junichiro; Kobayashi, Kenta; Uchigashima, Motokazu; Watanabe, Masahiko; Miura, Masami; Nishi, Akinori; Kobayashi, Kazuto; Yamada, Kiyofumi; Amano, Mutsuki; Kaibuchi, Kozo
Dopamine (DA) type 1 receptor (D1R) signaling in the striatum presumably regulates neuronal excitability and reward-related behaviors through PKA. However, whether and how D1Rs and PKA regulate neuronal excitability and behavior remain largely unknown. Here, we developed a phosphoproteomic analysis method to identify known and novel PKA substrates downstream of the D1R and obtained more than 100 candidate substrates, including Rap1 GEF (Rasgrp2). We found that PKA phosphorylation of Rasgrp2 activated its guanine nucleotide-exchange activity on Rap1. Cocaine exposure activated Rap1 in the nucleus accumbens in mice. The expression of constitutively active PKA or Rap1 in accumbal D1R-expressing medium spiny neurons (D1R-MSNs) enhanced neuronal firing rates and behavioral responses to cocaine exposure through MAPK. Knockout of Rap1 in the accumbal D1R-MSNs was sufficient to decrease these phenotypes. These findings demonstrate a novel DA-PKA-Rap1-MAPK intracellular signaling mechanism in D1R-MSNs that increases neuronal excitability to enhance reward-related behaviors. PMID:26804993
Redlich, Ronny; Dohm, Katharina; Grotegerd, Dominik; Opel, Nils; Zwitserlood, Pienie; Heindel, Walter; Arolt, Volker; Kugel, Harald; Dannlowski, Udo
Differentiating bipolar disorders (BD) from unipolar depression (UD) remains a major clinical challenge. The identification of neurobiological markers may help to differentiate these disorders, particularly during depressive episodes. This cross-sectional study, including 33 patients with UD, 33 patients with BD, and 34 healthy controls, is one of the first to directly compare UD and BD with respect to reward processing. A card-guessing paradigm was employed and brain activity associated with reward processing was investigated by means of fMRI. A 3 (group) × 2 (condition: reward>control, loss>control) ANOVA was conducted using the nucleus accumbens (NAcc) as ROI. Furthermore, a whole-brain approach was applied. A functional connectivity analysis was performed to characterize diagnosis-related alterations in the functional coupling between the NAcc and other brain areas. The ANOVA revealed higher activity for healthy controls (HCs) than for BD and UD in the NAcc during reward processing. Moreover, UD showed a higher functional connectivity between the NAcc and the VTA than HC. The patients groups could be differentiated in that BD showed a decreased activation, in the reward condition, of the NAcc, caudate nucleus, thalamus, putamen, insula, and prefrontal areas compared with UD. These results may help to refine the understanding of neural correlates of reward processing in both disorders, and to understand the neural underpinnings of anhedonia, a core symptom of depressive episodes. PMID:25881114
WANG Di; ZHANG Guoxiong; LI Xingfei
To find a design method for 3D active multichannel silicon microelectrode,a microstructure of active neural recording system is presented,where two 2D probes,two integrated circuits and two spacers are microassembled on a 5 mm ×7 mm silicon platform,and 32 sites neural signals can be operated simultaneously.A theoretical model for measuring the neural signal by the silicon microelectrode is proposed based on the structure and fabrication process of a single-shank probe.The method of determining the dimensional parameters of the probe shank is discussed in the following three aspects,i.e.the structures of pallium and endocranium,coupled interconnecters noise,and strength characteristic of neural probe.The design criterion is to minimize the size of the neural probe as well as that the probe has enough stiffness to pierce the endocranium.The on-chip unity-gain bandpass amplifier has an overall gain of 42 dB over a bandwidth from 60 Hz to 10 kHz;and the DC-baseline stability circuit is of high input resistance above 30 MΩ to guarantee a cutoff frequency below 100 Hz.The circuit works in stimulating or recording modes.The conversion of the modes depends on the stimulating control signal.
W. L. C. Rutten
Full Text Available One type of future, improved neural interface is the “cultured probe”. It is a hybrid type of neural information transducer or prosthesis, for stimulation and/or recording of neural activity. It would consist of a microelectrode array (MEA on a planar substrate, each electrode being covered and surrounded by a local circularly confined network (“island” of cultured neurons. The main purpose of the local networks is that they act as biofriendly intermediates for collateral sprouts from the in vivo system, thus allowing for an effective and selective neuron–electrode interface. As a secondary purpose, one may envisage future information processing applications of these intermediary networks. In this paper, first, progress is shown on how substrates can be chemically modified to confine developing networks, cultured from dissociated rat cortex cells, to “islands” surrounding an electrode site. Additional coating of neurophobic, polyimide-coated substrate by triblock-copolymer coating enhances neurophilic-neurophobic adhesion contrast. Secondly, results are given on neuronal activity in patterned, unconnected and connected, circular “island” networks. For connected islands, the larger the island diameter (50, 100 or 150 μm, the more spontaneous activity is seen. Also, activity may show a very high degree of synchronization between two islands. For unconnected islands, activity may start at 22 days in vitro (DIV, which is two weeks later than in unpatterned networks.
Full Text Available BACKGROUND: Manipulations of the early environment are linked to long-lasting alterations of emotionality and social capabilities. Denial of rewarding mother-pup interactions in early life of rats could serve as model for child neglect. Negative consequences for social competence in later life, accompanied by changes in the serotonergic system would be expected. In contrast, rewarding mother-pup contact should promote adequate social abilities. METHODOLOGY/PRINCIPAL FINDINGS: Male Wistar rats trained in a T-maze during postnatal days 10-13 under denial (DER or permission (RER of maternal contact were tested for play behavior in adolescence and for coping with defeat in adulthood. We estimated serotonin (5-HT levels in the brain under basal conditions and following defeat, as well as serotonin receptor 1A (5-HT1A and serotonin transporter (SERT expression. DER rats exhibited increased aggressive-like play behavior in adolescence (i.e. increased nape attacks, p<0.0001 and selected a proactive coping style during defeat in adulthood (higher sum of proactive behaviors: number of attacks, flights, rearings and defensive upright posture; p = 0.011, p<0.05 vs RER, non-handled-NH. In adulthood, they had lower 5-HT levels in both the prefrontal cortex (p<0.05 vs RER and the amygdala (p<0.05 vs NH, increased 5-HT levels following defeat (PFC p<0.0001 and decreased serotonin turnover (amygdala p = 0.008. The number of 5-HT1A immunopositive cells in the CA1 hippocampal area was increased (p<0.05 DER, vs RER, NH; SERT levels in the amygdala were elevated (p<0.05 vs RER, NH, but were lower in the prefrontal cortex (p<0.05 vs NH. CONCLUSIONS/SIGNIFICANCE: Denial of expected maternal reward early in life negatively affects sociability and the serotonergic system in a complex manner. We propose that our animal model could contribute to the identification of the neurobiological correlates of early neglect effects on social behavior and coping with challenges, but
Jennings, Joshua H.; Stuber, Garret D.
Mammalian neural circuits are sophisticated biological systems that choreograph behavioral processes vital for survival. While the inherent complexity of discrete neural circuits has proven difficult to decipher, many parallel methodological developments promise to help delineate the function and connectivity of molecularly defined neural circuits. Here, we review recent technological advances designed to precisely monitor and manipulate neural circuit activity. We propose a holistic, multifa...
Full Text Available People sometimes solve problems with a unique process called insight, accompanied by an "Aha!" experience. It has long been unclear whether different cognitive and neural processes lead to insight versus noninsight solutions, or if solutions differ only in subsequent subjective feeling. Recent behavioral studies indicate distinct patterns of performance and suggest differential hemispheric involvement for insight and noninsight solutions. Subjects solved verbal problems, and after each correct solution indicated whether they solved with or without insight. We observed two objective neural correlates of insight. Functional magnetic resonance imaging (Experiment 1 revealed increased activity in the right hemisphere anterior superior temporal gyrus for insight relative to noninsight solutions. The same region was active during initial solving efforts. Scalp electroencephalogram recordings (Experiment 2 revealed a sudden burst of high-frequency (gamma-band neural activity in the same area beginning 0.3 s prior to insight solutions. This right anterior temporal area is associated with making connections across distantly related information during comprehension. Although all problem solving relies on a largely shared cortical network, the sudden flash of insight occurs when solvers engage distinct neural and cognitive processes that allow them to see connections that previously eluded them.
Kirschner, Matthias; Hager, Oliver M.; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N.; Kaiser, Stefan
Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precis...
Ridgway, S H; Moore, P W; Carder, D A; Romano, T A
For many years, we heard sounds associated with reward from dolphins and belugas. We named these pulsed sounds victory squeals (VS), as they remind us of a child's squeal of delight. Here we put these sounds in context with natural and learned behavior. Like bats, echolocating cetaceans produce feeding buzzes as they approach and catch prey. Unlike bats, cetaceans continue their feeding buzzes after prey capture and the after portion is what we call the VS. Prior to training (or conditioning), the VS comes after the fish reward; with repeated trials it moves to before the reward. During training, we use a whistle or other sound to signal a correct response by the animal. This sound signal, named a secondary reinforcer (SR), leads to the primary reinforcer, fish. Trainers usually name their whistle or other SR a bridge, as it bridges the time gap between the correct response and reward delivery. During learning, the SR becomes associated with reward and the VS comes after the SR rather than after the fish. By following the SR, the VS confirms that the animal expects a reward. Results of early brain stimulation work suggest to us that SR stimulates brain dopamine release, which leads to the VS. Although there are no direct studies of dopamine release in cetaceans, we found that the timing of our VS is consistent with a response after dopamine release. We compared trained vocal responses to auditory stimuli with VS responses to SR sounds. Auditory stimuli that did not signal reward resulted in faster responses by a mean of 151 ms for dolphins and 250 ms for belugas. In laboratory animals, there is a 100 to 200 ms delay for dopamine release. VS delay in our animals is similar and consistent with vocalization after dopamine release. Our novel observation suggests that the dopamine reward system is active in cetacean brains. PMID:25122919
Oba, Kentaro; Noriuchi, Madoka; Atomi, Tomoaki; Moriguchi, Yoshiya; Kikuchi, Yoshiaki
People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia. PMID:26060325
Tessier, Charles R.; Kendal Broadie
In many nervous systems, the establishment of neural circuits is known to proceed via a two-stage process; 1) early, activity-independent wiring to produce a rough map characterized by excessive synaptic connections, and 2) subsequent, use-dependent pruning to eliminate inappropriate connections and reinforce maintained synapses. In invertebrates, however, evidence of the activity-dependent phase of synaptic refinement has been elusive, and the dogma has long been that invertebrate circ...
Full Text Available Direct interfacing of transected peripheral nerves with advanced robotic prosthetic devices has been proposed as a strategy for achieving natural motor control and sensory perception of such bionic substitutes, thus fully functionally replacing missing limbs in amputees. Multi-electrode arrays placed in the brain and peripheral nerves have been used successfully to convey neural control of prosthetic devices to the user. However, reactive gliosis, micro hemorrhages, axonopathy and excessive inflammation, currently limit their long-term use. Here we demonstrate that enticement of peripheral nerve regeneration through a non-obstructive multi-electrode array, after either acute or chronic nerve amputation, offers a viable alternative to obtain early neural recordings and to enhance long-term interfacing of nerve activity. Non restrictive electrode arrays placed in the path of regenerating nerve fibers allowed the recording of action potentials as early as 8 days post-implantation with high signal-to-noise ratio, as long as 3 months in some animals, and with minimal inflammation at the nerve tissue-metal electrode interface. Our findings suggest that regenerative on-dependent multi-electrode arrays of open design allow the early and stable interfacing of neural activity from amputated peripheral nerves and might contribute towards conveying full neural control and sensory feedback to users of robotic prosthetic devices. .
An exploratory study on seismic active control using an artificial neural network (ANN) is presented in which a singledegree-of-freedom (SDF) structural system is controlled by a trained neural network. A feed-forward neural network and the backpropagation training method are used in the study. In backpropagation training, the learning rate is determined by ensuring the decrease of the error function at each training cycle. The training patterns for the neural net are generated randomly. Then, the trained ANN is used to compute the control force according to the control algorithm. The control strategy proposed herein is to apply the control force at every time step to destroy the build-up of the system response. The ground motions considered in the simulations are the N21E and N69W components of the Lake Hughes No. 12 record that occurred in the San Fernando Valley in California on February 9, 1971. Significant reduction of the structural response by one order of magnitude is observed. Also, it is shown that the proposed control strategy has the ability to reduce the peak that occurs during the first few cycles of the time history. These promising results assert the potential of applying ANNs to active structural control under seismic loads
Full Text Available In a response to a growing demand for environments of 70dB or less noise levels, many industrial sectors have focused with some form of noise control system. Active noise control (ANC has proven to be the most effective technology. This paper mainly investigates application of neural network on self-adaptation system in active noise control (ANC. An active silencing control system is made which adopts a motional feedback loudspeaker as not a noise controlling source but a detecting sensor. The working fundamentals and the characteristics of the motional feedback loudspeaker are analyzed in detail. By analyzing each acoustical path, identification based adaptive linear neural network is built. This kind of identifying method can be achieved conveniently. The estimated result of each sound channel matches well with its real sound character, respectively.
The past decade has seen a wealth of physiological data suggesting that neural networks may behave like critical branching processes. Concurrently, the collective activity of neurons has been studied using explicit mappings to classic statistical mechanics models such as disordered Ising models, allowing for the study of their thermodynamics, but these efforts have ignored the dynamical nature of neural activity. I will show how to reconcile these two approaches by learning effective statistical mechanics models of the full history of the collective activity of a neuron population directly from physiological data, treating time as an additional dimension. Applying this technique to multi-electrode recordings from retinal ganglion cells, and studying the thermodynamics of the inferred model, reveals a peak in specific heat reminiscent of a second-order phase transition.
Full Text Available Controversial results have been reported concerning the neural mechanisms involved in the processing of rewards and punishments. On the one hand, there is evidence suggesting that monetary gains and losses activate a similar fronto-subcortical network. On the other hand, results of recent studies imply that reward and punishment may engage distinct neural mechanisms. Using functional magnetic resonance imaging we investigated both regional and interregional functional connectivity patterns while participants performed a gambling task featuring unexpectedly high monetary gains and losses. Classical univariate statistical analysis showed that monetary gains and losses activated a similar fronto-striatal-limbic network, in which main activation peaks were observed bilaterally in the ventral striatum. Functional connectivity analysis showed similar responses for gain and loss conditions in the insular cortex, the amygdala, and the hippocampus that correlated with the activity observed in the seed region ventral striatum, with the connectivity to the amygdale appearing more pronounced after losses. Larger functional connectivity was found to the medial OFC for negative outcomes. The fact that different functional patterns were obtained with both analyses suggests that the brain activations observed in the classical univariate approach identifies the involvement of different functional networks in a current task. These results stress the importance of studying functional connectivity in addition to standard fMRI analysis in reward-related studies.
Blood, Anne J.; Zatorre, Robert J.
We used positron emission tomography to study neural mechanisms underlying intensely pleasant emotional responses to music. Cerebral blood flow changes were measured in response to subject-selected music that elicited the highly pleasurable experience of “shivers-down-the-spine” or “chills.” Subjective reports of chills were accompanied by changes in heart rate, electromyogram, and respiration. As intensity of these chills increased, cerebral blood flow increases a...
Kini, Prathik; Wong, Joel; McInnis, Sydney; Gabana, Nicole; Brown, Joshua W
Gratitude is a common aspect of social interaction, yet relatively little is known about the neural bases of gratitude expression, nor how gratitude expression may lead to longer-term effects on brain activity. To address these twin issues, we recruited subjects who coincidentally were entering psychotherapy for depression and/or anxiety. One group participated in a gratitude writing intervention, which required them to write letters expressing gratitude. The therapy-as-usual control group did not perform a writing intervention. After three months, subjects performed a "Pay It Forward" task in the fMRI scanner. In the task, subjects were repeatedly endowed with a monetary gift and then asked to pass it on to a charitable cause to the extent they felt grateful for the gift. Operationalizing gratitude as monetary gifts allowed us to engage the subjects and quantify the gratitude expression for subsequent analyses. We measured brain activity and found regions where activity correlated with self-reported gratitude experience during the task, even including related constructs such as guilt motivation and desire to help as statistical controls. These were mostly distinct from brain regions activated by empathy or theory of mind. Also, our between groups cross-sectional study found that a simple gratitude writing intervention was associated with significantly greater and lasting neural sensitivity to gratitude - subjects who participated in gratitude letter writing showed both behavioral increases in gratitude and significantly greater neural modulation by gratitude in the medial prefrontal cortex three months later. PMID:26746580
Jaramillo, Santiago; Pearlmutter, Barak A.
Neuronal activity in response to a fixed stimulus has been shown to change as a function of attentional state, implying that the neural code also changes with attention. We propose an information-theoretic account of such modulation: that the nervous system adapts to optimally encode sensory stimuli while taking into account the changing relevance of different features. We show using computer simulation that such modulation emerges in a coding system informed about the uneven relevance of ...
Considering the difficulty of creating water quality model for activated sludge system, a typical BP artificial neural network model has been established to simulate the operation of a waste water treatment facilities. The comparison of prediction results with the on-spot measurements shows the model, the model is accurate and this model can also be used to realize intelligentized on-line control of the wastewater processing process.
Jennifer L Ariansen
Full Text Available Dopamine projections that extend from the ventral tegmental area to the striatum have been implicated in the biological basis for behaviors associated with reward and addiction. Until recently, it has been difficult to evaluate the complex balance of energy utilization and neural activity in the striatum. Many techniques such as electrophysiology, functional magnetic resonance imaging (fMRI, and fast-scan cyclic voltammetry have been employed to monitor these neurochemical and neurophysiological changes. In this brain region, physiological responses to cues and rewards cause local, transient pH changes. Oxygen and pH are coupled in the brain through a complex system of blood flow and metabolism as a result of transient neural activity. Indeed, this balance is at the heart of imaging studies such as fMRI. To this end, we measured pH and O2 changes with fast-scan cyclic voltammetry in the striatum as indices of changes in metabolism and blood flow in vivo in three Macaca mulatta monkeys. The animals were presented with Pavlovian conditioned cues that predicted different probabilities of liquid reward. They also received free reward without predictive cues. The primary change consisted of pH shifts in the striatal extracellular environment following the reward predicting cues or the free reward. We observed three types of cue responses which consisted of purely basic pH shifts, basic pH shifts followed by acidic pH shifts, and purely acidic pH shifts. These responses increased with reward probability. The pH changes were accompanied by increases in extracellular O2. The changes in pH and extracellular O2 are consistent with current theories of metabolism and blood flow. The findings suggest a role of these chemical responses in neuronal reward processing
Benjamin I Rapoport
Full Text Available The ability to decode neural activity into meaningful control signals for prosthetic devices is critical to the development of clinically useful brain- machine interfaces (BMIs. Such systems require input from tens to hundreds of brain-implanted recording electrodes in order to deliver robust and accurate performance; in serving that primary function they should also minimize power dissipation in order to avoid damaging neural tissue; and they should transmit data wirelessly in order to minimize the risk of infection associated with chronic, transcutaneous implants. Electronic architectures for brain- machine interfaces must therefore minimize size and power consumption, while maximizing the ability to compress data to be transmitted over limited-bandwidth wireless channels. Here we present a system of extremely low computational complexity, designed for real-time decoding of neural signals, and suited for highly scalable implantable systems. Our programmable architecture is an explicit implementation of a universal computing machine emulating the dynamics of a network of integrate-and-fire neurons; it requires no arithmetic operations except for counting, and decodes neural signals using only computationally inexpensive logic operations. The simplicity of this architecture does not compromise its ability to compress raw neural data by factors greater than [Formula: see text]. We describe a set of decoding algorithms based on this computational architecture, one designed to operate within an implanted system, minimizing its power consumption and data transmission bandwidth; and a complementary set of algorithms for learning, programming the decoder, and postprocessing the decoded output, designed to operate in an external, nonimplanted unit. The implementation of the implantable portion is estimated to require fewer than 5000 operations per second. A proof-of-concept, 32-channel field-programmable gate array (FPGA implementation of this portion
Novak, Brittni K; Novak, Keisha D; Lynam, Donald R; Foti, Dan
Reward dysfunction has been implicated in a wide range of psychological disorders, including internalizing and externalizing psychopathology. Basic neuroscience research has shown that reward is a multistage process, yet it is unclear how specific stages relate to individual differences in reward sensitivity. The current study utilized event-related potentials elicited during a monetary incentive task to parse sub-stages within anticipatory and consummatory reward processing. Effects of depressive symptoms and trait impulsivity were examined at each sub-stage (N=92). Reward anticipation modulated neural activity across three sub-stages: cue detection (cue-P3), approach behavior (contingent negative variation, CNV), and outcome anticipation (stimulus preceding negativity). Reward delivery modulated activity across two sub-stages: initial evaluation (reward positivity, RewP), and allocation of attention (feedback-P3). Sensation seeking predicted faster reaction times, as well as cue-P3 and RewP amplitudes. Depression and lack of premeditation interacted to predict CNV and RewP amplitudes. Results demonstrate that individual differences in reward functioning are stage-specific. PMID:27396750
A. David Redish
Full Text Available Flexible decision-making strategies (such as planning are a key component of adaptive behavior, yet their neural mechanisms have remained resistant to experimental analysis. Theories of planning require prediction and evaluation of potential future rewards, suggesting that reward signals may covertly appear at decision points. To test this idea, we recorded ensembles of ventral striatal neurons on a spatial decision task, in which hippocampal ensembles are known to represent future possibilities at decision points. We found representations of reward which were not only activated at actual reward delivery sites, but also at a high-cost choice point and before error correction. This expectation-of-reward signal at decision points was apparent at both the single cell and the ensemble level, and vanished with behavioral automation. We conclude that ventral striatal representations of reward are more dynamic than suggested by previous reports of reward- and cue-responsive cells, and may provide the necessary signal for evaluation of internally generated possibilities considered during flexible decision-making.
Morgan, Judith K; Shaw, Daniel S; Forbes, Erika E
Withdrawal from peers during childhood may reflect disruptions in reward functioning that heighten vulnerability to affective disorders during adolescence. The association between socially withdrawn behavior and reward functioning may depend on traits that influence this withdrawal, such as fearfulness or unsociability. In a study of 129 boys, we evaluated how boys' fearfulness and sociability at age 5 and social withdrawal at school at ages 6 to 10 and during a summer camp at age 9/10 were associated with their neural response to reward at age 20. Greater social withdrawal during childhood was associated with heightened striatal and mPFC activation when anticipating rewards at age 20. Fearfulness moderated this effect to indicate that social withdrawal was associated with heightened reward-related response in the striatum for boys high on fearfulness. Altered striatal response associated with social withdrawal and fearfulness predicted greater likelihood to have a lifetime history of depression and social phobia at age 20. These findings add greater specificity to previous findings that children high in traits related to fear of novelty show altered reward responses, by identifying fearfulness (but not low levels of sociability) as a potential underlying mechanism that contributes to reward alterations in withdrawn children. PMID:25193948
Saori C Tanaka
Full Text Available BACKGROUND: The ability to select an action by considering both delays and amount of reward outcome is critical for maximizing long-term benefits. Although previous animal experiments on impulsivity have suggested a role of serotonin in behaviors requiring prediction of delayed rewards, the underlying neural mechanism is unclear. METHODOLOGY/PRINCIPAL FINDINGS: To elucidate the role of serotonin in the evaluation of delayed rewards, we performed a functional brain imaging experiment in which subjects chose small-immediate or large-delayed liquid rewards under dietary regulation of tryptophan, a precursor of serotonin. A model-based analysis revealed that the activity of the ventral part of the striatum was correlated with reward prediction at shorter time scales, and this correlated activity was stronger at low serotonin levels. By contrast, the activity of the dorsal part of the striatum was correlated with reward prediction at longer time scales, and this correlated activity was stronger at high serotonin levels. CONCLUSIONS/SIGNIFICANCE: Our results suggest that serotonin controls the time scale of reward prediction by differentially regulating activities within the striatum.
Rewards can reinforce and at the same time forestall young children's willingness to learn. However, they are broadly used in the field of education, especially in early years settings, to stimulate children towards learning activities. This paper reviews the theoretical and research literature related to intrinsic and extrinsic motivational…
Zhang, Jin-Tao; Yao, Yuan-Wei; Potenza, Marc N; Xia, Cui-Cui; Lan, Jing; Liu, Lu; Wang, Ling-Jiao; Liu, Ben; Ma, Shan-Shan; Fang, Xiao-Yi
Internet gaming disorder (IGD) has become a serious mental health issue worldwide. Evaluating the benefits of interventions for IGD is of great significance. Thirty-six young adults with IGD and 19 healthy comparison (HC) subjects were recruited and underwent resting-state fMRI scanning. Twenty IGD subjects participated in a group craving behavioral intervention (CBI) and were scanned before and after the intervention. The remaining 16 IGD subjects did not receive an intervention. The results showed that IGD subjects showed decreased amplitude of low fluctuation in the orbital frontal cortex and posterior cingulate cortex, and exhibited increased resting-state functional connectivity between the posterior cingulate cortex and dorsolateral prefrontal cortex, compared with HC subjects. Compared with IGD subjects who did not receive the intervention, those receiving CBI demonstrated significantly reduced resting-state functional connectivity between the: (1) orbital frontal cortex with hippocampus/parahippocampal gyrus; and, (2) posterior cingulate cortex with supplementary motor area, precentral gyrus, and postcentral gyrus. These findings suggest that IGD is associated with abnormal resting-state neural activity in reward-related, default mode and executive control networks. Thus, the CBI may exert effects by reducing interactions between regions within a reward-related network, and across the default mode and executive control networks. PMID:27381822
Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme
The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills. PMID:25447993
目的 以国内外2005～2014年发表的针对与决策机制有关的关于奖赏、损失的神经结构及环路,及其与某些身心疾病关系的文献,综述决策奖损加工的脑神经结构及其意义,可以在一定程度上揭示行为决策的神经结构和网络机制,及其与某些身心疾病的关系.方法 2014年9月在PubMed、Science-Direct、中国知网和万方数据库等数据库,以“决策”、“奖赏”、“损失规避”等检索词,检索国内外有关决策奖损加工相关脑神经结构,及其与某些身心疾病的关系的研究.结果 检索文献110篇,纳入分析40篇.结果总结了大脑奖损结构及其关系在决策加工过程中的作用机制,以及两系统失衡所导致的身心疾病.结论 大部分文献认为奖赏趋近系统和损失规避系统的协调加工共同影响人们的行为决策,一旦上述系统平衡失调,则可出现行为决策障碍,产生一些身心疾病,但与决策行为模式相关的精确的神经机制尚须进一步研究.%Objective Based on the literatures published between 2005 and 2014,review the correlation between reward/loss of brain structure and neural network,and its relationship with physical and mental ailments,aim to reveal the neural structure and network of behavioral decision mechanism.Methods By retrieving literatures on PubMed,ScienceDirect,CNKI and Wanfang database in September 2014,we used "decision making","reward","loss aversion" and so on as the key words.Results Totally 40 papers were enrolled,the result reviewed the clinic meaning and the brain structure and neural network of the reward/loss process in decision making.Conclusion Most studies found the reward/loss decision making mechanism of the brain structure and the physical and mental ailments caused by the two systems imbalance,but related to the precise decision making neural mechanism has yet to be studied further.
Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I
Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). PMID:27246519
Gore, Felicity; Schwartz, Edmund C; Salzman, C Daniel
Understanding brain function requires knowing both how neural activity encodes information and how this activity generates appropriate responses. Electrophysiological, imaging and immediate early gene immunostaining studies have been instrumental in identifying and characterizing neurons that respond to different sensory stimuli, events and motor actions. Here we highlight approaches that have manipulated the activity of physiologically classified neurons to determine their role in the generation of behavioural responses. Previous experiments have often exploited the functional architecture observed in many cortical areas, where clusters of neurons share response properties. However, many brain structures do not exhibit such functional architecture. Instead, neurons with different response properties are anatomically intermingled. Emerging genetic approaches have enabled the identification and manipulation of neurons that respond to specific stimuli despite the lack of discernable anatomical organization. These approaches have advanced understanding of the circuits mediating sensory perception, learning and memory, and the generation of behavioural responses by providing causal evidence linking neural response properties to appropriate behavioural output. However, significant challenges remain for understanding cognitive processes that are probably mediated by neurons with more complex physiological response properties. Currently available strategies may prove inadequate for determining how activity in these neurons is causally related to cognitive behaviour. PMID:26240431
Peterson, E. J.; Tyler, D. J.
Objective. Localized activation of peripheral axons may improve selectivity of peripheral nerve interfaces. Infrared neural stimulation (INS) employs localized delivery to activate neural tissue. This study investigated INS to determine whether localized delivery limited functionality in larger mammalian nerves. Approach. The rabbit sciatic nerve was stimulated extraneurally with 1875 nm wavelength infrared light, electrical stimulation, or a combination of both. Infrared-sensitive regions (ISR) of the nerve surface and electromyogram (EMG) recruitment of the Medial Gastrocnemius, Lateral Gastrocnemius, Soleus, and Tibialis Anterior were the primary output measures. Stimulation applied included infrared-only, electrical-only, and combined infrared and electrical. Main results. 81% of nerves tested were sensitive to INS, with 1.7 ± 0.5 ISR detected per nerve. INS was selective to a single muscle within 81% of identified ISR. Activation energy threshold did not change significantly with stimulus power, but motor activation decreased significantly when radiant power was decreased. Maximum INS levels typically recruited up to 2-9% of any muscle. Combined infrared and electrical stimulation differed significantly from electrical recruitment in 7% of cases. Significance. The observed selectivity of INS indicates that it may be useful in augmenting rehabilitation, but significant challenges remain in increasing sensitivity and response magnitude to improve the functionality of INS.
Thompson, Alexander C; Fallon, James B; Wise, Andrew K; Wade, Scott A; Shepherd, Robert K; Stoddart, Paul R
At present there is some debate as to the processes by which infrared neural stimulation (INS) activates neurons in the cochlea, as the lasers used for INS can potentially generate a range of secondary stimuli e.g. an acoustic stimulus is produced when the light is absorbed by water. To clarify whether INS in the cochlea requires functioning hair cells and to explore the potential relevance to cochlear implants, experiments using INS were performed in the cochleae of both normal hearing and profoundly deaf guinea pigs. A response to laser stimulation was readily evoked in normal hearing cochlea. However, no response was evoked in any profoundly deaf cochleae, for either acute or chronic deafening, contrary to previous work where a response was observed after acute deafening with ototoxic drugs. A neural response to electrical stimulation was readily evoked in all cochleae after deafening. The absence of a response from optical stimuli in profoundly deaf cochleae suggests that the response from INS in the cochlea is hair cell mediated. PMID:25796297
Full Text Available This paper presents a method for identifying human stress levels by using a Kohonen neural network. The study focuses on differentiating between a relaxed and a stressed state and it presents a series of parameters (skin conductance response signal power, skin conductance response signal frequency, skin conductance level gradient, response rise time and response amplitude extracted only from the electrodermal activity signal. A very strict recording protocol was used to minimize the artifacts caused by the bad connection between electrodes and skin. A stress inducing method is presented that can be used to replicate results in laboratory conditions.
Ma, Yina; Bang, Dan; Wang, Chenbo;
Chinese than in Danish participants. Moreover, the group difference in TPJ activity was mediated by a measure of a cultural value (i.e., interdependence of self-construal). Our findings suggest that individuals in different sociocultural contexts may learn and/or adopt distinct strategies for self......Western cultures encourage self-construals independent of social contexts whereas East Asian cultures foster interdependent self-construals that rely on how others perceive the self. How are culturally specific self-construals mediated by the human brain? Using functional MRI, we monitored neural......-reflection by changing the weight of the mPFC and TPJ in the social brain network....
Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik
Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects. PMID:25799565
Full Text Available Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15 and in healthy control subjects (n = 15 with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.
Karasinska, Joanna M; George, Susan R; Cheng, Regina; O'Dowd, Brian F
Co-localization of dopamine D1 and D3 receptors in striatal neurons suggests that these two receptors interact at a cellular level in mediating dopaminergic function including psychostimulant-induced behaviour. To study D1 and D3 receptor interactions in cocaine-mediated effects, cocaine-induced locomotion and reward in mice lacking either D1, D3 or both receptors were analysed. Spontaneous locomotor activity was increased in D1-/- and D1-/-D3-/- mice and D1-/-D3-/- mice did not exhibit habituation of spontaneous rearing activity. Cocaine (20 mg/kg) increased locomotor activity in wild-type and D3-/- mice, failed to stimulate activity in D1-/- mice and reduced activity in D1-/-D3-/- mice. In the conditioned place preference, all groups exhibited reward at 5, 10 and 20 mg/kg of cocaine. D1-/-D3-/- mice did not demonstrate preference at 2.5 mg/kg of cocaine although preference was observed in wild-type, D1-/- and D3-/- mice. The transcription factor cAMP-responsive element binding protein (CREB) is activated by phosphorylation in striatal regions following dopamine receptor activation. Striatal pCREB levels following acute cocaine were increased in wild-type and D3-/- mice and decreased in D1-/- and D1-/-D3-/- mice. After repeated administration of 2.5 mg/kg of cocaine, D1-/- mice had lower pCREB levels in caudate-putamen and nucleus accumbens. Our findings suggest that, although spontaneous and cocaine-induced horizontal activity depended mainly on the presence of the D1 receptor, there may be crosstalk between D1 and D3 receptors in rearing habituation and the perception of cocaine reward at low doses of the drug. Furthermore, alterations in pCREB levels were associated with changes in cocaine-induced locomotor activity but not reward. PMID:16197514
Full Text Available Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question.